Homec4science
Diffusion YCSB (async) Browse

R7507/s3/README.md
d56c29b050fbasync

Last Change
Raw File

README.md
View Options

<!--
Copyright (c) 2015 YCSB contributors. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you
may not use this file except in compliance with the License. You
may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied. See the License for the specific language governing
permissions and limitations under the License. See accompanying
LICENSE file.
-->
Quick Start
===============
### 1. Set Up YCSB
Download the YCSB from this website:
https://github.com/brianfrankcooper/YCSB/releases/
You can choose to download either the full stable version or just one of the available binding.
### 2. Configuration of the AWS credentials
The access key ID and secret access key as well as the endPoint and region and the Client configurations like the maxErrorRetry can be set in a properties file under s3-binding/conf/s3.properties or sent by command line (see below).
It is highly suggested to use the property file instead of to send the credentials through the command line.
### 3. Run YCSB
To execute the benchmark using the S3 storage binding, first files must be uploaded using the "load" option with this command:
./bin/ycsb load s3 -p table=theBucket -p s3.endPoint=s3.amazonaws.com -p s3.accessKeyId=yourAccessKeyId -p s3.secretKey=yourSecretKey -p fieldlength=10 -p fieldcount=20 -P workloads/workloada
With this command, the workload A will be executing with the loading phase. The file size is determined by the number of fields (fieldcount) and by the field size (fieldlength). In this case each file is 200 bytes (10 bytes for each field multiplied by 20 fields).
Running the command:
./bin/ycsb -t s3 -p table=theBucket -p s3.endPoint=s3.amazonaws.com -p s3.accessKeyId=yourAccessKeyId -p s3.secretKey=yourSecretKey -p fieldlength=10 -p fieldcount=20 -P workloads/workloada
the workload A will be executed with file size 200 bytes.
#### S3 Storage Configuration Parameters
The parameters to configure the S3 client can be set using the file "s3-binding/conf/s3.properties". This is highly advisable for the parameters s3.accessKeyId and s3.secretKey. All the other parameters can be set also on the command line. Here the list of all the parameters that is possible to configure:
- `table`
- This should be a S3 Storage bucket name and it replace the standard table name assigned by YCSB.
- `s3.endpoint`
- This indicate the endpoint used to connect to the S3 Storage service.
- Default value is `s3.amazonaws.com`.
- `s3.region`
- This indicate the region where your buckets are.
- Default value is `us-east-1`.
- `s3.accessKeyId`
- This is the accessKey of your S3 account.
- `s3.secretKey`
- This is the secret associated with your S3 account.
- `s3.maxErrorRetry`
- This is the maxErrorRetry parameter for the S3Client.
- `s3.protocol`
- This is the protocol parameter for the S3Client. The default value is HTTPS.
- `s3.sse`
- This parameter set to true activates the Server Side Encryption.
- `s3.ssec`
- This parameter if not null activates the SSE-C client side encryption. The value passed with this parameter is the client key used to encrpyt the files.
c4science · Help