Object Storage Tools

s3cmd

S3cmd is a command-line tool for managing data in Amazon Simple Storage Service (S3). It is a free and open-source tool that is available for Linux, macOS, and Windows.

For more information, see https://docs.e-infra.cz/storage/object-storage/s3cmd/.

We recommend using the S3cmd tool already installed on Karolina.

How to Load Modules:

To see loaded modules, use:

ml

To load modules, use:

ml s3cmd

To see module info, use:

ml spider s3cmd

For more information on how to work with modules, see https://docs.it4i.cz/software/modules/lmod/.

Configuration

The s3cmd configuration file is named .s3cfg and it is located in the user’s home directory, e.g. /home/username/($HOME).

The configuration file has to be created first:

s3cmd --configure

For configuration steps, follow the e-INFRA CZ guide.

For the list of basic S3cmd commands, see https://docs.e-infra.cz/storage/object-storage/s3cmd/#basic-s3cmd-commands.

FAQ

Error when creating bucket:

ERROR: S3 error: 400 (InvalidLocationConstraint): The specified location-constraint is not valid

Solution: set location:

s3cmd --bucket-location=":default-placement" mb s3://newbucketname

Useful Links

• Introduction
• Usage
• Common S3cmd Errors
• Configuration erros