s3cmd


S3cmd is a command line tool for uploading, retrieving and managing data in storage services that are compatible with the Amazon Simple Storage Service (S3) protocol, including S3 itself. It supports rsync-like backup, GnuPG encryption, and more. It also supports management of Amazon's CloudFront content delivery network.

Wikipedia


Installation

guix package -i python2-s3cmd

Usage

I usually use this to verify S3 credentials, but of course you can do much more with this.

List files in a bucket

Amazon S3

s3cmd \
--access_key=ABC \
--secret_key=ABC \
--region=eu-central-1 \
ls s3://your-bucket-url

Wasabi S3

s3cmd \
--access_key=ABC \
--secret_key=ABC \
--region=eu-central-1 \
--host=s3.eu-central-1.wasabisys.com \
--host-bucket="%(bucket)s.s3.wasabisys.com" \
ls s3://your-bucket-url

When you’re working with Wasabi instead of Amazon AWS, make sure you include these:

--host=s3.eu-central-1.wasabisys.com
--host-bucket="%(bucket)s.s3.wasabisys.com"

Other regions include:

  • Wasabi US East 1 (N. Virginia): s3.wasabisys.com or s3.us-east-1.wasabisys.com
  • Wasabi US East 2 (N. Virginia): s3.us-east-2.wasabisys.com
  • Wasabi US Central 1 (Texas): s3.us-central-1.wasabisys.com
  • Wasabi US West 1 (Oregon): s3.us-west-1.wasabisys.com
  • Wasabi EU Central 1 (Amsterdam): s3.eu-central-1.wasabisys.com

Download all files from S3 bucket:

s3cmd get \
--access_key=ABC \
--secret_key=ABC \
--region=eu-central-1 \
--recursive s3://your-bucket-url \
your-local-folder

Upload a file to S3 bucket:

s3cmd put \
--access_key=ABC \
--secret_key=ABC \
--region=eu-central-1 \
your-local.file \
s3://your-bucket-url

Example:

s3cmd put \
--access_key=AASCDNPYDWSKWISAAS \
--secret_key=TXVAWbVKaCVARwxSDDAcOPLa12EodHTADUzu \
--region=eu-central-1 \
large-file.tar.xz \
s3://my-s3-bucket.org

Upload all files to S3 bucket:

s3cmd put \
--access_key=ABC \
--secret_key=ABC \
--region=eu-central-1 \
--recursive your-local-folder/ \
s3://your-bucket-url

See also

PantherX & (unofficial) GNU Guix Wiki.

Last update: 2024-04-21 10:28:03 +0000 | Apache-2.0

Inspired by the excellent Arch Linux Wiki