ShellHacks

Amazon S3 has a built-in versioning solution (can be enabled in the bucket’s properties tab), that helps to track all the changes that me make to the files hosted in an S3 bucket.

In this note i will show how to list all the versions of an object (file) stored in an S3 bucket and how to download the specific version of an object. (more…)

Once you run some command in the AWS CLI, for example aws s3 ls, you may get the error as follows:

SSL validation failed for <endpoint_url> [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed

To work around the issue you can add the --no-verify-ssl option to the AWS CLI:

$ aws s3 ls --no-verify-ssl

But this is not secure and will cause the following warning:

InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings

Cool Tip: How to get an SSL certificate from a server (site’s URL)! Read more →

AWS CLI: SSL Validation Failed

To use the AWS CLI with HTTPS certificate verification, it is required to specify the path to a custom certificate bundle.

This can be done by setting the AWS_CA_BUNDLE environment variable.

Linux:
$ export AWS_CA_BUNDLE="/data/ca-certs/ca-bundle.pem"

Windows:
PS C:\> setx AWS_CA_BUNDLE C:\data\ca-certs\ca-bundle.pem

Or by using the --ca-bundle command-line parameter:

$ aws s3 ls --ca-bundle "/data/ca-certs/ca-bundle.pem"

Or by setting the ca_bundle in the AWC CLI configuration file:

$ nano ~/aws/.config
$ cat ~/aws/.config
[default]
ca_bundle = /data/ca-certs/ca-bundle.pem

The AWS CLI is a tool for managing the AWS services from the command-line.

The easiest way to install the AWS CLI on Ubuntu is to get it from the official repository but the version you will get will be much older than the latest one.

In this note i will show how to install the latest version or any specific version of AWS CLI on Linux. (more…)

Amazon Simple Storage Service (S3) stores data as objects within resources called buckets.

Each Amazon S3 object consist of a key (file name), data and metadata that describes this object.

Amazon S3 lets you store and retrieve data via API over HTTPS using the AWS command-line interface (CLI).

In this note i will show how to list Amazon S3 buckets and objects from the AWS CLI using the aws s3 ls command. (more…)