In Amazon S3, buckets
and objects
are the primary resources, and objects are stored in buckets.
Amazon S3 has a flat structure
instead of a hierarchy like you would see in a file system.
However, for the sake of organizational simplicity, the Amazon S3 console supports the folder concept as a means of grouping objects.
Amazon S3 does this by using a shared name prefix
for objects (that is, objects have names that begin with a common string). Object names are also referred to as key names
.
Object key is the unique identifier for an object within a bucket. It is similar to a file path in a file system.
The key enables you to retrieve the object from the bucket.
Development/Projects.xls
Finance/statement1.pdf
Private/taxdocument.pdf
s3-dg.pdf
A few attributes come with the S3 object that can be used to parse the object.
For example, a file type can be extracted by referencing the metadata
attribute.
S3.Object.metadata
Download entire S3 bucket using AWS CLI
aws s3 sync s3://<MY-BUCKET> .