S3 - Directory Bucket

 

Directory buckets organize data hierarchically into directories as opposed to the flat storage structure of general purpose buckets.

There aren't prefix limits for directory buckets, and individual directories can scale horizontally.

Directory buckets support bucket creation in the following bucket location types: Availability Zone or Local Zone.

For low latency use cases, you can create a directory bucket in a single Availability Zone to store data.

Amazon S3 Express One Zone is a high-performance, single-zone Amazon S3 storage class that is purpose-built to deliver consistent, single-digit millisecond data access for your most latency-sensitive applications. 

S3 Express One Zone is the lowest latency cloud-object storage class available today, with data access speeds up to 10x faster and with request costs 50 percent lower than S3 Standard.

With S3 Express One Zone, your data is redundantly stored on multiple devices within a single Availability Zone. 

You can access S3 Express One Zone from your VPC by using gateway VPC endpoints.

After you create a gateway endpoint, you can add it as a target in your route table for traffic destined from your VPC to S3 Express One Zone.

Let's start with creating a directory bucket:

Working with directory bucket using AWS S3API commands.

Listing the directory buckets using “aws s3api list” command.

List objects from a directory bucket.

Copy objects from a directory bucket:

Mounting directory bucket.

Install the mount-s3 package.

We have mounted. Directory buckets follow traditional hierarchy architecture it can be mounted. But it cannot be mounted as NFS.

Creating files under mounted S3 bucket.

Verify those objects under the bucket.

Directory buckets do not have options like General purpose buckets like:

1)    Versioning.

2)    Object locking.

3)    Current and Non-current versions.

4)     No Replications.

5)    Lifecycle rules can be set via CLI/SDK. However, S3 Lifecycle for directory buckets doesn't support transition actions between storage classes.

6)    Lifecycle uses public DeleteObject and DeleteObjects API operations to expire objects in directory buckets. 

NOTE: Directory buckets are costlier than General purpose buckets