Posts

Showing posts from February, 2024

AWS - S3 Multi Region Access Point

Image
  Amazon S3 Multi-Region Access Points provide a global endpoint that applications can use to fulfill requests from S3 buckets that are located in multiple AWS Regions. You can use Multi-Region Access Points to build multi-Region applications with the same architecture that's used in a single Region, and then run those applications anywhere in the world.  Let's get started. I am going to create 2 buckets each under a different region. Next, We need to create a multi-regional access point with the 2 buckets. Next, We need to configure bi-directional replication between the buckets. This replication can be configured from the Multi-Region Access Point.  If the buckets are configured using AWS KMS, then the replication has to be configured manually.  Now, We have the replication configured. And we need to setup failover configuration. There are 2 configurations:  1) ACTIVE-ACTIVE. 2) ACTIVE-PASSIVE. I am going to set up ACTIVE-PASSIVE. Next comes the IAM. To access...

AWS S3 - Batch Operations

Image
  In this post, we will see how to use batch replication - S3.  A job is used to execute batch operations on a list of S3 objects. The list of S3 objects is contained in a manifest object, which can be an S3 inventory report or a list of objects that you generate. After the total number of objects listed in the manifest has been confirmed, the job status will update to Awaiting your confirmation to run, and you must Run the job within 30 days. I am going to create a replication job to tag the existing objects in the bucket. NOTE: The batch job relies on manifest.json which is an inventory of objects. This can be collected from bucket management. It takes 48 hrs to get the first inventory created. Let's create a batch job. Select the location were the manifest.json is created. I am to create tags for all the objects. Next, the critical portion is assigning the correct IAM role for the batch to perform action. I created a role with S3 full access. Please refer to the link for th...

AWS S3 - Access Point

Image
  Amazon S3 access points simplify data access for any AWS service or customer application that stores data in S3. Access points are named network endpoints that are attached to buckets that you can use to perform S3 object operations, such as  GetObject  and  PutObject . Each access point has distinct permissions and network controls that S3 applies for any request that is made through that access point. Each access point enforces a customized access point policy that works in conjunction with the bucket policy that is attached to the underlying bucket.  This is what we are trying to implement. The user will have an inline policy to perform GET/PUT object operation on the ACCESS POINT. To create an access point. I am creating the access point origin as "VPC", which means it's accessible only from VPC. So, for testing, I will be performing all actions from the EC2 instance. Next, updated the access point policy which allows access only for the user I created "u...

AWS Event Bridge Rule

Image
  Amazon EventBridge Event Bus is a serverless event bus that helps you receive, filter, transform, route, and deliver events. We will configure s3 event notifications for any new objects created, delete, and trigger mail alerts. Steps: 1) Create a SNS topic and confirm subscription with the mail ID. 2) Enable event bridge notification for the bucket. 3) Create an event bridge rule for the S3 event Object created and deleted. Creating SNS topic and subscription. Next, We will create an event bridge rule. Enable event bridge notification for the bucket. Let’s test by deleting object from the bucket. It worked.