Buckets and objects concept in AWS - Mini Project: Build & Apply

Buckets and Objects Concept

📖 Scenario: You are working as a cloud engineer for a small company. Your task is to create a storage bucket and upload files (objects) to it. This will help the company store and organize their documents safely in the cloud.

🎯 Goal: Build a simple AWS S3 bucket and add objects (files) to it using configuration code. This project will teach you how to create buckets and upload objects step-by-step.

📋 What You'll Learn

Create an S3 bucket with a specific name

Add a configuration variable for the bucket region

Upload two objects (files) to the bucket with exact keys and content

Set the bucket to block all public access

💡 Why This Matters

🌍 Real World

Cloud storage buckets are used by companies to store files safely and organize data in the cloud. Blocking public access helps keep data private.

💼 Career

Knowing how to create and configure buckets and objects is a fundamental skill for cloud engineers and DevOps professionals working with AWS.

1

Create an S3 bucket

Create an AWS S3 bucket resource named my_bucket with the bucket name my-company-docs.

AWS

# Create an S3 bucket resource named my_bucket with bucket = "my-company-docs"
# Your code here

Hint

Use the aws_s3_bucket resource and set the bucket attribute to the exact name.

2

Add a bucket region variable

Create a variable named bucket_region with the default value us-east-1 to specify the AWS region for the bucket.

AWS

resource "aws_s3_bucket" "my_bucket" {
  bucket = "my-company-docs"
}

# Create a variable bucket_region with default "us-east-1"
# Your code here

Hint

Define a variable block with the name bucket_region and set its default to us-east-1.

3

Upload objects to the bucket

Create two aws_s3_bucket_object resources named doc1 and doc2. Upload files with keys report.txt and summary.txt to the bucket my_bucket. Set the content of report.txt to Annual Report 2024 and summary.txt to Summary of Q1.

AWS

resource "aws_s3_bucket" "my_bucket" {
  bucket = "my-company-docs"
}

variable "bucket_region" {
  default = "us-east-1"
}

# Create aws_s3_bucket_object doc1 with key "report.txt" and content "Annual Report 2024"
# Create aws_s3_bucket_object doc2 with key "summary.txt" and content "Summary of Q1"
# Your code here

Hint

Use aws_s3_bucket_object resource with bucket set to aws_s3_bucket.my_bucket.bucket. Set key and content exactly as instructed.

4

Block all public access to the bucket

Add a aws_s3_bucket_public_access_block resource named block_public to block all public access on the bucket my_bucket. Set block_public_acls, block_public_policy, ignore_public_acls, and restrict_public_buckets all to true.

AWS

resource "aws_s3_bucket" "my_bucket" {
  bucket = "my-company-docs"
}

variable "bucket_region" {
  default = "us-east-1"
}

resource "aws_s3_bucket_object" "doc1" {
  bucket  = aws_s3_bucket.my_bucket.bucket
  key     = "report.txt"
  content = "Annual Report 2024"
}

resource "aws_s3_bucket_object" "doc2" {
  bucket  = aws_s3_bucket.my_bucket.bucket
  key     = "summary.txt"
  content = "Summary of Q1"
}

# Add aws_s3_bucket_public_access_block block_public to block all public access
# Your code here

Hint

Use the aws_s3_bucket_public_access_block resource with all four public access block settings set to true.

Practice

1. What is a bucket in AWS S3?

easy

A. A network firewall

B. A type of virtual machine

C. A database for storing records

D. A container to store files (objects) in the cloud

Solution

1. Step 1: Understand AWS S3 storage structure

   AWS S3 stores data in containers called buckets.

2. Step 2: Define bucket role

   Buckets hold objects, which are files uploaded by users.

3. Final Answer:

   A container to store files (objects) in the cloud -> Option D

4. Quick Check:

   Bucket = container for objects [OK]

Hint: Buckets hold files; think of them as folders [OK]

Common Mistakes:

• Confusing buckets with virtual machines
• Thinking buckets are databases
• Mixing buckets with network components

2. Which of the following is the correct way to upload an object to an S3 bucket using AWS CLI?

easy

A. aws s3 cp file.txt s3://mybucket/

B. aws s3 upload file.txt s3://mybucket/

C. aws s3 put file.txt s3://mybucket/

D. aws s3 add file.txt s3://mybucket/

Solution

1. Step 1: Recall AWS CLI command for uploading files

   The correct command to upload files is 'aws s3 cp'.

2. Step 2: Check other options

   'upload', 'put', and 'add' are not valid AWS CLI commands for S3.

3. Final Answer:

   aws s3 cp file.txt s3://mybucket/ -> Option A

4. Quick Check:

   Use 'cp' to copy/upload files [OK]

Hint: Use 'aws s3 cp' to upload files [OK]

Common Mistakes:

• Using 'upload' instead of 'cp'
• Confusing 'put' with AWS CLI commands
• Trying non-existent commands like 'add'

3. Given the following AWS CLI command:
aws s3 ls s3://mybucket/
What will this command do?

medium

A. List all objects inside the bucket named 'mybucket'

B. Delete the bucket named 'mybucket'

C. Create a new bucket named 'mybucket'

D. Upload files to the bucket named 'mybucket'

Solution

1. Step 1: Understand the 'aws s3 ls' command

   This command lists contents of a bucket or buckets.

2. Step 2: Analyze the command target

   Since it targets 's3://mybucket/', it lists objects inside that bucket.

3. Final Answer:

   List all objects inside the bucket named 'mybucket' -> Option A

4. Quick Check:

   'aws s3 ls' lists bucket contents [OK]

Hint: 'aws s3 ls' lists files in bucket [OK]

Common Mistakes:

• Thinking it deletes or creates buckets
• Confusing 'ls' with upload or delete
• Assuming it uploads files

4. You run this command:
aws s3 cp file.txt s3://mybucket
But you get an error saying the bucket does not exist. What is the likely cause?

medium

A. The AWS CLI command syntax is incorrect

B. The file 'file.txt' does not exist locally

C. The bucket 'mybucket' was not created before uploading

D. You need to delete the bucket before uploading

Solution

1. Step 1: Understand bucket existence requirement

   You must create a bucket before uploading objects to it.

2. Step 2: Analyze error message

   Error about bucket not existing means it was not created yet.

3. Final Answer:

   The bucket 'mybucket' was not created before uploading -> Option C

4. Quick Check:

   Bucket must exist before upload [OK]

Hint: Create bucket before uploading files [OK]

Common Mistakes:

• Assuming file missing causes bucket error
• Thinking syntax is wrong when bucket missing
• Trying to delete bucket before upload

5. You want to organize files in your S3 bucket 'photos' by year and month folders, like '2024/06/image.jpg'. Which is the best way to achieve this?

hard

A. Create actual folders inside the bucket before uploading

B. Upload objects with keys including folder paths, e.g., '2024/06/image.jpg'

C. Use separate buckets for each year and month

D. Rename the bucket to include year and month

Solution

1. Step 1: Understand S3 folder structure

   S3 does not have real folders; folder paths are part of object keys.

2. Step 2: Organize by key naming

   Use object keys with slashes to simulate folders, e.g., '2024/06/image.jpg'.

3. Step 3: Evaluate other options

   Creating folders physically is not possible; separate buckets for each date is inefficient; renaming bucket doesn't organize files.

4. Final Answer:

   Upload objects with keys including folder paths, e.g., '2024/06/image.jpg' -> Option B

5. Quick Check:

   Use key names with slashes for folders [OK]

Hint: Use slashes in object keys to mimic folders [OK]

Common Mistakes:

• Trying to create real folders in S3
• Using multiple buckets instead of keys
• Renaming bucket to organize files