Buckets and objects concept in AWS - Commands & Configuration

Introduction

When you want to store files or data in the cloud, you use buckets and objects. Buckets are like folders, and objects are the files inside them. This helps you keep your data safe and easy to find.

When you want to save photos or videos online to access them from anywhere.

When you need to back up important documents automatically to the cloud.

When you want to share files with friends or coworkers securely.

When you run a website and need to store images or files for visitors.

When you want to keep logs or data from your app in a safe place.

Commands

This command creates a new bucket named 'example-bucket-12345' in your AWS account. Buckets are containers for your files.

Terminal

aws s3 mb s3://example-bucket-12345

Expected Output

make_bucket: example-bucket-12345

This command uploads the file 'sample-file.txt' from your computer to the bucket you just created. The file becomes an object inside the bucket.

Terminal

aws s3 cp sample-file.txt s3://example-bucket-12345/

Expected Output

upload: ./sample-file.txt to s3://example-bucket-12345/sample-file.txt

This command lists all objects (files) inside the bucket so you can see what is stored there.

Terminal

aws s3 ls s3://example-bucket-12345/

Expected Output

2024-06-01 12:00:00       1234 sample-file.txt

This command deletes the object named 'sample-file.txt' from the bucket, removing the file from cloud storage.

Terminal

aws s3 rm s3://example-bucket-12345/sample-file.txt

Expected Output

delete: s3://example-bucket-12345/sample-file.txt

This command removes the bucket named 'example-bucket-12345'. The bucket must be empty before you delete it.

Terminal

aws s3 rb s3://example-bucket-12345

Expected Output

remove_bucket: example-bucket-12345

Key Concept

If you remember nothing else from this pattern, remember: buckets hold your files, and objects are the files inside buckets.

Common Mistakes

Trying to delete a bucket that still has files inside.

AWS does not allow deleting buckets that are not empty, so the command fails.

First delete all objects inside the bucket, then delete the bucket.

Using a bucket name that is already taken by someone else.

Bucket names must be unique across all AWS users, so creation fails if the name is taken.

Choose a unique bucket name, often by adding random numbers or your company name.

Uploading a file without specifying the correct bucket path.

The file may upload to the wrong location or fail if the bucket does not exist.

Double-check the bucket name and path before uploading files.

Summary

Create a bucket to hold your files using 'aws s3 mb'.

Upload files as objects into the bucket using 'aws s3 cp'.

List files inside the bucket with 'aws s3 ls'.

Delete files with 'aws s3 rm' before removing the bucket.

Remove the empty bucket using 'aws s3 rb'.

Practice

1. What is a bucket in AWS S3?

easy

A. A network firewall

B. A type of virtual machine

C. A database for storing records

D. A container to store files (objects) in the cloud

Solution

1. Step 1: Understand AWS S3 storage structure

   AWS S3 stores data in containers called buckets.

2. Step 2: Define bucket role

   Buckets hold objects, which are files uploaded by users.

3. Final Answer:

   A container to store files (objects) in the cloud -> Option D

4. Quick Check:

   Bucket = container for objects [OK]

Hint: Buckets hold files; think of them as folders [OK]

Common Mistakes:

• Confusing buckets with virtual machines
• Thinking buckets are databases
• Mixing buckets with network components

2. Which of the following is the correct way to upload an object to an S3 bucket using AWS CLI?

easy

A. aws s3 cp file.txt s3://mybucket/

B. aws s3 upload file.txt s3://mybucket/

C. aws s3 put file.txt s3://mybucket/

D. aws s3 add file.txt s3://mybucket/

Solution

1. Step 1: Recall AWS CLI command for uploading files

   The correct command to upload files is 'aws s3 cp'.

2. Step 2: Check other options

   'upload', 'put', and 'add' are not valid AWS CLI commands for S3.

3. Final Answer:

   aws s3 cp file.txt s3://mybucket/ -> Option A

4. Quick Check:

   Use 'cp' to copy/upload files [OK]

Hint: Use 'aws s3 cp' to upload files [OK]

Common Mistakes:

• Using 'upload' instead of 'cp'
• Confusing 'put' with AWS CLI commands
• Trying non-existent commands like 'add'

3. Given the following AWS CLI command:
aws s3 ls s3://mybucket/
What will this command do?

medium

A. List all objects inside the bucket named 'mybucket'

B. Delete the bucket named 'mybucket'

C. Create a new bucket named 'mybucket'

D. Upload files to the bucket named 'mybucket'

Solution

1. Step 1: Understand the 'aws s3 ls' command

   This command lists contents of a bucket or buckets.

2. Step 2: Analyze the command target

   Since it targets 's3://mybucket/', it lists objects inside that bucket.

3. Final Answer:

   List all objects inside the bucket named 'mybucket' -> Option A

4. Quick Check:

   'aws s3 ls' lists bucket contents [OK]

Hint: 'aws s3 ls' lists files in bucket [OK]

Common Mistakes:

• Thinking it deletes or creates buckets
• Confusing 'ls' with upload or delete
• Assuming it uploads files

4. You run this command:
aws s3 cp file.txt s3://mybucket
But you get an error saying the bucket does not exist. What is the likely cause?

medium

A. The AWS CLI command syntax is incorrect

B. The file 'file.txt' does not exist locally

C. The bucket 'mybucket' was not created before uploading

D. You need to delete the bucket before uploading

Solution

1. Step 1: Understand bucket existence requirement

   You must create a bucket before uploading objects to it.

2. Step 2: Analyze error message

   Error about bucket not existing means it was not created yet.

3. Final Answer:

   The bucket 'mybucket' was not created before uploading -> Option C

4. Quick Check:

   Bucket must exist before upload [OK]

Hint: Create bucket before uploading files [OK]

Common Mistakes:

• Assuming file missing causes bucket error
• Thinking syntax is wrong when bucket missing
• Trying to delete bucket before upload

5. You want to organize files in your S3 bucket 'photos' by year and month folders, like '2024/06/image.jpg'. Which is the best way to achieve this?

hard

A. Create actual folders inside the bucket before uploading

B. Upload objects with keys including folder paths, e.g., '2024/06/image.jpg'

C. Use separate buckets for each year and month

D. Rename the bucket to include year and month

Solution

1. Step 1: Understand S3 folder structure

   S3 does not have real folders; folder paths are part of object keys.

2. Step 2: Organize by key naming

   Use object keys with slashes to simulate folders, e.g., '2024/06/image.jpg'.

3. Step 3: Evaluate other options

   Creating folders physically is not possible; separate buckets for each date is inefficient; renaming bucket doesn't organize files.

4. Final Answer:

   Upload objects with keys including folder paths, e.g., '2024/06/image.jpg' -> Option B

5. Quick Check:

   Use key names with slashes for folders [OK]

Hint: Use slashes in object keys to mimic folders [OK]

Common Mistakes:

• Trying to create real folders in S3
• Using multiple buckets instead of keys
• Renaming bucket to organize files