DynamoDB Streams overview in AWS - Commands & Configuration

Introduction

Sometimes you want to know what changes happen to your database. DynamoDB Streams helps by recording these changes so you can react to them or keep track.

When you want to keep a log of all changes made to your DynamoDB table.

When you need to trigger other actions automatically after data changes, like sending notifications.

When you want to replicate data changes to another database or system.

When you want to audit who changed what and when in your database.

When you want to build real-time dashboards that update as data changes.

Commands

This command turns on DynamoDB Streams for the table named example-table. It records both the new and old versions of changed items.

Terminal

aws dynamodb update-table --table-name example-table --stream-specification StreamEnabled=true,StreamViewType=NEW_AND_OLD_IMAGES

Expected Output

{

    "TableDescription": {

        "TableName": "example-table",

        "StreamSpecification": {

            "StreamEnabled": true,

            "StreamViewType": "NEW_AND_OLD_IMAGES"

        }

    }

}

→

--stream-specification - Defines if streams are enabled and what data they capture

This command checks the current settings of example-table, including whether streams are enabled and their type.

Terminal

aws dynamodb describe-table --table-name example-table

Expected Output

{

    "Table": {

        "TableName": "example-table",

        "StreamSpecification": {

            "StreamEnabled": true,

            "StreamViewType": "NEW_AND_OLD_IMAGES"

        }

    }

}

This command lists the active streams for example-table so you can see the stream ARN to use in your applications.

Terminal

aws dynamodbstreams list-streams --table-name example-table

Expected Output

{

    "Streams": [

        {

            "StreamArn": "arn:aws:dynamodb:us-east-1:123456789012:table/example-table/stream/2024-06-01T12:00:00.000"

        }

    ]

}

Key Concept

If you remember nothing else from this pattern, remember: DynamoDB Streams records changes to your table so you can react to or track them.

Common Mistakes

Not enabling streams on the DynamoDB table before trying to read changes.

Without enabling streams, no change data is recorded and your application will not receive any events.

Always enable streams with the correct StreamViewType before expecting to consume stream data.

Choosing the wrong StreamViewType that does not include the data needed.

If you select KEYS_ONLY but need the full item data, you won't get the information you want.

Pick the StreamViewType (KEYS_ONLY, NEW_IMAGE, OLD_IMAGE, NEW_AND_OLD_IMAGES) that matches your use case.

Summary

Enable DynamoDB Streams on your table to start capturing changes.

Use the AWS CLI to verify stream settings and get the stream ARN.

Choose the right StreamViewType to capture the data you need.

Practice

1. What is the main purpose of DynamoDB Streams?

easy

A. To store backups of DynamoDB tables permanently

B. To encrypt data stored in DynamoDB tables

C. To increase the read capacity of a DynamoDB table

D. To track and react to data changes in real time

Solution

1. Step 1: Understand DynamoDB Streams function

   DynamoDB Streams capture data changes like inserts, updates, and deletes in real time.

2. Step 2: Compare options with Streams purpose

   Only To track and react to data changes in real time correctly describes tracking and reacting to data changes. Other options describe unrelated features.

3. Final Answer:

   To track and react to data changes in real time -> Option D

4. Quick Check:

   DynamoDB Streams = Track data changes [OK]

Hint: Streams capture table changes instantly for reaction [OK]

Common Mistakes:

• Confusing Streams with backup or encryption features
• Thinking Streams increase read capacity
• Assuming Streams store data permanently

2. Which setting must be enabled to start using DynamoDB Streams on a table?

easy

A. EncryptionEnabled set to true

B. BackupEnabled set to true

C. StreamEnabled set to true

D. AutoScalingEnabled set to true

Solution

1. Step 1: Identify the configuration for enabling Streams

   To use DynamoDB Streams, the table must have StreamEnabled set to true.

2. Step 2: Eliminate unrelated settings

   BackupEnabled, EncryptionEnabled, and AutoScalingEnabled do not enable Streams.

3. Final Answer:

   StreamEnabled set to true -> Option C

4. Quick Check:

   Enable Streams = StreamEnabled true [OK]

Hint: Enable Streams by setting StreamEnabled true [OK]

Common Mistakes:

• Confusing Streams with backups or encryption
• Assuming AutoScaling enables Streams
• Forgetting to enable Streams explicitly

3. Given a DynamoDB Stream with StreamViewType set to NEW_AND_OLD_IMAGES, what data will the stream record for each change?

medium

A. Only the new item image after the change

B. Both the new and old item images

C. Only the keys of the changed items

D. Only the old item image before the change

Solution

1. Step 1: Understand StreamViewType NEW_AND_OLD_IMAGES meaning

   This setting records both the item before and after the change.

2. Step 2: Compare options with StreamViewType behavior

   Only Both the new and old item images matches the behavior of capturing both new and old images.

3. Final Answer:

   Both the new and old item images -> Option B

4. Quick Check:

   NEW_AND_OLD_IMAGES = new + old data [OK]

Hint: NEW_AND_OLD_IMAGES means capture before and after data [OK]

Common Mistakes:

• Choosing only new or only old images
• Confusing keys only with full images
• Not knowing StreamViewType options

4. A developer enabled DynamoDB Streams but does not see any stream records after table updates. What is the most likely cause?

medium

A. StreamEnabled is false on the table

B. StreamViewType is set to KEYS_ONLY

C. Stream retention period is set to 7 days

D. The table has no primary key defined

Solution

1. Step 1: Check if Streams are enabled

   If StreamEnabled is false, no stream records are generated regardless of updates.

2. Step 2: Evaluate other options

   KEYS_ONLY still produces records; retention period (24-168 hours) does not prevent seeing recent records; tables require primary keys but that doesn't stop streams if enabled.

3. Final Answer:

   StreamEnabled is false on the table -> Option A

4. Quick Check:

   No records = Streams not enabled [OK]

Hint: Streams must be enabled to see records [OK]

Common Mistakes:

• Assuming KEYS_ONLY disables records
• Thinking retention period prevents seeing records
• Ignoring StreamEnabled setting

5. You want to trigger a Lambda function whenever an item is updated in your DynamoDB table to process both the old and new item images. Which DynamoDB Streams configuration and setup is required?

hard

A. Enable Streams with StreamViewType NEW_AND_OLD_IMAGES and configure Lambda trigger on the stream

B. Enable Streams with StreamViewType KEYS_ONLY and configure Lambda trigger on the table

C. Enable Streams with StreamViewType NEW_IMAGE and configure Lambda trigger on the stream

D. Enable Streams with StreamViewType OLD_IMAGE and configure Lambda trigger on the table

Solution

1. Step 1: Choose StreamViewType for updates

   To capture both before and after update data, use NEW_AND_OLD_IMAGES.

2. Step 2: Configure Lambda trigger on the DynamoDB Stream

   Lambda triggers must be set on the stream, not directly on the table.

3. Final Answer:

   Enable Streams with StreamViewType NEW_AND_OLD_IMAGES and configure Lambda trigger on the stream -> Option A

4. Quick Check:

   Lambda trigger on stream with NEW_AND_OLD_IMAGES [OK]

Hint: Use NEW_AND_OLD_IMAGES and trigger Lambda on stream [OK]

Common Mistakes:

• Triggering Lambda directly on table instead of stream
• Choosing KEYS_ONLY or OLD_IMAGE for update data
• Not enabling Streams before Lambda trigger