Pagination with SDK in DynamoDB - Mini Project: Build & Apply

Pagination with SDK

📖 Scenario: You are building a simple application that fetches user data from a DynamoDB table called Users. The table contains many user records, and you want to retrieve them in small chunks (pages) to avoid loading too much data at once.

🎯 Goal: Learn how to use the DynamoDB SDK to fetch user records with pagination, retrieving one page of results at a time.

📋 What You'll Learn

Create a DynamoDB client using the AWS SDK

Set a page size limit for the number of items to fetch

Write a query or scan operation that fetches one page of user data

Use the pagination token to fetch the next page of results

💡 Why This Matters

🌍 Real World

Pagination is essential when working with large datasets in DynamoDB to avoid loading too much data at once and to improve performance and user experience.

💼 Career

Understanding how to paginate DynamoDB results is a common task for backend developers and cloud engineers working with AWS services.

1

Create DynamoDB client

Create a DynamoDB client called dynamodb using new AWS.DynamoDB.DocumentClient().

DynamoDB

# Create a DynamoDB client
# Your code here

Hint

Use new AWS.DynamoDB.DocumentClient() to create the client.

2

Set page size limit

Create a variable called pageSize and set it to 5 to limit the number of items fetched per page.

DynamoDB

const AWS = require('aws-sdk');
const dynamodb = new AWS.DynamoDB.DocumentClient();

// Set the page size limit
# Your code here

Hint

Set pageSize to 5 to fetch 5 items per page.

3

Fetch one page of users

Write a params object with TableName set to 'Users' and Limit set to pageSize. Then call dynamodb.scan(params).promise() and assign the result to data using await.

DynamoDB

const AWS = require('aws-sdk');
const dynamodb = new AWS.DynamoDB.DocumentClient();

const pageSize = 5;

// Fetch one page of users
# Your code here

Hint

Use scan with Limit to get a page of items.

4

Use pagination token for next page

Add ExclusiveStartKey to params using a variable called lastKey. After fetching data, update lastKey with data.LastEvaluatedKey to prepare for the next page.

DynamoDB

const AWS = require('aws-sdk');
const dynamodb = new AWS.DynamoDB.DocumentClient();

const pageSize = 5;

let lastKey = undefined;

const params = {
    TableName: 'Users',
    Limit: pageSize
};

async function fetchPage() {
    // Add ExclusiveStartKey if lastKey exists
    # Your code here

    const data = await dynamodb.scan(params).promise();

    // Update lastKey with LastEvaluatedKey
    # Your code here

    return data;
}

Hint

Use ExclusiveStartKey to continue from the last page.

Practice

1. What does the Limit parameter do when paginating results in DynamoDB SDK?

easy

A. It specifies the starting point for the next page.

B. It sets the maximum number of items returned in one page.

C. It filters items based on a condition.

D. It sorts the results in ascending order.

Solution

1. Step 1: Understand the role of Limit in pagination

   The Limit parameter controls how many items DynamoDB returns in a single request, effectively setting the page size.

2. Step 2: Differentiate from other parameters

   ExclusiveStartKey sets the starting point for the next page, not Limit. Filtering and sorting are handled differently.

3. Final Answer:

   It sets the maximum number of items returned in one page. -> Option B

4. Quick Check:

   Limit = page size [OK]

Hint: Limit controls page size, not start or filter [OK]

Common Mistakes:

• Confusing Limit with ExclusiveStartKey
• Thinking Limit filters data
• Assuming Limit sorts results

2. Which of the following is the correct way to continue fetching the next page of results in DynamoDB SDK?

easy

A. Set StartKey to zero.

B. Use Limit with the last item key.

C. Set ExclusiveStartKey to the last evaluated key from previous response.

D. Use NextPageToken parameter.

Solution

1. Step 1: Identify the parameter for pagination continuation

   DynamoDB uses ExclusiveStartKey to tell the query where to start for the next page.

2. Step 2: Verify other options

   Limit sets page size, StartKey is not a valid parameter, and NextPageToken is not used in DynamoDB SDK.

3. Final Answer:

   Set ExclusiveStartKey to the last evaluated key from previous response. -> Option C

4. Quick Check:

   Use ExclusiveStartKey for next page [OK]

Hint: Use ExclusiveStartKey to continue pagination [OK]

Common Mistakes:

• Using Limit to continue pages
• Using invalid parameter StartKey
• Assuming NextPageToken exists in DynamoDB

3. Given the following DynamoDB SDK code snippet, what will be the output if LastEvaluatedKey is not empty?

const params = { TableName: 'Books', Limit: 2 };
const data = await dynamoDbClient.scan(params);
console.log(data.Items.length);
console.log(data.LastEvaluatedKey !== undefined);

medium

A. Error due to missing ExclusiveStartKey

B. All items and false

C. 2 and false

D. 2 and true

Solution

1. Step 1: Understand Limit effect on Items returned

   With Limit: 2, the scan returns at most 2 items, so data.Items.length will be 2.

2. Step 2: Check LastEvaluatedKey presence

   If LastEvaluatedKey is not empty, it means more pages exist, so data.LastEvaluatedKey !== undefined is true.

3. Final Answer:

   2 and true -> Option D

4. Quick Check:

   Limit = 2 items, LastEvaluatedKey present = true [OK]

Hint: Limit caps items; LastEvaluatedKey true means more pages [OK]

Common Mistakes:

• Assuming all items returned ignoring Limit
• Thinking LastEvaluatedKey is false when present
• Expecting error without ExclusiveStartKey

4. You wrote this code to paginate DynamoDB scan results but it returns only the first page repeatedly:

let params = { TableName: 'Users', Limit: 3 };
let data;
do {
  data = await dynamoDbClient.scan(params);
  console.log(data.Items);
} while (data.LastEvaluatedKey);

What is the main issue?

medium

A. Missing update of ExclusiveStartKey in params inside the loop.

B. Limit should be increased to fetch all items.

C. The loop condition should check data.Items instead.

D. The scan method does not support pagination.

Solution

1. Step 1: Analyze loop behavior

   The code calls scan repeatedly but never updates ExclusiveStartKey, so it fetches the same first page each time.

2. Step 2: Identify correct fix

   To get next pages, params.ExclusiveStartKey must be set to data.LastEvaluatedKey inside the loop.

3. Final Answer:

   Missing update of ExclusiveStartKey in params inside the loop. -> Option A

4. Quick Check:

   Update ExclusiveStartKey to paginate [OK]

Hint: Update ExclusiveStartKey each loop to get next page [OK]

Common Mistakes:

• Not updating ExclusiveStartKey inside loop
• Increasing Limit instead of paginating
• Wrong loop condition on Items
• Thinking scan can't paginate

5. You want to fetch all items from a large DynamoDB table using pagination with the SDK. Which approach correctly handles this scenario?

hard

A. Use a loop that calls scan with Limit, updating ExclusiveStartKey each time until LastEvaluatedKey is undefined.

B. Call scan once with a very large Limit to get all items at once.

C. Use scan without Limit and stop when Items array is empty.

D. Call scan repeatedly without ExclusiveStartKey until Items length is zero.

Solution

1. Step 1: Understand DynamoDB pagination for large tables

   Large tables require multiple scan calls with a Limit to avoid timeouts and memory issues.

2. Step 2: Correctly implement pagination loop

   Each scan call should use ExclusiveStartKey from the previous LastEvaluatedKey until it is undefined, indicating no more pages.

3. Final Answer:

   Use a loop that calls scan with Limit, updating ExclusiveStartKey each time until LastEvaluatedKey is undefined. -> Option A

4. Quick Check:

   Loop with Limit and ExclusiveStartKey until done [OK]

Hint: Loop with Limit and ExclusiveStartKey until no LastEvaluatedKey [OK]

Common Mistakes:

• Using huge Limit causing timeouts
• Ignoring ExclusiveStartKey for next pages
• Stopping on empty Items instead of LastEvaluatedKey
• Calling scan repeatedly without pagination