Why Secondary indexes (GSI, LSI) in AWS? - Purpose & Use Cases

The Big Idea

What if you could find any piece of data instantly, no matter how you want to look for it?

The Scenario

Imagine you have a huge phone book, but it's only sorted by last name. Now, you want to quickly find all people living in a certain city or with a specific job title. Without extra sorting, you'd have to flip through every page manually.

The Problem

Manually searching through all entries is slow and tiring. It's easy to miss details or make mistakes. As the phone book grows, finding what you want takes longer and longer, making your work frustrating and inefficient.

The Solution

Secondary indexes act like extra sorted lists for your data. They let you quickly find items by different keys without scanning everything. This saves time and reduces errors, making your data searches fast and reliable.

Before vs After

✗ Before

Scan entire table and filter results in code

✓ After

Query using a secondary index to get results directly

What It Enables

Secondary indexes unlock fast, flexible queries on large datasets without slowing down your application.

Real Life Example

A shopping app uses a secondary index to quickly find all orders by customer ID or by order date, making the app responsive and user-friendly.

Key Takeaways

Manual searches through large data are slow and error-prone.

Secondary indexes provide alternate ways to quickly find data.

They improve performance and user experience in real applications.

Practice

1. What is the main difference between a Local Secondary Index (LSI) and a Global Secondary Index (GSI) in DynamoDB?

easy

A. LSI can have a different partition key, but GSI must use the main table's partition key.

B. LSI uses the same partition key as the main table, but GSI can use a different partition key.

C. LSI and GSI both require the same partition and sort keys as the main table.

D. LSI is only for read operations, while GSI is only for write operations.

Solution

1. Step 1: Understand LSI key structure

   LSI shares the same partition key as the main table but allows a different sort key.

2. Step 2: Understand GSI key structure

   GSI can have a completely different partition key and sort key from the main table.

3. Final Answer:

   LSI uses the same partition key as the main table, but GSI can use a different partition key. -> Option B

4. Quick Check:

   LSI shares partition key, GSI can differ [OK]

Hint: LSI shares partition key; GSI can change both keys [OK]

Common Mistakes:

• Thinking LSI can have a different partition key
• Assuming GSI must use main table keys
• Confusing read/write capabilities of indexes

2. Which of the following is the correct syntax to define a Global Secondary Index (GSI) in a DynamoDB table using AWS CloudFormation?

easy

A. "GlobalSecondaryIndexes": [{"IndexName": "GSI1", "KeySchema": [{"AttributeName": "UserId", "KeyType": "HASH"}], "Projection": {"ProjectionType": "KEYS_ONLY"}}]

B. "LocalSecondaryIndexes": [{"IndexName": "GSI1", "KeySchema": [{"AttributeName": "UserId", "KeyType": "HASH"}], "Projection": {"ProjectionType": "ALL"}}]

C. "GlobalSecondaryIndexes": [{"IndexName": "GSI1", "KeySchema": [{"AttributeName": "UserId", "KeyType": "RANGE"}], "Projection": {"ProjectionType": "ALL"}}]

D. "GlobalSecondaryIndexes": [{"IndexName": "GSI1", "KeySchema": [{"AttributeName": "UserId", "KeyType": "HASH"}], "Projection": {"ProjectionType": "ALL"}}]

Solution

1. Step 1: Identify correct index type and key schema

   GlobalSecondaryIndexes is the correct property for GSI, and the partition key must have KeyType "HASH".

2. Step 2: Check projection type and syntax

   ProjectionType "ALL" is valid and commonly used; syntax matches CloudFormation format.

3. Final Answer:

   "GlobalSecondaryIndexes": [{"IndexName": "GSI1", "KeySchema": [{"AttributeName": "UserId", "KeyType": "HASH"}], "Projection": {"ProjectionType": "ALL"}}] -> Option D

4. Quick Check:

   GSI uses GlobalSecondaryIndexes with HASH key [OK]

Hint: GSI uses GlobalSecondaryIndexes with HASH key [OK]

Common Mistakes:

• Using LocalSecondaryIndexes for GSI
• Setting KeyType to RANGE for partition key
• Incorrect projection types or syntax errors

3. Given a DynamoDB table with a Global Secondary Index (GSI) on attribute Category as partition key and Price as sort key, what will the following query return?

Query on GSI where Category = 'Books' and Price between 10 and 20

medium

A. All items with Category 'Books' and Price between 10 and 20

B. All items with Price between 10 and 20 regardless of Category

C. All items with Category 'Books' regardless of Price

D. An error because Price cannot be used in query conditions

Solution

1. Step 1: Understand GSI query conditions

   Query on GSI requires specifying the partition key (Category = 'Books') and can filter by sort key range (Price between 10 and 20).

2. Step 2: Interpret the query result

   The query returns all items matching Category 'Books' with Price in the specified range.

3. Final Answer:

   All items with Category 'Books' and Price between 10 and 20 -> Option A

4. Quick Check:

   GSI query filters partition and sort keys correctly [OK]

Hint: Query GSI with partition key + sort key range filters [OK]

Common Mistakes:

• Ignoring partition key in query
• Thinking sort key can't be filtered
• Expecting error on valid query

4. You created a Local Secondary Index (LSI) on a DynamoDB table but your query on the LSI returns no results even though matching items exist. What is the most likely cause?

medium

A. The LSI was created with a different partition key than the main table.

B. The query used a filter expression instead of a key condition.

C. The query did not specify the same partition key as the main table.

D. LSIs do not support queries, only scans.

Solution

1. Step 1: Recall LSI key requirements

   LSI shares the same partition key as the main table, so queries must specify that partition key.

2. Step 2: Analyze query behavior

   If the query does not specify the partition key, no results will be returned because partition key is mandatory for queries on LSI.

3. Final Answer:

   The query did not specify the same partition key as the main table. -> Option C

4. Quick Check:

   LSI queries require main table partition key [OK]

Hint: LSI queries must include main table partition key [OK]

Common Mistakes:

• Assuming LSI can have different partition key
• Using filter instead of key condition for partition key
• Believing LSI does not support queries

5. You have a DynamoDB table with a partition key UserId and sort key OrderDate. You want to efficiently query all orders by Status and sort them by OrderAmount. Which secondary index should you create and how?

hard

A. Create a Global Secondary Index with partition key Status and sort key OrderAmount.

B. Create a Local Secondary Index with partition key UserId and sort key Status.

C. Create a Global Secondary Index with partition key UserId and sort key Status.

D. Create a Local Secondary Index with partition key Status and sort key OrderAmount.

Solution

1. Step 1: Identify query requirements

   You want to query by Status (different from main partition key) and sort by OrderAmount.

2. Step 2: Choose index type and keys

   Since Status is different from main partition key, use a Global Secondary Index with Status as partition key and OrderAmount as sort key.

3. Final Answer:

   Create a Global Secondary Index with partition key Status and sort key OrderAmount. -> Option A

4. Quick Check:

   GSI allows different partition and sort keys [OK]

Hint: Use GSI when partition key differs from main table [OK]

Common Mistakes:

• Trying to use LSI with different partition key
• Swapping partition and sort keys incorrectly
• Choosing wrong index type for query pattern