Cache invalidation strategies in Rest API - Time & Space Complexity

Time Complexity: Cache invalidation strategies

O(n)

Understanding Time Complexity

When using cache invalidation strategies in REST APIs, it's important to understand how the time to update or clear cache changes as the data grows.

We want to know how the cost of invalidating cache scales with the number of cached items or requests.

Scenario Under Consideration

Analyze the time complexity of this cache invalidation example.

// Simple cache invalidation by key
function invalidateCache(keys) {
  keys.forEach(key => {
    cache.delete(key);
  });
}

// keys is an array of cache keys to remove

This code removes cached items one by one by their keys.

Identify Repeating Operations

Look at what repeats in this code.

• Primary operation: Looping over each cache key to delete.
• How many times: Once for each key in the input list.

How Execution Grows With Input

As the number of keys to invalidate grows, the time to remove them grows too.

Input Size (n)	Approx. Operations
10	10 deletions
100	100 deletions
1000	1000 deletions

Pattern observation: The time grows directly with the number of keys to invalidate.

Final Time Complexity

Time Complexity: O(n)

This means the time to invalidate cache grows linearly with the number of keys you want to remove.

Common Mistake

[X] Wrong: "Invalidating cache keys is always instant, no matter how many keys there are."

[OK] Correct: Each key removal takes time, so more keys mean more work and longer time.

Interview Connect

Understanding how cache invalidation scales helps you design efficient APIs and shows you can think about performance in real systems.

Self-Check

"What if the cache invalidation used a pattern to delete keys in bulk instead of one by one? How would the time complexity change?"

Practice

1. Which cache invalidation strategy automatically removes cached data after a set period of time?

easy

A. Manual invalidation

B. Event-based invalidation

C. Time-based invalidation

D. Versioning invalidation

Solution

1. Step 1: Understand time-based invalidation

   Time-based invalidation removes cached data after a fixed time, ensuring data freshness automatically.

2. Step 2: Compare with other strategies

   Manual invalidation requires user action, event-based depends on data changes, and versioning uses data versions.

3. Final Answer:

   Time-based invalidation -> Option C

4. Quick Check:

   Automatic removal after time = Time-based invalidation [OK]

Hint: Time-based means cache expires after set time [OK]

Common Mistakes:

• Confusing manual with automatic removal
• Thinking event-based triggers on time
• Mixing versioning with time expiry

2. Which of the following is the correct way to manually invalidate a cache entry in a REST API?

easy

A. Send a PUT request to update cached data

B. Send a GET request to the cache endpoint

C. Send a POST request to retrieve cached data

D. Send a DELETE request to the cache endpoint

Solution

1. Step 1: Identify HTTP method for deletion

   DELETE requests are used to remove resources, including cache entries.

2. Step 2: Understand other methods

   GET retrieves data, POST creates, and PUT updates; none remove cache.

3. Final Answer:

   Send a DELETE request to the cache endpoint -> Option D

4. Quick Check:

   DELETE removes cache entry manually [OK]

Hint: DELETE method removes resources like cache entries [OK]

Common Mistakes:

• Using GET to remove cache
• Confusing POST with deletion
• Thinking PUT deletes cache

3. Consider this pseudo-code for event-based cache invalidation:

if (dataChangedEvent) {
  invalidateCache(key);
}
return getCachedData(key);

What will happen if dataChangedEvent is true?

medium

A. Cache is invalidated and fresh data is fetched next time

B. Cache remains unchanged and stale data is returned

C. Cache is updated without invalidation

D. An error occurs because cache cannot be invalidated

Solution

1. Step 1: Analyze the condition

   If dataChangedEvent is true, invalidateCache(key) runs, removing cached data.

2. Step 2: Understand cache behavior after invalidation

   After invalidation, next data fetch will get fresh data, not stale cache.

3. Final Answer:

   Cache is invalidated and fresh data is fetched next time -> Option A

4. Quick Check:

   Event triggers invalidation = fresh data next fetch [OK]

Hint: Event true means cache cleared for fresh data [OK]

Common Mistakes:

• Assuming cache stays after invalidation
• Thinking cache updates automatically
• Believing invalidation causes errors

4. You have this code snippet for versioning cache invalidation:

cache = { 'v1': data1 }
function getData(version) {
  return cache[version];
}

// Later
cache['v2'] = newData;

What is the main bug if the client still requests v1 after update?

medium

A. Cache throws an error because version key is missing

B. Client gets stale data because old version is still cached

C. Cache automatically updates old version to new data

D. Client cannot access any cached data

Solution

1. Step 1: Understand versioning cache behavior

   Old version 'v1' remains in cache, so requests for it get stale data.

2. Step 2: Identify bug impact

   Client requesting 'v1' does not see 'v2' data, causing stale responses.

3. Final Answer:

   Client gets stale data because old version is still cached -> Option B

4. Quick Check:

   Old version key returns stale data [OK]

Hint: Old version keys keep stale data unless removed [OK]

Common Mistakes:

• Assuming cache auto-updates old versions
• Expecting errors on missing keys
• Thinking client loses all cache access

5. You want to design a cache invalidation strategy for a REST API where data changes frequently but must stay fresh within 5 minutes. Which combined strategy is best?

hard

A. Use time-based invalidation with 5-minute expiry plus event-based invalidation on data changes

B. Use manual invalidation only, requiring user to clear cache

C. Use versioning only without time limits

D. Use time-based invalidation with 1-hour expiry only

Solution

1. Step 1: Analyze freshness requirement

   Data must be fresh within 5 minutes, so time-based expiry should be 5 minutes or less.

2. Step 2: Combine with event-based invalidation

   Event-based invalidation clears cache immediately on data changes, improving freshness.

3. Step 3: Evaluate other options

   Manual invalidation is slow, versioning alone may keep stale data, and 1-hour expiry is too long.

4. Final Answer:

   Use time-based invalidation with 5-minute expiry plus event-based invalidation on data changes -> Option A

5. Quick Check:

   Combine time and event for fresh cache [OK]

Hint: Combine time and event for best freshness [OK]

Common Mistakes:

• Relying only on manual invalidation
• Using too long expiry times
• Ignoring event triggers for changes