Micro-caching for dynamic content in Nginx - Time & Space Complexity

Time Complexity: Micro-caching for dynamic content

O(n)

Understanding Time Complexity

We want to understand how the time to serve requests changes when using micro-caching in nginx.

Specifically, how caching affects the work nginx does as requests increase.

Scenario Under Consideration

Analyze the time complexity of this nginx micro-caching setup.

proxy_cache_path /tmp/cache keys_zone=microcache:10m max_size=100m inactive=1m;

server {
    location /dynamic/ {
        proxy_cache microcache;
        proxy_cache_valid 200 1s;
        proxy_pass http://backend;
    }
}
    

This config caches dynamic content for 1 second to reduce backend load on many requests.

Identify Repeating Operations

Look at what repeats when requests come in.

• Primary operation: Checking cache for each request.
• How many times: Once per request.
• Secondary operation: Forwarding to backend if cache miss, which is more costly.

How Execution Grows With Input

As requests increase, nginx checks cache quickly each time.

Input Size (n)	Approx. Operations
10	10 cache checks, few backend calls
100	100 cache checks, few backend calls
1000	1000 cache checks, few backend calls

Pattern observation: Cache checks grow linearly with requests, but backend calls stay low due to caching.

Final Time Complexity

Time Complexity: O(n)

This means the work nginx does grows directly with the number of requests, but each request is fast because of caching.

Common Mistake

[X] Wrong: "Caching makes nginx handle requests instantly with no work."

[OK] Correct: Even with caching, nginx must check the cache for every request, so work still grows with requests.

Interview Connect

Understanding how caching affects request handling helps you explain real-world server performance clearly and confidently.

Self-Check

"What if the cache duration changed from 1 second to 10 seconds? How would the time complexity change?"

Practice

1. What is the main purpose of micro-caching dynamic content in nginx?

easy

A. To temporarily store dynamic pages to reduce server load and improve response time

B. To permanently save static files on the server

C. To disable caching for all dynamic content

D. To increase the size of the server's memory

Solution

1. Step 1: Understand micro-caching concept

   Micro-caching stores dynamic content briefly to reduce repeated processing and speed up responses.

2. Step 2: Identify the main benefit

   This reduces server load and improves response time during traffic spikes or frequent requests.

3. Final Answer:

   To temporarily store dynamic pages to reduce server load and improve response time -> Option A

4. Quick Check:

   Micro-caching = temporary dynamic content storage [OK]

Hint: Micro-caching means short-term caching of dynamic pages [OK]

Common Mistakes:

• Confusing micro-caching with permanent static caching
• Thinking micro-caching disables caching
• Assuming it increases server memory

2. Which nginx directive correctly sets micro-cache duration to 10 seconds?

easy

A. proxy_cache_duration 10s;

B. proxy_cache_valid 10s;

C. proxy_cache_valid 10m;

D. proxy_cache_time 10s;

Solution

1. Step 1: Recall correct directive for cache duration

   The directive to set cache validity time is proxy_cache_valid.

2. Step 2: Check correct time unit and syntax

   Using 10s sets cache duration to 10 seconds, which is valid syntax.

3. Final Answer:

   proxy_cache_valid 10s; -> Option B

4. Quick Check:

   Cache duration uses proxy_cache_valid [OK]

Hint: Use proxy_cache_valid with time unit for cache duration [OK]

Common Mistakes:

• Using wrong directive names like proxy_cache_duration
• Confusing seconds (s) with minutes (m)
• Omitting semicolon at end

3. Given this nginx config snippet:

proxy_cache_path /tmp/cache keys_zone=microcache:10m max_size=100m;
server {
  location /dynamic/ {
    proxy_cache microcache;
    proxy_cache_valid 5s;
    proxy_pass http://backend;
  }
}

What happens when a user requests /dynamic/page1 twice within 3 seconds?

medium

A. The second request is served from cache, speeding up response

B. The second request bypasses cache and fetches fresh content

C. Both requests cause backend to generate content

D. Cache is cleared after first request, so second fails

Solution

1. Step 1: Understand cache duration and behavior

   Cache duration is 5 seconds, so content is cached for 5 seconds after first request.

2. Step 2: Analyze requests timing

   Second request is within 3 seconds, so cache is still valid and serves cached content.

3. Final Answer:

   The second request is served from cache, speeding up response -> Option A

4. Quick Check:

   Cache valid 5s means repeated requests within 5s use cache [OK]

Hint: Requests within cache time get cached response [OK]

Common Mistakes:

• Assuming cache is bypassed before expiry
• Thinking cache clears after each request
• Confusing cache duration units

4. You configured micro-caching with:

proxy_cache_valid 10s;

But cache never stores responses. What is a likely cause?

medium

A. The server block lacks listen directive

B. The cache duration is too short to store anything

C. The proxy_pass URL is invalid

D. The proxy_cache_path directive is missing or incorrect

Solution

1. Step 1: Check required cache setup directives

   For caching to work, proxy_cache_path must define cache storage and zone.

2. Step 2: Identify missing or incorrect cache path

   If proxy_cache_path is missing or wrong, cache cannot store responses despite valid duration.

3. Final Answer:

   The proxy_cache_path directive is missing or incorrect -> Option D

4. Quick Check:

   proxy_cache_path must be set for caching to work [OK]

Hint: Always define proxy_cache_path to enable caching [OK]

Common Mistakes:

• Ignoring proxy_cache_path directive
• Blaming cache duration length
• Confusing proxy_pass errors with caching issues

5. You want to micro-cache dynamic API responses for 2 seconds but only cache successful responses (status 200). Which nginx config snippet achieves this?

hard

A. proxy_cache_valid 200 2s;
proxy_cache_valid 404 0s;

B. proxy_cache_valid 2s;
proxy_cache_use_stale error timeout;

C. proxy_cache_valid 200 2s;
proxy_cache_valid any 0s;

D. proxy_cache_valid 2s;
proxy_cache_min_uses 1;

Solution

1. Step 1: Understand proxy_cache_valid usage by status

   To cache only status 200 responses for 2 seconds, use proxy_cache_valid 200 2s;.

2. Step 2: Prevent caching other statuses

   Set proxy_cache_valid any 0s; to avoid caching other statuses like 404.

3. Final Answer:

   proxy_cache_valid 200 2s; proxy_cache_valid any 0s; -> Option C

4. Quick Check:

   Cache only 200 status with proxy_cache_valid [OK]

Hint: Use proxy_cache_valid with status code to control caching [OK]

Common Mistakes:

• Not specifying status code in proxy_cache_valid
• Using invalid directive names
• Caching error or 404 responses unintentionally