FastCGI cache in Nginx - Time & Space Complexity

Time Complexity: FastCGI cache

O(n)

Understanding Time Complexity

When using FastCGI cache in nginx, it is important to understand how the caching process affects request handling time.

We want to know how the time to serve requests changes as the number of requests grows.

Scenario Under Consideration

Analyze the time complexity of the following nginx FastCGI cache configuration snippet.

fastcgi_cache_path /var/cache/nginx levels=1:2 keys_zone=MYCACHE:10m max_size=1g inactive=60m;

server {
    location ~ \.php$ {
        fastcgi_pass unix:/run/php/php7.4-fpm.sock;
        fastcgi_cache MYCACHE;
        fastcgi_cache_valid 200 302 10m;
        fastcgi_cache_use_stale error timeout updating;
    }
}
    

This snippet sets up a FastCGI cache to store responses for PHP requests, speeding up repeated requests by serving cached content.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Checking the cache for each incoming request.
• How many times: Once per request, repeated for every request nginx handles.

How Execution Grows With Input

Each request triggers a cache lookup, which is a quick key-value check.

Input Size (n)	Approx. Operations
10	10 cache lookups
100	100 cache lookups
1000	1000 cache lookups

Pattern observation: The number of operations grows linearly with the number of requests.

Final Time Complexity

Time Complexity: O(n)

This means the time to handle requests grows directly in proportion to the number of requests.

Common Mistake

[X] Wrong: "FastCGI cache makes request handling time constant no matter how many requests come in."

[OK] Correct: Each request still requires a cache lookup, so time grows with requests, but the cache makes each lookup very fast compared to generating content from scratch.

Interview Connect

Understanding how caching affects request handling time shows you can reason about system performance and scalability, a key skill in real-world DevOps work.

Self-Check

"What if the cache size is too small and causes frequent evictions? How would that affect the time complexity of request handling?"