CPU requests and limits in Kubernetes - Time & Space Complexity

Time Complexity: CPU requests and limits

O(n)

Understanding Time Complexity

We want to understand how the CPU resource management in Kubernetes scales as more containers are scheduled.

Specifically, how does the system handle CPU requests and limits when the number of pods grows?

Scenario Under Consideration

Analyze the time complexity of the following Kubernetes resource configuration snippet.

apiVersion: v1
kind: Pod
metadata:
  name: example-pod
spec:
  containers:
  - name: example-container
    image: busybox
    resources:
      requests:
        cpu: "100m"
      limits:
        cpu: "200m"

This snippet sets CPU requests and limits for a container inside a pod, defining how much CPU it asks for and the maximum it can use.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Kubernetes scheduler checks CPU requests and limits for each pod to allocate CPU resources.
• How many times: This check happens once per pod, so it repeats as many times as there are pods.

How Execution Grows With Input

As the number of pods increases, the scheduler must process each pod's CPU requests and limits to assign CPU resources.

Input Size (n)	Approx. Operations
10	10 CPU checks
100	100 CPU checks
1000	1000 CPU checks

Pattern observation: The number of CPU resource checks grows directly with the number of pods.

Final Time Complexity

Time Complexity: O(n)

This means the CPU resource allocation work grows linearly as more pods are added.

Common Mistake

[X] Wrong: "CPU requests and limits are checked once for the whole cluster regardless of pod count."

[OK] Correct: Each pod's CPU needs are checked individually, so the work grows with the number of pods.

Interview Connect

Understanding how resource checks scale helps you explain how Kubernetes manages workloads efficiently as clusters grow.

Self-Check

"What if we added CPU limits but no requests? How would the time complexity change?"

Practice

1. What does setting a cpu request in a Kubernetes pod specification do?

easy

A. It guarantees a minimum amount of CPU for the container.

B. It limits the maximum CPU the container can use.

C. It sets the CPU priority for the container.

D. It reserves memory for the container.

Solution

1. Step 1: Understand CPU request meaning

   CPU request is the minimum CPU resource Kubernetes guarantees to a container.

2. Step 2: Differentiate from CPU limit

   CPU limit sets the maximum CPU usage, not the minimum guaranteed.

3. Final Answer:

   It guarantees a minimum amount of CPU for the container. -> Option A

4. Quick Check:

   CPU request = minimum CPU guaranteed [OK]

Hint: Requests guarantee minimum CPU, limits cap maximum CPU [OK]

Common Mistakes:

• Confusing CPU request with CPU limit
• Thinking requests set maximum CPU
• Mixing CPU with memory resource

2. Which of the following is the correct way to specify CPU requests and limits in a pod YAML?

easy

A. resources:
cpu:
request: 500m
limit: 1

B. resources:
requests:
cpu: 500
limits:
cpu: 1000

C. resources:
requests:
cpu: "500m"
limits:
cpu: "1"

D. resources:
requests:
cpu: "1.0"
limits:
cpu: "0.5"

Solution

1. Step 1: Check correct YAML structure for resources

   The correct keys are requests and limits under resources, with CPU values as strings with units like "500m" or "1".

2. Step 2: Validate resources: requests: cpu: "500m" limits: cpu: "1" format

   resources: requests: cpu: "500m" limits: cpu: "1" uses correct keys and units: "500m" means 0.5 CPU, "1" means 1 CPU core.

3. Final Answer:

   resources: requests: cpu: "500m" limits: cpu: "1" -> Option C

4. Quick Check:

   Correct YAML keys and CPU units = resources: requests: cpu: "500m" limits: cpu: "1" [OK]

Hint: Use 'requests' and 'limits' keys with CPU as string with units [OK]

Common Mistakes:

• Using 'request' instead of 'requests'
• Specifying CPU as numbers without quotes or units
• Mixing up 'cpu' and 'memory' keys

3. Given this pod spec snippet:

resources:
  requests:
    cpu: "200m"
  limits:
    cpu: "500m"

What happens if the container tries to use 600m CPU?

medium

A. The container will be killed immediately.

B. The container will be throttled to 500m CPU.

C. The container will be allowed to use 600m CPU.

D. The container will be throttled to 200m CPU.

Solution

1. Step 1: Understand CPU limit effect

   The CPU limit is the maximum CPU the container can use. Here it is 500m (0.5 CPU).

2. Step 2: Predict container behavior when exceeding limit

   If the container tries to use 600m CPU, Kubernetes throttles it to the limit, 500m CPU.

3. Final Answer:

   The container will be throttled to 500m CPU. -> Option B

4. Quick Check:

   CPU limit caps usage = throttled to 500m [OK]

Hint: CPU usage above limit gets throttled to limit [OK]

Common Mistakes:

• Thinking container can exceed CPU limit
• Confusing throttling with killing container
• Assuming CPU request is the max limit

4. You wrote this pod spec:

resources:
  requests:
    cpu: "100m"
  limits:
    cpu: "50m"

What is wrong with this configuration?

medium

A. CPU requests and limits cannot be set together.

B. CPU request is less than CPU limit, which is invalid.

C. CPU values must be integers, not strings.

D. CPU limit is less than CPU request, which is invalid.

Solution

1. Step 1: Compare CPU request and limit values

   CPU request is 100m (0.1 CPU), CPU limit is 50m (0.05 CPU).

2. Step 2: Validate Kubernetes rules for requests and limits

   CPU limit must be equal or greater than CPU request. Here limit < request, which is invalid.

3. Final Answer:

   CPU limit is less than CPU request, which is invalid. -> Option D

4. Quick Check:

   Limit >= Request rule violated = CPU limit is less than CPU request, which is invalid. [OK]

Hint: Limit must be >= request, else config is invalid [OK]

Common Mistakes:

• Setting limit less than request
• Thinking CPU values must be integers
• Believing requests and limits can't coexist

5. You want to ensure a container always gets at least 250m CPU but never uses more than 750m CPU. Which YAML snippet correctly sets this with CPU requests and limits?

hard

A. resources:
requests:
cpu: "250m"
limits:
cpu: "750m"

B. resources:
requests:
cpu: "750m"
limits:
cpu: "250m"

C. resources:
requests:
cpu: 0.25
limits:
cpu: 0.75

D. resources:
requests:
cpu: "0.75"
limits:
cpu: "0.25"

Solution

1. Step 1: Identify correct CPU units and values

   CPU values can be specified as millicores with 'm' suffix, e.g., "250m" for 0.25 CPU.

2. Step 2: Check request and limit order

   Request must be less than or equal to limit. resources: requests: cpu: "250m" limits: cpu: "750m" sets request to 250m and limit to 750m correctly.

3. Final Answer:

   resources: requests: cpu: "250m" limits: cpu: "750m" -> Option A

4. Quick Check:

   Request 250m ≤ Limit 750m with correct units = resources: requests: cpu: "250m" limits: cpu: "750m" [OK]

Hint: Use millicores with 'm' and keep request ≤ limit [OK]

Common Mistakes:

• Swapping request and limit values
• Using decimal numbers without quotes
• Not using millicores for fractional CPU