Horizontal Pod Autoscaler in Kubernetes - Mini Project: Build & Apply

Horizontal Pod Autoscaler

📖 Scenario: You manage a web application running on Kubernetes. To handle varying user traffic, you want to automatically adjust the number of pods based on CPU usage.

🎯 Goal: Learn how to create a Horizontal Pod Autoscaler (HPA) in Kubernetes that scales the number of pods of a deployment based on CPU usage.

📋 What You'll Learn

Create a deployment named webapp with 2 replicas

Add resource requests for CPU in the deployment

Create a Horizontal Pod Autoscaler targeting the webapp deployment

Set the CPU utilization target to 50%

Verify the HPA configuration

💡 Why This Matters

🌍 Real World

Horizontal Pod Autoscaler helps keep applications responsive by automatically adjusting the number of pods based on CPU load, just like how a car adjusts speed based on traffic.

💼 Career

Understanding HPA is essential for Kubernetes administrators and DevOps engineers to ensure applications scale efficiently and cost-effectively.

1

Create a deployment named webapp with 2 replicas

Write a Kubernetes deployment YAML named webapp-deployment.yaml that creates a deployment called webapp with 2 replicas running the image nginx. Include container port 80.

Kubernetes

# Write the deployment YAML with name 'webapp', 2 replicas, image 'nginx', and container port 80
# Your code here

Hint

Use kind: Deployment, set replicas: 2, and specify image: nginx with port 80.

2

Add CPU resource requests to the deployment

In the webapp-deployment.yaml, add CPU resource requests of 100m under resources.requests.cpu for the container named nginx.

Kubernetes

apiVersion: apps/v1
kind: Deployment
metadata:
  name: webapp
spec:
  replicas: 2
  selector:
    matchLabels:
      app: webapp
  template:
    metadata:
      labels:
        app: webapp
    spec:
      containers:
      - name: nginx
        image: nginx
        ports:
        - containerPort: 80
        # Add CPU resource requests of 100m below
        # Your code here

Hint

Under the container, add resources: then requests: with cpu: 100m.

3

Create a Horizontal Pod Autoscaler targeting the webapp deployment

Write a YAML file named webapp-hpa.yaml that creates a Horizontal Pod Autoscaler targeting the deployment webapp. Set the minimum replicas to 2, maximum replicas to 5, and target average CPU utilization to 50%.

Kubernetes

apiVersion: apps/v1
kind: Deployment
metadata:
  name: webapp
spec:
  replicas: 2
  selector:
    matchLabels:
      app: webapp
  template:
    metadata:
      labels:
        app: webapp
    spec:
      containers:
      - name: nginx
        image: nginx
        ports:
        - containerPort: 80
        resources:
          requests:
            cpu: 100m

# Write the Horizontal Pod Autoscaler YAML below
# Your code here

Hint

Use kind: HorizontalPodAutoscaler, set scaleTargetRef to deployment webapp, and set CPU target to 50%.

4

Display the Horizontal Pod Autoscaler status

Write the exact command to display the status of the Horizontal Pod Autoscaler named webapp-hpa in the default namespace.

Kubernetes

apiVersion: apps/v1
kind: Deployment
metadata:
  name: webapp
spec:
  replicas: 2
  selector:
    matchLabels:
      app: webapp
  template:
    metadata:
      labels:
        app: webapp
    spec:
      containers:
      - name: nginx
        image: nginx
        ports:
        - containerPort: 80
        resources:
          requests:
            cpu: 100m
---
apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
  name: webapp-hpa
spec:
  scaleTargetRef:
    apiVersion: apps/v1
    kind: Deployment
    name: webapp
  minReplicas: 2
  maxReplicas: 5
  metrics:
  - type: Resource
    resource:
      name: cpu
      target:
        type: Utilization
        averageUtilization: 50

# Write the kubectl command to show the HPA status
# Your code here

Hint

Use kubectl get hpa webapp-hpa to see the autoscaler status.

Practice

1. What is the main purpose of a Horizontal Pod Autoscaler (HPA) in Kubernetes?

easy

A. Manually increase pod count when needed

B. Automatically adjust the number of pods based on resource usage

C. Scale the number of nodes in the cluster

D. Backup pod data automatically

Solution

1. Step 1: Understand HPA functionality

   HPA monitors resource usage like CPU or memory and adjusts pod count automatically.

2. Step 2: Differentiate from other scaling types

   HPA scales pods, not nodes or manual actions, and does not handle backups.

3. Final Answer:

   Automatically adjust the number of pods based on resource usage -> Option B

4. Quick Check:

   HPA = automatic pod scaling [OK]

Hint: HPA changes pod count automatically by resource use [OK]

Common Mistakes:

• Confusing HPA with manual scaling
• Thinking HPA scales nodes instead of pods
• Assuming HPA handles backups

2. Which of the following is the correct command to create a Horizontal Pod Autoscaler for a deployment named webapp targeting 50% CPU usage with minimum 2 and maximum 5 pods?

easy

A. kubectl autoscale deployment webapp --cpu=50 --min=2 --max=5

B. kubectl create hpa webapp --cpu=50 --min-pods=2 --max-pods=5

C. kubectl autoscale deployment webapp --cpu-percent=50 --min=2 --max=5

D. kubectl autoscale deployment webapp --cpu-percent=50 --min-pods=2 --max-pods=5

Solution

1. Step 1: Recall correct kubectl autoscale syntax

   The correct command is kubectl autoscale deployment [name] --cpu-percent=[value] --min=[minPods] --max=[maxPods].

2. Step 2: Match options with correct syntax

   kubectl autoscale deployment webapp --cpu-percent=50 --min=2 --max=5 matches the correct syntax exactly with proper flags and values.

3. Final Answer:

   kubectl autoscale deployment webapp --cpu-percent=50 --min=2 --max=5 -> Option C

4. Quick Check:

   Correct autoscale syntax = kubectl autoscale deployment webapp --cpu-percent=50 --min=2 --max=5 [OK]

Hint: Use kubectl autoscale with --cpu-percent, --min, --max [OK]

Common Mistakes:

• Using wrong flags like --min-pods or --cpu
• Misspelling 'autoscale' or 'deployment'
• Omitting required flags

3. Given this HPA YAML snippet:

apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
  name: myapp-hpa
spec:
  scaleTargetRef:
    apiVersion: apps/v1
    kind: Deployment
    name: myapp
  minReplicas: 1
  maxReplicas: 4
  metrics:
  - type: Resource
    resource:
      name: cpu
      target:
        type: Utilization
        averageUtilization: 60

What happens if the CPU usage stays at 80% for a while?

medium

A. The number of pods will increase up to 4 to reduce CPU load

B. The number of pods will decrease to 1

C. The number of pods will stay the same regardless of CPU

D. The deployment will be deleted automatically

Solution

1. Step 1: Understand HPA scaling behavior

   HPA increases pods when CPU usage exceeds target averageUtilization (60%). Here CPU is 80%, which is higher.

2. Step 2: Check min and max replicas limits

   Pods can scale between 1 and 4. Since CPU is high, pods will increase up to max 4 to reduce load.

3. Final Answer:

   The number of pods will increase up to 4 to reduce CPU load -> Option A

4. Quick Check:

   CPU > target => pods increase [OK]

Hint: CPU above target means pods scale up within min-max [OK]

Common Mistakes:

• Thinking pods scale down when CPU is high
• Ignoring min/max replica limits
• Assuming deployment deletion on high CPU

4. You applied this HPA YAML but it does not scale pods as expected:

apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
  name: test-hpa
spec:
  scaleTargetRef:
    apiVersion: apps/v1
    kind: Deployment
    name: test-app
  minReplicas: 2
  maxReplicas: 5
  metrics:
  - type: Resource
    resource:
      name: memory
      target:
        type: Utilization
        averageUtilization: 70

What is the most likely reason for no scaling?

medium

A. The pods do not expose memory metrics, so HPA has no data

B. minReplicas is set too low

C. maxReplicas is less than minReplicas

D. The deployment name is incorrect

Solution

1. Step 1: Check metric type and data availability

   HPA needs metrics from pods. If memory metrics are not exposed or collected, HPA cannot scale.

2. Step 2: Verify other spec values

   minReplicas and maxReplicas are valid (2 and 5). Deployment name looks correct. So likely missing metrics cause no scaling.

3. Final Answer:

   The pods do not expose memory metrics, so HPA has no data -> Option A

4. Quick Check:

   Missing metrics = no scaling [OK]

Hint: HPA needs metrics; no metrics means no scaling [OK]

Common Mistakes:

• Assuming minReplicas too low stops scaling
• Confusing minReplicas and maxReplicas values
• Ignoring metric availability

5. You want to create an HPA that scales a deployment named api-server based on both CPU usage (target 70%) and custom metric requests_per_second (target 100). The minimum pods should be 3 and maximum 10. Which YAML snippet correctly defines this HPA?

hard

A. apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
name: api-server-hpa
spec:
scaleTargetRef:
apiVersion: apps/v1
kind: Deployment
name: api-server
minReplicas: 3
maxReplicas: 10
metrics:
- type: Resource
resource:
name: cpu
target:
type: Utilization
averageUtilization: 70
- type: Resource
resource:
name: requests_per_second
target:
type: AverageValue
averageValue: "100"

B. apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
name: api-server-hpa
spec:
scaleTargetRef:
apiVersion: apps/v1
kind: Deployment
name: api-server
minReplicas: 3
maxReplicas: 10
metrics:
- type: Resource
resource:
name: cpu
target:
type: AverageValue
averageValue: "70"
- type: Pods
pods:
metric:
name: requests_per_second
target:
type: AverageValue
averageValue: "100"

C. apiVersion: autoscaling/v1
kind: HorizontalPodAutoscaler
metadata:
name: api-server-hpa
spec:
scaleTargetRef:
apiVersion: apps/v1
kind: Deployment
name: api-server
minReplicas: 3
maxReplicas: 10
targetCPUUtilizationPercentage: 70

D. apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
metadata:
name: api-server-hpa
spec:
scaleTargetRef:
apiVersion: apps/v1
kind: Deployment
name: api-server
minReplicas: 3
maxReplicas: 10
metrics:
- type: Resource
resource:
name: cpu
target:
type: Utilization
averageUtilization: 70
- type: Pods
pods:
metric:
name: requests_per_second
target:
type: AverageValue
averageValue: "100"

Solution

1. Step 1: Use autoscaling/v2 API for multiple metrics

   autoscaling/v2 supports multiple metrics including resource and custom metrics.

2. Step 2: Check metric types and targets

   CPU uses type Utilization with averageUtilization; custom metric uses type Pods with metric name and AverageValue target.

3. Step 3: Verify minReplicas and maxReplicas

   Minimum 3 and maximum 10 pods are correctly set in spec.

4. Final Answer:

   YAML with cpu resource metric (Utilization) and pods metric for requests_per_second -> Option D

5. Quick Check:

   Multiple metrics with correct types = apiVersion: autoscaling/v2 kind: HorizontalPodAutoscaler metadata: name: api-server-hpa spec: scaleTargetRef: apiVersion: apps/v1 kind: Deployment name: api-server minReplicas: 3 maxReplicas: 10 metrics: - type: Resource resource: name: cpu target: type: Utilization averageUtilization: 70 - type: Pods pods: metric: name: requests_per_second target: type: AverageValue averageValue: "100" [OK]

Hint: Use autoscaling/v2 with resource and pods metrics for multiple targets [OK]

Common Mistakes:

• Using autoscaling/v1 which does not support multiple metrics
• Wrong metric types or target fields
• Mixing resource and custom metric syntax incorrectly