Auto-scaling inference endpoints in MLOps - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to define the minimum number of instances for auto-scaling.

MLOps

auto_scaling_config = {
    "MinInstances": [1],
    "MaxInstances": 10
}

Drag options to blanks, or click blank then click option'

A0

B10

C1

D5

Attempts:

3 left

💡 Hint

Common Mistakes

Setting MinInstances to 0 disables the endpoint availability.

The minimum number of instances must be at least 1 to keep the endpoint available.

2fill in blank

medium

Complete the code to set the target CPU utilization percentage for scaling.

MLOps

auto_scaling_config = {
    "TargetCPUUtilization": [1]
}

Drag options to blanks, or click blank then click option'

A50

B10

C90

D110

Attempts:

3 left

💡 Hint

Common Mistakes

Setting target above 100% is invalid and causes errors.

50% CPU utilization is a common target to balance performance and cost.

3fill in blank

hard

Fix the error in the auto-scaling policy by completing the missing field.

MLOps

auto_scaling_policy = {
    "PolicyName": "ScaleOutPolicy",
    "AdjustmentType": [1],
    "ScalingAdjustment": 2
}

Drag options to blanks, or click blank then click option'

APercentChangeInCapacity

BChangeInCapacity

CExactCapacity

DInvalidType

Attempts:

3 left

💡 Hint

Common Mistakes

Using unsupported adjustment types causes policy errors.

"ChangeInCapacity" is a valid adjustment type to increase instances by a fixed number.

4fill in blank

hard

Fill both blanks to create a scaling rule that triggers when CPU usage is above 70%.

MLOps

scaling_rule = {
    "MetricName": [1],
    "Threshold": [2]
}

Drag options to blanks, or click blank then click option'

A"CPUUtilization"

B"MemoryUsage"

C70

D30

Attempts:

3 left

💡 Hint

Common Mistakes

Using memory metric or wrong threshold values.

The metric to monitor is CPU utilization, and the threshold is set to 70%.

5fill in blank

hard

Fill all three blanks to define a complete auto-scaling configuration with min, max, and target CPU utilization.

MLOps

auto_scaling_config = {
    "MinInstances": [1],
    "MaxInstances": [2],
    "TargetCPUUtilization": [3]
}

Drag options to blanks, or click blank then click option'

A1

B50

C10

D5

Attempts:

3 left

💡 Hint

Common Mistakes

Mixing up min and max values or setting invalid CPU targets.

Minimum instances is 1, maximum is 10, and target CPU utilization is 50%.