Why scaling requires different strategies in MLOps - Test Your Understanding

Practice - 5 Tasks

1fill in blank

easy

Complete the code to print the main reason why scaling needs different strategies.

MLOps

print('Scaling requires different strategies because of [1].')

Drag options to blanks, or click blank then click option'

Asingle user

Bsame hardware

Cfixed costs

Dvarying workloads

Attempts:

3 left

💡 Hint

Common Mistakes

Choosing 'same hardware' which is not the main reason.

Thinking costs are fixed.

Scaling needs different strategies because workloads can vary a lot, so one size does not fit all.

2fill in blank

medium

Complete the sentence to explain a key challenge in scaling machine learning models.

MLOps

One challenge in scaling ML models is handling [1] data efficiently.

Drag options to blanks, or click blank then click option'

Alarge

Bstatic

Csmall

Dclean

Attempts:

3 left

💡 Hint

Common Mistakes

Choosing 'small' which is opposite of the challenge.

Selecting 'clean' which is about data quality, not size.

Handling large data efficiently is a key challenge when scaling ML models.

3fill in blank

hard

Fix the error in the statement about scaling strategies.

MLOps

Scaling strategies must consider [1] and resource limits.

Drag options to blanks, or click blank then click option'

Auser interface

Bhardware uniformity

Cnetwork latency

Dsingle-threading

Attempts:

3 left

💡 Hint

Common Mistakes

Choosing 'hardware uniformity' which is less relevant.

Selecting 'user interface' which is unrelated.

Network latency affects how scaling strategies perform, so it must be considered.

4fill in blank

hard

Fill both blanks to complete the scaling strategy code snippet.

MLOps

if workload [1] threshold:
    use [2] scaling

Drag options to blanks, or click blank then click option'

A>

Bhorizontal

Cvertical

D<

Attempts:

3 left

💡 Hint

Common Mistakes

Using '<' which reverses the logic.

Choosing vertical scaling when workload is high.

If workload is greater than a threshold, horizontal scaling is used to add more machines.

5fill in blank

hard

Fill all three blanks to complete the dictionary comprehension for scaling decisions.

MLOps

scaling_decisions = {model: '[1]' if load [2] limit else '[3]' for model, load in loads.items()}

Drag options to blanks, or click blank then click option'

Ascale horizontally

B>

Cscale vertically

D<

Attempts:

3 left

💡 Hint

Common Mistakes

Using '<' which reverses the condition.

Mixing up horizontal and vertical scaling.

If load is greater than limit, scale horizontally; otherwise, scale vertically.

Practice

1. Why do systems need different scaling strategies as they grow?

easy

A. Because all systems grow at the same speed

B. Because scaling always means adding more machines

C. Because different growth patterns require different resource management

D. Because vertical scaling is always better than horizontal scaling

Solution

1. Step 1: Understand system growth patterns

   Systems grow in different ways, such as more users or more data, which affects resource needs differently.

2. Step 2: Match scaling strategy to growth type

   Different growth types require different scaling approaches to manage resources efficiently and keep performance.

3. Final Answer:

   Because different growth patterns require different resource management -> Option C

4. Quick Check:

   Growth patterns = Different strategies [OK]

Hint: Match scaling to how system grows for best results [OK]

Common Mistakes:

• Assuming one scaling method fits all
• Thinking scaling always means adding machines
• Ignoring resource limits of single machines

2. Which of the following is the correct way to describe vertical scaling?

easy

A. Adding more machines to handle more load

B. Making a single machine more powerful by adding CPU or RAM

C. Splitting data across multiple databases

D. Reducing the number of users on the system

Solution

1. Step 1: Define vertical scaling

   Vertical scaling means improving one machine's capacity by adding resources like CPU or memory.

2. Step 2: Compare options

   Making a single machine more powerful by adding CPU or RAM matches this definition; others describe horizontal scaling or unrelated actions.

3. Final Answer:

   Making a single machine more powerful by adding CPU or RAM -> Option B

4. Quick Check:

   Vertical scaling = stronger single machine [OK]

Hint: Vertical scaling = upgrade one machine's power [OK]

Common Mistakes:

• Confusing vertical with horizontal scaling
• Thinking vertical scaling means adding machines
• Selecting unrelated options like reducing users

3. Consider a system that uses horizontal scaling by adding identical servers behind a load balancer. What is the main benefit of this approach?

medium

A. It allows the system to handle more users by distributing load

B. It simplifies the software by using only one server

C. It reduces the need for network connections

D. It increases the power of a single server

Solution

1. Step 1: Understand horizontal scaling

   Horizontal scaling adds more servers to share the workload, improving capacity.

2. Step 2: Identify benefit of load balancing

   Load balancers distribute user requests across servers, allowing more users to be served efficiently.

3. Final Answer:

   It allows the system to handle more users by distributing load -> Option A

4. Quick Check:

   Horizontal scaling = distribute load [OK]

Hint: More servers = more users handled [OK]

Common Mistakes:

• Thinking horizontal scaling powers one server
• Believing it reduces network needs
• Assuming it simplifies software to one server

4. A team tried to scale their ML model serving by only upgrading the CPU and RAM of one server, but the system still slowed down under heavy user load. What is the likely problem?

medium

A. They must have a bug in the model code

B. They needed to reduce the model size instead

C. They should have used a faster programming language

D. They should have added more servers instead of upgrading one

Solution

1. Step 1: Analyze the scaling approach

   Upgrading one server is vertical scaling, which has limits and may not handle very high loads.

2. Step 2: Identify better scaling strategy

   Adding more servers (horizontal scaling) distributes load and improves performance under heavy use.

3. Final Answer:

   They should have added more servers instead of upgrading one -> Option D

4. Quick Check:

   Heavy load needs horizontal scaling [OK]

Hint: Heavy load? Add servers, not just power [OK]

Common Mistakes:

• Blaming model size without checking scaling
• Assuming programming language causes slowdown
• Ignoring scaling limits of single server

5. You manage an ML system that processes large datasets and serves predictions to many users. Vertical scaling is costly and limited. Which combined strategy best balances cost, performance, and reliability?

hard

A. Use horizontal scaling with multiple servers and optimize model efficiency

B. Only upgrade the biggest server continuously

C. Reduce the number of users to fit one server

D. Switch to a simpler model without scaling

Solution

1. Step 1: Evaluate vertical scaling limits

   Vertical scaling is costly and hits hardware limits, so relying on it alone is not sustainable.

2. Step 2: Combine horizontal scaling and optimization

   Adding servers (horizontal scaling) spreads load, while optimizing the model reduces resource use, balancing cost and performance.

3. Step 3: Consider reliability

   Multiple servers improve fault tolerance, making the system more reliable than a single powerful server.

4. Final Answer:

   Use horizontal scaling with multiple servers and optimize model efficiency -> Option A

5. Quick Check:

   Combine horizontal scaling + optimization = best balance [OK]

Hint: Combine adding servers with model optimization [OK]

Common Mistakes:

• Relying only on vertical scaling
• Ignoring user demand growth
• Choosing to reduce users instead of scaling
• Dropping scaling for simpler models only