Why scaling requires different strategies in MLOps - Quick Recap

Recall & Review

beginner

What does scaling mean in the context of MLOps?

Scaling means adjusting resources or processes to handle more data, users, or workload efficiently in machine learning operations.

beginner

Why can't one scaling strategy fit all situations in MLOps?

Because different workloads, data sizes, and system architectures need specific approaches to maintain performance and cost-effectiveness.

beginner

What is horizontal scaling?

Adding more machines or instances to share the workload, like adding more cooks in a kitchen to prepare more meals.

beginner

What is vertical scaling?

Increasing the power of a single machine, like giving a cook better tools to work faster.

intermediate

How does data size affect scaling strategy in MLOps?

Large data may require distributed processing (horizontal scaling), while small data might be handled by upgrading a single machine (vertical scaling).

Which scaling strategy adds more machines to handle workload?

A Horizontal scaling

B Vertical scaling

C Diagonal scaling

D None of the above

Horizontal scaling means adding more machines or instances to share the workload.

Why do different scaling strategies matter in MLOps?

A Because all systems are the same

B Because only one strategy exists

C Because scaling is not needed

D Because workloads and data sizes vary

Different workloads and data sizes require different scaling strategies to be efficient.

What is vertical scaling?

A Adding more machines

B Increasing power of one machine

C Reducing workload

D Splitting data

Vertical scaling means upgrading a single machine's resources.

Which scenario best fits horizontal scaling?

A Small data on one powerful machine

B Single user workload

C Large data needing distributed processing

D No data processing

Large data often requires horizontal scaling with multiple machines.

What is a key reason to choose different scaling strategies?

A To save money and improve performance

B To make systems slower

C To confuse users

D To avoid using resources

Choosing the right scaling strategy helps save costs and keeps systems efficient.

Explain why scaling in MLOps requires different strategies depending on workload and data size.

Think about how adding machines or upgrading one machine affects performance.

Describe how choosing the wrong scaling strategy can affect an MLOps system.

Consider what happens if a small system tries to handle big data without proper scaling.

Practice

1. Why do systems need different scaling strategies as they grow?

easy

A. Because all systems grow at the same speed

B. Because scaling always means adding more machines

C. Because different growth patterns require different resource management

D. Because vertical scaling is always better than horizontal scaling

Solution

1. Step 1: Understand system growth patterns

   Systems grow in different ways, such as more users or more data, which affects resource needs differently.

2. Step 2: Match scaling strategy to growth type

   Different growth types require different scaling approaches to manage resources efficiently and keep performance.

3. Final Answer:

   Because different growth patterns require different resource management -> Option C

4. Quick Check:

   Growth patterns = Different strategies [OK]

Hint: Match scaling to how system grows for best results [OK]

Common Mistakes:

• Assuming one scaling method fits all
• Thinking scaling always means adding machines
• Ignoring resource limits of single machines

2. Which of the following is the correct way to describe vertical scaling?

easy

A. Adding more machines to handle more load

B. Making a single machine more powerful by adding CPU or RAM

C. Splitting data across multiple databases

D. Reducing the number of users on the system

Solution

1. Step 1: Define vertical scaling

   Vertical scaling means improving one machine's capacity by adding resources like CPU or memory.

2. Step 2: Compare options

   Making a single machine more powerful by adding CPU or RAM matches this definition; others describe horizontal scaling or unrelated actions.

3. Final Answer:

   Making a single machine more powerful by adding CPU or RAM -> Option B

4. Quick Check:

   Vertical scaling = stronger single machine [OK]

Hint: Vertical scaling = upgrade one machine's power [OK]

Common Mistakes:

• Confusing vertical with horizontal scaling
• Thinking vertical scaling means adding machines
• Selecting unrelated options like reducing users

3. Consider a system that uses horizontal scaling by adding identical servers behind a load balancer. What is the main benefit of this approach?

medium

A. It allows the system to handle more users by distributing load

B. It simplifies the software by using only one server

C. It reduces the need for network connections

D. It increases the power of a single server

Solution

1. Step 1: Understand horizontal scaling

   Horizontal scaling adds more servers to share the workload, improving capacity.

2. Step 2: Identify benefit of load balancing

   Load balancers distribute user requests across servers, allowing more users to be served efficiently.

3. Final Answer:

   It allows the system to handle more users by distributing load -> Option A

4. Quick Check:

   Horizontal scaling = distribute load [OK]

Hint: More servers = more users handled [OK]

Common Mistakes:

• Thinking horizontal scaling powers one server
• Believing it reduces network needs
• Assuming it simplifies software to one server

4. A team tried to scale their ML model serving by only upgrading the CPU and RAM of one server, but the system still slowed down under heavy user load. What is the likely problem?

medium

A. They must have a bug in the model code

B. They needed to reduce the model size instead

C. They should have used a faster programming language

D. They should have added more servers instead of upgrading one

Solution

1. Step 1: Analyze the scaling approach

   Upgrading one server is vertical scaling, which has limits and may not handle very high loads.

2. Step 2: Identify better scaling strategy

   Adding more servers (horizontal scaling) distributes load and improves performance under heavy use.

3. Final Answer:

   They should have added more servers instead of upgrading one -> Option D

4. Quick Check:

   Heavy load needs horizontal scaling [OK]

Hint: Heavy load? Add servers, not just power [OK]

Common Mistakes:

• Blaming model size without checking scaling
• Assuming programming language causes slowdown
• Ignoring scaling limits of single server

5. You manage an ML system that processes large datasets and serves predictions to many users. Vertical scaling is costly and limited. Which combined strategy best balances cost, performance, and reliability?

hard

A. Use horizontal scaling with multiple servers and optimize model efficiency

B. Only upgrade the biggest server continuously

C. Reduce the number of users to fit one server

D. Switch to a simpler model without scaling

Solution

1. Step 1: Evaluate vertical scaling limits

   Vertical scaling is costly and hits hardware limits, so relying on it alone is not sustainable.

2. Step 2: Combine horizontal scaling and optimization

   Adding servers (horizontal scaling) spreads load, while optimizing the model reduces resource use, balancing cost and performance.

3. Step 3: Consider reliability

   Multiple servers improve fault tolerance, making the system more reliable than a single powerful server.

4. Final Answer:

   Use horizontal scaling with multiple servers and optimize model efficiency -> Option A

5. Quick Check:

   Combine horizontal scaling + optimization = best balance [OK]

Hint: Combine adding servers with model optimization [OK]

Common Mistakes:

• Relying only on vertical scaling
• Ignoring user demand growth
• Choosing to reduce users instead of scaling
• Dropping scaling for simpler models only