Model optimization for serving (quantization, pruning) in MLOps - Mini Project: Build & Apply

Model Optimization for Serving with Quantization and Pruning

📖 Scenario: You work as a machine learning engineer preparing a model for deployment. To make the model faster and smaller for serving, you will apply two common optimization techniques: quantization and pruning.Quantization reduces the precision of the model weights to save space and speed up inference. Pruning removes less important weights to make the model lighter.

🎯 Goal: Build a simple Python script that simulates model weights as a dictionary, applies pruning by removing small weights, and applies quantization by rounding weights to fewer decimal places. Finally, display the optimized model weights.

📋 What You'll Learn

Create a dictionary called model_weights with specific float values representing weights.

Create a variable called prune_threshold to decide which weights to remove.

Use a dictionary comprehension to prune weights below the threshold and quantize remaining weights by rounding.

Print the final optimized model_weights dictionary.

💡 Why This Matters

🌍 Real World

Optimizing machine learning models before deployment helps reduce memory use and speeds up predictions, which is critical for real-time applications like voice assistants or recommendation systems.

💼 Career

Understanding model optimization techniques like pruning and quantization is essential for MLOps engineers and data scientists working to deploy efficient, scalable AI services.

1

Create initial model weights dictionary

Create a dictionary called model_weights with these exact entries: 'layer1': 0.2567, 'layer2': 0.0345, 'layer3': 0.7891, 'layer4': 0.0123, 'layer5': 0.4567.

MLOps

# Create the model_weights dictionary with given weights
# Your code here

Need a hint?

Use curly braces to create a dictionary with keys as layer names and values as floats.

2

Set pruning threshold

Create a variable called prune_threshold and set it to 0.05. This will be the cutoff below which weights are removed.

MLOps

model_weights = {'layer1': 0.2567, 'layer2': 0.0345, 'layer3': 0.7891, 'layer4': 0.0123, 'layer5': 0.4567}
# Create prune_threshold variable and set to 0.05
# Your code here

Need a hint?

Just assign the value 0.05 to the variable prune_threshold.

3

Apply pruning and quantization

Use a dictionary comprehension to create a new model_weights dictionary that only keeps weights greater than prune_threshold. Round each kept weight to 2 decimal places to simulate quantization.

MLOps

model_weights = {'layer1': 0.2567, 'layer2': 0.0345, 'layer3': 0.7891, 'layer4': 0.0123, 'layer5': 0.4567}
prune_threshold = 0.05
# Use dictionary comprehension to prune and quantize weights
# Your code here

Need a hint?

Use {layer: round(weight, 2) for layer, weight in model_weights.items() if weight > prune_threshold} to filter and round weights.

4

Display optimized model weights

Write a print statement to display the final model_weights dictionary.

MLOps

model_weights = {'layer1': 0.2567, 'layer2': 0.0345, 'layer3': 0.7891, 'layer4': 0.0123, 'layer5': 0.4567}
prune_threshold = 0.05
model_weights = {layer: round(weight, 2) for layer, weight in model_weights.items() if weight > prune_threshold}
# Print the optimized model_weights dictionary
# Your code here

Need a hint?

Use print(model_weights) to show the final dictionary.