Why CI/CD differs for ML vs software in MLOps - Challenge Your Understanding

Challenge - 5 Problems

🧠 Conceptual

intermediate

Key difference in CI/CD pipelines for ML vs traditional software

Which of the following best explains why CI/CD pipelines for machine learning projects differ from those for traditional software projects?

A ML pipelines only deploy code without testing, while traditional software pipelines include testing.

B Traditional software pipelines require model retraining, but ML pipelines do not.

C Traditional software pipelines always use containers, but ML pipelines never use containers.

D ML pipelines must handle data versioning and model training, unlike traditional software which focuses only on code changes.

💡 Hint

Think about what extra elements ML projects need to manage compared to software projects.

ML pipelines must manage data and model lifecycle, including versioning and retraining, which traditional software pipelines do not.

💻 Command Output

intermediate

Output of a model training step in ML CI/CD pipeline

What is the expected output when running a model training script in an ML CI/CD pipeline that logs metrics?

MLOps

python train.py --log-metrics

# Assume train.py prints training accuracy and loss

A Training accuracy: 0.92\nTraining loss: 0.15\nModel saved to /models/model_v1.pkl

B SyntaxError: invalid syntax on line 3

C Error: Missing data file for training

D Training accuracy: 0.50\nTraining loss: 1.2\nModel saved to /models/model_v1.pkl

💡 Hint

Look for a successful training output with high accuracy and saved model.

The training script outputs accuracy and loss metrics and confirms the model is saved, indicating successful training.

🔀 Workflow

advanced

Order of steps in an ML CI/CD pipeline

Arrange the following steps in the correct order for a typical ML CI/CD pipeline.

A 3,2,1,4

B 1,3,2,4

C 1,2,3,4

D 2,1,3,4

💡 Hint

Think about validating data before training, then evaluating before deploying.

Data validation comes first to ensure quality data, followed by training, evaluation to check model quality, then deployment.

❓ Troubleshoot

advanced

Troubleshooting model deployment failure in ML CI/CD

A model deployment step in your ML CI/CD pipeline fails with the error: 'Model file not found'. What is the most likely cause?

A The model training step did not save the model file to the expected location.

B The deployment script has a syntax error causing failure.

C The data validation step failed and stopped the pipeline.

D The model evaluation metrics were too low.

💡 Hint

Consider what the deployment step needs from previous steps.

If the model file is missing, it usually means the training step did not save it correctly or in the expected path.

✅ Best Practice

expert

Best practice for versioning in ML CI/CD pipelines

Which versioning strategy is best practice for managing ML models and data in CI/CD pipelines?

A Only version the code; data and models do not need versioning.

B Use semantic versioning for code and separate versioning for data and models with unique hashes.

C Version models by date only, ignoring code changes.

D Use the same version number for code, data, and models regardless of changes.

💡 Hint

Think about how to track changes in code, data, and models independently.

Best practice is to version code semantically and track data and models with unique identifiers like hashes to ensure reproducibility.