Logging artifacts and models in MLOps - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is an artifact in the context of ML model logging?

An artifact is any file or data generated during the ML process, such as model files, datasets, or logs, that you save for tracking and reuse.

beginner

Why do we log ML models during experiments?

Logging models helps keep track of different versions, parameters, and results so you can compare, reproduce, and deploy the best model easily.

beginner

Name a common tool used for logging artifacts and models in ML projects.

MLflow is a popular tool that helps log, store, and manage ML artifacts and models in a structured way.

intermediate

What is the difference between logging an artifact and logging a model?

Logging an artifact can be any file like images or data, while logging a model specifically saves the trained model file and its metadata.

intermediate

How does logging artifacts and models improve collaboration in ML teams?

It creates a shared record of experiments and results, making it easier for team members to understand, reproduce, and build on each other's work.

What is typically considered an artifact in ML logging?

A User interface designs

B Only source code

C Model files and datasets

D Network configurations

Artifacts include model files, datasets, and logs generated during ML experiments.

Which tool is commonly used to log ML models and artifacts?

A MLflow

B Docker

C Kubernetes

D GitHub

MLflow is designed for tracking and managing ML experiments, including logging models and artifacts.

Why is logging models important in ML projects?

A To improve user interface

B To track versions and reproduce results

C To reduce dataset size

D To speed up training

Logging models helps track versions and reproduce experiments reliably.

Which of the following is NOT an artifact in ML logging?

A Trained model file

B Training dataset

C Experiment logs

D CPU hardware specs

CPU hardware specs are not typically logged as artifacts in ML experiments.

How does logging artifacts help ML teams?

A By sharing experiment data and results

B By deleting old models automatically

C By encrypting datasets

D By speeding up model training

Logging artifacts creates a shared record that helps teams collaborate and reproduce work.

Explain what artifacts and models are in ML logging and why they are important.

Think about files created during ML work and why saving them matters.

Describe how a tool like MLflow helps with logging artifacts and models in ML projects.

Consider how MLflow organizes and records your ML work.

Practice

1. What is the main purpose of logging artifacts and models in MLOps?

easy

A. To speed up model training

B. To delete old models automatically

C. To create new datasets from artifacts

D. To save files and models for tracking and reuse

Solution

1. Step 1: Understand the role of logging in MLOps

   Logging artifacts and models helps keep track of work and reuse it later.

2. Step 2: Identify the correct purpose

   Saving files and models for tracking and reuse matches the main goal of logging.

3. Final Answer:

   To save files and models for tracking and reuse -> Option D

4. Quick Check:

   Logging = Save and track work [OK]

Hint: Logging means saving work for later use [OK]

Common Mistakes:

• Thinking logging deletes models
• Confusing logging with speeding training
• Assuming logging creates new data

2. Which of the following is the correct syntax to log a file artifact using MLflow?

easy

A. mlflow.log_model('path/to/file.txt')

B. mlflow.log_artifact('path/to/file.txt')

C. mlflow.log_artifacts('path/to/file.txt')

D. mlflow.log('path/to/file.txt')

Solution

1. Step 1: Recall MLflow function for logging files

   The correct function is mlflow.log_artifact() for single files.

2. Step 2: Check syntax correctness

   mlflow.log_artifact('path/to/file.txt') matches the correct syntax.

3. Final Answer:

   mlflow.log_artifact('path/to/file.txt') -> Option B

4. Quick Check:

   Single file logging = log_artifact() [OK]

Hint: Use log_artifact() for single files [OK]

Common Mistakes:

• Using log_model() for files
• Using plural log_artifacts() incorrectly
• Using generic log() function

3. What will be the output of this code snippet?

import mlflow
with mlflow.start_run():
    mlflow.log_artifact('data.csv')
    mlflow.log_model(model, 'model')
print('Run finished')

medium

A. Error because model is not defined

B. Run finished printed; artifacts and model logged in current run

C. No output; code hangs

D. Run finished printed; but nothing logged

Solution

1. Step 1: Analyze the code snippet

   The code tries to log a file and a model inside a run.

2. Step 2: Check for errors

   The variable 'model' is not defined, so mlflow.log_model(model, 'model') causes a NameError.

3. Final Answer:

   Error because model is not defined -> Option A

4. Quick Check:

   Undefined variable causes error [OK]

Hint: Check if variables are defined before logging [OK]

Common Mistakes:

• Assuming code runs without defining model
• Thinking print means success
• Ignoring variable definitions

4. You run this code but no artifacts appear in MLflow UI:

mlflow.log_artifact('output.txt')

What is the most likely reason?

medium

A. log_artifact() only works inside a run

B. The file output.txt does not exist

C. No active MLflow run was started

D. MLflow server is down

Solution

1. Step 1: Understand MLflow run context

   Logging artifacts requires an active run to group logs.

2. Step 2: Identify missing run

   Without mlflow.start_run(), logs are not saved properly.

3. Final Answer:

   No active MLflow run was started -> Option C

4. Quick Check:

   Logging needs active run [OK]

Hint: Always start a run before logging [OK]

Common Mistakes:

• Assuming logging works without a run
• Ignoring file existence
• Blaming server without checking run

5. You want to log multiple files and a trained model in one MLflow run. Which code snippet correctly does this?

hard

A. with mlflow.start_run():
mlflow.log_artifact('file1.txt')
mlflow.log_artifact('file2.txt')
mlflow.log_model(model, 'model')

B. mlflow.log_artifact(['file1.txt', 'file2.txt'])
mlflow.log_model(model, 'model')

C. with mlflow.start_run():
mlflow.log_artifacts(['file1.txt', 'file2.txt'])
mlflow.log_model(model, 'model')

D. mlflow.start_run()
mlflow.log_artifact('file1.txt')
mlflow.log_artifacts('file2.txt')
mlflow.log_model(model, 'model')
mlflow.end_run()

Solution

1. Step 1: Identify correct way to log multiple files

   For multiple individual files, call mlflow.log_artifact() for each file.

2. Step 2: Confirm run context and model logging

   Using with mlflow.start_run(): ensures proper context; logs each file and the model correctly.

3. Final Answer:

   with mlflow.start_run(): mlflow.log_artifact('file1.txt') mlflow.log_artifact('file2.txt') mlflow.log_model(model, 'model') -> Option A

4. Quick Check:

   Multiple files = log_artifact() for each inside run [OK]

Hint: Call log_artifact() for each file inside a run [OK]

Common Mistakes:

• Passing list to log_artifacts()
• Not using a run context
• Using log_artifacts() on single file