MLflow setup and basics in MLOps - Step-by-Step Execution

Process Flow - MLflow setup and basics

Install MLflow

↓

Start MLflow Tracking Server

↓

Run MLflow Experiment

↓

Log Parameters, Metrics, Artifacts

↓

View Results in MLflow UI

↓

Stop MLflow Server

This flow shows the basic steps to set up MLflow: install, start server, run experiments with logging, view results, and stop server.

Execution Sample

MLOps

pip install mlflow
mlflow ui

import mlflow
with mlflow.start_run():
    mlflow.log_param("alpha", 0.5)
    mlflow.log_metric("rmse", 0.75)

This code installs MLflow, starts the UI server, and logs a parameter and metric in an experiment.

Process Table

Step	Action	Command/Code	Result/Output
1	Install MLflow	pip install mlflow	MLflow installed successfully
2	Start MLflow UI server	mlflow ui	MLflow UI running at http://localhost:5000
3	Import MLflow in script	import mlflow	MLflow module loaded
4	Start MLflow run	mlflow.start_run()	MLflow tracking run started
5	Log parameter	mlflow.log_param("alpha", 0.5)	Parameter 'alpha' logged with value 0.5
6	Log metric	mlflow.log_metric("rmse", 0.75)	Metric 'rmse' logged with value 0.75
7	View experiment in UI	Open http://localhost:5000	Logged params and metrics visible in UI
8	Stop MLflow UI server	Ctrl+C in terminal	MLflow UI server stopped

💡 MLflow UI server stopped by user, ending session

Status Tracker

Variable	Start	After Step 5	After Step 6	Final
alpha	undefined	0.5	0.5	0.5
rmse	undefined	undefined	0.75	0.75

Key Moments - 3 Insights

Why do we need to start the MLflow UI server separately?

The MLflow UI server (step 2) runs as a separate process to show experiment results in a web browser. Without starting it, you cannot view logged data visually.

What happens if you log a parameter or metric without starting the MLflow server?

Logging parameters or metrics (steps 5 and 6) still works locally, but you won't see them in the UI until the server is running and pointed to the correct tracking location.

Can you log multiple parameters and metrics in one run?

Yes, you can log many parameters and metrics in one experiment run. Each call adds data to the current run, as shown in steps 5 and 6.

Visual Quiz - 3 Questions

Look at the execution table, what is the output after running 'mlflow.log_param("alpha", 0.5)'?

A MLflow module loaded

B MLflow UI running at http://localhost:5000

C Parameter 'alpha' logged with value 0.5

D Metric 'rmse' logged with value 0.75

💡 Hint

Check Step 5 in the execution table for the result of logging a parameter.

At which step does the MLflow UI server start running?

A Step 1

B Step 2

C Step 3

D Step 6

💡 Hint

Look for the step where the command 'mlflow ui' is executed.

If you skip step 2 (starting MLflow UI), what will you miss?

A Viewing experiment results in a web browser

B Installing MLflow

C Logging parameters

D Importing MLflow module

💡 Hint

Refer to the key moment about the purpose of the MLflow UI server.

Concept Snapshot

MLflow setup basics:
1. Install MLflow with 'pip install mlflow'.
2. Start UI server using 'mlflow ui' to view experiments.
3. In code, import mlflow, start run with 'mlflow.start_run()', and log parameters/metrics.
4. View results at http://localhost:5000.
5. Stop server with Ctrl+C when done.

Full Transcript

This visual execution guide shows how to set up MLflow for tracking machine learning experiments. First, install MLflow using pip. Then start the MLflow UI server with 'mlflow ui' to view experiment results in a browser. In your Python script, import mlflow, start a run, and log parameters and metrics using mlflow.log_param and mlflow.log_metric. These logs are saved and can be viewed in the UI. Finally, stop the MLflow server when finished. The execution table traces each step with commands and outputs, while the variable tracker shows how logged values change. Key moments clarify common confusions like why the UI server is needed. The quiz tests understanding of the setup and logging process.

Practice

1. What is the primary purpose of MLflow in machine learning projects?

easy

A. To deploy machine learning models to mobile devices

B. To write machine learning algorithms from scratch

C. To create datasets for training models

D. To track and organize machine learning experiments

Solution

1. Step 1: Understand MLflow's role

   MLflow is designed to help manage and track experiments, not to build models or datasets.

2. Step 2: Identify the correct purpose

   Tracking and organizing experiments is the core feature of MLflow.

3. Final Answer:

   To track and organize machine learning experiments -> Option D

4. Quick Check:

   MLflow = experiment tracking [OK]

Hint: Remember MLflow tracks experiments, not builds models [OK]

Common Mistakes:

• Confusing MLflow with model building libraries
• Thinking MLflow creates datasets
• Assuming MLflow deploys models directly

2. Which command correctly installs MLflow using pip?

easy

A. pip install mlflow

B. pip get mlflow

C. install mlflow pip

D. pip mlflow install

Solution

1. Step 1: Recall pip install syntax

   The correct syntax to install a package is 'pip install package_name'.

2. Step 2: Match the command

   Only 'pip install mlflow' matches the correct syntax.

3. Final Answer:

   pip install mlflow -> Option A

4. Quick Check:

   pip install + package = correct [OK]

Hint: Use 'pip install' followed by package name [OK]

Common Mistakes:

• Using incorrect order of words
• Using 'pip get' instead of 'pip install'
• Omitting 'install' keyword

3. What happens when you run the command mlflow ui in your terminal?

medium

A. It starts a web interface to view and compare ML experiments

B. It installs MLflow on your system

C. It runs your machine learning model training

D. It deletes all previous MLflow experiments

Solution

1. Step 1: Understand the 'mlflow ui' command

   This command launches the MLflow tracking server's web interface.

2. Step 2: Identify the effect

   The UI lets users view and compare experiments visually in a browser.

3. Final Answer:

   It starts a web interface to view and compare ML experiments -> Option A

4. Quick Check:

   mlflow ui = launch web UI [OK]

Hint: Think 'ui' means user interface for experiments [OK]

Common Mistakes:

• Confusing UI launch with installation
• Assuming it runs training automatically
• Thinking it deletes experiments

4. You try to start MLflow UI with mlflow ui but get an error saying 'command not found'. What is the most likely cause?

medium

A. You need to run 'mlflow start' instead

B. Your Python version is too new for MLflow

C. MLflow is not installed or not in your system PATH

D. You must run the command inside a Jupyter notebook

Solution

1. Step 1: Analyze the error message

   'command not found' means the system cannot locate the 'mlflow' command.

2. Step 2: Identify common causes

   This usually happens if MLflow is not installed or its executable is not in the system PATH.

3. Final Answer:

   MLflow is not installed or not in your system PATH -> Option C

4. Quick Check:

   Command not found = missing install or PATH [OK]

Hint: Check if MLflow is installed and in PATH [OK]

Common Mistakes:

• Trying wrong commands like 'mlflow start'
• Blaming Python version without checking install
• Assuming it must run inside Jupyter

5. You want to create a new MLflow experiment named 'MyExperiment' and log a parameter 'alpha' with value 0.5 in a Python script. Which code snippet correctly does this?

hard

A. import mlflow
mlflow.create_experiment('MyExperiment')
mlflow.log_param('alpha', 0.5)

B. import mlflow
mlflow.set_experiment('MyExperiment')
with mlflow.start_run():
mlflow.log_param('alpha', 0.5)

C. import mlflow
mlflow.start_experiment('MyExperiment')
mlflow.log_param('alpha', 0.5)

D. import mlflow
mlflow.set_experiment('MyExperiment')
mlflow.log_param('alpha', 0.5)

Solution

1. Step 1: Set the experiment name

   Use mlflow.set_experiment('MyExperiment') to select or create the experiment.

2. Step 2: Start a run and log parameters

   Use 'with mlflow.start_run():' block to start a run, then log parameters inside it.

3. Step 3: Identify correct snippet

   import mlflow mlflow.set_experiment('MyExperiment') with mlflow.start_run(): mlflow.log_param('alpha', 0.5) correctly uses set_experiment, start_run context, and logs parameter.

4. Final Answer:

   import mlflow mlflow.set_experiment('MyExperiment') with mlflow.start_run(): mlflow.log_param('alpha', 0.5) -> Option B

5. Quick Check:

   Set experiment + start run + log param = correct [OK]

Hint: Always start a run before logging parameters [OK]

Common Mistakes:

• Logging parameters outside a run
• Using non-existent functions like create_experiment
• Not using 'with' block for start_run