Model stages (staging, production, archived) in MLOps - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the purpose of the staging stage in model deployment?

The staging stage is where a model is tested in an environment similar to production to catch issues before full deployment. It acts like a dress rehearsal for the model.

beginner

Define the production stage for a machine learning model.

Production is the live environment where the model serves real users or systems. It must be stable, reliable, and performant.

beginner

What does it mean when a model is archived?

Archived means the model is no longer actively used but kept for record, audit, or possible future reference.

intermediate

Why is it important to have separate stages like staging and production?

Separate stages help catch errors early, protect users from unstable models, and allow safe testing before full release.

intermediate

How does archiving a model help in managing machine learning projects?

Archiving keeps old models safe for audits, comparisons, or rollback without cluttering active environments.

What is the main goal of the staging stage?

A Test the model in a safe environment before production

B Serve real users with the model

C Delete old models

D Train the model

Staging is used to test the model in an environment similar to production before full deployment.

Which stage is the model actively used by end users?

A Production

B Archived

C Staging

D Training

Production is the live environment where the model serves real users.

What happens to a model in the archived stage?

A It is deleted permanently

B It is kept for record but not used

C It is actively updated

D It is tested

Archived models are stored for record or audit but are not actively used.

Why should you not deploy a model directly to production without staging?

A Because staging is cheaper

B Because archived models are better

C To avoid exposing users to untested models

D Because production is slower

Staging helps catch issues before users see the model, protecting user experience.

Which stage helps in rolling back to a previous model version if needed?

A Production

B Staging

C Training

D Archived

Archived models can be retrieved to roll back or compare with current models.

Explain the differences between staging, production, and archived model stages.

Think about where the model is used and why.

Why is it important to archive models instead of deleting them?

Consider future needs and safety.

Practice

1. What is the primary purpose of the staging stage in model lifecycle management?

easy

A. To deploy models for live user traffic

B. To test and validate models before they go live

C. To permanently delete old models

D. To archive models for long-term storage

Solution

1. Step 1: Understand model stages

   The staging stage is used to test and validate models before they are deployed to production.

2. Step 2: Differentiate from other stages

   Production is for live use, archived is for storage, so staging is the testing phase.

3. Final Answer:

   To test and validate models before they go live -> Option B

4. Quick Check:

   Staging = Testing phase [OK]

Hint: Staging means testing before live use [OK]

Common Mistakes:

• Confusing staging with production
• Thinking archived means active use
• Assuming staging is for deleting models

2. Which MLflow command correctly transitions a model version to the production stage?

easy

A. mlflow models transition-version --model-name my_model --version 3 --stage production

B. mlflow model transition-version --model-name my_model --version 3 --to-stage production

C. mlflow models transition-version --model-name my_model --model-version 3 --stage production

D. mlflow models transition --model-name my_model --model-version 3 --stage production

Solution

1. Step 1: Recall MLflow CLI syntax

   The correct MLflow CLI command to transition a model version is mlflow models transition-version with flags --model-name, --version and --stage.

2. Step 2: Identify correct flags and command

   mlflow models transition-version --model-name my_model --version 3 --stage production matches the correct syntax.

3. Final Answer:

   mlflow models transition-version --model-name my_model --version 3 --stage production -> Option A

4. Quick Check:

   Correct MLflow syntax = mlflow models transition-version --model-name my_model --version 3 --stage production [OK]

Hint: Use 'transition-version' with --version and --stage flags [OK]

Common Mistakes:

• Using 'model' instead of 'models'
• Mixing up --model-version and --version flags
• Incorrect command order or missing flags

3. Given this MLflow Python snippet, what will be the stage of the model after execution?

from mlflow import MlflowClient
client = MlflowClient()
client.transition_model_version_stage(
    name="my_model",
    version=2,
    stage="archived"
)

medium

A. Archived

B. Production

C. Staging

D. None (error)

Solution

1. Step 1: Understand the method call

   The method transition_model_version_stage changes the stage of a model version to the specified stage.

2. Step 2: Check the stage argument

   The stage argument is set to "archived", so the model version 2 of "my_model" will be moved to archived stage.

3. Final Answer:

   Archived -> Option A

4. Quick Check:

   transition_model_version_stage with stage='archived' = Archived [OK]

Hint: Stage argument sets the model's new stage directly [OK]

Common Mistakes:

• Assuming default stage if not specified
• Confusing method name with other MLflow functions
• Thinking 'archived' means deletion

4. You run this MLflow CLI command but get an error:

mlflow models transition-version --version 5 --stage production

What is the most likely cause?

medium

A. The command should be mlflow model transition-version (singular 'model')

B. Incorrect stage name; should be 'prod' instead of 'production'

C. Version number must be a string, not a number

D. Missing the --model-name argument

Solution

1. Step 1: Check required arguments for transition-version

   The mlflow models transition-version command requires the --model-name argument to specify which model to update.

2. Step 2: Identify missing argument

   The command lacks --model-name, causing the error.

3. Final Answer:

   Missing the --model-name argument -> Option D

4. Quick Check:

   Missing required flags cause errors [OK]

Hint: Always include --model-name when transitioning versions [OK]

Common Mistakes:

• Assuming stage names are abbreviated
• Using singular 'model' instead of 'models'
• Passing version as string instead of number (both accepted)

5. You have two model versions: v1 in production and v2 in staging. You want to promote v2 to production and archive v1 using MLflow Python API. Which sequence of calls correctly achieves this?

hard

A. client.transition_model_version_stage('model', 2, 'archived') then client.transition_model_version_stage('model', 1, 'production')

B. client.transition_model_version_stage('model', 2, 'production') then client.transition_model_version_stage('model', 2, 'archived')

C. client.transition_model_version_stage('model', 1, 'archived') then client.transition_model_version_stage('model', 2, 'production')

D. client.transition_model_version_stage('model', 1, 'production') then client.transition_model_version_stage('model', 2, 'staging')

Solution

1. Step 1: Archive current production version first

   To free the production stage, first move v1 from production to archived.

2. Step 2: Promote staging version to production

   After archiving v1, promote v2 from staging to production.

3. Final Answer:

   Archive v1 then promote v2 -> Option C

4. Quick Check:

   Archive old before promoting new [OK]

Hint: Archive old production before promoting new [OK]

Common Mistakes:

• Promoting new before archiving old causes stage conflict
• Archiving staging version instead of production
• Reassigning stages incorrectly