Bird
Raised Fist0
MLOpsdevops~10 mins

Model approval workflows in MLOps - Step-by-Step Execution

Choose your learning style10 modes available

Start learning this pattern below

Jump into concepts and practice - no test required

or
Recommended
Test this pattern10 questions across easy, medium, and hard to know if this pattern is strong
Process Flow - Model approval workflows
Model Training Complete
Submit Model for Approval
Review Model Performance
Approve
Deploy Model
Model Training Complete
This flow shows how a trained model is submitted for approval, reviewed, and either approved for deployment or rejected for retraining.
Execution Sample
MLOps
submit_model()
review = review_model()
if review == 'approve':
    deploy_model()
else:
    retrain_model()
This code submits a model, reviews it, and deploys if approved; otherwise, it triggers retraining.
Process Table
StepActionInput/ConditionResultNext Step
1submit_model()Model trainedModel submitted for approvalreview_model()
2review_model()Model metrics evaluatedReview result: approvedeploy_model()
3deploy_model()Review result is approveModel deployed to productionEND
4review_model()Model metrics evaluatedReview result: rejectretrain_model()
5retrain_model()Review result is rejectModel retraining startedsubmit_model()
💡 Process ends when model is deployed or loops back for retraining after rejection
Status Tracker
VariableStartAfter Step 1After Step 2After Step 3 or 5
model_statusuntrainedsubmittedapproved or rejecteddeployed or retraining
Key Moments - 2 Insights
Why does the workflow loop back to training after rejection?
Because the review_model() returns 'reject' (see execution_table row 4), retrain_model() is called to improve the model before resubmission.
What triggers the deployment of the model?
When review_model() returns 'approve' (execution_table row 2), deploy_model() is called to put the model into production.
Visual Quiz - 3 Questions
Test your understanding
Look at the execution_table, what is the result after step 2 if the model is approved?
AReview result: approve
BModel retraining started
CModel submitted for approval
DModel deployed to production
💡 Hint
Check the 'Result' column in execution_table row 2.
At which step does the workflow start retraining the model?
AStep 3
BStep 4
CStep 5
DStep 2
💡 Hint
Look for 'retrain_model()' in the 'Action' column of execution_table.
If the model is rejected, what is the next action after retraining?
ADeploy the model
BSubmit model for approval again
CEnd the workflow
DReview model performance
💡 Hint
See the 'Next Step' column after retrain_model() in execution_table row 5.
Concept Snapshot
Model approval workflows:
- Train model
- Submit for approval
- Review performance
- If approved, deploy
- If rejected, retrain and resubmit
This loop ensures only good models reach production.
Full Transcript
Model approval workflows start after training a model. The model is submitted for approval where its performance is reviewed. If the review approves the model, it is deployed to production. If rejected, the model is sent back for retraining to improve. This cycle repeats until the model meets approval criteria and is deployed. The process ensures quality control before deployment.

Practice

(1/5)
1. What is the main purpose of a model approval workflow in MLOps?
easy
A. To delete old models from storage
B. To train models faster using more data
C. To deploy models automatically without any checks
D. To check and approve machine learning models before they are used in production

Solution

  1. Step 1: Understand the role of model approval workflows

    Model approval workflows are designed to ensure models are reviewed and tested before use.
  2. Step 2: Identify the correct purpose

    The main goal is to check and approve models to keep production safe and reliable.
  3. Final Answer:

    To check and approve machine learning models before they are used in production -> Option D
  4. Quick Check:

    Model approval = safety check before use [OK]
Hint: Approval means checking before use, not training or deleting [OK]
Common Mistakes:
  • Confusing approval with training or deployment
  • Thinking approval deletes models
  • Assuming approval skips checks
2. Which of the following is the correct syntax to add a manual approval step in a typical MLOps pipeline YAML?
easy
A. steps: - approval_step: users: ['team_lead']
B. steps: - name: manual_approval type: approval inputs: approvers: ['team_lead']
C. steps: - manual_approval: approvers: 'team_lead'
D. steps: - name: approval type: manual approvers: team_lead

Solution

  1. Step 1: Review typical YAML structure for approval steps

    Approval steps usually have a name, type, and inputs including approvers as a list.
  2. Step 2: Match syntax with correct YAML format

    steps: - name: manual_approval type: approval inputs: approvers: ['team_lead'] correctly uses 'name', 'type', and 'inputs' with a list of approvers.
  3. Final Answer:

    steps: - name: manual_approval type: approval inputs: approvers: ['team_lead'] -> Option B
  4. Quick Check:

    Correct YAML keys and list format = steps: - name: manual_approval type: approval inputs: approvers: ['team_lead'] [OK]
Hint: Look for 'name', 'type', and list of approvers in YAML [OK]
Common Mistakes:
  • Using wrong keys like 'users' instead of 'approvers'
  • Not using list format for approvers
  • Incorrect indentation or missing 'type'
3. Given this simplified MLOps pipeline snippet, what will be the output status after running the approval step if the approver rejects the model?
steps:
  - name: train_model
    type: training
  - name: approve_model
    type: approval
    inputs:
      approvers: ['alice']
    on_reject: fail_pipeline
medium
A. Pipeline skips approval and deploys
B. Pipeline continues to deploy the model
C. Pipeline fails and stops immediately
D. Pipeline retries training automatically

Solution

  1. Step 1: Understand the approval step behavior

    The approval step waits for 'alice' to approve or reject the model.
  2. Step 2: Analyze the 'on_reject' action

    If rejected, the pipeline is set to 'fail_pipeline', which stops the process immediately.
  3. Final Answer:

    Pipeline fails and stops immediately -> Option C
  4. Quick Check:

    Reject triggers fail_pipeline = stop [OK]
Hint: 'on_reject: fail_pipeline' means stop on rejection [OK]
Common Mistakes:
  • Assuming pipeline continues after rejection
  • Thinking approval is skipped
  • Believing training retries automatically
4. You have this approval step configuration but the pipeline never pauses for approval. What is the likely error?
steps:
  - name: approve_model
    type: approval
    inputs:
      approvers: 'bob'
medium
A. Approvers should be a list, not a string
B. Missing 'type' field for approval step
C. Approval step name must be 'manual_approval'
D. Pipeline needs a trigger to pause

Solution

  1. Step 1: Check the 'approvers' format

    The 'approvers' field must be a list, e.g., ['bob'], not a plain string.
  2. Step 2: Understand impact of wrong format

    Using a string causes the pipeline to ignore the approval step or not pause.
  3. Final Answer:

    Approvers should be a list, not a string -> Option A
  4. Quick Check:

    Approvers list format required = Approvers should be a list, not a string [OK]
Hint: Approvers must be a list, even if one person [OK]
Common Mistakes:
  • Using string instead of list for approvers
  • Changing step name unnecessarily
  • Assuming pipeline triggers control pause
5. You want to create a model approval workflow that automatically approves models with accuracy above 90%, but requires manual approval otherwise. Which workflow design achieves this?
hard
A. Add an automatic test step checking accuracy, then a conditional approval step that auto-approves if accuracy > 90%, else manual approval
B. Only use manual approval for all models regardless of accuracy
C. Skip approval if accuracy is above 90%, else reject the model automatically
D. Deploy all models first, then ask for approval later

Solution

  1. Step 1: Define automatic test for accuracy

    Use a test step to check if model accuracy is above 90% automatically.
  2. Step 2: Set conditional approval based on test result

    If accuracy > 90%, auto-approve; otherwise, require manual approval to ensure safety.
  3. Final Answer:

    Add an automatic test step checking accuracy, then a conditional approval step that auto-approves if accuracy > 90%, else manual approval -> Option A
  4. Quick Check:

    Auto test + conditional approval = Add an automatic test step checking accuracy, then a conditional approval step that auto-approves if accuracy > 90%, else manual approval [OK]
Hint: Combine auto test with conditional manual approval [OK]
Common Mistakes:
  • Skipping manual approval for low accuracy models
  • Approving all models without checks
  • Approving after deployment instead of before