Responsible AI practices in MLOps - Mini Project: Build & Apply

Responsible AI Practices with MLOps

📖 Scenario: You are working as a machine learning engineer in a team that builds AI models. Your team wants to ensure the AI models are responsible and fair before deployment. You will create a simple project to check model fairness and document ethical considerations.

🎯 Goal: Build a small Python script that stores model predictions and true labels, sets a fairness threshold, calculates fairness metrics, and prints a fairness report. This simulates responsible AI checks in an MLOps pipeline.

📋 What You'll Learn

Create a dictionary with exact model predictions and true labels

Add a fairness threshold variable

Calculate fairness metric using a for loop

Print the fairness report with exact formatting

💡 Why This Matters

🌍 Real World

Responsible AI practices help ensure machine learning models are fair and ethical before deployment. This reduces harm and builds trust.

💼 Career

MLOps engineers and data scientists use these checks to monitor models continuously and meet ethical standards required by companies and regulators.

1

Create model predictions and true labels dictionary

Create a dictionary called model_results with these exact entries: 'predictions': [1, 0, 1, 1, 0] and 'true_labels': [1, 0, 0, 1, 0].

MLOps

# Create the model_results dictionary with predictions and true_labels
# Your code here

Hint

Use a dictionary with keys 'predictions' and 'true_labels' and assign the exact lists as values.

2

Add fairness threshold variable

Add a variable called fairness_threshold and set it to 0.8.

MLOps

model_results = {'predictions': [1, 0, 1, 1, 0], 'true_labels': [1, 0, 0, 1, 0]}
# Set the fairness_threshold variable to 0.8
# Your code here

Hint

Just create a variable named fairness_threshold and assign 0.8 to it.

3

Calculate fairness metric

Use a for loop with variable i to iterate over the indexes of model_results['predictions']. Calculate the accuracy by counting how many predictions match true labels. Store the accuracy as a float in a variable called accuracy.

MLOps

model_results = {'predictions': [1, 0, 1, 1, 0], 'true_labels': [1, 0, 0, 1, 0]}
fairness_threshold = 0.8
# Calculate accuracy using a for loop and store in accuracy
# Your code here

Hint

Count matches between predictions and true_labels using a for loop over indexes, then divide by total count.

4

Print fairness report

Write a print statement to display the text: "Model fairness check: Accuracy = {accuracy}, Threshold = {fairness_threshold}" using an f-string with the variables accuracy and fairness_threshold.

MLOps

model_results = {'predictions': [1, 0, 1, 1, 0], 'true_labels': [1, 0, 0, 1, 0]}
fairness_threshold = 0.8
correct = 0
for i in range(len(model_results['predictions'])):
    if model_results['predictions'][i] == model_results['true_labels'][i]:
        correct += 1
accuracy = correct / len(model_results['predictions'])
# Print the fairness report using an f-string
# Your code here

Hint

Use print(f"Model fairness check: Accuracy = {accuracy}, Threshold = {fairness_threshold}") to show the result.

Practice

1. What is the main goal of Responsible AI practices?

easy

A. To ensure AI systems are fair, safe, and trustworthy

B. To make AI run faster on all devices

C. To increase the complexity of AI models

D. To reduce the cost of AI hardware

Solution

1. Step 1: Understand the purpose of Responsible AI

   Responsible AI focuses on ethical and safe AI use, not speed or cost.

2. Step 2: Identify the key goals

   Fairness, safety, and trustworthiness are the core goals of Responsible AI.

3. Final Answer:

   To ensure AI systems are fair, safe, and trustworthy -> Option A

4. Quick Check:

   Responsible AI = fairness, safety, trust [OK]

Hint: Responsible AI means fairness and safety first [OK]

Common Mistakes:

• Confusing performance optimization with ethical goals
• Thinking cost reduction is the main focus
• Assuming complexity equals responsibility

2. Which of the following is a correct practice to check AI bias in a model?

easy

A. Using fairness metrics to evaluate model outputs

B. Avoiding transparency in model decisions

C. Only testing the model on training data

D. Ignoring data diversity during training

Solution

1. Step 1: Identify bias checking methods

   Bias checks require measuring fairness, not ignoring data or hiding decisions.

2. Step 2: Match correct practice

   Using fairness metrics helps detect bias in model outputs effectively.

3. Final Answer:

   Using fairness metrics to evaluate model outputs -> Option A

4. Quick Check:

   Bias check = fairness metrics [OK]

Hint: Use fairness metrics to spot bias [OK]

Common Mistakes:

• Ignoring diverse data leads to hidden bias
• Testing only on training data misses real bias
• Lack of transparency hides bias issues

3. Consider this Python snippet for monitoring AI model fairness:

fairness_scores = {'groupA': 0.85, 'groupB': 0.65}
if min(fairness_scores.values()) < 0.7:
    alert = 'Bias detected'
else:
    alert = 'Fair model'

What will be the value of alert after running this code?

medium

A. 'Fair model'

B. KeyError

C. TypeError

D. 'Bias detected'

Solution

1. Step 1: Evaluate fairness scores

   Values are 0.85 and 0.65; minimum is 0.65.

2. Step 2: Check condition in if statement

   Since 0.65 < 0.7, condition is true, so alert is set to 'Bias detected'.

3. Final Answer:

   'Bias detected' -> Option D

4. Quick Check:

   Min fairness < 0.7 means bias alert [OK]

Hint: Check minimum fairness score for bias alert [OK]

Common Mistakes:

• Confusing greater than and less than signs
• Expecting error instead of string output
• Ignoring dictionary value extraction

4. You have this code snippet to log AI model decisions for explainability:

def log_decision(input, decision):
    print(f"Input: {input}, Decision: {decision}")

log_decision('data1', decision)

What is the error in this code?

medium

A. Print statement syntax error

B. Function name is invalid

C. Missing quotes around 'decision' in function call

D. No error, code runs fine

Solution

1. Step 1: Check function call parameters

   The call uses decision without quotes, but decision is not defined as a variable.

2. Step 2: Identify correct usage

   To pass the string 'decision', it must be in quotes: 'decision'.

3. Final Answer:

   Missing quotes around 'decision' in function call -> Option C

4. Quick Check:

   Undefined variable needs quotes [OK]

Hint: Strings need quotes in function calls [OK]

Common Mistakes:

• Assuming variable 'decision' is predefined
• Ignoring syntax of print with f-string
• Thinking function name causes error

5. You want to build a monitoring system that alerts when AI model fairness drops below 0.75 and also logs explanations for decisions. Which combination of practices best supports Responsible AI?

hard

A. Only monitor model speed and ignore fairness

B. Use fairness metrics for alerts and log decision explanations transparently

C. Log decisions but do not monitor fairness scores

D. Monitor fairness but keep decision logic secret

Solution

1. Step 1: Identify key Responsible AI practices

   Responsible AI requires fairness monitoring and transparent explanations.

2. Step 2: Evaluate options for best fit

   Use fairness metrics for alerts and log decision explanations transparently combines fairness alerts and transparent logging, matching Responsible AI goals.

3. Final Answer:

   Use fairness metrics for alerts and log decision explanations transparently -> Option B

4. Quick Check:

   Fairness + transparency = Responsible AI [OK]

Hint: Combine fairness alerts with transparent logs [OK]

Common Mistakes:

• Ignoring fairness monitoring
• Hiding decision explanations
• Focusing only on performance metrics