Bias detection and fairness metrics in MLOps - Commands & Configuration

Introduction

When building machine learning models, sometimes the model treats some groups unfairly. Bias detection and fairness metrics help us find and measure these unfair behaviors so we can fix them.

When you want to check if your model treats different genders equally.

When you need to ensure your loan approval model does not discriminate against certain races.

When you want to measure if your hiring algorithm favors one age group over others.

When you want to compare fairness between two versions of a model before deployment.

When you want to report fairness metrics to stakeholders to show responsible AI practices.

Commands

This command installs the Fairlearn library, which helps detect bias and calculate fairness metrics in machine learning models.

Terminal

pip install fairlearn

Expected Output

Collecting fairlearn

  Downloading fairlearn-0.8.0-py3-none-any.whl (1.1 MB)

Installing collected packages: fairlearn

Successfully installed fairlearn-0.8.0

This runs a Python script that trains a simple model, predicts outcomes, and calculates fairness metrics to detect bias.

Terminal

python bias_fairness_check.py

Expected Output

Accuracy: 0.85

Demographic Parity Difference: 0.12

Equalized Odds Difference: 0.10

The model shows some bias that needs attention.

Key Concept

If you remember nothing else, remember: fairness metrics measure how equally a model treats different groups to help detect bias.

Code Example

MLOps

from sklearn.datasets import make_classification
from sklearn.model_selection import train_test_split
from sklearn.linear_model import LogisticRegression
from fairlearn.metrics import MetricFrame, demographic_parity_difference, equalized_odds_difference
import numpy as np

# Create a simple dataset with a sensitive feature
X, y = make_classification(n_samples=1000, n_features=5, random_state=42)
sensitive_feature = np.random.choice(['group_a', 'group_b'], size=1000)

# Split data
X_train, X_test, y_train, y_test, sf_train, sf_test = train_test_split(X, y, sensitive_feature, test_size=0.3, random_state=42)

# Train model
model = LogisticRegression(solver='liblinear')
model.fit(X_train, y_train)

# Predict
y_pred = model.predict(X_test)

# Calculate fairness metrics
metrics = MetricFrame(metrics={'accuracy': lambda y_true, y_pred: np.mean(y_true == y_pred),
                              'demographic_parity_difference': demographic_parity_difference,
                              'equalized_odds_difference': equalized_odds_difference},
                      y_true=y_test, y_pred=y_pred, sensitive_features=sf_test)

print(f"Accuracy: {metrics.overall['accuracy']:.2f}")
print(f"Demographic Parity Difference: {metrics.overall['demographic_parity_difference']:.2f}")
print(f"Equalized Odds Difference: {metrics.overall['equalized_odds_difference']:.2f}")

if metrics.overall['demographic_parity_difference'] > 0.1 or metrics.overall['equalized_odds_difference'] > 0.1:
    print("The model shows some bias that needs attention.")
else:
    print("The model appears fair.")

Common Mistakes

Ignoring protected group labels when calculating fairness metrics.

Without group labels, you cannot measure if the model treats groups differently, so bias remains hidden.

Always include the sensitive attribute (like gender or race) when computing fairness metrics.

Using accuracy alone to judge model quality.

Accuracy does not show if the model is unfair to some groups; a model can be accurate but biased.

Use fairness metrics alongside accuracy to get a full picture of model performance.

Summary

Install the Fairlearn library to access bias detection tools.

Train your model and predict outcomes on test data.

Use fairness metrics like demographic parity difference and equalized odds difference to measure bias.

Interpret these metrics alongside accuracy to understand model fairness.

Practice

1. What is the main purpose of bias detection in machine learning models?

easy

A. To improve the speed of model training

B. To find unfair treatment or discrimination in model predictions

C. To increase the size of the training dataset

D. To reduce the cost of cloud computing resources

Solution

1. Step 1: Understand bias detection context

   Bias detection focuses on identifying unfair or unequal treatment of different groups by a model.

2. Step 2: Compare options to purpose

   Only To find unfair treatment or discrimination in model predictions correctly describes bias detection as finding unfair treatment in predictions.

3. Final Answer:

   To find unfair treatment or discrimination in model predictions -> Option B

4. Quick Check:

   Bias detection = find unfair treatment [OK]

Hint: Bias detection finds unfairness in model results [OK]

Common Mistakes:

• Confusing bias detection with model speed optimization
• Thinking bias detection changes dataset size
• Mixing bias detection with cost reduction

2. Which of the following is a correct way to calculate demographic parity difference in Python?

easy

A. dp_diff = abs(rate_group1 - rate_group2)

B. dp_diff = rate_group1 + rate_group2

C. dp_diff = rate_group1 * rate_group2

D. dp_diff = rate_group1 / rate_group2

Solution

1. Step 1: Understand demographic parity difference formula

   It is the absolute difference between positive outcome rates of two groups.

2. Step 2: Match formula to options

   dp_diff = abs(rate_group1 - rate_group2) correctly uses absolute difference, others use incorrect operations.

3. Final Answer:

   dp_diff = abs(rate_group1 - rate_group2) -> Option A

4. Quick Check:

   Demographic parity difference = absolute difference [OK]

Hint: Use absolute difference for parity difference [OK]

Common Mistakes:

• Using addition or multiplication instead of difference
• Forgetting to take absolute value
• Dividing rates which is not standard

3. Given the following Python code snippet, what is the output?

group1_positive_rate = 0.7
group2_positive_rate = 0.5
dp_diff = abs(group1_positive_rate - group2_positive_rate)
print(round(dp_diff, 2))

medium

A. 0.2

B. 1.20

C. 0.12

D. 0.35

Solution

1. Step 1: Calculate difference between rates

   0.7 - 0.5 = 0.2

2. Step 2: Apply absolute and rounding

   Absolute value is 0.2, rounded to 2 decimals is 0.2

3. Final Answer:

   0.2 -> Option A

4. Quick Check:

   abs(0.7 - 0.5) = 0.2 [OK]

Hint: Subtract and round absolute difference [OK]

Common Mistakes:

• Mixing up subtraction order
• Not rounding output
• Confusing decimal places

4. You wrote this code to calculate equal opportunity difference but it gives wrong results:

tpr_group1 = 0.8
tpr_group2 = 0.6
equal_opp_diff = tpr_group1 - tpr_group2
print(equal_opp_diff)

What is the likely issue?

medium

A. You need to add the true positive rates, not subtract

B. You should multiply the true positive rates instead of subtracting

C. You forgot to take the absolute value of the difference

D. The variable names are incorrect

Solution

1. Step 1: Understand equal opportunity difference metric

   It measures the absolute difference between true positive rates of groups.

2. Step 2: Check code calculation

   Code subtracts but does not take absolute value, so negative results possible.

3. Final Answer:

   You forgot to take the absolute value of the difference -> Option C

4. Quick Check:

   Equal opportunity difference = absolute difference [OK]

Hint: Always use absolute difference for fairness metrics [OK]

Common Mistakes:

• Ignoring absolute value leads to negative results
• Using addition or multiplication wrongly
• Assuming variable names cause errors

5. You want to ensure fairness in a loan approval model. The model predicts positive outcomes for two groups with rates 0.65 and 0.55. Which fairness metric and threshold would best detect bias if you want less than 10% difference between groups?

hard

A. Use accuracy score and check if difference < 0.1

B. Use recall difference and check if difference > 0.2

C. Use precision difference and check if difference > 0.1

D. Use demographic parity difference and check if difference < 0.1

Solution

1. Step 1: Identify appropriate fairness metric

   Demographic parity difference measures difference in positive prediction rates between groups.

2. Step 2: Apply threshold for bias detection

   Checking if difference is less than 0.1 (10%) ensures fairness within acceptable limits.

3. Final Answer:

   Use demographic parity difference and check if difference < 0.1 -> Option D

4. Quick Check:

   Demographic parity difference < 0.1 = fairness [OK]

Hint: Demographic parity difference < threshold detects bias [OK]

Common Mistakes:

• Using accuracy instead of fairness metrics
• Checking for difference greater than threshold incorrectly
• Confusing precision or recall with demographic parity