Bias detection and fairness metrics in MLOps - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is bias detection in machine learning?

Bias detection is the process of identifying unfair or prejudiced behavior in a machine learning model, where the model's predictions may favor or discriminate against certain groups.

beginner

Name two common fairness metrics used in bias detection.

Two common fairness metrics are Demographic Parity (ensuring equal positive rates across groups) and Equalized Odds (ensuring equal true positive and false positive rates across groups).

intermediate

What does Demographic Parity measure?

Demographic Parity measures whether different groups have the same probability of receiving a positive prediction, regardless of the true outcome.

intermediate

Explain Equalized Odds in simple terms.

Equalized Odds means that a model should have similar true positive and false positive rates for different groups.

beginner

Why is bias detection important in MLOps?

Bias detection is important in MLOps to ensure models are fair, trustworthy, and comply with ethical and legal standards before deployment and during monitoring.

Which fairness metric checks if all groups have the same chance of a positive prediction?

A Equalized Odds

B Demographic Parity

C Precision

D Recall

Demographic Parity ensures equal positive prediction rates across groups.

What does Equalized Odds require from a model?

A Equal number of samples per group

B Equal overall accuracy across groups

C Equal training time for each group

D Equal false positive and true positive rates across groups

Equalized Odds means the model has similar true positive and false positive rates for all groups.

Why is bias detection part of MLOps?

A To ensure models are fair and ethical

B To speed up model training

C To reduce model size

D To increase data volume

Bias detection helps maintain fairness and ethical standards in deployed models.

Which of these is NOT a fairness metric?

A Mean Squared Error

B Equalized Odds

C Demographic Parity

D Predictive Parity

Mean Squared Error measures prediction error, not fairness.

If a model favors one group over another in predictions, what is this called?

A Accuracy

B Overfitting

C Bias

D Normalization

Bias means unfair preference or discrimination in model predictions.

Describe what bias detection means in machine learning and why it matters.

Think about how models can treat groups differently and why we want to avoid that.

Explain two fairness metrics used to evaluate machine learning models.

Focus on how these metrics check if the model treats groups fairly.

Practice

1. What is the main purpose of bias detection in machine learning models?

easy

A. To improve the speed of model training

B. To find unfair treatment or discrimination in model predictions

C. To increase the size of the training dataset

D. To reduce the cost of cloud computing resources

Solution

1. Step 1: Understand bias detection context

   Bias detection focuses on identifying unfair or unequal treatment of different groups by a model.

2. Step 2: Compare options to purpose

   Only To find unfair treatment or discrimination in model predictions correctly describes bias detection as finding unfair treatment in predictions.

3. Final Answer:

   To find unfair treatment or discrimination in model predictions -> Option B

4. Quick Check:

   Bias detection = find unfair treatment [OK]

Hint: Bias detection finds unfairness in model results [OK]

Common Mistakes:

• Confusing bias detection with model speed optimization
• Thinking bias detection changes dataset size
• Mixing bias detection with cost reduction

2. Which of the following is a correct way to calculate demographic parity difference in Python?

easy

A. dp_diff = abs(rate_group1 - rate_group2)

B. dp_diff = rate_group1 + rate_group2

C. dp_diff = rate_group1 * rate_group2

D. dp_diff = rate_group1 / rate_group2

Solution

1. Step 1: Understand demographic parity difference formula

   It is the absolute difference between positive outcome rates of two groups.

2. Step 2: Match formula to options

   dp_diff = abs(rate_group1 - rate_group2) correctly uses absolute difference, others use incorrect operations.

3. Final Answer:

   dp_diff = abs(rate_group1 - rate_group2) -> Option A

4. Quick Check:

   Demographic parity difference = absolute difference [OK]

Hint: Use absolute difference for parity difference [OK]

Common Mistakes:

• Using addition or multiplication instead of difference
• Forgetting to take absolute value
• Dividing rates which is not standard

3. Given the following Python code snippet, what is the output?

group1_positive_rate = 0.7
group2_positive_rate = 0.5
dp_diff = abs(group1_positive_rate - group2_positive_rate)
print(round(dp_diff, 2))

medium

A. 0.2

B. 1.20

C. 0.12

D. 0.35

Solution

1. Step 1: Calculate difference between rates

   0.7 - 0.5 = 0.2

2. Step 2: Apply absolute and rounding

   Absolute value is 0.2, rounded to 2 decimals is 0.2

3. Final Answer:

   0.2 -> Option A

4. Quick Check:

   abs(0.7 - 0.5) = 0.2 [OK]

Hint: Subtract and round absolute difference [OK]

Common Mistakes:

• Mixing up subtraction order
• Not rounding output
• Confusing decimal places

4. You wrote this code to calculate equal opportunity difference but it gives wrong results:

tpr_group1 = 0.8
tpr_group2 = 0.6
equal_opp_diff = tpr_group1 - tpr_group2
print(equal_opp_diff)

What is the likely issue?

medium

A. You need to add the true positive rates, not subtract

B. You should multiply the true positive rates instead of subtracting

C. You forgot to take the absolute value of the difference

D. The variable names are incorrect

Solution

1. Step 1: Understand equal opportunity difference metric

   It measures the absolute difference between true positive rates of groups.

2. Step 2: Check code calculation

   Code subtracts but does not take absolute value, so negative results possible.

3. Final Answer:

   You forgot to take the absolute value of the difference -> Option C

4. Quick Check:

   Equal opportunity difference = absolute difference [OK]

Hint: Always use absolute difference for fairness metrics [OK]

Common Mistakes:

• Ignoring absolute value leads to negative results
• Using addition or multiplication wrongly
• Assuming variable names cause errors

5. You want to ensure fairness in a loan approval model. The model predicts positive outcomes for two groups with rates 0.65 and 0.55. Which fairness metric and threshold would best detect bias if you want less than 10% difference between groups?

hard

A. Use accuracy score and check if difference < 0.1

B. Use recall difference and check if difference > 0.2

C. Use precision difference and check if difference > 0.1

D. Use demographic parity difference and check if difference < 0.1

Solution

1. Step 1: Identify appropriate fairness metric

   Demographic parity difference measures difference in positive prediction rates between groups.

2. Step 2: Apply threshold for bias detection

   Checking if difference is less than 0.1 (10%) ensures fairness within acceptable limits.

3. Final Answer:

   Use demographic parity difference and check if difference < 0.1 -> Option D

4. Quick Check:

   Demographic parity difference < 0.1 = fairness [OK]

Hint: Demographic parity difference < threshold detects bias [OK]

Common Mistakes:

• Using accuracy instead of fairness metrics
• Checking for difference greater than threshold incorrectly
• Confusing precision or recall with demographic parity