Bias detection and mitigation in ML Python

Introduction

Bias detection and mitigation help make sure AI models treat everyone fairly. It stops models from making unfair decisions based on gender, race, or other traits.

When building a hiring tool to avoid unfairly rejecting candidates from certain groups.

When creating a loan approval system to ensure fair treatment for all applicants.

When developing a facial recognition system to reduce errors for different skin tones.

When analyzing medical data to prevent biased health predictions.

When training chatbots to avoid offensive or biased responses.

Syntax

ML Python

1. Collect data and check for bias using fairness metrics.
2. Use techniques like re-sampling, re-weighting, or adversarial training to reduce bias.
3. Evaluate the model again to confirm bias is reduced.

Bias detection uses fairness metrics like demographic parity or equal opportunity.

Mitigation can happen before, during, or after training the model.

Examples

This code checks if two groups get positive predictions at similar rates.

ML Python

# Example: Checking bias with demographic parity
from sklearn.metrics import confusion_matrix

# Calculate positive rates for groups
positive_rate_group1 = sum(predictions[group1]) / len(group1)
positive_rate_group2 = sum(predictions[group2]) / len(group2)

This code gives more importance to underrepresented group samples during training.

ML Python

# Example: Mitigation by re-weighting samples
weights = [1.5 if x in underrepresented_group else 1.0 for x in data]
model.fit(data, labels, sample_weight=weights)

Sample Model

This example shows how to detect bias by comparing positive prediction rates between two groups. Then it applies re-weighting to reduce bias and checks the results.

ML Python

import numpy as np
from sklearn.linear_model import LogisticRegression
from sklearn.metrics import accuracy_score

# Sample data: features and labels
X = np.array([[1, 20], [2, 22], [3, 21], [4, 23], [5, 24], [6, 25]])
y = np.array([0, 0, 1, 1, 1, 0])

# Sensitive attribute (e.g., group membership)
groups = np.array([0, 0, 1, 1, 1, 0])

# Train model without mitigation
model = LogisticRegression()
model.fit(X, y)
preds = model.predict(X)
accuracy = accuracy_score(y, preds)

# Calculate positive prediction rates per group
pos_rate_group0 = preds[groups == 0].mean()
pos_rate_group1 = preds[groups == 1].mean()

# Mitigation: re-weight samples to balance groups
weights = np.where(groups == 0, 1.0, 1.5)
model_mitigated = LogisticRegression()
model_mitigated.fit(X, y, sample_weight=weights)
preds_mitigated = model_mitigated.predict(X)
accuracy_mitigated = accuracy_score(y, preds_mitigated)

pos_rate_group0_m = preds_mitigated[groups == 0].mean()
pos_rate_group1_m = preds_mitigated[groups == 1].mean()

print(f"Before mitigation accuracy: {accuracy:.2f}")
print(f"Positive rate group 0 before: {pos_rate_group0:.2f}")
print(f"Positive rate group 1 before: {pos_rate_group1:.2f}")
print(f"After mitigation accuracy: {accuracy_mitigated:.2f}")
print(f"Positive rate group 0 after: {pos_rate_group0_m:.2f}")
print(f"Positive rate group 1 after: {pos_rate_group1_m:.2f}")

Important Notes

Bias detection is not just about accuracy; fairness metrics are key.

Mitigation may slightly reduce accuracy but improves fairness.

Always test models on diverse data to catch hidden biases.

Summary

Bias detection finds unfair treatment in AI models.

Mitigation techniques help models treat groups more equally.

Checking fairness is important for trustworthy AI.

Practice

1. What is the main goal of bias detection in machine learning models?

easy

A. To find unfair treatment of certain groups by the model

B. To increase the speed of model training

C. To reduce the size of the dataset

D. To improve the model's accuracy on all data

Solution

1. Step 1: Understand bias detection purpose

   Bias detection aims to identify if a model treats some groups unfairly compared to others.

2. Step 2: Compare options to goal

   Only To find unfair treatment of certain groups by the model matches this goal; others focus on speed, size, or accuracy, which are unrelated.

3. Final Answer:

   To find unfair treatment of certain groups by the model -> Option A

4. Quick Check:

   Bias detection = find unfair treatment [OK]

Hint: Bias detection finds unfairness in model decisions [OK]

Common Mistakes:

• Confusing bias detection with improving accuracy
• Thinking bias detection speeds up training
• Mixing bias detection with data size reduction

2. Which of the following is a common technique to mitigate bias in training data?

easy

A. Oversampling underrepresented groups

B. Reducing the number of features

C. Increasing the learning rate

D. Using dropout layers in neural networks

Solution

1. Step 1: Identify bias mitigation methods

   Oversampling underrepresented groups balances data, reducing bias.

2. Step 2: Evaluate other options

   Reducing features, increasing learning rate, and dropout affect model complexity or training, not bias directly.

3. Final Answer:

   Oversampling underrepresented groups -> Option A

4. Quick Check:

   Bias mitigation = oversampling minority data [OK]

Hint: Balance data by oversampling small groups [OK]

Common Mistakes:

• Confusing feature reduction with bias mitigation
• Thinking learning rate affects bias
• Mixing dropout with bias correction

3. Consider this Python code snippet for bias mitigation:

from sklearn.utils import resample

# Original data
X = [[1], [2], [3], [4]]
y = [0, 0, 1, 1]

# Minority class samples
X_minority = [x for x, label in zip(X, y) if label == 1]
y_minority = [1, 1]

# Oversample minority class
X_upsampled, y_upsampled = resample(X_minority, y_minority, replace=True, n_samples=4, random_state=42)

print(len(X_upsampled), len(y_upsampled))

What will be the output of the print statement?

medium

A. 2 2

B. 4 4

C. 8 8

D. Error due to wrong resample usage

Solution

1. Step 1: Understand resample parameters

   resample duplicates minority samples to reach n_samples=4, so output lists have length 4.

2. Step 2: Check print output

   Both X_upsampled and y_upsampled have length 4, so print outputs '4 4'.

3. Final Answer:

   4 4 -> Option B

4. Quick Check:

   Oversampling size = 4 [OK]

Hint: resample with n_samples sets output length [OK]

Common Mistakes:

• Assuming output length stays original size
• Thinking resample doubles data always
• Expecting error from resample usage

4. You have a model that shows bias against a group. The code below tries to fix it but causes an error:

def mitigate_bias(data, labels):
    # Remove samples from majority group
    filtered_data = [d for d, l in zip(data, labels) if l != 'majority']
    filtered_labels = [l for l in labels if l != 'majority']
    return filtered_data, filtered_labels

X = [1, 2, 3, 4]
y = ['majority', 'minority', 'majority', 'minority']

X_new, y_new = mitigate_bias(X, y)
print(len(X_new), len(y_new))

What is the error in this code?

medium

A. Function returns wrong variable names

B. Syntax error in list comprehension

C. No error, code runs correctly

D. filtered_labels length does not match filtered_data length

Solution

1. Step 1: Analyze the filtering logic

   filtered_data is filtered using zip(data, labels) with condition l != 'majority', selecting elements at indices 1 and 3. filtered_labels is filtered directly from labels with the same condition, resulting in elements at indices 1 and 3. However, filtered_data and filtered_labels are filtered differently: filtered_data uses zip to filter data and labels together, but filtered_labels filters labels alone, which can cause length mismatch if data and labels are not aligned.

2. Step 2: Check lengths

   In this specific example, both filtered_data and filtered_labels have length 2, but this is coincidental. The approach is error-prone and can cause mismatches in other cases.

3. Step 3: Correct approach

   Both filtered_data and filtered_labels should be filtered using zip together to ensure matching lengths.

4. Final Answer:

   filtered_labels length does not match filtered_data length -> Option D

5. Quick Check:

   Separate filtering risks length mismatch [OK]

Hint: Filter data and labels together using zip to keep lengths equal [OK]

Common Mistakes:

• Mistakenly thinking separate comprehensions cause length mismatch
• Believing zip and direct label filter select differently
• Assuming the code has a bug without tracing execution

5. You want to reduce bias in a model predicting loan approvals. You have data with a sensitive attribute 'gender'. Which combined approach best mitigates bias while keeping model performance?

hard

A. Increase model complexity to capture more patterns

B. Remove the 'gender' attribute and train the model normally

C. Use reweighting to balance training samples and add fairness constraints during model training

D. Only oversample the majority group to increase data size

Solution

1. Step 1: Understand bias mitigation strategies

   Reweighting balances data impact; fairness constraints guide model to treat groups fairly.

2. Step 2: Evaluate other options

   Removing 'gender' may hide bias but not fix it; increasing complexity can worsen bias; oversampling majority increases imbalance.

3. Final Answer:

   Use reweighting to balance training samples and add fairness constraints during model training -> Option C

4. Quick Check:

   Combine reweighting + fairness constraints = best bias mitigation [OK]

Hint: Combine data balancing and fairness rules for best results [OK]

Common Mistakes:

• Removing sensitive attribute hides but does not fix bias
• Increasing complexity ignores bias issues
• Oversampling majority worsens bias