Why responsible ML prevents harm in ML Python - Challenge Your Understanding

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Bias in Machine Learning

Which of the following best explains why bias in machine learning models can cause harm?

A Bias only affects the accuracy of models but not their fairness.

B Bias can cause models to make unfair decisions that negatively affect certain groups of people.

C Bias makes models run slower and use more memory.

D Bias helps models learn faster by focusing on important features.

💡 Hint

Think about how unfair treatment can impact people in real life.

Bias in models can lead to unfair or harmful decisions, especially for underrepresented groups, which is why responsible ML aims to detect and reduce bias.

❓ Model Choice

intermediate

Choosing Models to Reduce Harm

You want to build a model that predicts loan approvals fairly across different groups. Which model choice helps reduce harm?

A A simple model with fairness constraints to balance accuracy and fairness.

B A model trained only on data from one group to maximize accuracy for that group.

C A model that randomly approves loans without using any data.

D A complex model that overfits training data but ignores fairness constraints.

💡 Hint

Consider how fairness constraints help prevent harm.

Using fairness constraints helps ensure the model treats groups fairly, reducing harm while maintaining reasonable accuracy.

❓ Metrics

advanced

Evaluating Fairness Metrics

Given a classification model, which metric helps detect if the model treats different groups fairly?

A Precision score for the majority group only.

B Accuracy score across the entire dataset.

C Difference in false positive rates between groups.

D Training loss value.

💡 Hint

Think about errors that affect groups differently.

Difference in false positive rates between groups shows if one group is unfairly more likely to be wrongly classified, indicating potential harm.

🔧 Debug

advanced

Identifying Harmful Data Issues

Which data problem is most likely to cause harm if not addressed in a machine learning model?

A Using normalized data instead of raw data.

B Having too many features in the dataset.

C Missing values in some rows that are randomly distributed.

D Training data that underrepresents a minority group.

💡 Hint

Consider how data representation affects model fairness.

Underrepresentation of a group can cause the model to perform poorly for that group, leading to unfair and harmful outcomes.

🧠 Conceptual

expert

Why Responsible ML Prevents Harm

Why is responsible machine learning essential to prevent harm in real-world applications?

A Because it helps identify and reduce biases, ensuring fair and safe decisions for everyone.

B Because it ensures models are always 100% accurate on all data.

C Because it makes models run faster and use less memory.

D Because it guarantees models will never make mistakes.

💡 Hint

Think about fairness and safety in decisions made by models.

Responsible ML focuses on fairness, transparency, and safety to reduce harm caused by biased or unsafe model decisions.

Practice

1. Why is responsible machine learning important in AI development?

easy

A. It guarantees 100% accuracy in predictions.

B. It makes models run faster without errors.

C. It helps prevent harm by ensuring fairness and safety.

D. It removes the need for human oversight.

Solution

1. Step 1: Understand the goal of responsible ML

   Responsible ML focuses on fairness and safety to avoid harm.

2. Step 2: Compare options to this goal

   Only It helps prevent harm by ensuring fairness and safety. mentions preventing harm by fairness and safety, matching the goal.

3. Final Answer:

   It helps prevent harm by ensuring fairness and safety. -> Option C

4. Quick Check:

   Responsible ML = Prevents harm [OK]

Hint: Responsible ML = fairness + safety to avoid harm [OK]

Common Mistakes:

• Thinking responsible ML guarantees perfect accuracy
• Believing it removes human oversight
• Confusing speed improvements with harm prevention

2. Which of the following is a correct practice in responsible ML?

easy

A. Ignoring data biases to speed up training

B. Deploying models without monitoring

C. Using only one data source without checks

D. Regularly testing models for fairness

Solution

1. Step 1: Identify responsible ML practices

   Responsible ML includes testing models regularly to ensure fairness.

2. Step 2: Match options to responsible ML practices

   Regularly testing models for fairness matches this practice; others ignore bias or skip monitoring.

3. Final Answer:

   Regularly testing models for fairness -> Option D

4. Quick Check:

   Testing for fairness = Responsible ML [OK]

Hint: Test models often to catch bias early [OK]

Common Mistakes:

• Ignoring bias in data
• Skipping model monitoring after deployment
• Assuming one data source is enough

3. Consider this code snippet checking model fairness:

def check_fairness(scores):
    return all(score >= 0.8 for score in scores)

results = check_fairness([0.9, 0.85, 0.7, 0.95])
print(results)

What is the output?

medium

A. False

B. None

C. Error

D. True

Solution

1. Step 1: Understand the function check_fairness

   The function returns True only if all scores are at least 0.8.

2. Step 2: Evaluate the scores list

   The list has a 0.7 score, which is less than 0.8, so all() returns False.

3. Final Answer:

   False -> Option A

4. Quick Check:

   All scores >= 0.8? No, so False [OK]

Hint: all() returns False if any item fails condition [OK]

Common Mistakes:

• Assuming all scores are above 0.8
• Confusing any() with all()
• Expecting an error due to code structure

4. This code aims to monitor model bias but has a bug:

def monitor_bias(data):
    for value in data:
        if value < 0.5:
            print("Bias detected")
        else:
            print("No bias")

monitor_bias([0.6, 0.4, 0.7, 0.3])

What is the bug and how to fix it?

medium

A. The function should return a list instead of printing; fix by collecting results.

B. The comparison operator is wrong; use > instead of <.

C. The loop variable is unused; replace 'value' with 'data'.

D. The function is missing a return statement; add 'return None'.

Solution

1. Step 1: Identify the issue with printing inside the loop

   Printing inside the loop does not allow further analysis or storage of bias results.

2. Step 2: Suggest collecting results for monitoring

   Fix by storing results in a list and returning it for better monitoring.

3. Final Answer:

   The function should return a list instead of printing; fix by collecting results. -> Option A

4. Quick Check:

   Print vs return affects monitoring [OK]

Hint: Return data for monitoring, don't just print [OK]

Common Mistakes:

• Changing comparison operator incorrectly
• Confusing variable names
• Adding unnecessary return None

5. A company wants to deploy an AI model for loan approval. To prevent harm, which combination of responsible ML steps is best?

hard

A. Use a simple model without testing, rely on manual checks

B. Use diverse training data, test for bias, monitor model after deployment

C. Train only on past approved loans, deploy quickly, ignore feedback

D. Deploy model without data checks but monitor user complaints

Solution

1. Step 1: Identify responsible ML steps to prevent harm

   Responsible ML requires diverse data, bias testing, and ongoing monitoring.

2. Step 2: Evaluate options for these steps

   Use diverse training data, test for bias, monitor model after deployment includes all key steps; others skip important parts or ignore feedback.

3. Final Answer:

   Use diverse training data, test for bias, monitor model after deployment -> Option B

4. Quick Check:

   Diversity + testing + monitoring = Responsible ML [OK]

Hint: Combine data checks, bias tests, and monitoring [OK]

Common Mistakes:

• Ignoring data diversity
• Skipping bias testing
• Not monitoring after deployment