Why proper evaluation prevents overfitting in ML Python - Quick Recap

Recall & Review

beginner

What is overfitting in machine learning?

Overfitting happens when a model learns the training data too well, including noise and details that don't apply to new data. This makes it perform poorly on unseen data.

beginner

Why do we need to evaluate a model on data it hasn't seen before?

Evaluating on new data shows if the model can generalize well. It helps us check if the model learned useful patterns or just memorized the training data.

intermediate

What is the role of a validation set in preventing overfitting?

A validation set is separate data used during training to tune the model. It helps detect overfitting early by showing if the model's performance drops on unseen data.

intermediate

How does cross-validation help in proper evaluation?

Cross-validation splits data into parts and trains multiple models on different parts. This gives a better estimate of how the model will perform on new data, reducing overfitting risk.

beginner

What happens if you only check model accuracy on training data?

You might think the model is perfect, but it could just be memorizing. This hides overfitting and leads to poor results on real-world data.

What does overfitting mean?

A Model performs poorly on both training and new data

B Model performs well on new data but poorly on training data

C Model performs perfectly on all data

D Model performs well on training but poorly on new data

Why use a validation set?

A To test the model on unseen data during training

B To increase training speed

C To add more features

D To reduce model size

What is cross-validation?

A Splitting data into parts to train and test multiple times

B Training on all data without splitting

C Using only training data for evaluation

D Ignoring validation data

What risk do you face if you evaluate only on training data?

A Model generalizes better

B Overfitting goes unnoticed

C Model size increases

D Model runs faster

Proper evaluation helps to:

A Ignore new data

B Make the model more complex

C Detect if the model generalizes well

D Train faster

Explain in your own words why evaluating a model on new data helps prevent overfitting.

Describe how cross-validation works and why it is useful for proper model evaluation.