Boosting concept in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the main idea behind boosting in machine learning?

Boosting combines many weak models, each slightly better than random guessing, to create a strong model that makes accurate predictions.

beginner

How does boosting improve model performance?

Boosting focuses on correcting errors made by previous models by giving more attention to difficult examples, improving overall accuracy step by step.

beginner

Name a popular boosting algorithm.

AdaBoost is a popular boosting algorithm that adjusts weights on training examples to focus on harder cases.

beginner

What is a 'weak learner' in boosting?

A weak learner is a simple model that performs just a little better than random guessing, like a small decision tree.

beginner

Why does boosting often perform better than a single model?

Because it combines many weak models that learn from each other's mistakes, reducing errors and increasing prediction accuracy.

What does boosting mainly do to improve predictions?

A Uses one strong model only

B Randomly selects data points

C Combines weak models focusing on errors

D Ignores difficult examples

Boosting combines weak models and focuses on correcting errors from previous models.

Which of these is a boosting algorithm?

A AdaBoost

B K-Means

C PCA

D Random Forest

AdaBoost is a well-known boosting algorithm; Random Forest is a bagging method.

In boosting, what is a weak learner?

A A model that always predicts the same

B A perfect model

C A model that ignores data

D A model slightly better than guessing

A weak learner is a simple model that performs just a bit better than random guessing.

How does boosting treat difficult examples during training?

A Duplicates easy examples

B Gives them more weight

C Ignores them

D Removes them

Boosting increases the weight of difficult examples to focus learning on them.

Why is boosting considered an ensemble method?

A It combines multiple models

B It uses a single model

C It clusters data points

D It reduces data size

Boosting combines many weak models to form a stronger overall model.

Explain how boosting improves a model's accuracy using simple terms.

Think about how learning from mistakes helps you get better.

Describe what a weak learner is and why it is important in boosting.

Imagine small helpers that together do a big job.