LightGBM in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is LightGBM?

LightGBM is a fast, efficient, and scalable gradient boosting framework that uses tree-based learning algorithms. It is designed to handle large datasets with high speed and low memory usage.

intermediate

How does LightGBM grow trees differently from traditional gradient boosting methods?

LightGBM grows trees leaf-wise (best-first) instead of level-wise. This means it splits the leaf with the largest loss reduction first, which can lead to faster convergence and better accuracy.

beginner

What are the main advantages of using LightGBM?

LightGBM is faster and uses less memory than many other gradient boosting frameworks. It supports parallel and GPU learning, handles large datasets well, and often achieves higher accuracy due to leaf-wise tree growth.

beginner

What is the purpose of the 'max_depth' parameter in LightGBM?

The 'max_depth' parameter limits the maximum depth of each tree. It helps prevent overfitting by controlling how complex each tree can become.

intermediate

How does LightGBM handle categorical features?

LightGBM can directly handle categorical features by finding the best split based on category grouping without needing to one-hot encode them, which saves memory and speeds up training.

What type of algorithm is LightGBM?

A Support vector machine

B Neural network

C Gradient boosting decision tree

D K-means clustering

LightGBM is a gradient boosting decision tree algorithm designed for fast and efficient training.

How does LightGBM grow trees?

A Leaf-wise

B Randomly

C Level-wise

D Depth-wise

LightGBM grows trees leaf-wise, splitting the leaf with the highest loss reduction first.

Which of these is NOT an advantage of LightGBM?

A Requires one-hot encoding for categorical features

B Handles large datasets efficiently

C Supports GPU training

D Uses less memory than many other frameworks

LightGBM can handle categorical features directly without one-hot encoding.

What does the 'max_depth' parameter control in LightGBM?

A Number of trees

B Number of features

C Learning rate

D Maximum depth of each tree

'max_depth' limits how deep each tree can grow to prevent overfitting.

Which metric is commonly used to evaluate LightGBM classification models?

A Mean squared error

B Accuracy

C Silhouette score

D Sum of squared errors

Accuracy is a common metric for classification tasks using LightGBM.

Explain how LightGBM differs from traditional gradient boosting methods in tree growth and why this matters.

Think about how LightGBM chooses which part of the tree to split next.

Describe the benefits of using LightGBM for large datasets and categorical features.

Consider what makes LightGBM efficient and easy to use with different data types.