LightGBM in ML Python - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to import the LightGBM library.

ML Python

import [1] as lgb

Drag options to blanks, or click blank then click option'

Atensorflow

Bsklearn

Cxgboost

Dlightgbm

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'sklearn' instead of 'lightgbm'.

Trying to import 'xgboost' which is a different library.

The LightGBM library is imported using import lightgbm as lgb.

2fill in blank

medium

Complete the code to create a LightGBM dataset from features X and labels y.

ML Python

train_data = lgb.Dataset([1], label=y)

Drag options to blanks, or click blank then click option'

AX

By

Ctrain

Ddata

Attempts:

3 left

💡 Hint

Common Mistakes

Passing labels y as the first argument instead of features X.

Using an undefined variable like 'train'.

The features are passed as the first argument to lgb.Dataset, so we use X.

3fill in blank

hard

Fix the error in the code to train a LightGBM model with 100 boosting rounds.

ML Python

model = lgb.train(params, train_data, num_boost_round=[1])

Drag options to blanks, or click blank then click option'

A10

B1000

C100

D1

Attempts:

3 left

💡 Hint

Common Mistakes

Using too few boosting rounds like 1 or 10.

Using an excessively large number like 1000 without reason.

The num_boost_round parameter controls the number of boosting iterations. 100 is a common choice for training.

4fill in blank

hard

Fill both blanks to set LightGBM parameters for binary classification with learning rate 0.05.

ML Python

params = {'objective': [1], 'learning_rate': [2]

Drag options to blanks, or click blank then click option'

A'binary'

B'multiclass'

C0.05

D0.1

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'multiclass' for binary classification.

Setting learning rate too high like 0.1.

The objective for binary classification is 'binary', and the learning rate is set to 0.05.

5fill in blank

hard

Fill all three blanks to predict with the model and calculate accuracy score.

ML Python

y_pred = model.predict([1])
y_pred_labels = (y_pred > [2]).astype(int)
accuracy = sum(y_pred_labels == [3]) / len(y_pred_labels)

Drag options to blanks, or click blank then click option'

AX_test

B0.5

Cy_test

DX_train

Attempts:

3 left

💡 Hint

Common Mistakes

Predicting on training data instead of test data.

Using wrong threshold values.

Comparing predictions with features instead of true labels.

We predict on X_test, use 0.5 as threshold to get labels, and compare with true labels y_test to compute accuracy.

Practice

1. What is the main purpose of LightGBM in machine learning?

easy

A. To preprocess data by scaling features

B. To build fast and accurate decision tree models

C. To perform image recognition using neural networks

D. To cluster data points without labels

Solution

1. Step 1: Understand LightGBM's role

   LightGBM is designed to create decision tree models quickly and accurately.

2. Step 2: Compare with other options

   Options A, B, and D describe other machine learning tasks not related to LightGBM.

3. Final Answer:

   To build fast and accurate decision tree models -> Option B

4. Quick Check:

   LightGBM purpose = fast, accurate trees [OK]

Hint: LightGBM is known for fast tree models [OK]

Common Mistakes:

• Confusing LightGBM with neural networks
• Thinking LightGBM is for data scaling
• Assuming LightGBM does clustering

2. Which of the following is the correct way to import LightGBM in Python?

easy

A. import lightgbm as lgb

B. import LightGBM

C. from lightgbm import LightGBM

D. import lgbm

Solution

1. Step 1: Recall LightGBM import syntax

   The standard way is to import the package as import lightgbm as lgb.

2. Step 2: Check other options

   Options B, C, and D are incorrect because they use wrong module names or syntax.

3. Final Answer:

   import lightgbm as lgb -> Option A

4. Quick Check:

   Standard import = import lightgbm as lgb [OK]

Hint: Use lowercase 'lightgbm' and alias 'lgb' [OK]

Common Mistakes:

• Using capital letters in import
• Trying to import non-existent submodules
• Using wrong alias names

3. What will be the output of this code snippet?

import lightgbm as lgb
from sklearn.datasets import load_iris
from sklearn.model_selection import train_test_split
from sklearn.metrics import accuracy_score

iris = load_iris()
X_train, X_test, y_train, y_test = train_test_split(iris.data, iris.target, test_size=0.2, random_state=42)
train_data = lgb.Dataset(X_train, label=y_train)
params = {'objective': 'multiclass', 'num_class': 3, 'verbose': -1}
model = lgb.train(params, train_data, num_boost_round=10)
preds = model.predict(X_test)
preds_labels = preds.argmax(axis=1)
print(accuracy_score(y_test, preds_labels))

medium

A. An exception because of wrong parameter names

B. A list of predicted class labels

C. A syntax error due to missing import

D. A float value between 0 and 1 representing accuracy

Solution

1. Step 1: Understand the code flow

   The code trains a LightGBM multiclass model on iris data and predicts test labels, then calculates accuracy.

2. Step 2: Identify output type

   The print statement outputs accuracy_score, which is a float between 0 and 1.

3. Final Answer:

   A float value between 0 and 1 representing accuracy -> Option D

4. Quick Check:

   accuracy_score output = float between 0 and 1 [OK]

Hint: Accuracy score prints float between 0 and 1 [OK]

Common Mistakes:

• Confusing predicted labels with accuracy output
• Expecting a list instead of a float
• Thinking code has syntax errors

4. Identify the error in this LightGBM training code:

import lightgbm as lgb
train_data = lgb.Dataset(X_train, label=y_train)
params = {'objective': 'binary'}
model = lgb.train(params, train_data, num_round=100)

medium

A. The 'objective' value 'binary' is invalid

B. The Dataset object is missing 'feature_name' argument

C. The parameter 'num_round' should be 'num_boost_round'

D. The import statement is incorrect

Solution

1. Step 1: Check LightGBM training parameters

   The correct parameter for number of boosting rounds is 'num_boost_round', not 'num_round'.

2. Step 2: Verify other parts

   'binary' is a valid objective, 'feature_name' is optional, and import is correct.

3. Final Answer:

   The parameter 'num_round' should be 'num_boost_round' -> Option C

4. Quick Check:

   Correct parameter name = num_boost_round [OK]

Hint: Use 'num_boost_round' for training rounds [OK]

Common Mistakes:

• Using 'num_round' instead of 'num_boost_round'
• Thinking 'binary' objective is invalid
• Adding unnecessary parameters

5. You want to improve LightGBM model accuracy on a classification task. Which combination of actions is best?

hard

A. Increase num_boost_round and tune learning_rate

B. Decrease num_boost_round and remove categorical features

C. Use default parameters without tuning

D. Train with fewer data samples to reduce overfitting

Solution

1. Step 1: Understand model tuning

   Increasing boosting rounds and tuning learning rate helps the model learn better patterns.

2. Step 2: Evaluate other options

   Decreasing rounds or removing categorical features usually harms accuracy; training on fewer samples reduces data quality.

3. Final Answer:

   Increase num_boost_round and tune learning_rate -> Option A

4. Quick Check:

   Tuning rounds and learning rate improves accuracy [OK]

Hint: Tune rounds and learning rate for better accuracy [OK]

Common Mistakes:

• Reducing training data to fix overfitting
• Ignoring categorical features
• Not tuning parameters at all