Pipeline best practices in ML Python - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Why use a pipeline in machine learning?

Which of the following is the main reason to use a pipeline when building a machine learning model?

A To reduce the number of features in the dataset by default

B To increase the size of the training dataset automatically

C To combine data preprocessing and model training steps into one workflow

D To make the model run faster by skipping data cleaning

💡 Hint

Think about how pipelines help organize multiple steps in a machine learning task.

Pipelines help combine preprocessing and model training into a single, repeatable workflow. This ensures consistent data handling and easier experimentation.

❓ Predict Output

intermediate

Output of pipeline with scaling and logistic regression

What will be the output of the following code snippet?

ML Python

from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression
import numpy as np

X = np.array([[1, 2], [3, 4], [5, 6]])
y = np.array([0, 1, 0])

pipe = Pipeline([
    ('scaler', StandardScaler()),
    ('clf', LogisticRegression(random_state=42))
])

pipe.fit(X, y)
pred = pipe.predict(np.array([[2, 3]]))
print(pred[0])

A 1

B 0

C IndexError

D ValueError

💡 Hint

Consider how the logistic regression model predicts based on the scaled input.

The pipeline scales the input [[2, 3]] and then predicts using the trained logistic regression model. Given the training data, the prediction is class 0.

❓ Model Choice

advanced

Choosing the right pipeline step for text data

You want to build a pipeline to classify text messages as spam or not spam. Which step should you add before the classifier to convert text into numbers?

A CountVectorizer()

B PCA()

C StandardScaler()

D KMeans()

💡 Hint

Think about how to convert text data into a format a model can understand.

CountVectorizer converts text into a matrix of token counts, which is suitable for feeding into classifiers. StandardScaler and PCA are for numeric data, and KMeans is a clustering algorithm.

❓ Hyperparameter

advanced

Setting hyperparameters in a pipeline

Given a pipeline with a scaler and a random forest classifier named 'clf', how do you set the number of trees (n_estimators) to 100 in the classifier using the pipeline object?

A pipe.set_params(clf__n_estimators=100)

B pipe.set_params(n_estimators=100)

C pipe.clf.n_estimators = 100

D pipe.set_params(scaler__n_estimators=100)

💡 Hint

Remember how to access parameters of steps inside a pipeline.

To set parameters of a step inside a pipeline, use the step name followed by two underscores and the parameter name. Here, 'clf__n_estimators' sets the number of trees in the classifier.

🔧 Debug

expert

Why does this pipeline cause a data leakage problem?

Consider this pipeline code:

from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression

pipe = Pipeline([
    ('scaler', StandardScaler()),
    ('clf', LogisticRegression())
])

pipe.fit(X_train, y_train)

# Later
X_train_scaled = pipe.named_steps['scaler'].transform(X_train)
X_test_scaled = pipe.named_steps['scaler'].transform(X_test)

model = LogisticRegression()
model.fit(X_train_scaled, y_train)

predictions = model.predict(X_test_scaled)

What is the main issue with this approach?

A The scaler is fit twice, causing data leakage from test data

B The logistic regression model is trained twice on the same data

C The scaler is fit only on training data, so no leakage occurs

D The pipeline is not used for prediction, causing inconsistent preprocessing

💡 Hint

Think about how the pipeline should be used for both training and prediction.

The pipeline is fit on training data, but then the scaler is used separately to transform data and a new logistic regression model is trained outside the pipeline. This breaks the pipeline's consistency and can cause errors or leakage if not careful. The pipeline should be used end-to-end for both training and prediction.

Practice

1. Why is it important to use a pipeline in machine learning projects?

easy

A. It organizes steps clearly and avoids mistakes

B. It makes the model run faster on GPUs

C. It automatically improves model accuracy

D. It replaces the need for data cleaning

Solution

1. Step 1: Understand the purpose of pipelines

   Pipelines help organize the sequence of data processing and modeling steps clearly.

2. Step 2: Identify benefits of pipelines

   They reduce human errors and make the process repeatable and easy to follow.

3. Final Answer:

   It organizes steps clearly and avoids mistakes -> Option A

4. Quick Check:

   Pipeline purpose = Organize steps [OK]

Hint: Pipelines keep steps tidy and error-free [OK]

Common Mistakes:

• Thinking pipelines speed up model training
• Believing pipelines improve accuracy automatically
• Assuming pipelines replace data cleaning

2. Which of the following is the correct way to create a simple pipeline in scikit-learn?

easy

A. Pipeline('scale', StandardScaler(), 'model', LogisticRegression())

B. Pipeline({'scale': StandardScaler(), 'model': LogisticRegression()})

C. Pipeline([('scale', StandardScaler()), ('model', LogisticRegression())])

D. Pipeline(scale=StandardScaler(), model=LogisticRegression())

Solution

1. Step 1: Recall scikit-learn pipeline syntax

   It requires a list of tuples with step name and transformer/model.

2. Step 2: Match syntax to options

   Only Pipeline([('scale', StandardScaler()), ('model', LogisticRegression())]) uses a list of tuples correctly.

3. Final Answer:

   Pipeline([('scale', StandardScaler()), ('model', LogisticRegression())]) -> Option C

4. Quick Check:

   Pipeline syntax = list of tuples [OK]

Hint: Use list of (name, step) tuples for pipelines [OK]

Common Mistakes:

• Using dictionary instead of list of tuples
• Passing keyword arguments instead of list
• Passing separate arguments without list

3. Given the code below, what will be the output of print(pipe.named_steps['model'].coef_) after fitting?

from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression

pipe = Pipeline([
  ('scale', StandardScaler()),
  ('model', LogisticRegression())
])

X = [[1, 2], [2, 3], [3, 4], [4, 5]]
y = [0, 0, 1, 1]
pipe.fit(X, y)
print(pipe.named_steps['model'].coef_)

medium

A. A 2D array with coefficients for each feature

B. An error because 'coef_' is not available

C. A list of predicted labels

D. A scalar value representing accuracy

Solution

1. Step 1: Understand pipeline fitting

   Pipeline fits scaler then logistic regression on data.

2. Step 2: Access model coefficients

   After fitting, LogisticRegression has attribute 'coef_' which is a 2D array of feature weights.

3. Final Answer:

   A 2D array with coefficients for each feature -> Option A

4. Quick Check:

   Model coef_ = 2D array [OK]

Hint: Model coef_ holds feature weights after fit [OK]

Common Mistakes:

• Expecting coef_ before fitting
• Confusing coef_ with predictions
• Trying to access coef_ on pipeline instead of model

4. What is wrong with this pipeline code snippet?

from sklearn.pipeline import Pipeline
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression

pipe = Pipeline([
  ('scale', StandardScaler()),
  ('model', LogisticRegression())
])

pipe.fit(X, y)
pipe.predict(X_test)

Assuming X, y, and X_test are defined correctly.

medium

A. The pipeline is missing a call to transform before predict

B. The pipeline steps are not in a list

C. The pipeline is missing a final estimator

D. Nothing is wrong; code runs fine

Solution

1. Step 1: Check pipeline construction

   Pipeline steps are correctly given as a list of tuples with scaler and model.

2. Step 2: Verify usage of fit and predict

   Calling fit and then predict on pipeline is correct; pipeline applies scaler then model automatically.

3. Final Answer:

   Nothing is wrong; code runs fine -> Option D

4. Quick Check:

   Pipeline fit/predict usage = correct [OK]

Hint: Pipeline handles transform internally during predict [OK]

Common Mistakes:

• Thinking transform must be called separately
• Passing steps as dict instead of list
• Missing final estimator in pipeline

5. You want to build a pipeline that scales data, selects the top 3 features, and then fits a logistic regression model. Which pipeline setup is best practice?

hard

A. Pipeline([('model', LogisticRegression()), ('scale', StandardScaler()), ('select', SelectKBest(k=3))])

B. Pipeline([('scale', StandardScaler()), ('select', SelectKBest(k=3)), ('model', LogisticRegression())])

C. Pipeline([('select', SelectKBest(k=3)), ('scale', StandardScaler()), ('model', LogisticRegression())])

D. Pipeline([('scale', StandardScaler()), ('model', LogisticRegression()), ('select', SelectKBest(k=3))])

Solution

1. Step 1: Determine correct order of steps

   Scaling should happen before feature selection to normalize data for selection.

2. Step 2: Place model last in pipeline

   The model must be the final step to fit on selected features.

3. Final Answer:

   Pipeline([('scale', StandardScaler()), ('select', SelectKBest(k=3)), ('model', LogisticRegression())]) -> Option B

4. Quick Check:

   Order: scale -> select -> model [OK]

Hint: Scale first, then select features, then model [OK]

Common Mistakes:

• Selecting features before scaling
• Putting model before preprocessing steps
• Mixing order of pipeline steps