Custom transformers in ML Python - Model Pipeline Trace

Model Pipeline - Custom transformers

This pipeline shows how custom transformers help prepare data before training a model. Custom transformers let us add special steps to clean or change data in ways built-in tools don’t offer.

Data Flow - 5 Stages

1Raw data input

1000 rows x 5 columns→Load raw data with missing values and text columns→1000 rows x 5 columns

[{'age': 25, 'income': 50000, 'city': 'NY', 'score': 0.8, 'missing_feature': null}, ...]

↓

2Custom transformer: Fill missing values

1000 rows x 5 columns→Replace missing values with column mean→1000 rows x 5 columns

[{'age': 25, 'income': 50000, 'city': 'NY', 'score': 0.8, 'missing_feature': 0.5}, ...]

↓

3Custom transformer: Encode city names

1000 rows x 5 columns→Convert city names to numbers→1000 rows x 5 columns

[{'age': 25, 'income': 50000, 'city': 2, 'score': 0.8, 'missing_feature': 0.5}, ...]

↓

4Feature scaling

1000 rows x 5 columns→Scale numeric features to 0-1 range→1000 rows x 5 columns

[{'age': 0.25, 'income': 0.5, 'city': 2, 'score': 0.8, 'missing_feature': 0.5}, ...]

↓

5Model training

1000 rows x 5 columns→Train model on processed features→Model trained

Model learns to predict target from features

Training Trace - Epoch by Epoch

Loss
0.7 |****
0.6 |*** 
0.5 |**  
0.4 |*   
0.3 |*   
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.65	0.60	Model starts learning, loss is high, accuracy low
2	0.50	0.72	Loss decreases, accuracy improves
3	0.40	0.80	Model learns important patterns
4	0.35	0.85	Training converges, accuracy rising
5	0.30	0.88	Loss low, accuracy high, good fit

Prediction Trace - 5 Layers

Layer 1: Input sample

Layer 2: Fill missing values transformer

Layer 3: Encode city transformer

Layer 4: Feature scaling

Layer 5: Model prediction

Model Quiz - 3 Questions

What does the custom transformer for missing values do?

A Replaces missing values with the column mean

B Removes rows with missing values

C Converts missing values to zero

D Leaves missing values unchanged

Key Insight

Custom transformers let us add special data cleaning and feature changes that fit our needs. This helps the model learn better by giving it cleaner, more useful data.

Practice

1. What is the main purpose of creating a custom transformer in machine learning pipelines?

easy

A. To train a machine learning model directly

B. To define a reusable data processing step with fit and transform methods

C. To visualize data distributions

D. To store the final predictions of a model

Solution

1. Step 1: Understand the role of transformers

   Transformers process data by learning parameters in fit and applying changes in transform.

2. Step 2: Identify the purpose of custom transformers

   Custom transformers let you create your own data processing steps reusable in pipelines.

3. Final Answer:

   To define a reusable data processing step with fit and transform methods -> Option B

4. Quick Check:

   Custom transformer = reusable data step [OK]

Hint: Custom transformers handle data prep, not model training [OK]

Common Mistakes:

• Confusing transformers with models
• Thinking transformers visualize data
• Assuming transformers store predictions

2. Which of the following is the correct way to start defining a custom transformer class in Python using scikit-learn?

easy

A. class MyTransformer(Pipeline):

B. class MyTransformer(Model):

C. class MyTransformer(BaseEstimator, TransformerMixin):

D. def MyTransformer():

Solution

1. Step 1: Recall inheritance for custom transformers

   Custom transformers inherit from BaseEstimator and TransformerMixin to get fit and transform methods.

2. Step 2: Match correct class definition syntax

   class MyTransformer(BaseEstimator, TransformerMixin): correctly shows class inheritance from BaseEstimator and TransformerMixin.

3. Final Answer:

   class MyTransformer(BaseEstimator, TransformerMixin): -> Option C

4. Quick Check:

   Inheritance from BaseEstimator and TransformerMixin = class MyTransformer(BaseEstimator, TransformerMixin): [OK]

Hint: Custom transformers inherit BaseEstimator and TransformerMixin [OK]

Common Mistakes:

• Using Model or Pipeline as base classes
• Defining transformer as a function
• Missing inheritance entirely

3. Given this custom transformer code snippet, what will print(transformed_data) output?

from sklearn.base import BaseEstimator, TransformerMixin
import numpy as np

class AddConstant(BaseEstimator, TransformerMixin):
    def __init__(self, constant=1):
        self.constant = constant
    def fit(self, X, y=None):
        return self
    def transform(self, X):
        return X + self.constant

X = np.array([[1, 2], [3, 4]])
transformer = AddConstant(constant=5)
transformed_data = transformer.fit_transform(X)
print(transformed_data)

medium

A. [[6 7]
[8 9]]

B. [[1 2]
[3 4]]

C. [[5 5]
[5 5]]

D. Error: fit_transform method not defined

Solution

1. Step 1: Understand transform method behavior

   The transform method adds the constant (5) to every element in X.

2. Step 2: Calculate transformed data

   Original X is [[1,2],[3,4]]. Adding 5 gives [[6,7],[8,9]].

3. Final Answer:

   [[6 7] [8 9]] -> Option A

4. Quick Check:

   Adding constant 5 to X = [[6 7] [8 9]] [OK]

Hint: transform adds constant to all elements [OK]

Common Mistakes:

• Thinking fit_transform is missing
• Forgetting to add constant
• Confusing output with original data

4. What is wrong with this custom transformer code?

from sklearn.base import BaseEstimator, TransformerMixin

class MultiplyTransformer(BaseEstimator, TransformerMixin):
    def __init__(self, factor=2):
        self.factor = factor
    def fit(self, X, y=None):
        return self
    def transform(self, X):
        return X * self.factor

transformer = MultiplyTransformer(factor=3)
result = transformer.transform([1, 2, 3])
print(result)

medium

A. transform method should convert input to numpy array before multiplying

B. fit method is missing a return statement

C. factor should be a list, not an int

D. Class should inherit from Pipeline, not BaseEstimator

Solution

1. Step 1: Check input type handling in transform

   Input is a list, multiplying list by int repeats list instead of element-wise multiply.

2. Step 2: Fix transform to convert input to numpy array

   Converting input to numpy array allows element-wise multiplication as intended.

3. Final Answer:

   transform method should convert input to numpy array before multiplying -> Option A

4. Quick Check:

   List * int repeats list, need numpy array for element-wise multiply [OK]

Hint: Use numpy arrays for element-wise math in transform [OK]

Common Mistakes:

• Assuming list * int does element-wise multiply
• Missing return in fit method (actually present)
• Wrong base class inheritance

5. You want to create a custom transformer that replaces missing values in a dataset with the median of each column, then scales the data by dividing by the max value per column. Which approach correctly combines these steps in one transformer?

hard

A. In fit, replace missing values; in transform, compute medians and max values

B. Use two separate transformers instead of one custom transformer

C. Only implement transform method to do all steps without fit

D. In fit, compute medians and max values; in transform, replace missing with medians and divide by max values

Solution

1. Step 1: Understand fit and transform roles

   fit calculates statistics (median, max) from training data; transform applies these to new data.

2. Step 2: Apply correct sequence in methods

   In fit, compute medians and max values; in transform, replace missing with medians and divide by max values correctly computes medians and max in fit, then replaces missing and scales in transform.

3. Final Answer:

   In fit, compute medians and max values; in transform, replace missing with medians and divide by max values -> Option D

4. Quick Check:

   fit learns stats, transform applies them [OK]

Hint: fit learns stats; transform applies them to data [OK]

Common Mistakes:

• Doing data replacement in fit instead of transform
• Skipping fit method
• Using separate transformers unnecessarily