Custom transformers in ML Python

Introduction

Custom transformers let you create your own data processing steps to prepare data exactly how you want before training a model.

When you need to clean or change data in a special way not covered by built-in tools.

When you want to reuse the same data processing steps in different projects easily.

When you want to include your data changes inside a machine learning pipeline.

When you want to keep your code organized and clear by separating data preparation from model training.

Syntax

ML Python

from sklearn.base import BaseEstimator, TransformerMixin

class MyTransformer(BaseEstimator, TransformerMixin):
    def __init__(self, param=1):
        # initialize parameters
        self.param = param

    def fit(self, X, y=None):
        # learn from data if needed
        return self

    def transform(self, X):
        # change data and return it
        return X

Custom transformers must inherit from BaseEstimator and TransformerMixin to work well with scikit-learn pipelines.

The fit method learns from data (optional), and transform changes the data.

Examples

This transformer adds a fixed number to all values in the data.

ML Python

from sklearn.base import BaseEstimator, TransformerMixin

class AddConstantTransformer(BaseEstimator, TransformerMixin):
    def __init__(self, constant=1):
        self.constant = constant

    def fit(self, X, y=None):
        return self

    def transform(self, X):
        return X + self.constant

This transformer applies a log transform to make data less skewed.

ML Python

from sklearn.base import BaseEstimator, TransformerMixin
import numpy as np

class LogTransformer(BaseEstimator, TransformerMixin):
    def fit(self, X, y=None):
        return self

    def transform(self, X):
        return np.log1p(X)

Sample Model

This program creates a custom transformer that squares input numbers, then trains a linear regression model on the transformed data. It shows how to use the transformer inside a pipeline.

ML Python

from sklearn.base import BaseEstimator, TransformerMixin
from sklearn.pipeline import Pipeline
from sklearn.linear_model import LinearRegression
from sklearn.model_selection import train_test_split
import numpy as np

# Custom transformer that squares the input features
class SquareTransformer(BaseEstimator, TransformerMixin):
    def fit(self, X, y=None):
        return self

    def transform(self, X):
        return X ** 2

# Create sample data
X = np.array([[1], [2], [3], [4], [5]])
y = np.array([2, 4, 6, 8, 10])

# Split data
X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=42)

# Build pipeline with custom transformer and linear regression
pipeline = Pipeline([
    ('square', SquareTransformer()),
    ('model', LinearRegression())
])

# Train model
pipeline.fit(X_train, y_train)

# Predict on test data
predictions = pipeline.predict(X_test)

# Print predictions and score
print('Predictions:', predictions)
print('Model R^2 score:', pipeline.score(X_test, y_test))

Important Notes

Always return self in the fit method to allow chaining in pipelines.

Transformers should not change the number of samples (rows) in the data.

Use pipelines to combine custom transformers with models for clean and reusable code.

Summary

Custom transformers let you create your own data processing steps.

They must have fit and transform methods and inherit from BaseEstimator and TransformerMixin.

Use them inside pipelines to keep your machine learning code organized and reusable.

Practice

1. What is the main purpose of creating a custom transformer in machine learning pipelines?

easy

A. To train a machine learning model directly

B. To define a reusable data processing step with fit and transform methods

C. To visualize data distributions

D. To store the final predictions of a model

Solution

1. Step 1: Understand the role of transformers

   Transformers process data by learning parameters in fit and applying changes in transform.

2. Step 2: Identify the purpose of custom transformers

   Custom transformers let you create your own data processing steps reusable in pipelines.

3. Final Answer:

   To define a reusable data processing step with fit and transform methods -> Option B

4. Quick Check:

   Custom transformer = reusable data step [OK]

Hint: Custom transformers handle data prep, not model training [OK]

Common Mistakes:

• Confusing transformers with models
• Thinking transformers visualize data
• Assuming transformers store predictions

2. Which of the following is the correct way to start defining a custom transformer class in Python using scikit-learn?

easy

A. class MyTransformer(Pipeline):

B. class MyTransformer(Model):

C. class MyTransformer(BaseEstimator, TransformerMixin):

D. def MyTransformer():

Solution

1. Step 1: Recall inheritance for custom transformers

   Custom transformers inherit from BaseEstimator and TransformerMixin to get fit and transform methods.

2. Step 2: Match correct class definition syntax

   class MyTransformer(BaseEstimator, TransformerMixin): correctly shows class inheritance from BaseEstimator and TransformerMixin.

3. Final Answer:

   class MyTransformer(BaseEstimator, TransformerMixin): -> Option C

4. Quick Check:

   Inheritance from BaseEstimator and TransformerMixin = class MyTransformer(BaseEstimator, TransformerMixin): [OK]

Hint: Custom transformers inherit BaseEstimator and TransformerMixin [OK]

Common Mistakes:

• Using Model or Pipeline as base classes
• Defining transformer as a function
• Missing inheritance entirely

3. Given this custom transformer code snippet, what will print(transformed_data) output?

from sklearn.base import BaseEstimator, TransformerMixin
import numpy as np

class AddConstant(BaseEstimator, TransformerMixin):
    def __init__(self, constant=1):
        self.constant = constant
    def fit(self, X, y=None):
        return self
    def transform(self, X):
        return X + self.constant

X = np.array([[1, 2], [3, 4]])
transformer = AddConstant(constant=5)
transformed_data = transformer.fit_transform(X)
print(transformed_data)

medium

A. [[6 7]
[8 9]]

B. [[1 2]
[3 4]]

C. [[5 5]
[5 5]]

D. Error: fit_transform method not defined

Solution

1. Step 1: Understand transform method behavior

   The transform method adds the constant (5) to every element in X.

2. Step 2: Calculate transformed data

   Original X is [[1,2],[3,4]]. Adding 5 gives [[6,7],[8,9]].

3. Final Answer:

   [[6 7] [8 9]] -> Option A

4. Quick Check:

   Adding constant 5 to X = [[6 7] [8 9]] [OK]

Hint: transform adds constant to all elements [OK]

Common Mistakes:

• Thinking fit_transform is missing
• Forgetting to add constant
• Confusing output with original data

4. What is wrong with this custom transformer code?

from sklearn.base import BaseEstimator, TransformerMixin

class MultiplyTransformer(BaseEstimator, TransformerMixin):
    def __init__(self, factor=2):
        self.factor = factor
    def fit(self, X, y=None):
        return self
    def transform(self, X):
        return X * self.factor

transformer = MultiplyTransformer(factor=3)
result = transformer.transform([1, 2, 3])
print(result)

medium

A. transform method should convert input to numpy array before multiplying

B. fit method is missing a return statement

C. factor should be a list, not an int

D. Class should inherit from Pipeline, not BaseEstimator

Solution

1. Step 1: Check input type handling in transform

   Input is a list, multiplying list by int repeats list instead of element-wise multiply.

2. Step 2: Fix transform to convert input to numpy array

   Converting input to numpy array allows element-wise multiplication as intended.

3. Final Answer:

   transform method should convert input to numpy array before multiplying -> Option A

4. Quick Check:

   List * int repeats list, need numpy array for element-wise multiply [OK]

Hint: Use numpy arrays for element-wise math in transform [OK]

Common Mistakes:

• Assuming list * int does element-wise multiply
• Missing return in fit method (actually present)
• Wrong base class inheritance

5. You want to create a custom transformer that replaces missing values in a dataset with the median of each column, then scales the data by dividing by the max value per column. Which approach correctly combines these steps in one transformer?

hard

A. In fit, replace missing values; in transform, compute medians and max values

B. Use two separate transformers instead of one custom transformer

C. Only implement transform method to do all steps without fit

D. In fit, compute medians and max values; in transform, replace missing with medians and divide by max values

Solution

1. Step 1: Understand fit and transform roles

   fit calculates statistics (median, max) from training data; transform applies these to new data.

2. Step 2: Apply correct sequence in methods

   In fit, compute medians and max values; in transform, replace missing with medians and divide by max values correctly computes medians and max in fit, then replaces missing and scales in transform.

3. Final Answer:

   In fit, compute medians and max values; in transform, replace missing with medians and divide by max values -> Option D

4. Quick Check:

   fit learns stats, transform applies them [OK]

Hint: fit learns stats; transform applies them to data [OK]

Common Mistakes:

• Doing data replacement in fit instead of transform
• Skipping fit method
• Using separate transformers unnecessarily