One-hot encoding in ML Python

Introduction

One-hot encoding changes categories into numbers that computers can understand easily. It helps models learn from data with labels like colors or types.

When you have a list of fruits like apple, banana, and orange and want to use them in a model.

When your data has categories like car brands and you need to turn them into numbers.

When preparing survey answers like 'yes', 'no', or 'maybe' for machine learning.

When you want to avoid giving wrong importance to categories by using plain numbers.

When feeding categorical data into models that only understand numbers, like neural networks.

Syntax

ML Python

from sklearn.preprocessing import OneHotEncoder

encoder = OneHotEncoder(sparse_output=False)
encoded_data = encoder.fit_transform(data)

fit_transform learns the categories and converts data in one step.

Setting sparse_output=False returns a normal array instead of a sparse matrix.

Examples

This example converts three colors into one-hot encoded numbers.

ML Python

from sklearn.preprocessing import OneHotEncoder

encoder = OneHotEncoder(sparse_output=False)
data = [['red'], ['green'], ['blue']]
encoded = encoder.fit_transform(data)
print(encoded)

This example drops the first category to avoid extra columns.

ML Python

from sklearn.preprocessing import OneHotEncoder

encoder = OneHotEncoder(sparse_output=False, drop='first')
data = [['cat'], ['dog'], ['cat']]
encoded = encoder.fit_transform(data)
print(encoded)

Sample Model

This program shows how one-hot encoding changes fruit names into numbers. It prints the original list, the encoded array, and the categories found.

ML Python

from sklearn.preprocessing import OneHotEncoder

# Sample data with three categories
data = [['apple'], ['banana'], ['apple'], ['orange']]

# Create encoder
encoder = OneHotEncoder(sparse_output=False)

# Fit and transform data
encoded_data = encoder.fit_transform(data)

# Show original and encoded data
print('Original data:', data)
print('Encoded data:')
print(encoded_data)

# Show categories learned
print('Categories:', encoder.categories_)

Important Notes

One-hot encoding creates a new column for each category with 1 or 0 to show presence.

It works best for categories without order, like colors or names.

Too many categories can make data very large, so use carefully.

Summary

One-hot encoding turns categories into easy-to-use numbers for models.

It creates a separate column for each category with 1 or 0 values.

Use it when your data has labels that are not numbers.

Practice

1. What does one-hot encoding do in machine learning?

easy

A. It converts categorical labels into binary columns with 1s and 0s.

B. It normalizes numerical data to a 0-1 range.

C. It reduces the number of features by combining categories.

D. It fills missing values with the most frequent category.

Solution

1. Step 1: Understand the purpose of one-hot encoding

   One-hot encoding transforms categorical data into a format that machine learning models can use by creating separate binary columns for each category.

2. Step 2: Compare options with this definition

   Only It converts categorical labels into binary columns with 1s and 0s. describes this process correctly; others describe different preprocessing steps.

3. Final Answer:

   It converts categorical labels into binary columns with 1s and 0s. -> Option A

4. Quick Check:

   One-hot encoding = binary columns [OK]

Hint: One-hot means one column per category with 1 or 0 [OK]

Common Mistakes:

• Confusing one-hot encoding with normalization
• Thinking it reduces features instead of expanding
• Mixing it up with missing value imputation

2. Which of the following is the correct way to apply one-hot encoding using pandas in Python?

easy

A. data.encode_onehot('color')

B. data.one_hot_encode('color')

C. pd.onehot(data['color'])

D. pd.get_dummies(data['color'])

Solution

1. Step 1: Recall pandas function for one-hot encoding

   The pandas library uses the function get_dummies() to perform one-hot encoding on a column.

2. Step 2: Match the correct syntax

   Only pd.get_dummies(data['color']) uses the correct function and syntax; other options are invalid pandas methods.

3. Final Answer:

   pd.get_dummies(data['color']) -> Option D

4. Quick Check:

   pandas one-hot = get_dummies() [OK]

Hint: Use pd.get_dummies() for one-hot encoding in pandas [OK]

Common Mistakes:

• Using non-existent pandas methods
• Trying to call one-hot encoding directly on DataFrame without get_dummies
• Confusing method names

3. Given the code:

import pandas as pd
colors = ['red', 'blue', 'green', 'blue']
df = pd.DataFrame({'color': colors})
encoded = pd.get_dummies(df['color'])
print(encoded)

What is the printed output?

medium

A. A list of encoded numbers like [0,1,2,1].

B. An error because get_dummies requires a DataFrame, not a Series.

C. A DataFrame with columns 'red', 'blue', 'green' containing 1s and 0s for each row.

D. A DataFrame with a single column showing the original colors.

Solution

1. Step 1: Understand pd.get_dummies on a Series

   Applying pd.get_dummies on a Series creates a DataFrame with one column per unique category, filled with 1s and 0s indicating presence.

2. Step 2: Predict the output for given colors

   Since colors are 'red', 'blue', 'green', 'blue', the output will have columns 'blue', 'green', 'red' with 1s where the color matches and 0s otherwise.

3. Final Answer:

   A DataFrame with columns 'red', 'blue', 'green' containing 1s and 0s for each row. -> Option C

4. Quick Check:

   get_dummies output = binary columns DataFrame [OK]

Hint: get_dummies creates one column per category with 1/0 [OK]

Common Mistakes:

• Expecting numeric labels instead of binary columns
• Thinking get_dummies returns a list
• Assuming get_dummies needs a DataFrame, not Series

4. You wrote this code to one-hot encode a column but get an error:

from sklearn.preprocessing import OneHotEncoder
encoder = OneHotEncoder()
encoder.fit(['red', 'blue', 'green'])

What is the error and how to fix it?

medium

A. Error: OneHotEncoder requires numeric input; convert colors to numbers first.

B. Error: input must be 2D array; fix by reshaping input to [['red'], ['blue'], ['green']].

C. Error: OneHotEncoder is deprecated; use pd.get_dummies instead.

D. No error; code runs fine as is.

Solution

1. Step 1: Identify input shape requirement for OneHotEncoder

   sklearn's OneHotEncoder expects a 2D array (like a list of lists), not a 1D list.

2. Step 2: Fix input shape

   Reshape the input to [['red'], ['blue'], ['green']] to make it 2D and avoid the error.

3. Final Answer:

   Error: input must be 2D array; fix by reshaping input to [['red'], ['blue'], ['green']]. -> Option B

4. Quick Check:

   OneHotEncoder input = 2D array [OK]

Hint: OneHotEncoder needs 2D input, reshape 1D list to list of lists [OK]

Common Mistakes:

• Passing 1D list instead of 2D array
• Thinking OneHotEncoder only works with numbers
• Ignoring sklearn input shape requirements

5. You have a dataset with a column 'fruit' containing ['apple', 'banana', 'apple', 'orange', 'banana', 'apple']. You want to one-hot encode it but also keep track of the original order and avoid creating extra columns for unseen fruits later. Which approach is best?

hard

A. Use sklearn's OneHotEncoder with handle_unknown='ignore' and fit on training data only.

B. Use pd.get_dummies on the entire dataset including test data.

C. Manually create columns for each fruit and fill 1 or 0 by checking each row.

D. Convert fruits to numbers using label encoding before one-hot encoding.

Solution

1. Step 1: Understand the need to handle unseen categories

   When encoding training data, unseen categories in test data can cause errors unless handled properly.

2. Step 2: Choose method that fits training data and ignores unknowns

   sklearn's OneHotEncoder with handle_unknown='ignore' fits on training data and safely encodes test data without errors.

3. Step 3: Avoid pd.get_dummies on combined data to prevent data leakage

   Using pd.get_dummies on all data leaks test info into training and may create inconsistent columns.

4. Final Answer:

   Use sklearn's OneHotEncoder with handle_unknown='ignore' and fit on training data only. -> Option A

5. Quick Check:

   OneHotEncoder with ignore unknown = best practice [OK]

Hint: Fit encoder on train, ignore unknown categories in test [OK]

Common Mistakes:

• Using pd.get_dummies on combined train and test data
• Not handling unknown categories causing errors
• Label encoding before one-hot causing wrong model input