Creating interaction features in ML Python - Quick Revision & Summary

Recall & Review

beginner

What are interaction features in machine learning?

Interaction features are new features created by combining two or more existing features to capture relationships between them that might improve model performance.

beginner

Why do we create interaction features?

We create interaction features to help the model learn complex patterns where the effect of one feature depends on another, improving prediction accuracy.

beginner

Give an example of an interaction feature.

If you have features 'age' and 'income', an interaction feature could be 'age * income' which might capture how income effect changes with age.

intermediate

How can interaction features be created in Python using pandas?

You can create interaction features by multiplying or combining columns, for example: df['age_income'] = df['age'] * df['income'].

intermediate

What is a potential downside of creating many interaction features?

Creating many interaction features can increase the number of features a lot, which may cause the model to overfit or slow down training.

What does an interaction feature represent?

A A feature that is always categorical

B A feature that is removed during preprocessing

C A feature that contains missing values

D A combination of two or more features to capture their joint effect

Interaction features combine features to capture relationships that single features alone might miss.

Which of these is an example of an interaction feature?

A age + income

B age - 5

C age * income

D income / 2

Multiplying two features like age and income creates an interaction feature.

What is a risk of adding too many interaction features?

A Model underfitting

B Model overfitting

C Faster training

D Loss of data

Too many features can cause the model to memorize training data and not generalize well.

How can you create an interaction feature in pandas?

A df['new'] = df['a'] * df['b']

B df['new'] = df['a'] + df['b']

C df['new'] = df['a'] / df['b']

D df['new'] = df['a'] - df['b']

Multiplying columns creates an interaction feature capturing joint effects.

When should you consider creating interaction features?

A When you suspect features influence the target together

B When you have only one feature

C When features are independent

D When data is categorical only

Interaction features help when combined features affect the target differently than alone.

Explain what interaction features are and why they can help machine learning models.

Think about how two features together might tell a different story than alone.

Describe how you would create an interaction feature in a dataset using Python.

Remember pandas lets you do math directly on columns.

Practice

1. What is the main purpose of creating interaction features in machine learning?

easy

A. To capture the combined effect of two or more features on the target

B. To reduce the number of features in the dataset

C. To normalize the features to a common scale

D. To remove irrelevant features automatically

Solution

1. Step 1: Understand interaction features

   Interaction features combine two or more features to capture their joint effect on the target variable.

2. Step 2: Compare options

   Only To capture the combined effect of two or more features on the target describes capturing combined effects, which is the purpose of interaction features.

3. Final Answer:

   To capture the combined effect of two or more features on the target -> Option A

4. Quick Check:

   Interaction features = combined effect [OK]

Hint: Interaction features capture combined effects of features [OK]

Common Mistakes:

• Confusing interaction features with feature scaling
• Thinking interaction features reduce feature count
• Assuming interaction features remove irrelevant features

2. Which of the following is the correct way to create an interaction feature between two numeric features x1 and x2 in Python?

easy

A. interaction = x1 * x2

B. interaction = x1 - x2

C. interaction = x1 / x2

D. interaction = x1 + x2

Solution

1. Step 1: Recall how interaction features are created

   Interaction features are typically created by multiplying numeric features to capture their joint effect.

2. Step 2: Check each option

   Only multiplication (x1 * x2) correctly creates an interaction feature.

3. Final Answer:

   interaction = x1 * x2 -> Option A

4. Quick Check:

   Interaction = multiply features [OK]

Hint: Multiply numeric features to create interaction features [OK]

Common Mistakes:

• Using addition instead of multiplication
• Using division or subtraction which do not capture interaction
• Confusing interaction with feature scaling

3. Given the code below, what will be the output of print(df['interaction'].tolist())?

import pandas as pd

df = pd.DataFrame({'x1': [1, 2, 3], 'x2': [4, 5, 6]})
df['interaction'] = df['x1'] * df['x2']
print(df['interaction'].tolist())

medium

A. [4, 5, 6]

B. [5, 7, 9]

C. [1, 2, 3]

D. [4, 10, 18]

Solution

1. Step 1: Calculate interaction feature values

   Multiply each pair: 1*4=4, 2*5=10, 3*6=18.

2. Step 2: Verify output list

   The list of interaction values is [4, 10, 18].

3. Final Answer:

   [4, 10, 18] -> Option D

4. Quick Check:

   Multiplying pairs = [4, 10, 18] [OK]

Hint: Multiply row-wise values for interaction feature list [OK]

Common Mistakes:

• Adding instead of multiplying features
• Confusing original features with interaction
• Misreading the DataFrame values

4. The following code attempts to create an interaction feature between two categorical features color and shape. What is the error?

import pandas as pd

df = pd.DataFrame({'color': ['red', 'blue'], 'shape': ['circle', 'square']})
df['interaction'] = df['color'] * df['shape']
print(df['interaction'])

medium

A. DataFrame columns must be numeric to create interaction

B. The DataFrame is missing a target column

C. You cannot multiply string columns directly; need encoding first

D. The print statement syntax is incorrect

Solution

1. Step 1: Understand data types for interaction

   Multiplying string columns causes an error because strings cannot be multiplied directly.

2. Step 2: Identify correct approach

   Categorical features must be encoded (e.g., one-hot or label encoding) before creating interaction features.

3. Final Answer:

   You cannot multiply string columns directly; need encoding first -> Option C

4. Quick Check:

   Multiply strings error = need encoding [OK]

Hint: Encode categorical features before multiplying [OK]

Common Mistakes:

• Trying to multiply raw string columns
• Ignoring data type requirements for interaction
• Assuming print syntax is wrong

5. You have two categorical features: Gender with values ['Male', 'Female'] and Smoker with values ['Yes', 'No']. How would you create an interaction feature to help a model learn their combined effect?

hard

A. Multiply the raw string columns directly

B. One-hot encode both features, then multiply corresponding columns

C. Add the string values together as new strings

D. Ignore interaction features for categorical data

Solution

1. Step 1: Encode categorical features

   Convert 'Gender' and 'Smoker' into one-hot encoded numeric columns.

2. Step 2: Create interaction features

   Multiply corresponding one-hot columns (e.g., Male*Yes) to capture combined effect.

3. Final Answer:

   One-hot encode both features, then multiply corresponding columns -> Option B

4. Quick Check:

   Encode then multiply categorical features [OK]

Hint: One-hot encode then multiply for categorical interaction [OK]

Common Mistakes:

• Trying to multiply raw strings
• Concatenating strings instead of encoding
• Skipping interaction features for categorical data