Creating interaction features in ML Python - Practice Exercises

Challenge - 5 Problems

🧠 Conceptual

intermediate

Why create interaction features in a model?

Imagine you have two features: hours studied and hours slept. Why might creating an interaction feature (like multiplying these two) help your model?

A Because the combined effect of studying and sleeping might influence the outcome differently than each alone

B Because interaction features always reduce the number of features and simplify the model

C Because multiplying features always fixes missing data problems

D Because interaction features remove the need for normalization

💡 Hint

Think about how two things working together might have a different effect than each separately.

Interaction features capture how two variables together affect the target differently than individually. For example, studying a lot but sleeping very little might have a different impact than studying and sleeping both moderately.

❓ Predict Output

intermediate

Output of interaction feature creation code

What is the output of this Python code that creates an interaction feature?

ML Python

import pandas as pd

df = pd.DataFrame({'A': [1, 2, 3], 'B': [4, 5, 6]})
df['A_B'] = df['A'] * df['B']
print(df['A_B'].tolist())

A [1, 2, 3]

B [5, 7, 9]

C [4, 10, 18]

D [4, 5, 6]

💡 Hint

Multiply each element of column A by the corresponding element in column B.

The new column 'A_B' is created by multiplying values in 'A' and 'B' row-wise: 1*4=4, 2*5=10, 3*6=18.

❓ Model Choice

advanced

Best model type for interaction features

You have created many interaction features from your dataset. Which model type is best suited to automatically capture complex interactions without explicitly creating interaction features?

A K-Nearest Neighbors without feature scaling

B Linear Regression without interaction terms

C Simple Logistic Regression without polynomial features

D Decision Trees or Random Forests

💡 Hint

Think about models that split data based on feature values and can capture combinations naturally.

Decision Trees and Random Forests can capture complex feature interactions by splitting data on multiple features in sequence, without needing explicit interaction features.

❓ Hyperparameter

advanced

Hyperparameter affecting interaction feature complexity

When using polynomial features to create interaction terms, which hyperparameter controls the maximum degree of interactions included?

A degree

B alpha

C max_depth

D learning_rate

💡 Hint

It controls how many features are multiplied together.

The degree parameter in polynomial feature generation controls the highest power of features and thus the maximum interaction order included.

❓ Metrics

expert

Effect of interaction features on model metrics

You add interaction features to a regression model. After training, the training error decreases but the validation error increases. What does this indicate?

A The model is underfitting and needs more features

B The model is overfitting due to too many interaction features

C The interaction features improved generalization

D The data has no noise and the model is perfect

💡 Hint

Think about what it means when training error goes down but validation error goes up.

When training error decreases but validation error increases, the model fits training data too closely and fails to generalize, indicating overfitting often caused by too many or complex features like interaction terms.

Practice

1. What is the main purpose of creating interaction features in machine learning?

easy

A. To capture the combined effect of two or more features on the target

B. To reduce the number of features in the dataset

C. To normalize the features to a common scale

D. To remove irrelevant features automatically

Solution

1. Step 1: Understand interaction features

   Interaction features combine two or more features to capture their joint effect on the target variable.

2. Step 2: Compare options

   Only To capture the combined effect of two or more features on the target describes capturing combined effects, which is the purpose of interaction features.

3. Final Answer:

   To capture the combined effect of two or more features on the target -> Option A

4. Quick Check:

   Interaction features = combined effect [OK]

Hint: Interaction features capture combined effects of features [OK]

Common Mistakes:

• Confusing interaction features with feature scaling
• Thinking interaction features reduce feature count
• Assuming interaction features remove irrelevant features

2. Which of the following is the correct way to create an interaction feature between two numeric features x1 and x2 in Python?

easy

A. interaction = x1 * x2

B. interaction = x1 - x2

C. interaction = x1 / x2

D. interaction = x1 + x2

Solution

1. Step 1: Recall how interaction features are created

   Interaction features are typically created by multiplying numeric features to capture their joint effect.

2. Step 2: Check each option

   Only multiplication (x1 * x2) correctly creates an interaction feature.

3. Final Answer:

   interaction = x1 * x2 -> Option A

4. Quick Check:

   Interaction = multiply features [OK]

Hint: Multiply numeric features to create interaction features [OK]

Common Mistakes:

• Using addition instead of multiplication
• Using division or subtraction which do not capture interaction
• Confusing interaction with feature scaling

3. Given the code below, what will be the output of print(df['interaction'].tolist())?

import pandas as pd

df = pd.DataFrame({'x1': [1, 2, 3], 'x2': [4, 5, 6]})
df['interaction'] = df['x1'] * df['x2']
print(df['interaction'].tolist())

medium

A. [4, 5, 6]

B. [5, 7, 9]

C. [1, 2, 3]

D. [4, 10, 18]

Solution

1. Step 1: Calculate interaction feature values

   Multiply each pair: 1*4=4, 2*5=10, 3*6=18.

2. Step 2: Verify output list

   The list of interaction values is [4, 10, 18].

3. Final Answer:

   [4, 10, 18] -> Option D

4. Quick Check:

   Multiplying pairs = [4, 10, 18] [OK]

Hint: Multiply row-wise values for interaction feature list [OK]

Common Mistakes:

• Adding instead of multiplying features
• Confusing original features with interaction
• Misreading the DataFrame values

4. The following code attempts to create an interaction feature between two categorical features color and shape. What is the error?

import pandas as pd

df = pd.DataFrame({'color': ['red', 'blue'], 'shape': ['circle', 'square']})
df['interaction'] = df['color'] * df['shape']
print(df['interaction'])

medium

A. DataFrame columns must be numeric to create interaction

B. The DataFrame is missing a target column

C. You cannot multiply string columns directly; need encoding first

D. The print statement syntax is incorrect

Solution

1. Step 1: Understand data types for interaction

   Multiplying string columns causes an error because strings cannot be multiplied directly.

2. Step 2: Identify correct approach

   Categorical features must be encoded (e.g., one-hot or label encoding) before creating interaction features.

3. Final Answer:

   You cannot multiply string columns directly; need encoding first -> Option C

4. Quick Check:

   Multiply strings error = need encoding [OK]

Hint: Encode categorical features before multiplying [OK]

Common Mistakes:

• Trying to multiply raw string columns
• Ignoring data type requirements for interaction
• Assuming print syntax is wrong

5. You have two categorical features: Gender with values ['Male', 'Female'] and Smoker with values ['Yes', 'No']. How would you create an interaction feature to help a model learn their combined effect?

hard

A. Multiply the raw string columns directly

B. One-hot encode both features, then multiply corresponding columns

C. Add the string values together as new strings

D. Ignore interaction features for categorical data

Solution

1. Step 1: Encode categorical features

   Convert 'Gender' and 'Smoker' into one-hot encoded numeric columns.

2. Step 2: Create interaction features

   Multiply corresponding one-hot columns (e.g., Male*Yes) to capture combined effect.

3. Final Answer:

   One-hot encode both features, then multiply corresponding columns -> Option B

4. Quick Check:

   Encode then multiply categorical features [OK]

Hint: One-hot encode then multiply for categorical interaction [OK]

Common Mistakes:

• Trying to multiply raw strings
• Concatenating strings instead of encoding
• Skipping interaction features for categorical data