Linear regression concept in ML Python - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding the purpose of linear regression

What is the main goal of linear regression in machine learning?

A To reduce the number of features by combining them

B To classify data points into different categories based on input features

C To cluster data points into groups without labels

D To find the best straight line that predicts a continuous output from input features

💡 Hint

Think about what linear regression predicts: numbers or categories?

Linear regression fits a straight line to data to predict continuous values, unlike classification or clustering.

❓ Predict Output

intermediate

Output of simple linear regression prediction

What is the predicted value y when x=3 using the model y = 2x + 1?

ML Python

def predict(x):
    return 2 * x + 1

result = predict(3)
print(result)

A 8

B 6

C 7

D 5

💡 Hint

Plug x=3 into the formula y=2x+1.

For x=3, y=2*3+1=7.

❓ Hyperparameter

advanced

Effect of learning rate in linear regression training

What happens if the learning rate is set too high during linear regression training with gradient descent?

A The model will underfit the data by stopping early

B The model may overshoot the minimum loss and fail to converge

C The model will ignore the input features

D The model will always converge faster without any issues

💡 Hint

Think about how big steps affect finding the lowest point in a valley.

A too high learning rate causes the training to jump over the minimum loss repeatedly, preventing convergence.

❓ Metrics

advanced

Choosing the right metric for linear regression

Which metric is commonly used to measure the error of a linear regression model's predictions?

A Mean Squared Error (MSE)

B Accuracy

C F1 Score

D Confusion Matrix

💡 Hint

This metric calculates the average squared difference between predicted and actual values.

MSE measures how close predictions are to actual values by averaging squared errors, suitable for regression.

🔧 Debug

expert

Identifying the error in linear regression code

What error will this code raise when fitting a linear regression model using scikit-learn? from sklearn.linear_model import LinearRegression X = [[1], [2], [3]] y = [2, 4, 6] model = LinearRegression() model.fit(X, y) print(model.predict([4]))

A ValueError because input to predict must be 2D array, but [4] is 1D

B TypeError because model.fit expects a list of strings

C No error, output will be 8

D NameError because LinearRegression is not imported

💡 Hint

Check the shape of the input passed to predict method.

scikit-learn expects a 2D array for inputs; [4] is 1D, causing ValueError.

Practice

1. What does linear regression primarily do in machine learning?

easy

A. It groups data points into clusters.

B. It reduces the number of features in data.

C. It finds a straight line to predict values based on input data.

D. It creates decision trees for classification.

Solution

1. Step 1: Understand the goal of linear regression

   Linear regression aims to find a straight line that best fits the data points to predict continuous values.

2. Step 2: Compare with other methods

   Clustering groups data, feature reduction simplifies data, and decision trees classify data, which are different tasks.

3. Final Answer:

   It finds a straight line to predict values based on input data. -> Option C

4. Quick Check:

   Linear regression = straight line prediction [OK]

Hint: Linear regression fits a line to predict numbers [OK]

Common Mistakes:

• Confusing regression with classification
• Thinking it groups data instead of predicting
• Mixing it up with feature reduction techniques

2. Which of the following is the correct formula for a simple linear regression model?

easy

A. y = m - x / b

B. y = mx + b

C. y = m + x * b

D. y = x / m + b

Solution

1. Step 1: Recall the linear regression formula

   The formula is y = mx + b, where m is slope and b is intercept.

2. Step 2: Check each option

   Only y = mx + b matches the correct formula exactly.

3. Final Answer:

   y = mx + b -> Option B

4. Quick Check:

   Linear formula = y = mx + b [OK]

Hint: Slope times x plus intercept equals y [OK]

Common Mistakes:

• Mixing multiplication and division signs
• Swapping slope and intercept positions
• Using incorrect operators between terms

3. Given the linear regression model y = 2x + 3, what is the predicted value when x = 4?

medium

A. 11

B. 14

C. 8

D. 10

Solution

1. Step 1: Substitute x = 4 into the model

   Calculate y = 2 * 4 + 3.

2. Step 2: Perform the calculation

   2 * 4 = 8, then 8 + 3 = 11.

3. Final Answer:

   11 -> Option A

4. Quick Check:

   2*4+3 = 11 [OK]

Hint: Multiply slope by x, then add intercept [OK]

Common Mistakes:

• Adding before multiplying
• Using wrong slope or intercept values
• Confusing x with y

4. Identify the error in this Python code for linear regression prediction:

def predict(x):
    return 2 * x +

print(predict(5))

medium

A. Syntax error due to incomplete return statement

B. Missing intercept value in the formula

C. Wrong function name for prediction

D. Incorrect multiplication operator

Solution

1. Step 1: Check the return statement syntax

   The return line ends with a plus sign and no value after it, causing a syntax error.

2. Step 2: Confirm error type

   Python requires complete expressions; incomplete return causes syntax error.

3. Final Answer:

   Syntax error due to incomplete return statement -> Option A

4. Quick Check:

   Incomplete return line = syntax error [OK]

Hint: Check if return line ends abruptly [OK]

Common Mistakes:

• Ignoring incomplete expression errors
• Assuming missing intercept is the error
• Thinking function name matters here

5. You have data points: (1,3), (2,5), (3,7). Which linear regression model best fits this data?

hard

A. y = x + 2

B. y = 3x + 0

C. y = 2x + 3

D. y = 2x + 1

Solution

1. Step 1: Calculate slope (m)

   Change in y: 5-3=2, 7-5=2; change in x: 2-1=1, 3-2=1; slope m = 2/1 = 2.

2. Step 2: Calculate intercept (b)

   Use point (1,3): 3 = 2*1 + b -> b = 3 - 2 = 1.

3. Final Answer:

   y = 2x + 1 -> Option D

4. Quick Check:

   Slope=2, intercept=1 fits points [OK]

Hint: Slope = change in y/change in x, intercept from point [OK]

Common Mistakes:

• Mixing slope and intercept values
• Using wrong points for calculation
• Assuming intercept is zero without checking