Linear regression basics in Data Analysis Python - Step-by-Step Execution

Concept Flow - Linear regression basics

Start with data points

↓

Calculate mean of X and Y

↓

Calculate slope (m)

↓

Calculate intercept (b)

↓

Form line equation: y = m*x + b

↓

Use line to predict new Y values

↓

Evaluate fit (optional)

This flow shows how linear regression finds the best line through data by calculating slope and intercept, then uses it to predict values.

Execution Sample

Data Analysis Python

import numpy as np
X = np.array([1, 2, 3, 4, 5])
Y = np.array([2, 4, 5, 4, 5])

m = ((X - X.mean()) * (Y - Y.mean())).sum() / ((X - X.mean())**2).sum()
b = Y.mean() - m * X.mean()

This code calculates the slope (m) and intercept (b) for a line fitting points X and Y.

Execution Table

Step	Calculation	Value	Explanation
1	Calculate mean of X	3.0	Mean of X values: (1+2+3+4+5)/5 = 3
2	Calculate mean of Y	4.0	Mean of Y values: (2+4+5+4+5)/5 = 4
3	Calculate numerator for slope	6.0	Sum of (X - mean_X)*(Y - mean_Y) = 6
4	Calculate denominator for slope	10.0	Sum of (X - mean_X)^2 = 10
5	Calculate slope m	0.6	Slope m = numerator / denominator = 6/10 = 0.6
6	Calculate intercept b	2.2	Intercept b = mean_Y - m*mean_X = 4 - 0.6*3 = 2.2
7	Form line equation	y = 0.6*x + 2.2	Final linear equation to predict Y from X

💡 All steps complete, slope and intercept calculated for linear regression line.

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	After Step 4	After Step 5	After Step 6	Final
X.mean()	N/A	3.0	3.0	3.0	3.0	3.0	3.0	3.0
Y.mean()	N/A	N/A	4.0	4.0	4.0	4.0	4.0	4.0
Numerator	N/A	N/A	N/A	6.0	6.0	6.0	6.0	6.0
Denominator	N/A	N/A	N/A	N/A	10.0	10.0	10.0	10.0
Slope m	N/A	N/A	N/A	N/A	N/A	0.6	0.6	0.6
Intercept b	N/A	N/A	N/A	N/A	N/A	N/A	2.2	2.2

Key Moments - 3 Insights

Why do we subtract the mean of X and Y when calculating the slope?

Subtracting the means centers the data around zero, which helps measure how X and Y vary together. This is shown in steps 3 and 4 of the execution_table where (X - mean_X) and (Y - mean_Y) are used.

What does the slope value represent in the line equation?

The slope (step 5) shows how much Y changes for each unit increase in X. Here, slope 0.6 means Y increases by 0.6 when X increases by 1.

How is the intercept calculated and what does it mean?

The intercept (step 6) is where the line crosses the Y-axis when X=0. It is calculated by adjusting the mean Y by the slope times mean X.

Visual Quiz - 3 Questions

Look at the execution_table at step 5. What is the slope (m) value?

A 3.0

B 1.6

C 0.6

D 4.0

💡 Hint

Check the 'Value' column at step 5 in the execution_table.

At which step does the calculation of the intercept (b) happen?

A Step 3

B Step 6

C Step 2

D Step 7

💡 Hint

Look for the step labeled 'Calculate intercept b' in the execution_table.

If the mean of X was larger, how would that affect the intercept b?

A Intercept b would decrease

B Intercept b would increase

C Intercept b would stay the same

D Intercept b would become zero

💡 Hint

Refer to the formula b = mean_Y - m * mean_X in the key moments and variable_tracker.

Concept Snapshot

Linear regression fits a line y = m*x + b to data.
Calculate mean of X and Y.
Find slope m = sum((X-mean_X)*(Y-mean_Y)) / sum((X-mean_X)^2).
Find intercept b = mean_Y - m*mean_X.
Use line to predict Y from X.

Full Transcript

Linear regression basics involve finding a straight line that best fits a set of data points. We start by calculating the average (mean) of the X values and the Y values. Then, we calculate the slope (m) by measuring how X and Y vary together, using the formula that sums the products of differences from their means. Next, we calculate the intercept (b), which is the point where the line crosses the Y-axis, by adjusting the mean of Y with the slope times the mean of X. The final line equation y = m*x + b can then be used to predict Y values for new X inputs. This process helps us understand relationships between variables in simple, clear steps.

Practice

1. What is the main goal of linear regression in data analysis?

easy

A. To find a straight line that best fits the data points

B. To group data points into clusters

C. To calculate the average of all data points

D. To sort data points in ascending order

Solution

1. Step 1: Understand the purpose of linear regression

   Linear regression aims to find a straight line that best represents the relationship between two variables.

2. Step 2: Compare options with the goal

   Only To find a straight line that best fits the data points describes finding a straight line that fits data points, which matches the goal of linear regression.

3. Final Answer:

   To find a straight line that best fits the data points -> Option A

4. Quick Check:

   Linear regression = best fit line [OK]

Hint: Linear regression fits a line to data points [OK]

Common Mistakes:

• Confusing regression with clustering
• Thinking regression sorts or averages data
• Mixing up regression with classification

2. Which of the following is the correct way to import the LinearRegression class from scikit-learn in Python?

easy

A. from sklearn.linear_model import LinearRegression

B. import LinearRegression from sklearn.linear_model

C. from sklearn import LinearRegression

D. import linear_model.LinearRegression

Solution

1. Step 1: Recall correct import syntax in Python

   Python uses 'from module import class' to import specific classes.

2. Step 2: Match with scikit-learn syntax

   Scikit-learn's LinearRegression is in sklearn.linear_model, so the correct import is 'from sklearn.linear_model import LinearRegression'.

3. Final Answer:

   from sklearn.linear_model import LinearRegression -> Option A

4. Quick Check:

   Correct import = from sklearn.linear_model import LinearRegression [OK]

Hint: Use 'from module import class' for specific imports [OK]

Common Mistakes:

• Using wrong import order
• Trying to import class directly from sklearn
• Using incorrect module names

3. What will be the output of this Python code using scikit-learn's LinearRegression?

from sklearn.linear_model import LinearRegression
import numpy as np

X = np.array([[1], [2], [3], [4]])
y = np.array([2, 4, 6, 8])
model = LinearRegression()
model.fit(X, y)
pred = model.predict([[5]])
print(round(pred[0], 1))

medium

A. 12.0

B. 9.0

C. 10.0

D. 8.0

Solution

1. Step 1: Understand the data and model fitting

   X values are 1 to 4, y values are 2, 4, 6, 8, which is y = 2 * x perfectly.

2. Step 2: Predict for X=5 using the fitted model

   Since y = 2 * x, prediction for 5 is 2 * 5 = 10. The code rounds to 1 decimal place, so output is 10.0.

3. Final Answer:

   10.0 -> Option C

4. Quick Check:

   Prediction = 2 * 5 = 10.0 [OK]

Hint: Check if data fits y=mx+b, then predict easily [OK]

Common Mistakes:

• Ignoring rounding in print
• Confusing input shape for predict
• Assuming wrong slope or intercept

4. Identify the error in this code snippet for fitting a linear regression model:

from sklearn.linear_model import LinearRegression
X = [1, 2, 3, 4]
y = [2, 4, 6, 8]
model = LinearRegression()
model.fit(X, y)

medium

A. LinearRegression cannot be imported from sklearn.linear_model

B. y should be a 2D array, not a list

C. model.fit requires no arguments

D. X should be a 2D array, not a 1D list

Solution

1. Step 1: Check input shapes for model.fit

   LinearRegression expects X as 2D array (samples, features). Here X is 1D list, which causes error.

2. Step 2: Confirm y shape is acceptable

   y can be 1D array/list for target values, so y is fine.

3. Final Answer:

   X should be a 2D array, not a 1D list -> Option D

4. Quick Check:

   X must be 2D for fit() [OK]

Hint: X must be 2D array for sklearn fit() [OK]

Common Mistakes:

• Passing 1D X array causes shape error
• Thinking y must be 2D
• Misunderstanding import statements

5. You have data of house sizes (in square meters) and their prices (in thousands). You want to predict the price of a house with 120 square meters using linear regression. Given these data points:

sizes = [50, 80, 100, 150]
prices = [150, 200, 250, 350]

Which code snippet correctly fits the model and predicts the price for 120 square meters?

hard

A. from sklearn.linear_model import LinearRegression
X = sizes
y = prices
model = LinearRegression()
model.fit(X, y)
pred = model.predict([120])
print(pred)

B. from sklearn.linear_model import LinearRegression
import numpy as np
X = np.array(sizes).reshape(-1,1)
y = np.array(prices)
model = LinearRegression()
model.fit(X, y)
pred = model.predict([[120]])
print(round(pred[0], 2))

C. import LinearRegression
X = sizes
model = LinearRegression()
model.fit(X, prices)
pred = model.predict(120)
print(pred)

D. from sklearn.linear_model import LinearRegression
import numpy as np
X = np.array(sizes)
y = np.array(prices)
model = LinearRegression()
model.fit(X, y)
pred = model.predict(np.array([120]))
print(pred)

Solution

1. Step 1: Prepare data in correct shape for fitting

   LinearRegression requires X as 2D array, so sizes must be reshaped with .reshape(-1,1).

2. Step 2: Fit model and predict correctly

   from sklearn.linear_model import LinearRegression import numpy as np X = np.array(sizes).reshape(-1,1) y = np.array(prices) model = LinearRegression() model.fit(X, y) pred = model.predict([[120]]) print(round(pred[0], 2)) reshapes X, fits model, predicts with [[120]] (2D), and rounds output, which is correct usage.

3. Final Answer:

   from sklearn.linear_model import LinearRegression import numpy as np X = np.array(sizes).reshape(-1,1) y = np.array(prices) model = LinearRegression() model.fit(X, y) pred = model.predict([[120]]) print(round(pred[0], 2)) -> Option B

4. Quick Check:

   Reshape X and predict with 2D input [OK]

Hint: Always reshape X to 2D before fitting and predicting [OK]

Common Mistakes:

• Not reshaping X to 2D array
• Passing 1D array to predict
• Incorrect import or usage of LinearRegression