Linear regression with np.polyfit() in NumPy - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does np.polyfit() do in simple terms?

np.polyfit() finds the best straight line (or curve) that fits your data points. It helps you understand the relationship between two sets of numbers.

beginner

What are the main inputs to np.polyfit()?

You give it two lists or arrays: one for the x-values (input) and one for the y-values (output). You also tell it the degree of the polynomial (1 for a straight line).

beginner

What does the output of np.polyfit(x, y, 1) represent?

It returns two numbers: the slope (how steep the line is) and the intercept (where the line crosses the y-axis).

beginner

How can you use the result of np.polyfit() to predict new values?

Use the slope and intercept to make a formula: y = slope * x + intercept. Plug in new x-values to get predicted y-values.

beginner

Why is linear regression useful in real life?

It helps you find trends and make predictions, like estimating house prices based on size or predicting sales from advertising spend.

What degree should you use in np.polyfit() for a straight line?

A 1

B 2

C 0

D 3

Degree 1 means a straight line (linear). Higher degrees mean curves.

What does the first number returned by np.polyfit(x, y, 1) represent?

A Intercept

B Slope

C Correlation

D Residual

The first number is the slope, showing how steep the line is.

If you want to predict y for a new x, what formula do you use after np.polyfit()?

A y = slope * x + intercept

B y = intercept * x + slope

C y = x / slope + intercept

D y = slope + intercept * x

The correct formula is y = slope * x + intercept.

Which Python library provides polyfit()?

A pandas

B matplotlib

C scikit-learn

D numpy

polyfit() is a function in the numpy library.

What kind of relationship does linear regression model?

A Non-linear

B Random

C Linear

D Categorical

Linear regression models a straight-line (linear) relationship between variables.

Explain how to perform a simple linear regression using np.polyfit() with example data.

Think about giving x and y data, calling polyfit, then using the results.

Describe why linear regression is useful and how np.polyfit() helps in data analysis.

Consider real-life examples like predicting prices or sales.

Practice

1. What does np.polyfit(x, y, 1) return when used for linear regression?

easy

A. The residual errors of the fit

B. The predicted y values for each x

C. An array with slope and intercept of the best fit line

D. A plot of the data points and the fit line

Solution

1. Step 1: Understand np.polyfit parameters

   np.polyfit(x, y, 1) fits a polynomial of degree 1 (a line) to data points x and y.

2. Step 2: Identify the output

   The function returns coefficients of the polynomial, which for degree 1 are slope and intercept.

3. Final Answer:

   An array with slope and intercept of the best fit line -> Option C

4. Quick Check:

   np.polyfit(x, y, 1) = [slope, intercept] [OK]

Hint: Degree 1 means line: output is slope and intercept [OK]

Common Mistakes:

• Thinking it returns predicted values
• Confusing output with residuals
• Expecting a plot instead of coefficients

2. Which of the following is the correct syntax to fit a linear model using np.polyfit?

easy

A. np.polyfit(x, y, 1)

B. np.polyfit(1, x, y)

C. np.polyfit(x, 1, y)

D. np.polyfit(y, x, 1)

Solution

1. Step 1: Recall np.polyfit argument order

   The function signature is np.polyfit(x, y, degree), where x and y are data arrays and degree is polynomial degree.

2. Step 2: Match correct argument order

   Only np.polyfit(x, y, 1) follows this order correctly.

3. Final Answer:

   np.polyfit(x, y, 1) -> Option A

4. Quick Check:

   np.polyfit(x, y, 1) correct syntax [OK]

Hint: Remember order: x, y, degree [OK]

Common Mistakes:

• Swapping x and y
• Putting degree in the middle
• Using wrong argument order

3. What will be the output of this code?

import numpy as np
x = np.array([1, 2, 3, 4])
y = np.array([2, 4, 6, 8])
coeffs = np.polyfit(x, y, 1)
print(coeffs)

medium

A. [2.0, 0.0]

B. [0.0, 2.0]

C. [1.0, 2.0]

D. [2.0, 1.0]

Solution

1. Step 1: Analyze data points

   y is exactly 2 times x, so the line is y = 2*x + 0.

2. Step 2: Understand np.polyfit output

   It returns [slope, intercept], so here [2.0, 0.0].

3. Final Answer:

   [2.0, 0.0] -> Option A

4. Quick Check:

   Line y=2x+0 means coeffs = [2.0, 0.0] [OK]

Hint: Check if y is multiple of x for slope, intercept zero [OK]

Common Mistakes:

• Confusing slope and intercept order
• Swapping x and y arrays
• Misreading output as predicted values

4. Identify the error in this code snippet:

import numpy as np
x = np.array([1, 2, 3])
y = np.array([2, 3, 5])
coeffs = np.polyfit(y, x, 1)
print(coeffs)

medium

A. Degree argument is missing

B. x and y are swapped in np.polyfit arguments

C. np.polyfit cannot handle arrays

D. No error, code is correct

Solution

1. Step 1: Check argument order in np.polyfit

   np.polyfit expects x first, then y, then degree.

2. Step 2: Identify mistake in code

   Here, y and x are swapped, so the fit will be incorrect or misleading.

3. Final Answer:

   x and y are swapped in np.polyfit arguments -> Option B

4. Quick Check:

   Correct order is np.polyfit(x, y, 1) [OK]

Hint: Remember: first x, then y in np.polyfit [OK]

Common Mistakes:

• Swapping x and y arrays
• Forgetting degree argument
• Assuming np.polyfit can't handle arrays

5. You have data points x = [0, 1, 2, 3] and y = [1, 3, 7, 13]. Using np.polyfit(x, y, 1), what is the best fit line equation?

hard

A. y = 3x + 0

B. y = 3x + 1

C. y = 4x + 0

D. y = 4x + 1

Solution

1. Step 1: Calculate slope and intercept manually

   Calculate slope m = (n∑xy - ∑x∑y)/(n∑x² - (∑x)²). Here, n=4, ∑x=6, ∑y=24, ∑xy=56, ∑x²=14. So, m = (4*56 - 6*24)/(4*14 - 6²) = (224 - 144)/(56 - 36) = 80/20 = 4.

2. Step 2: Find intercept

   Intercept b = (∑y - m∑x)/n = (24 - 4*6)/4 = (24 - 24)/4 = 0.

3. Step 3: Check residuals

   Check predicted y values: y_pred = 4x + 0 = [0,4,8,12], actual y = [1,3,7,13]. Residuals are not zero, so intercept might not be exactly zero.

4. Step 4: Use np.polyfit to confirm

   Using np.polyfit(x, y, 1) gives approximately [4.0, 1.0], so intercept is about 1.

5. Final Answer:

   y = 4x + 1 -> Option D

6. Quick Check:

   np.polyfit(x, y, 1) ≈ [4.0, 1.0] [OK]

Hint: Slope = (last y - first y) / (last x - first x), intercept adjusted by average [OK]

Common Mistakes:

• Ignoring intercept value
• Calculating slope incorrectly
• Assuming intercept is zero