Regression analysis in MATLAB - Step-by-Step Execution

Concept Flow - Regression analysis

Start with data

↓

Choose regression model

↓

Fit model to data

↓

Calculate coefficients

↓

Evaluate model fit

↓

Use model for prediction

↓

End

Regression analysis fits a line or curve to data points to find relationships and make predictions.

Execution Sample

MATLAB

x = [1 2 3 4 5];
y = [2 4 5 4 5];
mdl = fitlm(x,y);
disp(mdl.Coefficients);

This code fits a linear regression model to x and y data and shows the coefficients.

Execution Table

Step	Action	Variable/Function	Result/Output
1	Define predictor data	x	[1 2 3 4 5]
2	Define response data	y	[2 4 5 4 5]
3	Fit linear model	mdl = fitlm(x,y)	Linear model object created
4	Extract coefficients	mdl.Coefficients	Estimate and statistics table
5	Display coefficients	disp(mdl.Coefficients)	Shows intercept and slope estimates
6	End	-	Model ready for prediction

💡 All steps completed, regression model fitted and coefficients displayed

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	After Step 4	Final
x	undefined	[1 2 3 4 5]	[1 2 3 4 5]	[1 2 3 4 5]	[1 2 3 4 5]	[1 2 3 4 5]
y	undefined	undefined	[2 4 5 4 5]	[2 4 5 4 5]	[2 4 5 4 5]	[2 4 5 4 5]
mdl	undefined	undefined	undefined	Linear model object	Linear model object	Linear model object

Key Moments - 3 Insights

Why do we need both x and y data before fitting the model?

The model needs predictor (x) and response (y) data to find the relationship, as shown in steps 1 and 2 in the execution_table.

What does the coefficient table represent?

It shows the intercept and slope estimates that define the best fit line, as seen in step 4 and 5 of the execution_table.

Can we predict new values before fitting the model?

No, the model must be fitted first to calculate coefficients, which is done in step 3 before prediction.

Visual Quiz - 3 Questions

Look at the execution_table, what is the value of x after step 2?

A [2 4 5 4 5]

B [1 2 3 4 5]

C undefined

D Linear model object

💡 Hint

Check the variable_tracker table under 'x' after step 2.

At which step is the linear model object created?

A Step 4

B Step 2

C Step 3

D Step 5

💡 Hint

Look at the execution_table row where 'Fit linear model' happens.

If we swap x and y in fitlm(y,x), what would change in the execution?

A The model fits y as predictor and x as response

B No change, same model

C Error occurs

D Coefficients become zero

💡 Hint

Recall that fitlm(predictor,response) expects predictor first, response second.

Concept Snapshot

Regression analysis fits a model to data points.
Use fitlm(x,y) in MATLAB for linear regression.
Coefficients show intercept and slope.
Model helps predict new values.
Requires both predictor and response data.

Full Transcript

Regression analysis is a way to find a relationship between two sets of data. In MATLAB, you start by defining your predictor data x and response data y. Then, you use the fitlm function to fit a linear model to these data points. This function calculates coefficients like the intercept and slope that best fit the data. You can display these coefficients to understand the model. After fitting, the model can be used to predict new values. Each step changes the variables: x and y are defined first, then the model object is created, and finally coefficients are extracted. Beginners often wonder why both x and y are needed; it's because the model needs both to find the relationship. The coefficients table shows the line equation. Predictions require the model to be fitted first. If you swap x and y, the roles of predictor and response switch, changing the model meaning.

Practice

1.

What is the main purpose of regression analysis in MATLAB?

easy

A. To find relationships between variables

B. To sort data alphabetically

C. To create pie charts

D. To calculate matrix inverses

Solution

1. Step 1: Understand regression analysis goal

   Regression analysis is used to find how one variable depends on others.

2. Step 2: Match purpose with options

   Only To find relationships between variables describes finding relationships between variables, which is the goal of regression.

3. Final Answer:

   To find relationships between variables -> Option A

4. Quick Check:

   Regression = find relationships [OK]

Hint: Regression = relationship finding between numbers [OK]

Common Mistakes:

• Confusing regression with sorting or plotting
• Thinking regression calculates matrix inverses

2.

Which MATLAB command correctly fits a linear regression model to data X and response Y?

?

easy

A. mdl = fitlm(X, Y);

B. mdl = linearfit(X, Y);

C. mdl = regress(X, Y);

D. mdl = fitmodel(X, Y);

Solution

1. Step 1: Recall MATLAB function for linear regression

   The function fitlm fits linear regression models in MATLAB.

2. Step 2: Check options for correct syntax

   Only mdl = fitlm(X, Y); uses fitlm(X, Y) correctly; others are invalid or incorrect functions.

3. Final Answer:

   mdl = fitlm(X, Y); -> Option A

4. Quick Check:

   fitlm = linear model fit [OK]

Hint: Use fitlm for linear regression in MATLAB [OK]

Common Mistakes:

• Using non-existent functions like linearfit or fitmodel
• Confusing regress syntax with fitlm

3.

What is the output of this MATLAB code?

X = (1:5)';
Y = [2; 4; 6; 8; 10];
mdl = fitlm(X, Y);
disp(mdl.Coefficients.Estimate(2));

medium

A. 10

B. 2

C. 1

D. 4

Solution

1. Step 1: Understand data and model

   X is 1 to 5, Y is 2,4,6,8,10 which is Y = 2*X exactly.

2. Step 2: Interpret coefficient output

   The slope (coefficient for X) is 2, so mdl.Coefficients.Estimate(2) returns 2.

3. Final Answer:

   2 -> Option B

4. Quick Check:

   Slope = 2 [OK]

Hint: Slope equals change in Y over X [OK]

Common Mistakes:

• Confusing intercept with slope coefficient
• Misreading coefficient index

4.

Identify the error in this MATLAB code for regression:

X = [1 2 3 4 5];
Y = [2; 4; 6; 8; 10];
mdl = fitlm(X, Y);

medium

A. fitlm requires three input arguments

B. fitlm cannot handle numeric data

C. Y must be a matrix, not a vector

D. X and Y should be column vectors, not row vectors

Solution

1. Step 1: Check input shapes for fitlm

   fitlm expects predictors and response as column vectors or tables.

2. Step 2: Identify vector orientation

   X is a row vector and Y is a column vector; they should be column vectors for fitlm to work properly.

3. Final Answer:

   X and Y should be column vectors, not row vectors -> Option D

4. Quick Check:

   fitlm needs column vectors [OK]

Hint: Use column vectors for fitlm inputs [OK]

Common Mistakes:

• Passing row vectors instead of column vectors
• Thinking fitlm needs 3 inputs
• Believing fitlm can't handle numeric vectors

5.

You have data vectors X and Y with some outliers. Which approach in MATLAB regression helps reduce outlier impact?

hard

A. Remove all data points manually

B. Use fitlm(X, Y) without options

C. Use fitlm(X, Y, ''RobustOpts'', ''on'')

D. Use polyfit(X, Y, 2) for quadratic fit

Solution

1. Step 1: Understand outlier effect on regression

   Outliers can distort ordinary least squares regression results.

2. Step 2: Identify MATLAB option for robustness

   Using RobustOpts set to 'on' in fitlm applies robust regression reducing outlier influence.

3. Final Answer:

   Use fitlm(X, Y, ''RobustOpts'', ''on'') -> Option C

4. Quick Check:

   RobustOpts = reduce outlier impact [OK]

Hint: Add RobustOpts 'on' to fitlm for outliers [OK]

Common Mistakes:

• Ignoring outliers and using default fitlm
• Removing data points without analysis
• Using polynomial fit which may not reduce outliers