Autocorrelation analysis in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is autocorrelation in time series data?

Autocorrelation measures how a time series is related to a lagged version of itself. It shows if past values influence future values.

beginner

Why is autocorrelation important in machine learning?

It helps detect patterns and dependencies in data over time, which can improve forecasting models and avoid misleading assumptions of independence.

intermediate

What does a high positive autocorrelation at lag 1 indicate?

It means the current value is strongly similar to the previous value, showing a persistent pattern or trend.

beginner

How can autocorrelation be visualized?

Using an autocorrelation plot (ACF plot), which shows autocorrelation values for different lags as bars or points.

intermediate

What is the difference between autocorrelation and partial autocorrelation?

Autocorrelation measures total correlation at a lag, while partial autocorrelation measures correlation at a lag after removing effects of shorter lags.

What does autocorrelation measure in a time series?

A Difference between two unrelated series

B Relationship between current and past values

C Random noise in data

D Correlation between two different variables

Autocorrelation measures how current values relate to past values in the same series.

Which plot is commonly used to visualize autocorrelation?

A Autocorrelation function (ACF) plot

B Scatter plot

C Box plot

D Histogram

The ACF plot shows autocorrelation values at different lags.

A high positive autocorrelation at lag 1 means:

A Current value is similar to previous value

B Values are unrelated

C Values are random

D Current value is opposite to previous value

High positive autocorrelation means values are similar to their immediate past values.

Partial autocorrelation differs from autocorrelation by:

A Only measuring lag 1

B Ignoring all lags

C Measuring correlation with unrelated series

D Measuring correlation after removing effects of shorter lags

Partial autocorrelation isolates the direct effect of a lag by removing influences of shorter lags.

Why should autocorrelation be checked before building forecasting models?

A To confirm data is random

B To remove all correlations

C To detect patterns and dependencies

D To increase noise

Checking autocorrelation helps identify patterns that improve forecasting accuracy.

Explain what autocorrelation is and why it matters in analyzing time series data.

Think about how past data points influence future ones.

Describe how you would use an autocorrelation plot to understand a time series.

Imagine looking at a bar chart showing similarity over time gaps.

Practice

1. What does autocorrelation measure in a time series dataset?

easy

A. The difference between the highest and lowest values in the data

B. The total sum of all data points in the series

C. The average value of the dataset

D. The relationship between current data points and past data points at different time lags

Solution

1. Step 1: Understand autocorrelation concept

   Autocorrelation checks how current values relate to past values at various time gaps (lags).

2. Step 2: Compare options to definition

   Only The relationship between current data points and past data points at different time lags correctly describes this relationship; others describe unrelated statistics.

3. Final Answer:

   The relationship between current data points and past data points at different time lags -> Option D

4. Quick Check:

   Autocorrelation = relationship with past points [OK]

Hint: Autocorrelation links current data to past data points [OK]

Common Mistakes:

• Confusing autocorrelation with average or sum
• Thinking it measures difference between max and min
• Assuming it only looks at immediate previous point

2. Which of the following Python code snippets correctly computes the autocorrelation at lag 1 for a list data?

easy

A. import numpy as np
np.corrcoef(data[:-1], data[1:])[0,1]

B. np.corrcoef(data, data)[0,1]

C. np.mean(data) - np.mean(data[1:])

D. np.sum(data) / len(data)

Solution

1. Step 1: Understand autocorrelation calculation

   Autocorrelation at lag 1 compares data points with the next point, so we correlate data[:-1] with data[1:].

2. Step 2: Check code correctness

   import numpy as np np.corrcoef(data[:-1], data[1:])[0,1] uses np.corrcoef correctly on shifted slices; others do not compute correlation at lag 1.

3. Final Answer:

   import numpy as np\nnp.corrcoef(data[:-1], data[1:])[0,1] -> Option A

4. Quick Check:

   Shifted slices correlation = import numpy as np np.corrcoef(data[:-1], data[1:])[0,1] [OK]

Hint: Use shifted slices for lag correlation in numpy [OK]

Common Mistakes:

• Using correlation of data with itself (option B)
• Calculating mean difference instead of correlation
• Using sum or mean instead of correlation

3. Given the time series data = [2, 4, 6, 8, 10], what is the autocorrelation at lag 1 using numpy's correlation coefficient?

medium

A. 0.9

B. 1.0

C. 0.8

D. 0.0

Solution

1. Step 1: Prepare shifted data slices

   data[:-1] = [2,4,6,8], data[1:] = [4,6,8,10]

2. Step 2: Calculate correlation coefficient

   These slices are perfectly linearly increasing, so correlation is 1.0.

3. Final Answer:

   1.0 -> Option B

4. Quick Check:

   Perfect linear increase = autocorrelation 1.0 [OK]

Hint: Perfect linear sequences have autocorrelation 1.0 [OK]

Common Mistakes:

• Calculating correlation with full data instead of shifted slices
• Confusing correlation with difference or ratio
• Rounding errors leading to wrong decimals

4. The following code attempts to compute autocorrelation at lag 2 but gives an error. What is the error?

import numpy as np
data = [1, 3, 5, 7, 9]
result = np.corrcoef(data[:-2], data[2:])[0,2]

medium

A. IndexError because index 2 is out of bounds for the correlation matrix

B. TypeError because data is a list, not a numpy array

C. ValueError because data slices have different lengths

D. No error, code runs correctly

Solution

1. Step 1: Analyze np.corrcoef output shape

   np.corrcoef returns a 2x2 matrix for two input arrays, so valid indices are 0 or 1.

2. Step 2: Check indexing in code

   Accessing [0,2] is invalid and causes IndexError.

3. Final Answer:

   IndexError because index 2 is out of bounds for the correlation matrix -> Option A

4. Quick Check:

   Correlation matrix max index = 1, so index 2 causes error [OK]

Hint: Correlation matrix for two arrays is 2x2, max index 1 [OK]

Common Mistakes:

• Assuming list input causes TypeError
• Thinking slices have different lengths (they are equal)
• Believing code runs without error

5. You have daily sales data showing a weekly pattern. How can autocorrelation analysis help you detect this seasonality?

hard

A. By plotting sales against time without any lag analysis

B. By calculating the average sales over the entire dataset

C. By computing autocorrelation at lag 7 to check if sales on a day relate to sales 7 days before

D. By computing autocorrelation only at lag 1

Solution

1. Step 1: Understand weekly seasonality

   Weekly seasonality means patterns repeat every 7 days.

2. Step 2: Use autocorrelation at lag 7

   Computing autocorrelation at lag 7 checks if sales today relate to sales 7 days ago, revealing weekly patterns.

3. Final Answer:

   By computing autocorrelation at lag 7 to check if sales on a day relate to sales 7 days before -> Option C

4. Quick Check:

   Weekly pattern detected by lag 7 autocorrelation [OK]

Hint: Match lag to season length to find repeating patterns [OK]

Common Mistakes:

• Using lag 1 only misses weekly pattern
• Ignoring lag and just averaging data
• Plotting without lag analysis misses seasonality