ARIMA model basics in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does ARIMA stand for in time series forecasting?

ARIMA stands for AutoRegressive Integrated Moving Average. It is a model used to understand and predict future points in a time series by combining autoregression, differencing (integration), and moving average components.

beginner

What is the role of the 'Integrated' part in ARIMA?

The 'Integrated' part means differencing the data to make it stationary. Stationary data has a constant mean and variance over time, which helps the model make better predictions.

beginner

Explain the 'AutoRegressive' (AR) component in ARIMA.

The AR part uses past values of the time series to predict the current value. It assumes that past points have a linear relationship with the current point.

beginner

What does the 'Moving Average' (MA) component do in ARIMA?

The MA part models the error of the prediction as a combination of past errors. It helps smooth out the noise by considering the impact of previous forecast errors.

beginner

What are the three parameters of an ARIMA model and what do they represent?

The three parameters are (p, d, q):
- p: number of autoregressive terms (AR)
- d: number of times the data is differenced (Integrated)
- q: number of moving average terms (MA)
Together, they define the ARIMA model structure.

What is the purpose of differencing in an ARIMA model?

A To remove outliers from the data

B To make the time series stationary

C To smooth the data by averaging

D To increase the number of data points

Differencing helps remove trends and seasonality to make the data stationary, which is important for ARIMA modeling.

In ARIMA(p, d, q), what does 'p' represent?

A Number of autoregressive terms

B Number of times data is differenced

C Number of moving average terms

D Number of seasonal cycles

'p' is the number of autoregressive terms, meaning how many past values are used to predict the current value.

Which component of ARIMA models the relationship between past forecast errors and the current value?

A Moving Average (MA)

B Integrated (I)

C Autoregressive (AR)

D Differencing

The Moving Average (MA) component models the current value based on past forecast errors.

Why is stationarity important in ARIMA modeling?

A It increases the number of data points

B It guarantees perfect predictions

C It removes all noise from the data

D It ensures the data has a constant mean and variance over time

Stationarity means the statistical properties of the series do not change over time, which is necessary for ARIMA to work well.

If a time series is not stationary, what is the common first step before applying ARIMA?

A Use only the moving average component

B Add more data points

C Apply differencing to the data

D Ignore the problem and fit the model

Differencing is used to transform a non-stationary series into a stationary one before modeling.

Describe the three main components of an ARIMA model and their roles in time series forecasting.

Think about how past values, differencing, and past errors contribute to predictions.

Explain why making a time series stationary is important before applying an ARIMA model and how this is achieved.

Consider what changes in mean or variance over time mean for prediction.

Practice

1. What does the d parameter in an ARIMA model represent?

easy

A. The number of times the data is differenced to make it stationary

B. The number of lag observations included in the model

C. The number of moving average terms

D. The total number of data points used for training

Solution

1. Step 1: Understand ARIMA parameters

   ARIMA has three parameters: p (lags), d (differencing), and q (moving average terms).

2. Step 2: Identify the role of d

   The d parameter controls how many times the data is differenced to remove trends and make it stationary.

3. Final Answer:

   The number of times the data is differenced to make it stationary -> Option A

4. Quick Check:

   d = differencing count [OK]

Hint: Remember: d = differencing steps to remove trend [OK]

Common Mistakes:

• Confusing d with p or q parameters
• Thinking d is the number of lag observations
• Assuming d relates to error terms

2. Which of the following is the correct way to import the ARIMA model from the statsmodels library in Python?

easy

A. import ARIMA from statsmodels.tsa

B. import ARIMA from statsmodels.arima

C. from statsmodels.arima_model import ARIMA

D. from statsmodels.tsa.arima.model import ARIMA

Solution

1. Step 1: Recall the correct import path

   The current and recommended import for ARIMA is from statsmodels.tsa.arima.model.

2. Step 2: Check each option

   from statsmodels.tsa.arima.model import ARIMA matches the correct import. Options B, C, and D use outdated or incorrect paths.

3. Final Answer:

   from statsmodels.tsa.arima.model import ARIMA -> Option D

4. Quick Check:

   Correct import path = from statsmodels.tsa.arima.model import ARIMA [OK]

Hint: Use statsmodels.tsa.arima.model for ARIMA import [OK]

Common Mistakes:

• Using deprecated import paths
• Incorrect module names
• Confusing ARIMA with other models

3. Given the following Python code, what will be the output of print(model_fit.aic)?

from statsmodels.tsa.arima.model import ARIMA
import numpy as np
np.random.seed(0)
data = np.random.randn(100)
model = ARIMA(data, order=(1,0,1))
model_fit = model.fit()
print(round(model_fit.aic, 2))

medium

A. Approximately 280.00

B. Approximately -280.00

C. Approximately 0.00

D. Raises an error because of missing differencing

Solution

1. Step 1: Understand the code and model

   The code fits an ARIMA(1,0,1) model on 100 random normal values. The model fit will compute the AIC (Akaike Information Criterion).

2. Step 2: Interpret the AIC output

   Since data is random noise, AIC will be a positive number around 280. Negative or zero values are unlikely here.

3. Final Answer:

   Approximately 280.00 -> Option A

4. Quick Check:

   AIC positive and around 280 for random data [OK]

Hint: AIC is positive and near 280 for random normal data [OK]

Common Mistakes:

• Expecting negative AIC values
• Thinking differencing is mandatory for ARIMA
• Confusing AIC with accuracy

4. Identify the error in the following ARIMA model fitting code:

from statsmodels.tsa.arima.model import ARIMA
data = [1, 2, 3, 4, 5]
model = ARIMA(data, order=(1,1))
model_fit = model.fit()

medium

A. Data must be a numpy array, not a list

B. ARIMA cannot be used with differencing (d > 0)

C. The order tuple must have three values (p, d, q)

D. The fit() method is not available for ARIMA

Solution

1. Step 1: Check the ARIMA order parameter

   The order parameter must be a tuple of three integers: (p, d, q). Here, only two values are given.

2. Step 2: Validate other parts

   Data as list is acceptable. Differencing is allowed. The fit() method exists.

3. Final Answer:

   The order tuple must have three values (p, d, q) -> Option C

4. Quick Check:

   Order needs 3 values (p,d,q) [OK]

Hint: ARIMA order always needs three numbers (p,d,q) [OK]

Common Mistakes:

• Using two values instead of three in order
• Thinking data type must be numpy array
• Believing fit() is unavailable

5. You have a time series with a strong upward trend and seasonal patterns. Which ARIMA order would be the best starting point to model this data?

hard

A. (1, 2, 1) to over-difference the data and reduce noise

B. (1, 1, 1) to handle trend with differencing and simple AR and MA terms

C. (2, 0, 2) to avoid differencing and capture seasonality directly

D. (0, 0, 0) since no differencing or lags are needed

Solution

1. Step 1: Understand the data characteristics

   The data has a strong upward trend and seasonality, so differencing is needed to remove trend.

2. Step 2: Choose ARIMA order

   Order (1,1,1) applies one differencing step (d=1) and includes AR and MA terms to model patterns. Over-differencing (d=2) risks losing information. (0,0,0) ignores trend and seasonality. (2,0,2) misses differencing for trend.

3. Final Answer:

   (1, 1, 1) to handle trend with differencing and simple AR and MA terms -> Option B

4. Quick Check:

   Use d=1 for trend, p and q for patterns [OK]

Hint: Use d=1 for trend, p and q for patterns [OK]

Common Mistakes:

• Skipping differencing for trending data
• Over-differencing causing data loss
• Ignoring seasonality in ARIMA order