ARIMA model basics in ML Python - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding ARIMA Components

Which of the following correctly describes the 'I' component in an ARIMA model?

A It represents the number of times the data is differenced to make it stationary.

B It stands for the number of autoregressive terms in the model.

C It is the parameter controlling seasonal effects in the data.

D It indicates the number of moving average terms included.

💡 Hint

Think about what 'differencing' means in time series.

The 'I' in ARIMA stands for 'Integrated', which means the number of times the data is differenced to remove trends and make it stationary.

❓ Predict Output

intermediate

ARIMA Model Prediction Output

What will be the output of the following Python code snippet using statsmodels ARIMA to fit and predict a simple time series?

ML Python

import numpy as np
from statsmodels.tsa.arima.model import ARIMA

data = np.array([1, 2, 3, 4, 5, 6, 7, 8, 9, 10])
model = ARIMA(data, order=(1,1,0))
model_fit = model.fit()
pred = model_fit.predict(start=9, end=10)
print(pred.tolist())

A [nan, nan]

B [9.0, 10.0]

C [10.0, 11.0]

D [8.0, 9.0]

💡 Hint

Remember that differencing reduces the series length by 1, and prediction starts at index 9.

The ARIMA(1,1,0) model fits the differenced data with one autoregressive term. Predicting at indices 9 and 10 gives the next values continuing the trend, which are 10.0 and 11.0.

❓ Hyperparameter

advanced

Choosing ARIMA Parameters

You have a time series with a strong seasonal pattern repeating every 12 months. Which ARIMA model order is most appropriate to capture this seasonality?

A (1, 1, 1)

B (2, 0, 2)

C (0, 1, 1)

D (1, 1, 1)(1, 0, 0, 12)

💡 Hint

Seasonal ARIMA models include extra parameters for seasonality.

Option D includes seasonal parameters (1,0,0) with a seasonal period of 12, which is needed to model yearly seasonality.

❓ Metrics

advanced

Evaluating ARIMA Model Performance

Which metric is most appropriate to evaluate the accuracy of an ARIMA model's forecast on a continuous time series?

A Accuracy score

B Mean Absolute Error (MAE)

C F1 Score

D Confusion Matrix

💡 Hint

Consider metrics for continuous numeric predictions.

MAE measures the average absolute difference between predicted and actual values, suitable for continuous forecasts like ARIMA outputs.

🔧 Debug

expert

Diagnosing ARIMA Model Fit Issues

After fitting an ARIMA(2,1,2) model to your data, you notice the residuals show a clear pattern and are not white noise. What is the most likely cause?

A The data was not differenced enough to achieve stationarity.

B The moving average order should be zero for better fit.

C The residuals always show patterns in ARIMA models.

D The model order is too low to capture the data's complexity.

💡 Hint

Check if the data is stationary before fitting ARIMA.

If residuals show patterns, it often means the model did not fully remove trends or seasonality, indicating insufficient differencing.

Practice

1. What does the d parameter in an ARIMA model represent?

easy

A. The number of times the data is differenced to make it stationary

B. The number of lag observations included in the model

C. The number of moving average terms

D. The total number of data points used for training

Solution

1. Step 1: Understand ARIMA parameters

   ARIMA has three parameters: p (lags), d (differencing), and q (moving average terms).

2. Step 2: Identify the role of d

   The d parameter controls how many times the data is differenced to remove trends and make it stationary.

3. Final Answer:

   The number of times the data is differenced to make it stationary -> Option A

4. Quick Check:

   d = differencing count [OK]

Hint: Remember: d = differencing steps to remove trend [OK]

Common Mistakes:

• Confusing d with p or q parameters
• Thinking d is the number of lag observations
• Assuming d relates to error terms

2. Which of the following is the correct way to import the ARIMA model from the statsmodels library in Python?

easy

A. import ARIMA from statsmodels.tsa

B. import ARIMA from statsmodels.arima

C. from statsmodels.arima_model import ARIMA

D. from statsmodels.tsa.arima.model import ARIMA

Solution

1. Step 1: Recall the correct import path

   The current and recommended import for ARIMA is from statsmodels.tsa.arima.model.

2. Step 2: Check each option

   from statsmodels.tsa.arima.model import ARIMA matches the correct import. Options B, C, and D use outdated or incorrect paths.

3. Final Answer:

   from statsmodels.tsa.arima.model import ARIMA -> Option D

4. Quick Check:

   Correct import path = from statsmodels.tsa.arima.model import ARIMA [OK]

Hint: Use statsmodels.tsa.arima.model for ARIMA import [OK]

Common Mistakes:

• Using deprecated import paths
• Incorrect module names
• Confusing ARIMA with other models

3. Given the following Python code, what will be the output of print(model_fit.aic)?

from statsmodels.tsa.arima.model import ARIMA
import numpy as np
np.random.seed(0)
data = np.random.randn(100)
model = ARIMA(data, order=(1,0,1))
model_fit = model.fit()
print(round(model_fit.aic, 2))

medium

A. Approximately 280.00

B. Approximately -280.00

C. Approximately 0.00

D. Raises an error because of missing differencing

Solution

1. Step 1: Understand the code and model

   The code fits an ARIMA(1,0,1) model on 100 random normal values. The model fit will compute the AIC (Akaike Information Criterion).

2. Step 2: Interpret the AIC output

   Since data is random noise, AIC will be a positive number around 280. Negative or zero values are unlikely here.

3. Final Answer:

   Approximately 280.00 -> Option A

4. Quick Check:

   AIC positive and around 280 for random data [OK]

Hint: AIC is positive and near 280 for random normal data [OK]

Common Mistakes:

• Expecting negative AIC values
• Thinking differencing is mandatory for ARIMA
• Confusing AIC with accuracy

4. Identify the error in the following ARIMA model fitting code:

from statsmodels.tsa.arima.model import ARIMA
data = [1, 2, 3, 4, 5]
model = ARIMA(data, order=(1,1))
model_fit = model.fit()

medium

A. Data must be a numpy array, not a list

B. ARIMA cannot be used with differencing (d > 0)

C. The order tuple must have three values (p, d, q)

D. The fit() method is not available for ARIMA

Solution

1. Step 1: Check the ARIMA order parameter

   The order parameter must be a tuple of three integers: (p, d, q). Here, only two values are given.

2. Step 2: Validate other parts

   Data as list is acceptable. Differencing is allowed. The fit() method exists.

3. Final Answer:

   The order tuple must have three values (p, d, q) -> Option C

4. Quick Check:

   Order needs 3 values (p,d,q) [OK]

Hint: ARIMA order always needs three numbers (p,d,q) [OK]

Common Mistakes:

• Using two values instead of three in order
• Thinking data type must be numpy array
• Believing fit() is unavailable

5. You have a time series with a strong upward trend and seasonal patterns. Which ARIMA order would be the best starting point to model this data?

hard

A. (1, 2, 1) to over-difference the data and reduce noise

B. (1, 1, 1) to handle trend with differencing and simple AR and MA terms

C. (2, 0, 2) to avoid differencing and capture seasonality directly

D. (0, 0, 0) since no differencing or lags are needed

Solution

1. Step 1: Understand the data characteristics

   The data has a strong upward trend and seasonality, so differencing is needed to remove trend.

2. Step 2: Choose ARIMA order

   Order (1,1,1) applies one differencing step (d=1) and includes AR and MA terms to model patterns. Over-differencing (d=2) risks losing information. (0,0,0) ignores trend and seasonality. (2,0,2) misses differencing for trend.

3. Final Answer:

   (1, 1, 1) to handle trend with differencing and simple AR and MA terms -> Option B

4. Quick Check:

   Use d=1 for trend, p and q for patterns [OK]

Hint: Use d=1 for trend, p and q for patterns [OK]

Common Mistakes:

• Skipping differencing for trending data
• Over-differencing causing data loss
• Ignoring seasonality in ARIMA order