Time series components (trend, seasonality) in ML Python - Model Pipeline Trace

Model Pipeline - Time series components (trend, seasonality)

This pipeline breaks down a time series into its main parts: trend and seasonality. It helps us understand how data changes over time and repeats in patterns.

Data Flow - 4 Stages

1Raw time series data

365 days x 1 column→Collect daily values (e.g., temperature or sales)→365 days x 1 column

Day 1: 20, Day 2: 22, Day 3: 21, ..., Day 365: 19

↓

2Detrend data

365 days x 1 column→Remove long-term trend using moving average→365 days x 1 column

Original: 20, 22, 21, ...; Detrended: -1, 0, -0.5, ...

↓

3Extract seasonality

365 days x 1 column (detrended)→Calculate repeating patterns (e.g., weekly or yearly)→365 days x 1 column

Seasonal pattern: +2 on weekends, -1 on weekdays

↓

4Residual calculation

365 days x 1 column→Subtract trend and seasonality from original data→365 days x 1 column

Residuals: small random noise values around 0

Training Trace - Epoch by Epoch

Loss
0.5 |****
0.4 |*** 
0.3 |**  
0.2 |*   
0.1 |    
    +----
     1 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.45	N/A	Initial decomposition with high error in residuals
2	0.30	N/A	Trend smoothing improved, residuals smaller
3	0.20	N/A	Seasonality captured better, residual noise reduced
4	0.15	N/A	Stable decomposition, residuals close to random noise
5	0.12	N/A	Final model captures trend and seasonality well

Prediction Trace - 4 Layers

Layer 1: Input raw value

Layer 2: Remove trend

Layer 3: Remove seasonality

Layer 4: Calculate residual

Model Quiz - 3 Questions

What does the trend component represent in a time series?

A The long-term increase or decrease in data

B Random noise in the data

C Daily repeating patterns

D Missing values in the data

Key Insight

Breaking a time series into trend and seasonality helps us understand and predict data better by separating long-term changes from repeating patterns.

Practice

1. Which component of a time series shows the long-term upward or downward movement over time?

easy

A. Trend

B. Seasonality

C. Noise

D. Residual

Solution

1. Step 1: Understand the meaning of trend

   The trend component represents the overall direction or pattern in the data over a long period, such as increasing sales over years.

2. Step 2: Differentiate from seasonality and noise

   Seasonality repeats in fixed cycles (like monthly), and noise is random variation. Trend is the smooth long-term movement.

3. Final Answer:

   Trend -> Option A

4. Quick Check:

   Long-term direction = Trend [OK]

Hint: Trend = overall direction over time, not repeating cycles [OK]

Common Mistakes:

• Confusing seasonality with trend
• Thinking noise is trend
• Mixing residual with trend

2. Which of the following is the correct Python code to plot seasonality in a time series using pandas?

easy

A. df['value'].plot()

B. df['value'].rolling(window=12).mean().plot()

C. df['value'].groupby(df.index.month).mean().plot()

D. df['value'].diff().plot()

Solution

1. Step 1: Identify how to extract seasonality

   Seasonality repeats in fixed intervals like months, so grouping by month and averaging shows seasonal pattern.

2. Step 2: Check code options

   df['value'].groupby(df.index.month).mean().plot() groups by month and plots mean, revealing seasonality. Others plot raw data, trend (rolling mean), or differences.

3. Final Answer:

   df['value'].groupby(df.index.month).mean().plot() -> Option C

4. Quick Check:

   Group by time period for seasonality plot [OK]

Hint: Group data by time unit (month) to see seasonality [OK]

Common Mistakes:

• Plotting raw data only
• Using rolling mean for seasonality
• Plotting differences instead of seasonal groups

3. Given this Python code snippet, what will be the output type of seasonal?

import pandas as pd
import numpy as np
index = pd.date_range('2023-01-01', periods=12, freq='M')
data = np.sin(np.linspace(0, 2 * np.pi, 12))
df = pd.Series(data, index=index)
seasonal = df.groupby(df.index.month).transform('mean')

medium

A. A numpy array of length 12

B. A pandas Series with same length as df

C. A pandas DataFrame with 12 rows and 1 column

D. A single float value representing mean

Solution

1. Step 1: Understand groupby with transform

   Using groupby with transform('mean') returns a Series aligned with original index, same length as df.

2. Step 2: Check output type

   Since df is a Series, seasonal is also a Series with same length, each value replaced by group mean.

3. Final Answer:

   A pandas Series with same length as df -> Option B

4. Quick Check:

   groupby + transform returns Series matching original length [OK]

Hint: groupby + transform keeps original length Series [OK]

Common Mistakes:

• Thinking transform returns single value
• Confusing transform with aggregate
• Expecting DataFrame instead of Series

4. You have this code to extract trend using rolling mean:

trend = df['value'].rolling(window=3).mean()

But the output has many NaN values at the start. How can you fix this?

medium

A. Use diff() instead of rolling mean

B. Change window to 1

C. Drop NaN values after rolling mean

D. Use min_periods=1 in rolling to reduce NaNs

Solution

1. Step 1: Understand rolling mean NaNs

   Rolling mean with window=3 needs 3 values to compute, so first 2 are NaN by default.

2. Step 2: Use min_periods to allow fewer values

   Setting min_periods=1 lets rolling mean compute with fewer points, reducing NaNs at start.

3. Final Answer:

   Use min_periods=1 in rolling to reduce NaNs -> Option D

4. Quick Check:

   min_periods controls minimum data points for rolling [OK]

Hint: Set min_periods=1 in rolling to avoid initial NaNs [OK]

Common Mistakes:

• Changing window to 1 loses smoothing
• Dropping NaNs loses early data
• Using diff() does not fix NaNs

5. You have monthly sales data with a strong yearly seasonality and an upward trend. Which method best separates trend and seasonality components?

hard

A. Use moving average with window=12 for trend, then subtract to get seasonality

B. Use differencing with lag=1 to remove seasonality

C. Apply Fourier transform to remove trend

D. Use rolling mean with window=3 to capture seasonality

Solution

1. Step 1: Understand yearly seasonality and trend

   Yearly seasonality repeats every 12 months; trend is slow upward movement.

2. Step 2: Choose method to separate components

   Moving average with window=12 smooths out seasonality, capturing trend. Subtracting trend leaves seasonality.

3. Step 3: Evaluate other options

   Differencing with lag=1 removes short-term changes, not yearly seasonality. Fourier transform is complex. Rolling mean with window=3 is too short for yearly seasonality.

4. Final Answer:

   Use moving average with window=12 for trend, then subtract to get seasonality -> Option A

5. Quick Check:

   Window matches season length to isolate trend [OK]

Hint: Match moving average window to season length to isolate trend [OK]

Common Mistakes:

• Using too short window for moving average
• Confusing differencing lag with season length
• Ignoring trend when extracting seasonality