Time series analysis patterns in Pandas - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a time series in data science?

A time series is a sequence of data points collected or recorded at regular time intervals, like daily temperatures or stock prices over time.

beginner

What does 'trend' mean in time series analysis?

A trend is a long-term increase or decrease in the data values over time, showing a general direction like rising sales over years.

beginner

Explain 'seasonality' in time series data.

Seasonality means repeating patterns or cycles in data at fixed intervals, like higher ice cream sales every summer.

beginner

What is 'noise' in a time series?

Noise is the random variation or fluctuations in data that do not follow a pattern, like small daily changes in temperature.

beginner

How can pandas help analyze time series patterns?

Pandas provides tools to handle dates, resample data, calculate rolling averages, and plot trends and seasonality easily.

Which pattern in time series shows a repeated cycle over fixed intervals?

A Trend

B Seasonality

C Noise

D Outlier

Seasonality is the repeated cycle or pattern at fixed intervals in time series data.

What does a 'trend' in time series data represent?

A Random fluctuations

B Missing data

C Short-term cycles

D Long-term increase or decrease

A trend shows the long-term direction of data, either increasing or decreasing.

In pandas, which function helps to calculate the moving average to smooth time series data?

A rolling().mean()

B shift()

C groupby()

D resample()

rolling().mean() calculates the moving average, which smooths out short-term fluctuations.

What is 'noise' in a time series?

A Random variation

B A clear pattern

C Seasonal cycle

D Trend

Noise is the random variation or irregular fluctuations in the data.

Which pandas method is used to change the frequency of time series data, like converting daily data to monthly?

A merge()

B pivot()

C resample()

D concat()

resample() changes the frequency of time series data, such as daily to monthly.

Describe the main patterns you can find in time series data and why they matter.

Think about how data changes over time and what those changes tell us.

Explain how pandas can be used to identify and analyze time series patterns.

Consider pandas functions that help with dates and smoothing data.

Practice

1. What is the main purpose of using a rolling average in time series analysis with pandas?

easy

A. To convert time series data into categorical data

B. To remove all missing values from the data

C. To smooth out short-term fluctuations and highlight longer-term trends

D. To sort the data by date in ascending order

Solution

1. Step 1: Understand rolling average concept

   A rolling average calculates the mean of data points in a moving window, smoothing short-term noise.

2. Step 2: Identify its effect on time series data

   This smoothing helps reveal longer-term trends by reducing random fluctuations.

3. Final Answer:

   To smooth out short-term fluctuations and highlight longer-term trends -> Option C

4. Quick Check:

   Rolling average = smoothing trends [OK]

Hint: Rolling average smooths data to show trends clearly [OK]

Common Mistakes:

• Thinking rolling average removes missing values
• Confusing rolling average with sorting
• Assuming it changes data type

2. Which of the following is the correct pandas syntax to calculate a 7-day rolling mean on a DataFrame column df['sales']?

easy

A. df['sales'].rolling(window=7).mean()

B. df['sales'].rolling(7).sum()

C. df.rolling(window=7)['sales'].sum()

D. df['sales'].rolling(window=7).median()

Solution

1. Step 1: Recall rolling syntax in pandas

   The rolling method is called on the Series with window=7 to specify 7 days.

2. Step 2: Apply mean function to get rolling average

   Using .mean() after rolling computes the rolling mean correctly.

3. Final Answer:

   df['sales'].rolling(window=7).mean() -> Option A

4. Quick Check:

   rolling(window=7).mean() = correct syntax [OK]

Hint: Use rolling(window=7).mean() for 7-day rolling average [OK]

Common Mistakes:

• Using rolling(7) without window= keyword
• Using sum() instead of mean() for average
• Applying rolling on DataFrame instead of Series

3. Given the following code, what will be the output of print(diff_series)?

import pandas as pd
s = pd.Series([10, 15, 20, 18, 25])
diff_series = s.diff()

medium

A. [NaN, 5.0, 5.0, -2.0, 7.0]

B. [10, 15, 20, 18, 25]

C. [NaN, 10, 15, 20, 18]

D. [5, 5, -2, 7, NaN]

Solution

1. Step 1: Understand what diff() does on a Series

   The diff() method calculates the difference between each element and its previous element.

2. Step 2: Calculate differences step-by-step

   Differences: NaN (no previous), 15-10=5, 20-15=5, 18-20=-2, 25-18=7.

3. Final Answer:

   [NaN, 5.0, 5.0, -2.0, 7.0] -> Option A

4. Quick Check:

   diff() = current - previous [OK]

Hint: diff() shows change from previous value [OK]

Common Mistakes:

• Forgetting first value is NaN
• Confusing diff() with cumulative sum
• Misordering differences

4. The following code throws an error. What is the cause?

import pandas as pd
dates = pd.date_range('2023-01-01', periods=5)
df = pd.DataFrame({'value': [1, 2, 3, 4, 5]}, index=dates)
rolling_sum = df.rolling(3).sum()
print(rolling_sum['value'])

medium

A. The rolling window size must be specified with window=3

B. There is no error; the code runs correctly

C. The rolling method cannot be used on DataFrames

D. The DataFrame index must be reset before rolling

Solution

1. Step 1: Check rolling syntax on DataFrame

   Using df.rolling(3).sum() is valid; window size can be passed as positional argument.

2. Step 2: Verify if code runs without error

   Rolling sum on DataFrame with datetime index works fine; no reset needed.

3. Final Answer:

   There is no error; the code runs correctly -> Option B

4. Quick Check:

   rolling(3) on DataFrame = valid [OK]

Hint: rolling() accepts window as positional argument [OK]

Common Mistakes:

• Assuming window= is mandatory
• Thinking index must be reset
• Believing rolling only works on Series

5. You have daily sales data in a DataFrame df with a datetime index. You want to detect if sales on a day are unusually high compared to the previous week. Which pandas method combination is best to identify these spikes?

hard

A. Sort the DataFrame by sales and pick top 7 days

B. Use diff() to find daily changes and select days with positive differences

C. Apply autocorrelation to find repeated patterns

D. Calculate 7-day rolling mean and then find days where sales exceed mean by a threshold

Solution

1. Step 1: Understand the goal to find spikes compared to previous week

   We want to compare each day's sales to the average of the last 7 days.

2. Step 2: Use rolling mean to get weekly average and compare

   Calculating 7-day rolling mean smooths data; days exceeding this mean by threshold indicate spikes.

3. Final Answer:

   Calculate 7-day rolling mean and then find days where sales exceed mean by a threshold -> Option D

4. Quick Check:

   Rolling mean + threshold = spike detection [OK]

Hint: Compare daily sales to 7-day rolling mean for spikes [OK]

Common Mistakes:

• Using diff() only finds changes, not spikes
• Sorting ignores time context
• Autocorrelation finds patterns, not spikes