Expanding window operations in Pandas - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is an expanding window operation in pandas?

An expanding window operation calculates a statistic over all data points from the start up to the current point, growing the window size as it moves forward.

beginner

How do you create an expanding window object in pandas?

Use the expanding() method on a pandas Series or DataFrame, for example: df.expanding().

intermediate

What is the difference between rolling and expanding window operations?

Rolling windows use a fixed-size window that moves forward, while expanding windows start at the beginning and grow larger with each step.

beginner

How can you calculate the expanding mean of a pandas Series named data?

Use data.expanding().mean() to get the mean of all values from the start up to each point.

intermediate

What does the min_periods parameter do in expanding window operations?

It sets the minimum number of observations required to have a valid result; before that, the result will be NaN.

Which pandas method creates an expanding window object?

A expanding()

B rolling()

C groupby()

D resample()

The expanding() method creates an expanding window object in pandas.

What does an expanding window operation compute at each step?

A Statistic over random samples

B Statistic over a fixed-size window

C Statistic over the last two points only

D Statistic over all data from start to current point

Expanding window operations compute statistics over all data from the start up to the current point.

What will data.expanding(min_periods=3).mean() return for the first two points?

A Mean values of first two points

B NaN values

C Zeros

D Errors

With min_periods=3, the first two points do not have enough data, so the result is NaN.

Which of these is NOT a valid aggregation function for expanding windows?

A max()

B sum()

C plot()

D mean()

plot() is not an aggregation function; it's used for visualization.

If you want a window that always includes the last 5 points only, which method should you use?

A rolling(window=5)

B expanding()

C cumsum()

D groupby()

The rolling(window=5) method creates a fixed-size window of 5 points.

Explain how expanding window operations work and give an example of when you might use them.

Think about how you track totals or averages that include all past data.

Describe the difference between expanding and rolling window operations in pandas.

Compare how the window size changes as you move through data.

Practice

1. What does an expanding window operation in pandas do?

easy

A. Sorts data in ascending order

B. Calculates values only for a fixed-size sliding window

C. Filters data based on a condition

D. Calculates cumulative values including all previous data points

Solution

1. Step 1: Understand expanding window concept

   Expanding window operations include all data points from the start up to the current point.

2. Step 2: Compare with other window types

   Unlike rolling windows, expanding windows grow with each step, accumulating more data.

3. Final Answer:

   Calculates cumulative values including all previous data points -> Option D

4. Quick Check:

   Expanding window = cumulative calculation [OK]

Hint: Expanding means cumulative from start to current [OK]

Common Mistakes:

• Confusing expanding with rolling window
• Thinking it filters data
• Assuming it sorts data

2. Which of the following is the correct syntax to create an expanding window object on a pandas Series s?

easy

A. s.window()

B. s.expanding()

C. s.cumulative()

D. s.rolling()

Solution

1. Step 1: Recall pandas expanding syntax

   The method to create an expanding window object is expanding() called on a Series or DataFrame.

2. Step 2: Eliminate incorrect options

   rolling() is for rolling windows, cumulative() and window() do not exist as methods.

3. Final Answer:

   s.expanding() -> Option B

4. Quick Check:

   Use .expanding() for expanding windows [OK]

Hint: Use .expanding() method on Series/DataFrame [OK]

Common Mistakes:

• Using .rolling() instead of .expanding()
• Trying non-existent methods like .cumulative()
• Confusing window types

3. Given the pandas Series s = pd.Series([2, 4, 6, 8]), what is the output of s.expanding(min_periods=2).mean()?

medium

A. [NaN, 3.0, 4.0, 5.0]

B. [2.0, 3.0, 4.0, 5.0]

C. [NaN, 4.0, 6.0, 8.0]

D. [2.0, 4.0, 6.0, 8.0]

Solution

1. Step 1: Understand min_periods effect

   With min_periods=2, results start from the second element; first is NaN.

2. Step 2: Calculate expanding mean values

   Means are: index 1: (2+4)/2=3.0, index 2: (2+4+6)/3=4.0, index 3: (2+4+6+8)/4=5.0.

3. Final Answer:

   [NaN, 3.0, 4.0, 5.0] -> Option A

4. Quick Check:

   Expanding mean with min_periods=2 starts NaN then cumulative means [OK]

Hint: min_periods controls when output starts (NaN before) [OK]

Common Mistakes:

• Ignoring min_periods and showing first value
• Calculating rolling mean instead of expanding mean
• Miscomputing cumulative averages

4. What is wrong with this code snippet?

import pandas as pd
s = pd.Series([1, 2, 3])
result = s.expanding(min_periods=-1).sum()

medium

A. sum() cannot be used after expanding()

B. expanding() method does not exist for Series

C. min_periods cannot be negative; it must be >= 0

D. The Series must be converted to DataFrame first

Solution

1. Step 1: Check min_periods parameter rules

   min_periods must be >= 0; negative is invalid and causes an error.

2. Step 2: Verify method usage

   expanding() exists for Series, and sum() is valid after expanding().

3. Final Answer:

   min_periods cannot be negative; it must be >= 0 -> Option C

4. Quick Check:

   min_periods ≥ 0 required [OK]

Hint: min_periods must be >= 0, never negative [OK]

Common Mistakes:

• Setting min_periods to a negative value causing errors
• Thinking expanding() is unavailable for Series
• Misusing sum() after expanding()

5. You have daily sales data in a pandas DataFrame df with a column 'sales'. You want to calculate a running average of sales but only start showing results after at least 3 days of data. Which code correctly achieves this using expanding window operations?

hard

A. df['sales'].expanding(min_periods=3).mean()

B. df['sales'].rolling(window=3).mean()

C. df['sales'].expanding(min_periods=1).mean()

D. df['sales'].cumsum() / 3

Solution

1. Step 1: Understand requirement for running average with minimum data

   Expanding with min_periods=3 starts calculating mean only after 3 data points.

2. Step 2: Evaluate options

   df['sales'].expanding(min_periods=3).mean() uses expanding with min_periods=3 correctly. df['sales'].rolling(window=3).mean() uses rolling window, which is different. df['sales'].expanding(min_periods=1).mean() starts from 1 data point, not 3. df['sales'].cumsum() / 3 divides cumulative sum by 3 always, which is incorrect.

3. Final Answer:

   df['sales'].expanding(min_periods=3).mean() -> Option A

4. Quick Check:

   Expanding with min_periods=3 for running average [OK]

Hint: Use expanding(min_periods=3) for running average after 3 days [OK]

Common Mistakes:

• Using rolling instead of expanding
• Setting min_periods too low
• Dividing cumulative sum by fixed number