describe() for statistical summary in Pandas - Time & Space Complexity

Time Complexity: describe() for statistical summary

O(n)

Understanding Time Complexity

We want to understand how the time needed to get a statistical summary with describe() changes as the data grows.

How does the work increase when we have more rows or columns?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

n = 10  # example value for n
data = pd.DataFrame({
    'A': range(n),
    'B': range(n, 0, -1)
})
summary = data.describe()

This code creates a DataFrame with n rows and 2 columns, then calls describe() to get summary statistics.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Scanning each column's values to calculate statistics like mean, min, max, and quartiles.
• How many times: For each of the 2 columns, it processes all n rows once.

How Execution Grows With Input

As the number of rows n grows, the work to calculate statistics grows roughly in direct proportion.

Input Size (n)	Approx. Operations
10	About 20 (2 columns x 10 rows)
100	About 200 (2 x 100)
1000	About 2000 (2 x 1000)

Pattern observation: The operations increase linearly as the number of rows increases.

Final Time Complexity

Time Complexity: O(n)

This means the time to get the summary grows in a straight line with the number of rows.

Common Mistake

[X] Wrong: "The time to run describe() grows with the square of the number of rows because it calculates many statistics."

[OK] Correct: Actually, each statistic is calculated by scanning the data once per column, so the time grows linearly, not squared.

Interview Connect

Understanding how summary functions scale helps you explain data processing speed clearly and shows you can think about efficiency in real tasks.

Self-Check

"What if the DataFrame had 100 columns instead of 2? How would the time complexity change?"