Writing to CSV with to_csv in Pandas - Time & Space Complexity

Time Complexity: Writing to CSV with to_csv

O(n)

Understanding Time Complexity

When saving data with pandas' to_csv, it's important to know how the time to write grows as data gets bigger.

We want to understand how the writing time changes when the data size increases.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

df = pd.DataFrame({
    'A': range(1000),
    'B': range(1000, 2000)
})
df.to_csv('output.csv', index=False)

This code creates a DataFrame with 1000 rows and writes it to a CSV file without the index.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Writing each row of the DataFrame to the CSV file.
• How many times: Once for each row in the DataFrame (n times).

How Execution Grows With Input

As the number of rows grows, the time to write grows roughly in the same way.

Input Size (n)	Approx. Operations
10	10 writes
100	100 writes
1000	1000 writes

Pattern observation: The time grows directly with the number of rows; doubling rows doubles the work.

Final Time Complexity

Time Complexity: O(n)

This means the time to write grows linearly with the number of rows in the DataFrame.

Common Mistake

[X] Wrong: "Writing to CSV is instant no matter how big the data is."

[OK] Correct: Writing takes longer as data grows because each row must be processed and saved, so time grows with data size.

Interview Connect

Understanding how data writing scales helps you explain performance in real projects and shows you think about efficiency clearly.

Self-Check

"What if we added more columns instead of rows? How would the time complexity change?"