Dictionary-based CSV handling in Python - Time & Space Complexity

Time Complexity: Dictionary-based CSV handling

O(n)

Understanding Time Complexity

When working with CSV files using dictionaries, it's important to know how the time to process data grows as the file gets bigger.

We want to understand how the program's speed changes when reading and handling rows in a CSV file.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import csv

def read_csv_to_dict(filename):
    with open(filename, mode='r', newline='') as file:
        reader = csv.DictReader(file)
        rows = []
        for row in reader:
            rows.append(row)
    return rows

This code reads a CSV file and stores each row as a dictionary in a list.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Looping through each row in the CSV file.
• How many times: Once for every row in the file (n times).

How Execution Grows With Input

As the number of rows in the CSV file increases, the time to read and store them grows in a straight line.

Input Size (n)	Approx. Operations
10	About 10 loops to read rows
100	About 100 loops to read rows
1000	About 1000 loops to read rows

Pattern observation: The work grows evenly with the number of rows; doubling rows doubles the work.

Final Time Complexity

Time Complexity: O(n)

This means the time to read the CSV grows directly with the number of rows in the file.

Common Mistake

[X] Wrong: "Reading a CSV with dictionaries is slower because dictionaries are complex."

[OK] Correct: The main time cost is reading each row once, not the dictionary creation, so the time grows linearly regardless.

Interview Connect

Understanding how reading data scales helps you write programs that handle files efficiently and shows you can think about performance clearly.

Self-Check

"What if we added a nested loop to compare each row with every other row? How would the time complexity change?"

Practice

1. What is the main advantage of using csv.DictReader over csv.reader when reading CSV files?

easy

A. It writes data back to the CSV file.

B. It reads the entire file into memory at once.

C. It automatically converts all values to integers.

D. It allows accessing data by column names instead of index positions.

Solution

1. Step 1: Understand csv.reader behavior

   csv.reader reads CSV rows as lists, so you access data by index positions.

2. Step 2: Understand csv.DictReader behavior

   csv.DictReader reads rows as dictionaries, letting you access data by column names, which is clearer and safer if column order changes.

3. Final Answer:

   It allows accessing data by column names instead of index positions. -> Option D

4. Quick Check:

   DictReader uses column names for access [OK]

Hint: DictReader uses column names, not positions, for easier access [OK]

Common Mistakes:

• Thinking DictReader reads entire file at once
• Assuming DictReader converts data types automatically
• Confusing reading with writing functions

2. Which of the following is the correct way to create a csv.DictWriter object to write a CSV with columns 'name' and 'age'?

easy

A. csv.DictWriter(file, fieldnames=['name', 'age'])

B. csv.DictWriter(file, columns=['name', 'age'])

C. csv.DictWriter(file, keys=['name', 'age'])

D. csv.DictWriter(file, headers=['name', 'age'])

Solution

1. Step 1: Recall the parameter name for columns in DictWriter

   The correct parameter to specify column names is fieldnames.

2. Step 2: Check the options

   Only csv.DictWriter(file, fieldnames=['name', 'age']) uses fieldnames correctly; others use incorrect parameter names.

3. Final Answer:

   csv.DictWriter(file, fieldnames=['name', 'age']) -> Option A

4. Quick Check:

   Use fieldnames to set columns [OK]

Hint: Use 'fieldnames' to specify columns in DictWriter [OK]

Common Mistakes:

• Using 'columns' or 'keys' instead of 'fieldnames'
• Forgetting to pass a file object first
• Confusing DictReader and DictWriter parameters

3. What will be the output of this code snippet?

import csv
from io import StringIO

csv_data = "name,age\nAlice,30\nBob,25"
file = StringIO(csv_data)
reader = csv.DictReader(file)
for row in reader:
    print(row['name'], row['age'])

medium

A. Alice 30
Bob 25

B. ['Alice', '30']
['Bob', '25']

C. {'name': 'Alice', 'age': '30'}
{'name': 'Bob', 'age': '25'}

D. 30 Alice
25 Bob

Solution

1. Step 1: Understand the CSV data and DictReader

   The CSV has two rows with columns 'name' and 'age'. DictReader reads each row as a dictionary.

2. Step 2: Analyze the print statement

   It prints the values of 'name' and 'age' keys separated by space for each row.

3. Final Answer:

   Alice 30 Bob 25 -> Option A

4. Quick Check:

   Prints name and age values separated by space [OK]

Hint: DictReader rows are dicts; print keys to get values [OK]

Common Mistakes:

• Printing the whole dictionary instead of values
• Mixing order of printed values
• Confusing list output with string output

4. Identify the error in this code that writes a CSV file using csv.DictWriter:

import csv
with open('output.csv', 'w') as f:
    writer = csv.DictWriter(f, fieldnames=['name', 'age'])
    writer.writerow({'name': 'Alice', 'age': 30})
    writer.writerow({'name': 'Bob', 'age': 25})

medium

A. Dictionaries passed to writerow must have string values only.

B. Fieldnames list should be a tuple, not a list.

C. Missing call to writer.writeheader() before writing rows.

D. The file should be opened in binary mode 'wb'.

Solution

1. Step 1: Check DictWriter usage

   DictWriter requires calling writeheader() to write the header row before writing data rows.

2. Step 2: Verify other parts

   Opening file in text mode 'w' is correct in Python 3, fieldnames can be a list, and values can be int or str.

3. Final Answer:

   Missing call to writer.writeheader() before writing rows. -> Option C

4. Quick Check:

   Always call writeheader() before writerow() [OK]

Hint: Call writeheader() before writing rows with DictWriter [OK]

Common Mistakes:

• Forgetting writeheader() call
• Opening file in binary mode unnecessarily
• Thinking fieldnames must be tuple
• Assuming all values must be strings

5. You have a CSV file with columns 'id', 'name', and 'score'. You want to read it using csv.DictReader and create a dictionary mapping each 'id' to the 'score' as an integer. Which code snippet correctly does this?

hard

A. with open('data.csv') as f:
reader = csv.DictReader(f)
result = {int(row['id']): row['score'] for row in reader}

B. with open('data.csv') as f:
reader = csv.DictReader(f)
result = {row['id']: int(row['score']) for row in reader}

C. with open('data.csv') as f:
reader = csv.reader(f)
result = {row['id']: int(row['score']) for row in reader}

D. with open('data.csv') as f:
reader = csv.DictReader(f)
result = {row['score']: int(row['id']) for row in reader}

Solution

1. Step 1: Use DictReader to access columns by name

   Only csv.DictReader allows accessing 'id' and 'score' by keys.

2. Step 2: Create dictionary with 'id' as key and integer 'score' as value

   with open('data.csv') as f: reader = csv.DictReader(f) result = {row['id']: int(row['score']) for row in reader} correctly converts 'score' to int and uses 'id' as key.

3. Final Answer:

   with open('data.csv') as f: reader = csv.DictReader(f) result = {row['id']: int(row['score']) for row in reader} -> Option B

4. Quick Check:

   DictReader + dict comprehension + int conversion [OK]

Hint: Use DictReader and dict comprehension with int() conversion [OK]

Common Mistakes:

• Using csv.reader instead of DictReader
• Swapping keys and values in dictionary
• Not converting score to int
• Converting id to int instead of score