Reading file data in Python - Time & Space Complexity

Time Complexity: Reading file data

O(n)

Understanding Time Complexity

When reading data from a file, it is important to understand how the time taken grows as the file size increases.

We want to know how the program's running time changes when the file has more lines or characters.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

with open('data.txt', 'r') as file:
    lines = file.readlines()
    for line in lines:
        print(line.strip())

This code reads all lines from a file and prints each line after removing extra spaces.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Looping through each line in the file.
• How many times: Once for every line in the file.

How Execution Grows With Input

As the number of lines in the file grows, the time to read and print each line grows in a similar way.

Input Size (n)	Approx. Operations
10	About 10 lines read and printed
100	About 100 lines read and printed
1000	About 1000 lines read and printed

Pattern observation: The time grows roughly in direct proportion to the number of lines.

Final Time Complexity

Time Complexity: O(n)

This means the time taken grows linearly with the number of lines in the file.

Common Mistake

[X] Wrong: "Reading a file always takes the same time no matter how big it is."

[OK] Correct: The more lines or characters in the file, the longer it takes to read and process each one.

Interview Connect

Understanding how file reading time grows helps you write efficient programs and explain your reasoning clearly in interviews.

Self-Check

"What if we read the file line by line inside the loop instead of reading all lines at once? How would the time complexity change?"

Practice

1. What does the open('file.txt', 'r') command do in Python?

easy

A. It creates a new file named 'file.txt'.

B. It deletes the file 'file.txt'.

C. It opens the file 'file.txt' for reading.

D. It writes data to 'file.txt'.

Solution

1. Step 1: Understand the open() function

   The open() function is used to open a file in a specified mode.

2. Step 2: Recognize mode 'r'

   Mode 'r' means open the file for reading only, no writing or creating.

3. Final Answer:

   It opens the file 'file.txt' for reading. -> Option C

4. Quick Check:

   open() with 'r' = open for reading [OK]

Hint: Mode 'r' always means read file only [OK]

Common Mistakes:

• Confusing 'r' with write mode 'w'
• Thinking it creates a new file
• Assuming it deletes the file

2. Which of the following is the correct syntax to read all content from a file using with?

easy

A. open('data.txt', 'r') as file:
content = file.read()

B. with open('data.txt', 'w') as file:
content = file.read()

C. with open('data.txt', 'r'):
content = file.read()

D. with open('data.txt', 'r') as file:
content = file.read()

Solution

1. Step 1: Check the use of 'with' statement

   The 'with' statement must be followed by open(filename, mode) as variable to assign the file object.

2. Step 2: Verify reading mode and method

   Mode 'r' is for reading, and file.read() reads all content.

3. Final Answer:

   with open('data.txt', 'r') as file: content = file.read() -> Option D

4. Quick Check:

   with + open + 'r' + read() = correct syntax [OK]

Hint: Use 'with open(filename, 'r') as f:' to read files safely [OK]

Common Mistakes:

• Using 'w' mode when reading is needed
• Missing 'as file' after open()
• Not indenting inside 'with' block

3. What will be the output of this code if 'example.txt' contains three lines: 'apple', 'banana', 'cherry'?

with open('example.txt', 'r') as f:
    lines = f.readlines()
print(lines)

medium

A. ['apple\n', 'banana\n', 'cherry\n']

B. ['apple\n', 'banana\n', 'cherry']

C. apple banana cherry

D. ['apple', 'banana', 'cherry']

Solution

1. Step 1: Understand readlines() behavior

   readlines() reads all lines into a list, each line ending with a newline character '\n' except possibly the last.

2. Step 2: Check the file content and output

   Since the file has three lines, the list will contain each line as a string with '\n' at the end except maybe the last line. Usually, text files end lines with '\n', so all lines have '\n'.

3. Final Answer:

   ['apple\n', 'banana\n', 'cherry\n'] -> Option A

4. Quick Check:

   readlines() returns list of lines with '\n' [OK]

Hint: readlines() keeps newline characters '\n' at line ends [OK]

Common Mistakes:

• Assuming readlines() strips '\n'
• Confusing read() output with readlines()
• Expecting a single string instead of list

4. Identify the error in this code snippet that tries to read a file line by line:

file = open('notes.txt', 'r')
for line in file.read():
    print(line)
file.close()

medium

A. Using 'r' mode instead of 'w' mode

B. Using file.read() instead of file.readlines() or iterating directly on file

C. Not closing the file after reading

D. Missing 'with' statement to open the file

Solution

1. Step 1: Analyze the for loop iteration

   The code uses file.read() which returns a single string of the whole file content.

2. Step 2: Understand iteration over string vs lines

   Iterating over a string loops over each character, not each line. To read line by line, use file.readlines() or iterate directly on file.

3. Final Answer:

   Using file.read() instead of file.readlines() or iterating directly on file -> Option B

4. Quick Check:

   read() returns string, not list of lines [OK]

Hint: Iterate file object or use readlines() to get lines [OK]

Common Mistakes:

• Iterating over string instead of lines
• Forgetting to close the file
• Confusing read() and readline()

5. You want to read a file and create a list of all non-empty lines without newline characters. Which code correctly does this?

hard

A. with open('log.txt', 'r') as f:
lines = [line.strip() for line in f if line.strip()]

B. with open('log.txt', 'r') as f:
lines = [line for line in f.readlines() if line != '\n']

C. with open('log.txt', 'r') as f:
lines = f.read().split('\n')

D. with open('log.txt', 'r') as f:
lines = [line.rstrip('\n') for line in f.readlines()]

Solution

1. Step 1: Remove whitespace and filter empty lines

   Using line.strip() removes spaces and newline characters from both ends. The condition if line.strip() filters out empty lines.

2. Step 2: Use list comprehension on file object

   Iterating directly on the file object reads line by line efficiently. This creates a list of cleaned, non-empty lines.

3. Final Answer:

   with open('log.txt', 'r') as f: lines = [line.strip() for line in f if line.strip()] -> Option A

4. Quick Check:

   strip() + filter empty lines = clean list [OK]

Hint: Use strip() and filter with if line.strip() in comprehension [OK]

Common Mistakes:

• Not stripping newline characters
• Including empty lines in the list
• Using read() then splitting without filtering empty lines