Reading files line by line in Python - Step-by-Step Execution

Concept Flow - Reading files line by line

Open file

↓

Read one line

↓

Is line empty?

Yes→Close file & Exit

No↓

Process line

↓

Read next line

↩Back to 'Is line empty?'

The program opens a file, reads it line by line, processes each line, and stops when no more lines are left.

Execution Sample

Python

with open('example.txt', 'r') as file:
    for line in file:
        print(line.strip())

This code opens a file and prints each line without extra spaces or newlines.

Execution Table

Step	Action	Line Read	Line Stripped	Output
1	Open file 'example.txt'
2	Read first line	Hello world	Hello world	Hello world
3	Read second line	This is a test	This is a test	This is a test
4	Read third line	Goodbye!	Goodbye!	Goodbye!
5	Read next line
6	No more lines, close file

💡 Reached end of file, no more lines to read

Variable Tracker

Variable	Start	After 1	After 2	After 3	After 4	Final
line	None	Hello world	This is a test	Goodbye!

Key Moments - 3 Insights

Why do we use line.strip() before printing?

Because each line read from the file ends with a newline character '\n'. Using strip() removes it so the output looks clean, as shown in execution_table rows 2-4.

What happens when the file has no more lines?

The loop stops automatically when there are no more lines to read, as seen in execution_table step 5 and 6 where reading returns empty and the file closes.

Why do we use 'with open' instead of just open()?

'with open' ensures the file is properly closed after reading, even if errors happen. This is safer and cleaner, as shown in execution_table step 6.

Visual Quiz - 3 Questions

Look at the execution_table, what is the value of 'line' after step 3?

A "Goodbye!\n"

B "Hello world\n"

C "This is a test\n"

D Empty string

💡 Hint

Check the 'Line Read' column at step 3 in the execution_table.

At which step does the program detect there are no more lines to read?

A Step 5

B Step 6

C Step 4

D Step 2

💡 Hint

Look for the step where 'Line Read' is empty in the execution_table.

If we remove .strip() from the print statement, what changes in the output?

A Output will be the same

B Output lines will have extra blank lines between them

C Output lines will be joined together

D Program will crash

💡 Hint

Refer to the 'Line Stripped' and 'Output' columns in the execution_table to understand the effect of strip().

Concept Snapshot

Reading files line by line in Python:
Use 'with open(filename) as file:' to open safely.
Loop with 'for line in file:' to read each line.
Use line.strip() to remove newline characters.
Loop ends automatically at file end.
File closes automatically after block.

Full Transcript

This visual trace shows how Python reads a file line by line. First, the file is opened safely using 'with open'. Then, each line is read in a loop. Each line includes a newline character at the end, so we use strip() to remove it before printing. The loop stops when no more lines are left, and the file closes automatically. Variables like 'line' change each iteration to hold the current line's text. This method is simple and safe for reading text files line by line.

Practice

1. What does the following code do?

with open('data.txt') as file:
    for line in file:
        print(line)

easy

A. Creates a new file named 'data.txt'

B. Reads the whole file at once and prints it

C. Writes lines to 'data.txt'

D. Reads and prints each line from 'data.txt' including newline characters

Solution

1. Step 1: Understand the with open statement

   The code opens 'data.txt' for reading and ensures it closes automatically after use.

2. Step 2: Analyze the for loop over the file object

   Looping over the file reads it line by line, printing each line including its newline character.

3. Final Answer:

   Reads and prints each line from 'data.txt' including newline characters -> Option D

4. Quick Check:

   Reading lines one by one = Reads and prints each line from 'data.txt' including newline characters [OK]

Hint: Looping file reads lines one by one including newlines [OK]

Common Mistakes:

• Thinking it reads whole file at once
• Confusing reading with writing
• Assuming it creates a file

2. Which of these is the correct syntax to read a file line by line in Python?

easy

A. with open('file.txt') as f:
for line in f:
print(line)

B. open('file.txt') for line in f:
print(line)

C. with open('file.txt') as f:
while line in f:
print(line)

D. with open('file.txt') as f:
for line in file:
print(line)

Solution

1. Step 1: Check the correct use of with open

   with open('file.txt') as f: for line in f: print(line) correctly uses 'with open(filename) as f:' to open the file safely.

2. Step 2: Verify the for loop syntax

   with open('file.txt') as f: for line in f: print(line) uses 'for line in f:' which is the proper way to iterate lines in the file object.

3. Final Answer:

   with open('file.txt') as f:\n for line in f:\n print(line) -> Option A

4. Quick Check:

   Correct with open and for loop syntax = with open('file.txt') as f: for line in f: print(line) [OK]

Hint: Use 'with open' and 'for line in file' to read lines [OK]

Common Mistakes:

• Missing 'with' keyword
• Using wrong loop syntax like 'while line in f'
• Using undefined variable 'file' instead of 'f'

3. What will be the output of this code if 'test.txt' contains:\nLine1\nLine2\n\nLine4\n?

with open('test.txt') as f:
    for line in f:
        print(line.strip())

medium

A. Line1\nLine2\n\nLine4

B. Line1\nLine2\n\n\nLine4

C. Line1\nLine2\nLine4

D. Line1\nLine2\nLine4\n

Solution

1. Step 1: Understand strip() effect on lines

   strip() removes whitespace including newlines, so empty lines become empty strings.

2. Step 2: Analyze printing each stripped line

   Empty lines print as blank lines, but print() adds a newline, so empty lines show as blank lines.

3. Final Answer:

   Line1\nLine2\n\nLine4 -> Option A

4. Quick Check:

   strip() on empty -> '', print('') = blank line = Line1\nLine2\n\nLine4 [OK]

Hint: strip() removes newlines, print adds one newline per line [OK]

Common Mistakes:

• Assuming strip() keeps newlines
• Confusing blank lines with extra newlines
• Ignoring print() adds newline automatically

4. Find the error in this code snippet:

with open('file.txt') as f:
    for line in file:
        print(line)

medium

A. Indentation error inside the loop

B. Missing colon after for loop

C. Variable 'file' is undefined; should use 'f' instead

D. File not opened in write mode

Solution

1. Step 1: Check variable names used in the loop

   The file is opened as 'f', but the loop uses 'file' which is undefined.

2. Step 2: Confirm correct variable usage

   Changing 'file' to 'f' fixes the error and allows reading lines properly.

3. Final Answer:

   Variable 'file' is undefined; should use 'f' instead -> Option C

4. Quick Check:

   Use same variable name as in with open = Variable 'file' is undefined; should use 'f' instead [OK]

Hint: Use same variable name from with open in for loop [OK]

Common Mistakes:

• Using different variable names
• Assuming file is a keyword
• Ignoring variable scope inside with block

5. You want to read a large log file line by line and count how many lines contain the word 'error'. Which code snippet correctly does this?

hard

A. count = 0
with open('log.txt') as f:
lines = f.readlines()
for line in lines:
if 'error' in line:
count += 1
print(count)

B. count = 0
with open('log.txt') as f:
for line in f:
if 'error' in line:
count += 1
print(count)

C. count = 0
f = open('log.txt')
lines = f.readlines()
for line in lines:
if 'error' in line:
count += 1
f.close()
print(count)

D. count = 0
with open('log.txt') as f:
for line in f:
if line == 'error':
count += 1
print(count)

Solution

1. Step 1: Choose efficient line-by-line reading

   count = 0 with open('log.txt') as f: for line in f: if 'error' in line: count += 1 print(count) uses 'with open' and iterates file line by line, which is memory efficient for large files.

2. Step 2: Check condition for counting 'error' in line

   count = 0 with open('log.txt') as f: for line in f: if 'error' in line: count += 1 print(count) correctly checks if 'error' is anywhere in the line and increments count.

3. Final Answer:

   count = 0\nwith open('log.txt') as f:\n for line in f:\n if 'error' in line:\n count += 1\nprint(count) -> Option B

4. Quick Check:

   Efficient reading + correct condition = count = 0 with open('log.txt') as f: for line in f: if 'error' in line: count += 1 print(count) [OK]

Hint: Use with open and for line in file for big files [OK]

Common Mistakes:

• Using readlines() for big files (memory issue)
• Forgetting to close file without with
• Checking line equality instead of substring