Reading files line by line (while read) in Bash Scripting - Time & Space Complexity

Time Complexity: Reading files line by line (while read)

O(n)

Understanding Time Complexity

When reading a file line by line in a bash script, it's important to know how the time to finish grows as the file gets bigger.

We want to understand how the script's running time changes when the file has more lines.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

while IFS= read -r line; do
  echo "$line"
done < input.txt

This script reads each line from a file named input.txt and prints it to the screen.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Reading and printing each line inside the while read loop.
• How many times: Once for every line in the file.

How Execution Grows With Input

As the number of lines in the file grows, the script does more reading and printing steps, one per line.

Input Size (n)	Approx. Operations
10	About 10 reads and prints
100	About 100 reads and prints
1000	About 1000 reads and prints

Pattern observation: The work grows directly with the number of lines. Double the lines, double the work.

Final Time Complexity

Time Complexity: O(n)

This means the script takes time proportional to the number of lines in the file.

Common Mistake

[X] Wrong: "Reading a file line by line is always constant time because it just reads one line at a time."

[OK] Correct: Even though it reads one line at a time, the total time depends on how many lines there are. More lines mean more reads, so time grows with file size.

Interview Connect

Understanding how loops over file lines scale helps you explain script efficiency clearly and confidently in real-world tasks and interviews.

Self-Check

"What if we changed the script to read the whole file at once into a variable before processing? How would the time complexity change?"

Practice

1. What does the command while IFS= read -r line; do echo "$line"; done < file.txt do in a bash script?

easy

A. Deletes the contents of file.txt.

B. Reads the entire file at once and prints it.

C. Writes each line of file.txt to a new file.

D. Reads the file file.txt line by line and prints each line.

Solution

1. Step 1: Understand the while read loop

   The loop reads input line by line from the redirected file file.txt.

2. Step 2: Check the action inside the loop

   Each line read is stored in variable line and printed with echo.

3. Final Answer:

   Reads the file file.txt line by line and prints each line. -> Option D

4. Quick Check:

   Line-by-line reading = A [OK]

Hint: Remember: while read loops read files line by line [OK]

Common Mistakes:

• Thinking it reads the whole file at once
• Confusing input redirection with output
• Ignoring the role of IFS= and -r

2. Which of the following is the correct syntax to read a file line by line in bash?

easy

A. while read line; do echo $line; done < file.txt

B. while read -r line; do echo $line; done > file.txt

C. while read line; do echo $line; done >> file.txt

D. while read line; do echo $line; done | file.txt

Solution

1. Step 1: Identify input redirection for reading

   The correct way to read from a file is using input redirection: < file.txt.

2. Step 2: Check the loop syntax

   while read line; do ... done is the standard loop to read lines.

3. Final Answer:

   while read line; do echo $line; done < file.txt -> Option A

4. Quick Check:

   Input redirection with < = C [OK]

Hint: Use < file.txt to feed file lines into the loop [OK]

Common Mistakes:

• Using output redirection (>) instead of input (<)
• Piping file name instead of redirecting input
• Missing the -r option to prevent backslash escapes

3. What will be the output of this script if file.txt contains:

apple
banana
cherry

Script:

while IFS= read -r line; do echo "Fruit: $line"; done < file.txt

medium

A. Fruit: apple
Fruit: banana
Fruit: cherry

B. apple
banana
cherry

C. Fruit: apple banana cherry

D. Syntax error

Solution

1. Step 1: Understand the loop reading each line

   The loop reads each line from file.txt separately.

2. Step 2: Check the echo command

   Each line is printed prefixed with "Fruit: ".

3. Final Answer:

   Fruit: apple Fruit: banana Fruit: cherry -> Option A

4. Quick Check:

   Line prefixing with echo = B [OK]

Hint: Each loop iteration prints one line with prefix [OK]

Common Mistakes:

• Expecting all lines printed on one line
• Ignoring the prefix in echo
• Confusing input and output redirection

4. Identify the error in this script snippet:

while read line; do echo $line; done file.txt

medium

A. Echo command syntax is wrong

B. Incorrect variable name used

C. Missing input redirection operator < before file.txt

D. Missing semicolon after read

Solution

1. Step 1: Check how the file is provided to the loop

   The file must be redirected as input using < file.txt, not as an argument.

2. Step 2: Confirm syntax correctness

   The rest of the syntax is correct; variable and echo usage are fine.

3. Final Answer:

   Missing input redirection operator < before file.txt -> Option C

4. Quick Check:

   Input redirection needed = D [OK]

Hint: Use < file.txt to feed file lines, not argument [OK]

Common Mistakes:

• Passing filename as argument instead of redirecting input
• Forgetting semicolon after read (optional here)
• Misusing echo syntax

5. You want to read a file line by line and skip empty lines. Which script snippet correctly does this?

hard

A. while read line; do echo "$line"; done < file.txt | grep '^$'

B. while IFS= read -r line; do if [[ -n $line ]]; then echo "$line"; fi; done < file.txt

C. cat file.txt | while read line; do echo "$line"; done

D. while IFS= read -r line; do echo "$line"; done < file.txt

Solution

1. Step 1: Understand skipping empty lines

   We need to check if the line is not empty using [[ -n $line ]].

2. Step 2: Confirm reading and condition

   while IFS= read -r line; do if [[ -n $line ]]; then echo "$line"; fi; done < file.txt reads lines safely and prints only non-empty lines inside the loop.

3. Final Answer:

   while IFS= read -r line; do if [[ -n $line ]]; then echo "$line"; fi; done < file.txt -> Option B

4. Quick Check:

   Condition inside loop filters empty lines = A [OK]

Hint: Use if [[ -n $line ]] inside loop to skip empty lines [OK]

Common Mistakes:

• Using external grep after loop (may lose variable scope)
• Not checking for empty lines inside the loop
• Using unnecessary cat command