Process substitution (<() and >()) in Bash Scripting - Time & Space Complexity

Time Complexity: Process substitution (<() and >())

O(n log n)

Understanding Time Complexity

We want to understand how the time cost changes when using process substitution in bash scripts.

Specifically, how the script's execution time grows as input size changes when using <() and ()>.

Scenario Under Consideration

Analyze the time complexity of the following bash snippet using process substitution.

    diff <(sort file1.txt) <(sort file2.txt)
    

This code compares two files by sorting each and then running diff on the sorted outputs using process substitution.

Identify Repeating Operations

Look for loops or repeated commands inside the process substitution.

• Primary operation: Sorting each file with sort, which reads and processes all lines.
• How many times: Each file is processed once by sort, then diff compares the sorted outputs line by line.

How Execution Grows With Input

As the size of each file grows, the sorting and diffing take more time.

Input Size (n lines per file)	Approx. Operations
10	Sort ~10 lines + diff ~10 lines
100	Sort ~100 lines + diff ~100 lines
1000	Sort ~1000 lines + diff ~1000 lines

Pattern observation: Sorting cost grows faster than line count, diff grows roughly linearly.

Final Time Complexity

Time Complexity: O(n log n)

This means the script's time mainly depends on sorting each file, which grows a bit faster than just reading lines.

Common Mistake

[X] Wrong: "Process substitution runs instantly and does not add to time complexity."

[OK] Correct: Process substitution runs the commands inside it fully, so their time cost counts just like normal commands.

Interview Connect

Understanding how process substitution affects script time helps you write efficient bash scripts and explain your choices clearly in interviews.

Self-Check

What if we replaced sort with a command that reads the file once without sorting? How would the time complexity change?

Practice

1. What does the process substitution syntax <() do in bash scripting?

easy

A. It runs a command and waits for user input.

B. It redirects the output of a command to a file on disk.

C. It creates a temporary file with command output saved.

D. It runs a command and provides its output as a file input to another command.

Solution

1. Step 1: Understand process substitution <()

   This syntax runs a command and makes its output appear as a file that another command can read.

2. Step 2: Compare with other options

   Unlike redirecting output to a disk file, <() creates a temporary file descriptor for input.

3. Final Answer:

   It runs a command and provides its output as a file input to another command. -> Option D

4. Quick Check:

   Process substitution <() = command output as input file [OK]

Hint: Remember: <() gives command output as a file input [OK]

Common Mistakes:

• Confusing <() with output redirection >
• Thinking it creates a real disk file
• Assuming it waits for user input

2. Which of the following is the correct syntax to use process substitution to compare two files file1 and file2 using diff?

easy

A. diff <(cat file1) <(cat file2)

B. diff >(cat file1) >(cat file2)

C. diff <(file1) <(file2)

D. diff file1 >() file2

Solution

1. Step 1: Identify correct process substitution usage

   Using <() runs commands and provides their output as files to diff.

2. Step 2: Check each option

   diff <(cat file1) <(cat file2) correctly uses cat file1 and cat file2 inside <(). Options B, C, and D misuse syntax or operators.

3. Final Answer:

   diff <(cat file1) <(cat file2) -> Option A

4. Quick Check:

   Correct syntax for process substitution in diff = diff <(cat file1) <(cat file2) [OK]

Hint: Use <() with commands producing input, not >() [OK]

Common Mistakes:

• Using >() instead of <() for input
• Trying to put filenames directly inside <()
• Mixing redirection symbols incorrectly

3. What will be the output of the following bash command?

comm -12 <(sort fileA.txt) <(sort fileB.txt)

Assuming fileA.txt contains:
apple banana carrot
and fileB.txt contains:
banana carrot date

medium

A. apple
banana
carrot
date

B. banana
carrot

C. apple

D. banana
carrot
date
apple

Solution

1. Step 1: Understand comm -12 with process substitution

   The command compares sorted files and outputs lines common to both (options 1 and 2).

2. Step 2: Sort and compare file contents

   Sorted fileA.txt: apple, banana, carrot
   Sorted fileB.txt: banana, carrot, date
   Common lines: banana, carrot

3. Final Answer:

   banana carrot -> Option B

4. Quick Check:

   Common sorted lines = banana and carrot [OK]

Hint: comm -12 shows common lines from sorted inputs [OK]

Common Mistakes:

• Not sorting files before comm
• Expecting all lines combined
• Confusing comm options

4. Identify the error in this script snippet using process substitution:

grep 'error' >(sort > errors_sorted.txt)

medium

A. Using >() where <() is needed for input

B. Missing quotes around 'error'

C. Cannot redirect output inside >()

D. sort command should be outside process substitution

Solution

1. Step 1: Analyze the use of >() in the command

   The syntax >() creates a writable file descriptor for output redirection, but here grep expects a file input, not output.

2. Step 2: Determine correct substitution type

   To provide input from a command, <() should be used. Using >() here is incorrect.

3. Final Answer:

   Using >() where <() is needed for input -> Option A

4. Quick Check:

   Input needs <() not >() [OK]

Hint: Use <() for input, >() for output redirection [OK]

Common Mistakes:

• Confusing input and output process substitution
• Assuming >() can be nested inside commands
• Ignoring command expectations for input/output

5. You want to run a command that reads from a file and writes output to another command simultaneously, without creating temporary files on disk. Which process substitution usage correctly achieves this?

command1 <(producer) >(consumer)

What does this setup do?

hard

A. Runs command1 output to producer and input from consumer.

B. Creates two temporary files for producer and consumer.

C. Runs producer and feeds its output as input to command1, then sends command1 output to consumer.

D. Runs consumer first, then producer.

Solution

1. Step 1: Understand <() and >() roles

   <() provides command output as input file, >() provides a writable file for output redirection.

2. Step 2: Analyze the command flow

   producer output feeds command1 input via <(), and command1 output is sent to consumer via >().

3. Final Answer:

   Runs producer and feeds its output as input to command1, then sends command1 output to consumer. -> Option C

4. Quick Check:

   <() input, >() output redirection [OK]

Hint: Use <() for input, >() for output to chain commands [OK]

Common Mistakes:

• Mixing input and output substitutions
• Assuming temporary disk files are created
• Confusing command execution order