sort and uniq in Linux CLI - Step-by-Step Execution

Concept Flow - sort and uniq

Input lines

↓

sort command

↓

sorted lines

↓

uniq command

↓

unique lines output

The input lines are first sorted alphabetically, then passed to uniq which removes consecutive duplicate lines, producing unique sorted output.

Execution Sample

Linux CLI

echo -e "apple\nbanana\napple\ncarrot" | sort | uniq

Sorts the list of words and removes duplicates, showing unique sorted words.

Execution Table

Step	Input	Command	Output	Notes
1	apple\nbanana\napple\ncarrot	echo input	apple\nbanana\napple\ncarrot	Original unsorted input with duplicates
2	apple\nbanana\napple\ncarrot	sort	apple\napple\nbanana\ncarrot	Lines sorted alphabetically
3	apple\napple\nbanana\ncarrot	uniq	apple\nbanana\ncarrot	Consecutive duplicates removed
4	apple\nbanana\ncarrot	end	apple\nbanana\ncarrot	Final unique sorted output

💡 uniq stops after processing all sorted lines, outputting unique lines

Variable Tracker

Variable	Start	After sort	After uniq	Final
lines	apple\nbanana\napple\ncarrot	apple\napple\nbanana\ncarrot	apple\nbanana\ncarrot	apple\nbanana\ncarrot

Key Moments - 2 Insights

Why does uniq only remove duplicates after sorting?

uniq only removes duplicates that are next to each other. Sorting puts duplicates next to each other, so uniq can remove them. See execution_table rows 2 and 3.

What happens if you run uniq without sort?

uniq will only remove duplicates that are consecutive in the original input. Non-adjacent duplicates stay. This is why sorting first is important. See execution_table row 1 vs 3.

Visual Quiz - 3 Questions

Look at the execution table, what is the output after the sort command?

A apple\nbanana\ncarrot

B apple\nbanana\napple\ncarrot

C apple\napple\nbanana\ncarrot

D banana\napple\ncarrot

💡 Hint

Check the 'Output' column in step 2 of the execution_table.

At which step does uniq remove duplicates?

A Step 3

B Step 2

C Step 1

D Step 4

💡 Hint

Look at the 'Command' and 'Output' columns in execution_table rows 2 and 3.

If the input was already sorted with duplicates together, what would change in the execution table?

A uniq would not remove any lines

B The sort step would output the same as input

C The final output would have duplicates

D The input would be empty

💡 Hint

Consider what sorting does if input is already sorted (see variable_tracker).

Concept Snapshot

sort and uniq commands:
- sort: arranges lines alphabetically
- uniq: removes only adjacent duplicate lines
- Use together: sort | uniq
- Ensures unique sorted output
- uniq alone won't remove non-adjacent duplicates

Full Transcript

This visual trace shows how the Linux commands sort and uniq work together. First, the input lines are printed as is. Then sort arranges them alphabetically, putting duplicates next to each other. Next, uniq removes these consecutive duplicates, leaving only unique lines. The final output is unique sorted lines. This is important because uniq only removes duplicates that are next to each other, so sorting first is necessary to group duplicates. Running uniq without sorting only removes duplicates that are already adjacent. The execution table and variable tracker clearly show each step's input and output, helping beginners see how the commands transform the data step-by-step.