Why String prefix removal (${var#pattern}) in Bash Scripting? - Purpose & Use Cases

The Big Idea

What if you could instantly cut off any unwanted start from a string with just one simple command?

The Scenario

Imagine you have a list of file names with full paths, and you want to get just the file names without the folder paths. Doing this by hand means opening each file name and cutting off the folder part manually.

The Problem

Manually removing prefixes from many strings is slow and boring. It's easy to make mistakes, like cutting too much or too little. If you have hundreds of names, it becomes a big headache.

The Solution

Using ${var#pattern} in bash lets you quickly remove the shortest matching prefix from a string. This means you can automatically strip folder paths or any unwanted start part from many strings with one simple command.

Before vs After

✗ Before

filename="/home/user/docs/report.txt"
# Manually remove prefix by complex commands or editing

✓ After

filename="/home/user/docs/report.txt"
file_only=${filename#*/docs/}
# file_only is now "report.txt"

What It Enables

This lets you quickly clean up strings by removing unwanted beginnings, making your scripts smarter and faster.

Real Life Example

When processing log files stored in deep folders, you can extract just the log file names without the full path to organize or analyze them easily.

Key Takeaways

Manually cutting prefixes is slow and error-prone.

${var#pattern} removes the shortest matching prefix automatically.

This makes string handling in scripts simple and efficient.

Practice

1. What does the Bash expression ${var#pattern} do?

easy

A. Removes the shortest matching prefix pattern from the variable's value

B. Removes the longest matching suffix pattern from the variable's value

C. Removes the shortest matching suffix pattern from the variable's value

D. Removes the longest matching prefix pattern from the variable's value

Solution

1. Step 1: Understand the syntax

   The syntax ${var#pattern} is used in Bash to remove a prefix pattern from the start of the variable's value.

2. Step 2: Identify shortest prefix removal

   The single # removes the shortest matching prefix, unlike ## which removes the longest.

3. Final Answer:

   Removes the shortest matching prefix pattern from the variable's value -> Option A

4. Quick Check:

   Prefix removal = shortest match = A [OK]

Hint: Single # removes shortest prefix, double ## removes longest [OK]

Common Mistakes:

• Confusing # with ## for prefix length
• Mixing prefix removal with suffix removal
• Thinking it removes suffix instead of prefix

2. Which of the following is the correct syntax to remove the shortest prefix matching abc from variable var in Bash?

easy

A. ${var#abc}

B. ${var##abc}

C. ${var%abc}

D. ${var%%abc}

Solution

1. Step 1: Recall prefix removal syntax

   Single # removes shortest prefix, double ## removes longest prefix. % and %% remove suffixes.

2. Step 2: Match the pattern

   To remove shortest prefix matching 'abc', use ${var#abc}.

3. Final Answer:

   ${var#abc} -> Option A

4. Quick Check:

   Shortest prefix removal = single # = B [OK]

Hint: Use single # for shortest prefix removal syntax [OK]

Common Mistakes:

• Using ## instead of # for shortest prefix
• Using % or %% which remove suffixes
• Confusing prefix and suffix removal syntax

3. Given var="folder/subfolder/file.txt", what is the output of echo ${var#*/}?

medium

A. folder/subfolder/file.txt

B. subfolder/file.txt

C. file.txt

D. folder

Solution

1. Step 1: Understand the pattern */

   The pattern */ matches the shortest prefix ending with a slash.

2. Step 2: Remove shortest prefix matching */

   From "folder/subfolder/file.txt", the shortest prefix matching */ is "folder/". Removing it leaves "subfolder/file.txt".

3. Final Answer:

   subfolder/file.txt -> Option B

4. Quick Check:

   Remove shortest prefix ending with / = subfolder/file.txt [OK]

Hint: Pattern */ removes up to first slash [OK]

Common Mistakes:

• Removing longest prefix with ## instead of #
• Expecting only filename instead of subfolder/file.txt
• Confusing prefix removal with suffix removal

4. Consider the script snippet:

var="abc123abc456"
echo ${var##abc*}

It outputs an empty line. Why?

medium

A. Because the pattern is invalid and causes an error

B. Because abc* matches the entire string as shortest prefix

C. Because abc* matches the longest prefix, so nothing remains

D. Because the variable is empty

Solution

1. Step 1: Analyze the pattern abc*

   The pattern abc* matches 'abc' followed by zero or more any characters.

2. Step 2: Understand longest prefix removal

   With ##, it removes the longest matching prefix. The * matches greedily as many characters as possible after 'abc', so the match covers the entire string.

3. Final Answer:

   Because abc* matches the longest prefix, so nothing remains -> Option C

4. Quick Check:

   Longest prefix with ## + greedy * = B [OK]

Hint: Wildcard * matches greedily with longest prefix ## [OK]

Common Mistakes:

• Confusing ## (longest) with # (shortest)
• Underestimating greedy nature of * in longest match
• Assuming pattern causes error or variable is empty

5. You have a variable path="folder/home/user/docs/report.txt". Which command removes only the first slash and everything before it, leaving home/user/docs/report.txt?

hard

A. echo ${path#/*}

B. echo ${path##/*}

C. echo ${path##*/}

D. echo ${path#*/}

Solution

1. Step 1: Understand the variable value

   The variable path is "folder/home/user/docs/report.txt".

2. Step 2: Analyze each option's pattern

   ${path#/*} removes shortest prefix matching slash followed by anything, but path doesn't start with /, so no match.
   ${path##/*} removes longest prefix matching slash-anything, no match.
   ${path##*/} removes longest prefix up to last slash, leaving only filename "report.txt".
   ${path#*/} removes shortest prefix up to first slash ("folder/"), leaving "home/user/docs/report.txt".

3. Step 3: Choose correct option

   To remove up to the first slash, use ${path#*/}.

4. Final Answer:

   echo ${path#*/} -> Option D

5. Quick Check:

   Remove shortest prefix up to first slash = D [OK]

Hint: Use #*/ to remove up to first slash only [OK]

Common Mistakes:

• Using ##*/ removes up to last slash (only filename)
• Using #/* or ##/* which don't match without leading slash
• Confusing prefix removal with suffix removal