wget for file downloads in Linux CLI - Commands & Configuration

Introduction

Sometimes you need to get files from the internet directly to your computer using the command line. wget is a simple tool that helps you download files quickly and easily without opening a browser.

When you want to download a software installer from a website using the terminal.

When you need to save a backup of a webpage or file for offline use.

When you want to download multiple files automatically using a script.

When you have a slow or unstable internet connection and want to resume downloads.

When you want to download files on a remote server without a graphical interface.

Commands

This command downloads the file named sample.txt from the website example.com to your current folder.

Terminal

wget https://example.com/sample.txt

Expected Output

2024-06-01 12:00:00 URL:https://example.com/sample.txt [1234/1234] -> "sample.txt" [1]

This command downloads the file but saves it locally as newname.txt instead of the original name.

Terminal

wget -O newname.txt https://example.com/sample.txt

Expected Output

2024-06-01 12:01:00 URL:https://example.com/sample.txt [1234/1234] -> "newname.txt" [1]

→

-O - Save the downloaded file with a custom name

This command downloads a large file and allows resuming if the download is interrupted.

Terminal

wget -c https://example.com/largefile.zip

Expected Output

2024-06-01 12:02:00 URL:https://example.com/largefile.zip [104857600/104857600] -> "largefile.zip" [1]

Resuming download

→

-c - Continue an incomplete download

This command downloads the file quietly without showing progress or messages.

Terminal

wget -q https://example.com/sample.txt

Expected Output

No output (command runs silently)

→

-q - Quiet mode, no output

Key Concept

If you remember nothing else from wget, remember: it downloads files from the internet directly to your computer using simple commands.

Common Mistakes

Typing the URL incorrectly or missing the https:// part

wget cannot find the file and returns an error because the address is wrong.

Always copy the full and correct URL including the protocol (http:// or https://).

Not using -c flag when resuming a large interrupted download

The download restarts from the beginning instead of continuing where it left off.

Use wget -c to continue incomplete downloads and save time.

Expecting wget to show progress when using -q flag

No output appears, so it seems like nothing is happening.

Use -q only when you want no messages; otherwise omit it to see progress.

Summary

Use wget followed by a URL to download files from the internet.

Use -O to save the file with a different name.

Use -c to resume interrupted downloads.

Use -q to download quietly without showing progress.

Practice

1. What is the primary purpose of the wget command in Linux?

easy

A. To download files from the internet

B. To upload files to a server

C. To list files in a directory

D. To edit text files

Solution

1. Step 1: Understand the function of wget

   The wget command is designed to retrieve files from the internet using HTTP, HTTPS, or FTP protocols.

2. Step 2: Compare options with wget's purpose

   Uploading files, listing directories, or editing text are not functions of wget. It only downloads files.

3. Final Answer:

   To download files from the internet -> Option A

4. Quick Check:

   wget downloads files [OK]

Hint: Remember: wget = get files from web [OK]

Common Mistakes:

• Confusing wget with upload commands like scp
• Thinking wget edits or lists files
• Assuming wget is for local file operations

2. Which of the following is the correct syntax to download a file from http://example.com/file.txt using wget?

easy

A. wget -d http://example.com/file.txt

B. wget http://example.com/file.txt

C. wget download http://example.com/file.txt

D. wget -save http://example.com/file.txt

Solution

1. Step 1: Recall basic wget syntax

   The basic command to download a file is simply wget URL without extra flags.

2. Step 2: Analyze each option

   wget -d http://example.com/file.txt uses an invalid flag -d. wget download http://example.com/file.txt adds an unnecessary word download. wget -save http://example.com/file.txt uses a non-existent flag -save. Only wget http://example.com/file.txt is correct.

3. Final Answer:

   wget http://example.com/file.txt -> Option B

4. Quick Check:

   Basic wget syntax = wget URL [OK]

Hint: Use just 'wget' plus URL to download [OK]

Common Mistakes:

• Adding extra words or flags not supported by wget
• Using incorrect or made-up options
• Confusing wget syntax with other commands

3. What will be the output filename when you run wget http://example.com/data.csv in your current directory?

medium

A. index.html

B. downloaded_file

C. http://example.com/data.csv

D. data.csv

Solution

1. Step 1: Understand wget default naming

   By default, wget saves the downloaded file with the same name as in the URL's last part, here data.csv.

2. Step 2: Check other options

   index.html is default for HTML pages without filename. http://example.com/data.csv is invalid as wget does not save with full URL as filename. downloaded_file is arbitrary and not default.

3. Final Answer:

   data.csv -> Option D

4. Quick Check:

   Filename = last URL part = data.csv [OK]

Hint: Filename defaults to last part of URL [OK]

Common Mistakes:

• Expecting wget to rename files automatically
• Confusing default HTML save name with other files
• Thinking wget saves full URL as filename

4. You run wget -c http://example.com/bigfile.zip but it restarts download from zero instead of resuming. What is the likely cause?

medium

A. The URL is incorrect

B. You forgot to add the -r option

C. The server does not support resuming downloads

D. wget cannot download zip files

Solution

1. Step 1: Understand -c option in wget

   The -c option tells wget to continue/resume an interrupted download if the server supports it.

2. Step 2: Identify why resume fails

   If the server does not support partial content requests, wget cannot resume and restarts from zero. Other options or file types do not affect this behavior.

3. Final Answer:

   The server does not support resuming downloads -> Option C

4. Quick Check:

   -c needs server support [OK]

Hint: Resume needs server support, else restart [OK]

Common Mistakes:

• Thinking -r is for resume (it's for recursive)
• Assuming wget can't download zip files
• Blaming URL without checking server features

5. You want to download multiple files listed in urls.txt using wget, saving each with its original name. Which command correctly does this?

hard

A. wget -i urls.txt

B. wget -o urls.txt

C. wget --save-urls urls.txt

D. wget -c urls.txt

Solution

1. Step 1: Understand wget options for multiple downloads

   The -i option tells wget to read URLs from a file and download each one.

2. Step 2: Check other options

   -o is for log file output, not URLs. --save-urls is not a valid option. -c is for resuming downloads, not reading URL lists.

3. Final Answer:

   wget -i urls.txt -> Option A

4. Quick Check:

   Use -i to read URLs from file [OK]

Hint: Use -i to download from URL list file [OK]

Common Mistakes:

• Using -o instead of -i for input file
• Assuming -c reads URL lists
• Trying non-existent options like --save-urls