Bird
Raised Fist0
Signal Processingdata~5 mins

Sampling theorem (Nyquist-Shannon) in Signal Processing - Time & Space Complexity

Choose your learning style10 modes available
LearnWhyDeepVisualTryChallengeProjectRecallTime
Time Complexity: Sampling theorem (Nyquist-Shannon)
O(n)
Understanding Time Complexity

We want to understand how the time needed to sample a signal changes as the signal length grows.

How does the number of operations grow when we increase the signal size?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.


# signal is a list of samples
sampling_rate = 2 * max_frequency  # Nyquist rate
samples = []
step = int(1 / sampling_rate) if sampling_rate != 0 else 1
for i in range(0, len(signal), step):
    samples.append(signal[i])

This code takes a continuous signal and samples it at the Nyquist rate to avoid losing information.

Identify Repeating Operations
  • Primary operation: Looping through the signal array to pick samples.
  • How many times: Approximately proportional to the length of the signal divided by the sampling interval.
How Execution Grows With Input

As the signal length grows, the number of samples taken grows roughly in the same way.

Input Size (n)Approx. Operations
10About 10 sampling steps
100About 100 sampling steps
1000About 1000 sampling steps

Pattern observation: The operations grow linearly as the signal length increases.

Final Time Complexity

Time Complexity: O(n)

This means the time to sample grows directly in proportion to the signal length.

Common Mistake

[X] Wrong: "Sampling time grows faster than the signal length because of complex calculations."

[OK] Correct: Sampling just picks points at regular intervals, so the work grows only as the signal gets longer, not more complex.

Interview Connect

Understanding how sampling scales helps you explain signal processing tasks clearly and shows you can think about efficiency in real data work.

Self-Check

"What if we changed the sampling rate to be twice the Nyquist rate? How would the time complexity change?"

Practice

(1/5)
1. What does the Nyquist-Shannon sampling theorem state about the sampling rate?
easy
A. Sample at the same rate as the highest frequency
B. Sample at half the highest frequency of the signal
C. Sample at any random rate
D. Sample at least twice the highest frequency of the signal

Solution

  1. Step 1: Understand the sampling theorem

    The Nyquist-Shannon theorem says to sample at least twice the highest frequency to capture all information.

  2. Step 2: Identify correct sampling rate

    Sampling below twice the highest frequency causes aliasing and loss of information.

  3. Final Answer:

    Sample at least twice the highest frequency of the signal -> Option D

  4. Quick Check:

    Sampling rate ≥ 2 x highest frequency [OK]
Hint: Remember: sample rate must be double highest frequency [OK]
Common Mistakes:
  • Thinking sampling rate can be less than highest frequency
  • Confusing sampling rate with signal frequency
  • Ignoring aliasing effects
2. Which of the following is the correct Python syntax to calculate the Nyquist frequency for a signal with sampling rate fs?
easy
A. nyquist = fs / 2
B. nyquist = fs * 2
C. nyquist = 2 / fs
D. nyquist = fs + 2

Solution

  1. Step 1: Recall Nyquist frequency formula

    The Nyquist frequency is half the sampling rate, so nyquist = fs / 2.

  2. Step 2: Match formula to options

    Only nyquist = fs / 2 correctly divides fs by 2.

  3. Final Answer:

    nyquist = fs / 2 -> Option A

  4. Quick Check:

    Nyquist frequency = sampling rate / 2 [OK]
Hint: Nyquist frequency is half the sampling rate [OK]
Common Mistakes:
  • Multiplying instead of dividing by 2
  • Confusing Nyquist frequency with sampling rate
  • Using addition or reciprocal incorrectly
3. Given a signal with highest frequency 500 Hz, what is the minimum sampling rate to avoid aliasing? Consider the code:
highest_freq = 500
sampling_rate = ?
medium
A. sampling_rate = 1000
B. sampling_rate = 750
C. sampling_rate = 250
D. sampling_rate = 500

Solution

  1. Step 1: Apply Nyquist theorem to highest frequency

    Minimum sampling rate = 2 x highest frequency = 2 x 500 = 1000 Hz.

  2. Step 2: Compare with options

    Only sampling_rate = 1000 matches 1000 Hz.

  3. Final Answer:

    sampling_rate = 1000 -> Option A

  4. Quick Check:

    Minimum sampling rate = 2 x 500 = 1000 [OK]
Hint: Double the highest frequency for minimum sampling rate [OK]
Common Mistakes:
  • Choosing sampling rate equal to highest frequency
  • Selecting a rate less than twice the frequency
  • Confusing frequency units
4. Identify the error in this Python code snippet that calculates the Nyquist frequency:
fs = 800
nyquist = fs * 0.5
print("Nyquist frequency is", nyquist)
medium
A. The multiplication should be division by 2
B. The variable fs should be lowercase
C. The code is correct and will print 400.0
D. The print statement syntax is wrong

Solution

  1. Step 1: Understand calculation of Nyquist frequency

    Nyquist frequency = sampling rate divided by 2, which equals fs * 0.5.

  2. Step 2: Check code correctness

    Code multiplies fs by 0.5 correctly and prints the value 400.0.

  3. Final Answer:

    The code is correct and will print 400.0 -> Option C

  4. Quick Check:

    fs * 0.5 = 400.0, print works fine [OK]
Hint: Multiplying by 0.5 equals dividing by 2 [OK]
Common Mistakes:
  • Thinking multiplication by 0.5 is wrong
  • Assuming variable case matters here
  • Believing print syntax is incorrect in Python 3
5. You have a signal with components up to 1200 Hz. You sample it at 2000 Hz. What problem will occur and why?

Options:
A) No problem, sampling rate is sufficient
B) Aliasing will occur because sampling rate is less than twice highest frequency
C) Aliasing will occur because sampling rate is more than twice highest frequency
D) Signal will be perfectly reconstructed without aliasing
hard
A. No problem, sampling rate is sufficient
B. Aliasing will occur because sampling rate is less than twice highest frequency
C. Aliasing will occur because sampling rate is more than twice highest frequency
D. Signal will be perfectly reconstructed without aliasing

Solution

  1. Step 1: Calculate minimum sampling rate needed

    Minimum sampling rate = 2 x 1200 Hz = 2400 Hz.

  2. Step 2: Compare given sampling rate with minimum

    Given sampling rate is 2000 Hz, which is less than 2400 Hz, so aliasing will occur.

  3. Step 3: Understand aliasing cause

    Sampling below twice the highest frequency causes signal distortion called aliasing.

  4. Final Answer:

    Aliasing will occur because sampling rate is less than twice highest frequency -> Option B

  5. Quick Check:

    Sampling rate < 2 x highest frequency causes aliasing [OK]
Hint: Sampling rate must be ≥ 2 x highest frequency to avoid aliasing [OK]
Common Mistakes:
  • Assuming 2000 Hz is enough for 1200 Hz signal
  • Confusing aliasing cause with oversampling
  • Thinking aliasing occurs when sampling rate is too high
Recommended

Ready to prove it?

Pass the test and this pattern moves unknown strong while earning +1 Grip toward your certificate.

10 questions~5 mineasy hard