Real-time DSP processing pipeline in Signal Processing - Step-by-Step Execution

Concept Flow - Real-time DSP processing pipeline

Input Signal

↓

Preprocessing

↓

Filtering

↓

Feature Extraction

↓

Decision/Output

↓

Output Signal

The pipeline takes an input signal, processes it step-by-step in real-time through stages like preprocessing, filtering, feature extraction, and finally outputs the processed signal or decision.

Execution Sample

Signal Processing

buffer = []
for sample in input_stream:
    filtered = filter(sample)
    feature = extract_feature(filtered)
    output = decision(feature)
    buffer.append(output)

This code processes each incoming sample in real-time, filtering it, extracting features, making a decision, and storing the output.

Execution Table

Step	Input Sample	Filtered Output	Feature Extracted	Decision Output	Buffer State
1	0.5	0.45	0.45	1	[1]
2	0.7	0.65	0.65	1	[1, 1]
3	0.2	0.18	0.18	0	[1, 1, 0]
4	0.9	0.85	0.85	1	[1, 1, 0, 1]
5	0.1	0.09	0.09	0	[1, 1, 0, 1, 0]
Exit	No more samples	-	-	-	Processing complete

💡 All input samples processed, loop ends

Variable Tracker

Variable	Start	After 1	After 2	After 3	After 4	After 5	Final
buffer	[]	[1]	[1, 1]	[1, 1, 0]	[1, 1, 0, 1]	[1, 1, 0, 1, 0]	[1, 1, 0, 1, 0]
sample	N/A	0.5	0.7	0.2	0.9	0.1	N/A
filtered	N/A	0.45	0.65	0.18	0.85	0.09	N/A
feature	N/A	0.45	0.65	0.18	0.85	0.09	N/A
output	N/A	1	1	0	1	0	N/A

Key Moments - 3 Insights

Why does the output sometimes become 0 even if the input sample is positive?

Because the decision function converts features below a threshold (like 0.2) to 0, as seen in steps 3 and 5 in the execution_table.

Why do we store outputs in a buffer instead of just printing them?

Storing outputs allows us to keep track of all processed results for later use or analysis, shown by the growing buffer in the variable_tracker.

Is filtering applied before or after feature extraction?

Filtering is applied first to clean the input, then features are extracted from the filtered signal, as shown in the execution_table columns order.

Visual Quiz - 3 Questions

Look at the execution_table at step 3, what is the value of 'Filtered Output'?

A 0.18

B 0.2

C 0.45

D 0.65

💡 Hint

Check the 'Filtered Output' column in row for step 3 in execution_table.

At which step does the decision output first become 0?

A Step 2

B Step 4

C Step 3

D Step 5

💡 Hint

Look at the 'Decision Output' column in execution_table rows.

If the input sample at step 4 was 0.15 instead of 0.9, how would the 'Decision Output' change at that step?

A It would be 1

B It would be 0

C It would be 0.5

D No change

💡 Hint

Since lower filtered values lead to features below threshold, check how decision output depends on feature value in execution_table.

Concept Snapshot

Real-time DSP pipeline processes input signals step-by-step.
Each sample flows through preprocessing, filtering, feature extraction, and decision stages.
Outputs are generated immediately and stored or used.
Filtering cleans signal; feature extraction summarizes important info.
Decisions classify or transform features for output.
This pipeline runs continuously for live data.

Full Transcript

A real-time DSP processing pipeline takes input signals and processes them step-by-step. First, the input signal is preprocessed to prepare it. Then filtering removes noise or unwanted parts. Next, features are extracted to summarize important information from the filtered signal. Finally, a decision stage uses these features to produce an output, such as a classification or transformed signal. This output is stored or sent forward. The process repeats for each new sample in real-time, allowing continuous signal processing. Variables like the buffer grow as outputs accumulate. Filtering always happens before feature extraction. Decisions depend on feature values crossing thresholds. This stepwise flow ensures clean, meaningful, and timely outputs from live signals.

Practice

1. What is the main purpose of a real-time DSP processing pipeline?

easy

A. To process signals step-by-step as data arrives

B. To store large amounts of data for later analysis

C. To generate random signals for testing

D. To visualize signals after processing is complete

Solution

1. Step 1: Understand real-time processing

   Real-time DSP means processing data immediately as it comes in, not storing for later.

2. Step 2: Identify pipeline purpose

   The pipeline processes signals step-by-step to analyze or clean them on the fly.

3. Final Answer:

   To process signals step-by-step as data arrives -> Option A

4. Quick Check:

   Real-time DSP = step-by-step processing [OK]

Hint: Real-time means processing data immediately as it arrives [OK]

Common Mistakes:

• Confusing real-time with batch processing
• Thinking pipeline stores data only
• Assuming visualization is the main goal

2. Which of the following is the correct syntax to apply a moving average filter on a signal array data in Python using a window size of 3?

easy

A. filtered = [sum(data[i:i+3])*3 for i in range(len(data)-2)]

B. filtered = [sum(data[i:i+3])/3 for i in range(len(data)-2)]

C. filtered = [sum(data[i:i+3])/3 for i in range(len(data)+2)]

D. filtered = sum(data[i:i+3])/3 for i in range(len(data)-2)

Solution

1. Step 1: Understand moving average filter

   It averages each group of 3 consecutive elements in the data.

2. Step 2: Check syntax correctness

   filtered = [sum(data[i:i+3])/3 for i in range(len(data)-2)] correctly uses list comprehension with range(len(data)-2) and divides sum by 3.

3. Final Answer:

   filtered = [sum(data[i:i+3])/3 for i in range(len(data)-2)] -> Option B

4. Quick Check:

   Correct list comprehension with proper range and division [OK]

Hint: Use range(len(data)-window+1) for correct slicing [OK]

Common Mistakes:

• Missing brackets for list comprehension
• Using wrong range length causing index errors
• Multiplying instead of dividing for average

3. Given the Python code below for a simple real-time DSP pipeline, what is the output of print(filtered_signal)?

signal = [1, 3, 5, 7, 9]
window_size = 2
filtered_signal = [ (signal[i] + signal[i+1]) / 2 for i in range(len(signal)-1) ]
print(filtered_signal)

medium

A. [1.0, 4.0, 6.0, 8.0]

B. [1.0, 3.0, 5.0, 7.0, 9.0]

C. [2.0, 4.0, 6.0, 8.0]

D. [3.0, 5.0, 7.0, 9.0]

Solution

1. Step 1: Understand the list comprehension

   It averages each pair of consecutive elements: (signal[i] + signal[i+1]) / 2.

2. Step 2: Calculate each average

   Pairs: (1+3)/2=2.0, (3+5)/2=4.0, (5+7)/2=6.0, (7+9)/2=8.0.

3. Final Answer:

   [2.0, 4.0, 6.0, 8.0] -> Option C

4. Quick Check:

   Pairwise averages = [2.0, 4.0, 6.0, 8.0] [OK]

Hint: Calculate pair averages step-by-step [OK]

Common Mistakes:

• Including last element without pair
• Confusing sum with average
• Wrong range causing index error

4. The following code attempts to implement a moving average filter but raises an error. What is the error and how to fix it?

data = [2, 4, 6, 8]
window = 3
filtered = []
for i in range(len(data)):
    avg = (data[i] + data[i+1] + data[i+2]) / window
    filtered.append(avg)
print(filtered)

medium

A. IndexError because indexing goes beyond list end; fix by using range(len(data)-window+1)

B. ZeroDivisionError because window is zero; fix by setting window to 1

C. TypeError because sum cannot add list slices; fix by converting slice to list

D. No error; code runs correctly

Solution

1. Step 1: Identify the error cause

   Loop runs till len(data), but indexing data[i+2] exceeds list length at end.

2. Step 2: Fix the loop range

   Change loop to range(len(data)-window+1) to avoid out-of-range indexing.

3. Final Answer:

   IndexError because indexing goes beyond list end; fix by using range(len(data)-window+1) -> Option A

4. Quick Check:

   Loop range must prevent out-of-bound indexing [OK]

Hint: Loop till len(data)-window+1 for safe indexing [OK]

Common Mistakes:

• Ignoring index bounds causing IndexError
• Changing window size incorrectly
• Assuming no error occurs

5. You want to build a real-time DSP pipeline that filters noise from a sensor signal using a moving average filter of window size 4, but the sensor sometimes sends fewer than 4 samples at once. How should you adapt your pipeline to handle this situation correctly?

hard

A. Use a fixed window size of 1 to avoid buffering

B. Apply the filter on whatever samples arrive, even if fewer than 4, without buffering

C. Discard any samples fewer than 4 and wait for a full batch

D. Process only when at least 4 samples are available; buffer incoming data until then

Solution

1. Step 1: Understand window size requirement

   Moving average with window 4 needs 4 samples to compute an average.

2. Step 2: Handle fewer samples in real-time

   Buffer incoming samples until at least 4 are collected, then apply filter.

3. Step 3: Avoid incorrect averages

   Processing fewer samples without buffering gives wrong results; discarding loses data.

4. Final Answer:

   Process only when at least 4 samples are available; buffer incoming data until then -> Option D

5. Quick Check:

   Buffering ensures correct window size for filtering [OK]

Hint: Buffer data until window size reached before filtering [OK]

Common Mistakes:

• Filtering with incomplete windows causing errors
• Discarding useful data
• Using window size 1 losing noise reduction benefits