Applying filters (lfilter, sosfilt) in SciPy - Step-by-Step Execution

Concept Flow - Applying filters (lfilter, sosfilt)

Start: Input Signal

↓

Choose Filter Type

↓

lfilter

↓

Apply filter coefficients

↓

Filtered Output Signal

↓

End

The input signal is processed by choosing either lfilter or sosfilt, applying filter coefficients or second-order sections, producing the filtered output.

Execution Sample

SciPy

from scipy.signal import lfilter, sosfilt, butter
b, a = butter(2, 0.3)
x = [1, 2, 3, 4, 5]
y = lfilter(b, a, x)

This code creates a Butterworth filter and applies it to a simple signal using lfilter.

Execution Table

Step	Input x[n]	Filter Coefficients b	Filter Coefficients a	Calculation	Output y[n]
1	1	[0.2066, 0.4131, 0.2066]	[1.0, -0.3695, 0.1958]	y[0] = b0*x[0]	0.2066
2	2	[0.2066, 0.4131, 0.2066]	[1.0, -0.3695, 0.1958]	y[1] = b0*x[1] + b1*x[0] - a1*y[0]	0.9026
3	3	[0.2066, 0.4131, 0.2066]	[1.0, -0.3695, 0.1958]	y[2] = b0*x[2] + b1*x[1] + b2*x[0] - a1*y[1] - a2*y[0]	1.9457
4	4	[0.2066, 0.4131, 0.2066]	[1.0, -0.3695, 0.1958]	y[3] = b0*x[3] + b1*x[2] + b2*x[1] - a1*y[2] - a2*y[1]	3.0923
5	5	[0.2066, 0.4131, 0.2066]	[1.0, -0.3695, 0.1958]	y[4] = b0*x[4] + b1*x[3] + b2*x[2] - a1*y[3] - a2*y[2]	4.1721
6	-	-	-	-	End of signal, filtering complete

💡 Reached end of input signal x, no more samples to filter.

Variable Tracker

Variable	Start	After 1	After 2	After 3	After 4	After 5	Final
x[n]	[1, 2, 3, 4, 5]	1	2	3	4	5	-
y[n]	[0, 0, 0, 0, 0]	0.2066	0.9026	1.9457	3.0923	4.1721	4.1721

Key Moments - 3 Insights

Why does the output y[n] depend on previous outputs y[n-1], y[n-2]?

Because the filter is recursive (IIR), each output uses past outputs as feedback, shown in execution_table rows 2-5 where a1 and a2 coefficients multiply previous y values.

What is the difference between lfilter and sosfilt in applying filters?

lfilter uses direct filter coefficients (b, a), while sosfilt uses second-order sections for better numerical stability, especially for higher order filters.

Why do we need to use butter() before lfilter or sosfilt?

butter() designs the filter and returns coefficients needed by lfilter or sosfilt to apply the filter to the signal.

Visual Quiz - 3 Questions

Look at the execution_table, what is the output y[3] after filtering the input x[3]?

A 3.0923

B 1.9457

C 0.9026

D 4.1721

💡 Hint

Check the row where Step is 4 in the execution_table for y[3].

At which step does the filtering process stop according to the execution_table?

A Step 5

B Step 4

C Step 6

D Step 3

💡 Hint

Look for the row with 'End of signal' in the Calculation column.

If the input signal x had one more sample, how would the variable_tracker change?

A It would remove the last column.

B It would add one more column for After 6 with new x and y values.

C It would keep the same columns but change y values.

D It would reset all values to zero.

💡 Hint

Variable tracker columns represent steps after each input sample is processed.

Concept Snapshot

Applying filters with scipy.signal:
- Use butter() to design filter coefficients (b, a) or sos.
- Use lfilter(b, a, x) for direct filtering.
- Use sosfilt(sos, x) for stable filtering with second-order sections.
- Output depends on current and past inputs and outputs (IIR filters).
- Filtering stops when input signal ends.

Full Transcript

This visual execution shows how scipy.signal applies filters using lfilter and sosfilt. Starting with an input signal, we design filter coefficients using butter(). Then lfilter applies these coefficients step-by-step to produce the filtered output. Each output sample depends on current and previous inputs and previous outputs, demonstrating recursive filtering. The execution table traces each calculation and output value. The variable tracker shows how input and output values change after each step. Key moments clarify why outputs depend on past outputs and the difference between lfilter and sosfilt. The quiz tests understanding of output values, stopping conditions, and variable tracking. This helps beginners see filtering as a stepwise process, not just a black box.

Practice

1. What is the main purpose of using lfilter in signal processing with SciPy?

easy

A. To generate random noise signals

B. To apply a digital filter using numerator and denominator coefficients

C. To visualize the frequency response of a filter

D. To compute the Fourier transform of a signal

Solution

1. Step 1: Understand the role of lfilter

   lfilter applies a digital filter to a signal using given numerator (b) and denominator (a) coefficients.

2. Step 2: Compare with other options

   Options A, B, and D describe different signal processing tasks unrelated to filtering with coefficients.

3. Final Answer:

   To apply a digital filter using numerator and denominator coefficients -> Option B

4. Quick Check:

   lfilter = apply filter with b, a coefficients [OK]

Hint: Remember: lfilter uses b, a coefficients to filter signals [OK]

Common Mistakes:

• Confusing lfilter with Fourier transform functions
• Thinking lfilter generates signals instead of filtering
• Mixing up lfilter with visualization tools

2. Which of the following is the correct way to import and use lfilter from SciPy to filter a signal array named data with coefficients b and a?

easy

A. from scipy.signal import lfilter; filtered = lfilter(data, b, a)

B. import scipy.signal as signal; filtered = signal.lfilter(data, b, a)

C. from scipy.signal import lfilter; filtered = lfilter(b, a, data)

D. import lfilter from scipy.signal; filtered = lfilter(b, a, data)

Solution

1. Step 1: Recall the correct import syntax

   The correct import is from scipy.signal import lfilter.

2. Step 2: Check the function call order

   lfilter takes arguments in order: numerator coefficients (b), denominator coefficients (a), then the signal (data).

3. Final Answer:

   from scipy.signal import lfilter; filtered = lfilter(b, a, data) -> Option C

4. Quick Check:

   Import and call lfilter(b, a, data) [OK]

Hint: Import lfilter then call with (b, a, data) order [OK]

Common Mistakes:

• Swapping the order of arguments in lfilter
• Incorrect import syntax causing errors
• Passing data as first argument instead of third

3. Given the code below, what will be the output of filtered_signal?

from scipy.signal import lfilter
b = [0.2, 0.2, 0.2, 0.2, 0.2]
a = [1]
data = [1, 2, 3, 4, 5]
filtered_signal = lfilter(b, a, data)
print(list(filtered_signal))

medium

A. [0.2, 0.6, 1.2, 2.0, 3.0]

B. [1, 2, 3, 4, 5]

C. [0.2, 0.2, 0.2, 0.2, 0.2]

D. [0, 0, 0, 0, 0]

Solution

1. Step 1: Understand the filter coefficients

   The numerator coefficients b average the last 5 samples equally (each 0.2), denominator a is 1 (no feedback).

2. Step 2: Calculate filtered values step-by-step

   Filtered signal is moving average: - y[0] = 0.2*1 = 0.2 - y[1] = 0.2*1 + 0.2*2 = 0.6 - y[2] = 0.2*1 + 0.2*2 + 0.2*3 = 1.2 - y[3] = 0.2*1 + 0.2*2 + 0.2*3 + 0.2*4 = 2.0 - y[4] = 0.2*1 + 0.2*2 + 0.2*3 + 0.2*4 + 0.2*5 = 3.0

3. Final Answer:

   [0.2, 0.6, 1.2, 2.0, 3.0] -> Option A

4. Quick Check:

   Moving average filter output = [0.2, 0.6, 1.2, 2.0, 3.0] [OK]

Hint: Sum weighted inputs by b coefficients for each output [OK]

Common Mistakes:

• Ignoring the filter coefficients and outputting original data
• Confusing denominator coefficients effect
• Calculating only single sample instead of cumulative

4. What is wrong with the following code snippet that attempts to filter a signal using sosfilt?

from scipy.signal import sosfilt
sos = [[0.2929, 0.5858, 0.2929, 1, -0.0000, 0.1716]]
data = [1, 2, 3, 4, 5]
filtered = sosfilt(sos, data)
print(filtered)

medium

A. The sos array should have denominator coefficients in positions 3, 4, 5, but here the second denominator coefficient is zero, which is invalid

B. The denominator coefficients in sos must be normalized; here they are not

C. The sos array should be a 2D array with float values, but the given sos is a list of lists which is invalid

D. The sos array must have shape (n_sections, 6), but here it has shape (1, 6) which is correct

Solution

1. Step 1: Check the sos array format

   The sos array must be a 2D array with each row having 6 coefficients: [b0, b1, b2, a0, a1, a2].

2. Step 2: Validate denominator coefficients

   Denominator coefficients (a0, a1, a2) must be valid. Here, a0=1 (correct), a1=-0.0000 (effectively zero), a2=0.1716. Having a1 near zero is unusual and can cause instability or errors.

3. Final Answer:

   The sos array should have denominator coefficients in positions 3, 4, 5, but here the second denominator coefficient is zero, which is invalid -> Option A

4. Quick Check:

   sos denominator coefficients must be valid and non-zero [OK]

Hint: Check sos denominator coefficients are valid and non-zero [OK]

Common Mistakes:

• Assuming list of lists is invalid input for sos
• Ignoring denominator coefficients causing filter errors
• Confusing numerator and denominator positions in sos

5. You want to apply a stable Butterworth low-pass filter of order 4 with cutoff frequency 0.3 (normalized) to a noisy signal data. Which approach is best to ensure numerical stability and why? A) Use lfilter with numerator and denominator coefficients from butter. B) Use sosfilt with second-order sections from butter. C) Use lfilter with only numerator coefficients. D) Use sosfilt with random coefficients.

hard

A. Use lfilter with numerator and denominator coefficients from butter

B. Use sosfilt with random coefficients

C. Use lfilter with only numerator coefficients ignoring denominator

D. Use sosfilt with second-order sections from butter for better stability

Solution

1. Step 1: Understand filter stability issues

   High order filters can be unstable when applied directly with numerator and denominator coefficients due to numerical errors.

2. Step 2: Recognize sosfilt advantage

   Using second-order sections (sos) breaks the filter into smaller stable parts, improving numerical stability.

3. Step 3: Evaluate options

   Use sosfilt with second-order sections from butter for better stability (recommended stable method). Options C and D are incorrect or nonsensical.

4. Final Answer:

   Use sosfilt with second-order sections from butter for better stability -> Option D

5. Quick Check:

   Use sosfilt with sos for stable filtering [OK]

Hint: Use sosfilt with butter sos for stable high-order filters [OK]

Common Mistakes:

• Using lfilter directly for high order filters causing instability
• Ignoring denominator coefficients in filtering
• Using random coefficients causing wrong results