Power spectral density in SciPy - Deep Dive

Overview - Power spectral density

What is it?

Power spectral density (PSD) shows how the power of a signal is spread across different frequencies. It tells us which frequencies carry the most energy in a signal. PSD is useful for analyzing signals like sound, vibrations, or any time series data. It helps us understand the hidden patterns in the frequency domain.

Why it matters

Without PSD, we would only see signals as changing values over time, missing important frequency information. This would make it hard to detect patterns like noise, rhythms, or faults in machines. PSD helps engineers, scientists, and data analysts find meaningful frequency components, improving designs, diagnostics, and predictions.

Where it fits

Before learning PSD, you should understand basic signals and Fourier transforms, which convert signals from time to frequency. After PSD, you can explore advanced spectral analysis, filtering, and signal processing techniques like wavelets or spectral estimation.

Mental Model

Core Idea

Power spectral density breaks down a signal’s power into its frequency parts, showing how much energy each frequency holds.

Think of it like...

Imagine a music equalizer showing how loud each sound frequency is in a song. PSD is like that equalizer but for any signal, revealing which notes (frequencies) are strongest.

Signal (time) ── Fourier Transform ──> Frequency components
          │
          ▼
    Power Spectral Density

┌───────────────┐
│ Frequency (Hz)│
│ Power (Energy)│
└───────────────┘

Build-Up - 7 Steps

1

Foundation

Understanding signals and frequencies

Concept: Signals change over time and can be made of many frequencies combined.

A signal is a sequence of values measured over time, like sound or temperature. Any signal can be thought of as a mix of simple waves at different frequencies. Frequency means how fast something repeats per second, measured in Hertz (Hz).

Result

You see that signals are not just random but built from waves of different speeds.

Understanding that signals are combinations of frequencies is the base for analyzing them in the frequency domain.

2

Foundation

Fourier transform basics

Concept: Fourier transform converts a time signal into its frequency components.

The Fourier transform takes a signal and shows how much of each frequency is inside it. It changes the view from time to frequency. For example, a pure tone at 5 Hz will show a spike at 5 Hz in the frequency view.

Result

You can see the frequency makeup of any signal.

Knowing Fourier transform lets you move from time to frequency, which is essential for PSD.

3

Intermediate

Defining power spectral density

Concept: PSD measures the power (energy per frequency) distribution of a signal.

Power spectral density tells how the power of a signal is spread over frequencies. It is calculated by squaring the magnitude of the Fourier transform and normalizing by the signal length. This shows which frequencies carry more energy.

Result

You get a graph or data showing power vs frequency.

PSD reveals the strength of each frequency component, not just presence, which is key for understanding signal energy.

4

Intermediate

Using scipy to compute PSD

🤔Before reading on: do you think scipy’s PSD function needs raw signal or frequency data as input? Commit to your answer.

Concept: scipy.signal.welch estimates PSD from raw time signals using a method that reduces noise.

scipy.signal.welch splits the signal into overlapping segments, computes the Fourier transform for each, then averages the squared magnitudes. This reduces variance in the PSD estimate. You provide the raw signal and sampling rate, and it returns frequencies and PSD values.

Result

You get smooth PSD estimates that highlight true frequency power, not random noise.

Understanding Welch’s method helps you get reliable PSD estimates from noisy real-world signals.

5

Intermediate

Interpreting PSD plots

🤔Before reading on: does a higher peak in PSD always mean a louder sound? Commit to your answer.

Concept: PSD plots show power vs frequency, peaks indicate dominant frequencies.

In a PSD plot, the x-axis is frequency and the y-axis is power. Peaks show frequencies where the signal has strong energy. For example, a 60 Hz peak in electrical signals often means power line noise. Not all peaks mean loud sounds; some may be weak but important.

Result

You can identify key frequencies and noise sources in signals.

Knowing how to read PSD plots lets you diagnose signal properties and problems effectively.

6

Advanced

Windowing and its effect on PSD

🤔Before reading on: do you think using no window or a rectangular window always gives the best PSD? Commit to your answer.

Concept: Window functions reduce spectral leakage in PSD estimation.

When computing PSD, the signal is cut into segments. If you cut abruptly, it causes spectral leakage—energy spreading to wrong frequencies. Applying window functions like Hanning or Hamming smooths edges, reducing leakage and improving PSD accuracy.

Result

PSD estimates become cleaner and more accurate with proper windowing.

Understanding windowing prevents common PSD errors and improves frequency resolution.

7

Expert

Limitations and advanced PSD techniques

🤔Before reading on: can PSD perfectly separate two very close frequencies in a short signal? Commit to your answer.

Concept: PSD has resolution limits and advanced methods improve estimation.

PSD resolution depends on signal length and windowing. Short signals or close frequencies cause overlap in PSD peaks. Advanced methods like multitaper or parametric models improve resolution and reduce bias. Also, PSD assumes stationarity; non-stationary signals need time-frequency methods.

Result

You learn when PSD works well and when to use advanced spectral analysis.

Knowing PSD limits guides you to choose the right tool for complex signals.

Under the Hood

PSD calculation involves transforming the time signal into frequency components using Fourier transform, then computing the squared magnitude of these components to measure power. Averaging over segments (Welch’s method) reduces variance. Window functions taper the signal edges to minimize spectral leakage. Internally, the algorithm handles discrete samples and uses fast Fourier transform (FFT) for efficiency.

Why designed this way?

PSD was designed to quantify signal power distribution in frequency because raw time signals hide frequency info. Welch’s method balances bias and variance by segmenting and averaging. Windowing was introduced to fix leakage caused by abrupt segment edges. Alternatives like periodogram were less stable, so Welch’s method became standard.

┌─────────────┐
│ Raw Signal  │
└─────┬───────┘
      │ Segment into overlapping parts
      ▼
┌─────────────┐
│ Apply Window│
└─────┬───────┘
      │ FFT on each segment
      ▼
┌─────────────┐
│ Compute PSD │
│ (square mag)│
└─────┬───────┘
      │ Average PSDs
      ▼
┌─────────────┐
│ Final PSD   │
└─────────────┘

Myth Busters - 4 Common Misconceptions

Quick: Does a higher PSD peak always mean a louder sound? Commit to yes or no.

Common Belief: A higher PSD peak always means the sound is louder at that frequency.

Reality: PSD shows power distribution, but loudness perception also depends on human hearing sensitivity and context. A high PSD peak means more power, but not necessarily louder perceived sound.

Why it matters: Misinterpreting PSD peaks as loudness can lead to wrong conclusions in audio analysis or noise control.

Quick: Is PSD the same as the Fourier transform magnitude squared? Commit to yes or no.

Common Belief: PSD is just the squared magnitude of the Fourier transform of the whole signal.

Reality: PSD is often estimated by averaging squared magnitudes over segments (Welch’s method) to reduce noise and variance, not just a single Fourier transform.

Why it matters: Using raw squared magnitude without averaging leads to noisy, unreliable PSD estimates.

Quick: Does windowing always reduce signal information? Commit to yes or no.

Common Belief: Applying a window function removes important parts of the signal and reduces accuracy.

Reality: Windowing reduces spectral leakage by smoothing edges, improving frequency resolution despite slight signal modification.

Why it matters: Avoiding windowing causes spectral leakage, making PSD misleading and less useful.

Quick: Can PSD perfectly separate two very close frequencies in a short signal? Commit to yes or no.

Common Belief: PSD can always distinguish any two frequencies regardless of signal length.

Reality: PSD resolution depends on signal length and windowing; very close frequencies in short signals may blur together.

Why it matters: Expecting perfect resolution leads to wrong analysis and missed frequency components.

Expert Zone

1

PSD estimates depend heavily on segment length and overlap; tuning these parameters balances resolution and variance.

2

The choice of window function affects sidelobe levels and mainlobe width, impacting frequency leakage and resolution trade-offs.

3

PSD assumes signal stationarity; for signals changing over time, time-frequency methods like spectrograms or wavelets are more appropriate.

When NOT to use

Avoid PSD for non-stationary signals or very short data segments where frequency resolution is insufficient. Use time-frequency analysis like spectrograms or wavelet transforms instead.

Production Patterns

In real systems, PSD is used for fault detection in machinery by spotting frequency spikes, in wireless communications to analyze channel noise, and in neuroscience to study brain wave frequencies. Welch’s method with tuned parameters is standard for robust PSD estimation.

Connections

Fourier transform

PSD builds directly on Fourier transform by analyzing power of frequency components.

Understanding Fourier transform is essential to grasp how PSD decomposes signal energy by frequency.

Signal filtering

PSD helps identify frequencies to keep or remove in filtering.

Knowing PSD guides filter design by showing which frequencies carry noise or important signal parts.

Music equalizers

PSD and equalizers both analyze and adjust power across frequencies.

Recognizing this connection helps relate abstract PSD concepts to everyday audio experiences.

Common Pitfalls

#1 Using raw Fourier transform squared magnitude as PSD without averaging.

Wrong approach:

import numpy as np
from scipy.fft import fft
signal = np.random.randn(1024)
psd = np.abs(fft(signal))**2

Correct approach:

from scipy.signal import welch
frequencies, psd = welch(signal, fs=1000)

Root cause:

Misunderstanding that PSD needs averaging to reduce noise and variance.

#2 Not applying window function before PSD calculation.

Wrong approach:

frequencies, psd = welch(signal, fs=1000, window='boxcar') # boxcar is rectangular window

Correct approach:

frequencies, psd = welch(signal, fs=1000, window='hann')

Root cause:

Ignoring spectral leakage effects caused by abrupt segment edges.

#3 Using too short signal segments causing poor frequency resolution.

Wrong approach:

frequencies, psd = welch(signal, fs=1000, nperseg=64)

Correct approach:

frequencies, psd = welch(signal, fs=1000, nperseg=256)

Root cause:

Not balancing segment length and resolution trade-off.

Key Takeaways

Power spectral density reveals how signal power is distributed across frequencies, unlocking hidden patterns.

PSD relies on Fourier transform and averaging methods like Welch’s to produce stable, meaningful estimates.

Windowing is essential to reduce spectral leakage and improve PSD accuracy.

PSD has limits in frequency resolution depending on signal length and stationarity assumptions.

Understanding PSD helps in many fields from audio analysis to machine fault detection by showing frequency energy.