Correlation and cross-correlation in Signal Processing - Mini Project: Build & Apply

Correlation and Cross-Correlation in Signal Processing

📖 Scenario: Imagine you are working with two simple signals recorded from sensors. You want to understand how similar these signals are and how one signal might be shifted in time compared to the other.

🎯 Goal: Build a small program to calculate the correlation and cross-correlation of two signals using basic Python lists and loops.

📋 What You'll Learn

Create two lists representing signals with exact values

Create a variable to hold the length of the signals

Write a function to calculate the correlation of two signals

Write a function to calculate the cross-correlation of two signals

Print the correlation and cross-correlation results

💡 Why This Matters

🌍 Real World

Correlation and cross-correlation help engineers and scientists find relationships between signals, like sound waves, sensor data, or stock prices.

💼 Career

Understanding these concepts is important for roles in data analysis, signal processing, communications, and machine learning.

1

Create two signals as lists

Create two lists called signal_a and signal_b with these exact values: signal_a = [1, 2, 3, 4, 5] and signal_b = [5, 4, 3, 2, 1].

Signal Processing

# Your code here

Hint

Use square brackets to create lists and separate numbers with commas.

2

Create a variable for signal length

Create a variable called n and set it to the length of signal_a using the len() function.

Signal Processing

signal_a = [1, 2, 3, 4, 5]
signal_b = [5, 4, 3, 2, 1]
# Your code here

Hint

Use len(signal_a) to get the number of elements in the list.

3

Write functions for correlation and cross-correlation

Write two functions: correlation(signal1, signal2, n) and cross_correlation(signal1, signal2, n). The correlation function should calculate the sum of products of corresponding elements. The cross_correlation function should calculate the sum of products of signal1[i] and signal2[(i + lag) % n] for lag = 1. Use a for loop with i from 0 to n-1.

Signal Processing

signal_a = [1, 2, 3, 4, 5]
signal_b = [5, 4, 3, 2, 1]
n = len(signal_a)
# Your code here

Hint

Use a for loop and add products to a total variable. Use modulo % for wrapping index in cross-correlation.

4

Print the correlation and cross-correlation results

Use print() to display the correlation of signal_a and signal_b by calling correlation(signal_a, signal_b, n). Then print the cross-correlation by calling cross_correlation(signal_a, signal_b, n).

Signal Processing

signal_a = [1, 2, 3, 4, 5]
signal_b = [5, 4, 3, 2, 1]
n = len(signal_a)

def correlation(signal1, signal2, n):
    total = 0
    for i in range(n):
        total += signal1[i] * signal2[i]
    return total

def cross_correlation(signal1, signal2, n):
    lag = 1
    total = 0
    for i in range(n):
        total += signal1[i] * signal2[(i + lag) % n]
    return total

# Your code here

Hint

Call the functions with the signals and print the results.

Practice

1. What does the cross-correlation between two signals primarily measure?

easy

A. The similarity between the signals at different time shifts

B. The sum of the signals' amplitudes

C. The difference in frequency between the signals

D. The product of the signals' maximum values

Solution

1. Step 1: Understand cross-correlation concept

   Cross-correlation compares two signals by sliding one over the other to find similarity at different shifts.

2. Step 2: Identify what cross-correlation measures

   It measures how well the signals match at each time delay, not just their sums or frequency differences.

3. Final Answer:

   The similarity between the signals at different time shifts -> Option A

4. Quick Check:

   Cross-correlation = similarity at shifts [OK]

Hint: Cross-correlation slides signals to find best match [OK]

Common Mistakes:

• Confusing correlation with frequency difference
• Thinking it sums amplitudes only
• Assuming it multiplies max values

2. Which Python function from NumPy computes the cross-correlation of two 1D signals correctly?

easy

A. numpy.convolve(signal1, signal2)

B. numpy.correlate(signal1, signal2, mode='full')

C. numpy.cross(signal1, signal2)

D. numpy.corrcoef(signal1, signal2)

Solution

1. Step 1: Identify NumPy functions for correlation

   numpy.correlate computes cross-correlation; numpy.cross is for vector cross product; numpy.convolve does convolution; numpy.corrcoef computes correlation coefficient matrix.

2. Step 2: Confirm correct function and parameters

   numpy.correlate with mode='full' returns cross-correlation at all shifts.

3. Final Answer:

   numpy.correlate(signal1, signal2, mode='full') -> Option B

4. Quick Check:

   Use numpy.correlate for cross-correlation [OK]

Hint: Use numpy.correlate with mode='full' for cross-correlation [OK]

Common Mistakes:

• Using numpy.cross which is vector product
• Confusing convolution with correlation
• Using numpy.corrcoef which gives correlation matrix

3. Given two signals x = [1, 2, 3] and y = [0, 1, 0.5], what is the cross-correlation output using numpy.correlate(x, y, mode='full')?

medium

A. [0.5, 2.5, 4, 3, 0]

B. [0, 1, 2, 3, 4]

C. [0.5, 2, 3.5, 3, 0]

D. [1, 2, 3, 0, 0]

Solution

1. Step 1: Calculate cross-correlation values manually

   Cross-correlation at lag -2: x[0]*y[2]=1*0.5=0.5; lag -1: x[0]*y[1]+x[1]*y[2]=1*1+2*0.5=1+1=2; lag 0: x[0]*y[0]+x[1]*y[1]+x[2]*y[2]=1*0+2*1+3*0.5=0+2+1.5=3.5; lag 1: x[1]*y[0]+x[2]*y[1]=2*0+3*1=3; lag 2: x[2]*y[0]=3*0=0

2. Step 2: Arrange results in full mode order

   Full mode output is [lag -2, -1, 0, 1, 2] = [0.5, 2, 3.5, 3, 0]

3. Final Answer:

   [0.5, 2, 3.5, 3, 0] -> Option C

4. Quick Check:

   Cross-correlation values match calculated array [OK]

Hint: Calculate lag by lag multiplying overlapping elements [OK]

Common Mistakes:

• Mixing convolution with correlation
• Incorrect lag order in output
• Forgetting zero padding in full mode

4. You run numpy.correlate(signal1, signal2) but get a shorter output than expected. What is the likely cause?

medium

A. The function requires 2D arrays, not 1D

B. signal1 and signal2 must be the same length

C. You need to normalize signals before correlation

D. The default mode is 'valid', which returns only overlapping parts

Solution

1. Step 1: Check default mode of numpy.correlate

   By default, numpy.correlate uses mode='valid', which returns only positions where signals fully overlap, resulting in shorter output.

2. Step 2: Understand effect of mode on output length

   To get full cross-correlation including partial overlaps, mode='full' must be specified.

3. Final Answer:

   The default mode is 'valid', which returns only overlapping parts -> Option D

4. Quick Check:

   Default mode='valid' shortens output [OK]

Hint: Specify mode='full' for complete cross-correlation output [OK]

Common Mistakes:

• Assuming signals must be same length
• Thinking normalization affects output length
• Believing function needs 2D arrays

5. You have two noisy signals recorded with a delay. How can cross-correlation help you find the delay between them?

hard

A. By finding the lag where cross-correlation is maximum, indicating best alignment

B. By subtracting the signals and measuring the difference

C. By computing the Fourier transform and comparing magnitudes

D. By averaging the signals and checking the mean value

Solution

1. Step 1: Understand cross-correlation use for delay detection

   Cross-correlation slides one signal over the other and measures similarity at each lag.

2. Step 2: Identify lag with maximum cross-correlation

   The lag where cross-correlation peaks shows the delay that best aligns the two signals despite noise.

3. Final Answer:

   By finding the lag where cross-correlation is maximum, indicating best alignment -> Option A

4. Quick Check:

   Max cross-correlation lag = signal delay [OK]

Hint: Max cross-correlation lag reveals signal delay [OK]

Common Mistakes:

• Using subtraction which ignores alignment
• Confusing frequency domain methods here
• Averaging signals loses timing info