Correlation (correlate) in SciPy - Mini Project: Build & Apply

Calculate Correlation Using scipy.correlate

📖 Scenario: You are analyzing two simple time series data sets representing daily sales of two products in a small store. You want to find how these two sales patterns relate to each other by calculating their correlation.

🎯 Goal: Build a Python program that uses scipy.correlate to find the correlation between two lists of sales data.

📋 What You'll Learn

Create two lists named sales_product_a and sales_product_b with exact daily sales values.

Create a variable named mode with the value 'full' to configure the correlation.

Use scipy.correlate with sales_product_a, sales_product_b, and mode to calculate the correlation and store it in correlation_result.

Print the correlation_result to see the correlation values.

💡 Why This Matters

🌍 Real World

Correlation helps find relationships between two sets of data, like sales of two products over time, to understand if they move together.

💼 Career

Data scientists and analysts use correlation to find patterns and connections in data, which helps businesses make better decisions.

1

Create sales data lists

Create two lists called sales_product_a and sales_product_b with these exact values: sales_product_a = [10, 20, 30, 40, 50] and sales_product_b = [15, 25, 35, 45, 55].

SciPy

# Create the sales data lists
# Your code here

Hint

Use square brackets to create lists and separate numbers with commas.

2

Set correlation mode

Create a variable called mode and set it to the string 'full' to specify the correlation mode.

SciPy

sales_product_a = [10, 20, 30, 40, 50]
sales_product_b = [15, 25, 35, 45, 55]
# Create the mode variable
# Your code here

Hint

Assign the string 'full' to the variable mode.

3

Calculate correlation using scipy.correlate

Import correlate from scipy.signal. Then use correlate with sales_product_a, sales_product_b, and mode to calculate the correlation. Store the result in a variable called correlation_result.

SciPy

sales_product_a = [10, 20, 30, 40, 50]
sales_product_b = [15, 25, 35, 45, 55]
mode = 'full'
# Import correlate and calculate correlation_result
# Your code here

Hint

Use from scipy.signal import correlate to import. Then call correlate() with the two lists and the mode.

4

Print the correlation result

Write a print statement to display the value of correlation_result.

SciPy

from scipy.signal import correlate

sales_product_a = [10, 20, 30, 40, 50]
sales_product_b = [15, 25, 35, 45, 55]
mode = 'full'

correlation_result = correlate(sales_product_a, sales_product_b, mode=mode)
# Print the correlation_result
# Your code here

Hint

Use print(correlation_result) to show the correlation values.

Practice

1. What does the scipy.signal.correlate function measure between two arrays?

easy

A. The difference between the maximum values of two arrays

B. The sum of elements in both arrays

C. The similarity between two arrays at different shifts

D. The product of the two arrays element-wise

Solution

1. Step 1: Understand correlation concept

   Correlation measures how similar two data sets are when one is shifted over the other.

2. Step 2: Identify function purpose

   scipy.signal.correlate computes this similarity at all possible shifts.

3. Final Answer:

   The similarity between two arrays at different shifts -> Option C

4. Quick Check:

   Correlation = similarity at shifts [OK]

Hint: Correlation = similarity at shifts between arrays [OK]

Common Mistakes:

• Confusing correlation with element-wise multiplication
• Thinking it sums elements instead of comparing shifts
• Mixing correlation with difference or subtraction

2. Which of the following is the correct way to import the correlate function from scipy.signal?

easy

A. import correlate from scipy.signal

B. from scipy.signal import correlate

C. from scipy import correlate

D. import scipy.correlate

Solution

1. Step 1: Recall correct import syntax

   Python imports functions using from module import function syntax.

2. Step 2: Match function and module

   correlate is in scipy.signal, so correct import is from scipy.signal import correlate.

3. Final Answer:

   from scipy.signal import correlate -> Option B

4. Quick Check:

   Correct import syntax = from scipy.signal import correlate [OK]

Hint: Use 'from scipy.signal import correlate' to import [OK]

Common Mistakes:

• Using 'import scipy.correlate' which is invalid
• Trying 'from scipy import correlate' missing submodule
• Incorrect order like 'import correlate from scipy.signal'

3. What is the output of this code?

import numpy as np
from scipy.signal import correlate
x = np.array([1, 2, 3])
y = np.array([0, 1, 0.5])
result = correlate(x, y, mode='full')
print(result)

medium

A. [0.5 2. 3.5 3. 0. ]

B. [0. 1. 2.5 3. 1.5]

C. [0. 1. 2. 3. 4.]

D. [1. 2. 3. 0. 0.5]

Solution

1. Step 1: Understand correlation calculation

   Correlation slides the reversed y over x and sums element-wise products at each shift. Equivalent to np.convolve(x, np.flip(y), mode='full').

2. Step 2: Calculate each position manually

   Reversed y = [0.5, 1, 0]
   Pos 0: 1*0.5 = 0.5
   Pos 1: 1*1 + 2*0.5 = 2.0
   Pos 2: 1*0 + 2*1 + 3*0.5 = 3.5
   Pos 3: 2*0 + 3*1 = 3.0
   Pos 4: 3*0 = 0.0
   result = [0.5 2. 3.5 3. 0. ]

3. Final Answer:

   [0.5 2. 3.5 3. 0. ] -> Option A

4. Quick Check:

   Cross-correlation with flip = [0.5 2. 3.5 3. 0.] [OK]

Hint: Calculate sums at each shift for full mode [OK]

Common Mistakes:

• Confusing convolution with correlation
• Miscounting output length for 'full' mode
• Ignoring zero padding in calculation

4. Identify the error in this code snippet:

import numpy as np
from scipy.signal import correlate
x = np.array([1, 2, 3])
y = np.array([4, 5])
result = correlate(x, y, mode='same')
print(result)

medium

A. The mode 'same' is invalid for correlate

B. Arrays x and y must be the same length

C. The import statement is incorrect

D. No error; code runs correctly and prints output

Solution

1. Step 1: Check mode validity

   The mode 'same' is valid and returns output same size as first input.

2. Step 2: Check array length requirements

   Arrays can have different lengths; correlate handles this with zero padding.

3. Step 3: Verify import correctness

   Import statement is correct as per scipy.signal documentation.

4. Final Answer:

   No error; code runs correctly and prints output -> Option D

5. Quick Check:

   Mode 'same' works with different length arrays [OK]

Hint: Mode 'same' works even if arrays differ in length [OK]

Common Mistakes:

• Thinking arrays must be equal length
• Assuming 'same' mode is invalid
• Misreading import statement as wrong

5. You have two time series arrays representing sensor readings:

sensor1 = [1, 3, 2, 4, 5]
sensor2 = [0, 1, 0.5, 2]

You want to find the shift where sensor2 best matches sensor1 using correlation. Which code snippet correctly finds the shift index with the highest correlation?

hard

A. import numpy as np
from scipy.signal import correlate
corr = correlate(sensor1, sensor2, mode='full')
shift = np.argmax(corr) - (len(sensor2) - 1)
print(shift)

B. import numpy as np
from scipy.signal import correlate
corr = correlate(sensor2, sensor1, mode='valid')
shift = np.argmax(corr)
print(shift)

C. import numpy as np
from scipy.signal import correlate
corr = correlate(sensor1, sensor2, mode='same')
shift = np.argmax(corr)
print(shift)

D. import numpy as np
from scipy.signal import correlate
corr = correlate(sensor1, sensor2)
shift = np.argmin(corr)
print(shift)

Solution

1. Step 1: Use 'full' mode for complete correlation

   To find best matching shift, full correlation output is needed to cover all shifts.

2. Step 2: Calculate shift index correctly

   Shift index = position of max correlation minus (length of second array - 1) to center shifts around zero.

3. Step 3: Verify code correctness

   import numpy as np from scipy.signal import correlate corr = correlate(sensor1, sensor2, mode='full') shift = np.argmax(corr) - (len(sensor2) - 1) print(shift) uses full mode, np.argmax, and correct shift calculation.

4. Final Answer:

   import numpy as np from scipy.signal import correlate corr = correlate(sensor1, sensor2, mode='full') shift = np.argmax(corr) - (len(sensor2) - 1) print(shift) -> Option A

5. Quick Check:

   Full mode + argmax - (len(y)-1) = correct shift [OK]

Hint: Use full mode and adjust argmax by (len(y)-1) for shift [OK]

Common Mistakes:

• Using 'valid' or 'same' mode which limits shifts
• Using argmin instead of argmax
• Not adjusting shift index by array length