Correlation matrix visualization in Matplotlib - Time & Space Complexity

Time Complexity: Correlation matrix visualization

O(n^2)

Understanding Time Complexity

We want to understand how the time needed to create a correlation matrix visualization changes as the data size grows.

How does the number of variables affect the work matplotlib does to draw the matrix?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import matplotlib.pyplot as plt
import numpy as np

# Generate random data
np.random.seed(0)
data = np.random.rand(100, 5)  # 100 rows, 5 variables

# Compute correlation matrix
corr = np.corrcoef(data, rowvar=False)

# Plot correlation matrix
plt.imshow(corr, cmap='coolwarm', vmin=-1, vmax=1)
plt.colorbar()
plt.show()

This code creates a correlation matrix from 5 variables and shows it as a colored grid.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Calculating correlations between each pair of variables.
• How many times: For n variables, correlations are computed for each pair, about n x n times.

How Execution Grows With Input

As the number of variables increases, the number of pairs grows quickly.

Input Size (n)	Approx. Operations
5	25
10	100
100	10,000

Pattern observation: The operations grow roughly by the square of the number of variables.

Final Time Complexity

Time Complexity: O(n2)

This means if you double the number of variables, the work to compute and draw the matrix roughly quadruples.

Common Mistake

[X] Wrong: "The time to create the correlation matrix grows linearly with the number of variables."

[OK] Correct: Because each variable pairs with every other variable, the number of pairs grows much faster than the number of variables alone.

Interview Connect

Understanding how visualization time grows with data size helps you explain performance and scalability clearly in real projects.

Self-Check

"What if we only visualize the upper triangle of the correlation matrix? How would the time complexity change?"

Practice

1. What does a correlation matrix visualization primarily help you understand in data science?

easy

A. The total number of missing values in the data

B. The strength and direction of relationships between variables

C. The order of rows in a dataset

D. The exact values of each data point in the dataset

Solution

1. Step 1: Understand the purpose of a correlation matrix

   A correlation matrix shows how variables relate to each other, indicating strength and direction of relationships.

2. Step 2: Connect visualization to understanding relationships

   Visualizing the matrix with colors helps quickly spot strong positive or negative correlations between variables.

3. Final Answer:

   The strength and direction of relationships between variables -> Option B

4. Quick Check:

   Correlation matrix = relationships [OK]

Hint: Correlation matrix shows variable relationships, not raw data [OK]

Common Mistakes:

• Confusing correlation matrix with raw data values
• Thinking it shows missing data counts
• Assuming it orders dataset rows

2. Which of the following is the correct way to display a correlation matrix using matplotlib's imshow function?

easy

A. plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none')

B. plt.imshow(corr_matrix, color='red')

C. plt.imshow(corr_matrix, style='heatmap')

D. plt.imshow(corr_matrix, axis='off')

Solution

1. Step 1: Recall correct imshow parameters for correlation matrix

   Use cmap to set color map and interpolation='none' to avoid smoothing colors.

2. Step 2: Evaluate options

   plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none') correctly uses cmap='coolwarm' and interpolation='none'. Others use invalid or unsupported parameters.

3. Final Answer:

   plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none') -> Option A

4. Quick Check:

   Correct imshow syntax = plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none') [OK]

Hint: Use cmap and interpolation='none' with imshow for clear matrix [OK]

Common Mistakes:

• Using invalid parameters like 'color' or 'style' in imshow
• Forgetting interpolation='none' causing blurry colors
• Trying to hide axes with 'axis' parameter inside imshow

3. Given the following code, what will be the output visualization?

import matplotlib.pyplot as plt
import numpy as np

np.random.seed(0)
data = np.random.rand(4,4)
corr_matrix = np.corrcoef(data)
plt.imshow(corr_matrix, cmap='viridis', interpolation='none')
plt.colorbar()
plt.show()

medium

A. A line plot showing correlation coefficients over time

B. A scatter plot of the original data points

C. A heatmap showing correlation values between 4 variables with colors from viridis colormap

D. An error because np.corrcoef cannot handle 2D arrays

Solution

1. Step 1: Understand the code steps

   Data is a 4x4 random array, then np.corrcoef computes correlation matrix (4x4). imshow visualizes it with 'viridis' colors and a colorbar.

2. Step 2: Identify the output type

   The output is a heatmap showing correlation strengths between variables, colored by viridis scale.

3. Final Answer:

   A heatmap showing correlation values between 4 variables with colors from viridis colormap -> Option C

4. Quick Check:

   Correlation matrix + imshow = heatmap [OK]

Hint: Correlation matrix + imshow + colorbar = heatmap visualization [OK]

Common Mistakes:

• Confusing correlation matrix with scatter or line plots
• Thinking np.corrcoef fails on 2D arrays
• Ignoring the colorbar presence

4. You run this code but get a blurry correlation matrix image:

plt.imshow(corr_matrix, cmap='coolwarm')
plt.colorbar()
plt.show()

What is the likely cause and fix?

medium

A. The colormap 'coolwarm' is invalid; use 'viridis' instead

B. The correlation matrix must be normalized before plotting

C. You forgot to call plt.show(), so image is blurry

D. Missing interpolation='none' causes smoothing; add interpolation='none' to fix

Solution

1. Step 1: Identify cause of blurry image

   By default, imshow applies interpolation which smooths colors, causing blur.

2. Step 2: Fix by disabling interpolation

   Adding interpolation='none' disables smoothing, making each cell color sharp and clear.

3. Final Answer:

   Missing interpolation='none' causes smoothing; add interpolation='none' to fix -> Option D

4. Quick Check:

   Interpolation='none' stops blur [OK]

Hint: Add interpolation='none' to imshow to avoid blurry colors [OK]

Common Mistakes:

• Changing colormap instead of fixing interpolation
• Forgetting plt.show() does not affect blur
• Normalizing matrix is unnecessary for visualization

5. You have a dataset with 5 variables and want to visualize their correlation matrix with variable names on axes. Which code snippet correctly adds labels and a title to the heatmap?

hard

A. plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none')
plt.xticks(ticks=range(5), labels=var_names)
plt.yticks(ticks=range(5), labels=var_names)
plt.title('Correlation Matrix')
plt.colorbar()
plt.show()

B. plt.imshow(corr_matrix, cmap='coolwarm')
plt.xlabel(var_names)
plt.ylabel(var_names)
plt.title('Correlation Matrix')
plt.colorbar()
plt.show()

C. plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none')
plt.axis('off')
plt.title('Correlation Matrix')
plt.colorbar()
plt.show()

D. plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none')
plt.xticks(var_names)
plt.yticks(var_names)
plt.colorbar()
plt.show()

Solution

1. Step 1: Understand how to label axes in matplotlib heatmap

   Use plt.xticks and plt.yticks with ticks=range(n) and labels=var_names to set variable names on axes.

2. Step 2: Check options for correct labeling and title

   plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none') plt.xticks(ticks=range(5), labels=var_names) plt.yticks(ticks=range(5), labels=var_names) plt.title('Correlation Matrix') plt.colorbar() plt.show() correctly sets ticks and labels, adds title and colorbar. Others misuse xlabel, ylabel, or omit ticks.

3. Final Answer:

   plt.imshow(corr_matrix, cmap='coolwarm', interpolation='none') plt.xticks(ticks=range(5), labels=var_names) plt.yticks(ticks=range(5), labels=var_names) plt.title('Correlation Matrix') plt.colorbar() plt.show() -> Option A

4. Quick Check:

   Use xticks/yticks with ticks and labels [OK]

Hint: Use plt.xticks and plt.yticks with ticks and labels for axis names [OK]

Common Mistakes:

• Using plt.xlabel/plt.ylabel for multiple tick labels
• Forgetting to specify ticks in xticks/yticks
• Turning axis off removes labels