Heatmaps for correlation in Data Analysis Python - Step-by-Step Execution

Concept Flow - Heatmaps for correlation

Start with dataset

↓

Calculate correlation matrix

↓

Create heatmap visualization

↓

Interpret colors for correlation strength

↓

End

We start with data, find correlations between variables, then show these as colors in a heatmap to see relationships easily.

Execution Sample

Data Analysis Python

import pandas as pd
import seaborn as sns
import matplotlib.pyplot as plt

data = pd.DataFrame({
  'A': [1,2,3,4], 'B': [4,3,2,1], 'C': [1,3,2,4]
})
corr = data.corr()
sns.heatmap(corr, annot=True)
plt.show()

This code calculates correlations between columns A, B, C and shows them as a colored heatmap with numbers.

Execution Table

Step	Action	Variable/Output	Value/Result
1	Create DataFrame	data	{'A':[1,2,3,4], 'B':[4,3,2,1], 'C':[1,3,2,4]}
2	Calculate correlation matrix	corr	{'A':{'A':1.0,'B':-1.0,'C':0.4}, 'B':{'A':-1.0,'B':1.0,'C':-0.4}, 'C':{'A':0.4,'B':-0.4,'C':1.0}}
3	Create heatmap plot	heatmap	Color grid showing correlation values with annotations
4	Display plot	plot window	Shows heatmap with colors from blue (negative) to red (positive) correlations
5	End	-	Visualization complete

💡 All steps done, heatmap displayed to user

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	Final
data	None	{'A':[1,2,3,4], 'B':[4,3,2,1], 'C':[1,3,2,4]}	{'A':[1,2,3,4], 'B':[4,3,2,1], 'C':[1,3,2,4]}	{'A':[1,2,3,4], 'B':[4,3,2,1], 'C':[1,3,2,4]}	{'A':[1,2,3,4], 'B':[4,3,2,1], 'C':[1,3,2,4]}
corr	None	None	{'A':{'A':1.0,'B':-1.0,'C':0.4}, 'B':{'A':-1.0,'B':1.0,'C':-0.4}, 'C':{'A':0.4,'B':-0.4,'C':1.0}}	{'A':{'A':1.0,'B':-1.0,'C':0.4}, 'B':{'A':-1.0,'B':1.0,'C':-0.4}, 'C':{'A':0.4,'B':-0.4,'C':1.0}}	{'A':{'A':1.0,'B':-1.0,'C':0.4}, 'B':{'A':-1.0,'B':1.0,'C':-0.4}, 'C':{'A':0.4,'B':-0.4,'C':1.0}}
heatmap	None	None	None	Color grid with annotations	Color grid with annotations

Key Moments - 3 Insights

Why do some correlation values show as 1.0 on the heatmap?

Because each variable is perfectly correlated with itself, shown in the diagonal cells in the correlation matrix (see execution_table step 2).

Why are some correlations negative and what does the color mean?

Negative correlations mean when one variable goes up, the other goes down. The heatmap colors blue for negative and red for positive correlations (see execution_table step 4).

What does the 'annot=True' option do in the heatmap?

It adds the actual correlation numbers on the heatmap squares so you can see exact values, not just colors (see execution_sample code line with sns.heatmap).

Visual Quiz - 3 Questions

Look at the execution_table at step 2, what is the correlation value between A and B?

A 1.0

B -1.0

C 0.7

D -0.7

💡 Hint

Check the 'corr' variable value in execution_table step 2 under 'A' and 'B'

At which step is the heatmap visualization created?

A Step 1

B Step 2

C Step 3

D Step 4

💡 Hint

Look for the step where 'heatmap' variable is assigned in execution_table

If we remove 'annot=True' from sns.heatmap, what changes in the output?

A Correlation numbers on squares disappear

B Correlation matrix calculation changes

C Heatmap colors disappear

D Plot window does not open

💡 Hint

Refer to key_moments about the effect of 'annot=True' in the heatmap

Concept Snapshot

Heatmaps for correlation:
- Use data.corr() to get correlation matrix
- Use sns.heatmap() to visualize matrix
- Colors show strength and direction (red=positive, blue=negative)
- annot=True shows numbers on heatmap
- Helps quickly see relationships between variables

Full Transcript

We start with a dataset containing columns of numbers. We calculate the correlation matrix using data.corr(), which shows how each variable relates to others. Then we create a heatmap using seaborn's heatmap function to visualize these correlations as colors. Positive correlations appear red, negative blue, and the diagonal is always 1 because variables correlate perfectly with themselves. Adding annot=True shows the exact correlation numbers on the heatmap squares. This visual helps us quickly understand which variables move together or oppositely.

Practice

1. What does a heatmap of correlation typically show in data analysis?

easy

A. The total sum of all numerical columns

B. The frequency of each value in a dataset

C. The order of rows in a DataFrame

D. The strength and direction of relationships between variables

Solution

1. Step 1: Understand correlation meaning

   Correlation measures how two variables move together, either positively or negatively.

2. Step 2: Relate heatmap to correlation

   A heatmap uses colors to show these correlation strengths and directions between variables.

3. Final Answer:

   The strength and direction of relationships between variables -> Option D

4. Quick Check:

   Heatmap = Correlation strength/direction [OK]

Hint: Heatmaps color-code relationships between variables [OK]

Common Mistakes:

• Confusing correlation with frequency counts
• Thinking heatmaps show raw data values
• Assuming heatmaps show data order

2. Which of the following is the correct way to create a heatmap of correlations using seaborn in Python?

easy

A. sns.heatmap(data.corr())

B. sns.heatmap(data.corr)

C. sns.heatmap(corr(data))

D. sns.heatmap(data.correlation())

Solution

1. Step 1: Recall pandas correlation method

   In pandas, correlation is calculated by calling data.corr() with parentheses.

2. Step 2: Use seaborn heatmap correctly

   Seaborn's heatmap() accepts a matrix like the correlation matrix from data.corr().

3. Final Answer:

   sns.heatmap(data.corr()) -> Option A

4. Quick Check:

   Use parentheses for corr() method [OK]

Hint: Use data.corr() with parentheses inside sns.heatmap() [OK]

Common Mistakes:

• Omitting parentheses after corr
• Using non-existent corr() functions
• Passing raw data instead of correlation matrix

3. Given the following code, what will be the output of corr_matrix?

import pandas as pd
import numpy as np
data = pd.DataFrame({
  'A': [1, 2, 3, 4],
  'B': [4, 3, 2, 1],
  'C': [1, 3, 5, 7]
})
corr_matrix = data.corr()

medium

A. An error because data has different ranges

B. A matrix showing negative correlation between A and B, positive between A and C

C. A matrix with only positive correlations

D. A matrix showing all zeros because data is small

Solution

1. Step 1: Analyze data columns

   Column A increases, B decreases (inverse), C increases faster than A.

2. Step 2: Understand correlation signs

   A and B have negative correlation, A and C have positive correlation, B and C negative correlation.

3. Final Answer:

   A matrix showing negative correlation between A and B, positive between A and C -> Option B

4. Quick Check:

   Opposite trends = negative correlation [OK]

Hint: Opposite value trends mean negative correlation [OK]

Common Mistakes:

• Assuming small data means zero correlation
• Ignoring sign of correlation
• Expecting errors from different value ranges

4. You wrote this code to plot a heatmap but get an error:

import seaborn as sns
import pandas as pd
data = pd.DataFrame({'X':[1,2,3],'Y':[4,5,6]})
sns.heatmap(data.corr)

What is the error and how to fix it?

medium

A. DataFrame columns must be numeric for heatmap

B. Seaborn heatmap does not accept correlation matrices

C. Missing parentheses after corr; fix by using data.corr()

D. Missing import matplotlib.pyplot as plt

Solution

1. Step 1: Identify the error cause

   Calling data.corr without parentheses passes a method, not the correlation matrix.

2. Step 2: Correct the method call

   Add parentheses to call the method: data.corr() to get the matrix.

3. Final Answer:

   Missing parentheses after corr; fix by using data.corr() -> Option C

4. Quick Check:

   Method call needs parentheses [OK]

Hint: Always use parentheses to call methods like corr() [OK]

Common Mistakes:

• Passing method instead of result
• Assuming heatmap can't use correlation matrix
• Forgetting to import seaborn

5. You have a DataFrame with columns 'Age', 'Income', 'SpendingScore', and 'Savings'. You want to create a heatmap showing only correlations above 0.5 to focus on strong relationships. Which code snippet correctly creates this filtered heatmap?

hard

A. corr = data.corr(); sns.heatmap(corr.where(corr > 0.5))

B. corr = data.corr(); sns.heatmap(corr > 0.5)

C. corr = data.corr(); sns.heatmap(corr.filter(lambda x: x > 0.5))

D. corr = data.corr(); sns.heatmap(corr.dropna(thresh=0.5))

Solution

1. Step 1: Calculate correlation matrix

   Use data.corr() to get all correlations.

2. Step 2: Filter correlations above 0.5

   Use corr.where(corr > 0.5) to keep values above 0.5 and set others to NaN.

3. Step 3: Plot heatmap with filtered matrix

   Pass the filtered matrix to sns.heatmap() to visualize only strong correlations.

4. Final Answer:

   corr = data.corr(); sns.heatmap(corr.where(corr > 0.5)) -> Option A

5. Quick Check:

   Use where() to filter matrix values [OK]

Hint: Use corr.where(condition) to filter heatmap values [OK]

Common Mistakes:

• Using filter() which works on columns, not matrix values
• Trying to index matrix with boolean mask directly
• Dropping rows instead of masking values