Correlation with corr() in Data Analysis Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does the corr() function do in data analysis?

The corr() function calculates the correlation between columns in a dataset, showing how strongly two variables move together.

beginner

What type of values does corr() return?

It returns values between -1 and 1, where 1 means perfect positive correlation, -1 means perfect negative correlation, and 0 means no correlation.

beginner

How can you interpret a correlation value of 0.8 between two variables?

A value of 0.8 means a strong positive relationship; as one variable increases, the other tends to increase too.

beginner

Which Python library provides the corr() function for dataframes?

The pandas library provides the corr() function to calculate correlation between dataframe columns.

beginner

Can corr() handle non-numeric data?

No, corr() only works with numeric data columns. Non-numeric columns are ignored.

What does a correlation value of -1 indicate?

A Perfect positive correlation

B No correlation

C Perfect negative correlation

D Weak correlation

A correlation of -1 means the two variables move exactly in opposite directions.

Which Python library do you use to call corr() on a dataframe?

A NumPy

B pandas

C matplotlib

D scikit-learn

corr() is a method in pandas dataframes.

If two variables have a correlation close to 0, what does it mean?

A Perfect correlation

B Strong negative relationship

C Strong positive relationship

D No linear relationship

A correlation near 0 means no linear relationship between the variables.

What kind of data does corr() require?

A Numeric data

B Date data

C Text data

D Categorical data

corr() works only with numeric data columns.

Which of these correlation values shows the strongest relationship?

A -0.9

B 0.3

C 0.5

D -0.2

The value -0.9 is closest to -1, showing a very strong negative correlation.

Explain what correlation means and how the corr() function helps in data analysis.

Think about how two things can move together or opposite.

Describe how to interpret a correlation matrix output from corr().

Imagine a table showing how each pair of columns relate.

Practice

1. What does the corr() function in pandas do?

easy

A. Counts the number of missing values in a DataFrame

B. Calculates the correlation between numeric columns in a DataFrame

C. Sorts the DataFrame by a specific column

D. Filters rows based on a condition

Solution

1. Step 1: Understand the purpose of corr()

   The corr() function calculates how numeric columns relate to each other in a DataFrame.

2. Step 2: Compare with other options

   Counting missing values, sorting, or filtering are different functions like isna(), sort_values(), and loc.

3. Final Answer:

   Calculates the correlation between numeric columns in a DataFrame -> Option B

4. Quick Check:

   corr() finds relationships [OK]

Hint: Remember: corr() measures how numbers move together [OK]

Common Mistakes:

• Confusing corr() with counting or sorting functions
• Thinking corr() works on non-numeric data
• Assuming corr() changes the DataFrame structure

2. Which of the following is the correct way to calculate correlation between columns in a pandas DataFrame named df?

easy

A. df.corr()

B. df.correlate()

C. df.corrrelation()

D. df.correlation()

Solution

1. Step 1: Recall the exact method name

   The correct pandas method to calculate correlation is corr().

2. Step 2: Check each option

   Options A, B, and C are misspelled or incorrect method names.

3. Final Answer:

   df.corr() -> Option A

4. Quick Check:

   Use df.corr() for correlation [OK]

Hint: Remember exact method name: corr() not correlation [OK]

Common Mistakes:

• Misspelling the method name
• Using non-existent pandas methods
• Confusing corr() with other functions

3. Given the following DataFrame df:

   A  B  C
0  1  2  5
1  2  4  7
2  3  6  9
3  4  8  11

What is the output of df.corr()?

medium

A. {'A': {'A': 1.0, 'B': 1.0, 'C': 1.0}, 'B': {'A': 1.0, 'B': 1.0, 'C': 1.0}, 'C': {'A': 1.0, 'B': 1.0, 'C': 1.0}}

B. {'A': {'A': 1.0, 'B': 0.5, 'C': 0.5}, 'B': {'A': 0.5, 'B': 1.0, 'C': 0.5}, 'C': {'A': 0.5, 'B': 0.5, 'C': 1.0}}

C. {'A': {'A': 1.0, 'B': -1.0, 'C': 0.0}, 'B': {'A': -1.0, 'B': 1.0, 'C': 0.0}, 'C': {'A': 0.0, 'B': 0.0, 'C': 1.0}}

D. Error: corr() cannot be applied to this DataFrame

Solution

1. Step 1: Understand the data pattern

   Columns A, B, and C increase perfectly linearly: B = 2*A, C = 2*A + 3.

2. Step 2: Calculate correlation values

   Since all columns are perfectly linearly related, correlation between any two is 1.0, and correlation with itself is 1.0.

3. Final Answer:

   {'A': {'A': 1.0, 'B': 1.0, 'C': 1.0}, 'B': {'A': 1.0, 'B': 1.0, 'C': 1.0}, 'C': {'A': 1.0, 'B': 1.0, 'C': 1.0}} -> Option A

4. Quick Check:

   Perfect linear relation means correlation = 1 [OK]

Hint: Perfect linear columns have correlation 1 [OK]

Common Mistakes:

• Assuming correlation less than 1 for perfect linear data
• Confusing correlation with covariance
• Thinking corr() raises error on numeric data

4. You run the code below but get an error:

import pandas as pd
df = pd.DataFrame({'X': [1, 2, 3], 'Y': ['a', 'b', 'c']})
print(df.corr(numeric_only=False))

What is the cause of the error?

medium

A. The corr() method is misspelled

B. The DataFrame is empty

C. The DataFrame has non-numeric columns which corr() cannot process

D. The DataFrame columns have missing values

Solution

1. Step 1: Analyze DataFrame columns

   Column 'Y' contains strings, which are non-numeric.

2. Step 2: Understand corr() requirements

   corr() only works on numeric columns; non-numeric columns cause it to ignore or error depending on pandas version.

3. Final Answer:

   The DataFrame has non-numeric columns which corr() cannot process -> Option C

4. Quick Check:

   corr() needs numeric data [OK]

Hint: Check for non-numeric columns before using corr() [OK]

Common Mistakes:

• Assuming corr() works on strings
• Thinking misspelling caused error
• Ignoring data types in DataFrame

5. You have a DataFrame df with columns height, weight, and age. You want to find which two variables have the strongest positive correlation. Which code snippet correctly finds this?

hard

A. corr_matrix = df.corr()
max_corr = corr_matrix.where(corr_matrix < 1).max().max()

B. corr_matrix = df.corr()
max_corr = corr_matrix.where(corr_matrix != 1).min().min()

C. corr_matrix = df.corr()
max_corr = corr_matrix.max().max()

D. corr_matrix = df.corr()
max_corr = corr_matrix.where(corr_matrix != 1).max().max()

Solution

1. Step 1: Calculate correlation matrix

   Use df.corr() to get correlations between all numeric columns.

2. Step 2: Exclude self-correlation (which is 1)

   Use where(corr_matrix != 1) to ignore diagonal 1s, then find the maximum correlation value.

3. Step 3: Find the strongest positive correlation

   Use max().max() to get the highest correlation excluding 1.

4. Final Answer:

   corr_matrix = df.corr() max_corr = corr_matrix.where(corr_matrix != 1).max().max() -> Option D

5. Quick Check:

   Exclude 1, then find max correlation [OK]

Hint: Exclude 1s (self-correlation) before max() [OK]

Common Mistakes:

• Including diagonal 1s in max correlation
• Using min() instead of max()
• Not excluding self-correlation values