MultiIndex (hierarchical indexing) in Data Analysis Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a MultiIndex in pandas?

A MultiIndex is a way to have multiple levels of indexing on rows or columns in a pandas DataFrame or Series. It helps organize data with multiple keys, like a table with grouped categories.

beginner

How do you create a MultiIndex from arrays in pandas?

Use pandas.MultiIndex.from_arrays() by passing a list of arrays, each representing one level of the index. For example, pandas.MultiIndex.from_arrays([['A', 'A', 'B'], [1, 2, 1]]) creates two levels.

beginner

What is the benefit of using MultiIndex in data analysis?

MultiIndex allows you to group and organize data by multiple keys, making it easier to slice, aggregate, and analyze complex datasets with hierarchical relationships.

intermediate

How can you select data from a MultiIndex DataFrame?

You can use .loc with tuples to specify values at each level of the index. For example, df.loc[('A', 1)] selects rows where the first level is 'A' and the second level is 1.

beginner

What method can you use to reset a MultiIndex to regular columns?

Use the reset_index() method. It moves the index levels back into columns, turning the MultiIndex into normal DataFrame columns.

What does a MultiIndex allow you to do in pandas?

A Use multiple levels of indexing on rows or columns

B Create multiple DataFrames at once

C Automatically clean missing data

D Convert DataFrame to CSV

A MultiIndex lets you have multiple levels of indexing, which helps organize complex data.

Which function creates a MultiIndex from arrays?

A pandas.MultiIndex.from_arrays()

B pandas.DataFrame.from_arrays()

C pandas.Series.from_arrays()

D pandas.Index.from_arrays()

pandas.MultiIndex.from_arrays() creates a MultiIndex from multiple arrays representing index levels.

How do you select data at multiple index levels in a MultiIndex DataFrame?

A Using .head() method

B Using .iloc with a single integer

C Using .loc with a tuple of index values

D Using .tail() method

Use .loc with a tuple specifying values for each index level to select data in MultiIndex.

What does reset_index() do on a MultiIndex DataFrame?

A Deletes the DataFrame

B Turns index levels into columns

C Sorts the DataFrame

D Filters rows by index

reset_index() moves the MultiIndex levels back into regular columns.

Why use MultiIndex instead of a single index?

A To speed up calculations

B To export data faster

C To reduce memory usage

D To organize data by multiple keys or categories

MultiIndex helps organize data by multiple keys, making complex data easier to analyze.

Explain what a MultiIndex is and how it helps in organizing data.

Think about how you might group data by categories and subcategories.

Describe how to select data from a DataFrame with a MultiIndex.

Consider how you pick a specific item from nested folders.

Practice

1. What is the main purpose of a MultiIndex in pandas?

easy

A. To create plots automatically

B. To label data with multiple levels for better organization

C. To convert data into a list

D. To speed up numerical calculations

Solution

1. Step 1: Understand MultiIndex concept

   MultiIndex allows multiple levels of labels on rows or columns, organizing complex data.

2. Step 2: Compare options

   Only To label data with multiple levels for better organization correctly describes MultiIndex's purpose; others describe unrelated features.

3. Final Answer:

   To label data with multiple levels for better organization -> Option B

4. Quick Check:

   MultiIndex = multiple levels labeling [OK]

Hint: MultiIndex means multiple levels of labels [OK]

Common Mistakes:

• Thinking MultiIndex speeds up calculations
• Confusing MultiIndex with plotting tools
• Believing MultiIndex converts data to lists

2. Which of the following is the correct way to create a MultiIndex from tuples in pandas?

easy

A. pd.MultiIndex.build_tuples([('A', 1), ('B', 2)])

B. pd.MultiIndex.create_tuples([('A', 1), ('B', 2)])

C. pd.MultiIndex.make_tuples([('A', 1), ('B', 2)])

D. pd.MultiIndex.from_tuples([('A', 1), ('B', 2)])

Solution

1. Step 1: Recall pandas MultiIndex creation methods

   The correct method to create MultiIndex from tuples is from_tuples.

2. Step 2: Check method names

   Only pd.MultiIndex.from_tuples([('A', 1), ('B', 2)]) uses the correct method name; others are invalid pandas methods.

3. Final Answer:

   pd.MultiIndex.from_tuples([('A', 1), ('B', 2)]) -> Option D

4. Quick Check:

   Use from_tuples to create MultiIndex from tuples [OK]

Hint: Use from_tuples to create MultiIndex from tuple list [OK]

Common Mistakes:

• Using non-existent methods like create_tuples
• Confusing method names with make_tuples or build_tuples
• Forgetting to import pandas as pd

3. Given the code:

import pandas as pd
index = pd.MultiIndex.from_tuples([('A', 1), ('A', 2), ('B', 1)])
data = pd.Series([10, 20, 30], index=index)
print(data.loc['A'])

What is the output?

medium

A. A 10
A 20
dtype: int64

B. 10
20

C. 1 10
2 20
dtype: int64

D. KeyError

Solution

1. Step 1: Understand MultiIndex and selection

   The MultiIndex has two levels: first level 'A' or 'B', second level numbers. Selecting data.loc['A'] returns all entries where first level is 'A'.

2. Step 2: Check values for 'A'

   Entries with first level 'A' are ('A', 1):10 and ('A', 2):20, so output shows index 1 and 2 with values 10 and 20.

3. Final Answer:

   1 10 2 20 dtype: int64 -> Option C

4. Quick Check:

   data.loc['A'] returns second level index and values [OK]

Hint: Selecting first level returns second level index and values [OK]

Common Mistakes:

• Expecting full tuple index in output
• Getting KeyError by wrong indexing
• Confusing index labels with values

4. What is wrong with this code snippet?

import pandas as pd
index = pd.MultiIndex.from_product([['X', 'Y'], [1, 2]])
data = pd.Series([5, 10, 15], index=index)
print(data)

medium

A. The length of data does not match the MultiIndex length

B. from_product is not a valid MultiIndex method

C. Series cannot have MultiIndex

D. The index should be a list, not MultiIndex

Solution

1. Step 1: Check MultiIndex length

   from_product creates all combinations: 2 (X,Y) * 2 (1,2) = 4 index entries.

2. Step 2: Check data length

   Data has length 3, which does not match 4 index entries, causing a ValueError.

3. Final Answer:

   The length of data does not match the MultiIndex length -> Option A

4. Quick Check:

   Data length must match MultiIndex length [OK]

Hint: Data length must equal MultiIndex length [OK]

Common Mistakes:

• Thinking from_product is invalid
• Believing Series can't have MultiIndex
• Assuming index must be list, not MultiIndex

5. You have sales data for two stores over two years stored as a MultiIndex DataFrame with levels ['Store', 'Year']. How do you select sales data for Store 'B' in year 2023?

hard

A. df.loc[('B', 2023)]

B. df['B'][2023]

C. df.loc[2023, 'B']

D. df.loc['B', [2023]]

Solution

1. Step 1: Understand MultiIndex selection syntax

   To select a row with multiple index levels, use a tuple inside loc with all levels specified.

2. Step 2: Analyze options

   df.loc[('B', 2023)] correctly specifies both levels as a tuple. df.loc[2023, 'B'] uses incorrect order of levels (year before store). df['B'][2023] attempts column access first, causing KeyError. df.loc['B', [2023]] uses a list which pandas interprets as column slice, causing KeyError if no such columns.

3. Final Answer:

   df.loc[('B', 2023)] -> Option A

4. Quick Check:

   Use tuple in loc for MultiIndex row selection [OK]

Hint: Use tuple inside loc to select MultiIndex row [OK]

Common Mistakes:

• Reversing the order of index levels
• Using df['B'] to access rows instead of loc with tuple
• Passing list to loc causing column slice misinterpretation