crosstab() for cross-tabulation in Pandas

Introduction

We use crosstab() to see how two or more groups relate by counting how often their values appear together. It helps us understand connections in data easily.

To find how many customers bought different product categories by gender.

To check how many students passed or failed in different classes.

To compare survey answers between age groups and regions.

To see the relationship between job roles and education levels.

To analyze how different marketing campaigns performed across cities.

Syntax

Pandas

import pandas as pd

# Basic crosstab syntax
df_crosstab = pd.crosstab(index=data['column1'], columns=data['column2'], margins=False, normalize=False)

index is the row variable, columns is the column variable.

margins=True adds totals for rows and columns.

Examples

Shows counts of each product bought by gender.

Pandas

import pandas as pd

# Example data
data = pd.DataFrame({
    'Gender': ['Male', 'Female', 'Female', 'Male'],
    'Product': ['A', 'B', 'A', 'B']
})

# Crosstab of Gender vs Product
result = pd.crosstab(index=data['Gender'], columns=data['Product'])
print(result)

Shows that crosstab returns an empty DataFrame if input data is empty.

Pandas

import pandas as pd

# Empty data example
data_empty = pd.DataFrame({'A': [], 'B': []})

result_empty = pd.crosstab(index=data_empty['A'], columns=data_empty['B'])
print(result_empty)

Shows crosstab with only one row and one column.

Pandas

import pandas as pd

# Single element data
data_single = pd.DataFrame({'A': ['X'], 'B': ['Y']})

result_single = pd.crosstab(index=data_single['A'], columns=data_single['B'])
print(result_single)

Adds row and column totals to the crosstab.

Pandas

import pandas as pd

# Using margins to add totals
result_margins = pd.crosstab(index=data['Gender'], columns=data['Product'], margins=True)
print(result_margins)

Sample Program

This program shows how many products each gender bought and includes totals for rows and columns.

Pandas

import pandas as pd

# Create sample data
sales_data = pd.DataFrame({
    'Customer': ['Alice', 'Bob', 'Charlie', 'Diana', 'Evan', 'Fiona'],
    'Gender': ['Female', 'Male', 'Male', 'Female', 'Male', 'Female'],
    'Product': ['Book', 'Pen', 'Book', 'Pen', 'Notebook', 'Book']
})

print('Original Data:')
print(sales_data)

# Create crosstab to count products bought by gender
product_gender_crosstab = pd.crosstab(index=sales_data['Gender'], columns=sales_data['Product'], margins=True)

print('\nCrosstab of Product by Gender with Totals:')
print(product_gender_crosstab)

Important Notes

Time complexity: O(n), where n is the number of rows in the data.

Space complexity: Depends on the number of unique values in the index and columns.

Common mistake: Forgetting to specify the correct columns for index and columns, which can lead to confusing results.

Use crosstab() when you want to count occurrences between categories. For more complex aggregation, consider pivot_table().

Summary

crosstab() counts how often values from two columns appear together.

It helps compare groups easily with simple tables.

You can add totals with margins=True for better summary.

Practice

1. What does the pandas.crosstab() function primarily do?

easy

A. Filters rows based on a condition

B. Sorts data in ascending order

C. Counts how often values from two columns appear together

D. Calculates the mean of numerical columns

Solution

1. Step 1: Understand the purpose of crosstab()

   The crosstab() function creates a table showing frequency counts of combinations of values from two or more columns.

2. Step 2: Compare with other options

   Sorting, calculating mean, and filtering are different operations not done by crosstab().

3. Final Answer:

   Counts how often values from two columns appear together -> Option C

4. Quick Check:

   crosstab() = frequency count [OK]

Hint: Remember: crosstab counts pairs of values [OK]

Common Mistakes:

• Confusing crosstab with sorting or filtering
• Thinking crosstab calculates averages
• Assuming crosstab modifies original data

2. Which of the following is the correct syntax to create a crosstab of columns 'A' and 'B' from DataFrame df?

easy

A. pd.crosstab(df.A, df.B, axis=1)

B. pd.crosstab(df['A'], df['B'])

C. df.crosstab('A', 'B')

D. pd.crosstab(df['A', 'B'])

Solution

1. Step 1: Recall correct crosstab syntax

   The correct syntax is pd.crosstab(df['A'], df['B']) where you pass two series as arguments.

2. Step 2: Identify incorrect options

   pd.crosstab(df.A, df.B, axis=1) wrongly uses axis parameter; df.crosstab('A', 'B') tries to call crosstab as a DataFrame method which doesn't exist; pd.crosstab(df['A', 'B']) passes a tuple incorrectly.

3. Final Answer:

   pd.crosstab(df['A'], df['B']) -> Option B

4. Quick Check:

   pd.crosstab(series1, series2) = correct syntax [OK]

Hint: Use pd.crosstab(series1, series2) syntax [OK]

Common Mistakes:

• Calling crosstab as a DataFrame method
• Passing multiple columns as a tuple incorrectly
• Using wrong parameters like axis

3. Given the DataFrame:

import pandas as pd
data = {'Gender': ['M', 'F', 'F', 'M', 'F'], 'Preference': ['Tea', 'Coffee', 'Tea', 'Coffee', 'Tea']}
df = pd.DataFrame(data)

What is the output of pd.crosstab(df['Gender'], df['Preference'])?

medium

A. Preference Coffee Tea
Gender
F 1 2
M 1 1

B. Preference Coffee Tea
Gender
F 2 1
M 1 1

C. Preference Coffee Tea
Gender
F 1 1
M 2 1

D. Preference Coffee Tea
Gender
F 1 2
M 2 0

Solution

1. Step 1: Count occurrences for each Gender and Preference

   For 'F': Coffee appears once, Tea appears twice. For 'M': Coffee appears once, Tea appears once.

2. Step 2: Construct the crosstab table

   Rows are Gender (F, M), columns are Preference (Coffee, Tea), with counts filled accordingly.

3. Final Answer:

   Preference Coffee Tea Gender F 1 2 M 1 1 -> Option A

4. Quick Check:

   Count values by groups = Preference Coffee Tea Gender F 1 2 M 1 1 [OK]

Hint: Count each group pair carefully for crosstab [OK]

Common Mistakes:

• Mixing up row and column labels
• Counting values incorrectly
• Assuming missing pairs have counts > 0

4. What is wrong with this code snippet?

import pandas as pd
data = {'A': ['x', 'y', 'x'], 'B': ['p', 'q', 'p']}
df = pd.DataFrame(data)
result = pd.crosstab(df['A'], df['B'], margins=True, margin_name='Total')
print(result)

It raises an error. Why?

medium

A. The print statement is missing parentheses

B. You cannot use margins=True with crosstab

C. The DataFrame columns must be numeric for crosstab

D. The parameter name should be margins_name, not margin_name

Solution

1. Step 1: Check parameter names for crosstab()

   The correct parameter to name the totals row/column is margins_name, not margin_name.

2. Step 2: Identify the cause of error

   Using margin_name causes a TypeError because it's an unexpected keyword argument.

3. Final Answer:

   The parameter name should be margins_name, not margin_name -> Option D

4. Quick Check:

   Correct parameter is margins_name [OK]

Hint: Use margins_name, not margin_name for totals [OK]

Common Mistakes:

• Misspelling parameter names
• Thinking crosstab requires numeric columns
• Forgetting parentheses in print (Python 3)

5. You have a DataFrame df with columns 'City', 'Product', and 'Sales'. You want to create a crosstab showing total sales for each city-product pair. Which code correctly achieves this?

hard

A. pd.crosstab(df['City'], df['Product'], values=df['Sales'], aggfunc='sum')

B. pd.crosstab(df['City'], df['Product'], values='Sales', aggfunc='sum')

C. pd.crosstab(df['City'], df['Product'], aggfunc='sum')

D. pd.crosstab(df['City'], df['Product'], values=df['Sales'])

Solution

1. Step 1: Understand crosstab with aggregation

   To aggregate values like sales, use values= with the column and aggfunc= with the aggregation function.

2. Step 2: Check each option

   pd.crosstab(df['City'], df['Product'], values=df['Sales'], aggfunc='sum') correctly passes the sales column and sum function. pd.crosstab(df['City'], df['Product'], values='Sales', aggfunc='sum') passes a string instead of a series for values. pd.crosstab(df['City'], df['Product'], aggfunc='sum') misses values parameter. pd.crosstab(df['City'], df['Product'], values=df['Sales']) misses aggfunc, so it defaults to count.

3. Final Answer:

   pd.crosstab(df['City'], df['Product'], values=df['Sales'], aggfunc='sum') -> Option A

4. Quick Check:

   Use values= and aggfunc= for aggregation [OK]

Hint: Use values=column and aggfunc='sum' for totals [OK]

Common Mistakes:

• Passing column name as string instead of series
• Omitting aggfunc for aggregation
• Expecting crosstab to sum without values parameter