groupby() basics in Data Analysis Python - Step-by-Step Execution

Concept Flow - groupby() basics

Start with DataFrame

↓

Choose column(s) to group by

↓

Split data into groups

↓

Apply aggregation function

↓

Combine results into new DataFrame

↓

Output grouped data

The groupby() process splits data by chosen columns, applies a function to each group, then combines the results.

Execution Sample

Data Analysis Python

import pandas as pd

data = {'Team': ['A', 'A', 'B', 'B'], 'Points': [10, 15, 10, 5]}
df = pd.DataFrame(data)
grouped = df.groupby('Team').sum()

This code groups data by 'Team' and sums the 'Points' for each team.

Execution Table

Step	Action	Data State	Result
1	Create DataFrame	{'Team': ['A', 'A', 'B', 'B'], 'Points': [10, 15, 10, 5]}	4 rows with Team and Points columns
2	Group by 'Team'	DataFrame	Groups: 'A' with 2 rows, 'B' with 2 rows
3	Sum Points in each group	Groups	Group 'A': 10+15=25, Group 'B': 10+5=15
4	Combine results	Aggregated sums	New DataFrame with Team as index and Points summed
5	Output grouped data	Grouped DataFrame	Team A: 25 points, Team B: 15 points

💡 All groups processed and summed, output DataFrame ready

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	Final
df	None	{'Team': ['A', 'A', 'B', 'B'], 'Points': [10, 15, 10, 5]}	Same	Same	Same
grouped	None	None	Groups by Team	Sum applied per group	DataFrame with sums

Key Moments - 2 Insights

Why does groupby() create groups before applying sum()?

groupby() first splits the data into groups based on the column, then sum() is applied to each group separately, as shown in execution_table step 3.

Is the original DataFrame changed after groupby()?

No, the original DataFrame stays the same; groupby() returns a new grouped object, as seen in variable_tracker where df remains unchanged.

Visual Quiz - 3 Questions

Look at the execution table, what is the sum of Points for group 'A' after step 3?

A 15

B 25

C 10

D 35

💡 Hint

Check execution_table row 3 under Result for group 'A' sum

At which step does the data get split into groups?

A Step 1

B Step 3

C Step 2

D Step 4

💡 Hint

Look at execution_table row 2 Action column

If we group by 'Team' and use mean() instead of sum(), what changes in the execution table?

A Step 3 result changes to average Points per group

B Step 2 changes to grouping by Points

C Step 4 combines results differently

D No change at all

💡 Hint

Aggregation function in step 3 affects the result calculation

Concept Snapshot

groupby() basics:
- Use df.groupby('column') to split data into groups
- Apply aggregation like sum(), mean() on groups
- Returns new DataFrame with grouped results
- Original DataFrame stays unchanged
- Useful for summarizing data by categories

Full Transcript

The groupby() function in pandas splits a DataFrame into groups based on one or more columns. Then, you apply an aggregation function like sum() to each group separately. The results combine into a new DataFrame showing the summary per group. The original data does not change. This process helps summarize data by categories, like summing points per team.

Practice

1. What does the groupby() function do in pandas?

easy

A. It splits data into groups based on column values.

B. It sorts the data in ascending order.

C. It removes duplicate rows from the data.

D. It changes the data type of columns.

Solution

1. Step 1: Understand the purpose of groupby()

   The groupby() function is used to split data into groups based on the values in one or more columns.

2. Step 2: Compare with other options

   Sorting, removing duplicates, and changing data types are different operations and not the main function of groupby().

3. Final Answer:

   It splits data into groups based on column values. -> Option A

4. Quick Check:

   groupby() = split data by column [OK]

Hint: Remember: groupby splits data into groups by column values [OK]

Common Mistakes:

• Confusing groupby with sorting or filtering
• Thinking groupby changes data types
• Assuming groupby removes duplicates

2. Which of the following is the correct syntax to group a DataFrame df by the column 'Category'?

easy

A. df.group_by('Category')

B. df.groupby('Category')

C. df.groupby['Category']

D. df.groupby(Category)

Solution

1. Step 1: Recall correct method syntax

   The correct method name is groupby without underscore, called with parentheses and column name as a string.

2. Step 2: Check each option

   The correct syntax is df.groupby('Category'). Incorrect versions include df.group_by('Category') (wrong method name), df.groupby['Category'] (wrong brackets), and df.groupby(Category) (missing quotes).

3. Final Answer:

   df.groupby('Category') -> Option B

4. Quick Check:

   Correct syntax uses parentheses and quotes [OK]

Hint: Use df.groupby('column_name') with quotes and parentheses [OK]

Common Mistakes:

• Using underscore in groupby (group_by)
• Using square brackets instead of parentheses
• Not quoting the column name

3. Given the DataFrame df below, what is the output of df.groupby('Team')['Points'].sum()?

   Team  Points
0  A     10
1  B     15
2  A     5
3  B     10
4  C     7

medium

A. Team
A 20
B 25
C 7
Name: Points, dtype: int64

B. Team
A 10
B 15
C 7
Name: Points, dtype: int64

C. Team
A 15
B 25
C 7
Name: Points, dtype: int64

D. Team
A 5
B 10
C 7
Name: Points, dtype: int64

Solution

1. Step 1: Group data by 'Team'

   The groups are: A with points 10 and 5, B with 15 and 10, C with 7.

2. Step 2: Sum points in each group

   Sum for A = 10 + 5 = 15, for B = 15 + 10 = 25, for C = 7.

3. Final Answer:

   Team A 15 B 25 C 7 Name: Points, dtype: int64 -> Option C

4. Quick Check:

   Sum points per team = 15, 25, 7 [OK]

Hint: Add values in each group to get sum quickly [OK]

Common Mistakes:

• Not summing all values per group
• Mixing group labels and sums
• Using count instead of sum

4. What is wrong with this code snippet?

grouped = df.groupby('Category')
result = grouped.sum['Sales']
print(result)

medium

A. Using square brackets instead of parentheses after sum.

B. Missing quotes around 'Category' in groupby.

C. Calling sum() without parentheses.

D. Using print() incorrectly.

Solution

1. Step 1: Check method call syntax

   The sum function must be called with parentheses: sum(), not accessed with square brackets.

2. Step 2: Verify other parts

   The groupby column is correctly quoted, and print usage is correct.

3. Final Answer:

   Using square brackets instead of parentheses after sum. -> Option A

4. Quick Check:

   sum() needs parentheses, not brackets [OK]

Hint: Call aggregation functions with parentheses like sum() [OK]

Common Mistakes:

• Using brackets instead of parentheses for functions
• Forgetting parentheses after sum
• Misquoting column names

5. You have a DataFrame df with columns 'City', 'Category', and 'Sales'. How do you find the average sales for each city and category combination?

hard

A. df.groupby('City' & 'Category')['Sales'].mean()

B. df.groupby('City', 'Category')['Sales'].mean()

C. df.groupby('City' + 'Category')['Sales'].mean()

D. df.groupby(['City', 'Category'])['Sales'].mean()

Solution

1. Step 1: Group by multiple columns

   To group by both 'City' and 'Category', pass a list of column names: ['City', 'Category'].

2. Step 2: Calculate mean of 'Sales'

   After grouping, select 'Sales' column and apply mean() to get average sales per group.

3. Final Answer:

   df.groupby(['City', 'Category'])['Sales'].mean() -> Option D

4. Quick Check:

   Group by list of columns, then mean() [OK]

Hint: Group by list of columns: df.groupby(['col1','col2']) [OK]

Common Mistakes:

• Passing multiple columns as separate arguments
• Using bitwise AND (&) instead of list
• Using string concatenation (+ ) instead of list