agg() for multiple aggregations in Data Analysis Python - Time & Space Complexity

Time Complexity: agg() for multiple aggregations

O(n * k)

Understanding Time Complexity

When using agg() to perform multiple calculations on data, it is important to understand how the time needed grows as the data gets bigger.

We want to know how the work changes when we ask for many summaries at once.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

data = pd.DataFrame({
    'group': ['A', 'B', 'A', 'B', 'A'],
    'value': [10, 20, 30, 40, 50]
})

result = data.groupby('group').agg({
    'value': ['sum', 'mean', 'max']
})

This code groups data by a column and calculates sum, mean, and max for each group.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: The code loops over each group and then over each aggregation function.
• How many times: For each group, it processes all rows once, then applies each aggregation function.

How Execution Grows With Input

As the number of rows grows, the code must look at more data for each group. Also, more aggregation functions mean more work per group.

Input Size (n)	Approx. Operations
10	About 10 times number of aggregations
100	About 100 times number of aggregations
1000	About 1000 times number of aggregations

Pattern observation: The work grows roughly in direct proportion to the number of rows and the number of aggregation functions.

Final Time Complexity

Time Complexity: O(n * k)

This means the time grows linearly with the number of rows n and the number of aggregation functions k.

Common Mistake

[X] Wrong: "Adding more aggregation functions does not affect the time much because they run together."

[OK] Correct: Each aggregation function needs to process the data separately, so more functions mean more work and more time.

Interview Connect

Understanding how multiple aggregations affect performance helps you explain your data processing choices clearly and shows you know how to handle bigger datasets efficiently.

Self-Check

"What if we used a single aggregation function instead of multiple? How would the time complexity change?"

Practice

1. What does the agg() function do when used on a pandas DataFrame?

easy

A. It merges two DataFrames together.

B. It filters rows based on a condition.

C. It applies one or more aggregation functions to columns and returns summary results.

D. It sorts the DataFrame by column values.

Solution

1. Step 1: Understand the purpose of agg()

   agg() is used to apply aggregation functions like sum, mean, count on DataFrame columns.

2. Step 2: Identify what agg() returns

   It returns a summary DataFrame or Series with the aggregated results for specified columns.

3. Final Answer:

   It applies one or more aggregation functions to columns and returns summary results. -> Option C

4. Quick Check:

   agg() = summary aggregation [OK]

Hint: Remember: agg() summarizes columns with functions fast [OK]

Common Mistakes:

• Thinking agg() filters or sorts data
• Confusing agg() with merge or join
• Expecting agg() to modify original data

2. Which of the following is the correct syntax to apply agg() with multiple functions on a DataFrame column named 'sales'?

easy

A. df['sales'].agg(['sum', 'mean'])

B. df.agg('sales', ['sum', 'mean'])

C. df.agg({'sales': 'sum', 'mean'})

D. df['sales'].agg('sum', 'mean')

Solution

1. Step 1: Check correct agg() syntax for multiple functions

   To apply multiple functions on one column, pass a list of function names inside agg() like agg(['sum', 'mean']).

2. Step 2: Validate the syntax options

   df['sales'].agg(['sum', 'mean']) uses df['sales'].agg(['sum', 'mean']), which is correct. Others have wrong argument order or structure.

3. Final Answer:

   df['sales'].agg(['sum', 'mean']) -> Option A

4. Quick Check:

   Multiple functions in list inside agg() [OK]

Hint: Use a list of functions inside agg() for multiple aggregations [OK]

Common Mistakes:

• Passing multiple functions as separate arguments
• Using dict without proper key-value pairs
• Wrong argument order in agg()

3. Given the DataFrame:

import pandas as pd
data = {'A': [1, 2, 3, 4], 'B': [5, 6, 7, 8]}
df = pd.DataFrame(data)
result = df.agg({'A': ['sum', 'max'], 'B': ['min', 'mean']})
print(result)

What is the output of print(result)?

medium

A. A B
sum 10.0 NaN
max 4.0 NaN
min NaN 5.0
mean NaN 6.5

B. A B
sum 10 5
max 4 8
min 1 5
mean 2.5 6.5

C. A B
sum 10 26
max 4 8
min NaN NaN
mean NaN NaN

D. A B
sum 10 5
max 4 7
min 5 6.5
mean 2.5 6.5

Solution

1. Step 1: Calculate aggregations for column 'A'

   Sum of A = 1+2+3+4 = 10, Max of A = 4.

2. Step 2: Calculate aggregations for column 'B'

   Min of B = 5, Mean of B = (5+6+7+8)/4 = 6.5.

3. Step 3: Understand agg() output format

   Output is a DataFrame with aggregation functions as index and columns as 'A' and 'B'. For functions not applied to a column, NaN appears.

4. Final Answer:

   A B sum 10.0 NaN max 4.0 NaN min NaN 5.0 mean NaN 6.5 -> Option A

5. Quick Check:

   agg() with dict of lists returns DataFrame with NaNs for missing aggregations [OK]

Hint: Calculate each agg function separately, then check output shape [OK]

Common Mistakes:

• Mixing up min and mean values
• Confusing rows and columns in output
• Expecting all functions for all columns

4. What is wrong with this code snippet?

df.agg({'col1': 'sum', 'col2': ['mean', 'max']})

Assuming df has columns 'col1' and 'col2'.

medium

A. You cannot mix single function strings and lists in the same agg dictionary.

B. agg() requires all functions to be passed as a list, even if only one.

C. The column names must be passed as a list, not a dictionary.

D. The syntax is correct; no error will occur.

Solution

1. Step 1: Check if mixing single function and list is allowed in agg()

   agg() accepts a dict where values can be a string (single function) or list (multiple functions).

2. Step 2: Confirm syntax validity

   Passing {'col1': 'sum', 'col2': ['mean', 'max']} is valid and works correctly.

3. Final Answer:

   The syntax is correct; no error will occur. -> Option D

4. Quick Check:

   agg() accepts mixed single and multiple functions [OK]

Hint: agg() dict values can be string or list of functions [OK]

Common Mistakes:

• Assuming all dict values must be lists
• Trying to pass columns as list instead of dict keys
• Confusing agg() with apply() syntax

5. You have a DataFrame df with columns 'score' and 'group'. You want to get the mean and standard deviation of 'score' for each 'group'. Which code correctly uses agg() to do this after grouping?

hard

A. df.groupby('group')['score'].agg('mean', 'std')

B. df.groupby('group').agg({'score': ['mean', 'std']})

C. df.agg({'score': ['mean', 'std']}, groupby='group')

D. df.groupby('score')['group'].agg(['mean', 'std'])

Solution

1. Step 1: Understand grouping and aggregation

   To get stats per group, first group by 'group', then aggregate 'score' with mean and std.

2. Step 2: Check each option

   df.groupby('group')['score'].agg('mean', 'std') passes functions as separate arguments, incorrect syntax. df.groupby('group').agg({'score': ['mean', 'std']}) groups by 'group' and applies agg on 'score' column correctly. df.agg({'score': ['mean', 'std']}, groupby='group') has invalid syntax. df.groupby('score')['group'].agg(['mean', 'std']) groups by 'score' which is wrong.

3. Step 3: Choose best option

   df.groupby('group').agg({'score': ['mean', 'std']}) is the correct way to get mean and std of 'score' per 'group'.

4. Final Answer:

   df.groupby('group').agg({'score': ['mean', 'std']}) -> Option B

5. Quick Check:

   Group by then agg with dict for columns [OK]

Hint: Group first, then agg with dict for multiple functions per column [OK]

Common Mistakes:

• Grouping by wrong column
• Passing groupby as argument to agg()
• Aggregating wrong columns