Binning with cut() and qcut() in Pandas - Step-by-Step Execution

Concept Flow - Binning with cut() and qcut()

Start with numeric data

↓

Choose binning method

↓

Define bins

↓

Assign bins

↓

Analyze binned data

We start with numeric data, choose either cut() for fixed bins or qcut() for quantile-based bins, assign data to bins, then analyze the results.

Execution Sample

Pandas

import pandas as pd

ages = [22, 25, 47, 35, 46, 55, 21, 23, 37, 52]

bins = [20, 30, 40, 50, 60]
labels = ['20-29', '30-39', '40-49', '50-59']

age_bins = pd.cut(ages, bins=bins, labels=labels)

quantile_bins = pd.qcut(ages, q=4, labels=['Q1', 'Q2', 'Q3', 'Q4'])

This code bins ages into fixed ranges using cut(), and into four quantile groups using qcut().

Execution Table

Step	Data Point	cut() Bin	qcut() Quantile Bin
1	22	20-29	Q1
2	25	20-29	Q1
3	47	40-49	Q3
4	35	30-39	Q2
5	46	40-49	Q3
6	55	50-59	Q4
7	21	20-29	Q1
8	23	20-29	Q1
9	37	30-39	Q2
10	52	50-59	Q4
Exit	All data processed	-	-

💡 All data points assigned to bins; execution ends.

Variable Tracker

Variable	Start	After 1	After 2	After 3	After 4	After 5	After 6	After 7	After 8	After 9	After 10	Final
ages	[22,25,47,35,46,55,21,23,37,52]	[25,47,35,46,55,21,23,37,52]	[47,35,46,55,21,23,37,52]	[35,46,55,21,23,37,52]	[46,55,21,23,37,52]	[55,21,23,37,52]	[21,23,37,52]	[23,37,52]	[37,52]	[52]	[]	[]
age_bins	[]	['20-29']	['20-29', '20-29']	['20-29', '20-29', '40-49']	['20-29', '20-29', '40-49', '30-39']	['20-29', '20-29', '40-49', '30-39', '40-49']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59', '20-29']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59', '20-29', '20-29']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59', '20-29', '20-29', '30-39']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59', '20-29', '20-29', '30-39', '50-59']	['20-29', '20-29', '40-49', '30-39', '40-49', '50-59', '20-29', '20-29', '30-39', '50-59']
quantile_bins	[]	['Q1']	['Q1', 'Q1']	['Q1', 'Q1', 'Q3']	['Q1', 'Q1', 'Q3', 'Q2']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4', 'Q1']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4', 'Q1', 'Q1']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4', 'Q1', 'Q1', 'Q2']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4', 'Q1', 'Q1', 'Q2', 'Q4']	['Q1', 'Q1', 'Q3', 'Q2', 'Q3', 'Q4', 'Q1', 'Q1', 'Q2', 'Q4']

Key Moments - 2 Insights

Why do some ages fall into the same bin in cut() but different bins in qcut()?

cut() uses fixed ranges (bins), so ages 22 and 25 both go to '20-29'. qcut() divides data into equal-sized groups (quantiles), so 22 is Q1 and 25 is also Q1 due to the data distribution. See execution_table rows 1-2.

What happens if a data point is exactly on a bin edge in cut()?

By default (right=True), cut() uses (a, b] intervals, so value == b goes into the bin ending at b (upper bin). Set right=False for [a, b). No exact edges in our example.

Visual Quiz - 3 Questions

Look at the execution_table, what bin does the age 37 fall into using cut()?

A 20-29

B 30-39

C 40-49

D 50-59

💡 Hint

Check the row where Data Point is 37 in the cut() Bin column.

At which step does qcut() assign the first data point to Q3?

A Step 4

B Step 2

C Step 3

D Step 5

💡 Hint

Look at qcut() Quantile Bin column in execution_table for the earliest Q3.

If we change bins in cut() to [20, 35, 50, 60], how would the bin for age 35 change?

A It would be in '35-50' bin

B It would be in '30-39' bin

C It would be in '20-29' bin

D It would be in '50-59' bin

💡 Hint

Bins define intervals; with default right=True, 35==35 goes to (20,35], but assuming adjusted labels or right=False for '35-50'.

Concept Snapshot

pandas cut() divides data into fixed bins by ranges.
pandas qcut() divides data into bins with equal counts (quantiles).
Use cut() when you want specific ranges.
Use qcut() when you want balanced groups.
Both return categorical bins for analysis.

Full Transcript

We start with a list of ages. Using pandas cut(), we define fixed bins like 20-29, 30-39, etc., and assign each age to these bins. Using qcut(), we split the data into four equal groups called quantiles labeled Q1 to Q4. Each age is assigned to a bin or quantile based on its value. The execution table shows each age's bin assignments step by step. Variables track how bins fill up as we process each age. Key moments clarify why cut() and qcut() differ and how bin edges are handled. The quiz tests understanding of bin assignments and effects of changing bins. The snapshot summarizes when to use cut() or qcut() for binning numeric data.

Practice

1. What is the main difference between pandas.cut() and pandas.qcut()?

easy

A. cut() creates bins with fixed ranges; qcut() creates bins with equal counts.

B. cut() sorts data; qcut() filters data.

C. cut() works only on integers; qcut() works only on floats.

D. cut() creates equal-sized bins; qcut() creates fixed range bins.

Solution

1. Step 1: Understand cut() behavior

   cut() divides data into bins with fixed numeric ranges you specify.

2. Step 2: Understand qcut() behavior

   qcut() divides data into bins so that each bin has roughly the same number of data points.

3. Final Answer:

   cut() creates bins with fixed ranges; qcut() creates bins with equal counts. -> Option A

4. Quick Check:

   Fixed ranges vs equal counts = C [OK]

Hint: Remember: cut = fixed ranges, qcut = equal-sized groups [OK]

Common Mistakes:

• Confusing fixed ranges with equal counts
• Thinking qcut sorts data instead of binning
• Assuming cut only works on integers

2. Which of the following is the correct syntax to create 3 equal-width bins from a pandas Series data using cut()?

easy

A. pd.cut(data, bins=3)

B. pd.qcut(data, bins=3)

C. pd.cut(data, q=3)

D. pd.qcut(data, q=3)

Solution

1. Step 1: Recall cut() syntax

   cut() uses the parameter bins to specify the number of equal-width bins.

2. Step 2: Identify correct usage

   Using pd.cut(data, bins=3) creates 3 fixed-width bins.

3. Final Answer:

   pd.cut(data, bins=3) -> Option A

4. Quick Check:

   cut with bins=3 = B [OK]

Hint: cut(): bins=N (equal width); qcut(): bins=N (equal count) [OK]

Common Mistakes:

• Using q parameter with cut()
• Confusing cut() and qcut() syntax
• Using bins parameter with qcut()

3. Given the code:

import pandas as pd
values = [10, 20, 30, 40, 50]
bins = pd.cut(values, bins=[0, 25, 50])
print(bins.tolist())

What is the output?

medium

A. ['(0, 25]', '(0, 25]', '(25, 50]', '(25, 50]', 'NaN']

B. ['[0, 25)', '[0, 25)', '[25, 50)', '[25, 50)', '[25, 50)']

C. ['(0, 25]', '(0, 25]', '(25, 50]', '(25, 50]', '(50, 75]']

D. ['(0, 25]', '(0, 25]', '(25, 50]', '(25, 50]', '(25, 50]']

Solution

1. Step 1: Understand bins parameter

   The bins are [0, 25, 50], so intervals (0, 25], (25, 50]. Values <=25 in first, >25 to <=50 in second.

2. Step 2: Assign values to bins

   10, 20 in (0, 25]; 30, 40, 50 in (25, 50].

3. Final Answer:

   ['(0, 25]', '(0, 25]', '(25, 50]', '(25, 50]', '(25, 50]'] -> Option D

4. Quick Check:

   Bins match values = A [OK]

Hint: Check bin edges and which side is inclusive [OK]

Common Mistakes:

• Confusing inclusive side of intervals
• Assuming last bin includes values >50
• Using wrong interval notation

4. What is wrong with this code snippet?

import pandas as pd
values = [1, 2, 3, 4, 5]
bins = pd.qcut(values, bins=3)
print(bins)

medium

A. No error; code runs correctly.

B. Values list must be a pandas Series, not a list.

C. Using 'bins' parameter with qcut causes an error.

D. qcut requires numeric bins, not number of bins.

Solution

1. Step 1: Check qcut parameters

   qcut() accepts q=int or q=array-like to specify quantiles. The parameter bins is not valid for qcut().

2. Step 2: Verify code runs

   The code uses bins=3 which is invalid for qcut() and will raise a TypeError.

3. Final Answer:

   Using 'bins' parameter with qcut causes an error. -> Option C

4. Quick Check:

   qcut uses q= for quantiles, bins= invalid = D [OK]

Hint: qcut uses q= for quantile count, not bins= [OK]

Common Mistakes:

• Thinking bins= invalid for qcut()
• Believing input must be Series
• Confusing parameter requirements

5. You have a DataFrame column df['scores'] with 1000 exam scores ranging from 0 to 100. You want to create 4 groups with roughly equal number of students in each group. Which code correctly creates these groups?

hard

A. df['grade_bins'] = pd.cut(df['scores'], bins=4)

B. df['grade_bins'] = pd.qcut(df['scores'], q=4)

C. df['grade_bins'] = pd.cut(df['scores'], q=4)

D. df['grade_bins'] = pd.qcut(df['scores'], bins=4)

Solution

1. Step 1: Understand goal

   Roughly equal students per group -> equal counts -> qcut().

2. Step 2: Choose correct function and parameters

   qcut(df['scores'], q=4) creates 4 equal-count bins. The parameter bins does not exist for qcut().

3. Final Answer:

   df['grade_bins'] = pd.qcut(df['scores'], q=4) -> Option B

4. Quick Check:

   Equal counts need qcut q=4 = A [OK]

Hint: qcut(..., q=N) for N equal-count groups [OK]

Common Mistakes:

• Using cut() for equal-sized groups
• Confusing bins and nonexistent q parameters
• Using q= with qcut()