Why Ordered categories in Pandas? - Purpose & Use Cases

The Big Idea

What if your data could understand the real meaning behind words like "Low" and "High" automatically?

The Scenario

Imagine you have a list of survey answers like "Low", "Medium", and "High" stored as plain text. You want to analyze trends or sort these answers meaningfully. Doing this by hand means guessing the order or manually rearranging data every time.

The Problem

Manually sorting or comparing these text answers is slow and error-prone. Computers treat them as simple words, so "High" might come before "Low" alphabetically, which is wrong for our scale. This leads to wrong analysis and frustration.

The Solution

Ordered categories let you tell the computer the exact order of these categories. Now, sorting or comparing respects the real-world meaning, making analysis faster, accurate, and automatic.

Before vs After

✗ Before

data['rating'].sort_values()  # sorts alphabetically, not by importance

✓ After

data['rating'] = pd.Categorical(data['rating'], categories=['Low', 'Medium', 'High'], ordered=True)
data['rating'].sort_values()  # sorts by defined order

What It Enables

It enables meaningful sorting and comparison of categorical data that reflects real-world order, unlocking clearer insights.

Real Life Example

In customer feedback, ratings like "Poor", "Fair", "Good", "Excellent" can be analyzed correctly to find trends in satisfaction over time.

Key Takeaways

Manual sorting of categories can lead to wrong order and confusion.

Ordered categories define a clear, meaningful order for data.

This makes analysis and visualization more accurate and insightful.

Practice

1. What does setting ordered=True do when creating a pandas categorical variable?

easy

A. It converts categories to numeric values automatically.

B. It sorts the categories alphabetically.

C. It defines a natural order for the categories, allowing comparisons.

D. It removes duplicate categories from the list.

Solution

1. Step 1: Understand the role of ordered categories

   Ordered categories allow pandas to know the sequence of categories, so it can compare them meaningfully.

2. Step 2: Effect of ordered=True

   Setting ordered=True tells pandas to treat the categories as having a specific order, enabling operations like greater than or less than.

3. Final Answer:

   It defines a natural order for the categories, allowing comparisons. -> Option C

4. Quick Check:

   ordered=True means categories have order [OK]

Hint: Ordered=True means categories can be compared by order [OK]

Common Mistakes:

• Thinking it sorts categories automatically
• Assuming it converts categories to numbers
• Believing it removes duplicates

2. Which of the following is the correct way to create an ordered categorical variable in pandas with categories 'low', 'medium', 'high' in that order?

easy

A. pd.Categorical(['low', 'medium', 'high'], categories=['low', 'medium', 'high'], ordered=True)

B. pd.Categorical(['low', 'tiny', 'high'], categories=['low', 'medium', 'high'], ordered=True)

C. pd.Categorical(['low', 'medium', 'high'], ordered=True, categories=['low', 'medium', 'high'])

D. pd.Categorical(['low', 'medium', 'high'], ordered=False, categories=['low', 'medium', 'high'])

Solution

1. Step 1: Check parameter order and names

   pd.Categorical takes data first, then categories, then ordered flag as keyword arguments.

2. Step 2: Identify correct syntax

   pd.Categorical(['low', 'medium', 'high'], categories=['low', 'medium', 'high'], ordered=True) correctly passes data, categories list, and ordered=True in correct order and names.

3. Final Answer:

   pd.Categorical(['low', 'medium', 'high'], categories=['low', 'medium', 'high'], ordered=True) -> Option A

4. Quick Check:

   Correct syntax uses categories= and ordered=True [OK]

Hint: Use categories= first, then ordered=True keyword [OK]

Common Mistakes:

• Passing ordered=True before categories
• Using ordered=False for ordered categories
• Not matching categories list with data

3. What will be the output of this code?

import pandas as pd
cats = pd.Categorical(['medium', 'low', 'high'], categories=['low', 'medium', 'high'], ordered=True)
print(cats > 'low')

medium

A. [False, True, True]

B. [False, False, True]

C. [True, True, False]

D. [True, False, True]

Solution

1. Step 1: Understand the categories and order

   Categories are ordered as low < medium < high.

2. Step 2: Compare each element to 'low'

   'medium' > 'low' is True, 'low' > 'low' is False, 'high' > 'low' is True.

3. Final Answer:

   [True, False, True] -> Option D

4. Quick Check:

   medium and high are greater than low [OK]

Hint: Compare each category to 'low' using order [OK]

Common Mistakes:

• Confusing category order
• Assuming string comparison instead of categorical
• Mixing True/False positions

4. The following code raises an error. What is the cause?

import pandas as pd
cats = pd.Categorical(['low', 'medium', 'high'], categories=['low', 'medium'], ordered=True)
print(cats > 'medium')

medium

A. Comparison operator '>' is not supported for categorical data.

B. The categories list is missing 'high', causing invalid comparison.

C. Ordered=True cannot be used with categories parameter.

D. The data list has duplicate values.

Solution

1. Step 1: Check categories vs data

   Data contains 'high' but categories only include 'low' and 'medium'.

2. Step 2: Understand effect on comparison

   'high' is not in categories, so comparison with 'medium' fails causing error.

3. Final Answer:

   The categories list is missing 'high', causing invalid comparison. -> Option B

4. Quick Check:

   Data must match categories exactly [OK]

Hint: Ensure all data values are in categories list [OK]

Common Mistakes:

• Thinking ordered=True disallows categories
• Believing '>' is unsupported for ordered categories
• Ignoring missing categories in list

5. You have a DataFrame with a column 'size' containing values 'small', 'medium', 'large', and 'extra large'. You want to sort the DataFrame by 'size' in the natural order small < medium < large < extra large. Which code correctly achieves this?

hard

A. df['size'] = pd.Categorical(df['size'], categories=['small', 'medium', 'large', 'extra large'], ordered=True)
df.sort_values('size')

B. df['size'] = pd.Categorical(df['size'], ordered=True)
df.sort_values('size')

C. df['size'] = pd.Categorical(df['size'], categories=['extra large', 'large', 'medium', 'small'], ordered=True)
df.sort_values('size')

D. df.sort_values('size') # No need to set categories

Solution

1. Step 1: Define ordered categories with correct order

   Set categories=['small', 'medium', 'large', 'extra large'] with ordered=True to define natural order.

2. Step 2: Sort DataFrame by the ordered categorical column

   Use df.sort_values('size') to sort according to the defined order.

3. Final Answer:

   df['size'] = pd.Categorical(df['size'], categories=['small', 'medium', 'large', 'extra large'], ordered=True) df.sort_values('size') -> Option A

4. Quick Check:

   Set ordered categories then sort [OK]

Hint: Set ordered categories with correct order before sorting [OK]

Common Mistakes:

• Not specifying categories order
• Using wrong category order
• Trying to sort without ordered categories