String methods on Series in Data Analysis Python - Mini Project: Build & Apply

String methods on Series

📖 Scenario: You work in a small bookstore. You have a list of book titles, but some titles have extra spaces and inconsistent capitalization. You want to clean up the titles to make them look neat and consistent for your website.

🎯 Goal: You will create a list of book titles, then use string methods on a pandas Series to clean the titles by removing extra spaces and making all letters lowercase.

📋 What You'll Learn

Create a pandas Series from a list of book titles with extra spaces and mixed capitalization

Create a variable to hold the cleaned titles using string methods on the Series

Use the str.strip() method to remove extra spaces

Use the str.lower() method to convert all letters to lowercase

Print the cleaned Series

💡 Why This Matters

🌍 Real World

Cleaning text data is very common in real life, like fixing names, addresses, or product titles before analysis or display.

💼 Career

Data scientists often clean and prepare text data using string methods in pandas to make data consistent and ready for analysis.

1

Create a pandas Series with book titles

Import pandas as pd and create a pandas Series called titles from this list: [" The Great Gatsby", "to Kill a Mockingbird ", "1984", "Pride and Prejudice ", " Moby-Dick"]

Data Analysis Python

# Import pandas and create the Series called titles
# Your code here

Hint

Use pd.Series() to create the Series from the list.

2

Create a variable for cleaned titles

Create a variable called cleaned_titles and set it to titles. You will use this variable to store the cleaned book titles.

Data Analysis Python

import pandas as pd

titles = pd.Series(["  The Great Gatsby", "to Kill a Mockingbird  ", "1984", "Pride and Prejudice  ", "  Moby-Dick"])

# Create cleaned_titles variable
# Your code here

Hint

Just assign titles to cleaned_titles for now.

3

Clean titles by stripping spaces and converting to lowercase

Use string methods on cleaned_titles to remove extra spaces with str.strip() and convert all letters to lowercase with str.lower(). Update cleaned_titles with the cleaned results.

Data Analysis Python

import pandas as pd

titles = pd.Series(["  The Great Gatsby", "to Kill a Mockingbird  ", "1984", "Pride and Prejudice  ", "  Moby-Dick"])

cleaned_titles = titles

# Clean the titles by stripping spaces and converting to lowercase
# Your code here

Hint

Use cleaned_titles.str.strip() first, then .str.lower() to chain the methods.

4

Print the cleaned titles

Print the cleaned_titles Series to see the cleaned book titles.

Data Analysis Python

import pandas as pd

titles = pd.Series(["  The Great Gatsby", "to Kill a Mockingbird  ", "1984", "Pride and Prejudice  ", "  Moby-Dick"])

cleaned_titles = titles
cleaned_titles = cleaned_titles.str.strip().str.lower()

# Print the cleaned_titles Series
# Your code here

Hint

Use print(cleaned_titles) to display the cleaned titles.

Practice

1. What does the .str.lower() method do when applied to a pandas Series?

easy

A. Converts all characters in each string of the Series to lowercase.

B. Removes all whitespace from each string in the Series.

C. Counts the number of characters in each string of the Series.

D. Replaces all digits in each string with a special character.

Solution

1. Step 1: Understand the .str accessor

   The .str accessor allows string methods to be applied element-wise on a pandas Series.

2. Step 2: Identify the effect of .lower()

   The .lower() method converts all uppercase letters in each string to lowercase.

3. Final Answer:

   Converts all characters in each string of the Series to lowercase. -> Option A

4. Quick Check:

   .str.lower() = lowercase conversion [OK]

Hint: Remember .str.lower() makes all letters small [OK]

Common Mistakes:

• Confusing .str.lower() with .str.strip()
• Thinking it removes whitespace
• Assuming it counts characters

2. Which of the following is the correct syntax to check if each string in a pandas Series names contains the substring 'data'?

easy

A. names.contains(str('data'))

B. names.contains('data')

C. names.str.contains(data)

D. names.str.contains('data')

Solution

1. Step 1: Recall the correct usage of string methods on Series

   String methods must be accessed via the .str accessor on a pandas Series.

2. Step 2: Check the correct method call syntax

   The method .contains() requires the substring as a string argument inside quotes.

3. Final Answer:

   names.str.contains('data') -> Option D

4. Quick Check:

   Use .str.contains('substring') for substring check [OK]

Hint: Always use .str before string methods on Series [OK]

Common Mistakes:

• Omitting .str accessor
• Passing variable without quotes
• Using .contains() directly on Series

3. Given the pandas Series fruits = pd.Series(['Apple', 'banana', 'Cherry', 'date']), what is the output of fruits.str.upper()?

medium

A. ['apple', 'banana', 'cherry', 'date']

B. ['APPLE', 'banana', 'CHERRY', 'DATE']

C. ['APPLE', 'BANANA', 'CHERRY', 'DATE']

D. ['Apple', 'banana', 'Cherry', 'date']

Solution

1. Step 1: Understand .str.upper() effect on Series

   The .str.upper() method converts all characters in each string to uppercase.

2. Step 2: Apply .str.upper() to each element

   Each fruit name is converted fully to uppercase: 'Apple' -> 'APPLE', 'banana' -> 'BANANA', etc.

3. Final Answer:

   ['APPLE', 'BANANA', 'CHERRY', 'DATE'] -> Option C

4. Quick Check:

   .str.upper() = all uppercase strings [OK]

Hint: Uppercase method makes all letters capital [OK]

Common Mistakes:

• Thinking it only affects first letter
• Confusing with .str.capitalize()
• Expecting original case unchanged

4. What is wrong with this code snippet?

import pandas as pd
s = pd.Series(['cat', 'dog', 'bird'])
s.str.replace('d', '')

medium

A. It raises a FutureWarning and requires regex=false to avoid it.

B. It works correctly and removes 'd' from each string.

C. It raises a TypeError because 'replace' is not a string method.

D. It returns null instead of a Series.

Solution

1. Step 1: Understand .str.replace() default behavior

   By default, .str.replace() treats the first argument as a regex pattern.

2. Step 2: Identify warning about regex default change

   Recent pandas versions raise a FutureWarning suggesting to specify regex=false when replacing literal strings.

3. Final Answer:

   It raises a FutureWarning and requires regex=false to avoid it. -> Option A

4. Quick Check:

   .str.replace() warns about regex=true default [OK]

Hint: Add regex=false to .str.replace() for literal replace [OK]

Common Mistakes:

• Ignoring FutureWarning
• Assuming no warning occurs
• Expecting error instead of warning

5. You have a pandas Series emails = pd.Series(['[e-mail]', '[e-mail]', '[e-mail]']). How can you extract the domain names (like 'example.com') from each email using string methods?

hard

A. emails.str.extract('(@.*)')

B. emails.str.split('@').str[1]

C. emails.str.replace('.*@', '')

D. emails.str.slice(start=emails.str.find('@')+1)

Solution

1. Step 1: Understand the goal to get text after '@'

   We want the part of each string after the '@' symbol, which is the domain.

2. Step 2: Use .str.split('@') and select the second part

   Splitting each string by '@' creates a list; index 1 is the domain part.

3. Final Answer:

   emails.str.split('@').str[1] -> Option B

4. Quick Check:

   Split by '@' and take second element [OK]

Hint: Split by '@' and pick index 1 for domain [OK]

Common Mistakes:

• Using incorrect regex in .str.extract()
• Forgetting to select index after split
• Using .str.replace() incorrectly