str.split() for splitting in Pandas - Mini Project: Build & Apply

Splitting Text Data Using str.split() in pandas

📖 Scenario: You work in a small company that keeps customer information in a spreadsheet. One column contains full names, but you want to separate the first and last names into two columns for easier analysis.

🎯 Goal: Learn how to use pandas str.split() to split a column of full names into separate first and last name columns.

📋 What You'll Learn

Create a pandas DataFrame with a column of full names

Create a variable for the separator character

Use str.split() with the separator to split the full names into two columns

Print the resulting DataFrame with the new columns

💡 Why This Matters

🌍 Real World

Splitting full names into first and last names is common in customer data cleaning and preparation for analysis or mailing.

💼 Career

Data analysts and data scientists often need to clean and transform text data using pandas string methods like <code>str.split()</code>.

1

Create a pandas DataFrame with full names

Import pandas as pd and create a DataFrame called df with one column named 'FullName' containing these exact values: 'Alice Johnson', 'Bob Smith', 'Charlie Brown'.

Pandas

# Import pandas and create the DataFrame df with the FullName column
# Your code here

Hint

Use pd.DataFrame() with a dictionary where the key is 'FullName' and the value is a list of the full names.

2

Create a separator variable

Create a variable called separator and set it to a single space character ' ' to use for splitting the full names.

Pandas

import pandas as pd

df = pd.DataFrame({'FullName': ['Alice Johnson', 'Bob Smith', 'Charlie Brown']})

# Create the separator variable with a space character
# Your code here

Hint

The separator is a string with one space: ' '.

3

Split the FullName column into FirstName and LastName

Use df['FullName'].str.split(separator, expand=True) to split the full names into two columns. Assign the result to two new columns in df called 'FirstName' and 'LastName'.

Pandas

import pandas as pd

df = pd.DataFrame({'FullName': ['Alice Johnson', 'Bob Smith', 'Charlie Brown']})

separator = ' '

# Split FullName into FirstName and LastName columns
# Your code here

Hint

Use expand=True to get two separate columns from the split.

4

Print the DataFrame with split names

Write a print(df) statement to display the DataFrame with the new 'FirstName' and 'LastName' columns.

Pandas

import pandas as pd

df = pd.DataFrame({'FullName': ['Alice Johnson', 'Bob Smith', 'Charlie Brown']})

separator = ' '

df[['FirstName', 'LastName']] = df['FullName'].str.split(separator, expand=True)

# Print the DataFrame df
# Your code here

Hint

The output should show the original FullName column plus the new FirstName and LastName columns.

Practice

1. What does the str.split() method do in pandas when applied to a text column?

easy

A. It breaks the text into parts based on a separator.

B. It merges multiple columns into one string.

C. It converts numbers to strings.

D. It removes all spaces from the text.

Solution

1. Step 1: Understand the purpose of str.split()

   The method splits strings into parts using a separator, like spaces or commas.

2. Step 2: Compare with other options

   Options A, B, and C describe different string operations, not splitting.

3. Final Answer:

   It breaks the text into parts based on a separator. -> Option A

4. Quick Check:

   Split means break text apart [OK]

Hint: Split means break text into pieces by separator [OK]

Common Mistakes:

• Confusing split with join or merge
• Thinking split removes spaces instead of using them as separators
• Assuming split converts data types

2. Which of the following is the correct syntax to split a pandas column 'Name' by spaces into multiple columns?

easy

A. df['Name'].split(expand=True)

B. df['Name'].split(' ')

C. df.str.split(' ', 'Name')

D. df['Name'].str.split(' ', expand=True)

Solution

1. Step 1: Recall pandas string method syntax

   Use str.split() on a Series with expand=True to get multiple columns.

2. Step 2: Check each option

   df['Name'].split(' ') misses str, C has wrong argument order, D misses separator argument.

3. Final Answer:

   df['Name'].str.split(' ', expand=True) -> Option D

4. Quick Check:

   Use str.split with expand=True [OK]

Hint: Use df['col'].str.split(sep, expand=True) for columns [OK]

Common Mistakes:

• Forgetting to use .str before split
• Not setting expand=True to get multiple columns
• Passing wrong arguments or order

3. Given the DataFrame:

import pandas as pd
df = pd.DataFrame({'FullName': ['Alice Smith', 'Bob Jones', 'Carol Lee']})
df[['First', 'Last']] = df['FullName'].str.split(' ', expand=True)
print(df)

What will be the output?

medium

A. A DataFrame with columns FullName, First, Last where First and Last contain split names.

B. An error because split cannot create multiple columns.

C. A DataFrame with only First and Last columns, FullName removed.

D. A DataFrame with FullName column unchanged and First column with full names.

Solution

1. Step 1: Understand the split with expand=True

   Splitting 'FullName' by space creates two columns: 'First' and 'Last'.

2. Step 2: Check DataFrame structure after assignment

   Original 'FullName' stays, new columns 'First' and 'Last' are added with split parts.

3. Final Answer:

   A DataFrame with columns FullName, First, Last where First and Last contain split names. -> Option A

4. Quick Check:

   Split with expand=True adds columns [OK]

Hint: expand=True adds new columns, original stays [OK]

Common Mistakes:

• Expecting original column to be removed
• Thinking split returns a list inside one column
• Confusing expand=True effect

4. What is wrong with this code snippet?

df['City', 'State'] = df['Location'].str.split(',', expand=True)

medium

A. expand=True should be False to assign multiple columns.

B. The split separator ',' is incorrect for splitting locations.

C. You cannot assign multiple columns using a tuple as column names like ('City', 'State').

D. The code is correct and will work without errors.

Solution

1. Step 1: Check assignment syntax for multiple columns

   Assigning multiple columns requires a list of column names, not a tuple.

2. Step 2: Identify correct syntax

   Use df[['City', 'State']] = ... with double brackets for multiple columns.

3. Final Answer:

   You cannot assign multiple columns using a tuple as column names like ('City', 'State'). -> Option C

4. Quick Check:

   Use double brackets for multiple columns [OK]

Hint: Use double brackets [[]] to assign multiple columns [OK]

Common Mistakes:

• Using single brackets with tuple for multiple columns
• Confusing expand=True with assignment syntax
• Assuming tuple works like list for columns

5. You have a DataFrame with a column 'Tags' containing strings like 'red,blue,green'. You want to create a new DataFrame where each tag is a separate row linked to the original row index. Which pandas method combined with str.split() helps achieve this?

hard

A. Use str.split(',', expand=True) to create multiple columns.

B. Use str.split(',').explode() to split and expand tags into rows.

C. Use str.split(',').apply(list) to convert tags to lists.

D. Use str.split(',').join() to merge tags back.

Solution

1. Step 1: Understand the goal to expand tags into rows

   Splitting creates lists; explode() turns list elements into separate rows.

2. Step 2: Evaluate options for correct method

   Use str.split(',').explode() to split and expand tags into rows. correctly chains str.split() with explode() to get one tag per row.

3. Final Answer:

   Use str.split(',').explode() to split and expand tags into rows. -> Option B

4. Quick Check:

   Split then explode = rows per item [OK]

Hint: Split then explode to get rows per list item [OK]

Common Mistakes:

• Using expand=True creates columns, not rows
• Forgetting to use explode() after split
• Confusing join() with explode()