to_datetime() conversion in Data Analysis Python - Mini Project: Build & Apply

Convert Strings to Dates with to_datetime()

📖 Scenario: You work in a small business that keeps sales records as text. You want to analyze sales by date, but the dates are stored as words, not real dates. You need to change these text dates into real date values so you can sort and filter them easily.

🎯 Goal: Convert a list of sales dates stored as strings into real date objects using pandas.to_datetime(). This will help you work with dates correctly in your analysis.

📋 What You'll Learn

Create a pandas DataFrame with a column of date strings

Create a variable to hold the date format string

Use pandas to_datetime() with the format string to convert the date strings

Print the DataFrame with the converted dates

💡 Why This Matters

🌍 Real World

Businesses often get dates as text from reports or user input. Converting these to real dates lets them sort, filter, and analyze data by time.

💼 Career

Data analysts and scientists frequently convert date strings to datetime objects to prepare data for time series analysis, reporting, and visualization.

1

Create a DataFrame with date strings

Create a pandas DataFrame called sales_data with one column named 'date' containing these exact strings: '2023-01-15', '2023-02-20', '2023-03-25'.

Data Analysis Python

import pandas as pd
# Create the DataFrame sales_data with the date strings
# Your code here

Hint

Use pd.DataFrame and pass a dictionary with key 'date' and the list of strings as value.

2

Create a date format string

Create a variable called date_format and set it to the string '%Y-%m-%d' which matches the format of the date strings.

Data Analysis Python

import pandas as pd
sales_data = pd.DataFrame({
    'date': ['2023-01-15', '2023-02-20', '2023-03-25']
})
# Create the date_format variable with '%Y-%m-%d'
# Your code here

Hint

The format '%Y-%m-%d' means 4-digit year, 2-digit month, 2-digit day separated by dashes.

3

Convert the date strings to datetime objects

Use pandas.to_datetime() with the sales_data['date'] column and the date_format variable to convert the strings to datetime objects. Save the result back to sales_data['date'].

Data Analysis Python

import pandas as pd
sales_data = pd.DataFrame({
    'date': ['2023-01-15', '2023-02-20', '2023-03-25']
})
date_format = '%Y-%m-%d'
# Convert sales_data['date'] to datetime using to_datetime and date_format
# Your code here

Hint

Use pd.to_datetime() with the format parameter set to date_format.

4

Print the DataFrame with converted dates

Print the sales_data DataFrame to show the dates as datetime objects.

Data Analysis Python

import pandas as pd
sales_data = pd.DataFrame({
    'date': ['2023-01-15', '2023-02-20', '2023-03-25']
})
date_format = '%Y-%m-%d'
sales_data['date'] = pd.to_datetime(sales_data['date'], format=date_format)
# Print the sales_data DataFrame
# Your code here

Hint

Use print(sales_data) to display the DataFrame.

Practice

1. What does the pd.to_datetime() function do in pandas?

easy

A. Calculates the difference between two dates

B. Converts datetime objects into strings

C. Converts strings or numbers into datetime objects

D. Sorts dates in ascending order

Solution

1. Step 1: Understand the function purpose

   pd.to_datetime() is used to convert text or numbers that represent dates into pandas datetime objects.

2. Step 2: Identify the correct description

   Among the options, only converting strings or numbers into datetime objects matches the function's purpose.

3. Final Answer:

   Converts strings or numbers into datetime objects -> Option C

4. Quick Check:

   to_datetime() = Converts to datetime [OK]

Hint: Remember: to_datetime() turns text into dates [OK]

Common Mistakes:

• Thinking it converts dates back to strings
• Confusing it with date difference calculation
• Assuming it sorts dates automatically

2. Which of the following is the correct syntax to convert a column 'date_str' in DataFrame df to datetime using pandas?

easy

A. df['date_str'] = pd.to_datetime(df['date_str'])

B. df.to_datetime('date_str')

C. pd.to_datetime(df.date_str, inplace=true)

D. df['date_str'].to_datetime()

Solution

1. Step 1: Recall correct function usage

   The correct way is to call pd.to_datetime() on the column and assign it back to the DataFrame column.

2. Step 2: Check each option

   df['date_str'] = pd.to_datetime(df['date_str']) correctly uses pd.to_datetime(df['date_str']) and assigns it back. Others misuse syntax or methods.

3. Final Answer:

   df['date_str'] = pd.to_datetime(df['date_str']) -> Option A

4. Quick Check:

   Assign converted column back = df['date_str'] = pd.to_datetime(df['date_str']) [OK]

Hint: Use pd.to_datetime() and assign back to column [OK]

Common Mistakes:

• Calling to_datetime() directly on DataFrame
• Using inplace=true which is invalid here
• Trying to call to_datetime() as a method on Series

3. What will be the output of this code?

import pandas as pd
dates = ['12/11/2023', '01/02/2024']
df = pd.DataFrame({'date': dates})
df['date'] = pd.to_datetime(df['date'], dayfirst=True)
print(df['date'])

medium

A. [Timestamp('2023-12-11'), Timestamp('2024-02-01')]

B. [Timestamp('2023-12-11'), Timestamp('2024-01-02')]

C. [Timestamp('2023-11-12'), Timestamp('2024-01-02')]

D. [Timestamp('2023-11-12'), Timestamp('2024-02-01')]

Solution

1. Step 1: Understand dayfirst=True effect

   With dayfirst=True, the date strings are parsed as day/month/year.

2. Step 2: Convert each date string

   '12/11/2023' becomes 12 Nov 2023 (2023-11-12), '01/02/2024' becomes 1 Feb 2024 (2024-02-01).

3. Final Answer:

   [Timestamp('2023-11-12'), Timestamp('2024-02-01')] -> Option D

4. Quick Check:

   dayfirst=True swaps day and month [OK]

Hint: dayfirst=True means day/month/year format [OK]

Common Mistakes:

• Ignoring dayfirst and assuming month/day/year
• Mixing up which part is day or month
• Confusing output format with input string

4. Identify the error in this code snippet:

import pandas as pd
dates = ['2023-31-12', '2024-01-15']
df = pd.DataFrame({'date': dates})
df['date'] = pd.to_datetime(df['date'], format='%Y-%m-%d')

medium

A. The date format string does not match the input dates

B. pd.to_datetime() cannot convert strings with dashes

C. DataFrame creation syntax is incorrect

D. Missing dayfirst=True parameter

Solution

1. Step 1: Check input date format

   The dates are '2023-31-12' and '2024-01-15', which look like year-day-month format.

2. Step 2: Compare with format string

   The format string '%Y-%m-%d' expects year-month-day, so it does not match the input dates.

3. Final Answer:

   The date format string does not match the input dates -> Option A

4. Quick Check:

   Format string must match input date pattern [OK]

Hint: Match format string exactly to date string pattern [OK]

Common Mistakes:

• Assuming default format works for all date strings
• Using wrong format codes for day and month
• Ignoring error messages about parsing failure

5. You have a DataFrame with a column 'date_str' containing dates in mixed formats like '2023/12/31', '31-01-2024', and 'Feb 15, 2024'. How can you convert this column to datetime correctly?

hard

A. Manually split and parse each date format before conversion

B. Use pd.to_datetime(df['date_str'], errors='coerce') without format to parse mixed formats

C. Use df['date_str'].astype('datetime64') to convert directly

D. Use pd.to_datetime(df['date_str'], format='%Y/%m/%d') to parse all dates

Solution

1. Step 1: Understand mixed date formats challenge

   Mixed formats cannot be parsed with a single fixed format string.

2. Step 2: Use flexible parsing with errors='coerce'

   Calling pd.to_datetime() without a format lets pandas try multiple formats. Using errors='coerce' converts unparseable dates to NaT safely.

3. Step 3: Avoid rigid format or manual splitting

   Using a fixed format or manual splitting is inefficient and error-prone.

4. Final Answer:

   Use pd.to_datetime(df['date_str'], errors='coerce') without format to parse mixed formats -> Option B

5. Quick Check:

   Flexible parsing with errors='coerce' handles mixed dates [OK]

Hint: Omit format and use errors='coerce' for mixed date formats [OK]

Common Mistakes:

• Forcing a single format on mixed date strings
• Using astype('datetime64') which fails on strings
• Trying to manually parse each format separately