Timezone handling basics in Pandas - Mini Project: Build & Apply

Timezone handling basics

📖 Scenario: You work for a travel company that records flight departure times in UTC. You want to convert these times to the local timezone of the departure city to make it easier for customers to understand.

🎯 Goal: Learn how to create timezone-aware datetime data using pandas, convert between timezones, and display the results.

📋 What You'll Learn

Create a pandas Series with UTC datetime values

Create a timezone variable for the local timezone

Convert the UTC datetime Series to the local timezone

Print the converted datetime Series

💡 Why This Matters

🌍 Real World

Travel companies, airlines, and event planners often need to convert times between UTC and local timezones for scheduling and communication.

💼 Career

Understanding timezone handling is important for data analysts and data scientists working with time series data across different regions.

1

Create a pandas Series with UTC datetime values

Import pandas as pd and create a pandas Series called utc_times with these exact datetime strings: '2024-01-01 12:00', '2024-01-01 15:00', '2024-01-01 18:00'. Convert these strings to datetime with timezone set to UTC using pd.to_datetime(...).tz_localize('UTC').

Pandas

# Import pandas and create utc_times Series with timezone UTC
# Your code here

Hint

Use pd.to_datetime to convert strings to datetime, then use .tz_localize('UTC') to set the timezone.

2

Create a timezone variable for the local timezone

Create a variable called local_tz and set it to the string 'America/New_York' to represent the local timezone.

Pandas

import pandas as pd

utc_times = pd.to_datetime([
    '2024-01-01 12:00',
    '2024-01-01 15:00',
    '2024-01-01 18:00'
]).tz_localize('UTC')

# Create local_tz variable with value 'America/New_York'
# Your code here

Hint

Just assign the string 'America/New_York' to the variable local_tz.

3

Convert the UTC datetime Series to the local timezone

Create a new pandas Series called local_times by converting utc_times to the timezone stored in local_tz using the .tz_convert(local_tz) method.

Pandas

import pandas as pd

utc_times = pd.to_datetime([
    '2024-01-01 12:00',
    '2024-01-01 15:00',
    '2024-01-01 18:00'
]).tz_localize('UTC')

local_tz = 'America/New_York'

# Convert utc_times to local_tz and store in local_times
# Your code here

Hint

Use utc_times.tz_convert(local_tz) to convert the timezone.

4

Print the converted datetime Series

Print the local_times Series to display the datetime values in the local timezone.

Pandas

import pandas as pd

utc_times = pd.to_datetime([
    '2024-01-01 12:00',
    '2024-01-01 15:00',
    '2024-01-01 18:00'
]).tz_localize('UTC')

local_tz = 'America/New_York'

local_times = utc_times.tz_convert(local_tz)

# Print local_times
# Your code here

Hint

Use print(local_times) to show the converted times.

Practice

1. What does the tz_localize method do in pandas when working with timestamps?

easy

A. Converts timestamps from one timezone to another.

B. Adds timezone information to timestamps without any timezone (naive timestamps).

C. Removes timezone information from timestamps.

D. Changes the timestamp format to string.

Solution

1. Step 1: Understand naive timestamps

   Naive timestamps have no timezone information attached.

2. Step 2: Role of tz_localize

   This method adds timezone info to naive timestamps without changing the actual time.

3. Final Answer:

   Adds timezone information to timestamps without any timezone (naive timestamps). -> Option B

4. Quick Check:

   tz_localize adds timezone [OK]

Hint: Remember: localize adds timezone, convert changes it [OK]

Common Mistakes:

• Confusing tz_localize with tz_convert
• Thinking tz_localize changes the time value
• Assuming tz_localize removes timezone info

2. Which of the following is the correct way to convert a timezone-aware pandas datetime Series dt from UTC to US/Eastern timezone?

easy

A. dt.tz_convert('US/Eastern')

B. dt.tz_localize('UTC').tz_convert('US/Eastern')

C. dt.tz_localize('US/Eastern')

D. dt.tz_convert('UTC')

Solution

1. Step 1: Check if dt is timezone-aware

   Since dt is timezone-aware, we use tz_convert to change its timezone.

2. Step 2: Apply correct method

   tz_convert('US/Eastern') converts from current timezone (UTC) to US/Eastern.

3. Final Answer:

   dt.tz_convert('US/Eastern') -> Option A

4. Quick Check:

   Convert aware timestamps with tz_convert [OK]

Hint: Use tz_convert only on timezone-aware timestamps [OK]

Common Mistakes:

• Using tz_localize on already aware timestamps
• Not converting timezone properly
• Confusing order of localization and conversion

3. Given the following code, what will be the output?

import pandas as pd
rng = pd.date_range('2024-01-01 12:00', periods=2, freq='H')
rng_utc = rng.tz_localize('UTC')
rng_est = rng_utc.tz_convert('US/Eastern')
print(rng_est)

medium

A. DatetimeIndex with times 17:00 and 18:00 in US/Eastern timezone

B. DatetimeIndex with times 12:00 and 13:00 in US/Eastern timezone

C. DatetimeIndex with times 07:00 and 08:00 in US/Eastern timezone

D. Error because tz_convert cannot be used after tz_localize

Solution

1. Step 1: Localize naive timestamps to UTC

   The original times are 12:00 and 13:00 UTC after tz_localize('UTC').

2. Step 2: Convert UTC times to US/Eastern timezone

   US/Eastern is UTC-5 in winter, so times become 07:00 and 08:00 with timezone info.

3. Final Answer:

   DatetimeIndex with times 07:00 and 08:00 in US/Eastern timezone -> Option C

4. Quick Check:

   UTC 12:00 -> EST 07:00 [OK]

Hint: Convert UTC to EST subtracts 5 hours [OK]

Common Mistakes:

• Assuming times stay the same after conversion
• Mixing up tz_localize and tz_convert order
• Expecting error instead of valid output

4. What is wrong with this code snippet?

import pandas as pd
dt = pd.to_datetime(['2024-01-01 10:00', '2024-01-01 11:00'])
dt = dt.tz_convert('Europe/London')

medium

A. Cannot use tz_convert on naive timestamps; must localize first.

B. The timezone string 'Europe/London' is invalid.

C. The to_datetime function needs a timezone argument.

D. The code is correct and runs without error.

Solution

1. Step 1: Check timestamp awareness

   The timestamps created by to_datetime are naive (no timezone).

2. Step 2: Understand tz_convert usage

   tz_convert requires timestamps to be timezone-aware; naive timestamps must use tz_localize first.

3. Final Answer:

   Cannot use tz_convert on naive timestamps; must localize first. -> Option A

4. Quick Check:

   tz_convert needs aware timestamps [OK]

Hint: Localize before convert on naive timestamps [OK]

Common Mistakes:

• Trying to convert timezone without localizing
• Assuming to_datetime adds timezone automatically
• Confusing error cause with invalid timezone string

5. You have a pandas Series of timestamps without timezone info representing local times in New York. You want to convert them to UTC timestamps correctly considering daylight saving time. Which sequence of operations should you perform?

hard

A. Convert timestamps to string first, then parse with UTC timezone.

B. Use tz_convert('UTC') directly on naive timestamps.

C. Use tz_localize('UTC') then tz_convert('America/New_York').

D. Use tz_localize('America/New_York') then tz_convert('UTC').

Solution

1. Step 1: Localize naive timestamps to New York timezone

   Since timestamps are local New York times without timezone, use tz_localize('America/New_York') to mark them as such, correctly handling daylight saving.

2. Step 2: Convert localized timestamps to UTC

   Use tz_convert('UTC') to get equivalent UTC times.

3. Final Answer:

   Use tz_localize('America/New_York') then tz_convert('UTC'). -> Option D

4. Quick Check:

   Localize then convert for correct timezone shifts [OK]

Hint: Localize first, then convert to UTC [OK]

Common Mistakes:

• Converting naive timestamps directly
• Localizing to wrong timezone first
• Ignoring daylight saving time effects