Date feature extraction in Data Analysis Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is Date feature extraction in data analysis?

Date feature extraction means taking a date and pulling out useful parts like the year, month, day, or weekday to help understand or predict patterns.

beginner

How can you extract the month from a date column in Python using pandas?

Use df['date_column'].dt.month to get the month number (1 to 12) from each date in the column.

beginner

Why might extracting the weekday from a date be useful in data analysis?

Weekdays can show patterns like higher sales on weekends or different behaviors on weekdays, helping models learn better.

intermediate

What pandas attribute helps to extract the day of the week as a name (e.g., Monday)?

Use df['date_column'].dt.day_name() to get the weekday name from dates.

intermediate

How do you extract the quarter of the year from a date in pandas?

Use df['date_column'].dt.quarter to get the quarter number (1 to 4) from each date.

Which pandas attribute extracts the year from a datetime column?

A dt.year

B dt.month

C dt.day

D dt.hour

The dt.year attribute extracts the year part from datetime values.

What does df['date'].dt.weekday return?

A Year

B Day of the month

C Month number

D Day of the week as a number from 0 (Monday) to 6 (Sunday)

The dt.weekday returns the day of the week as an integer where Monday is 0.

Which extracted date feature can help identify seasonal trends?

A Hour of the day

B Quarter of the year

C Weekday name

D Minute

The quarter of the year groups months into seasons, helping spot seasonal trends.

How do you get the weekday name from a pandas datetime column?

A dt.hour

B dt.weekday()

C dt.day_name()

D dt.month_name()

Use dt.day_name() to get the weekday as a string like 'Monday'.

Why is date feature extraction important in data science?

A It helps convert dates into numbers for models

B It removes missing values

C It cleans text data

D It creates charts automatically

Extracting date parts turns dates into useful numeric or categorical features for models.

Explain how you would extract useful features from a date column in a dataset using pandas.

Think about the parts of a date that might affect your data patterns.

Describe why extracting the weekday or quarter from dates can improve a predictive model.

Consider how time affects human activities or business cycles.

Practice

1. What does the dt.year attribute do when applied to a pandas datetime column?

easy

A. Extracts the year part from each date in the column

B. Extracts the day of the week as a number

C. Converts the date to a string format

D. Calculates the difference between dates

Solution

1. Step 1: Understand pandas datetime accessor

   The dt accessor allows extraction of date parts from datetime columns.

2. Step 2: Identify what dt.year extracts

   dt.year extracts the year component from each datetime value.

3. Final Answer:

   Extracts the year part from each date in the column -> Option A

4. Quick Check:

   dt.year = year extraction [OK]

Hint: Remember dt.year gives the year number from dates [OK]

Common Mistakes:

• Confusing dt.year with dt.day or dt.month
• Thinking dt.year converts dates to strings
• Assuming dt.year calculates date differences

2. Which of the following is the correct syntax to extract the month from a pandas datetime column named df['date']?

easy

A. df['date'].month

B. df['date'].dt.month

C. df['date'].get_month()

D. df['date'].extract('month')

Solution

1. Step 1: Recall pandas datetime accessor usage

   To extract date parts, pandas requires the dt accessor before the attribute.

2. Step 2: Identify correct syntax for month extraction

   The correct syntax is df['date'].dt.month. Other options are invalid methods or missing dt.

3. Final Answer:

   df['date'].dt.month -> Option B

4. Quick Check:

   Use dt.month to get month [OK]

Hint: Use .dt before date parts like month or day [OK]

Common Mistakes:

• Omitting .dt accessor
• Using non-existent methods like get_month()
• Trying to extract with extract('month')

3. Given the following code, what will be the output?

import pandas as pd
dates = pd.to_datetime(['2023-01-15', '2023-07-04', '2023-12-31'])
df = pd.DataFrame({'date': dates})
df['day_of_week'] = df['date'].dt.dayofweek
print(df['day_of_week'].tolist())

medium

A. [6, 1, 0]

B. [0, 1, 6]

C. [6, 2, 6]

D. [6, 1, 6]

Solution

1. Step 1: Convert dates to day of week numbers

   Using dt.dayofweek, Monday=0 ... Sunday=6. Dates: 2023-01-15 is Sunday (6), 2023-07-04 is Tuesday (1), 2023-12-31 is Sunday (6).

2. Step 2: List the dayofweek values

   The list is [6, 1, 6].

3. Final Answer:

   [6, 1, 6] -> Option D

4. Quick Check:

   Sunday=6, Tuesday=1, Sunday=6 [OK]

Hint: Remember Monday=0, Sunday=6 for dayofweek [OK]

Common Mistakes:

• Confusing dayofweek with weekday names
• Assuming Sunday=0 instead of 6
• Mixing up dayofweek and day_name()

4. What is wrong with this code snippet to extract the hour from a datetime column df['timestamp']?

df['hour'] = df['timestamp'].hour

medium

A. Missing .dt accessor before .hour

B. The column must be converted to string first

C. The .hour attribute does not exist in pandas

D. The code should use .time.hour instead

Solution

1. Step 1: Check pandas datetime attribute access

   Datetime properties require the dt accessor to access parts like hour.

2. Step 2: Identify missing .dt in code

   The code uses df['timestamp'].hour which is invalid; it should be df['timestamp'].dt.hour.

3. Final Answer:

   Missing .dt accessor before .hour -> Option A

4. Quick Check:

   Use .dt.hour to extract hour [OK]

Hint: Always use .dt before date parts like hour [OK]

Common Mistakes:

• Trying to access .hour directly on Series
• Converting datetime to string unnecessarily
• Using .time.hour which is invalid in pandas

5. You have a pandas DataFrame df with a datetime column 'order_date'. You want to create a new column 'is_weekend' that is True if the order was placed on Saturday or Sunday, and False otherwise. Which code snippet correctly achieves this?

hard

A. df['is_weekend'] = df['order_date'].dt.dayofweek == 6 or 5

B. df['is_weekend'] = df['order_date'].dt.weekday in [5,6]

C. df['is_weekend'] = df['order_date'].dt.dayofweek >= 5

D. df['is_weekend'] = df['order_date'].dt.day_name() in ['Saturday', 'Sunday']

Solution

1. Step 1: Understand dayofweek values for weekend

   In pandas, dt.dayofweek returns 0 for Monday through 6 for Sunday. Weekend days are 5 (Saturday) and 6 (Sunday).

2. Step 2: Check which code correctly marks weekend

   df['is_weekend'] = df['order_date'].dt.dayofweek >= 5 uses df['order_date'].dt.dayofweek >= 5, which is True for 5 and 6, correctly marking weekends. Other options use invalid syntax or incorrect logic.

3. Final Answer:

   df['is_weekend'] = df['order_date'].dt.dayofweek >= 5 -> Option C

4. Quick Check:

   Weekend days are dayofweek >= 5 [OK]

Hint: Weekend days have dayofweek 5 or 6, use >= 5 [OK]

Common Mistakes:

• Using 'in' without vectorized methods
• Using 'or' instead of bitwise operators
• Confusing dayofweek numbers or names