Why time-based analysis reveals trends in Data Analysis Python - Quick Recap

Recall & Review

beginner

What is time-based analysis in data science?

Time-based analysis studies data points collected over time to find patterns, changes, or trends that happen as time passes.

beginner

Why do trends often appear in time-based data?

Because many things change gradually or regularly over time, like sales increasing in summer or website visits rising during holidays, time-based data shows these patterns clearly.

intermediate

How does time-based analysis help in decision making?

It helps by showing how things change over time, so you can predict future events or understand past behavior to make better choices.

beginner

What is seasonality in time-based data?

Seasonality means regular patterns that repeat over fixed periods, like daily, weekly, or yearly cycles, such as more ice cream sales in summer.

beginner

Give an example of a real-life situation where time-based analysis reveals trends.

A store tracking monthly sales might see sales rise every December due to holiday shopping. This trend helps plan inventory and staff.

What does time-based analysis mainly focus on?

A Data changes over time

B Data from different locations

C Data from different categories

D Data without any order

Time-based analysis studies how data changes as time passes.

Which of these is an example of seasonality?

A One-time sale event

B Random daily sales changes

C Sales increasing every December

D Sales dropping suddenly without reason

Seasonality means repeated patterns like higher sales every December.

Why is time-based analysis useful for forecasting?

A It removes all patterns

B It ignores past data

C It only looks at one point in time

D It shows past trends to predict future events

By studying past trends over time, we can guess what might happen next.

Which of these is NOT a reason time-based analysis reveals trends?

A Data points are ordered by time

B Data is collected randomly

C Patterns repeat over time

D Changes happen gradually

Random data collection does not help reveal trends over time.

What kind of data is best for time-based analysis?

A Data with timestamps or dates

B Data without any time info

C Data from different categories only

D Data with missing values only

Time-based analysis needs data with time information to find trends.

Explain why analyzing data over time helps reveal trends.

Think about how sales or weather change during the year.

Describe a real-life example where time-based analysis can improve decisions.

Consider stores, websites, or weather patterns.

Practice

1. Why is time-based analysis important in data science?

easy

A. It removes all missing data automatically.

B. It helps us see how data changes over time to find trends.

C. It ignores the order of data points.

D. It only works with numbers, not dates.

Solution

1. Step 1: Understand the role of time in data

   Time-based analysis focuses on data points collected over time to observe changes.

2. Step 2: Identify the benefit of time-based analysis

   By analyzing data over time, we can detect trends and patterns that are not visible in static data.

3. Final Answer:

   It helps us see how data changes over time to find trends. -> Option B

4. Quick Check:

   Time-based analysis reveals trends = D [OK]

Hint: Time shows how data evolves; trends need time order [OK]

Common Mistakes:

• Thinking time-based analysis ignores data order
• Believing it only works with numbers, not dates
• Assuming it automatically cleans missing data

2. Which of the following is the correct way to convert a column named 'date' to datetime in pandas?

easy

A. df['date'] = convert_to_date(df['date'])

B. df['date'] = datetime(df['date'])

C. df['date'] = pd.datetime(df['date'])

D. df['date'] = pd.to_datetime(df['date'])

Solution

1. Step 1: Recall pandas datetime conversion function

   pandas uses pd.to_datetime() to convert columns to datetime format.

2. Step 2: Check each option for correctness

   df['date'] = pd.to_datetime(df['date']) uses the correct function and syntax. Options B, C, and D use invalid or non-existent functions.

3. Final Answer:

   df['date'] = pd.to_datetime(df['date']) -> Option D

4. Quick Check:

   Use pd.to_datetime() for date conversion = A [OK]

Hint: Use pd.to_datetime() to convert date columns [OK]

Common Mistakes:

• Using datetime() instead of pd.to_datetime()
• Trying pd.datetime() which does not exist
• Assuming a function named convert_to_date exists

3. Given the following code, what will be the output?

import pandas as pd

data = {'date': ['2023-01-01', '2023-01-02', '2023-01-08'], 'value': [10, 20, 30]}
df = pd.DataFrame(data)
df['date'] = pd.to_datetime(df['date'])
df.set_index('date', inplace=True)
weekly_sum = df.resample('W').sum()
print(weekly_sum)

medium

A. A DataFrame with weekly sums: 2023-01-01 sum=10, 2023-01-02 to 2023-01-08 sum=50

B. A DataFrame with daily sums for each date

C. An error because resample needs a column, not index

D. Empty DataFrame because dates are not sorted

Solution

1. Step 1: Understand resample with weekly frequency

   Resampling with 'W' groups data by week ending on Sunday. 2023-01-01 (Sunday) falls in week ending 2023-01-01, 2023-01-02 (Monday) to 2023-01-08 (Sunday) fall in week ending 2023-01-08.

2. Step 2: Calculate sums per week

   First week sum: 10; second week sum: 20 + 30 = 50.

3. Final Answer:

   A DataFrame with weekly sums: 2023-01-01 sum=10, 2023-01-02 to 2023-01-08 sum=50 -> Option A

4. Quick Check:

   Weekly resample sums values correctly = C [OK]

Hint: Resample groups by time; sum adds values per period [OK]

Common Mistakes:

• Thinking resample works on columns instead of index
• Assuming daily sums instead of weekly
• Believing resample requires sorted dates (pandas sorts automatically)

4. What is wrong with this code snippet for time-based analysis?

import pandas as pd
data = {'date': ['2023-01-01', '2023-01-02'], 'value': [5, 10]}
df = pd.DataFrame(data)
df['date'] = pd.to_datetime(df['date'])
df.set_index('date')
weekly_avg = df.resample('W').mean()
print(weekly_avg)

medium

A. resample('W') cannot be used with mean().

B. pd.to_datetime is used incorrectly.

C. The index is not set inplace, so resample fails on original index.

D. DataFrame is missing a 'value' column.

Solution

1. Step 1: Check index setting

   df.set_index('date') returns a new DataFrame but does not change df unless inplace=True is used or reassigned.

2. Step 2: Understand resample requirement

   Resample works on the datetime index. Since index was not set inplace, df still has default integer index, causing wrong grouping.

3. Final Answer:

   The index is not set inplace, so resample fails on original index. -> Option C

4. Quick Check:

   set_index needs inplace=True or reassignment = A [OK]

Hint: Use inplace=True or assign set_index result [OK]

Common Mistakes:

• Forgetting inplace=True when setting index
• Thinking resample works without datetime index
• Assuming mean() is invalid with resample

5. You have daily sales data for a year. You want to find monthly sales trends but notice some days are missing. Which approach best reveals accurate monthly trends?

hard

A. Convert dates to datetime, set as index, then resample monthly with sum(), filling missing days with 0.

B. Ignore missing days and calculate monthly sum directly on raw data.

C. Convert dates to string and group by month substring, then sum values.

D. Use daily data without conversion and average all values.

Solution

1. Step 1: Prepare data with datetime index

   Convert the date column to datetime and set it as the DataFrame index for time-based operations.

2. Step 2: Resample monthly and handle missing days

   Use resample('M').sum() to aggregate monthly sales. Fill missing days with 0 to avoid undercounting.

3. Step 3: Avoid incorrect grouping methods

   Grouping by string substrings or ignoring missing days can cause inaccurate trends.

4. Final Answer:

   Convert dates to datetime, set as index, then resample monthly with sum(), filling missing days with 0. -> Option A

5. Quick Check:

   Proper datetime index + resample + fill missing = B [OK]

Hint: Set datetime index, resample monthly, fill missing with zero [OK]

Common Mistakes:

• Grouping by string instead of datetime index
• Ignoring missing days causing wrong sums
• Not converting dates to datetime before resampling