Train-test split for time series in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the main difference between train-test split for time series data and for regular data?

In time series, the data is ordered by time, so the train-test split must keep this order to avoid using future data to predict the past. Regular data can be shuffled before splitting.

beginner

Why should you never randomly shuffle time series data before splitting into train and test sets?

Random shuffling breaks the time order and can cause the model to learn from future information, which is unrealistic and leads to over-optimistic results.

beginner

What is a common method to split time series data into train and test sets?

Use the earliest part of the data for training and the later part for testing, preserving the time order.

intermediate

How does the size of the test set affect time series model evaluation?

A larger test set gives a better estimate of future performance but reduces training data size. A balance is needed to train well and evaluate reliably.

intermediate

What is the purpose of using a rolling or expanding window approach in time series train-test splitting?

These approaches simulate real forecasting by repeatedly training on past data and testing on the next time step, helping to evaluate model stability over time.

Why can't you randomly shuffle time series data before splitting into train and test sets?

A It breaks the time order and leaks future information into training

B It makes the dataset too small

C It increases the training time

D It improves model accuracy

Random shuffling breaks the time order and causes the model to learn from future data, which is not realistic.

What is the typical way to split time series data for training and testing?

A Randomly split 50% train and 50% test

B Use the earliest data for training and the latest data for testing

C Shuffle data then split

D Use only the last data points for training

Time series data must keep time order, so training uses earlier data and testing uses later data.

What does a rolling window approach do in time series model evaluation?

A Ignores time order

B Randomly selects data points for training

C Uses only the first half of data for training

D Trains and tests repeatedly on moving time windows

Rolling window trains on a fixed-size past window and tests on the next time step repeatedly.

What is a risk of using too small a training set in time series?

A Model will overfit perfectly

B Test set will be too large

C Model may not learn enough patterns

D Data will be shuffled

A small training set may not provide enough information for the model to learn well.

Which of these is NOT a valid reason to keep time order in train-test split for time series?

A To increase randomness in training data

B To simulate real forecasting scenarios

C To avoid data leakage from future to past

D To evaluate model on unseen future data

Increasing randomness by shuffling is not valid for time series splitting.

Explain why preserving time order is important when splitting time series data into train and test sets.

Think about how time flows and why using future data to predict past is a problem.

Describe how a rolling window approach works for training and testing time series models.

Imagine sliding a small window over your data to train and test repeatedly.

Practice

1. Why is it important to keep the order of data when doing a train-test split for time series?

easy

A. Because time series data depends on the order of events and future data should not be used to predict past data.

B. Because random shuffling improves model accuracy in time series.

C. Because train and test sets must have the same number of samples.

D. Because test data should always come before train data.

Solution

1. Step 1: Understand time series data nature

   Time series data is sequential and depends on the order of events over time.

2. Step 2: Importance of order in train-test split

   Using future data to predict past data breaks the time flow and causes unrealistic model evaluation.

3. Final Answer:

   Because time series data depends on the order of events and future data should not be used to predict past data. -> Option A

4. Quick Check:

   Keep order to respect time flow = A [OK]

Hint: Always keep time order to avoid future data leakage [OK]

Common Mistakes:

• Randomly shuffling time series data
• Mixing future data into training
• Ignoring time dependency

2. Which of the following Python code snippets correctly splits a time series dataset data into 80% train and 20% test sets while preserving order?

easy

A. train = data[:int(len(data)*0.8)]
test = data[int(len(data)*0.8):]

B. train = data.sample(frac=0.8)
test = data.drop(train.index)

C. train = data[int(len(data)*0.2):]
test = data[:int(len(data)*0.2)]

D. train = data.shuffle().iloc[:80]
test = data.shuffle().iloc[80:]

Solution

1. Step 1: Understand slicing for time series split

   We use slicing to keep the order: first 80% for training, last 20% for testing.

2. Step 2: Check each code snippet

   train = data[:int(len(data)*0.8)] test = data[int(len(data)*0.8):] slices data correctly without shuffling. Options B and D shuffle data, breaking order. train = data[int(len(data)*0.2):] test = data[:int(len(data)*0.2)] reverses train and test.

3. Final Answer:

   train = data[:int(len(data)*0.8)] test = data[int(len(data)*0.8):] -> Option A

4. Quick Check:

   Slicing without shuffle = C [OK]

Hint: Use slicing, not shuffle, to keep time order [OK]

Common Mistakes:

• Using sample() which shuffles data
• Reversing train and test slices
• Shuffling data before splitting

3. Given the following code, what will be the length of test if data has 1000 samples?

split_index = int(len(data) * 0.75)
train = data[:split_index]
test = data[split_index:]

medium

A. 750

B. 250

C. 1000

D. 500

Solution

1. Step 1: Calculate split index

   split_index = int(1000 * 0.75) = 750

2. Step 2: Calculate test length

   test = data[750:] means test has samples from index 750 to 999, total 1000 - 750 = 250 samples.

3. Final Answer:

   250 -> Option B

4. Quick Check:

   Test length = total - train length = 250 [OK]

Hint: Test size = total samples minus train size [OK]

Common Mistakes:

• Confusing train size with test size
• Forgetting zero-based indexing
• Using float instead of int for index

4. You wrote this code to split a time series dataset data:

from sklearn.model_selection import train_test_split
train, test = train_test_split(data, test_size=0.2)

What is the main problem with this approach?

medium

A. test_size=0.2 is too small for time series

B. train and test sets will have overlapping samples

C. train_test_split cannot handle numeric data

D. train_test_split shuffles data by default, breaking time order

Solution

1. Step 1: Understand train_test_split default behavior

   By default, train_test_split shuffles data before splitting.

2. Step 2: Why shuffling is a problem for time series

   Shuffling breaks the time order, causing future data to leak into training, invalidating model evaluation.

3. Final Answer:

   train_test_split shuffles data by default, breaking time order -> Option D

4. Quick Check:

   Default shuffle breaks time order = B [OK]

Hint: train_test_split shuffles unless shuffle=False [OK]

Common Mistakes:

• Ignoring shuffle=True default
• Assuming test_size controls order
• Thinking train_test_split is time-series aware

5. You have daily sales data for 3 years and want to train a model to predict future sales. Which approach correctly splits the data to train on the first 2.5 years and test on the last 0.5 year, ensuring no data leakage?

hard

A. train = data[int(len(data)*0.5):]
test = data[:int(len(data)*0.5)]

B. train = data.sample(frac=0.83)
test = data.drop(train.index)

C. train = data[:int(len(data)*5/6)]
test = data[int(len(data)*5/6):]

D. train = data.shuffle().iloc[:900]
test = data.shuffle().iloc[900:]

Solution

1. Step 1: Calculate split fraction for 2.5 years out of 3 years

   2.5 years / 3 years = 5/6 ≈ 0.8333, so train is first 5/6 of data.

2. Step 2: Use slicing to split data preserving order

   train = data[:int(len(data)*5/6)] test = data[int(len(data)*5/6):] slices data correctly from start to 5/6 for train, and last 1/6 for test, preserving time order and avoiding leakage.

3. Final Answer:

   train = data[:int(len(data)*5/6)] test = data[int(len(data)*5/6):] -> Option C

4. Quick Check:

   Slice first 5/6 for train, last 1/6 for test = A [OK]

Hint: Split by slicing using fraction of total length [OK]

Common Mistakes:

• Using random sampling instead of slicing
• Reversing train and test sets
• Shuffling data before splitting