Batch size and epochs in TensorFlow - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is batch size in machine learning?

Batch size is the number of training examples the model looks at before updating its internal settings (weights). It controls how many samples are processed together in one go.

beginner

Define epoch in the context of training a model.

An epoch is one full pass through the entire training dataset. After one epoch, the model has seen every training example once.

intermediate

How does increasing batch size affect training speed and memory?

Increasing batch size usually speeds up training because more data is processed at once, but it also uses more memory. Very large batches may reduce the model's ability to learn well.

intermediate

What happens if you increase the number of epochs too much?

If you train for too many epochs, the model might memorize the training data and perform poorly on new data. This is called overfitting.

beginner

In TensorFlow, how do you specify batch size and epochs when training a model?

You specify batch size and epochs in the model's fit() method like this: model.fit(x_train, y_train, batch_size=32, epochs=10). This trains the model with batches of 32 samples for 10 full passes over the data.

What does one epoch represent in training?

A One batch of data processed

B One update of model weights

C One pass through the entire training dataset

D One prediction made by the model

An epoch means the model has seen all training samples once.

If batch size is 64, what does this mean?

A The model trains on 64 epochs

B The model updates weights after every 64 samples

C The model sees 64 batches per epoch

D The model uses 64 layers

Batch size defines how many samples are processed before updating the model.

What is a risk of training with too many epochs?

A Overfitting the data

B Less memory usage

C Faster training

D Underfitting the data

Too many epochs can cause the model to memorize training data and not generalize well.

Which of these is true about increasing batch size?

A It decreases the number of epochs needed

B It reduces memory usage

C It always improves model accuracy

D It can speed up training but uses more memory

Larger batch sizes process more data at once, speeding training but using more memory.

How do you set batch size and epochs in TensorFlow's model.fit()?

A model.fit(x_train, y_train, batch_size=32, epochs=10)

B model.train(batch_size=32, epochs=10)

C model.fit(batch=32, epoch=10)

D model.train(x_train, y_train, batch=32, epoch=10)

The correct syntax is model.fit(x_train, y_train, batch_size=32, epochs=10).

Explain in your own words what batch size and epochs mean in training a machine learning model.

Think about how many samples the model sees at once and how many times it sees the whole dataset.

Describe the effects of choosing very large batch sizes and very high numbers of epochs on model training.

Consider both computer resources and model performance.

Practice

1. What does the batch size control during training in TensorFlow?

easy

A. The total number of times the model sees the entire dataset

B. The number of samples processed before the model updates its weights

C. The number of layers in the neural network

D. The learning rate of the optimizer

Solution

1. Step 1: Understand batch size meaning

   Batch size is how many samples the model processes before updating weights.

2. Step 2: Differentiate from epochs

   Epochs count full dataset passes, not batch updates.

3. Final Answer:

   The number of samples processed before the model updates its weights -> Option B

4. Quick Check:

   Batch size = samples per update [OK]

Hint: Batch size = samples per update, epochs = full dataset passes [OK]

Common Mistakes:

• Confusing batch size with epochs
• Thinking batch size controls learning rate
• Mixing batch size with model layers

2. Which of the following is the correct way to set batch size and epochs in TensorFlow's model.fit() method?

easy

A. model.fit(x_train, y_train, batch_size=32, epochs=10)

B. model.fit(x_train, y_train, batch=32, epochs=10)

C. model.fit(x_train, y_train, batchsize=32, epoch=10)

D. model.fit(x_train, y_train, size_batch=32, epochs=10)

Solution

1. Step 1: Recall correct parameter names

   TensorFlow uses batch_size and epochs as parameter names in model.fit().

2. Step 2: Check each option

   Only model.fit(x_train, y_train, batch_size=32, epochs=10) uses correct parameter names exactly.

3. Final Answer:

   model.fit(x_train, y_train, batch_size=32, epochs=10) -> Option A

4. Quick Check:

   Correct parameter names = batch_size, epochs [OK]

Hint: Use exact parameter names: batch_size and epochs [OK]

Common Mistakes:

• Using batch instead of batch_size
• Using epoch instead of epochs
• Misspelling parameter names

3. Consider this code snippet:

history = model.fit(x_train, y_train, batch_size=64, epochs=3, verbose=0)
print(len(history.history['loss']))

What will be the printed output?

medium

A. 64

B. 1

C. 3

D. Number of samples in x_train

Solution

1. Step 1: Understand what history.history['loss'] stores

   It stores loss values per epoch, so its length equals number of epochs.

2. Step 2: Check epochs parameter

   Epochs is set to 3, so length will be 3.

3. Final Answer:

   3 -> Option C

4. Quick Check:

   Length of loss history = epochs = 3 [OK]

Hint: Loss history length equals epochs count [OK]

Common Mistakes:

• Confusing batch size with number of loss entries
• Thinking loss history length equals dataset size
• Assuming one loss per batch instead of per epoch

4. You wrote this code but it runs very slowly:

model.fit(x_train, y_train, batch_size=1, epochs=10)

What is the most likely reason for the slow training?

medium

A. Using batch_size=1 disables GPU acceleration

B. Epochs set to 10 is too low to train well

C. Batch size should be larger than number of epochs

D. Batch size of 1 causes frequent weight updates, slowing training

Solution

1. Step 1: Understand effect of batch size 1

   Batch size 1 means model updates weights after every single sample, causing overhead.

2. Step 2: Evaluate other options

   Epochs=10 is normal; batch size does not need to be larger than epochs; batch size 1 does not disable GPU.

3. Final Answer:

   Batch size of 1 causes frequent weight updates, slowing training -> Option D

4. Quick Check:

   Small batch size = slower training due to many updates [OK]

Hint: Very small batch size slows training due to many updates [OK]

Common Mistakes:

• Thinking epochs number causes slowness
• Believing batch size must be bigger than epochs
• Assuming batch size disables GPU

5. You have a dataset of 10,000 samples. You want to train a model efficiently and avoid overfitting. Which combination of batch size and epochs is best?

hard

A. Batch size = 1000, epochs = 5

B. Batch size = 10, epochs = 1000

C. Batch size = 1, epochs = 10000

D. Batch size = 500, epochs = 50

Solution

1. Step 1: Consider batch size impact

   Large batch sizes (like 1000) speed training and provide stable updates.

2. Step 2: Consider epochs and overfitting

   Too many epochs (like 1000 or 10000) risk overfitting; fewer epochs with larger batches balance training.

3. Step 3: Evaluate options

   Batch size = 1000, epochs = 5 balances batch size and epochs for efficient training and less overfitting.

4. Final Answer:

   Batch size = 1000, epochs = 5 -> Option A

5. Quick Check:

   Balanced batch size and epochs avoid overfitting [OK]

Hint: Large batch + fewer epochs = efficient, less overfitting [OK]

Common Mistakes:

• Choosing very small batch sizes with many epochs
• Ignoring overfitting risk with too many epochs
• Assuming bigger batch size always means better accuracy