Sequential model API in TensorFlow - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the Sequential model API in TensorFlow?

The Sequential model API is a simple way to build neural networks by stacking layers one after another in order. It is easy to use for beginners and works well for models with a single input and output.

beginner

How do you add layers to a Sequential model?

You add layers by calling the add() method on the Sequential model object, passing the layer you want to add, like model.add(tf.keras.layers.Dense(10)).

beginner

What is the difference between model.compile() and model.fit() in the Sequential API?

model.compile() sets up the learning process by specifying the optimizer, loss function, and metrics. model.fit() trains the model on data for a number of epochs.

intermediate

Can the Sequential model API handle models with multiple inputs or outputs?

No, the Sequential model API is designed for simple linear stacks of layers with one input and one output. For multiple inputs or outputs, use the Functional API instead.

beginner

Write a simple Sequential model with one hidden layer of 5 neurons and an output layer of 1 neuron.

import tensorflow as tf
model = tf.keras.Sequential()
model.add(tf.keras.layers.Dense(5, activation='relu', input_shape=(3,)))
model.add(tf.keras.layers.Dense(1))

What does the Sequential model API in TensorFlow represent?

A A tool for data preprocessing

B A graph of layers with multiple inputs

C A linear stack of layers

D A visualization library

The Sequential model API represents a linear stack of layers, where each layer has exactly one input and one output.

Which method is used to add layers to a Sequential model?

A add()

B append()

C add_layer()

D insert()

The method to add layers in a Sequential model is add().

Which method prepares the Sequential model for training by specifying optimizer and loss?

A model.fit()

B model.evaluate()

C model.predict()

D model.compile()

model.compile() sets the optimizer, loss function, and metrics before training.

Can the Sequential API handle models with multiple outputs?

A Yes, easily

B No, it only supports single input and output

C Yes, but only with special layers

D Only if you use callbacks

The Sequential API supports only one input and one output. For multiple outputs, use the Functional API.

What is the correct way to specify the input shape in the first layer of a Sequential model?

A input_shape=(number_of_features,)

B input_shape=[number_of_features]

C input_shape=number_of_features

D input_shape='number_of_features'

The input shape should be a tuple, e.g., input_shape=(3,) for 3 features.

Explain how to build and train a simple neural network using the Sequential model API in TensorFlow.

Think about the steps from model creation to training.

Describe the limitations of the Sequential model API and when you might need to use the Functional API instead.

Consider model complexity and input/output requirements.

Practice

1. What is the main purpose of the Sequential model API in TensorFlow?

easy

A. To visualize the training process of a model

B. To create complex models with multiple inputs and outputs

C. To perform data preprocessing before training

D. To build a model by stacking layers in a linear order

Solution

1. Step 1: Understand the Sequential API purpose

   The Sequential API is designed to build models by stacking layers one after another in a simple linear fashion.

2. Step 2: Compare options with the API's function

   Options B, C, and D describe other functionalities not related to the Sequential API's main purpose.

3. Final Answer:

   To build a model by stacking layers in a linear order -> Option D

4. Quick Check:

   Sequential API = linear stacking of layers [OK]

Hint: Sequential means layers stacked one after another [OK]

Common Mistakes:

• Confusing Sequential with Functional API for complex models
• Thinking Sequential handles data preprocessing
• Assuming Sequential is for visualization

2. Which of the following is the correct way to create a Sequential model with one dense layer of 10 units in TensorFlow?

easy

A. model = Sequential(Dense(10))

B. model = Sequential([Dense(10)])

C. model = Sequential().add(Dense(10))

D. model = Sequential.add(Dense(10))

Solution

1. Step 1: Recall correct Sequential model creation syntax

   The Sequential model can be created by passing a list of layers inside the constructor, e.g., Sequential([Dense(10)]).

2. Step 2: Check each option's syntax validity

   model = Sequential([Dense(10)]) uses the correct list syntax. model = Sequential(Dense(10)) misses the list brackets. model = Sequential().add(Dense(10)) is valid usage but requires assignment to a variable to keep the model reference. model = Sequential.add(Dense(10)) incorrectly calls add() on the class, not an instance.

3. Final Answer:

   model = Sequential([Dense(10)]) -> Option B

4. Quick Check:

   Sequential needs list of layers in constructor [OK]

Hint: Pass layers as a list inside Sequential() [OK]

Common Mistakes:

• Omitting brackets around layers list
• Calling add() on class instead of instance
• Chaining add() without assignment

3. What will be the output shape of the model after running this code?

from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense

model = Sequential([
    Dense(5, input_shape=(10,)),
    Dense(3)
])
print(model.output_shape)

medium

A. (None, 5)

B. (10, 3)

C. (None, 3)

D. (5, 3)

Solution

1. Step 1: Understand input and output shapes in Sequential

   The input shape is (10,), so the first Dense layer outputs (None, 5). The second Dense layer outputs (None, 3) because it has 3 units.

2. Step 2: Identify final output shape

   The model's output shape is the output of the last layer, which is (None, 3). None means batch size is flexible.

3. Final Answer:

   (None, 3) -> Option C

4. Quick Check:

   Last Dense units = output shape [OK]

Hint: Output shape matches last layer units with batch None [OK]

Common Mistakes:

• Confusing input shape with output shape
• Using batch size instead of None
• Mixing layer output shapes

4. Identify the error in this Sequential model code:

from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense

model = Sequential()
model.add(Dense(10, input_shape=(5,)))
model.add(Dense(1))
model.compile(optimizer='adam', loss='mse')
model.fit(x_train, y_train, epochs=5)

medium

A. x_train and y_train are not defined

B. Sequential model cannot use add() method

C. Loss function 'mse' is invalid

D. Missing import for optimizer

Solution

1. Step 1: Check code for missing definitions

   The code uses x_train and y_train in model.fit() but they are not defined anywhere, causing a runtime error.

2. Step 2: Verify other parts

   Optimizer 'adam' and loss 'mse' are valid strings. add() method is valid for Sequential instances. Imports are sufficient.

3. Final Answer:

   x_train and y_train are not defined -> Option A

4. Quick Check:

   Undefined training data causes error [OK]

Hint: Check if training data variables are defined before fit() [OK]

Common Mistakes:

• Assuming loss 'mse' is invalid
• Thinking add() method is not allowed
• Ignoring missing data variables

5. You want to build a Sequential model for a classification task with 3 classes. Which of the following is the best final layer and loss combination?

hard

A. Dense(3, activation='softmax') with loss='categorical_crossentropy'

B. Dense(1, activation='sigmoid') with loss='mean_squared_error'

C. Dense(3, activation='relu') with loss='binary_crossentropy'

D. Dense(3) with loss='sparse_categorical_crossentropy'

Solution

1. Step 1: Understand classification output requirements

   For 3 classes, the final layer should have 3 units with softmax activation to output class probabilities.

2. Step 2: Match appropriate loss function

   For one-hot encoded labels, 'categorical_crossentropy' is the correct loss function to use with softmax output.

3. Final Answer:

   Dense(3, activation='softmax') with loss='categorical_crossentropy' -> Option A

4. Quick Check:

   Softmax + categorical_crossentropy = multi-class classification [OK]

Hint: Use softmax + categorical_crossentropy for multi-class tasks [OK]

Common Mistakes:

• Using sigmoid for multi-class output
• Using mean squared error for classification
• Missing activation in final layer