Loss functions (MSE, cross-entropy) in TensorFlow - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to import the mean squared error loss from TensorFlow.

TensorFlow

from tensorflow.keras.losses import [1]

Drag options to blanks, or click blank then click option'

AMeanSquaredError

Bmean_squared_error

CMSE

DCrossEntropy

Attempts:

3 left

💡 Hint

Common Mistakes

Using function names instead of class names for import.

Confusing cross-entropy loss with mean squared error.

The correct import for mean squared error loss function in TensorFlow Keras is MeanSquaredError class.

2fill in blank

medium

Complete the code to compile a model using mean squared error loss.

TensorFlow

model.compile(optimizer='adam', loss=[1], metrics=['accuracy'])

Drag options to blanks, or click blank then click option'

A'mean_squared_error'

B'hinge'

C'cross_entropy'

D'categorical_crossentropy'

Attempts:

3 left

💡 Hint

Common Mistakes

Using cross-entropy loss names when mean squared error is needed.

Forgetting to put the loss name in quotes.

To use mean squared error as the loss function, specify 'mean_squared_error' as the loss parameter.

3fill in blank

hard

Fix the error in the code to use sparse categorical cross-entropy loss correctly.

TensorFlow

model.compile(optimizer='adam', loss=[1], metrics=['accuracy'])

Drag options to blanks, or click blank then click option'

A'mean_squared_error'

B'sparse_categorical_crossentropy'

C'binary_crossentropy'

D'categorical_crossentropy'

Attempts:

3 left

💡 Hint

Common Mistakes

Using categorical cross-entropy with sparse labels.

Using mean squared error for classification tasks.

The correct loss function for sparse categorical labels is 'sparse_categorical_crossentropy'.

4fill in blank

hard

Fill both blanks to create a model with binary cross-entropy loss and sigmoid activation.

TensorFlow

model = tf.keras.Sequential([
    tf.keras.layers.Dense(1, activation=[1])
])
model.compile(optimizer='adam', loss=[2], metrics=['accuracy'])

Drag options to blanks, or click blank then click option'

A'sigmoid'

B'relu'

C'binary_crossentropy'

D'mean_squared_error'

Attempts:

3 left

💡 Hint

Common Mistakes

Using relu activation for output layer in binary classification.

Using mean squared error loss for classification.

Binary classification models use sigmoid activation and binary cross-entropy loss.

5fill in blank

hard

Fill all three blanks to define a custom loss function using mean squared error.

TensorFlow

import tensorflow as tf

def custom_loss(y_true, y_pred):
    return tf.keras.losses.[1](y_true, y_pred)

model.compile(optimizer='adam', loss=[2], metrics=[[3]])

Drag options to blanks, or click blank then click option'

Amean_squared_error

B'mean_squared_error'

C'accuracy'

D'categorical_accuracy'

Attempts:

3 left

💡 Hint

Common Mistakes

Putting quotes around the function call inside custom loss.

Using wrong metric names.

The custom loss calls mean_squared_error function. The compile loss is the string name. Accuracy is a common metric.

Practice

1. Which loss function is best suited for predicting continuous numbers in TensorFlow?

easy

A. Mean Squared Error (MSE)

B. Categorical Cross-Entropy

C. Binary Cross-Entropy

D. Hinge Loss

Solution

1. Step 1: Understand the type of prediction

   Continuous number prediction means the output is a real number, not categories.

2. Step 2: Match loss function to prediction type

   MSE calculates the average squared difference between predicted and true numbers, ideal for continuous values.

3. Final Answer:

   Mean Squared Error (MSE) -> Option A

4. Quick Check:

   Continuous output = MSE [OK]

Hint: Use MSE for numbers, cross-entropy for categories [OK]

Common Mistakes:

• Using cross-entropy for number prediction
• Confusing binary and categorical cross-entropy
• Choosing hinge loss for regression

2. Which of the following is the correct way to use Mean Squared Error loss in TensorFlow?

easy

A. tf.keras.losses.BinaryCrossentropy()

B. tf.losses.CrossEntropy()

C. tf.keras.losses.MeanSquaredError()

D. tf.losses.MSE()

Solution

1. Step 1: Recall TensorFlow loss function syntax

   TensorFlow uses tf.keras.losses.MeanSquaredError() for MSE loss.

2. Step 2: Check options for correct function name and module

   tf.keras.losses.MeanSquaredError() matches the correct full name and module; others are either wrong names or modules.

3. Final Answer:

   tf.keras.losses.MeanSquaredError() -> Option C

4. Quick Check:

   Correct MSE syntax = tf.keras.losses.MeanSquaredError() [OK]

Hint: Use tf.keras.losses for standard loss functions [OK]

Common Mistakes:

• Using tf.losses instead of tf.keras.losses
• Wrong function names like CrossEntropy for MSE
• Missing parentheses when creating loss object

3. What will be the output loss value when using Mean Squared Error loss in TensorFlow for predictions [2.0, 3.0] and true values [1.0, 5.0]?

medium

A. 1.5

B. 3.0

C. 4.0

D. 2.5

Solution

1. Step 1: Calculate squared errors for each prediction

   (2.0 - 1.0)^2 = 1.0, (3.0 - 5.0)^2 = 4.0

2. Step 2: Compute mean of squared errors

   (1.0 + 4.0) / 2 = 2.5

3. Step 3: Verify options

   2.5 matches 2.5, but check carefully: The question asks for output loss value from TensorFlow's MSE which returns mean, so 2.5 is correct.

4. Final Answer:

   2.5 -> Option D

5. Quick Check:

   MSE = mean squared error = 2.5 [OK]

Hint: Square errors, then average them for MSE [OK]

Common Mistakes:

• Summing errors without averaging
• Taking absolute difference instead of squared
• Mixing up predicted and true values

4. Identify the error in this TensorFlow code snippet using categorical cross-entropy loss:

model.compile(optimizer='adam', loss=tf.keras.losses.CategoricalCrossentropy, metrics=['accuracy'])

medium

A. Missing parentheses after CategoricalCrossentropy

B. Wrong optimizer name

C. Metrics should be 'loss' not 'accuracy'

D. Loss function should be a string, not an object

Solution

1. Step 1: Check loss function usage in compile

   Loss functions must be called as objects, so parentheses are needed.

2. Step 2: Identify missing parentheses

   tf.keras.losses.CategoricalCrossentropy is a class; missing () means passing the class, not an instance.

3. Final Answer:

   Missing parentheses after CategoricalCrossentropy -> Option A

4. Quick Check:

   Loss function needs () to create instance [OK]

Hint: Always add () when passing loss function classes [OK]

Common Mistakes:

• Forgetting parentheses on loss functions
• Confusing optimizer names
• Using wrong metric names

5. You have a multi-class classification problem with 4 classes. Which loss function and output layer activation should you use in TensorFlow for best results?

hard

A. Use Mean Squared Error loss with sigmoid activation

B. Use Categorical Cross-Entropy loss with softmax activation

C. Use Binary Cross-Entropy loss with softmax activation

D. Use Hinge loss with linear activation

Solution

1. Step 1: Identify problem type and output requirements

   Multi-class classification with 4 classes requires probabilities summing to 1.

2. Step 2: Match loss and activation functions

   Softmax activation outputs probabilities for each class; categorical cross-entropy measures loss for multi-class.

3. Final Answer:

   Use Categorical Cross-Entropy loss with softmax activation -> Option B

4. Quick Check:

   Multi-class = softmax + categorical cross-entropy [OK]

Hint: Softmax + categorical cross-entropy for multi-class [OK]

Common Mistakes:

• Using MSE for classification
• Using sigmoid for multi-class output
• Using binary cross-entropy for multi-class