Why thorough evaluation ensures reliability in TensorFlow - Test Your Understanding

Practice - 5 Tasks

1fill in blank

easy

Complete the code to compile the TensorFlow model with the correct loss function.

TensorFlow

model.compile(optimizer='adam', loss=[1], metrics=['accuracy'])

Drag options to blanks, or click blank then click option'

A'mse'

B'hinge'

C'mean_absolute_error'

D'sparse_categorical_crossentropy'

Attempts:

3 left

💡 Hint

Common Mistakes

Using a regression loss like 'mse' for classification tasks.

The 'sparse_categorical_crossentropy' loss is used for multi-class classification with integer labels, which fits many classification tasks.

2fill in blank

medium

Complete the code to fit the model on training data for 10 epochs.

TensorFlow

history = model.fit(x_train, y_train, epochs=[1], validation_split=0.2)

Drag options to blanks, or click blank then click option'

A10

B5

C20

D50

Attempts:

3 left

💡 Hint

Common Mistakes

Setting epochs too low or too high without validation.

Training for 10 epochs is a common choice to balance learning and overfitting.

3fill in blank

hard

Fix the error in the code to evaluate the model on test data and get accuracy.

TensorFlow

test_loss, [1] = model.evaluate(x_test, y_test)

Drag options to blanks, or click blank then click option'

Aaccuracy

Bloss

Cacc

Dscore

Attempts:

3 left

💡 Hint

Common Mistakes

Using variable names that don't match the metric names.

The model.evaluate returns loss and metrics in order; here, the second value is accuracy as specified during compile.

4fill in blank

hard

Fill both blanks to create a confusion matrix and print it.

TensorFlow

from sklearn.metrics import [1]
cm = [2](y_test, y_pred)
print(cm)

Drag options to blanks, or click blank then click option'

Aconfusion_matrix

Bclassification_report

Cconfusion_matrix_score

Daccuracy_score

Attempts:

3 left

💡 Hint

Common Mistakes

Using incorrect function names or metrics for confusion matrix.

The confusion_matrix function from sklearn.metrics computes the confusion matrix, which helps evaluate classification reliability.

5fill in blank

hard

Fill all three blanks to calculate precision, recall, and F1-score.

TensorFlow

from sklearn.metrics import [1], [2], [3]
precision = [1](y_test, y_pred)
recall = [2](y_test, y_pred)
f1 = [3](y_test, y_pred)
print(f"Precision: {precision}\nRecall: {recall}\nF1-score: {f1}")

Drag options to blanks, or click blank then click option'

Aprecision_score

Brecall_score

Cf1_score

Daccuracy_score

Attempts:

3 left

💡 Hint

Common Mistakes

Mixing up metric function names or using accuracy instead of F1-score.

Precision, recall, and F1-score are key metrics to evaluate classification models thoroughly for reliability.

Practice

1. Why is it important to evaluate a TensorFlow model on new, unseen data?

easy

A. To increase the number of layers in the model

B. To check if the model can make good predictions on data it hasn't seen before

C. To reduce the size of the model

D. To make the training process faster

Solution

1. Step 1: Understand model evaluation purpose

   Evaluating on new data tests if the model generalizes beyond training examples.

2. Step 2: Identify the correct reason

   Only To check if the model can make good predictions on data it hasn't seen before describes checking model predictions on unseen data, which ensures reliability.

3. Final Answer:

   To check if the model can make good predictions on data it hasn't seen before -> Option B

4. Quick Check:

   Model generalization = Check on new data [OK]

Hint: New data evaluation tests real-world prediction ability [OK]

Common Mistakes:

• Confusing evaluation with training speed
• Thinking evaluation changes model size
• Believing evaluation adds layers

2. Which TensorFlow code snippet correctly evaluates a model on test data stored in test_dataset?

easy

A. model.evaluate(test_dataset)

B. model.train(test_dataset)

C. model.predict(test_dataset)

D. model.fit(test_dataset)

Solution

1. Step 1: Identify evaluation method

   TensorFlow models use evaluate() to measure performance on test data.

2. Step 2: Match code to evaluation

   Only model.evaluate(test_dataset) runs evaluation, others are for training or prediction.

3. Final Answer:

   model.evaluate(test_dataset) -> Option A

4. Quick Check:

   Evaluation method = evaluate() [OK]

Hint: Use evaluate() to check model on test data [OK]

Common Mistakes:

• Using fit() or train() instead of evaluate() for testing
• Confusing predict() with evaluation
• Calling non-existent train() method

3. Given the code below, what will be printed after evaluation?

loss, accuracy = model.evaluate(test_dataset)
print(f"Loss: {loss:.2f}, Accuracy: {accuracy:.2f}")

Assuming the model's loss is 0.35 and accuracy is 0.88 on test data.

medium

A. Loss: 35.00, Accuracy: 0.88

B. Loss: 0.35, Accuracy: 88.00

C. Loss: 0.35, Accuracy: 0.88

D. Loss: 0.0035, Accuracy: 0.88

Solution

1. Step 1: Understand formatting in print statement

   The format specifier {value:.2f} rounds the float to 2 decimal places.

2. Step 2: Apply values to format

   Loss 0.35 and accuracy 0.88 print as "0.35" and "0.88" respectively.

3. Final Answer:

   Loss: 0.35, Accuracy: 0.88 -> Option C

4. Quick Check:

   Float formatting = 2 decimals [OK]

Hint: Check float formatting with .2f for decimals [OK]

Common Mistakes:

• Misreading accuracy as percentage without conversion
• Confusing decimal places
• Assuming loss is multiplied by 100

4. You run model.evaluate(test_dataset) but get an error: ValueError: Data cardinality is ambiguous. What is the likely cause?

medium

A. The test dataset has mismatched input and label sizes

B. The model has too many layers

C. The learning rate is too high

D. The model was not compiled

Solution

1. Step 1: Understand the error meaning

   "Data cardinality is ambiguous" means input and label counts don't match in the dataset.

2. Step 2: Identify cause from options

   Only The test dataset has mismatched input and label sizes describes mismatched input-label sizes causing this error.

3. Final Answer:

   The test dataset has mismatched input and label sizes -> Option A

4. Quick Check:

   Data cardinality error = input-label size mismatch [OK]

Hint: Check input and label counts match in dataset [OK]

Common Mistakes:

• Blaming model architecture for data errors
• Confusing learning rate with data errors
• Ignoring dataset structure before evaluation

5. You trained a TensorFlow model and want to ensure it is reliable before deployment. Which combination of steps best ensures thorough evaluation?

hard

A. Use the same data for training and testing to get best results

B. Train longer on the training data and increase batch size

C. Only check accuracy on training data and save the model

D. Evaluate on a separate test dataset, use multiple metrics like accuracy and loss, and check for overfitting

Solution

1. Step 1: Identify best evaluation practices

   Thorough evaluation means testing on unseen data, using multiple metrics, and checking overfitting.

2. Step 2: Match options to best practices

   Evaluate on a separate test dataset, use multiple metrics like accuracy and loss, and check for overfitting includes all these steps, ensuring reliable model performance.

3. Final Answer:

   Evaluate on a separate test dataset, use multiple metrics like accuracy and loss, and check for overfitting -> Option D

4. Quick Check:

   Thorough evaluation = test data + metrics + overfitting check [OK]

Hint: Use test data and multiple metrics to confirm reliability [OK]

Common Mistakes:

• Evaluating only on training data
• Ignoring overfitting signs
• Using same data for training and testing