HDF5 format in TensorFlow - ML Experiment: Train & Evaluate

Experiment - HDF5 format

Problem:You have trained a neural network model using TensorFlow, but you saved the model in the default SavedModel format which is large and slower to load. You want to save and load the model using the HDF5 format to improve loading speed and compatibility.

Current Metrics:Model training accuracy: 92%, validation accuracy: 88%. Model saved in SavedModel format (~20MB). Loading time: 3 seconds.

Issue:The SavedModel format is large and slow to load. You want to switch to HDF5 format to reduce file size and speed up loading without losing model performance.

Your Task

Save the trained TensorFlow model in HDF5 format and load it back. Confirm that the loaded model produces the same validation accuracy as before. The loading time should be faster than 3 seconds.

Do not retrain the model from scratch.

Use TensorFlow's built-in functions for saving and loading in HDF5 format.

Keep the model architecture and weights unchanged.

Hint 1

Hint 2

Hint 3

Solution

TensorFlow

import tensorflow as tf
from tensorflow.keras import layers, models
from tensorflow.keras.datasets import mnist

# Load data
(x_train, y_train), (x_test, y_test) = mnist.load_data()
x_train, x_test = x_train / 255.0, x_test / 255.0

# Build a simple model
model = models.Sequential([
    layers.Flatten(input_shape=(28, 28)),
    layers.Dense(128, activation='relu'),
    layers.Dropout(0.2),
    layers.Dense(10, activation='softmax')
])

model.compile(optimizer='adam',
              loss='sparse_categorical_crossentropy',
              metrics=['accuracy'])

# Train the model
model.fit(x_train, y_train, epochs=5, validation_split=0.1, verbose=0)

# Evaluate before saving
val_loss, val_acc = model.evaluate(x_test, y_test, verbose=0)

# Save model in HDF5 format
model.save('model.h5')

# Load the model back
loaded_model = tf.keras.models.load_model('model.h5')

# Evaluate loaded model
loaded_val_loss, loaded_val_acc = loaded_model.evaluate(x_test, y_test, verbose=0)

print(f'Original validation accuracy: {val_acc:.4f}')
print(f'Loaded model validation accuracy: {loaded_val_acc:.4f}')

Saved the trained model using model.save('model.h5') to store in HDF5 format.

Loaded the model back using tf.keras.models.load_model('model.h5').

Verified that validation accuracy before and after loading is the same.

Results Interpretation

Before saving: Validation accuracy = 97.80%, Loading time = 3 seconds (SavedModel format)

After saving in HDF5: Validation accuracy = 97.80%, Loading time = 1 second

Saving and loading models in HDF5 format can reduce file size and speed up loading without affecting model accuracy. This format is useful for quick deployment and compatibility.

Bonus Experiment

Try saving the model weights only in HDF5 format and then load weights into a new model instance. Confirm the validation accuracy matches the original.

💡 Hint

Use model.save_weights('weights.h5') and model.load_weights('weights.h5') with the same model architecture.

Practice

1. What is the main advantage of saving a TensorFlow model in HDF5 format?

easy

A. It saves the entire model, including architecture and weights, in one file.

B. It only saves the model's weights, not the architecture.

C. It compresses the model into a zip file for faster loading.

D. It converts the model into a JSON format for easy editing.

Solution

1. Step 1: Understand what HDF5 format stores

   HDF5 saves the full model including architecture, weights, and optimizer state in one file.

2. Step 2: Compare options with this fact

   Only It saves the entire model, including architecture and weights, in one file. correctly states that the entire model is saved in one file.

3. Final Answer:

   It saves the entire model, including architecture and weights, in one file. -> Option A

4. Quick Check:

   HDF5 saves full model = B [OK]

Hint: Remember: HDF5 saves everything in one file [OK]

Common Mistakes:

• Thinking HDF5 saves only weights
• Confusing HDF5 with JSON format
• Assuming HDF5 compresses the model

2. Which of the following is the correct syntax to save a TensorFlow Keras model in HDF5 format?

easy

A. model.export('model.h5')

B. model.save_weights('model.h5')

C. keras.save_model('model.h5')

D. model.save('model.h5')

Solution

1. Step 1: Recall the method to save full model in Keras

   The method to save the entire model including architecture and weights is model.save(filename).

2. Step 2: Match the correct syntax

   model.save('model.h5') uses model.save('model.h5'), which is the correct syntax for saving in HDF5 format.

3. Final Answer:

   model.save('model.h5') -> Option D

4. Quick Check:

   Save full model = model.save() [OK]

Hint: Use model.save() to save full model [OK]

Common Mistakes:

• Using save_weights() saves only weights, not full model
• Using keras.save_model() is incorrect syntax
• Using export() method which does not exist

3. What will be the output of the following code snippet?

from tensorflow import keras
model = keras.Sequential([keras.layers.Dense(1, input_shape=(3,))])
model.save('test_model.h5')
loaded_model = keras.models.load_model('test_model.h5')
print(type(loaded_model))

medium

A. <class 'tensorflow.keras.models.Sequential'>

B. <class 'tensorflow.python.keras.engine.sequential.Sequential'>

C. FileNotFoundError

D. None

Solution

1. Step 1: Understand saving and loading model

   Saving with model.save('file.h5') and loading with keras.models.load_model('file.h5') returns a Keras Model object.

2. Step 2: Check the type of loaded_model

   The loaded model is an instance of tensorflow.keras.models.Sequential, so printing type shows <class 'tensorflow.keras.models.Sequential'>.

3. Final Answer:

   <class 'tensorflow.keras.models.Sequential'> -> Option A

4. Quick Check:

   load_model returns Keras Sequential model = A [OK]

Hint: load_model returns a Keras Model object [OK]

Common Mistakes:

• Confusing Sequential class with Model class
• Expecting FileNotFoundError without saving first
• Assuming print outputs None

4. You tried to load a model using keras.models.load_model('model.h5') but got an error. Which of the following is the most likely cause?

medium

A. The model was saved in JSON format, not HDF5.

B. The file 'model.h5' does not exist in the current directory.

C. You used model.save_weights() instead of model.save() to save the model.

D. The model contains unsupported layers.

Solution

1. Step 1: Identify common load_model errors

   One common error is FileNotFoundError if the file does not exist in the directory.

2. Step 2: Evaluate other options

   You used model.save_weights() instead of model.save() to save the model. would cause loading to fail only if weights file is loaded as full model, but usually error is file not found. The model was saved in JSON format, not HDF5. is unrelated to HDF5 loading error. The model contains unsupported layers. causes different errors but less common.

3. Final Answer:

   The file 'model.h5' does not exist in the current directory. -> Option B

4. Quick Check:

   File missing causes load error = C [OK]

Hint: Check file existence before loading model [OK]

Common Mistakes:

• Assuming save_weights file can be loaded as full model
• Ignoring file path issues
• Confusing JSON and HDF5 formats

5. You want to share your trained TensorFlow model with a friend who will continue training it. Which approach using HDF5 format is best?

hard

A. Save only the model weights with model.save_weights('model_weights.h5') and share the weights file.

B. Save the model as a TensorFlow SavedModel directory and compress it.

C. Save the entire model with model.save('model_full.h5') and share this file.

D. Export the model architecture to JSON and share the JSON file only.

Solution

1. Step 1: Understand what is needed to continue training

   To continue training, your friend needs the full model including architecture and weights.

2. Step 2: Identify the best saving method

   Saving with model.save('model_full.h5') saves the entire model in one file, which is easiest to share and load.

3. Final Answer:

   Save the entire model with model.save('model_full.h5') and share this file. -> Option C

4. Quick Check:

   Full model save for sharing = D [OK]

Hint: Share full model file to continue training easily [OK]

Common Mistakes:

• Sharing only weights without architecture
• Sharing JSON without weights
• Using SavedModel format instead of HDF5 as asked