Saving and loading models in ML Python - Model Pipeline Trace

Model Pipeline - Saving and loading models

This pipeline shows how a machine learning model is trained, saved to a file, and later loaded back to make predictions without retraining.

Data Flow - 6 Stages

1Data input

1000 rows x 10 columns→Load dataset with 10 features per example→1000 rows x 10 columns

[[5.1, 3.5, 1.4, ..., 0.2], [4.9, 3.0, 1.4, ..., 0.2], ...]

↓

2Train/test split

1000 rows x 10 columns→Split data into 800 training and 200 testing rows→Train: 800 rows x 10 columns, Test: 200 rows x 10 columns

Train sample: [5.1, 3.5, 1.4, ..., 0.2], Test sample: [6.7, 3.1, 4.7, ..., 1.5]

↓

3Model training

800 rows x 10 columns→Train model on training data→Trained model object

Model weights updated after training

↓

4Model saving

Trained model object→Save model to file 'model.pkl'→File 'model.pkl' saved on disk

Binary file storing model parameters

↓

5Model loading

File 'model.pkl'→Load model from file→Loaded model object identical to trained model

Model ready for prediction without retraining

↓

6Prediction

200 rows x 10 columns→Use loaded model to predict on test data→200 rows x 1 column (predicted labels)

[0, 1, 0, 2, 1, ...]

Training Trace - Epoch by Epoch

Loss
1.0 |****
0.8 |****
0.6 |****
0.4 |****
0.2 |****
0.0 +----
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.85	0.60	Model starts learning with moderate accuracy
2	0.65	0.75	Loss decreases and accuracy improves
3	0.50	0.82	Model continues to improve
4	0.40	0.87	Good convergence observed
5	0.35	0.90	Training stabilizes with high accuracy

Prediction Trace - 3 Layers

Layer 1: Input test sample

Layer 2: Model loaded from file

Layer 3: Prediction

Model Quiz - 3 Questions

Why do we save a trained model to a file?

A To reuse the model later without retraining

B To increase the training speed

C To improve the model accuracy

D To reduce the size of the dataset

Key Insight

Saving and loading models allows us to keep the trained knowledge and use it anytime without repeating the training process, saving time and resources.

Practice

1. What is the main purpose of saving a trained machine learning model?

easy

A. To increase the model's training speed

B. To reuse the model later without retraining

C. To improve the model's accuracy automatically

D. To delete the training data after use

Solution

1. Step 1: Understand model saving

   Saving a model stores its learned parameters so it can be reused later.

2. Step 2: Identify the main benefit

   This avoids retraining, saving time and resources.

3. Final Answer:

   To reuse the model later without retraining -> Option B

4. Quick Check:

   Saving = reuse without retraining [OK]

Hint: Saving means keep model for later use without retraining [OK]

Common Mistakes:

• Thinking saving improves accuracy automatically
• Confusing saving with speeding up training
• Believing saving deletes data

2. Which of the following is the correct way to save a Keras model named model to a file called my_model.h5?

easy

A. model.save('my_model.h5')

B. save_model('my_model.h5', model)

C. model.save_model('my_model.h5')

D. save('model', 'my_model.h5')

Solution

1. Step 1: Recall Keras save syntax

   Keras models are saved using model.save(filename).

2. Step 2: Match correct syntax

   model.save('my_model.h5') matches this syntax exactly.

3. Final Answer:

   model.save('my_model.h5') -> Option A

4. Quick Check:

   model.save(filename) saves model [OK]

Hint: Use model.save('filename') to save Keras models [OK]

Common Mistakes:

• Using incorrect function names like save_model or save
• Swapping argument order
• Calling save_model as a method on model

3. What will be the output of the following code snippet?

from tensorflow.keras.models import load_model
model = load_model('saved_model.h5')
predictions = model.predict([[5.1, 3.5, 1.4, 0.2]])
print(predictions)

medium

A. The model architecture printed as text

B. An error because load_model requires a directory, not a file

C. A list of class labels as strings

D. A numpy array of prediction probabilities

Solution

1. Step 1: Understand load_model usage

   load_model loads a saved Keras model from a file.

2. Step 2: Predict method output

   model.predict returns a numpy array of prediction probabilities for input data.

3. Final Answer:

   A numpy array of prediction probabilities -> Option D

4. Quick Check:

   load_model + predict = numpy array output [OK]

Hint: load_model loads model; predict returns probabilities array [OK]

Common Mistakes:

• Thinking load_model only loads from directories
• Expecting printed model architecture from predict
• Assuming predict returns class labels directly

4. You try to load a saved model using load_model('model.h5') but get an error: OSError: Unable to open file (file signature not found). What is the most likely cause?

medium

A. The model file is too large to load

B. You forgot to import load_model from keras

C. The file 'model.h5' is corrupted or not a valid model file

D. The model was saved with a different Python version

Solution

1. Step 1: Analyze the error message

   OSError about file signature means the file is not recognized as a valid HDF5 model file.

2. Step 2: Identify common causes

   This usually happens if the file is corrupted or not a saved model file.

3. Final Answer:

   The file 'model.h5' is corrupted or not a valid model file -> Option C

4. Quick Check:

   File signature error = corrupted or invalid file [OK]

Hint: File signature errors mean corrupted or wrong file type [OK]

Common Mistakes:

• Assuming Python version mismatch causes this error
• Forgetting to import but error message differs
• Thinking file size causes signature errors

5. You have a trained model saved as model_v1.h5. You want to load it, continue training on new data, then save the updated model as model_v2.h5. Which code snippet correctly does this?

hard

A. from tensorflow.keras.models import load_model
model = load_model('model_v1.h5')
model.fit(new_data, new_labels, epochs=5)
model.save('model_v2.h5')

B. model = load('model_v1.h5')
model.train(new_data, new_labels)
save_model(model, 'model_v2.h5')

C. load_model('model_v1.h5')
train_model(new_data, new_labels)
save('model_v2.h5')

D. from keras import load
model = load('model_v1.h5')
model.fit(new_data, new_labels)
model.save('model_v2.h5')

Solution

1. Step 1: Load the saved model correctly

   Use load_model('model_v1.h5') from tensorflow.keras.models to load the model.

2. Step 2: Continue training and save updated model

   Call model.fit() with new data, then save with model.save('model_v2.h5').

3. Final Answer:

   from tensorflow.keras.models import load_model model = load_model('model_v1.h5') model.fit(new_data, new_labels, epochs=5) model.save('model_v2.h5') -> Option A

4. Quick Check:

   Load, fit, save = from tensorflow.keras.models import load_model model = load_model('model_v1.h5') model.fit(new_data, new_labels, epochs=5) model.save('model_v2.h5') [OK]

Hint: Load with load_model, fit new data, then save again [OK]

Common Mistakes:

• Using undefined functions like load or save_model
• Forgetting to import load_model
• Not calling fit before saving updated model