Why deployment delivers model value in TensorFlow - Experiment to Prove It

Experiment - Why deployment delivers model value

Problem:You have trained a TensorFlow model that predicts if a customer will buy a product. The model works well on test data with 90% accuracy.

Current Metrics:Test accuracy: 90%

Issue:The model is not yet deployed, so it cannot provide real value to users or the business.

Your Task

Deploy the trained TensorFlow model as a simple web service so it can make predictions on new customer data and deliver value.

Use TensorFlow and Python only

Deploy locally or on a simple server

Keep the deployment code simple and clear

Hint 1

Hint 2

Hint 3

Solution

TensorFlow

import tensorflow as tf
from flask import Flask, request, jsonify
import numpy as np

# Load the saved model
model = tf.keras.models.load_model('saved_model/my_model')

app = Flask(__name__)

@app.route('/predict', methods=['POST'])
def predict():
    data = request.json
    # Assume input data is a list of features
    features = np.array(data['features']).reshape(1, -1)
    prediction = model.predict(features)
    # Convert prediction to class label (0 or 1)
    predicted_class = int(prediction[0][0] > 0.5)
    return jsonify({'prediction': predicted_class})

if __name__ == '__main__':
    app.run(debug=True, port=5000)

# To test, send a POST request with JSON: {"features": [feature_values]}

Exported the trained TensorFlow model using tf.keras.models.save_model

Created a Flask web app to serve the model predictions via a /predict endpoint

Added code to receive JSON input, run model prediction, and return JSON output

Results Interpretation

Before deployment: Model accuracy on test data was 90%, but no real users could access it.

After deployment: Model is accessible via a web service, delivering predictions on new data instantly.

Training a model is only part of the value. Deployment makes the model usable in real life, turning accuracy into actual business impact.

Bonus Experiment

Try deploying the model using FastAPI instead of Flask for faster performance and automatic API docs.

💡 Hint

Use FastAPI's @app.post decorator and Pydantic models for input validation.

Practice

1. Why is deploying a trained TensorFlow model important?

easy

A. It allows the model to be used for making predictions in real situations.

B. It improves the model's training speed.

C. It changes the model's architecture automatically.

D. It deletes the training data to save space.

Solution

1. Step 1: Understand deployment purpose

   Deployment means putting the trained model into use outside training, like in apps or websites.

2. Step 2: Identify the benefit of deployment

   Deployment lets the model make predictions on new data anytime, helping solve real problems.

3. Final Answer:

   It allows the model to be used for making predictions in real situations. -> Option A

4. Quick Check:

   Deployment = real use of model [OK]

Hint: Deployment means using the model, not training it [OK]

Common Mistakes:

• Confusing deployment with training
• Thinking deployment changes model structure
• Believing deployment deletes data

2. Which TensorFlow function is used to save a trained model for deployment?

easy

A. tf.keras.models.load_model()

B. tf.keras.models.save_model()

C. tf.keras.models.compile()

D. tf.keras.models.fit()

Solution

1. Step 1: Recall saving function

   To save a trained model, TensorFlow uses save_model() to store the model files.

2. Step 2: Differentiate from other functions

   load_model() loads a saved model, compile() prepares model for training, fit() trains the model.

3. Final Answer:

   tf.keras.models.save_model() -> Option B

4. Quick Check:

   Save model = save_model() [OK]

Hint: Save model uses save_model(), load uses load_model() [OK]

Common Mistakes:

• Mixing save_model() and load_model()
• Confusing compile() with saving
• Using fit() to save model

3. What will be the output of this code snippet after loading and predicting with a deployed model?

import tensorflow as tf
model = tf.keras.Sequential([tf.keras.layers.Dense(1, input_shape=(1,), kernel_initializer='ones')])
model.compile(optimizer='sgd', loss='mse')
model.fit([[1.0]], [[2.0]], epochs=1, verbose=0)
model.save('my_model')
loaded_model = tf.keras.models.load_model('my_model')
prediction = loaded_model.predict([[3.0]])
print(round(prediction[0][0], 1))

medium

A. Approximately 6.0

B. Approximately 2.0

C. Approximately 3.0

D. Error due to missing input shape

Solution

1. Step 1: Understand model training

   The model is a simple linear layer with initial weight=1, trained on input 1.0 to output 2.0 for 1 epoch. With small learning rate (0.01), the weight updates minimally to ~1.02.

2. Step 2: Predict with loaded model

   Predicting input 3.0 with weight ~1.02 and small bias adjustment gives ~3.08, which rounds to 3.1, approximately 3.0.

3. Final Answer:

   Approximately 3.0 -> Option C

4. Quick Check:

   Prediction ~ input * weight ~ 3.0 [OK]

Hint: Minimal training means weight near 1, so output ~ input [OK]

Common Mistakes:

• Assuming perfect training after 1 epoch
• Ignoring model saving and loading
• Expecting error from input shape

4. You saved a TensorFlow model with model.save('model_path') but get an error loading it with tf.keras.models.load_model('wrong_path'). What is the fix?

medium

A. Retrain the model before loading

B. Restart Python without saving

C. Change save() to compile()

D. Use the correct saved model path in load_model()

Solution

1. Step 1: Identify cause of error

   Loading a model from a wrong or non-existing path causes errors because the file is missing.

2. Step 2: Correct the load path

   Use the exact path where the model was saved to successfully load it.

3. Final Answer:

   Use the correct saved model path in load_model() -> Option D

4. Quick Check:

   Load path must match save path [OK]

Hint: Load from exact saved folder path [OK]

Common Mistakes:

• Changing save() to compile()
• Trying to load from wrong folder
• Thinking retraining fixes loading error

5. You want to deploy a TensorFlow model that predicts house prices. Which steps ensure the model delivers value after deployment?

hard

A. Train the model, save it, load it in an app, and use it to predict new house data.

B. Train the model, delete training data, and never save the model.

C. Only train the model without saving or deploying it.

D. Save the model before training to speed up deployment.

Solution

1. Step 1: Outline deployment steps

   Training creates the model, saving stores it, loading in an app allows real-time predictions.

2. Step 2: Understand value delivery

   Using the model to predict new house data helps users make decisions, delivering real value.

3. Final Answer:

   Train the model, save it, load it in an app, and use it to predict new house data. -> Option A

4. Quick Check:

   Train + save + load + predict = value [OK]

Hint: Train, save, load, predict new data for value [OK]

Common Mistakes:

• Skipping saving or loading steps
• Deleting training data prematurely
• Saving model before training