Mobile deployment (TFLite, Core ML) in Computer Vision - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to convert a TensorFlow model to TensorFlow Lite format.

Computer Vision

import tensorflow as tf

model = tf.keras.models.load_model('model.h5')
converter = tf.lite.TFLiteConverter.from_keras_model(model)
tflite_model = converter.[1]()

Drag options to blanks, or click blank then click option'

Acompile

Bconvert

Csave

Dfit

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'compile()' instead of 'convert()' which is for preparing the model for training.

Using 'save()' which saves the model but does not convert it.

Using 'fit()' which trains the model.

The method 'convert()' converts the Keras model to TensorFlow Lite format.

2fill in blank

medium

Complete the code to load a Core ML model in Swift for iOS deployment.

Computer Vision

import CoreML

guard let model = try? [1](configuration: MLModelConfiguration()) else {
    fatalError("Failed to load model")
}

Drag options to blanks, or click blank then click option'

AMyModel

BMLModel

CVNCoreMLModel

DMLModelConfiguration

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'MLModel' directly instead of the generated model class.

Confusing 'VNCoreMLModel' which is for Vision framework.

Using 'MLModelConfiguration' as a model instance.

You instantiate your specific Core ML model class (e.g., 'MyModel') to load it.

3fill in blank

hard

Fix the error in the TensorFlow Lite interpreter initialization code.

Computer Vision

import tensorflow as tf

interpreter = tf.lite.Interpreter(model_path='model.tflite')
interpreter.[1]()

Drag options to blanks, or click blank then click option'

Aprepare

Bload_tensors

Cinitialize

Dallocate_tensors

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'load_tensors()' which does not exist.

Using 'initialize()' or 'prepare()' which are not valid methods.

You must call 'allocate_tensors()' to prepare the interpreter before inference.

4fill in blank

hard

Fill both blanks to create a dictionary mapping input names to input data for TFLite inference.

Computer Vision

input_details = interpreter.get_input_details()
input_data = [1]
inputs = {input_details[0]['name']: [2]

Drag options to blanks, or click blank then click option'

Anp.array([1.0, 2.0, 3.0], dtype=np.float32)

Binput_data

Cnp.array([0.0, 0.0, 0.0], dtype=np.float32)

Dinput_details

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'input_details' as input data.

Using a zero array instead of actual input values.

Not matching the input name to the data variable.

First, input_data is created as a numpy array, then the dictionary maps the input name to input_data.

5fill in blank

hard

Fill all three blanks to run inference and get the output tensor from a TFLite interpreter.

Computer Vision

interpreter.set_tensor(input_details[0]['index'], [1])
interpreter.[2]()
output_data = interpreter.get_tensor(output_details[0]['[3]'])

Drag options to blanks, or click blank then click option'

Ainput_data

Binvoke

Cindex

Doutput

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'output' instead of 'index' to get tensor.

Calling a wrong method instead of 'invoke()'.

Passing wrong variable to set_tensor.

You set the input tensor with input_data, call 'invoke()' to run inference, then get the output tensor by 'index'.

Practice

1. What is the main purpose of using TFLite or Core ML in mobile deployment?

easy

A. To replace mobile operating systems with AI-powered ones

B. To run AI models directly on mobile devices for faster and offline use

C. To collect data from mobile devices for training

D. To train AI models on mobile devices

Solution

1. Step 1: Understand mobile deployment goals

   Mobile deployment aims to run AI models on phones to improve speed and allow offline use.

2. Step 2: Identify TFLite and Core ML roles

   TFLite and Core ML are formats to convert models for running directly on Android and Apple devices respectively.

3. Final Answer:

   To run AI models directly on mobile devices for faster and offline use -> Option B

4. Quick Check:

   Mobile AI models run locally = D [OK]

Hint: Mobile AI runs on device for speed and offline use [OK]

Common Mistakes:

• Thinking TFLite/Core ML train models on phones
• Confusing data collection with deployment
• Assuming they replace mobile OS

2. Which of the following is the correct command to convert a TensorFlow model to TFLite format in Python?

easy

A. tflite_model = tf.convert_to_tflite('model_dir')

B. tflite_model = tf.saved_model.convert_to_tflite('model_dir')

C. tflite_model = tf.lite.convert('model_dir')

D. tflite_model = tf.lite.TFLiteConverter.from_saved_model('model_dir').convert()

Solution

1. Step 1: Recall TensorFlow Lite conversion syntax

   The official way is using tf.lite.TFLiteConverter.from_saved_model() to load and convert.

2. Step 2: Check each option's correctness

   Only tflite_model = tf.lite.TFLiteConverter.from_saved_model('model_dir').convert() uses the correct method and chaining to convert the model.

3. Final Answer:

   tflite_model = tf.lite.TFLiteConverter.from_saved_model('model_dir').convert() -> Option D

4. Quick Check:

   Use tf.lite.TFLiteConverter.from_saved_model() = B [OK]

Hint: Use tf.lite.TFLiteConverter.from_saved_model() to convert [OK]

Common Mistakes:

• Using non-existent tf.convert_to_tflite function
• Calling convert() on wrong object
• Mixing saved_model and convert_to_tflite methods

3. Given the following Python code snippet, what will be the output type of tflite_model after conversion?

import tensorflow as tf
converter = tf.lite.TFLiteConverter.from_saved_model('my_model')
tflite_model = converter.convert()

medium

A. A string path to the converted model file

B. A TensorFlow SavedModel object

C. A bytes object containing the TFLite model

D. A Python dictionary with model details

Solution

1. Step 1: Understand the convert() method output

   The convert() method returns a bytes object representing the TFLite flatbuffer model.

2. Step 2: Match output type to options

   Only A bytes object containing the TFLite model correctly states the output is a bytes object containing the TFLite model.

3. Final Answer:

   A bytes object containing the TFLite model -> Option C

4. Quick Check:

   convert() returns bytes = A [OK]

Hint: convert() returns bytes of TFLite model, not file path [OK]

Common Mistakes:

• Thinking convert() saves file automatically
• Expecting a model object instead of bytes
• Confusing output with string path

4. You tried to convert a Core ML model using the command coremltools.converters.convert('model.mlmodel') but got an error. What is the likely cause?

medium

A. The convert function requires a model object, not a file path string

B. The model file extension must be .tflite for Core ML conversion

C. Core ML models cannot be converted with coremltools

D. The convert function only works on TensorFlow models

Solution

1. Step 1: Understand coremltools convert function input

   The convert function expects a model object or supported format, not just a file path string.

2. Step 2: Identify the error cause

   Passing a string path directly causes an error because the function cannot load the model from string alone.

3. Final Answer:

   The convert function requires a model object, not a file path string -> Option A

4. Quick Check:

   convert() needs model object input = C [OK]

Hint: Pass model object, not file path string, to convert() [OK]

Common Mistakes:

• Confusing file extensions for Core ML
• Thinking coremltools can't convert Core ML models
• Assuming convert() only works on TensorFlow

5. You have a trained TensorFlow model and want to deploy it on both Android and iOS devices. Which sequence of steps correctly prepares the model for mobile deployment?

hard

A. Convert the TensorFlow model to TFLite format for Android, then convert the same TensorFlow model to Core ML format for iOS

B. Convert the TensorFlow model to Core ML format for Android, then convert to TFLite for iOS

C. Use the TensorFlow model directly on both Android and iOS without conversion

D. Convert the TensorFlow model to ONNX format, then use ONNX runtime on both Android and iOS

Solution

1. Step 1: Identify platform-specific model formats

   Android uses TFLite format, and iOS uses Core ML format for efficient mobile deployment.

2. Step 2: Convert TensorFlow model accordingly

   Convert the TensorFlow model separately to TFLite for Android and Core ML for iOS to ensure compatibility.

3. Final Answer:

   Convert the TensorFlow model to TFLite format for Android, then convert the same TensorFlow model to Core ML format for iOS -> Option A

4. Quick Check:

   Platform-specific formats: TFLite for Android, Core ML for iOS = A [OK]

Hint: Convert TensorFlow model separately for Android (TFLite) and iOS (Core ML) [OK]

Common Mistakes:

• Mixing Core ML format for Android devices
• Skipping conversion and using TensorFlow model directly
• Using ONNX runtime without proper support