Multi-input and multi-output models in TensorFlow - Model Pipeline Trace

Model Pipeline - Multi-input and multi-output models

This pipeline shows how a model can learn from two different inputs at the same time and give two different outputs. It’s like using two senses to understand something and then giving two answers based on that understanding.

Data Flow - 5 Stages

1Raw Data

1000 rows x 2 inputs→Two separate input features collected: Input A (10 features), Input B (5 features)→1000 rows x 2 inputs (10 features and 5 features)

Input A: [0.5, 1.2, ..., 0.3], Input B: [3, 0, 1, 2, 1]

↓

2Preprocessing

1000 rows x 2 inputs→Normalize Input A and one-hot encode Input B→1000 rows x 2 inputs (10 normalized features and 5 one-hot features)

Input A normalized: [0.05, 0.12, ..., 0.03], Input B one-hot: [0,1,0,0,0]

↓

3Feature Engineering

1000 rows x 2 inputs→Separate dense layers for each input to extract features→1000 rows x 2 feature vectors (each 8 features)

Feature vector A: [0.1, 0.2, ..., 0.05], Feature vector B: [0.3, 0.1, ..., 0.2]

↓

4Concatenate Features

1000 rows x 2 feature vectors→Combine feature vectors into one vector→1000 rows x 16 features

[0.1, 0.2, ..., 0.05, 0.3, 0.1, ..., 0.2]

↓

5Model Trains

1000 rows x 16 features→Train model with two outputs: Output 1 (regression), Output 2 (classification)→Two outputs: Output 1 shape (1000 rows x 1), Output 2 shape (1000 rows x 3 classes)

Output 1: [2.5, 3.1, ..., 1.2], Output 2: [[0.1, 0.7, 0.2], [0.8, 0.1, 0.1], ...]

Training Trace - Epoch by Epoch

Loss
1.2 |*       
1.0 | *      
0.8 |  *     
0.6 |   *    
0.4 |    *   
0.2 |     *  
0.0 +--------
      1 3 5 7 10 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.2	0.45	Loss starts high; accuracy low as model begins learning
3	0.8	0.60	Loss decreases; accuracy improves as model learns patterns
5	0.5	0.75	Loss continues to drop; accuracy rises steadily
7	0.35	0.82	Model converging; loss low and accuracy high
10	0.25	0.88	Training stabilizes with good accuracy and low loss

Prediction Trace - 4 Layers

Layer 1: Input Layer

Layer 2: Separate Dense Layers

Layer 3: Concatenate Features

Layer 4: Output Layers

Model Quiz - 3 Questions

Why does the model have two separate inputs?

A To reduce the number of features

B To learn from different types of data separately

C To make training faster

D To avoid using activation functions

Key Insight

Multi-input and multi-output models allow learning from different data sources simultaneously and produce multiple predictions. This helps solve complex problems where one input or output is not enough.

Practice

1. What is the main purpose of a multi-input model in TensorFlow?

easy

A. To accept more than one data source at the same time

B. To predict multiple outputs from a single input

C. To train faster using GPU acceleration

D. To reduce the number of layers in the model

Solution

1. Step 1: Understand multi-input models

   Multi-input models are designed to take multiple data sources as inputs simultaneously.

2. Step 2: Differentiate from multi-output models

   Multi-output models predict multiple outputs but usually from a single input source.

3. Final Answer:

   To accept more than one data source at the same time -> Option A

4. Quick Check:

   Multi-input = multiple data sources [OK]

Hint: Multi-input means many inputs, not many outputs [OK]

Common Mistakes:

• Confusing multi-input with multi-output
• Thinking multi-input reduces layers
• Assuming multi-input speeds training automatically

2. Which of the following is the correct way to define two inputs in a TensorFlow Keras model?

easy

A. inputs = tf.keras.Input(shape=(10, 5))

B. inputs = tf.keras.Input(shape=(10,)), tf.keras.Input(shape=(5,))

C. inputs = [tf.keras.Input(shape=(10,)), tf.keras.Input(shape=(5,))]

D. inputs = tf.keras.Input(shape=(10,)); inputs = tf.keras.Input(shape=(5,))

Solution

1. Step 1: Recall how to define multiple inputs

   Multiple inputs should be stored as a list of Input layers in Keras.

2. Step 2: Check each option

   inputs = [tf.keras.Input(shape=(10,)), tf.keras.Input(shape=(5,))] correctly creates a list of two Input layers. inputs = tf.keras.Input(shape=(10,)), tf.keras.Input(shape=(5,)) creates a tuple but does not assign it properly. inputs = tf.keras.Input(shape=(10, 5)) defines a single input with combined shape. inputs = tf.keras.Input(shape=(10,)); inputs = tf.keras.Input(shape=(5,)) overwrites the first input with the second.

3. Final Answer:

   inputs = [tf.keras.Input(shape=(10,)), tf.keras.Input(shape=(5,))] -> Option C

4. Quick Check:

   Multiple inputs = list of Input layers [OK]

Hint: Use a list to hold multiple Input layers [OK]

Common Mistakes:

• Using a tuple instead of a list for inputs
• Overwriting inputs instead of storing both
• Combining shapes into one input incorrectly

3. What will be the output shape of the following multi-output model?

input1 = tf.keras.Input(shape=(8,))
input2 = tf.keras.Input(shape=(4,))
x1 = tf.keras.layers.Dense(5)(input1)
x2 = tf.keras.layers.Dense(3)(input2)
output1 = tf.keras.layers.Dense(2)(x1)
output2 = tf.keras.layers.Dense(1)(x2)
model = tf.keras.Model(inputs=[input1, input2], outputs=[output1, output2])
print([o.shape for o in model.outputs])

medium

A. [TensorShape([None, 2]), TensorShape([None, 1])]

B. [TensorShape([8, 2]), TensorShape([4, 1])]

C. [TensorShape([None, 5]), TensorShape([None, 3])]

D. [TensorShape([None, 8]), TensorShape([None, 4])]

Solution

1. Step 1: Trace output layers shapes

   output1 is Dense(2) applied to x1, so shape is (None, 2). output2 is Dense(1) applied to x2, so shape is (None, 1).

2. Step 2: Understand batch dimension

   TensorFlow uses None for batch size, so output shapes include None as first dimension.

3. Final Answer:

   [TensorShape([None, 2]), TensorShape([None, 1])] -> Option A

4. Quick Check:

   Output shapes match Dense layer units [OK]

Hint: Output shape = batch size null + Dense units [OK]

Common Mistakes:

• Confusing input shape with output shape
• Ignoring batch dimension null
• Mixing intermediate layer shapes with output shapes

4. Identify the error in this multi-output model definition:

input = tf.keras.Input(shape=(10,))
x = tf.keras.layers.Dense(8)(input)
output1 = tf.keras.layers.Dense(4)(x)
output2 = tf.keras.layers.Dense(3)(x)
model = tf.keras.Model(inputs=input, outputs=[output1, output2])

medium

A. inputs should be a list when there are multiple outputs

B. outputs should be a single tensor, not a list

C. inputs must be a list even if only one input exists

D. No error, the model is defined correctly

Solution

1. Step 1: Check inputs parameter

   inputs can be a single Input layer if there is only one input source.

2. Step 2: Check outputs parameter

   outputs can be a list of tensors to define multiple outputs.

3. Final Answer:

   No error, the model is defined correctly -> Option D

4. Quick Check:

   Single input + multiple outputs = valid model [OK]

Hint: Single input can be passed directly, outputs can be list [OK]

Common Mistakes:

• Thinking inputs must always be a list
• Believing outputs cannot be a list
• Assuming multiple outputs require multiple inputs

5. You want to build a model that takes two inputs: an image (shape 64x64x3) and a vector of 10 features. It should output two predictions: a 5-class classification and a single continuous value. Which is the correct way to define the model inputs and outputs?

hard

A. inputs = [tf.keras.Input(shape=(64,64,3)), tf.keras.Input(shape=(10,))]; outputs = tf.keras.layers.Dense(6)(inputs)

B. inputs = [tf.keras.Input(shape=(64,64,3)), tf.keras.Input(shape=(10,))]; outputs = [tf.keras.layers.Dense(5, activation='softmax')(x), tf.keras.layers.Dense(1)(y)]

C. inputs = tf.keras.Input(shape=(64,64,3)); outputs = [tf.keras.layers.Dense(5)(inputs), tf.keras.layers.Dense(1)(inputs)]

D. inputs = tf.keras.Input(shape=(74,)); outputs = [tf.keras.layers.Dense(5)(inputs), tf.keras.layers.Dense(1)(inputs)]

Solution

1. Step 1: Define inputs separately for image and vector

   Two inputs require two Input layers with correct shapes: (64,64,3) for image and (10,) for vector.

2. Step 2: Define outputs separately for classification and regression

   Outputs are two layers: one Dense with 5 units and softmax for classification, one Dense with 1 unit for continuous value.

3. Final Answer:

   inputs = [tf.keras.Input(shape=(64,64,3)), tf.keras.Input(shape=(10,))]; outputs = [tf.keras.layers.Dense(5, activation='softmax')(x), tf.keras.layers.Dense(1)(y)] -> Option B

4. Quick Check:

   Separate inputs and outputs for multi-input/output model [OK]

Hint: Match each input and output with separate Input and Dense layers [OK]

Common Mistakes:

• Combining inputs into one vector incorrectly
• Using single input for different data types
• Outputting combined units instead of separate outputs