Dataset from tensors in TensorFlow - Model Pipeline Trace

Model Pipeline - Dataset from tensors

This pipeline shows how to create a dataset directly from tensors, then use it to train a simple model. It starts with raw data in tensors, builds a dataset, trains a model, and makes predictions.

Data Flow - 3 Stages

1Raw tensors

None→Create tensors for features and labels→5 rows x 3 columns (features), 5 rows x 1 column (labels)

[[1.0, 2.0, 3.0], [4.0, 5.0, 6.0], [7.0, 8.0, 9.0], [10.0, 11.0, 12.0], [13.0, 14.0, 15.0]] (features), [0, 1, 0, 1, 0] (labels)

↓

2Dataset creation

5 rows x 3 columns (features), 5 rows x 1 column (labels)→Create tf.data.Dataset from tensors→5 elements of (3 features, 1 label)

Dataset element example: (features=[1.0, 2.0, 3.0], label=0)

↓

3Batching

5 elements of (3 features, 1 label)→Batch dataset into groups of 2→3 batches: 2 elements, 2 elements, 1 element

Batch 1: features=[[1.0,2.0,3.0],[4.0,5.0,6.0]], labels=[0,1]

Training Trace - Epoch by Epoch

Loss
0.7 |****
0.6 |*** 
0.5 |**  
0.4 |*   
0.3 |    
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.693	0.40	Initial loss is high, accuracy low as model starts learning
2	0.580	0.60	Loss decreases, accuracy improves as model learns patterns
3	0.480	0.80	Model continues to improve, loss goes down, accuracy up
4	0.400	0.80	Loss decreases further, accuracy stabilizes
5	0.350	1.00	Model fits data well, perfect accuracy on training set

Prediction Trace - 3 Layers

Layer 1: Input layer

Layer 2: Dense layer with ReLU

Layer 3: Output layer with sigmoid

Model Quiz - 3 Questions

What is the shape of the dataset after batching?

A 3 batches: 2 elements, 2 elements, 1 element

B 5 batches: 1 element each

C 1 batch: 5 elements

D 2 batches: 3 elements, 2 elements

Key Insight

Creating a dataset from tensors allows easy feeding of data into TensorFlow models. Batching helps training efficiency. Loss decreasing and accuracy increasing show the model is learning well.

Practice

1. What does tf.data.Dataset.from_tensor_slices() do in TensorFlow?

easy

A. It merges multiple datasets into one.

B. It converts a dataset back into tensors.

C. It creates a dataset by slicing the input tensors row-wise.

D. It shuffles the dataset randomly.

Solution

1. Step 1: Understand the function purpose

   tf.data.Dataset.from_tensor_slices() takes tensors and creates a dataset by slicing them row-wise, so each element is one slice.

2. Step 2: Compare with other options

   Options B, C, and D describe different dataset operations, not the slicing creation step.

3. Final Answer:

   It creates a dataset by slicing the input tensors row-wise. -> Option C

4. Quick Check:

   Dataset from tensor slices = row-wise slicing [OK]

Hint: Remember: from_tensor_slices splits tensors row-wise [OK]

Common Mistakes:

• Confusing from_tensor_slices with shuffling
• Thinking it merges datasets
• Assuming it converts datasets back to tensors

2. Which of the following is the correct syntax to create a dataset from a tensor data_tensor using TensorFlow?

easy

A. dataset = tf.data.Dataset.from_tensor_slices(data_tensor)

B. dataset = tf.data.Dataset.create_from_tensor(data_tensor)

C. dataset = tf.data.Dataset.tensor_slices(data_tensor)

D. dataset = tf.data.from_tensor_slices(data_tensor)

Solution

1. Step 1: Recall the correct method name

   The correct TensorFlow method to create a dataset from tensor slices is tf.data.Dataset.from_tensor_slices().

2. Step 2: Check syntax correctness

   dataset = tf.data.Dataset.from_tensor_slices(data_tensor) matches the exact syntax. Options A, B, and D use incorrect method names or missing parts.

3. Final Answer:

   dataset = tf.data.Dataset.from_tensor_slices(data_tensor) -> Option A

4. Quick Check:

   Correct method name and syntax = dataset = tf.data.Dataset.from_tensor_slices(data_tensor) [OK]

Hint: Use exact method: Dataset.from_tensor_slices() [OK]

Common Mistakes:

• Using wrong method names
• Missing Dataset class before method
• Confusing with other dataset creation functions

3. What will be the output of the following code?

import tensorflow as tf
x = tf.constant([[1, 2], [3, 4], [5, 6]])
dataset = tf.data.Dataset.from_tensor_slices(x)
for element in dataset:
    print(element.numpy())

medium

A. [[1 2]
[3 4]
[5 6]]

B. [[1], [2], [3], [4], [5], [6]]

C. [1, 2, 3, 4, 5, 6]

D. [1 2]
[3 4]
[5 6]

Solution

1. Step 1: Understand from_tensor_slices behavior

   The method slices the tensor row-wise, so each element is a 1D tensor representing one row.

2. Step 2: Analyze the loop output

   Each iteration prints one row as a numpy array, so output lines are [1 2], then [3 4], then [5 6].

3. Final Answer:

   [1 2] [3 4] [5 6] -> Option D

4. Quick Check:

   Row-wise slices printed line by line = [1 2] [3 4] [5 6] [OK]

Hint: from_tensor_slices outputs row slices printed separately [OK]

Common Mistakes:

• Expecting full tensor printed at once
• Confusing row slices with flattened output
• Assuming column-wise slicing

4. Identify the error in this code snippet:

import tensorflow as tf
x = tf.constant([1, 2, 3])
dataset = tf.data.Dataset.from_tensor_slices(x)
for element in dataset:
    print(element.numpy())
print(dataset.batch(2))

medium

A. Calling batch() after iteration does not return a new dataset.

B. print(dataset.batch(2)) prints a dataset object, not batches.

C. from_tensor_slices() requires a list, not a tensor.

D. The loop should use dataset.batch(2) instead of dataset.

Solution

1. Step 1: Understand batch() output

   The batch() method returns a new dataset object that groups elements, but printing it directly shows the object info, not the batch contents.

2. Step 2: Check what print(dataset.batch(2)) does

   It prints a dataset representation, not the actual batched data. To see batches, you must iterate over it.

3. Final Answer:

   print(dataset.batch(2)) prints a dataset object, not batches. -> Option B

4. Quick Check:

   Printing dataset.batch() shows object info, not data [OK]

Hint: Iterate to see batches; print shows object info only [OK]

Common Mistakes:

• Expecting print to show batch data
• Thinking batch modifies original dataset in place
• Confusing tensor and list input types

5. You have two tensors:

features = tf.constant([[1, 2], [3, 4], [5, 6]])
labels = tf.constant([0, 1, 0])

You want to create a dataset that pairs each feature row with its label for training. Which code correctly creates this dataset?

hard

A. dataset = tf.data.Dataset.from_tensor_slices((features, labels))

B. dataset = tf.data.Dataset.from_tensor_slices(features).zip(labels)

C. dataset = tf.data.Dataset.from_tensor_slices(features + labels)

D. dataset = tf.data.Dataset.from_tensor_slices(features).batch(labels)

Solution

1. Step 1: Understand pairing tensors in dataset

   To pair features and labels, pass a tuple of tensors to from_tensor_slices(). This creates dataset elements as (feature_row, label) pairs.

2. Step 2: Evaluate each option

   dataset = tf.data.Dataset.from_tensor_slices((features, labels)) correctly uses a tuple. dataset = tf.data.Dataset.from_tensor_slices(features).zip(labels) tries to zip a tensor, which is invalid. dataset = tf.data.Dataset.from_tensor_slices(features + labels) adds tensors incorrectly. dataset = tf.data.Dataset.from_tensor_slices(features).batch(labels) misuses batch() with labels.

3. Final Answer:

   dataset = tf.data.Dataset.from_tensor_slices((features, labels)) -> Option A

4. Quick Check:

   Tuple input pairs tensors row-wise = dataset = tf.data.Dataset.from_tensor_slices((features, labels)) [OK]

Hint: Use tuple inside from_tensor_slices to pair tensors [OK]

Common Mistakes:

• Trying to zip a tensor directly
• Adding tensors instead of pairing
• Using batch() incorrectly with labels