Indexing and slicing tensors in TensorFlow - Model Pipeline Trace

Model Pipeline - Indexing and slicing tensors

This pipeline shows how a tensor (multi-dimensional array) is accessed and sliced to extract smaller parts. This is like cutting a cake into pieces to share.

Data Flow - 5 Stages

1Input tensor

1 tensor of shape (4, 5)→Create a 2D tensor with 4 rows and 5 columns→1 tensor of shape (4, 5)

[[1, 2, 3, 4, 5], [6, 7, 8, 9, 10], [11, 12, 13, 14, 15], [16, 17, 18, 19, 20]]

↓

2Indexing a single element

tensor of shape (4, 5)→Access element at row 2, column 3 (0-based indexing)→scalar (single number)

Element at [2, 3] is 14

↓

3Slicing rows

tensor of shape (4, 5)→Select rows 1 to 3 (excluding 3), all columns→tensor of shape (2, 5)

[[6, 7, 8, 9, 10], [11, 12, 13, 14, 15]]

↓

4Slicing columns

tensor of shape (4, 5)→Select all rows, columns 2 to 4 (excluding 4)→tensor of shape (4, 2)

[[3, 4], [8, 9], [13, 14], [18, 19]]

↓

5Slicing with step

tensor of shape (4, 5)→Select every other row, all columns→tensor of shape (2, 5)

[[1, 2, 3, 4, 5], [11, 12, 13, 14, 15]]

Training Trace - Epoch by Epoch

No training loss to show for tensor slicing operations

Epoch	Loss ↓	Accuracy ↑	Observation
1	N/A	N/A	No training, only tensor slicing operations

Prediction Trace - 5 Layers

Layer 1: Input tensor

Layer 2: Indexing element [2,3]

Layer 3: Slicing rows 1:3

Layer 4: Slicing columns 2:4

Layer 5: Slicing rows with step 0:4:2

Model Quiz - 3 Questions

What is the shape of the tensor after slicing rows 1 to 3 (excluding 3) from a (4, 5) tensor?

A (3, 5)

B (1, 5)

C (2, 5)

D (4, 3)

Key Insight

Indexing and slicing tensors lets you pick parts of data easily, like cutting a cake into slices. This is essential for preparing data for machine learning models.

Practice

1. What does indexing a tensor in TensorFlow do?

easy

A. Selects a single element by its position

B. Changes the shape of the tensor

C. Adds new elements to the tensor

D. Deletes elements from the tensor

Solution

1. Step 1: Understand indexing

   Indexing means picking one element from a tensor by its position, like choosing one item from a list.

2. Step 2: Compare with other options

   Changing shape, adding, or deleting elements are different operations, not indexing.

3. Final Answer:

   Selects a single element by its position -> Option A

4. Quick Check:

   Indexing = single element pick [OK]

Hint: Indexing picks one element, slicing picks many [OK]

Common Mistakes:

• Thinking indexing changes tensor shape
• Confusing indexing with adding elements
• Assuming indexing deletes elements

2. Which of the following is the correct syntax to slice a 1D tensor t from index 2 to 5 (exclusive) in TensorFlow?

easy

A. t[2:5]

B. t.slice(2, 5)

C. t[2, 5]

D. t.slice(2:5)

Solution

1. Step 1: Recall slicing syntax

   TensorFlow uses Python-style slicing: t[start:stop] to get elements from start up to but not including stop.

2. Step 2: Check each option

   t[2:5] uses correct Python slice syntax. t.slice(2, 5) and D use incorrect method calls or syntax. t[2, 5] uses comma which is invalid for 1D slicing.

3. Final Answer:

   t[2:5] -> Option A

4. Quick Check:

   Slice syntax = t[start:stop] [OK]

Hint: Use square brackets with colon for slicing [OK]

Common Mistakes:

• Using commas instead of colons in slices
• Trying to call slice as a method incorrectly
• Confusing slice stop index as inclusive

3. Given the tensor t = tf.constant([[1, 2, 3], [4, 5, 6], [7, 8, 9]]), what is the output of t[1:, :2].numpy()?

medium

A. [[5 6]
[8 9]]

B. [[1 2]
[4 5]]

C. [[4 5 6]
[7 8 9]]

D. [[4 5]
[7 8]]

Solution

1. Step 1: Understand slicing t[1:, :2]

   1: means rows from index 1 to end (rows 1 and 2). :2 means columns from start to index 2 (columns 0 and 1).

2. Step 2: Extract the sliced elements

   Rows 1 and 2 are [[4,5,6], [7,8,9]]. Taking first two columns gives [[4,5], [7,8]].

3. Final Answer:

   [[4 5] [7 8]] -> Option D

4. Quick Check:

   Rows 1+ and cols 0-1 = [[4 5],[7 8]] [OK]

Hint: Remember slice stop is exclusive, so :2 means columns 0 and 1 [OK]

Common Mistakes:

• Including column index 2 mistakenly
• Starting rows from 0 instead of 1
• Confusing rows and columns order

4. What is wrong with this TensorFlow slicing code?

t = tf.constant([10, 20, 30, 40, 50])
slice = t[1:6]

medium

A. Index 6 is out of range, causing an error

B. Slicing with stop index beyond length is allowed, no error

C. Syntax error due to missing colon

D. TensorFlow does not support slicing

Solution

1. Step 1: Check slicing behavior with stop index

   In Python and TensorFlow, slicing stop index can be beyond tensor length without error; it stops at the end.

2. Step 2: Analyze given code

   Tensor t has length 5, slicing 1:6 extracts elements from index 1 to end safely.

3. Final Answer:

   Slicing with stop index beyond length is allowed, no error -> Option B

4. Quick Check:

   Slice stop > length is safe [OK]

Hint: Slice stop can exceed length without error [OK]

Common Mistakes:

• Expecting IndexError for slice stop beyond length
• Confusing slicing with indexing single element
• Thinking slicing syntax is invalid

5. You have a 3D tensor t = tf.constant([[[1,2],[3,4]], [[5,6],[7,8]], [[9,10],[11,12]]]). How do you extract the second element from each 2D matrix (i.e., elements 2, 4, 6, 8, 10, 12) using indexing and slicing?

hard

A. t[1, :, :]

B. t[:, 1, :]

C. t[:, :, 1]

D. t[:, 1]

Solution

1. Step 1: Understand tensor shape and indexing

   The tensor shape is (3, 2, 2): 3 matrices, each 2x2. We want the second element in the last dimension (index 1).

2. Step 2: Apply slicing to get second element in last dimension

   Using t[:, :, 1] selects all matrices (:), all rows (:), and the second element (index 1) in the last dimension.

3. Final Answer:

   t[:, :, 1] -> Option C

4. Quick Check:

   Last dim index 1 selects second elements [OK]

Hint: Use colon for all dims except last, index last dim 1 [OK]

Common Mistakes:

• Mixing row and column indices
• Using incomplete slicing like t[:, 1]
• Selecting wrong dimension index