Indexing and slicing tensors in TensorFlow

Introduction

Indexing and slicing let you pick parts of your data easily, like choosing pieces of a photo or words from a sentence.

When you want to get a single value from a big data set, like one pixel from an image.

When you need to extract a smaller part of your data, like a few rows from a table.

When you want to change or analyze only a part of your data without touching the rest.

When preparing batches of data for training a machine learning model.

When you want to combine or compare specific parts of different data tensors.

Syntax

TensorFlow

tensor[index]
tensor[start:stop]
tensor[start:stop:step]
tensor[dim1_index, dim2_index, ...]

Indexing starts at 0, so the first element is at position 0.

You can use negative numbers to count from the end, like -1 for the last element.

Examples

Gets the third element (index 2) from a 1D tensor.

TensorFlow

import tensorflow as tf
x = tf.constant([10, 20, 30, 40, 50])
print(x[2])

Slices elements from index 1 up to but not including 4.

TensorFlow

x = tf.constant([10, 20, 30, 40, 50])
print(x[1:4])

Gets the element at row 1, column 0 from a 2D tensor.

TensorFlow

x = tf.constant([[1, 2], [3, 4], [5, 6]])
print(x[1, 0])

Reverses the tensor using slicing with a negative step.

TensorFlow

x = tf.constant([10, 20, 30, 40, 50])
print(x[::-1])

Sample Model

This program shows how to get a single element, slice a part of a 2D tensor, and reverse the rows of the tensor.

TensorFlow

import tensorflow as tf

# Create a 2D tensor (3 rows, 4 columns)
tensor = tf.constant([[1, 2, 3, 4],
                      [5, 6, 7, 8],
                      [9, 10, 11, 12]])

# Get the element at row 0, column 2
elem = tensor[0, 2]

# Slice rows 1 to 2 (inclusive start, exclusive end 3), columns 1 to 3
slice_part = tensor[1:3, 1:4]

# Reverse the rows
reversed_rows = tensor[::-1, :]

print(f"Element at [0,2]: {elem.numpy()}")
print("Slice rows 1-2, cols 1-3:")
print(slice_part.numpy())
print("Tensor with rows reversed:")
print(reversed_rows.numpy())

Important Notes

TensorFlow tensors are immutable, so slicing returns a new tensor without changing the original.

You can combine indexing and slicing to access complex parts of your data easily.

Using .numpy() converts a tensor to a regular array for printing or further use outside TensorFlow.

Summary

Indexing picks single elements by position.

Slicing extracts ranges of elements using start, stop, and step.

You can use indexing and slicing together on multi-dimensional tensors.

Practice

1. What does indexing a tensor in TensorFlow do?

easy

A. Selects a single element by its position

B. Changes the shape of the tensor

C. Adds new elements to the tensor

D. Deletes elements from the tensor

Solution

1. Step 1: Understand indexing

   Indexing means picking one element from a tensor by its position, like choosing one item from a list.

2. Step 2: Compare with other options

   Changing shape, adding, or deleting elements are different operations, not indexing.

3. Final Answer:

   Selects a single element by its position -> Option A

4. Quick Check:

   Indexing = single element pick [OK]

Hint: Indexing picks one element, slicing picks many [OK]

Common Mistakes:

• Thinking indexing changes tensor shape
• Confusing indexing with adding elements
• Assuming indexing deletes elements

2. Which of the following is the correct syntax to slice a 1D tensor t from index 2 to 5 (exclusive) in TensorFlow?

easy

A. t[2:5]

B. t.slice(2, 5)

C. t[2, 5]

D. t.slice(2:5)

Solution

1. Step 1: Recall slicing syntax

   TensorFlow uses Python-style slicing: t[start:stop] to get elements from start up to but not including stop.

2. Step 2: Check each option

   t[2:5] uses correct Python slice syntax. t.slice(2, 5) and D use incorrect method calls or syntax. t[2, 5] uses comma which is invalid for 1D slicing.

3. Final Answer:

   t[2:5] -> Option A

4. Quick Check:

   Slice syntax = t[start:stop] [OK]

Hint: Use square brackets with colon for slicing [OK]

Common Mistakes:

• Using commas instead of colons in slices
• Trying to call slice as a method incorrectly
• Confusing slice stop index as inclusive

3. Given the tensor t = tf.constant([[1, 2, 3], [4, 5, 6], [7, 8, 9]]), what is the output of t[1:, :2].numpy()?

medium

A. [[5 6]
[8 9]]

B. [[1 2]
[4 5]]

C. [[4 5 6]
[7 8 9]]

D. [[4 5]
[7 8]]

Solution

1. Step 1: Understand slicing t[1:, :2]

   1: means rows from index 1 to end (rows 1 and 2). :2 means columns from start to index 2 (columns 0 and 1).

2. Step 2: Extract the sliced elements

   Rows 1 and 2 are [[4,5,6], [7,8,9]]. Taking first two columns gives [[4,5], [7,8]].

3. Final Answer:

   [[4 5] [7 8]] -> Option D

4. Quick Check:

   Rows 1+ and cols 0-1 = [[4 5],[7 8]] [OK]

Hint: Remember slice stop is exclusive, so :2 means columns 0 and 1 [OK]

Common Mistakes:

• Including column index 2 mistakenly
• Starting rows from 0 instead of 1
• Confusing rows and columns order

4. What is wrong with this TensorFlow slicing code?

t = tf.constant([10, 20, 30, 40, 50])
slice = t[1:6]

medium

A. Index 6 is out of range, causing an error

B. Slicing with stop index beyond length is allowed, no error

C. Syntax error due to missing colon

D. TensorFlow does not support slicing

Solution

1. Step 1: Check slicing behavior with stop index

   In Python and TensorFlow, slicing stop index can be beyond tensor length without error; it stops at the end.

2. Step 2: Analyze given code

   Tensor t has length 5, slicing 1:6 extracts elements from index 1 to end safely.

3. Final Answer:

   Slicing with stop index beyond length is allowed, no error -> Option B

4. Quick Check:

   Slice stop > length is safe [OK]

Hint: Slice stop can exceed length without error [OK]

Common Mistakes:

• Expecting IndexError for slice stop beyond length
• Confusing slicing with indexing single element
• Thinking slicing syntax is invalid

5. You have a 3D tensor t = tf.constant([[[1,2],[3,4]], [[5,6],[7,8]], [[9,10],[11,12]]]). How do you extract the second element from each 2D matrix (i.e., elements 2, 4, 6, 8, 10, 12) using indexing and slicing?

hard

A. t[1, :, :]

B. t[:, 1, :]

C. t[:, :, 1]

D. t[:, 1]

Solution

1. Step 1: Understand tensor shape and indexing

   The tensor shape is (3, 2, 2): 3 matrices, each 2x2. We want the second element in the last dimension (index 1).

2. Step 2: Apply slicing to get second element in last dimension

   Using t[:, :, 1] selects all matrices (:), all rows (:), and the second element (index 1) in the last dimension.

3. Final Answer:

   t[:, :, 1] -> Option C

4. Quick Check:

   Last dim index 1 selects second elements [OK]

Hint: Use colon for all dims except last, index last dim 1 [OK]

Common Mistakes:

• Mixing row and column indices
• Using incomplete slicing like t[:, 1]
• Selecting wrong dimension index