Broadcasting for distance matrices in NumPy - Mini Project: Build & Apply

Broadcasting for Distance Matrices

📖 Scenario: Imagine you have a few cities with their coordinates on a map. You want to find the distance between every pair of cities. This helps in planning trips or deliveries.

🎯 Goal: You will create a program that calculates the distance matrix between cities using numpy broadcasting. This means you will find all distances without writing loops, making the code fast and simple.

📋 What You'll Learn

Use numpy arrays to store city coordinates

Use broadcasting to calculate pairwise distances

Calculate Euclidean distance between points

Output the full distance matrix

💡 Why This Matters

🌍 Real World

Calculating distance matrices is useful in mapping, delivery route planning, and clustering locations based on proximity.

💼 Career

Data scientists and analysts often use broadcasting to efficiently compute distance matrices for machine learning, geographic analysis, and optimization problems.

1

Create city coordinates array

Create a numpy array called cities with these exact coordinates: [0, 0], [3, 4], and [6, 8]. Each coordinate is a list of two numbers representing x and y positions.

NumPy

# Create the numpy array called cities with the given coordinates
# Your code here

Hint

Use np.array and pass a list of lists with the coordinates.

2

Prepare for broadcasting

Create two new variables: cities_expanded_1 by adding a new axis to cities at position 1 using np.newaxis, and cities_expanded_2 by adding a new axis to cities at position 0 using np.newaxis.

NumPy

import numpy as np

cities = np.array([[0, 0], [3, 4], [6, 8]])

# Add new axis at position 1 to cities and assign to cities_expanded_1
# Add new axis at position 0 to cities and assign to cities_expanded_2
# Your code here

Hint

Use np.newaxis inside the square brackets to add a dimension.

3

Calculate the distance matrix using broadcasting

Create a variable called distances that calculates the Euclidean distance between each pair of cities using cities_expanded_1 and cities_expanded_2. Use the formula: square root of the sum of squared differences along the last axis.

NumPy

import numpy as np

cities = np.array([[0, 0], [3, 4], [6, 8]])
cities_expanded_1 = cities[:, np.newaxis, :]
cities_expanded_2 = cities[np.newaxis, :, :]

# Calculate the Euclidean distance matrix and assign it to distances
# Your code here

Hint

Subtract the expanded arrays, square the result, sum over the last axis, then take the square root.

4

Print the distance matrix

Print the variable distances to display the full distance matrix between the cities.

NumPy

import numpy as np

cities = np.array([[0, 0], [3, 4], [6, 8]])
cities_expanded_1 = cities[:, np.newaxis, :]
cities_expanded_2 = cities[np.newaxis, :, :]

distances = np.sqrt(np.sum((cities_expanded_1 - cities_expanded_2) ** 2, axis=-1))

# Print the distances array
# Your code here

Hint

Use print(distances) to show the matrix.

Practice

1. What does broadcasting help you do when calculating distance matrices in numpy?

easy

A. Convert points into categorical data

B. Sort points by their distance values

C. Reduce the dimensionality of points automatically

D. Calculate distances between all pairs of points without explicit loops

Solution

1. Step 1: Understand broadcasting concept

   Broadcasting allows numpy to perform operations on arrays of different shapes by automatically expanding their dimensions.

2. Step 2: Apply broadcasting to distance calculation

   By adding new axes, numpy can subtract all pairs of points at once, avoiding explicit loops.

3. Final Answer:

   Calculate distances between all pairs of points without explicit loops -> Option D

4. Quick Check:

   Broadcasting = Calculate distances without loops [OK]

Hint: Broadcasting avoids loops for pairwise distance calculations [OK]

Common Mistakes:

• Thinking broadcasting sorts or reduces data
• Confusing broadcasting with data conversion
• Assuming broadcasting changes data types

2. Which of the following numpy expressions correctly adds a new axis to a 2D array points to prepare for broadcasting in distance calculation?

easy

A. points[:, None, :]

B. points[None, :, :]

C. points[:, :, None]

D. points[None, None, :]

Solution

1. Step 1: Identify the shape of points

   Assuming points has shape (n, d), where n is number of points and d is dimensions.

2. Step 2: Add new axis for broadcasting

   Adding None at axis 1: points[:, None, :] changes shape to (n, 1, d), allowing subtraction with (1, n, d) array.

3. Final Answer:

   points[:, None, :] -> Option A

4. Quick Check:

   New axis at position 1 = points[:, None, :] [OK]

Hint: Add new axis with None at correct position for broadcasting [OK]

Common Mistakes:

• Adding new axis at wrong dimension
• Using too many None indices
• Confusing axis order in slicing

3. Given the code below, what is the shape of the resulting distances array?

import numpy as np
points = np.array([[1, 2], [4, 6], [7, 8]])
diff = points[:, None, :] - points[None, :, :]
distances = np.sqrt(np.sum(diff**2, axis=-1))

medium

A. (3, 3)

B. (3, 2)

C. (2, 3)

D. (2, 2)

Solution

1. Step 1: Analyze shapes after broadcasting

   points shape is (3, 2). After points[:, None, :] shape is (3, 1, 2), and points[None, :, :] shape is (1, 3, 2). Broadcasting subtraction results in shape (3, 3, 2).

2. Step 2: Calculate distances shape

   Sum over last axis (-1) reduces (3, 3, 2) to (3, 3). Square root keeps shape same.

3. Final Answer:

   (3, 3) -> Option A

4. Quick Check:

   Distance matrix shape = (number of points, number of points) = (3, 3) [OK]

Hint: Distance matrix shape = (n_points, n_points) [OK]

Common Mistakes:

• Confusing axis for sum operation
• Ignoring broadcasting shape expansion
• Assuming output shape matches input points shape

4. Identify the error in the following code snippet for computing Euclidean distances:

import numpy as np
points = np.array([[0, 0], [3, 4]])
diff = points[:, :, None] - points[:, None, :]
distances = np.sqrt(np.sum(diff**2, axis=-1))

medium

A. Missing import statement for numpy

B. Incorrect axis placement for new axes, causing shape mismatch

C. Using np.sum instead of np.mean

D. Square root should be applied before sum

Solution

1. Step 1: Check new axis placement

   Using points[:, :, None] and points[:, None, :] adds new axes at wrong positions, resulting in incompatible shapes for subtraction.

2. Step 2: Correct axis placement for broadcasting

   Correct way is points[:, None, :] and points[None, :, :] to get shapes (n,1,d) and (1,n,d) for broadcasting.

3. Final Answer:

   Incorrect axis placement for new axes, causing shape mismatch -> Option B

4. Quick Check:

   Axis placement error = shape mismatch [OK]

Hint: New axes must align for broadcasting subtraction [OK]

Common Mistakes:

• Adding new axes at wrong positions
• Confusing axis indices in slicing
• Applying sqrt before sum

5. You have a 3D array points of shape (5, 4, 3) representing 5 sets of 4 points in 3D space. How would you compute the pairwise Euclidean distance matrices for each set using broadcasting?

hard

A. Use diff = points[None, :, :, :] - points[:, :, None, :] then sum squares over axis 1

B. Reshape points to (20, 3) and compute distances with loops

C. Use diff = points[:, :, None, :] - points[:, None, :, :] then sum squares over last axis

D. Compute distances by flattening points to 1D array

Solution

1. Step 1: Understand points shape and goal

   points shape (5, 4, 3) means 5 sets, each with 4 points in 3D.

2. Step 2: Apply broadcasting for pairwise distances per set

   Subtract points with shapes (5, 4, 1, 3) and (5, 1, 4, 3) using points[:, :, None, :] - points[:, None, :, :]. Then sum squares over last axis (3) and sqrt.

3. Final Answer:

   Use diff = points[:, :, None, :] - points[:, None, :, :] then sum squares over last axis -> Option C

4. Quick Check:

   Broadcast sets with new axes at 2 and 1 [OK]

Hint: Add axes at positions 2 and 1 for sets and points [OK]

Common Mistakes:

• Mixing axis order for broadcasting
• Flattening instead of broadcasting
• Using loops instead of vectorized operations