Distance matrix computation in SciPy

Introduction

We use distance matrix computation to find how far apart items are from each other. This helps us understand relationships or groupings in data.

Comparing distances between cities on a map.

Finding similar customers based on their shopping habits.

Grouping animals by their features in biology.

Measuring how close different documents are in text analysis.

Syntax

SciPy

from scipy.spatial import distance_matrix

distance_matrix(X, Y=None, p=2, threshold=1000.0)

X and Y are arrays of points (rows are points, columns are features).

p sets the distance type: 2 means Euclidean (straight line).

Examples

Compute distances between points in X itself.

SciPy

from scipy.spatial import distance_matrix
import numpy as np

X = np.array([[0, 0], [1, 1]])
D = distance_matrix(X, X)
print(D)

Compute distances from points in X to points in Y.

SciPy

from scipy.spatial import distance_matrix
import numpy as np

X = np.array([[0, 0], [1, 1]])
Y = np.array([[2, 2]])
D = distance_matrix(X, Y)
print(D)

Sample Program

This program calculates the distances between each point in X and each point in Y. The result is a matrix where each row corresponds to a point in X and each column to a point in Y.

SciPy

from scipy.spatial import distance_matrix
import numpy as np

# Define two sets of points
X = np.array([[0, 0], [3, 4], [6, 8]])
Y = np.array([[0, 0], [1, 1]])

# Compute the distance matrix
D = distance_matrix(X, Y)

print(D)

Important Notes

The distance matrix is always a 2D array with shape (len(X), len(Y)).

Euclidean distance (p=2) is the most common, but you can use other distances by changing p.

If Y is not given, distances are computed between points in X itself.

Summary

Distance matrix shows how far points are from each other.

Use scipy.spatial.distance_matrix to compute it easily.

It helps in clustering, similarity, and spatial analysis tasks.

Practice

1. What does the scipy.spatial.distance_matrix function compute?

easy

A. The average value of a list of numbers

B. The sum of all points in a dataset

C. The distances between all pairs of points in two sets

D. The maximum value in a dataset

Solution

1. Step 1: Understand the function purpose

   scipy.spatial.distance_matrix calculates distances between points, not sums or averages.

2. Step 2: Identify what is computed

   It returns a matrix showing distances between each point in one set to each point in another set.

3. Final Answer:

   The distances between all pairs of points in two sets -> Option C

4. Quick Check:

   Distance matrix = pairwise distances [OK]

Hint: Distance matrix = all pair distances between points [OK]

Common Mistakes:

• Confusing distance matrix with sum or average calculations
• Thinking it returns a single distance value
• Assuming it only works for one set of points

2. Which of the following is the correct way to import the distance_matrix function from scipy?

easy

A. import scipy.distance_matrix

B. import distance_matrix from scipy.spatial

C. from scipy import distance_matrix

D. from scipy.spatial import distance_matrix

Solution

1. Step 1: Recall correct import syntax

   Functions inside modules are imported using from module import function.

2. Step 2: Match with scipy structure

   distance_matrix is inside scipy.spatial, so correct import is from scipy.spatial import distance_matrix.

3. Final Answer:

   from scipy.spatial import distance_matrix -> Option D

4. Quick Check:

   Correct import syntax = from scipy.spatial import distance_matrix [OK]

Hint: Use 'from module import function' for specific imports [OK]

Common Mistakes:

• Using 'import scipy.distance_matrix' which is invalid
• Trying 'from scipy import distance_matrix' ignoring submodules
• Incorrect order like 'import distance_matrix from ...'

3. What is the output of this code?

import numpy as np
from scipy.spatial import distance_matrix
points1 = np.array([[0, 0], [1, 1]])
points2 = np.array([[1, 0], [2, 2]])
dm = distance_matrix(points1, points2)
print(dm)

medium

A. [[1. 2.82842712]
[1. 1.41421356]]

B. [[0. 1.41421356]
[1. 2.23606798]]

C. [[1.41421356 2.23606798]
[0. 1.41421356]]

D. [[1. 1.41421356]
[1.41421356 2.82842712]]

Solution

1. Step 1: Calculate distances from points1 to points2

   Distance between (0,0) and (1,0) is 1.0; between (0,0) and (2,2) is sqrt(4+4)=2.8284.

2. Step 2: Calculate distances for second point

   Distance between (1,1) and (1,0) is 1.0; between (1,1) and (2,2) is sqrt(1+1)=1.4142.

3. Final Answer:

   [[1. 2.82842712] [1. 1.41421356]] -> Option A

4. Quick Check:

   Distance matrix matches calculated values [OK]

Hint: Calculate Euclidean distances pairwise for matrix [OK]

Common Mistakes:

• Mixing order of points causing wrong matrix
• Using Manhattan distance instead of Euclidean
• Confusing rows and columns in output

4. Identify the error in this code snippet:

import numpy as np
from scipy.spatial import distance_matrix
points = np.array([[0, 0], [1, 1]])
dm = distance_matrix(points)
print(dm)

medium

A. distance_matrix cannot handle integer arrays

B. distance_matrix requires two arguments, but only one is given

C. numpy array must be 1D, but points is 2D

D. print statement syntax is incorrect

Solution

1. Step 1: Check function parameters

   distance_matrix needs two arrays of points to compute distances between them.

2. Step 2: Identify missing argument

   Only one argument points is passed, so it will raise a TypeError.

3. Final Answer:

   distance_matrix requires two arguments, but only one is given -> Option B

4. Quick Check:

   Missing second argument error [OK]

Hint: distance_matrix needs two point sets as input [OK]

Common Mistakes:

• Passing only one array instead of two
• Assuming it computes distances within one set automatically
• Ignoring function signature requirements

5. You have two sets of points:

pointsA = [[0, 0], [3, 4], [6, 8]]
pointsB = [[0, 0], [0, 5]]

You want to find which point in pointsA is closest to any point in pointsB. Which approach using scipy.spatial.distance_matrix is correct?

hard

A. Compute the distance matrix, then find the minimum distance in each row

B. Compute the distance matrix, then sum all distances and pick the smallest sum

C. Compute the distance matrix, then find the maximum distance in each column

D. Compute the distance matrix, then average all distances and pick the largest average

Solution

1. Step 1: Compute distance matrix between pointsA and pointsB

   This gives distances from each point in pointsA to each point in pointsB.

2. Step 2: Find minimum distance per point in pointsA

   For each row (point in pointsA), find the smallest distance to any point in pointsB to identify closest point.

3. Final Answer:

   Compute the distance matrix, then find the minimum distance in each row -> Option A

4. Quick Check:

   Closest point = min distance per row [OK]

Hint: Minimum distance per row shows closest point [OK]

Common Mistakes:

• Using sum or average instead of minimum distance
• Finding maximum distance which is farthest, not closest
• Confusing rows and columns in the matrix