Distance matrix computation in SciPy - Time & Space Complexity

Time Complexity: Distance matrix computation

O(n²)

Understanding Time Complexity

When we compute a distance matrix, we find distances between many pairs of points.

We want to know how the time needed grows as we add more points.

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import numpy as np
from scipy.spatial import distance_matrix

n = 100  # example number of points
points = np.random.rand(n, 2)  # n points in 2D
D = distance_matrix(points, points)
    

This code creates n random points and computes the full distance matrix between them.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Calculating distance between each pair of points.
• How many times: For n points, distances are computed for all n x n pairs.

How Execution Grows With Input

As the number of points grows, the number of distance calculations grows quickly.

Input Size (n)	Approx. Operations
10	100
100	10,000
1000	1,000,000

Pattern observation: The operations grow roughly by the square of n, so doubling points makes calculations about four times more.

Final Time Complexity

Time Complexity: O(n²)

This means the time needed grows roughly with the square of the number of points.

Common Mistake

[X] Wrong: "Computing distances grows linearly with the number of points."

[OK] Correct: Each point's distance is calculated to every other point, so the total pairs grow much faster than just the number of points.

Interview Connect

Understanding how distance matrix computation scales helps you explain performance in data tasks involving many points.

Self-Check

"What if we only compute distances between points in two different sets instead of one set to itself? How would the time complexity change?"

Practice

1. What does the scipy.spatial.distance_matrix function compute?

easy

A. The average value of a list of numbers

B. The sum of all points in a dataset

C. The distances between all pairs of points in two sets

D. The maximum value in a dataset

Solution

1. Step 1: Understand the function purpose

   scipy.spatial.distance_matrix calculates distances between points, not sums or averages.

2. Step 2: Identify what is computed

   It returns a matrix showing distances between each point in one set to each point in another set.

3. Final Answer:

   The distances between all pairs of points in two sets -> Option C

4. Quick Check:

   Distance matrix = pairwise distances [OK]

Hint: Distance matrix = all pair distances between points [OK]

Common Mistakes:

• Confusing distance matrix with sum or average calculations
• Thinking it returns a single distance value
• Assuming it only works for one set of points

2. Which of the following is the correct way to import the distance_matrix function from scipy?

easy

A. import scipy.distance_matrix

B. import distance_matrix from scipy.spatial

C. from scipy import distance_matrix

D. from scipy.spatial import distance_matrix

Solution

1. Step 1: Recall correct import syntax

   Functions inside modules are imported using from module import function.

2. Step 2: Match with scipy structure

   distance_matrix is inside scipy.spatial, so correct import is from scipy.spatial import distance_matrix.

3. Final Answer:

   from scipy.spatial import distance_matrix -> Option D

4. Quick Check:

   Correct import syntax = from scipy.spatial import distance_matrix [OK]

Hint: Use 'from module import function' for specific imports [OK]

Common Mistakes:

• Using 'import scipy.distance_matrix' which is invalid
• Trying 'from scipy import distance_matrix' ignoring submodules
• Incorrect order like 'import distance_matrix from ...'

3. What is the output of this code?

import numpy as np
from scipy.spatial import distance_matrix
points1 = np.array([[0, 0], [1, 1]])
points2 = np.array([[1, 0], [2, 2]])
dm = distance_matrix(points1, points2)
print(dm)

medium

A. [[1. 2.82842712]
[1. 1.41421356]]

B. [[0. 1.41421356]
[1. 2.23606798]]

C. [[1.41421356 2.23606798]
[0. 1.41421356]]

D. [[1. 1.41421356]
[1.41421356 2.82842712]]

Solution

1. Step 1: Calculate distances from points1 to points2

   Distance between (0,0) and (1,0) is 1.0; between (0,0) and (2,2) is sqrt(4+4)=2.8284.

2. Step 2: Calculate distances for second point

   Distance between (1,1) and (1,0) is 1.0; between (1,1) and (2,2) is sqrt(1+1)=1.4142.

3. Final Answer:

   [[1. 2.82842712] [1. 1.41421356]] -> Option A

4. Quick Check:

   Distance matrix matches calculated values [OK]

Hint: Calculate Euclidean distances pairwise for matrix [OK]

Common Mistakes:

• Mixing order of points causing wrong matrix
• Using Manhattan distance instead of Euclidean
• Confusing rows and columns in output

4. Identify the error in this code snippet:

import numpy as np
from scipy.spatial import distance_matrix
points = np.array([[0, 0], [1, 1]])
dm = distance_matrix(points)
print(dm)

medium

A. distance_matrix cannot handle integer arrays

B. distance_matrix requires two arguments, but only one is given

C. numpy array must be 1D, but points is 2D

D. print statement syntax is incorrect

Solution

1. Step 1: Check function parameters

   distance_matrix needs two arrays of points to compute distances between them.

2. Step 2: Identify missing argument

   Only one argument points is passed, so it will raise a TypeError.

3. Final Answer:

   distance_matrix requires two arguments, but only one is given -> Option B

4. Quick Check:

   Missing second argument error [OK]

Hint: distance_matrix needs two point sets as input [OK]

Common Mistakes:

• Passing only one array instead of two
• Assuming it computes distances within one set automatically
• Ignoring function signature requirements

5. You have two sets of points:

pointsA = [[0, 0], [3, 4], [6, 8]]
pointsB = [[0, 0], [0, 5]]

You want to find which point in pointsA is closest to any point in pointsB. Which approach using scipy.spatial.distance_matrix is correct?

hard

A. Compute the distance matrix, then find the minimum distance in each row

B. Compute the distance matrix, then sum all distances and pick the smallest sum

C. Compute the distance matrix, then find the maximum distance in each column

D. Compute the distance matrix, then average all distances and pick the largest average

Solution

1. Step 1: Compute distance matrix between pointsA and pointsB

   This gives distances from each point in pointsA to each point in pointsB.

2. Step 2: Find minimum distance per point in pointsA

   For each row (point in pointsA), find the smallest distance to any point in pointsB to identify closest point.

3. Final Answer:

   Compute the distance matrix, then find the minimum distance in each row -> Option A

4. Quick Check:

   Closest point = min distance per row [OK]

Hint: Minimum distance per row shows closest point [OK]

Common Mistakes:

• Using sum or average instead of minimum distance
• Finding maximum distance which is farthest, not closest
• Confusing rows and columns in the matrix