np.linalg.norm() for vector norms in NumPy - Time & Space Complexity

Time Complexity: np.linalg.norm() for vector norms

O(n)

Understanding Time Complexity

We want to understand how the time to calculate a vector's length grows as the vector gets bigger.

How does the work needed change when the vector size increases?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import numpy as np

vector = np.array([1, 2, 3, 4, 5])
norm_value = np.linalg.norm(vector)

This code calculates the length (norm) of a vector using numpy's built-in function.

Identify Repeating Operations

Identify the loops, recursion, array traversals that repeat.

• Primary operation: Summing the squares of each element in the vector.
• How many times: Once for each element in the vector (n times).

How Execution Grows With Input

As the vector gets longer, the work grows in a straight line with the number of elements.

Input Size (n)	Approx. Operations
10	About 10 multiplications and additions
100	About 100 multiplications and additions
1000	About 1000 multiplications and additions

Pattern observation: Doubling the vector size roughly doubles the work needed.

Final Time Complexity

Time Complexity: O(n)

This means the time to find the vector length grows directly with the number of elements.

Common Mistake

[X] Wrong: "Calculating the norm takes the same time no matter how big the vector is."

[OK] Correct: The function must look at every element to compute the sum of squares, so bigger vectors take more time.

Interview Connect

Knowing how vector length calculation scales helps you understand performance in many data tasks, like measuring distances or normalizing data.

Self-Check

"What if we calculate the norm of a matrix row-wise instead of a single vector? How would the time complexity change?"

Practice

1. What does np.linalg.norm() calculate by default when given a vector?

easy

A. The maximum element in the vector

B. The sum of all vector elements

C. The Euclidean length (distance) of the vector

D. The product of all vector elements

Solution

1. Step 1: Understand the default behavior of np.linalg.norm()

   By default, np.linalg.norm() calculates the Euclidean norm, which is the straight-line distance from the origin to the point represented by the vector.

2. Step 2: Compare with other options

   The sum, max, and product are different operations and not what np.linalg.norm() returns by default.

3. Final Answer:

   The Euclidean length (distance) of the vector -> Option C

4. Quick Check:

   Default norm = Euclidean length [OK]

Hint: Default norm is Euclidean distance, not sum or max [OK]

Common Mistakes:

• Confusing norm with sum of elements
• Thinking norm returns max element
• Assuming norm multiplies elements

2. Which of the following is the correct syntax to compute the 1-norm (sum of absolute values) of a vector v using np.linalg.norm()?

easy

A. np.linalg.norm(v, order=1)

B. np.linalg.norm(v, ord=1)

C. np.linalg.norm(v, norm=1)

D. np.linalg.norm(v, p=1)

Solution

1. Step 1: Recall the parameter name for norm order

   The parameter to specify the norm order in np.linalg.norm() is ord, not order, norm, or p.

2. Step 2: Check the correct syntax

   Using ord=1 correctly computes the 1-norm, which sums the absolute values of vector elements.

3. Final Answer:

   np.linalg.norm(v, ord=1) -> Option B

4. Quick Check:

   Use ord=1 for 1-norm [OK]

Hint: Use ord=1 to specify 1-norm in np.linalg.norm() [OK]

Common Mistakes:

• Using 'order' instead of 'ord'
• Using 'norm' or 'p' as parameter names
• Omitting the ord parameter for 1-norm

3. What is the output of the following code?

import numpy as np
v = np.array([3, 4])
norm_val = np.linalg.norm(v)
print(norm_val)

medium

A. 5.0

B. 7

C. 12

D. 1

Solution

1. Step 1: Calculate the Euclidean norm of vector [3, 4]

   The Euclidean norm is sqrt(3^2 + 4^2) = sqrt(9 + 16) = sqrt(25) = 5.0.

2. Step 2: Confirm the printed output

   The code prints the norm value, which is 5.0.

3. Final Answer:

   5.0 -> Option A

4. Quick Check:

   Euclidean norm of [3,4] = 5.0 [OK]

Hint: Euclidean norm of (3,4) is 5 by Pythagoras [OK]

Common Mistakes:

• Adding elements instead of squaring and summing
• Forgetting to take square root
• Confusing norm with sum or max

4. The following code throws an error. What is the mistake?

import numpy as np
v = np.array([1, -2, 3])
norm_val = np.linalg.norm(v, order=2)
print(norm_val)

medium

A. The parameter name should be 'ord' not 'order'

B. The vector contains negative values which cause error

C. np.linalg.norm() does not accept a second argument

D. The vector must be a list, not a numpy array

Solution

1. Step 1: Identify the parameter name error

   The parameter to specify norm order is ord, not order. Using order causes a TypeError.

2. Step 2: Confirm other options are incorrect

   Negative values are allowed, np.linalg.norm accepts second argument ord, and numpy arrays are valid inputs.

3. Final Answer:

   The parameter name should be 'ord' not 'order' -> Option A

4. Quick Check:

   Use ord=2, not order=2 [OK]

Hint: Use ord= for norm order, not order= [OK]

Common Mistakes:

• Using 'order' instead of 'ord'
• Thinking negative values cause error
• Believing np.linalg.norm takes only one argument

5. You have a dataset of 2D points stored as rows in a numpy array points. You want to normalize each point to have length 1 (unit vector). Which code correctly does this using np.linalg.norm()?

hard

A. normalized = points / np.linalg.norm(points, ord=1, axis=1)

B. normalized = points / np.linalg.norm(points, axis=0)

C. normalized = points / np.linalg.norm(points)

D. normalized = points / np.linalg.norm(points, axis=1, keepdims=True)

Solution

1. Step 1: Calculate norms along rows with correct shape

   Using np.linalg.norm(points, axis=1, keepdims=True) computes the Euclidean norm for each row and keeps the result as a column vector, allowing correct broadcasting for division.

2. Step 2: Normalize each point by dividing by its norm

   Dividing points by the norms with matching shape normalizes each row vector to length 1.

3. Final Answer:

   normalized = points / np.linalg.norm(points, axis=1, keepdims=True) -> Option D

4. Quick Check:

   Use keepdims=True for correct broadcasting [OK]

Hint: Use keepdims=True to keep norm shape for division [OK]

Common Mistakes:

• Using axis=0 instead of axis=1 for row-wise normalization
• Using norm of whole array instead of per row
• Using ord=1 instead of default Euclidean norm