Performance tips and vectorization in SciPy - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

Output of vectorized operation with NumPy arrays

What is the output of this code snippet using NumPy vectorization?

SciPy

import numpy as np
arr = np.array([1, 2, 3, 4])
result = arr * 2 + 1
print(result.tolist())

A [4, 6, 8, 10]

B [1, 3, 5, 7]

C [3, 5, 7, 9]

D [2, 4, 6, 8]

💡 Hint

Remember vectorized operations apply element-wise.

Each element in the array is multiplied by 2, then 1 is added. So 1*2+1=3, 2*2+1=5, etc.

❓ data_output

intermediate

Resulting shape after vectorized matrix multiplication

Given two NumPy arrays A with shape (3, 4) and B with shape (4, 2), what is the shape of the result after np.dot(A, B)?

SciPy

import numpy as np
A = np.ones((3, 4))
B = np.ones((4, 2))
result = np.dot(A, B)
print(result.shape)

A (3, 2)

B (4, 4)

C (3, 4)

D (2, 3)

💡 Hint

Matrix multiplication shape rule: (m,n) dot (n,p) = (m,p).

The dot product of (3,4) and (4,2) results in shape (3,2).

🔧 Debug

advanced

Identify the error in vectorized code using SciPy sparse matrix

What error will this code raise when executed?

SciPy

from scipy.sparse import csr_matrix
import numpy as np

sparse_mat = csr_matrix([[1, 0], [0, 2]])
result = sparse_mat * np.array([1, 2, 3])

A IndexError: index out of bounds

B TypeError: unsupported operand type(s) for *: 'csr_matrix' and 'list'

C No error, outputs a sparse matrix

D ValueError: dimension mismatch

💡 Hint

Check the shapes of the sparse matrix and the array for multiplication compatibility.

The sparse matrix shape is (2,2) but the array has shape (3,), so multiplication fails due to dimension mismatch.

🚀 Application

advanced

Choosing vectorized approach for element-wise operation

You want to compute the square root of each element in a large NumPy array efficiently. Which approach is fastest and uses vectorization?

A Use list comprehension with math.sqrt for each element.

B Use np.sqrt(array) to compute all square roots at once.

C Use a for loop to compute sqrt for each element individually.

D Convert array to list and use map with math.sqrt.

💡 Hint

Vectorized NumPy functions are optimized for array operations.

np.sqrt is a vectorized function that applies sqrt element-wise efficiently without Python loops.

🧠 Conceptual

expert

Why vectorization improves performance in SciPy and NumPy?

Which explanation best describes why vectorization improves performance in SciPy and NumPy?

A Vectorization reduces Python-level loops by using optimized C/Fortran code that runs faster.

B Vectorization increases memory usage but slows down computation due to overhead.

C Vectorization replaces all functions with GPU code by default.

D Vectorization allows parallel execution on multiple CPUs automatically without any code changes.

💡 Hint

Think about how vectorized operations avoid slow Python loops.

Vectorization uses compiled code underneath to perform operations on whole arrays at once, avoiding slow Python loops.

Practice

1. What is the main benefit of vectorization in SciPy and NumPy?

easy

A. It makes code harder to read but more secure

B. It speeds up calculations by operating on whole arrays at once

C. It requires writing explicit loops for better control

D. It only works with small datasets

Solution

1. Step 1: Understand vectorization concept

   Vectorization means applying operations to entire arrays without explicit loops.

2. Step 2: Identify the main benefit

   This approach speeds up calculations because it uses optimized low-level code.

3. Final Answer:

   It speeds up calculations by operating on whole arrays at once -> Option B

4. Quick Check:

   Vectorization = Faster array operations [OK]

Hint: Vectorization means no loops, faster math on arrays [OK]

Common Mistakes:

• Thinking vectorization requires loops
• Believing vectorization slows code
• Assuming vectorization only works on small data

2. Which of the following is the correct way to add two NumPy arrays a and b element-wise using vectorization?

easy

A. for i in range(len(a)): c[i] = a[i] + b[i]

B. c = np.add(a, b, out=None, where=False)

C. c = a + b

D. c = a.append(b)

Solution

1. Step 1: Review vectorized addition syntax

   NumPy supports element-wise addition directly with c = a + b.

2. Step 2: Check other options

   for i in range(len(a)): c[i] = a[i] + b[i] uses a loop (not vectorized), np.add(a, b, out=None, where=False) has wrong parameters, c = a.append(b) is invalid for arrays.

3. Final Answer:

   c = a + b -> Option C

4. Quick Check:

   Use + for vectorized array addition [OK]

Hint: Use c = a + b for fast element-wise addition [OK]

Common Mistakes:

• Using loops instead of vectorized operators
• Misusing np.add with wrong parameters
• Trying to append arrays for addition

3. What will be the output of the following code?

import numpy as np
x = np.array([1, 2, 3])
y = np.array([4, 5, 6])
z = np.dot(x, y)

medium

A. 32

B. array([4, 10, 18])

C. [5, 7, 9]

D. TypeError

Solution

1. Step 1: Understand np.dot with 1D arrays

   np.dot computes the dot product (sum of element-wise products) for 1D arrays.

2. Step 2: Calculate dot product manually

   1*4 + 2*5 + 3*6 = 4 + 10 + 18 = 32

3. Final Answer:

   32 -> Option A

4. Quick Check:

   Dot product sum = 32 [OK]

Hint: np.dot sums element-wise products for 1D arrays [OK]

Common Mistakes:

• Confusing dot product with element-wise multiplication
• Expecting an array instead of a scalar
• Using wrong function for multiplication

4. Identify the error in this vectorized code snippet:

import numpy as np
arr = np.array([1, 2, 3])
result = arr * 2
print(result[3])

medium

A. IndexError because result has no element at index 3

B. TypeError due to multiplying array by integer

C. SyntaxError in array creation

D. No error, prints 6

Solution

1. Step 1: Check array size after multiplication

   Multiplying by 2 keeps array size same: result = [2, 4, 6]

2. Step 2: Accessing index 3

   Index 3 is out of bounds (valid indices: 0,1,2), causing IndexError.

3. Final Answer:

   IndexError because result has no element at index 3 -> Option A

4. Quick Check:

   Array length 3, index 3 invalid [OK]

Hint: Array indices start at 0; max index is length-1 [OK]

Common Mistakes:

• Assuming array length changes after multiplication
• Confusing IndexError with TypeError
• Ignoring zero-based indexing

5. You have a large dataset stored as a NumPy array data. You want to compute the mean of each column efficiently. Which approach is best?

hard

A. Use a for loop to sum each column and divide by number of rows

B. Use np.mean(data) without axis parameter

C. Convert array to list and use Python's built-in sum and len

D. Use np.mean(data, axis=0) to compute means vectorized

Solution

1. Step 1: Understand mean calculation per column

   Mean per column requires averaging along rows (axis=0).

2. Step 2: Identify efficient vectorized method

   np.mean with axis=0 computes column means efficiently without loops.

3. Step 3: Evaluate other options

   Use a for loop to sum each column and divide by number of rows uses slow loops, C converts to list (slow), D computes overall mean, not per column.

4. Final Answer:

   Use np.mean(data, axis=0) to compute means vectorized -> Option D

5. Quick Check:

   Vectorized mean per column = np.mean(data, axis=0) [OK]

Hint: Use np.mean with axis=0 for column-wise mean [OK]

Common Mistakes:

• Using loops instead of vectorized functions
• Forgetting axis parameter in np.mean
• Converting arrays to lists unnecessarily