When NumPy is not fast enough - Cheat Sheet & Quick Revision

Recall & Review

beginner

Why might NumPy sometimes be too slow for certain tasks?

NumPy can be slow when operations require complex loops or when Python-level loops are used instead of vectorized operations. It also struggles with tasks that need parallel processing or just-in-time compilation.

beginner

What is Numba and how does it help when NumPy is not fast enough?

Numba is a tool that compiles Python functions to fast machine code at runtime. It speeds up loops and numerical code by using just-in-time (JIT) compilation, making Python code run closer to C speed.

intermediate

How does using Cython improve performance beyond NumPy?

Cython lets you write Python code with optional type declarations that get compiled into C code. This reduces Python overhead and speeds up loops and calculations, especially when NumPy vectorization is not enough.

intermediate

What role does parallel processing play when NumPy is not fast enough?

Parallel processing splits work across multiple CPU cores or machines. NumPy alone is mostly single-threaded, so using parallel tools like multiprocessing or libraries like Dask can speed up large or complex computations.

beginner

When should you consider switching from NumPy to other tools for speed?

If your code has many Python loops, complex logic, or needs to run on multiple cores, and vectorized NumPy is not enough, consider tools like Numba, Cython, or parallel libraries to get better speed.

Which of these is a common reason NumPy might be slow?

A Using Python loops instead of vectorized operations

B Using vectorized NumPy functions

C Working with small arrays only

D Using built-in NumPy random functions

Python loops are slower than NumPy's vectorized operations because they run at Python speed, not optimized machine code.

What does Numba do to speed up Python code?

A Runs Python code on a GPU automatically

B Converts Python code to JavaScript

C Optimizes Python code by caching results

D Compiles Python code to fast machine code at runtime

Numba uses just-in-time compilation to turn Python functions into fast machine code.

Which tool allows adding type declarations to Python code for speed?

A Matplotlib

B Cython

C Pandas

D NumPy

Cython lets you add types and compiles Python code to C for better performance.

Why might parallel processing help when NumPy is not fast enough?

A It uses multiple CPU cores to do work at the same time

B It reduces the size of the data

C It converts data to strings

D It slows down the computation

Parallel processing splits tasks across cores to speed up computation.

When should you consider using tools like Numba or Cython?

A When you want to create plots

B When working only with small datasets

C When NumPy vectorization is not enough for speed

D When you want to write web applications

Numba and Cython help speed up code that can't be fully optimized by NumPy vectorization.

Explain why NumPy might not be fast enough for some numerical tasks and name two tools that can help improve performance.

Think about how Python loops compare to vectorized operations and what tools compile Python code.

Describe how parallel processing can enhance performance when using NumPy and give an example of a library that supports it.

Consider how dividing work helps and which Python tools can do this.

Practice

1. Why might NumPy sometimes be too slow for certain tasks?

easy

A. Because it does not support mathematical operations

B. Because it cannot handle arrays larger than 100 elements

C. Because it only works on single-core processors

D. Because it uses Python loops internally which are slow

Solution

1. Step 1: Understand NumPy's speed basis

   NumPy is fast because it uses optimized C code, but Python loops around NumPy operations can slow it down.

2. Step 2: Identify the cause of slowness

   When complex tasks require Python loops or non-vectorized code, speed drops because Python loops are slower than compiled code.

3. Final Answer:

   Because it uses Python loops internally which are slow -> Option D

4. Quick Check:

   Python loops slow NumPy = Because it uses Python loops internally which are slow [OK]

Hint: NumPy is fast with vectorized code, slow with Python loops [OK]

Common Mistakes:

• Thinking NumPy can't handle large arrays
• Believing NumPy only works on single-core CPUs
• Assuming NumPy lacks math operation support

2. Which of the following is the correct way to import Numba to speed up NumPy code?

easy

A. import numba as nb

B. import numba.speedup

C. from numba import jit

D. import numba.jit

Solution

1. Step 1: Recall Numba import syntax

   Numba's just-in-time compiler is accessed by importing jit from numba: from numba import jit.

2. Step 2: Check other options

   Options A, C, and D are invalid imports; 'import numba as nb' imports the whole module but requires nb.jit to use the decorator, while C and D do not exist.

3. Final Answer:

   from numba import jit -> Option C

4. Quick Check:

   Correct Numba import = from numba import jit [OK]

Hint: Use 'from numba import jit' to access speedup decorator [OK]

Common Mistakes:

• Trying to import submodules that don't exist
• Importing whole numba without jit
• Using incorrect import syntax

3. What will be the output of this code snippet?

import numpy as np
from numba import jit

@jit(nopython=True)
def sum_squares(n):
    total = 0
    for i in range(n):
        total += i * i
    return total

print(sum_squares(5))

medium

A. 30

B. 55

C. 10

D. Error due to jit decorator

Solution

1. Step 1: Understand the function logic

   The function sums squares of numbers from 0 to n-1. For n=5, it sums 0²+1²+2²+3²+4² = 0+1+4+9+16 = 30.

2. Step 2: Check jit decorator effect

   The jit decorator speeds up the function but does not change output. No error occurs.

3. Final Answer:

   30 -> Option A

4. Quick Check:

   Sum of squares 0 to 4 = 30 [OK]

Hint: Sum squares 0 to 4 = 30; jit doesn't change output [OK]

Common Mistakes:

• Confusing sum of squares with sum of numbers
• Expecting jit to cause errors
• Miscounting range end

4. Identify the error in this code that tries to speed up a NumPy operation using Numba:

import numpy as np
from numba import jit

@jit
def multiply_array(arr):
    return arr * 2

print(multiply_array(np.array([1, 2, 3])))

medium

A. Numba jit cannot speed up NumPy array operations directly

B. The jit decorator is missing parentheses

C. The function multiply_array must use a loop inside

D. NumPy arrays cannot be passed to jit functions

Solution

1. Step 1: Understand Numba's limitations

   Numba jit speeds up Python loops and scalar operations but does not speed up vectorized NumPy operations directly.

2. Step 2: Analyze the code behavior

   The function returns arr * 2, which is a NumPy vectorized operation. Numba jit won't speed this up; it just calls NumPy internally.

3. Final Answer:

   Numba jit cannot speed up NumPy array operations directly -> Option A

4. Quick Check:

   Numba jit doesn't speed vectorized NumPy ops = Numba jit cannot speed up NumPy array operations directly [OK]

Hint: Numba jit speeds loops, not vectorized NumPy ops [OK]

Common Mistakes:

• Thinking jit decorator syntax is wrong
• Believing jit requires loops inside
• Assuming NumPy arrays can't be used with jit

5. You have a large NumPy array and want to speed up a custom function that applies a complex calculation element-wise. Which approach is best?

hard

A. Use pure Python loops without any acceleration

B. Rewrite the function using Numba jit with a loop over array elements

C. Convert the array to a list and use list comprehensions

D. Use NumPy vectorized operations only, no jit

Solution

1. Step 1: Understand the problem context

   Complex element-wise calculations may not be vectorizable easily with NumPy, so pure vectorized operations might not work.

2. Step 2: Choose the best speedup method

   Using Numba jit with a loop over array elements compiles the loop to fast machine code, speeding up the custom calculation.

3. Step 3: Evaluate other options

   Pure Python loops and list comprehensions are slow; vectorized NumPy ops may not support complex logic.

4. Final Answer:

   Rewrite the function using Numba jit with a loop over array elements -> Option B

5. Quick Check:

   Numba jit + loops = best speedup for complex element-wise ops [OK]

Hint: Use Numba jit with loops for complex element-wise speedup [OK]

Common Mistakes:

• Relying on pure Python loops for speed
• Converting arrays to lists unnecessarily
• Assuming all complex ops can be vectorized