Monitoring memory usage in NumPy - Practice Problems & Coding Challenges

Challenge - 5 Problems

💻 Command Output

intermediate

Memory usage of a NumPy array

What is the output of the following code that checks the memory usage of a NumPy array?

NumPy

import numpy as np
arr = np.arange(1000, dtype=np.int32)
print(arr.nbytes)

A 4000

B 8000

C 1000

D 2000

💡 Hint

Each int32 element uses 4 bytes. Multiply by number of elements.

The array has 1000 elements, each 4 bytes (int32), so total memory is 4000 bytes.

🧠 Conceptual

intermediate

Understanding memory views in NumPy

Which statement correctly describes the memory usage when creating a slice view of a NumPy array?

A The slice creates a new array and copies all data, increasing memory usage.

B The slice compresses the data to save memory.

C The slice deletes the original array to free memory.

D The slice shares the original data buffer, so no extra memory is used for data.

💡 Hint

Think about whether slicing copies data or not.

NumPy slices create views sharing the same data buffer, so no extra memory is used for the data itself.

❓ Troubleshoot

advanced

Diagnosing high memory usage in NumPy arrays

You notice your Python program using too much memory when working with large NumPy arrays. Which of the following is the most likely cause?

A Using arrays with dtype float64 instead of float32 unnecessarily.

B Using array views instead of copies.

C Using np.arange instead of np.linspace for array creation.

D Using np.zeros instead of np.empty to initialize arrays.

💡 Hint

Consider how data type affects memory size per element.

float64 uses 8 bytes per element, double the memory of float32 which uses 4 bytes.

✅ Best Practice

advanced

Reducing memory footprint of large NumPy arrays

Which approach is best to reduce memory usage when storing large integer arrays in NumPy?

A Convert arrays to Python lists to save memory.

B Use dtype=np.int64 for maximum precision.

C Use dtype=np.int8 if values fit in 8 bits.

D Use object dtype to store integers flexibly.

💡 Hint

Choose the smallest integer type that fits your data.

Using smaller integer types like int8 reduces memory per element significantly.

🔀 Workflow

expert

Monitoring memory usage dynamically in a NumPy-based application

Which Python tool or method is best suited to monitor memory usage of a running Python program that uses NumPy arrays?

A Using the time module to measure execution time.

B Using the memory_profiler module with @profile decorator.

C Using the os.system('free -m') command inside the script.

D Using print statements to output arr.nbytes frequently.

💡 Hint

Look for a tool designed to measure memory usage line-by-line.

memory_profiler is a Python module that tracks memory usage of code lines, ideal for monitoring NumPy memory.

Practice

1. What does the nbytes attribute of a NumPy array represent?

easy

A. The size of each element in the array

B. The total memory in bytes used by the array data

C. The number of elements in the array

D. The number of dimensions of the array

Solution

1. Step 1: Understand what nbytes means

   The nbytes attribute gives the total number of bytes consumed by the elements of the array.

2. Step 2: Differentiate from other attributes

   Other attributes like size give element count, itemsize gives size per element, and ndim gives dimensions.

3. Final Answer:

   The total memory in bytes used by the array data -> Option B

4. Quick Check:

   nbytes = total bytes used [OK]

Hint: Remember: nbytes = total bytes used by array data [OK]

Common Mistakes:

• Confusing nbytes with size (number of elements)
• Thinking nbytes is size of one element
• Mixing nbytes with number of dimensions

2. Which of the following is the correct way to get the memory usage of a NumPy array arr?

easy

A. arr.memsize

B. arr.memory()

C. arr.size()

D. arr.nbytes

Solution

1. Step 1: Recall the attribute for memory usage

   The correct attribute to get total memory used by array data is nbytes, accessed without parentheses.

2. Step 2: Check other options for correctness

   memory() and memsize do not exist; size() is a method but returns element count, not memory.

3. Final Answer:

   arr.nbytes -> Option D

4. Quick Check:

   Use nbytes attribute, no parentheses [OK]

Hint: Use arr.nbytes without parentheses to get memory [OK]

Common Mistakes:

• Using parentheses with nbytes (it's an attribute, not a method)
• Confusing size() method with memory usage
• Trying non-existent methods like memory()

3. What is the output of the following code?

import numpy as np
arr = np.array([1, 2, 3, 4], dtype=np.int32)
print(arr.nbytes)

medium

A. 8

B. 32

C. 16

D. 4

Solution

1. Step 1: Calculate number of elements and size per element

   The array has 4 elements, each of type int32 which uses 4 bytes.

2. Step 2: Multiply elements by bytes per element

   Total bytes = 4 elements * 4 bytes = 16 bytes.

3. Final Answer:

   16 -> Option C

4. Quick Check:

   4 elements x 4 bytes = 16 bytes [OK]

Hint: Multiply element count by itemsize for nbytes [OK]

Common Mistakes:

• Assuming int32 uses 8 bytes
• Confusing nbytes with number of elements
• Forgetting to multiply by element size

4. You run this code but get an error:

import numpy as np
arr = np.array([1, 2, 3])
print(arr.nbytes())

What is the cause of the error?

medium

A. nbytes is an attribute, not a method; remove parentheses

B. Array must be created with dtype specified

C. nbytes only works on 2D arrays

D. You must import nbytes separately

Solution

1. Step 1: Identify the error cause

   The code calls arr.nbytes() with parentheses, but nbytes is an attribute, not a function.

2. Step 2: Correct usage

   Access nbytes without parentheses: arr.nbytes.

3. Final Answer:

   nbytes is an attribute, not a method; remove parentheses -> Option A

4. Quick Check:

   Attributes have no parentheses [OK]

Hint: Remember: attributes like nbytes have no parentheses [OK]

Common Mistakes:

• Adding parentheses to attributes
• Thinking dtype is required for nbytes
• Believing nbytes only works on certain array shapes

5. You have a large NumPy array big_arr with 1 million elements of type float64. You want to reduce memory usage without losing much precision. Which approach helps monitor and reduce memory usage effectively?

hard

A. Check big_arr.nbytes and convert to float32 if memory is high

B. Use big_arr.size to reduce elements by half

C. Delete big_arr and recreate with zeros

D. Convert big_arr to Python list to save memory

Solution

1. Step 1: Monitor memory usage with nbytes

   Use big_arr.nbytes to see current memory consumption in bytes.

2. Step 2: Reduce memory by changing data type

   Converting from float64 (8 bytes) to float32 (4 bytes) halves memory usage with minimal precision loss.

3. Final Answer:

   Check big_arr.nbytes and convert to float32 if memory is high -> Option A

4. Quick Check:

   Use nbytes + dtype change to reduce memory [OK]

Hint: Check nbytes then downcast dtype to save memory [OK]

Common Mistakes:

• Using size instead of nbytes to measure memory
• Converting to Python list increases memory
• Deleting array without monitoring memory