Masked arrays concept in NumPy - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a masked array in numpy?

A masked array is like a regular array but with a mask that hides or ignores certain elements during computations. It helps handle missing or invalid data easily.

beginner

How do you create a masked array in numpy?

You can create a masked array using numpy.ma.array(data, mask=mask_array), where mask_array is a boolean array marking elements to hide.

intermediate

What happens when you perform operations on masked arrays?

Operations ignore the masked elements, so calculations like sums or means only consider visible data, avoiding errors from missing or invalid values.

beginner

How can masked arrays help with real-world data?

They help handle missing or corrupted data points without removing entire rows or columns, making analysis more accurate and easier.

beginner

What is the difference between a masked array and a regular numpy array?

A masked array has an extra mask that marks elements to ignore, while a regular array treats all elements equally without hiding any.

What does the mask in a numpy masked array do?

A Duplicates the array

B Changes the data type of elements

C Sorts the array elements

D Marks elements to ignore in calculations

The mask is a boolean array that marks which elements to ignore during computations.

How do masked arrays handle missing data?

A They hide missing data using a mask

B They replace missing data with zeros

C They convert missing data to strings

D They remove missing data permanently

Masked arrays hide missing or invalid data using a mask, so calculations ignore those elements.

Which numpy module provides masked array functionality?

A numpy.ma

B numpy.linalg

C numpy.random

D numpy.fft

The masked array functions are in the numpy.ma module.

What is the output of sum on a masked array with some masked elements?

A Sum of all elements including masked

B Always zero

C Sum ignoring masked elements

D Error due to masked elements

Sum ignores masked elements and adds only visible data.

Which of these is a valid way to create a masked array?

A numpy.array([1, 2, 3], mask=[False, True, False])

B numpy.ma.array([1, 2, 3], mask=[False, True, False])

C numpy.masked([1, 2, 3])

D numpy.array.mask([1, 2, 3])

The correct way is to use numpy.ma.array with a mask argument.

Explain what a masked array is and why it is useful in data analysis.

Think about how you handle missing data in a spreadsheet.

Describe how you would create a masked array in numpy and perform a sum ignoring certain values.

Remember the mask is a boolean array matching the data.

Practice

1. What is the main purpose of using masked arrays in NumPy?

easy

A. To speed up array computations by using GPU

B. To sort arrays in ascending order

C. To convert arrays into lists

D. To mark certain data points as invalid without removing them

Solution

1. Step 1: Understand masked arrays concept

   Masked arrays allow marking some elements as invalid or missing without deleting them.

2. Step 2: Compare options with concept

   Only To mark certain data points as invalid without removing them correctly describes this purpose; others describe unrelated operations.

3. Final Answer:

   To mark certain data points as invalid without removing them -> Option D

4. Quick Check:

   Masked arrays = mark invalid data [OK]

Hint: Masked arrays hide invalid data without deleting it [OK]

Common Mistakes:

• Thinking masked arrays delete invalid data
• Confusing masked arrays with sorting or conversion
• Assuming masked arrays speed up GPU computations

2. Which of the following is the correct way to create a masked array from a NumPy array arr where values equal to 0 are masked?

easy

A. np.ma.masked_array(arr, mask=arr == 0)

B. np.ma.masked_where(arr, arr == 0)

C. np.ma.masked_array(arr == 0)

D. np.ma.mask(arr, arr == 0)

Solution

1. Step 1: Recall masked_array syntax

   The correct syntax is np.ma.masked_array(data, mask=condition).

2. Step 2: Match options with syntax

   np.ma.masked_array(arr, mask=arr == 0) uses np.ma.masked_array with mask=arr == 0, which is correct. np.ma.masked_where(arr, arr == 0) reverses arguments, C misses data argument, D uses invalid function.

3. Final Answer:

   np.ma.masked_array(arr, mask=arr == 0) -> Option A

4. Quick Check:

   masked_array(data, mask=condition) = np.ma.masked_array(arr, mask=arr == 0) [OK]

Hint: Use np.ma.masked_array(data, mask=condition) to mask values [OK]

Common Mistakes:

• Swapping arguments in masked_where
• Using masked_array without data argument
• Calling non-existent np.ma.mask function

3. What will be the output of the following code?

import numpy as np
arr = np.array([1, 0, 3, 0, 5])
masked_arr = np.ma.masked_array(arr, mask=(arr == 0))
print(masked_arr.sum())

medium

A. 9

B. 0

C. 9.0

D. MaskedArray with sum 9

Solution

1. Step 1: Identify masked elements

   Elements equal to 0 are masked, so only 1, 3, and 5 are counted.

2. Step 2: Calculate sum ignoring masked values

   Sum = 1 + 3 + 5 = 9. The sum() returns an integer scalar, so output is 9.

3. Final Answer:

   9 -> Option A

4. Quick Check:

   Sum ignoring masked zeros = 9 [OK]

Hint: Masked values are ignored in sum calculations [OK]

Common Mistakes:

• Thinking only masked values are summed (0)
• Expecting float output (9.0)
• Thinking print shows masked array instead of sum

4. The following code throws an error. What is the most likely cause?

import numpy as np
arr = np.array([1, 2, 3])
mask = np.array([True, False])
masked_arr = np.ma.masked_array(arr, mask=mask)

medium

A. np.ma.masked_array requires a list, not a NumPy array

B. Mask array shape does not match data array shape

C. Boolean mask must be integers, not booleans

D. Masked arrays cannot be created from 1D arrays

Solution

1. Step 1: Check shapes of data and mask

   Data array shape is (3,), mask shape is (2,), which do not match.

2. Step 2: Understand mask shape requirement

   Mask must have the same shape as data to apply element-wise masking.

3. Final Answer:

   Mask array shape does not match data array shape -> Option B

4. Quick Check:

   Mask shape must match data shape [OK]

Hint: Mask shape must match data shape exactly [OK]

Common Mistakes:

• Using mask with different shape than data
• Thinking mask must be integer array
• Believing masked_array needs list input

5. You have a dataset with some invalid temperature readings marked as -999. How would you create a masked array to ignore these invalid values and then calculate the average temperature ignoring them?

hard

A. Use np.ma.masked_where(data != -999, data) and then call .mean()

B. Replace -999 with 0 and then calculate mean normally

C. Use np.ma.masked_array(data, mask=(data == -999)) and then call .mean()

D. Filter out -999 values manually and use np.array.mean()

Solution

1. Step 1: Mask invalid values correctly

   Mask where data equals -999 to mark invalid readings.

2. Step 2: Calculate mean ignoring masked values

   Calling .mean() on masked array ignores masked elements automatically.

3. Final Answer:

   Use np.ma.masked_array(data, mask=(data == -999)) and then call .mean() -> Option C

4. Quick Check:

   Mask invalids, then mean() ignores them [OK]

Hint: Mask invalids with condition, then use .mean() [OK]

Common Mistakes:

• Replacing invalids with zero changes data meaning
• Using masked_where with wrong condition
• Manually filtering loses masked array benefits