Set operations on structured data in NumPy - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a structured array in NumPy?

A structured array in NumPy is an array with named fields, like columns in a table, where each field can have a different data type.

beginner

Which NumPy function can you use to find the intersection of two structured arrays?

You can use numpy.intersect1d() to find common elements between two structured arrays.

intermediate

How does numpy.setdiff1d() work with structured arrays?

It returns the elements in the first structured array that are not in the second, comparing all fields to find differences.

intermediate

Why do you need to use the return_indices=True parameter in set operations on structured arrays?

Using return_indices=True helps you find the original positions of elements in the input arrays, which is useful for tracking data after set operations.

advanced

What is the main challenge when performing set operations on structured arrays compared to simple arrays?

The main challenge is that structured arrays have multiple fields with different data types, so comparisons must consider all fields together to identify unique or common records.

Which NumPy function finds elements common to two structured arrays?

A numpy.union1d()

B numpy.concatenate()

C numpy.setdiff1d()

D numpy.intersect1d()

numpy.intersect1d() returns the sorted, unique values that are in both input arrays.

What does numpy.setdiff1d(arr1, arr2) return for structured arrays?

A Elements in arr2 not in arr1

B Elements in arr1 not in arr2

C All elements from both arrays

D Common elements in both arrays

It returns elements that are in arr1 but not in arr2.

Why is it important to have the same data types and field names in structured arrays for set operations?

A To ensure correct element-wise comparison

B To speed up calculations

C To reduce memory usage

D It is not important

Matching data types and field names ensure that comparisons between records are accurate.

Which parameter helps you get the original indices of elements after a set operation?

A unique=True

B sort=True

C return_index=True

D axis=0

return_index=True returns the indices of the input arrays that correspond to the output elements.

What is the output type of set operations on structured arrays in NumPy?

A Structured array

B Python dictionary

C Simple NumPy array

D List of tuples

Set operations return a structured array with the same dtype as the inputs.

Explain how to perform an intersection of two structured arrays in NumPy and why it is useful.

Think about finding shared records in tables.

Describe the challenges of using set operations on structured arrays compared to simple arrays.

Consider how comparing rows with multiple columns differs from comparing single values.

Practice

1. What does the numpy.intersect1d function do when applied to two structured arrays?

easy

A. Finds rows present only in the second array

B. Combines all rows from both arrays without duplicates

C. Finds the common rows present in both arrays

D. Finds rows present only in the first array

Solution

1. Step 1: Understand intersect1d purpose

   numpy.intersect1d returns elements common to both input arrays.

2. Step 2: Apply to structured arrays

   For structured arrays, it compares rows and returns those present in both arrays.

3. Final Answer:

   Finds the common rows present in both arrays -> Option C

4. Quick Check:

   Intersection = common rows [OK]

Hint: Intersect means common elements only [OK]

Common Mistakes:

• Confusing intersect1d with union1d
• Thinking it returns unique rows from one array only
• Assuming it returns rows exclusive to one array

2. Which of the following is the correct syntax to find the union of two structured numpy arrays a and b?

easy

A. numpy.union(a | b)

B. numpy.union(a, b)

C. numpy.setunion(a, b)

D. numpy.union1d(a, b)

Solution

1. Step 1: Recall numpy union function

   The correct function to find union is numpy.union1d.

2. Step 2: Check syntax correctness

   The syntax is numpy.union1d(a, b) with two arguments.

3. Final Answer:

   numpy.union1d(a, b) -> Option D

4. Quick Check:

   Use union1d for union operation [OK]

Hint: Use union1d, not union or setunion [OK]

Common Mistakes:

• Using nonexistent functions like union or setunion
• Passing arguments incorrectly with bitwise operators
• Confusing union1d with intersect1d

3. Given two structured arrays:

a = np.array([(1, 'A'), (2, 'B'), (3, 'C')], dtype=[('id', int), ('val', 'U1')])
b = np.array([(2, 'B'), (4, 'D')], dtype=[('id', int), ('val', 'U1')])
print(np.setdiff1d(a, b))

What is the output?

medium

A. [(1, 'A') (3, 'C')]

B. [(2, 'B') (4, 'D')]

C. [(1, 'A') (2, 'B') (3, 'C')]

D. [(4, 'D')]

Solution

1. Step 1: Understand setdiff1d behavior

   np.setdiff1d(a, b) returns rows in a not in b.

2. Step 2: Compare rows of a and b

   Rows (2, 'B') is common, so excluded. Remaining are (1, 'A') and (3, 'C').

3. Final Answer:

   [(1, 'A') (3, 'C')] -> Option A

4. Quick Check:

   Difference = rows only in a [OK]

Hint: Setdiff1d returns items only in first array [OK]

Common Mistakes:

• Including common rows in output
• Confusing setdiff1d with union1d or intersect1d
• Expecting output from second array instead

4. Consider this code snippet:

a = np.array([(1, 'X'), (2, 'Y')], dtype=[('id', int), ('val', 'U1')])
b = np.array([(2, 'Y'), (3, 'Z')], dtype=[('id', int), ('val', 'U2')])
result = np.setxor1d(a, b)
print(result)

It raises an error. What is the likely cause?

medium

A. Arrays must be sorted before setxor1d

B. Structured arrays have different dtypes or field order

C. setxor1d does not support structured arrays

D. Missing import statement for numpy

Solution

1. Step 1: Check dtype compatibility

   For set operations on structured arrays, dtypes and field order must match exactly.

2. Step 2: Identify cause of error

   If dtypes differ or field order differs, setxor1d raises an error.

3. Final Answer:

   Structured arrays have different dtypes or field order -> Option B

4. Quick Check:

   Matching dtypes needed for set operations [OK]

Hint: Ensure structured arrays have identical dtypes [OK]

Common Mistakes:

• Assuming setxor1d can't handle structured arrays
• Forgetting to check dtype and field order
• Thinking arrays must be sorted first

5. You have two structured arrays representing employee records:

emp1 = np.array([(101, 'Alice'), (102, 'Bob'), (103, 'Carol')], dtype=[('id', int), ('name', 'U10')])
emp2 = np.array([(102, 'Bob'), (104, 'Dave')], dtype=[('id', int), ('name', 'U10')])

You want to find employees who are in either list but not both (exclusive employees). Which numpy function and code will give the correct result?

hard

A. np.setxor1d(emp1, emp2)

B. np.union1d(emp1, emp2)

C. np.intersect1d(emp1, emp2)

D. np.setdiff1d(emp1, emp2)

Solution

1. Step 1: Understand exclusive elements

   Exclusive employees are those in one array but not both, which is the symmetric difference.

2. Step 2: Identify correct numpy function

   np.setxor1d returns elements in either array but not in both.

3. Final Answer:

   np.setxor1d(emp1, emp2) -> Option A

4. Quick Check:

   Symmetric difference = setxor1d [OK]

Hint: Use setxor1d for exclusive elements [OK]

Common Mistakes:

• Using union1d which includes all elements
• Using intersect1d which finds common only
• Using setdiff1d which finds only one-sided difference