Practical uses of structured arrays in NumPy

Introduction

Structured arrays help organize different types of data together in one table. This makes it easy to work with complex data like records or mixed information.

When you have data with different types, like names (text), ages (numbers), and scores (floats).

When you want to store and access data like a spreadsheet with columns of different types.

When you need to sort or filter data based on one or more fields.

When you want to perform calculations on specific parts of your data easily.

When you want to save and load complex data efficiently.

Syntax

NumPy

import numpy as np

# Define a structured array with fields
structured_array = np.array([
    ('Alice', 25, 88.5),
    ('Bob', 30, 92.0),
    ('Charlie', 22, 79.5)
], dtype=[('name', 'U10'), ('age', 'i4'), ('score', 'f4')])

The dtype defines the fields: name (string), age (integer), score (float).

Each element is a tuple matching the fields in order.

Examples

This shows how to create an empty structured array with defined fields.

NumPy

import numpy as np

# Empty structured array with 3 fields
empty_array = np.array([], dtype=[('name', 'U10'), ('age', 'i4'), ('score', 'f4')])
print(empty_array)

Structured array with a single record.

NumPy

import numpy as np

# Structured array with one element
one_element = np.array([('Diana', 28, 85.0)], dtype=[('name', 'U10'), ('age', 'i4'), ('score', 'f4')])
print(one_element)

Access the 'name' field from the structured array.

NumPy

import numpy as np

# Accessing a field
print(one_element['name'])

Sort the structured array by the 'age' field.

NumPy

import numpy as np

# Sorting by age
sorted_array = np.sort(one_element, order='age')
print(sorted_array)

Sample Program

This program creates a structured array of students with their names, ages, and scores. It shows how to access a single field, filter by age, and sort by score.

NumPy

import numpy as np

# Create a structured array with fields: name, age, score
students = np.array([
    ('Alice', 25, 88.5),
    ('Bob', 30, 92.0),
    ('Charlie', 22, 79.5),
    ('Diana', 28, 85.0)
], dtype=[('name', 'U10'), ('age', 'i4'), ('score', 'f4')])

print("Original array:")
print(students)

# Access the 'age' field
ages = students['age']
print("\nAges:")
print(ages)

# Filter students older than 25
older_students = students[students['age'] > 25]
print("\nStudents older than 25:")
print(older_students)

# Sort students by score
sorted_by_score = np.sort(students, order='score')
print("\nStudents sorted by score:")
print(sorted_by_score)

Important Notes

Time complexity for accessing fields is O(1) because fields are stored separately.

Filtering and sorting depend on the number of elements, typically O(n) for filtering and O(n log n) for sorting.

Common mistake: forgetting to define the dtype properly, which causes errors or wrong data types.

Use structured arrays when you want to keep related data together but with different types, instead of separate arrays.

Summary

Structured arrays store mixed data types in one array with named fields.

They make it easy to access, filter, and sort complex data.

Useful for handling tabular data like records or datasets with different types.

Practice

1. What is the main advantage of using numpy structured arrays in data science?

easy

A. They allow storing different data types in one array with named fields.

B. They only store integers efficiently.

C. They automatically visualize data.

D. They replace all pandas functionality.

Solution

1. Step 1: Understand structured arrays

   Structured arrays let you store mixed data types in one array with named fields, like columns in a table.

2. Step 2: Compare options

   Only They allow storing different data types in one array with named fields. correctly describes this main advantage. Others are incorrect or unrelated.

3. Final Answer:

   They allow storing different data types in one array with named fields. -> Option A

4. Quick Check:

   Structured arrays = mixed types + named fields [OK]

Hint: Remember: structured arrays hold mixed types with names [OK]

Common Mistakes:

• Thinking structured arrays only store one data type
• Confusing structured arrays with visualization tools
• Assuming structured arrays replace pandas completely

2. Which of the following is the correct way to define a structured array with fields 'name' (string) and 'age' (integer) in numpy?

easy

A. np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'f8'), ('age', 'S10')])

B. np.array([('Alice', 25), ('Bob', 30)], dtype=[('name', 'int'), ('age', 'float')])

C. np.array([(25, 'Alice'), (30, 'Bob')], dtype=[('age', 'i4'), ('name', 'S10')])

D. np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'S10'), ('age', 'i4')])

Solution

1. Step 1: Check field names and types

   The fields are 'name' as string (bytes) and 'age' as integer. 'S10' means string of max 10 bytes, 'i4' means 4-byte integer.

2. Step 2: Validate each option

   np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'S10'), ('age', 'i4')]) matches the correct dtype and data format. np.array([('Alice', 25), ('Bob', 30)], dtype=[('name', 'int'), ('age', 'float')]) uses wrong types. np.array([(25, 'Alice'), (30, 'Bob')], dtype=[('age', 'i4'), ('name', 'S10')]) swaps fields order and data. np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'f8'), ('age', 'S10')]) swaps types incorrectly.

3. Final Answer:

   np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'S10'), ('age', 'i4')]) -> Option D

4. Quick Check:

   Correct dtype and data order = np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'S10'), ('age', 'i4')]) [OK]

Hint: Match field names and types exactly in dtype [OK]

Common Mistakes:

• Using wrong data types in dtype
• Swapping field order and data
• Not using byte strings for fixed-length strings

3. Given the structured array:

data = np.array([(b'Alice', 25), (b'Bob', 30), (b'Carol', 22)], dtype=[('name', 'S10'), ('age', 'i4')])
sorted_data = np.sort(data, order='age')

What is the output of sorted_data['name']?

medium

A. [b'Carol' b'Alice' b'Bob']

B. [b'Alice' b'Bob' b'Carol']

C. [b'Bob' b'Carol' b'Alice']

D. [b'Carol' b'Bob' b'Alice']

Solution

1. Step 1: Understand sorting by 'age'

   The array is sorted by the 'age' field ascending: 22 (Carol), 25 (Alice), 30 (Bob).

2. Step 2: Extract 'name' field after sorting

   After sorting, the 'name' field order matches sorted ages: Carol, Alice, Bob.

3. Final Answer:

   [b'Carol' b'Alice' b'Bob'] -> Option A

4. Quick Check:

   Sort by age ascending = Carol, Alice, Bob [OK]

Hint: Sort by field then check that field's order [OK]

Common Mistakes:

• Assuming original order remains after sort
• Mixing up ascending vs descending order
• Confusing field names when accessing

4. Consider this code snippet:

data = np.array([(b'Alice', 25), (b'Bob', 30)], dtype=[('name', 'S10'), ('age', 'i4')])
filtered = data[data['age'] > 25]

What is the error in this code?

medium

A. ValueError because comparison with > is invalid on structured arrays.

B. No error; it correctly filters entries with age > 25.

C. TypeError because 'age' field is not accessible.

D. SyntaxError due to wrong indexing syntax.

Solution

1. Step 1: Check filtering syntax

   Filtering structured arrays by a field with a condition like data['age'] > 25 is valid and returns a boolean mask.

2. Step 2: Confirm no errors

   The code correctly filters rows where age is greater than 25, so no error occurs.

3. Final Answer:

   No error; it correctly filters entries with age > 25. -> Option B

4. Quick Check:

   Filtering with boolean mask on field works [OK]

Hint: Use boolean masks on fields to filter structured arrays [OK]

Common Mistakes:

• Thinking structured arrays can't be filtered by fields
• Confusing syntax for filtering
• Assuming comparison operators don't work on fields

5. You have a structured array of employees with fields 'name' (string), 'age' (int), and 'salary' (float). You want to find the average salary of employees older than 30. Which code snippet correctly does this?

hard

A. avg_salary = data[data['salary'] > 30]['age'].mean()

B. avg_salary = np.mean(data['salary'] > 30)

C. avg_salary = data['salary'][data['age'] > 30].mean()

D. avg_salary = data['salary'].mean(data['age'] > 30)

Solution

1. Step 1: Filter employees older than 30

   Use boolean mask data['age'] > 30 to select salaries of employees older than 30.

2. Step 2: Calculate mean salary of filtered data

   Apply .mean() on the filtered salary array to get average salary.

3. Final Answer:

   avg_salary = data['salary'][data['age'] > 30].mean() -> Option C

4. Quick Check:

   Filter by age, then mean salary = avg_salary = data['salary'][data['age'] > 30].mean() [OK]

Hint: Filter first, then compute mean on selected field [OK]

Common Mistakes:

• Using mean on boolean arrays instead of salaries
• Mixing up fields in filtering and aggregation
• Passing filter as argument to mean() incorrectly