Broadcasting rules in Data Analysis Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is broadcasting in data analysis with Python?

Broadcasting is a way to perform operations on arrays of different shapes by automatically expanding the smaller array to match the larger one without copying data.

beginner

What are the three main broadcasting rules?

1. If arrays have different dimensions, prepend 1s to the smaller shape.
2. Arrays are compatible if their dimensions are equal or one of them is 1.
3. The resulting shape is the maximum size along each dimension.

intermediate

Why does broadcasting avoid copying data?

Broadcasting uses a virtual expansion of the smaller array by repeating its elements logically, so it doesn't create new copies, saving memory and time.

beginner

What happens if two arrays do not follow broadcasting rules?

An error occurs, usually a ValueError, because the arrays cannot be aligned for element-wise operations due to incompatible shapes.

intermediate

Example: What is the result shape when adding arrays of shapes (3,1) and (1,4)?

The result shape is (3,4) because 3 and 1 are compatible (1 is broadcast), and 1 and 4 are compatible (1 is broadcast).

Which of these pairs of shapes can be broadcast together?
A) (5,3) and (3)
B) (2,3) and (3,2)
C) (4,1) and (3,4)
D) (1,3) and (3,2)

A (5,3) and (3)

B (2,3) and (3,2)

C (4,1) and (3,4)

D (1,3) and (3,2)

Option A works because (3) is treated as (1,3) and 5 and 1 are compatible. Option C works because (4,1) and (3,4) broadcast to (3,4). Others have incompatible dimensions.

What does broadcasting do when one array has a dimension of size 1 and the other has size 5 in the same axis?

A Repeats the smaller array's elements 5 times along that axis

B Raises an error

C Ignores the smaller array

D Truncates the larger array

Broadcasting repeats the elements of the smaller array along the axis with size 1 to match the larger array's size.

If two arrays have shapes (3, 4) and (4,), what is the shape after broadcasting?

A (3, 1)

B (4, 3)

C (3, 4)

D Error

The (4,) shape is treated as (1,4), so it broadcasts to (3,4).

Which of these is NOT a broadcasting rule?

A Result shape is max size along each dimension

B Dimensions must be exactly equal or one must be 1

C Prepend 1s to smaller array shape to match dimensions

D Arrays must have the same number of elements

Arrays do not need the same number of elements, only compatible shapes per broadcasting rules.

What error is raised when broadcasting rules fail?

A TypeError

B ValueError

C IndexError

D KeyError

A ValueError is raised when arrays cannot be broadcast due to incompatible shapes.

Explain broadcasting rules in your own words and why they are useful in data analysis.

Think about how smaller arrays can 'stretch' to match bigger ones without copying data.

Describe a real-life example where broadcasting helps simplify calculations with arrays.

Imagine adding a single row or column to a table of data.

Practice

1. What does broadcasting do when working with arrays of different shapes in Python's NumPy?

easy

A. It stretches smaller arrays to match the shape of larger arrays without copying data.

B. It copies smaller arrays to make them the same size as larger arrays.

C. It only works if arrays have exactly the same shape.

D. It deletes extra elements from larger arrays to match smaller ones.

Solution

1. Step 1: Understand broadcasting concept

   Broadcasting allows operations on arrays with different shapes by stretching the smaller array.

2. Step 2: Identify how broadcasting works

   It does not copy data but virtually stretches the smaller array to match the larger one.

3. Final Answer:

   It stretches smaller arrays to match the shape of larger arrays without copying data. -> Option A

4. Quick Check:

   Broadcasting = stretching without copying [OK]

Hint: Broadcasting stretches smaller arrays without copying data [OK]

Common Mistakes:

• Thinking broadcasting copies data
• Believing arrays must have same shape
• Assuming larger arrays get shrunk

2. Which of the following code snippets correctly applies broadcasting to add a 1D array to each row of a 2D array in NumPy?

easy

A. result = arr2d + arr1d[:, np.newaxis]

B. result = arr2d.flatten() + arr1d

C. result = arr2d + arr1d.reshape(-1, 1)

D. result = arr2d + arr1d

Solution

1. Step 1: Understand shapes of arrays

   arr2d is 2D (m,n), arr1d is 1D (n,). Adding arr1d directly to arr2d adds arr1d to each row by broadcasting.

2. Step 2: Check reshaping effects

   Reshaping arr1d to column vector (A,C) causes shape incompatibility (m,n) + (n,1); flattening arr2d (D) leads to incompatible 1D shapes.

3. Final Answer:

   result = arr2d + arr1d -> Option D

4. Quick Check:

   Direct addition broadcasts 1D to rows [OK]

Hint: Add 1D array directly to 2D to broadcast rows [OK]

Common Mistakes:

• Reshaping 1D array to column vector
• Flattening the 2D array arr2d
• Confusing row vs column broadcasting

3. What is the output of the following code?

import numpy as np
arr1 = np.array([[1, 2, 3], [4, 5, 6]])
arr2 = np.array([10, 20, 30])
result = arr1 + arr2
print(result)

medium

A. [[11 22 33]
[14 25 36]]

B. [[11 22 33]
[14 25 36]
[10 20 30]]

C. [[11 12 13]
[14 15 16]]

D. Error due to shape mismatch

Solution

1. Step 1: Identify shapes of arrays

   arr1 shape is (2,3), arr2 shape is (3,). Broadcasting stretches arr2 to (2,3).

2. Step 2: Perform element-wise addition

   Add each element of arr2 to corresponding column in arr1: [[1+10,2+20,3+30],[4+10,5+20,6+30]].

3. Final Answer:

   [[11 22 33] [14 25 36]] -> Option A

4. Quick Check:

   Broadcasting adds arr2 to each row [OK]

Hint: Broadcast 1D array across rows for addition [OK]

Common Mistakes:

• Expecting error due to shape difference
• Confusing addition with multiplication
• Misreading output shape

4. The following code throws a ValueError. What is the main reason?

import numpy as np
arr1 = np.array([[1, 2], [3, 4]])
arr2 = np.array([1, 2, 3])
result = arr1 + arr2
print(result)

medium

A. arr1 should be 1D to add with arr2.

B. arr2 must be reshaped to (2,1) before addition.

C. Shapes (2,2) and (3,) are incompatible for broadcasting.

D. Addition operator '+' cannot be used with arrays.

Solution

1. Step 1: Check shapes of arrays

   arr1 shape is (2,2), arr2 shape is (3,). Broadcasting requires trailing dimensions to be equal or 1.

2. Step 2: Identify broadcasting rule violation

   Last dimensions 2 and 3 differ and neither is 1, so broadcasting fails causing ValueError.

3. Final Answer:

   Shapes (2,2) and (3,) are incompatible for broadcasting. -> Option C

4. Quick Check:

   Broadcasting needs compatible trailing dimensions [OK]

Hint: Check trailing dimensions for broadcasting compatibility [OK]

Common Mistakes:

• Assuming any shapes can broadcast
• Thinking reshaping arr2 fixes without correct shape
• Believing '+' can't add arrays

5. You have a 3D array arr3d with shape (2, 3, 4) and a 1D array arr1d with shape (4,). You want to add arr1d to each 2D slice of arr3d along the last axis. Which code correctly uses broadcasting to do this?

hard

A. result = arr3d + arr1d.reshape(2, 3, 4)

B. result = arr3d + arr1d.reshape(1, 1, 4)

C. result = arr3d + arr1d.reshape(4, 1, 1)

D. result = arr3d + arr1d.reshape(1, 4, 1)

Solution

1. Step 1: Understand shapes and broadcasting rules

   arr3d shape is (2,3,4), arr1d shape is (4,). To add along last axis, arr1d must broadcast to (1,1,4).

2. Step 2: Reshape arr1d for correct broadcasting

   Reshape arr1d to (1,1,4) so it broadcasts across first two dimensions and aligns with last dimension.

3. Step 3: Confirm addition

   Addition with arr3d + arr1d.reshape(1,1,4) works correctly by broadcasting arr1d along first two axes.

4. Final Answer:

   result = arr3d + arr1d.reshape(1, 1, 4) -> Option B

5. Quick Check:

   Reshape 1D to (1,1,last_dim) for 3D broadcasting [OK]

Hint: Reshape 1D to (1,1,last_dim) to add along last axis [OK]

Common Mistakes:

• Not reshaping arr1d or wrong reshape shape
• Confusing axis order in reshape
• Assuming direct addition always works