Float types (float16, float32, float64) in NumPy - Step-by-Step Execution

Concept Flow - Float types (float16, float32, float64)

Start: Choose float type

↓

Create numpy array with chosen float type

↓

Store numbers in array

↓

Check memory size per element

↓

Use array for calculations

↓

Observe precision and memory trade-off

↓

End

This flow shows how to create numpy arrays with different float types, check their memory size, and understand precision differences.

Execution Sample

NumPy

import numpy as np
arr16 = np.array([1.5, 2.5], dtype=np.float16)
arr32 = np.array([1.5, 2.5], dtype=np.float32)
arr64 = np.array([1.5, 2.5], dtype=np.float64)
print(arr16.itemsize, arr32.itemsize, arr64.itemsize)

Creates three numpy arrays with float16, float32, and float64 types and prints their memory size per element.

Execution Table

Step	Action	Array Created	Data Type	Item Size (bytes)	Output
1	Create array with float16	[1.5, 2.5]	float16	2	None
2	Create array with float32	[1.5, 2.5]	float32	4	None
3	Create array with float64	[1.5, 2.5]	float64	8	None
4	Print item sizes	N/A	N/A	N/A	2 4 8
5	End	N/A	N/A	N/A	Execution complete

💡 All arrays created and item sizes printed, showing memory usage differences.

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	Final
arr16	undefined	[1.5, 2.5] (float16)	[1.5, 2.5] (float16)	[1.5, 2.5] (float16)	[1.5, 2.5] (float16)
arr32	undefined	undefined	[1.5, 2.5] (float32)	[1.5, 2.5] (float32)	[1.5, 2.5] (float32)
arr64	undefined	undefined	undefined	[1.5, 2.5] (float64)	[1.5, 2.5] (float64)

Key Moments - 2 Insights

Why does float16 use less memory than float64?

Because float16 uses 2 bytes per number while float64 uses 8 bytes, as shown in execution_table step 4 where item sizes are printed.

Does using float16 affect the precision of numbers?

Yes, float16 has less precision than float64, meaning it can store fewer decimal places accurately. This is implied by the different data types in execution_table steps 1-3.

Visual Quiz - 3 Questions

Look at the execution table at step 4, what is the item size in bytes for float32?

A 2

B 4

C 8

D 16

💡 Hint

Check the 'Item Size (bytes)' column in execution_table row for step 4.

At which step is the float64 array created?

A Step 3

B Step 2

C Step 1

D Step 4

💡 Hint

Look at the 'Action' and 'Data Type' columns in execution_table.

If you want to save memory but keep some decimal precision, which float type would you choose based on the execution?

A float64

B float16

C float32

D int32

💡 Hint

Consider the item sizes and typical precision trade-offs shown in execution_table and key_moments.

Concept Snapshot

Float types in numpy:
- float16 uses 2 bytes, less precision
- float32 uses 4 bytes, balanced precision
- float64 uses 8 bytes, highest precision
Choose based on memory vs precision needs
Use dtype parameter to set type

Full Transcript

This lesson shows how to create numpy arrays with different float types: float16, float32, and float64. Each type uses different memory sizes per number: 2, 4, and 8 bytes respectively. We create arrays with each type and print their item sizes to see the difference. Float16 uses less memory but has less precision, while float64 uses more memory but stores numbers more precisely. This helps decide which float type to use depending on your needs for memory and accuracy.

Practice

1. Which numpy float type uses the least amount of memory?

easy

A. float16

B. float32

C. float64

D. float128

Solution

1. Step 1: Recall memory sizes of float types

   float16 uses 2 bytes, float32 uses 4 bytes, and float64 uses 8 bytes.

2. Step 2: Identify the smallest memory usage

   Among these, float16 uses the least memory (2 bytes).

3. Final Answer:

   float16 -> Option A

4. Quick Check:

   Smallest memory float = float16 [OK]

Hint: Smaller float number means less memory used [OK]

Common Mistakes:

• Confusing float32 as smallest
• Thinking float64 uses less memory
• Assuming float128 is standard

2. Which of the following is the correct way to create a NumPy array with float32 type?

easy

A. np.array([1.0, 2.0], dtype='float32')

B. np.array([1.0, 2.0], type='float32')

C. np.array([1.0, 2.0], dtype=float16)

D. np.array([1.0, 2.0], float='float32')

Solution

1. Step 1: Recall correct parameter for data type in np.array

   The correct parameter is dtype, not type or float.

2. Step 2: Check correct dtype value for float32

   Using dtype='float32' is correct syntax to specify float32 type.

3. Final Answer:

   np.array([1.0, 2.0], dtype='float32') -> Option A

4. Quick Check:

   Use dtype='float32' in np.array [OK]

Hint: Use dtype='float32' to set float type in np.array [OK]

Common Mistakes:

• Using 'type' instead of 'dtype'
• Passing float='float32' parameter
• Using wrong dtype like float16 when asked for float32

3. What is the output dtype of this code?

import numpy as np
arr = np.array([1.5, 2.5], dtype=np.float16)
print(arr.dtype)

medium

A. float32

B. float64

C. int16

D. float16

Solution

1. Step 1: Check dtype argument in np.array

   The array is created with dtype=np.float16, so the array elements are stored as float16.

2. Step 2: Print dtype attribute

   Printing arr.dtype will show float16 as the data type.

3. Final Answer:

   float16 -> Option D

4. Quick Check:

   dtype set to float16 prints float16 [OK]

Hint: dtype attribute shows the array's float type [OK]

Common Mistakes:

• Assuming default float64 dtype
• Confusing float16 with float32
• Thinking dtype prints data values

4. Identify the error in this code snippet:

import numpy as np
arr = np.array([1.0, 2.0], dtype='float16')
arr = arr.astype('float32')
print(arr.dtype)

medium

A. dtype argument must be np.float32, not string

B. No error; code runs and prints float32

C. astype cannot convert float16 to float32

D. print statement syntax is wrong

Solution

1. Step 1: Check dtype usage in np.array

   Using dtype='float16' is valid and creates a float16 array.

2. Step 2: Check astype conversion and print

   astype('float32') converts array to float32 correctly. The print statement syntax is correct.

3. Final Answer:

   No error; code runs and prints float32 -> Option B

4. Quick Check:

   astype converts float16 to float32 fine [OK]

Hint: astype converts float types smoothly [OK]

Common Mistakes:

• Thinking astype can't convert float16 to float32
• Believing dtype must be np.float32 object
• Assuming print syntax error

5. You have a large dataset of decimal numbers but limited memory. You want to store the data with the smallest float type without losing too much precision. Which float type should you choose?

hard

A. float64 for maximum precision

B. int32 since decimals are not needed

C. float32 as a balance of precision and memory

D. float16 for smallest memory regardless of precision

Solution

1. Step 1: Understand memory vs precision tradeoff

   float16 uses least memory but has low precision, which may lose important decimal details.

2. Step 2: Choose float type balancing memory and precision

   float32 uses moderate memory and keeps good precision, suitable for large datasets with decimals.

3. Final Answer:

   float32 as a balance of precision and memory -> Option C

4. Quick Check:

   Balance memory and precision with float32 [OK]

Hint: Pick float32 for good precision and moderate memory [OK]

Common Mistakes:

• Choosing float16 losing too much precision
• Always picking float64 ignoring memory
• Using int32 when decimals matter