Memory layout (C-order vs Fortran-order) in NumPy

Introduction

Memory layout shows how data is stored in computer memory. It helps programs access data faster.

When you want to speed up calculations on large arrays.

When you share data between programs that expect different memory layouts.

When you want to understand how numpy stores arrays internally.

When you need to save or load arrays efficiently.

When you want to optimize memory usage for big data.

Syntax

NumPy

import numpy as np

# Create array with C-order (row-major)
array_c = np.array([[1, 2], [3, 4]], order='C')

# Create array with Fortran-order (column-major)
array_f = np.array([[1, 2], [3, 4]], order='F')

order='C' means rows are stored one after another (row-major).

order='F' means columns are stored one after another (column-major).

Examples

Empty array still has C-order layout flag True.

NumPy

import numpy as np

# Empty array with C-order
empty_c = np.empty((0, 3), order='C')
print(empty_c)
print(empty_c.flags['C_CONTIGUOUS'])

Single element array can be Fortran contiguous.

NumPy

import numpy as np

# Single element array with Fortran-order
single_f = np.array([42], order='F')
print(single_f)
print(single_f.flags['F_CONTIGUOUS'])

C-order array is C contiguous but not Fortran contiguous.

NumPy

import numpy as np

# Array with C-order
array_c = np.array([[1, 2], [3, 4]], order='C')
print(array_c.flags['C_CONTIGUOUS'])
print(array_c.flags['F_CONTIGUOUS'])

Fortran-order array is Fortran contiguous but not C contiguous.

NumPy

import numpy as np

# Array with Fortran-order
array_f = np.array([[1, 2], [3, 4]], order='F')
print(array_f.flags['F_CONTIGUOUS'])
print(array_f.flags['C_CONTIGUOUS'])

Sample Program

This program creates the same 2x3 array twice: once with C-order and once with Fortran-order. It prints the arrays and shows which memory layout they use.

NumPy

import numpy as np

# Create a 2x3 array in C-order
array_c = np.array([[10, 20, 30], [40, 50, 60]], order='C')
print("Array in C-order:")
print(array_c)
print("Is C contiguous?", array_c.flags['C_CONTIGUOUS'])
print("Is Fortran contiguous?", array_c.flags['F_CONTIGUOUS'])

# Create the same array in Fortran-order
array_f = np.array([[10, 20, 30], [40, 50, 60]], order='F')
print("\nArray in Fortran-order:")
print(array_f)
print("Is C contiguous?", array_f.flags['C_CONTIGUOUS'])
print("Is Fortran contiguous?", array_f.flags['F_CONTIGUOUS'])

Important Notes

Time complexity: Memory layout does not affect time to create arrays but affects speed of some operations.

Space complexity: Both layouts use the same amount of memory.

Common mistake: Assuming all numpy arrays are C-contiguous by default.

Use C-order when you process data row by row, Fortran-order when processing column by column.

Summary

Memory layout controls how array data is stored in memory.

C-order stores rows one after another; Fortran-order stores columns one after another.

Choosing the right layout can improve speed and compatibility.

Practice

1. What does C-order memory layout mean in NumPy arrays?

easy

A. Rows are stored one after another in memory.

B. Columns are stored one after another in memory.

C. Data is stored randomly in memory.

D. Memory layout depends on the array shape only.

Solution

1. Step 1: Understand C-order layout

   C-order means the array stores data row by row, so all elements of the first row come first, then the second row, and so on.

2. Step 2: Compare with other layouts

   Fortran-order stores columns one after another, not rows. Random or shape-based storage is incorrect.

3. Final Answer:

   Rows are stored one after another in memory. -> Option A

4. Quick Check:

   C-order = rows stored sequentially [OK]

Hint: C-order means row-wise storage in memory [OK]

Common Mistakes:

• Confusing C-order with Fortran-order
• Thinking memory layout depends only on shape
• Assuming random storage order

2. Which of the following is the correct way to create a NumPy array with Fortran-order memory layout?

easy

A. np.array([[1, 2], [3, 4]], order='C')

B. np.array([[1, 2], [3, 4]], order='F')

C. np.array([[1, 2], [3, 4]], layout='F')

D. np.array([[1, 2], [3, 4]], memory='Fortran')

Solution

1. Step 1: Recall NumPy array creation syntax

   NumPy uses the parameter 'order' to specify memory layout, with 'C' for C-order and 'F' for Fortran-order.

2. Step 2: Identify correct parameter and value

   np.array([[1, 2], [3, 4]], order='F') uses order='F', which is the correct way to request Fortran-order layout.

3. Final Answer:

   np.array([[1, 2], [3, 4]], order='F') -> Option B

4. Quick Check:

   Use order='F' for Fortran-order arrays [OK]

Hint: Use order='F' to create Fortran-order arrays [OK]

Common Mistakes:

• Using wrong parameter name like 'layout' or 'memory'
• Confusing order='C' with Fortran-order
• Omitting the order parameter

3. What will be the output of the following code?

import numpy as np
arr = np.array([[1, 2], [3, 4]], order='F')
print(arr.flags.f_contiguous)

medium

A. True

B. False

C. Raises an error

D. None

Solution

1. Step 1: Understand the array creation

   The array is created with order='F', so it uses Fortran-order memory layout.

2. Step 2: Check the f_contiguous flag

   The f_contiguous flag is True if the array is stored in Fortran-contiguous order, which matches order='F'.

3. Final Answer:

   True -> Option A

4. Quick Check:

   Fortran-order array has f_contiguous = True [OK]

Hint: f_contiguous is True for Fortran-order arrays [OK]

Common Mistakes:

• Confusing f_contiguous with c_contiguous
• Expecting False for order='F'
• Thinking flags attribute raises error

4. The following code is intended to create a Fortran-order array, but it does not. What is the error?

import numpy as np
arr = np.array([[1, 2], [3, 4]])
arr = np.asfortranarray(arr, order='C')

medium

A. np.array must have order='F' to create Fortran array.

B. order='C' forces C-order, not Fortran-order.

C. np.asfortranarray does not accept 'order' parameter.

D. arr is immutable and cannot change order.

Solution

1. Step 1: Understand np.asfortranarray usage

   np.asfortranarray converts an array to Fortran-order. It does not take an 'order' parameter.

2. Step 2: Analyze the incorrect parameter

   Passing order='C' is an unexpected keyword argument, causing a TypeError that prevents creating the Fortran-order array.

3. Final Answer:

   np.asfortranarray does not accept 'order' parameter. -> Option C

4. Quick Check:

   np.asfortranarray rejects 'order' parameter [OK]

Hint: np.asfortranarray does not accept 'order' parameter [OK]

Common Mistakes:

• Assuming np.asfortranarray accepts order parameter
• Thinking order='C' overrides Fortran layout
• Thinking arrays are immutable in this context

5. You have a large 2D NumPy array representing image data. You want to speed up column-wise operations. Which memory layout should you choose and why?

hard

A. C-order, because rows are stored consecutively, speeding up column access.

B. Either layout works the same for column-wise operations.

C. Use random memory layout for better cache usage.

D. Fortran-order, because columns are stored consecutively, speeding up column access.

Solution

1. Step 1: Understand memory layout impact on access

   For column-wise operations, accessing consecutive memory locations improves speed due to cache efficiency.

2. Step 2: Identify layout matching column-wise access

   Fortran-order stores columns consecutively, so column-wise operations are faster with Fortran-order.

3. Step 3: Evaluate other options

   C-order stores rows consecutively, so column access is slower. Random layout is not a valid option.

4. Final Answer:

   Fortran-order, because columns are stored consecutively, speeding up column access. -> Option D

5. Quick Check:

   For column speed, use Fortran-order [OK]

Hint: For column operations, choose Fortran-order layout [OK]

Common Mistakes:

• Choosing C-order for column-wise speed
• Thinking layout does not affect speed
• Believing random layout improves cache