CSR format (Compressed Sparse Row) in SciPy - Step-by-Step Execution

Concept Flow - CSR format (Compressed Sparse Row)

Start with Sparse Matrix

↓

Extract non-zero values

↓

Record column indices of non-zeros

↓

Build row pointer array

↓

Store as CSR format: data, indices, indptr

CSR format stores a sparse matrix by saving only non-zero values, their column positions, and pointers to row starts.

Execution Sample

SciPy

import numpy as np
from scipy.sparse import csr_matrix

matrix = np.array([[0,0,1],[2,0,0],[0,3,0]])
csr = csr_matrix(matrix)
print(csr.data)
print(csr.indices)
print(csr.indptr)

This code converts a dense matrix to CSR format and prints its internal arrays.

Execution Table

Step	Action	Data Array	Indices Array	Indptr Array
1	Start with matrix [[0,0,1],[2,0,0],[0,3,0]]
2	Extract non-zero values	[1, 2, 3]
3	Record column indices of non-zeros	[1, 2, 3]	[2, 0, 1]
4	Build row pointer array	[1, 2, 3]	[2, 0, 1]	[0, 1, 2, 3]
5	Store as CSR format	[1, 2, 3]	[2, 0, 1]	[0, 1, 2, 3]

💡 CSR arrays fully built representing the sparse matrix.

Variable Tracker

Variable	Start	After Step 2	After Step 3	After Step 4	Final
data	[]	[1, 2, 3]	[1, 2, 3]	[1, 2, 3]	[1, 2, 3]
indices	[]	[]	[2, 0, 1]	[2, 0, 1]	[2, 0, 1]
indptr	[0]	[0]	[0]	[0, 1, 2, 3]	[0, 1, 2, 3]

Key Moments - 2 Insights

Why does the 'indices' array have values [2, 0, 1] instead of sorted?

The 'indices' array records the column positions of non-zero values in the order they appear row-wise, matching the original matrix layout (see execution_table step 3).

What does the 'indptr' array represent?

'indptr' shows where each row's data starts in the 'data' array. For example, indptr[1]=1 means row 1's data starts at data[1] (see execution_table step 4).

Visual Quiz - 3 Questions

Look at the execution_table at step 3, what is the value of indices[1]?

A 2

B 1

C 0

D 3

💡 Hint

Check the 'indices' array column in execution_table row for step 3.

At which step does the 'indptr' array get its final form?

A Step 2

B Step 4

C Step 3

D Step 5

💡 Hint

Look at the 'indptr' column in execution_table and see when it changes from [0] to [0,1,2,3].

If the matrix had an extra zero row at the end, how would 'indptr' change?

A [0, 1, 2, 3, 3]

B [0, 1, 2, 3]

C [0, 1, 2, 3, 4]

D [0, 1, 2, 4]

💡 Hint

The last number in 'indptr' equals total non-zero elements; zero row adds no new data but adds a pointer.

Concept Snapshot

CSR format stores sparse matrices efficiently by:
- data: non-zero values in row order
- indices: column indices of these values
- indptr: pointers to row starts in data
Use csr_matrix() in scipy to convert dense to CSR
Access arrays via .data, .indices, .indptr

Full Transcript

CSR format compresses sparse matrices by storing only non-zero values, their column positions, and row start pointers. The example matrix [[0,0,1],[2,0,0],[0,3,0]] has non-zero values [1,2,3]. Their column indices are [2,0,1] respectively. The indptr array [0,1,2,3] marks where each row's data starts in the data array. This structure saves memory and speeds up matrix operations. The execution table shows step-by-step how these arrays build up. Key points include understanding that indices follow the order of non-zero elements row-wise and indptr length is number of rows plus one. Quizzes test understanding of these arrays and their changes.

Practice

1. What is the main advantage of using the CSR format for storing matrices in data science?

easy

A. It stores all elements including zeros for faster access.

B. It saves memory by storing only non-zero elements and their positions.

C. It converts matrices into a list of lists format.

D. It automatically normalizes the matrix values.

Solution

1. Step 1: Understand CSR format purpose

   CSR format is designed to save space by storing only non-zero values and their positions in the matrix.

2. Step 2: Compare options with CSR features

   It saves memory by storing only non-zero elements and their positions. correctly describes this space-saving feature. Other options describe unrelated or incorrect features.

3. Final Answer:

   It saves memory by storing only non-zero elements and their positions. -> Option B

4. Quick Check:

   CSR = stores non-zero only [OK]

Hint: Remember CSR stores only non-zero values and their indices [OK]

Common Mistakes:

• Thinking CSR stores all elements including zeros
• Confusing CSR with dense matrix formats
• Assuming CSR normalizes data automatically

2. Which of the following is the correct way to create a CSR matrix from a dense NumPy array arr using SciPy?

easy

A. csr_matrix.to_csr(arr)

B. csr(arr)

C. sparse.csr(arr)

D. csr_matrix(arr)

Solution

1. Step 1: Recall SciPy CSR matrix creation syntax

   The correct function to create a CSR matrix from a dense array is csr_matrix() from scipy.sparse.

2. Step 2: Check each option

   csr_matrix(arr) uses the correct function name and syntax. Options B, C, and D are incorrect or invalid function calls.

3. Final Answer:

   csr_matrix(arr) -> Option D

4. Quick Check:

   Use csr_matrix() to convert dense to CSR [OK]

Hint: Use csr_matrix() function from scipy.sparse [OK]

Common Mistakes:

• Using incorrect function names like csr() or sparse.csr()
• Trying to call to_csr() method which doesn't exist
• Confusing with other sparse formats like COO

3. Given the following code, what will be the output of print(csr.data)?

import numpy as np
from scipy.sparse import csr_matrix

arr = np.array([[0, 0, 1], [2, 0, 0], [0, 3, 0]])
csr = csr_matrix(arr)
print(csr.data)

medium

A. [1 2 3]

B. [0 0 1 2 0 0 0 3 0]

C. [1 2 0 3]

D. [1 2 3 0]

Solution

1. Step 1: Understand csr.data attribute

   The data attribute of a CSR matrix stores only the non-zero values in row-major order.

2. Step 2: Identify non-zero elements in arr

   The non-zero elements are 1 (row 0, col 2), 2 (row 1, col 0), and 3 (row 2, col 1). So csr.data will be [1, 2, 3].

3. Final Answer:

   [1 2 3] -> Option A

4. Quick Check:

   csr.data = non-zero values list [OK]

Hint: csr.data holds only non-zero values in order [OK]

Common Mistakes:

• Expecting csr.data to include zeros
• Confusing csr.data with the full dense array
• Misordering the non-zero elements

4. Identify the error in the following code snippet that attempts to create a CSR matrix:

from scipy.sparse import csr_matrix

arr = [[0, 1], [2, 0]]
csr = csr_matrix(arr, shape=(2, 1))
print(csr.shape)

medium

A. The shape parameter is incompatible with the input array size.

B. The input array must be a NumPy array, not a list.

C. csr_matrix does not accept the shape parameter.

D. The print statement syntax is incorrect.

Solution

1. Step 1: Check input array and shape parameter

   The input array has shape (2, 2), but the shape parameter is set to (2, 1), which conflicts.

2. Step 2: Understand csr_matrix shape rules

   The shape parameter must match or be compatible with the input data shape. Here, (2, 1) is incompatible with (2, 2) input.

3. Final Answer:

   The shape parameter is incompatible with the input array size. -> Option A

4. Quick Check:

   Shape must match input array size [OK]

Hint: Ensure shape matches input array dimensions [OK]

Common Mistakes:

• Assuming lists cannot be input to csr_matrix
• Thinking csr_matrix disallows shape parameter
• Misreading print statement as error

5. You have a large sparse matrix representing user-item ratings with many zeros. You want to efficiently compute the sum of all ratings for each user (row). Which approach using CSR format is best?

hard

A. Use the CSR matrix's sum(axis=0) method to sum rows.

B. Convert the CSR matrix back to a dense array and use NumPy sum along axis 1.

C. Use the CSR matrix's sum(axis=1) method to sum non-zero values per row efficiently.

D. Manually iterate over all elements including zeros to sum each row.

Solution

1. Step 1: Understand CSR matrix row sum

   CSR format stores data row-wise, so summing along axis 1 is efficient and skips zeros.

2. Step 2: Evaluate options for efficiency

   Use the CSR matrix's sum(axis=1) method to sum non-zero values per row efficiently. uses sum(axis=1) directly on CSR, which is fast and memory efficient. Convert the CSR matrix back to a dense array and use NumPy sum along axis 1. wastes memory converting to dense. Manually iterate over all elements including zeros to sum each row. is slow. Use the CSR matrix's sum(axis=0) method to sum rows. sums columns, not rows.

3. Final Answer:

   Use the CSR matrix's sum(axis=1) method to sum non-zero values per row efficiently. -> Option C

4. Quick Check:

   Sum rows with csr.sum(axis=1) [OK]

Hint: Sum rows with csr.sum(axis=1) for efficiency [OK]

Common Mistakes:

• Converting to dense wastes memory
• Summing axis=0 sums columns, not rows
• Iterating manually is slow and unnecessary