Preconditioners in SciPy

Introduction

Preconditioners help solve large math problems faster by making them easier for computers to handle.

When solving big systems of equations that take too long to compute.

When using iterative methods like Conjugate Gradient to find solutions.

When the problem matrix is difficult or slow to work with directly.

When you want to improve the accuracy and speed of numerical solvers.

Syntax

SciPy

from scipy.sparse.linalg import LinearOperator

# Define a preconditioner as a LinearOperator
M = LinearOperator(shape, matvec=preconditioner_function)

A preconditioner is often given as a function that approximates the inverse of the matrix.

It is wrapped in a LinearOperator so it can be used by solvers without forming full matrices.

Examples

This example creates a simple preconditioner that divides input by 2.

SciPy

from scipy.sparse.linalg import LinearOperator
import numpy as np

def preconditioner(x):
    return x / 2  # simple example

M = LinearOperator((3,3), matvec=preconditioner)

This example uses an incomplete LU factorization as a preconditioner for matrix A.

SciPy

from scipy.sparse.linalg import spilu, LinearOperator
import scipy.sparse as sp

A = sp.diags([1, 2, 3], 0)
ilu = spilu(A)
M = LinearOperator(A.shape, matvec=ilu.solve)

Sample Program

This program solves a simple system Ax = b using the Conjugate Gradient method with a preconditioner from incomplete LU factorization. It prints the solution and info about convergence (0 means success).

SciPy

import numpy as np
import scipy.sparse as sp
from scipy.sparse.linalg import cg, spilu, LinearOperator

# Create a sparse diagonal matrix
A = sp.diags([4, 5, 6], 0)

# Create a vector b
b = np.array([8, 10, 12])

# Create an incomplete LU preconditioner
ilu = spilu(A)
M = LinearOperator(A.shape, matvec=ilu.solve)

# Solve Ax = b using Conjugate Gradient with preconditioner
x, info = cg(A, b, M=M)

print('Solution x:', x)
print('Convergence info:', info)

Important Notes

Preconditioners speed up iterative solvers by improving the problem's condition.

Not all problems need preconditioners, but they help with large or tough systems.

Choosing a good preconditioner can be tricky and depends on the problem.

Summary

Preconditioners make solving big math problems faster and easier.

They are used with iterative solvers like Conjugate Gradient.

In scipy, preconditioners are LinearOperators that approximate matrix inverses.