Solving linear systems (solve) in SciPy - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the purpose of the scipy.linalg.solve function?

It solves a system of linear equations Ax = b for x, where A is a square matrix and b is a vector or matrix of constants.

beginner

What are the input requirements for scipy.linalg.solve?

The matrix A must be square (same number of rows and columns), and b must have a compatible shape (same number of rows as A).

intermediate

What happens if the matrix A is singular or nearly singular when using scipy.linalg.solve?

The function will raise a LinAlgError because the system does not have a unique solution or is unstable to solve.

intermediate

How does scipy.linalg.solve differ from using matrix inversion to solve Ax = b?

It is more efficient and numerically stable to use solve directly rather than computing the inverse of A and multiplying by b.

beginner

Write a simple example code snippet using scipy.linalg.solve to solve the system:
2x + 3y = 8
5x + 4y = 13

import numpy as np
from scipy.linalg import solve

A = np.array([[2, 3], [5, 4]])
b = np.array([8, 13])
x = solve(A, b)
print(x)  # Output: [1. 2.]

What shape must matrix A have to use scipy.linalg.solve?

A Any rectangular matrix

B Square matrix

C Only diagonal matrix

D Only identity matrix

The matrix A must be square to solve Ax = b uniquely.

If A is singular, what does scipy.linalg.solve do?

A Raises a <code>LinAlgError</code>

B Automatically inverts <code>A</code>

C Returns zeros

D Returns a solution anyway

Singular matrices do not have unique solutions, so LinAlgError is raised.

Which is better for solving Ax = b numerically?

A Using <code>solve</code> function

B Calculating <code>A</code> inverse and multiplying by <code>b</code>

C Guessing the solution

D Using random numbers

solve is more efficient and stable than calculating the inverse.

What does the output of scipy.linalg.solve(A, b) represent?

A The matrix <code>A</code> multiplied by <code>b</code>

B The inverse of <code>A</code>

C The vector <code>x</code> that satisfies <code>Ax = b</code>

D The determinant of <code>A</code>

The output is the solution vector x.

Which library provides the solve function used here?

A pandas

B numpy.linalg

C matplotlib

D scipy.linalg

solve is from scipy.linalg.

Explain how to use scipy.linalg.solve to solve a system of linear equations.

Think about the inputs and outputs of the function.

Describe why using scipy.linalg.solve is preferred over calculating the inverse of a matrix to solve linear systems.

Consider performance and accuracy.

Practice

1. What does the scipy.linalg.solve function do in solving linear systems?

easy

A. It finds the exact solution vector for a system of linear equations.

B. It approximates the solution using random guesses.

C. It only checks if the system has any solution without solving.

D. It multiplies two matrices together.

Solution

1. Step 1: Understand the purpose of scipy.linalg.solve

   This function is designed to solve linear systems of the form Ax = b, where A is a matrix and b is a vector.

2. Step 2: Identify the output of the function

   The function returns the vector x that exactly satisfies the equation Ax = b.

3. Final Answer:

   It finds the exact solution vector for a system of linear equations. -> Option A

4. Quick Check:

   Function purpose = exact solution vector [OK]

Hint: Remember: solve() returns exact solutions, not guesses. [OK]

Common Mistakes:

• Thinking solve() approximates solutions
• Confusing solve() with matrix multiplication
• Assuming solve() only checks for solution existence

2. Which of the following is the correct way to import the solve function from scipy.linalg?

easy

A. from scipy.linalg import solve

B. import solve from scipy.linalg

C. from scipy import solve.linalg

D. import scipy.solve.linalg

Solution

1. Step 1: Recall Python import syntax for functions

   To import a specific function from a module, use from module import function.

2. Step 2: Match the correct module and function

   The function solve is inside the scipy.linalg module, so the correct import is from scipy.linalg import solve.

3. Final Answer:

   from scipy.linalg import solve -> Option A

4. Quick Check:

   Correct import syntax = from scipy.linalg import solve [OK]

Hint: Use 'from module import function' for specific imports. [OK]

Common Mistakes:

• Using 'import solve from ...' which is invalid syntax
• Trying to import submodules as functions
• Using dot notation incorrectly in import statements

3. What is the output of this code?

import numpy as np
from scipy.linalg import solve
A = np.array([[2, 1], [1, 3]])
b = np.array([10, 15])
x = solve(A, b)
print(x)

medium

A. [4. 3.]

B. [3. 4.]

C. [2. 5.]

D. [5. 2.]

Solution

1. Step 1: Set up the system of equations

   The matrix A and vector b represent the system:
   2x + y = 10
   x + 3y = 15

2. Step 2: Solve the system manually

   Solving manually:
   Multiply first equation by 3: 6x + 3y = 30
   Subtract second equation: 5x = 15 -> x = 3
   y = 10 - 2*3 = 4
   Thus, x = [3. 4.], which matches the output of solve(A, b).

3. Final Answer:

   [3. 4.] -> Option B

4. Quick Check:

   solve(A,b) output = [3. 4.] [OK]

Hint: Trust solve() output for exact numeric solutions. [OK]

Common Mistakes:

• Mixing up order of solution vector
• Trying to solve manually without decimals
• Assuming integer solutions only

4. What is wrong with this code snippet?

import numpy as np
from scipy.linalg import solve
A = np.array([[1, 2], [2, 4]])
b = np.array([5, 10])
x = solve(A, b)
print(x)

medium

A. The code will run and print the solution without issues.

B. Vector b has wrong shape and causes a syntax error.

C. The import statement is incorrect.

D. Matrix A is singular (not invertible), so solve() will raise an error.

Solution

1. Step 1: Check matrix A properties

   Matrix A = [[1, 2], [2, 4]] has rows that are multiples (second row = 2 * first row), so it is singular (determinant = 0).

2. Step 2: Understand solve() behavior with singular matrices

   Since A is singular, it cannot be inverted, so solve() will raise a LinAlgError indicating the matrix is singular.

3. Final Answer:

   Matrix A is singular (not invertible), so solve() will raise an error. -> Option D

4. Quick Check:

   Singular matrix causes error in solve() [OK]

Hint: Check if matrix rows are multiples before solving. [OK]

Common Mistakes:

• Ignoring singular matrix errors
• Assuming solve() works for all matrices
• Confusing vector shape errors with matrix singularity

5. You have a system of 3 equations with 3 unknowns:

A = [[1, 2, 3], [0, 1, 4], [5, 6, 0]]
b = [11, 7, 28]

Using scipy.linalg.solve, what is the solution vector x?

hard

A. [1. 2. 3.]

B. [0. 1. 2.]

C. [2. 3. 1.]

D. [3. 1. 2.]

Solution

1. Step 1: Write the system of equations

   The system is:
   1x + 2y + 3z = 11
   0x + 1y + 4z = 7
   5x + 6y + 0z = 28

2. Step 2: Solve the system using substitution

   From second equation: y = 7 - 4z
   Substitute into first: x + 2(7 - 4z) + 3z = 11 -> x + 14 - 8z + 3z = 11 -> x - 5z = -3 -> x = -3 + 5z
   Substitute into third: 5(-3 + 5z) + 6(7 - 4z) = 28 -> -15 + 25z + 42 - 24z = 28 -> z + 27 = 28 -> z = 1
   y = 7 - 4*1 = 3
   x = -3 + 5*1 = 2
   Thus, x = [2. 3. 1.]

3. Final Answer:

   [2. 3. 1.] -> Option C

4. Quick Check:

   solve(A,b) = [2. 3. 1.] [OK]

Hint: Use solve() to avoid manual errors in 3x3 systems. [OK]

Common Mistakes:

• Manual calculation errors with substitution
• Mixing variable order in solution vector
• Ignoring code output for complex systems