Constrained optimization in SciPy - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is constrained optimization?

Constrained optimization is a way to find the best solution to a problem while following some rules or limits called constraints.

beginner

Name two types of constraints in optimization problems.

Two common types of constraints are:<br>1. Equality constraints (e.g., x + y = 10)<br>2. Inequality constraints (e.g., x ≥ 0)

beginner

Which function in scipy.optimize is commonly used for constrained optimization?

The function scipy.optimize.minimize is commonly used for constrained optimization by specifying constraints and bounds.

intermediate

How do you define constraints for scipy.optimize.minimize?

Constraints are defined as a list of dictionaries with keys like type ('eq' for equality, 'ineq' for inequality) and fun (a function that returns the constraint value).

intermediate

What does the 'method' parameter in scipy.optimize.minimize control?

The 'method' parameter chooses the algorithm to solve the optimization, such as 'SLSQP' which supports constraints and bounds.

What does an inequality constraint like 'x >= 0' mean in optimization?

A x must be exactly 0

B x must be greater than or equal to 0

C x must be less than 0

D x can be any value

An inequality constraint 'x >= 0' means x must be greater than or equal to zero.

Which scipy.optimize method supports constraints directly?

A Nelder-Mead

B CG

C SLSQP

D BFGS

The 'SLSQP' method supports both equality and inequality constraints.

In scipy.optimize.minimize, how are equality constraints specified?

A type='eq'

B type='ineq'

C type='equal'

D type='equal_to'

Equality constraints use type='eq' in the constraints dictionary.

What is the purpose of bounds in constrained optimization?

A To limit the range of variables

B To define the objective function

C To set the initial guess

D To choose the solver method

Bounds limit the range of values that variables can take.

What does the function passed to 'fun' in a constraint dictionary return?

A The initial guess

B The objective function value

C The gradient of the objective

D The constraint value (should be zero or positive)

The function returns the value of the constraint, which should be zero for equality or non-negative for inequality.

Explain how to set up a constrained optimization problem using scipy.optimize.minimize.

Think about the inputs needed for minimize to handle constraints.

Describe the difference between equality and inequality constraints with examples.

Consider how each constraint restricts possible solutions.