The fundamental principle of optimisation is that the rate of change of a quantity is zero at its maximum or minimum points.
Mathematically, if is the quantity to be optimized with respect to variable , the optimum occurs when the first derivative .
This works because the derivative represents the gradient of the function; a gradient of zero indicates a horizontal tangent, which characterizes stationary points.
The Second Derivative Test is used to confirm the nature of the point: if , the point is a maximum; if , it is a minimum.
It is vital to distinguish between the variable value that causes the optimum and the optimum value itself.
| Feature | Objective Function | Constraint Equation |
|---|---|---|
| Purpose | The value you want to maximize/minimize | The rule that limits the system |
| Example | Total Surface Area of a cylinder | Fixed Volume of the cylinder |
| Role | Differentiated to find stationary points | Used to substitute and reduce variables |
Global vs. Local: In real-world modelling, we often only care about the 'local' maximum within a specific domain (e.g., lengths must be positive, ).