Page: 11
DERIVATIVES
``Analytic'' derivatives
Most accurate but sometimes not available
Often difficult to encode
Finite difference approximations
About half the precision of
for well chosen step
Secant and BFGS approximations