Gast ::
| Hauptseite > Publikationsdatenbank > A detailed survey of numerical methods for unconstrained minimization 1 : Conjugate direction and gradient methods |
| Hauptseite > Publikationsdatenbank > A detailed survey of numerical methods for unconstrained minimization 1 : Conjugate direction and gradient methods |
| Book/Report | FZJ-2018-01452 |
;
1980
Kernforschungsanlage Jülich, Verlag
Jülich
Please use a persistent id in citations: http://hdl.handle.net/2128/17488
Report No.: Juel-1643
Abstract: A detailed description of numerical methods for unconstrained minimization is presented. This first part surveys in particular conjugate direction and gradient methods, whereas variable metric methods will be the subject of the second part. Among the results of special interest we quote the following. The conjugate direction methods of Powell, Zangwill and Sutti can be best interpreted if the Smith approach is adopted. The conditions for quadratic termination of Powell's first procedure are analyzed. Numerical results based on non linear least squares problems are presented for the following conjugate direction codes: VA04AD from Harwell Subroutine Library and ZXPOW from IMSL, both implernentations of Powell's second procedure, DFMND from IBM-SLMATH (Zangwill's method) and Brent's algorithrn PRAXIS.VA04AD turns out to be superior in all cases, PRAXIS improves for high-airnensional problems. All codes clearly exhibit superlinear convergence. Akaike's result for the method of steepest descent is derived directly from a set of nonlinear recurrence relations. Numerical results obtained with the highly ill conditioned Hilbert function confirrn the theoretical predictions. Several properties of the conjugate gradient method are presented and a new derivation of the equivalence of steepest descent partan and -the CG method is given. A comparison of nurnerical results from the CG codes VA08AD (Fletcher-Reeves), DFMCG (the SSP version of the Fletcher-Reeves algorithrn) and VA14AD (Powell's implementation of the Polak-Ribiere formula) reveals that VA14AD is clearly superior in all cases, but that the convergence rate ofthese codes is only weakly superlinear such that high accuracy solutions require extremely large nurnbers of-function calls.
|
The record appears in these collections: |
PDF
PDF (PDFA)