An Adaptive Nonlinear Least-Squares Algorithm
John E. Dennis, David M. Gay, Roy E. Walsh · ACM Transactions on Mathematical Software · 1981
Least-SquaresNL2SOL is a modular program for solving nonhnear least-squares problems that incorporates a number of novel features.It maintains a secant approximation S to the second-order part of the leastsquares Hessian and adaptively decides when to use this approximation.S is "sized" before updating, something that is similar to Oren-Luenberger scaling.The step choice algorithm is based on minimizing a local quadratic model of the sum of squares ftmctmn constrained to an elhptmal trust regmn centered at the current approximate minimizer This is accomphshed using ideas chscussed by Mor6, together with a special module for assessing the quahty of the step thus computed.These and other ideas behind NL2SOL are discussed, and its evolution and current implementation are also described briefly.
Cited by 930 works. doi:10.1145/355958.355965 Open-access PDF
Authors
References
- A Rapidly Convergent Descent Method for Minimization
- An Automatic Method for Finding the Greatest or Least Value of a Function
- An Iterative Method for Finding Stationary Values of a Function of Several Variables
- The Levenberg-Marquardt algorithm: Implementation and theory
- Quasi-Newton Methods, Motivation and Theory
- A Comparison of Several Current Optimization Methods, and the use of Transformations in Constrained Problems
- Comparison of Gradient Methods for the Solution of Nonlinear Parameter Estimation Problems
- Smoothing by spline functions. II
- Non-Linear Programming Via Penalty Functions
- Function Minimization Without Evaluating Derivatives--a Review