Two-Point Step Size Gradient Methods
Jonathan Barzilai, Jonathan Michael Borwein · IMA Journal of Numerical Analysis · 1988
We derive two-point step sizes for the steepest-descent method by approximating the secant equation. At the cost of storage of an extra iterate and gradient, these algorithms achieve better performance and cheaper computation than the classical steepest-descent method. We indicate a convergence analysis of the method in the two-dimensional quadratic case. The behaviour is highly remarkable and the analysis entirely nonstandard.
Cited by 2,873 works. doi:10.1093/imanum/8.1.141