Optimization Transfer Using Surrogate Objective Functions
Kenneth L. Lange, David R. Hunter, Ilsoon Yang · Journal of Computational and Graphical Statistics · 2000
The well-known EM algorithm is an optimization transfer algorithm that depends on the notion of incomplete or missing data. By invoking convexity arguments, one can construct a variety of other optimization transfer algorithms that do not involve missing data. These algorithms all rely on a majorizing or minorizing function that serves as a surrogate for the objective function. Optimizing the surrogate function drives the objective function in the correct direction. This article illustrates this general principle by a number of specific examples drawn from the statistical literature. Because optimization transfer algorithms often exhibit the slow convergence of EM algorithms, two methods of accelerating optimization transfer are discussed and evaluated in the context of specific problems.
Cited by 808 works. doi:10.1080/10618600.2000.10474858
Authors
References
- Maximum Likelihood from Incomplete Data Via the EM Algorithm
- Matrix Analysis
- Statistical Analysis With Missing Data
- Numerical recipes in Pascal: the art of scientific computing
- Matrix Analysis
- Iterative Solution of Nonlinear Equations in Several Variables
- Maximum likelihood estimation from incomplete data via the EM algorithm
- Robust Statistics
- Linear and nonlinear programming.
- Robust Regression and Outlier Detection