Mixture Densities, Maximum Likelihood and the EM Algorithm
Richard A. Redner, Homer F. Walker · SIAM Review · 1984
The problem of estimating the parameters which determine a mixture density has been the subject of a large, diverse body of literature spanning nearly ninety years. During the last two decades, the method of maximum likelihood has become the most widely followed approach to this problem, thanks primarily to the advent of high speed electronic computers. Here, we first offer a brief survey of the literature directed toward this problem and review maximum-likelihood estimation for it. We then turn to the subject of ultimate interest, which is a particular iterative procedure for numerically approximating maximum-likelihood estimates for mixture density problems. This procedure, known as the EM algorithm, is a specialization to the mixture density context of a general algorithm of the same name used to approximate maximum-likelihood estimates for incomplete data problems. We discuss the formulation and theoretical and practical properties of the EM algorithm for mixture densities, focussing in particular on mixtures of densities from exponential families.
Cited by 2,693 works. doi:10.1137/1026034
Authors
References
- Maximum Likelihood from Incomplete Data Via the EM Algorithm
- Mathematical Methods of Statistics.
- Optimization by Vector Space Methods
- Pattern classification and scene analysis
- A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains
- Introduction to matrix computations
- Iterative Solution of Nonlinear Equations in Several Variables
- Practical optimization
- Note on the Consistency of the Maximum Likelihood Estimate
- Computer methods for mathematical computations