Nonparametric Maximum Likelihood Estimation by the Method of Sieves
Stuart Geman, Chii-Ruey Hwang · The Annals of Statistics · 1982
Maximum likelihood estimation often fails when the parameter takes values in an infinite dimensional space. For example, the maximum likelihood method cannot be applied to the completely nonparametric estimation of a density function from an $\operatorname{iid}$ sample; the maximum of the likelihood is not attained by any density. In this example, as in many other examples, the parameter space (positive functions with area one) is too big. But the likelihood method can often be salvaged if we first maximize over a constrained subspace of the parameter space and then relax the constraint as the sample size grows. This is Grenander's "method of sieves." Application of the method sometimes leads to new estimators for familiar problems, or to a new motivation for an already well-studied technique. We will establish some general consistency results for the method, and then we will focus on three applications.
Cited by 367 works. doi:10.1214/aos/1176345782 Open-access PDF
Authors
References
- Note on the Consistency of the Maximum Likelihood Estimate
- An analysis of the finite element method
- A completely automatic french curve: fitting spline functions by cross validation
- Consistent Nonparametric Regression
- SPLINE FUNCTIONS AND THE PROBLEM OF GRADUATION
- Smoothing noisy data with spline functions
- On entropy maximization principle
- Nonparametric probability density estimation
- Non-parametric Roughness Penalty for Probability Densities
- The Estimation of Probability Densities and Cumulatives by Fourier Series Methods