Consistent Cross-Validated Density Estimation
Y. S. Chow, Stuart Geman, L.-D. Wu · The Annals of Statistics · 1983
Application of nonparametric density estimators generally requires the specification of a "smoothing parameter." The kernel estimator, for example, is not fully defined until a window width, or scaling, for the kernels has been chosen. Many "data-driven" techniques have been suggested for the practical choice of smoothing parameter. Of these, the most widely studied is the method of cross-validation. Our own simulations, as well as those of many other investigators, indicate that cross-validated smoothing can be an extremely effective practical solution. However, many of the most basic properties of cross-validated estimators are unknown. Indeed, recent results show that cross-validated estimators can fail even to be consistent for seemingly well-behaved problems. In this paper we will review the application of cross-validation to the smoothing problem, and establish $L_1$ consistency for certain cross-validated kernels and histograms.
Cited by 108 works. doi:10.1214/aos/1176346053 Open-access PDF
Authors
References
- A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations
- Singular Integrals and Differentiability Properties of Functions.
- A completely automatic french curve: fitting spline functions by cross validation
- Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
- Smoothing noisy data with spline functions
- Smoothing Techniques for Curve Estimation
- Asymptotics For and Against Cross-Validation
- Variable Kernel Estimates of Multivariate Densities
- The Estimation of Probability Densities and Cumulatives by Fourier Series Methods
- Cross-Validation and Multinomial Prediction