Gaussian model selection
Lucien Birgé, Pascal Massart · Journal of the European Mathematical Society · 2001
Our purpose in this paper is to provide a general approach to model selection via penalization for Gaussian regression and to develop our point of view about this subject. The advantage and importance of model selection come from the fact that it provides a suitable approach to many different types of problems, starting from model selection per se (among a family of parametric models, which one is more suitable for the data at hand), which includes for instance variable selection in regression models, to nonparametric estimation, for which it provides a very powerful tool that allows adaptation under quite general circumstances. Our approach to model selection also provides a natural connection between the parametric and nonparametric points of view and copes naturally with the fact that a model is not necessarily true. The method is based on the penalization of a least squares criterion which can be viewed as a generalization of Mallows' C_p . A large part of our efforts will be put on choosing properly the list of models and the penalty function for various estimation problems like classical variable selection or adaptive estimation for various types of l_p -bodies.
Cited by 479 works. doi:10.1007/s100970100031 Open-access PDF
Authors
References
- Estimating the Dimension of a Model
- Information Theory and an Extension of the Maximum Likelihood Principle
- Ideal Spatial Adaptation by Wavelet Shrinkage
- Applied Regression Analysis
- Spline Models for Observational Data.
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- INADMISSIBILITY OF THE USUAL ESTIMATOR FOR THE MEAN OF A MULTIVARIATE NORMAL DISTRIBUTION
- Regression and Time Series Model Selection in Small Samples
- Fitting Equations to Data
- Constructive Approximation