Bayesian Model Selection in High-Dimensional Settings
Valen E. Johnson, David Rossell · Journal of the American Statistical Association · 2012
Standard assumptions incorporated into Bayesian model selection procedures result in procedures that are not competitive with commonly used penalized likelihood methods. We propose modifications of these methods by imposing nonlocal prior densities on model parameters. We show that the resulting model selection procedures are consistent in linear model settings when the number of possible covariates p is bounded by the number of observations n, a property that has not been extended to other model selection procedures. In addition to consistently identifying the true model, the proposed procedures provide accurate estimates of the posterior probability that each identified model is correct. Through simulation studies, we demonstrate that these model selection procedures perform as well or better than commonly used penalized likelihood methods in a range of simulation settings. Proofs of the primary theorems are provided in the Supplementary Material that is available online.
Cited by 248 works. doi:10.1080/01621459.2012.682536
Authors
References
- Estimating the Dimension of a Model
- Regression Shrinkage and Selection Via the Lasso
- Least angle regression
- Regularization and Variable Selection Via the Elastic Net
- Bayes Factors
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Accurate Approximations for Posterior Moments and Marginal Densities
- The Adaptive Lasso and Its Oracle Properties
- Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
- Better Subset Regression Using the Nonnegative Garrote