Variable Selection for Logistic Regression Using a Prediction‐Focused Information Criterion
Gerda Claeskens, Christophe Croux, Johan Van Kerckhoven · Biometrics · 2006
In biostatistical practice, it is common to use information criteria as a guide for model selection. We propose new versions of the focused information criterion (FIC) for variable selection in logistic regression. The FIC gives, depending on the quantity to be estimated, possibly different sets of selected variables. The standard version of the FIC measures the mean squared error of the estimator of the quantity of interest in the selected model. In this article, we propose more general versions of the FIC, allowing other risk measures such as the one based on L(p) error. When prediction of an event is important, as is often the case in medical applications, we construct an FIC using the error rate as a natural risk measure. The advantages of using an information criterion which depends on both the quantity of interest and the selected risk measure are illustrated by means of a simulation study and application to a study on diabetic retinopathy.
Cited by 106 works. doi:10.1111/j.1541-0420.2006.00567.x Open-access PDF
Authors
References
- A new look at the statistical model identification
- Estimating the Dimension of a Model
- The Elements of Statistical Learning
- Applied Linear Statistical Models
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction
- Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach
- Discussion on the paper by Spiegelhalter, Best, Carlin and van der Linde
- The Wisconsin Epidemiologic Study of Diabetic Retinopathy
- Combining Pattern Classifiers
- Combining Pattern Classifiers: Methods and Algorithms