Sparse Discriminant Analysis
Line Katrine Harder Clemmensen, Trevor J. Hastie, Daniela Witten et al. · Technometrics · 2011
We consider the problem of performing interpretable classification in the high-dimensional setting, in which the number of features is very large and the number of observations is limited. This setting has been studied extensively in the chemometrics literature, and more recently has become commonplace in biological and medical applications. In this setting, a traditional approach involves performing feature selection before classification. We propose sparse discriminant analysis, a method for performing linear discriminant analysis with a sparseness criterion imposed such that classification and feature selection are performed simultaneously. Sparse discriminant analysis is based on the optimal scoring interpretation of linear discriminant analysis, and can be extended to perform sparse discrimination via mixtures of Gaussians if boundaries between classes are nonlinear or if subgroups are present within each class. Our proposal also provides low-dimensional views of the discriminative directions.
Cited by 534 works. doi:10.1198/tech.2011.08118
Authors
References
- Regression Shrinkage and Selection Via the Lasso
- The Elements of Statistical Learning
- Least angle regression
- Regularization and Variable Selection Via the Elastic Net
- Regularized Discriminant Analysis
- Diagnosis of multiple cancer types by shrunken centroids of gene expression
- Empirical Bayes Analysis of a Microarray Experiment
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
- Sparse Principal Component Analysis
- Penalized Discriminant Analysis