Regularized Discriminant Analysis
Jerome H. Friedman · Journal of the American Statistical Association · 1989
Linear and quadratic discriminant analysis are considered in the small-sample, high-dimensional setting. Alternatives to the usual maximum likelihood (plug-in) estimates for the covariance matrices are proposed. These alternatives are characterized by two parameters, the values of which are customized to individual situations by jointly minimizing a sample-based estimate of future misclassification risk. Computationally fast implementations are presented, and the efficacy of the approach is examined through simulation studies and application to data. These studies indicate that in many circumstances dramatic gains in classification accuracy can be achieved.
Cited by 2,421 works. doi:10.1080/01621459.1989.10478752 Open-access PDF
Authors
References
- Matrix Computations
- Classification and Regression Trees.
- Classification and Regression Trees.
- Matrix Analysis
- Pattern Classification
- Estimation of the Mean of a Multivariate Normal Distribution
- Estimation with Quadratic Loss
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
- Discriminant Functions
- Introduction to Multivariate Analysis