Probabilistic Principal Component Analysis
Michael E. Tipping, Chris Bishop · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1999
Summary Principal component analysis (PCA) is a ubiquitous technique for data analysis and processing, but one which is not based on a probability model. We demonstrate how the principal axes of a set of observed data vectors may be determined through maximum likelihood estimation of parameters in a latent variable model that is closely related to factor analysis. We consider the properties of the associated likelihood function, giving an EM algorithm for estimating the principal subspace iteratively, and discuss, with illustrative examples, the advantages conveyed by this probabilistic approach to PCA.
Cited by 3,666 works. doi:10.1111/1467-9868.00196 Open-access PDF
Authors
References
- The Nature of Statistical Learning Theory
- Support-Vector Networks
- Backpropagation Applied to Handwritten Zip Code Recognition
- Methods of Mathematical Physics
- A training algorithm for optimal margin classifiers
- Pattern Recognition and Neural Networks
- Statistical Analysis With Missing Data
- Analysis of a complex of statistical variables into principal components.
- Principal Component Analysis
- Nonlinear Component Analysis as a Kernel Eigenvalue Problem