The Relevance Vector Machine
Michael E. Tipping · 1999
The support vector machine (SVM) is a state-of-the-art technique for regression and classification, combining excellent generalisation properties with a sparse kernel representation. However, it does suffer from a number of disadvantages, notably the absence of probabilistic outputs, the requirement to estimate a trade-off parameter and the need to utilise `Mercer' kernel functions. In this paper we introduce the Relevance Vector Machine (RVM), a Bayesian treatment of a generalised linear model of identical functional form to the SVM. The RVM suffers from none of the above disadvantages, and examples demonstrate that for comparable generalisation performance, the RVM requires dramatically fewer kernel functions.
Cited by 855 works.
Authors
References
- Statistical Learning Theory
- Statistical Decision Theory and Bayesian Analysis
- Bayesian Learning for Neural Networks
- Bayesian Interpolation
- Stastical Decision Theory and Bayesian Analysis.
- Input space versus feature space in kernel-based methods
- The Evidence Framework Applied to Classification Networks
- Bayesian classification with Gaussian processes
- Efficient training of RBF networks for classification