Learning the Kernel with Hyperkernels
Cheng Soon Ong, Alexander Johannes Smola, Robert C. Williamson et al. · ANU Open Research (Australian National University) · 2003
This paper addresses the problem of choosing a kernel suitable for estimation with a support vector machine, hence further automating machine learning. This goal is achieved by defining a reproducing kernel Hilbert space on the space of kernels itself. Such a formulation leads to a statistical estimation problem similar to the problem of minimizing a regularized risk functional. We state the equivalent representer theorem for the choice of kernels and present a semidefinite programming formulation of the resulting optimization problem. Several recipes for constructing hyperkernels are provided, as well as the details of common machine learning problems. Experimental results for classification, regression and novelty detection on UCI data show the feasibility of our approach.
Cited by 315 works. Open-access PDF
Authors
References
- The Nature of Statistical Learning Theory
- Support-Vector Networks
- Statistical Learning Theory
- Neural networks for pattern recognition
- Experiments with a new boosting algorithm
- A Tutorial on Support Vector Machines for Pattern Recognition
- Spline Models for Observational Data.
- Theory of reproducing kernels
- Using SeDuMi 1.02, A Matlab toolbox for optimization over symmetric cones
- Data mining and knowledge discovery: making sense out of data