Tree Decomposition for Large-Scale SVM Problems
Fu Chang, Chien-Yang Guo, Xiao-Rong Lin et al. · International Conference on Technologies and Applications of Artificial Intelligence · 2010
To handle problems created by large data sets, we propose a method that uses a decision tree to decompose a given data space and trains SVMs on the decomposed regions. Although there are other means of decomposing a data space, we show that the decision tree has several merits for large-scale SVM training. First, it can classify some data points by its own means, thereby reducing the cost of SVM training applied to the remaining data points. Second, it is efficient for seeking the parameter values that maximize the validation accuracy, which helps maintain good test accuracy. For experiment data sets whose size can be handled by current non-linear, or kernel-based, SVM training techniques, the proposed method can speed up the training by a factor of thousands, and still achieve comparable test accuracy.
Cited by 60 works. doi:10.1109/taai.2010.47
Authors
References
- The Nature of Statistical Learning Theory
- Support-Vector Networks
- Classification and Regression Trees.
- Classification and Regression Trees.
- Induction of Decision Trees
- Bagging Predictors
- A Tutorial on Support Vector Machines for Pattern Recognition
- UCI Repository of machine learning databases
- An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
- Bagging predictors