Support vector machine learning for interdependent and structured output spaces
Ioannis Tsochantaridis, Thomas Hofmann, Thorsten Joachims et al. · 2004
Learning general functional dependencies is one of the main goals in machine learning. Recent progress in kernel-based methods has focused on designing flexible and powerful input representations. This paper addresses the complementary issue of problems involving complex outputs such as multiple dependent output variables and structured output spaces. We propose to generalize multiclass Support Vector Machine learning in a formulation that involves features extracted jointly from inputs and outputs. The resulting optimization problem is solved efficiently by a cutting plane algorithm that exploits the sparseness and structural decomposition of the problem. We demonstrate the versatility and effectiveness of our method on problems ranging from supervised grammar learning and named-entity recognition, to taxonomic text classification and sequence alignment.
Cited by 1,243 works. doi:10.1145/1015330.1015341 Open-access PDF
Authors
References
- The Nature of Statistical Learning Theory
- Statistical Learning Theory
- Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
- Foundations of statistical natural language processing
- Discriminative training methods for hidden Markov models
- On the algorithmic implementation of multiclass kernel-based vector machines
- Multiclass Support Vector Machines
- Max-Margin Markov Networks
- Hidden Markov support vector machines
- PCFG Models of Linguistic Tree Representations