A high-performance semi-supervised learning method for text chunking
Rie Kubota Ando, Tong Zhang · Annual Meeting of the Association for Computational Linguistics (ACL) · 2005
In machine learning, whether one can build a more accurate classifier by using unlabeled data (semi-supervised learning) is an important issue. Although a number of semi-supervised methods have been proposed, their effectiveness on NLP tasks is not always clear. This paper presents a novel semi-supervised method that employs a learning paradigm which we call structural learning. The idea is to find "what good classifiers are like" by learning from thousands of automatically generated auxiliary classification problems on unlabeled data. By doing so, the common predictive structure shared by the multiple classification problems can be discovered, which can then be used to improve performance on the target problem. The method produces performance higher than the previous best results on CoNLL'00 syntactic chunking and CoNLL'03 named entity chunking (English and German).
Cited by 223 works. doi:10.3115/1219840.1219841 Open-access PDF
Authors
References
- Combining labeled and unlabeled data with co-training
- Unsupervised word sense disambiguation rivaling supervised methods
- A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data
- Shallow parsing with conditional random fields
- Unsupervised Models for Named Entity Classification
- Solving large scale linear prediction problems using stochastic gradient descent algorithms
- Learning dictionaries for information extraction by multi-level bootstrapping
- Tagging English text with a probabilistic model
- Chunking with support vector machines
- Named entity recognition through classifier combination