Shallow parsing with conditional random fields
Fei Sha, Fernando M. B. Pereira · 2003
Conditional random fields for sequence labeling offer advantages over both generative models like HMMs and classifiers applied at each sequence position. Among sequence labeling tasks in language processing, shallow parsing has received much attention, with the development of standard evaluation datasets and extensive comparison among methods. We show here how to train a conditional random field to achieve performance as good as any reported base noun-phrase chunking method on the CoNLL task, and better than any reported single model. Improved training methods based on modern optimization algorithms were critical in achieving these results. We present extensive comparisons between models and training methods that confirm and strengthen previous results on shallow parsing and training methods for maximum-entropy models.
Cited by 1,242 works. doi:10.3115/1073445.1073473 Open-access PDF
Authors
References
- An Introduction to the Bootstrap
- Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
- A maximum entropy approach to natural language processing
- Numerical Optimization
- Generalized Iterative Scaling for Log-Linear Models
- A Maximum Entropy Model for Part-Of-Speech Tagging
- Inducing features of random fields
- Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging
- Discriminative training methods for hidden Markov models
- An Introduction to the Bootstrap.