Bayesian Information Extraction Network
Leonid Peshkin, Avi Pfeffer · arXiv (Cornell University) · 2003
Dynamic Bayesian networks (DBNs) offer an elegant way to integrate various aspects of language in one model. Many existing algorithms developed for learning and inference in DBNs are applicable to probabilistic language modeling. To demonstrate the potential of DBNs for natural language processing, we employ a DBN in an information extraction task. We show how to assemble wealth of emerging linguistic instruments for shallow parsing, syntactic and semantic tagging, morphological decomposition, named entity recognition etc. in order to incrementally build a robust information extraction system. Our method outperforms previously published results on an established benchmark domain.
Cited by 51 works. doi:10.48550/arxiv.cs/0306039 Open-access PDF
Authors
References
- Building a Large Annotated Corpus of English: The Penn Treebank
- Foundations of statistical natural language processing
- Maximum Entropy Markov Models for Information Extraction and Segmentation
- Dynamic bayesian networks: representation, inference and learning
- Loopy Belief Propagation for Approximate Inference: An Empirical Study
- Learning Information Extraction Rules for Semi-Structured and Free Text
- On artificial intelligence
- Relational Learning of Pattern-Match Rules for Information Extraction.
- Learning to Parse Natural Language with Maximum Entropy Models
- Machine Learning for Information Extraction in Informal Domains