SystemT
Rajasekar Krishnamurthy, Yunyao Li, Sriram Raghavan et al. · ACM SIGMOD Record · 2009
As applications within and outside the enterprise encounter increasing volumes of unstructured data, there has been renewed interest in the area of information extraction (IE) -- the discipline concerned with extracting structured information from unstructured text. Classical IE techniques developed by the NLP community were based on cascading grammars and regular expressions. However, due to the inherent limitations of grammarbased extraction, these techniques are unable to: (i) scale to large data sets, and (ii) support the expressivity requirements of complex information tasks. At the IBM Almaden Research Center, we are developing SystemT, an IE system that addresses these limitations by adopting an algebraic approach. By leveraging well-understood database concepts such as declarative queries and costbased optimization, SystemT enables scalable execution of complex information extraction tasks. In this paper, we motivate the SystemT approach to information extraction. We describe our extraction algebra and demonstrate the effectiveness of our optimization techniques in providing orders of magnitude reduction in the running time of complex extraction tasks.
Cited by 134 works. doi:10.1145/1519103.1519105
Authors
References
- Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
- Access path selection in a relational database management system
- Department of Computer Science
- Accurate Information Extraction from Research Papers using Conditional Random Fields
- Multistrategy Learning for Information Extraction
- The common pattern specification language
- Declarative information extraction using datalog with embedded extraction predicates
- An Algebraic Approach to Rule-Based Information Extraction
- Managing information extraction
- Information Extraction from the World Wide Web