Using lexical chains for text summarization
Regina Barzilay, Michael Elhadad · 1997
We investigate one technique to produce a summary of an original text without requiring its full semantic interpretation, but instead relying on a model of the topic progression in the text derived from lexical chains. We present a new algorithm to compute lexical chains in a text, merging several robust knowledge sources: the WordNet thesaurus, a part-of-speech tagger, shallow parser for the identification of nominal groups, and a segmentation algorithm. Summarization proceeds in four steps: the original text is segmented, lexical chains are constructed, strong chains are identified and significant sentences are extracted. We present in this paper empirical results on the identification of strong chains and of significant sentences. Preliminary results indicate that quality indicative summaries are produced. Pending problems are identified. Plans to address these short-comings are briefly presented.
Cited by 855 works. doi:10.7916/d85b09vz
Authors
References
- Introduction to WordNet: An On-line Lexical Database *
- The Automatic Creation of Literature Abstracts
- Cohesion in English
- A simple rule-based part of speech tagger
- A trainable document summarizer
- Lexical cohesion computed by thesaural relations as an indicator of the structure of text
- New Methods in Automatic Extracting
- Multi-paragraph segmentation of expository text
- Constructing literature abstracts by computer: Techniques and prospects
- Lexical Chains as Representations of Context for the Detection and Correction of Malapropisms