Towards multidocument summarization by reformulation: progress and prospects
Kathleen R. McKeown, Judith L. Klavans, Vasileios Hatzivassiloglou et al. · 1999
By synthesizing information common to retrieved documents, multi-document summarization can help users of information retrieval systems to find relevant documents with a minimal amount of reading. We are developing a multidocument summarization system to automatically generate a concise summary by identifying and synthesizing similarities across a set of related documents. Our approach is unique in its integration of machine learning and statistical techniques to identify similar paragraphs, intersection of similar phrases within paragraphs, and language generation to reformulate the wording of the summary. Our evaluation of system components shows that learning over multiple extracted linguistic features is more effective than information retrieval approaches at identifying similar text units for summarization and that it is possible to generate a fluent summary that conveys similarities among documents even when full semantic interpretations of the input text are not available.
Cited by 191 works. doi:10.7916/d8sb4f3v
Authors
References
- Term-weighting approaches in automatic text retrieval
- Introduction to WordNet: An On-line Lexical Database *
- A new statistical parser based on bigram lexical dependencies
- A trainable document summarizer
- English verb classes and alternations: A preliminary investigation. By Beth Levin. Chicago: University of Chicago Press, 1993. Pp. xviii, 345. Cloth $45.00, paper $18.95.
- Topic Detection and Tracking Pilot Study Final Report
- Constructing literature abstracts by computer: Techniques and prospects
- Using lexical chains for text summarization
- English verb classes and alternations : a preliminaryinvestigation
- Learning trees and rules with set-valued features