Document concept lattice for text understanding and summarization

作者:

Highlights:

摘要

We argue that the quality of a summary can be evaluated based on how many concepts in the original document(s) that can be preserved after summarization. Here, a concept refers to an abstract or concrete entity or its action often expressed by diverse terms in text. Summary generation can thus be considered as an optimization problem of selecting a set of sentences with minimal answer loss. In this paper, we propose a document concept lattice that indexes the hierarchy of local topics tied to a set of frequent concepts and the corresponding sentences containing these topics. The local topics will specify the promising sub-spaces related to the selected concepts and sentences. Based on this lattice, the summary is an optimized selection of a set of distinct and salient local topics that lead to maximal coverage of concepts with the given number of sentences. Our summarizer based on the concept lattice has demonstrated competitive performance in Document Understanding Conference 2005 and 2006 evaluations as well as follow-on tests.

论文关键词:Text summarization,Document concept lattice,Concept,Semantic

论文评审过程:Received 18 July 2006, Revised 16 February 2007, Accepted 8 March 2007, Available online 21 May 2007.

论文官网地址:https://doi.org/10.1016/j.ipm.2007.03.010