Efficient phrase querying with common phrase index

作者:

Highlights:

摘要

In this paper, we propose a common phrase index as an efficient index structure to support phrase queries in a very large text database. Our structure is an extension of previous index structures for phrases and achieves better query efficiency with modest extra storage cost. Further improvement in efficiency can be attained by implementing our index according to our observation of the dynamic nature of common word set. In experimental evaluation, a common phrase index using 255 common words has an improvement of about 11% and 62% in query time for the overall and large queries (queries of long phrases) respectively over an auxiliary nextword index. Moreover, it has only about 19% extra storage cost. Compared with an inverted index, our improvement is about 72% and 87% for the overall and large queries respectively. We also propose to implement a common phrase index with dynamic update feature. Our experiments show that more improvement in time efficiency can be achieved.

论文关键词:Indexing,Query evaluation,Phrase query evaluation,Inverted index,Auxiliary nextword index,Common phrase index

论文评审过程:Received 22 December 2006, Revised 26 June 2007, Accepted 29 June 2007, Available online 9 August 2007.

论文官网地址:https://doi.org/10.1016/j.ipm.2007.06.003