On the impact of domain expertise on query formulation, relevance assessment and retrieval performance in clinical settings

作者:

Highlights:

• A crowd-based evaluation on the impact of domain expertise on query formulation, relevance assessment and retrieval performance.

• Queries issues by experts are significantly longer and more technical than queries issued by novices.

• There is a low level of relevance assessment agreement among both experts and novices but the reasons of the relevance assessment difficulty significantly differ between them.

• Traditional information retrieval models which mainly consider the presence or absence of query terms within documents are particularly unsuccessful for experts who rather leverage from their knowledge and past experience to assess a multi-dimensional relevance.

摘要

•A crowd-based evaluation on the impact of domain expertise on query formulation, relevance assessment and retrieval performance.•Queries issues by experts are significantly longer and more technical than queries issued by novices.•There is a low level of relevance assessment agreement among both experts and novices but the reasons of the relevance assessment difficulty significantly differ between them.•Traditional information retrieval models which mainly consider the presence or absence of query terms within documents are particularly unsuccessful for experts who rather leverage from their knowledge and past experience to assess a multi-dimensional relevance.

论文关键词:Medical information retrieval,Domain expertise,Query formulations Relevance assessment,Retrieval performance

论文评审过程:Received 28 July 2016, Revised 15 November 2016, Accepted 17 November 2016, Available online 6 December 2016, Version of Record 6 December 2016.

论文官网地址:https://doi.org/10.1016/j.ipm.2016.11.004