Relevance theory and distributions of judgments in document retrieval
作者：
Highlights：
• Links information retrieval evaluation to Sperber and Wilson's relevance theory.
• Analyzes the language of relevance judgment scales in more than 50 experiments.
• Focuses on scale-induced effort as a variable in relevance judgments.
• Shows that vague scales tend to produce U- or V-shaped distributions of judgments.
• Shows that strict scales tend to produce right-skewed distributions of judgments.
摘要
•Links information retrieval evaluation to Sperber and Wilson's relevance theory.•Analyzes the language of relevance judgment scales in more than 50 experiments.•Focuses on scale-induced effort as a variable in relevance judgments.•Shows that vague scales tend to produce U- or V-shaped distributions of judgments.•Shows that strict scales tend to produce right-skewed distributions of judgments.
论文关键词：Scale language,Cognitive effects,Processing effort
论文评审过程：Received 18 December 2016, Revised 18 February 2017, Accepted 21 February 2017, Available online 4 May 2017, Version of Record 4 May 2017.
论文官网地址：https://doi.org/10.1016/j.ipm.2017.02.010
