Learning representations for quality estimation of crowdsourced submissions
作者:
Highlights:
• The problem of quality estimation of crowdsourced work is of great importance.
• We aim to find high-quality work for more general tasks, such as article writing.
• We exploit requesters historical feedback and directly model the submission quality.
• Our embedding-based feature-learning methods outperform feature-engineering methods.
• Our methods do not require additional crowdsourced grading.
摘要
•The problem of quality estimation of crowdsourced work is of great importance.•We aim to find high-quality work for more general tasks, such as article writing.•We exploit requesters historical feedback and directly model the submission quality.•Our embedding-based feature-learning methods outperform feature-engineering methods.•Our methods do not require additional crowdsourced grading.
论文关键词:Crowdsourcing,Quality estimation,Embedding
论文评审过程:Received 22 June 2018, Revised 24 October 2018, Accepted 31 October 2018, Available online 28 December 2018, Version of Record 14 May 2019.
论文官网地址:https://doi.org/10.1016/j.ipm.2018.10.020