Quality control of crowdsourced classification using hierarchical class structures

作者:

Highlights:

• We proposed a quality control method for crowdsourced hierarchical classification.

• Our method captures worker abilities by incorporating hierarchical class structures.

• The experiments using real crowdsourced datasets showed that our method is effective.

• Our method is helpful to multi-class classification with an implicit hierarchy.

摘要

•We proposed a quality control method for crowdsourced hierarchical classification.•Our method captures worker abilities by incorporating hierarchical class structures.•The experiments using real crowdsourced datasets showed that our method is effective.•Our method is helpful to multi-class classification with an implicit hierarchy.

论文关键词:Crowdsourcing,Quality control,Hierarchical classification,Human computation

论文评审过程:Received 28 December 2015, Revised 5 April 2016, Accepted 6 April 2016, Available online 8 April 2016, Version of Record 18 April 2016.

论文官网地址:https://doi.org/10.1016/j.eswa.2016.04.009