An empirical study on the quantitative notion of task difficulty

作者：

Highlights：

• Analysis of differences between tasks difficulty models in ITS and IRT.

• Comparison between statistical and heuristic estimation of questions difficulty.

• Teachers’ estimation of difficulty is not always reliable.

• Students’ estimation is more accurate than teacher’s estimation.

• Human difficulty estimation is closer to the IRT 3PL model.

摘要

•Analysis of differences between tasks difficulty models in ITS and IRT.•Comparison between statistical and heuristic estimation of questions difficulty.•Teachers’ estimation of difficulty is not always reliable.•Students’ estimation is more accurate than teacher’s estimation.•Human difficulty estimation is closer to the IRT 3PL model.

论文关键词：Web-based educational system,Intelligent tutoring systems,Knowledge assessment,IRT,CAT,Item difficulty,Item calibration,Difficulty estimation

论文评审过程：Available online 7 August 2013.

论文官网地址：https://doi.org/10.1016/j.eswa.2013.07.084