First among equals: Log data indicates ability differences despite equal scores

作者:

Highlights:

• Test-taking behavior in complex problem-solving (CPS) tasks differs across test-takers.

• We scrutinize the assumption that test-taking behavior is a valid indicator of ability.

• Students showed significant variance in behavior even without variance in CPS test scores.

• Behavior significantly predicted students' GPA.

• When adding intelligence, the relation behavior and GPA was reduced to negligible effects.

摘要

•Test-taking behavior in complex problem-solving (CPS) tasks differs across test-takers.•We scrutinize the assumption that test-taking behavior is a valid indicator of ability.•Students showed significant variance in behavior even without variance in CPS test scores.•Behavior significantly predicted students' GPA.•When adding intelligence, the relation behavior and GPA was reduced to negligible effects.

论文关键词:Log data,Time-on-task,Complex problem solving,Structural equation modelling,Validity

论文评审过程:Received 16 January 2020, Revised 22 April 2020, Accepted 25 May 2020, Available online 27 May 2020, Version of Record 5 June 2020.

论文官网地址:https://doi.org/10.1016/j.chb.2020.106442