Ranking journals using social choice theory methods: A novel approach in bibliometrics

作者:

Highlights:

• We present an axiomatic analysis of the journal rank aggregation problem in the formal framework of social welfare functionals.

• We argue against the weighted summation and other cardinal functions in favor of the ordinal aggregation methods based on the majority rule.

• We use data on economic, management and political science journals to produce quantitative estimates of (in)consistency of the evaluations based on six popular bibliometric indicators.

• We demonstrate that the majority-rule-based aggregates reduce the number of contradictions and represent the set of the single-indicator-based rankings better than any of the seven rankings themselves.

摘要

•We present an axiomatic analysis of the journal rank aggregation problem in the formal framework of social welfare functionals.•We argue against the weighted summation and other cardinal functions in favor of the ordinal aggregation methods based on the majority rule.•We use data on economic, management and political science journals to produce quantitative estimates of (in)consistency of the evaluations based on six popular bibliometric indicators.•We demonstrate that the majority-rule-based aggregates reduce the number of contradictions and represent the set of the single-indicator-based rankings better than any of the seven rankings themselves.

论文关键词:Social choice,Rank aggregation,Majority rule,Ordinal method,Copeland rule,Tournament solution,Externally stable,Multiple criteria,Impact factor,SNIP,SJR

论文评审过程:Received 23 October 2015, Accepted 8 March 2018, Available online 11 April 2018, Version of Record 11 April 2018.

论文官网地址:https://doi.org/10.1016/j.joi.2018.03.001