Critical remarks on the Italian research assessment exercise VQR 2011–2014

作者:

Highlights:

• The paper focuses on the Italian exercise for assessing the research performance, VQR 2011–2014.

• Several critical remarks concerning the VQR 2011–2014 are presented.

• Three major vulnerabilities are: (1) small number of papers considered; (2) incorrect use of the journal metrics; (3) conceptually misleading criteria for normalizing bibliometric indicators.

• The description is supported by practical examples.

摘要

•The paper focuses on the Italian exercise for assessing the research performance, VQR 2011–2014.•Several critical remarks concerning the VQR 2011–2014 are presented.•Three major vulnerabilities are: (1) small number of papers considered; (2) incorrect use of the journal metrics; (3) conceptually misleading criteria for normalizing bibliometric indicators.•The description is supported by practical examples.

论文关键词:Research assessment exercise,Italian VQR,Bibliometric evaluation,Peer review,Journal metric,Percentile rank

论文评审过程:Received 28 October 2016, Revised 8 February 2017, Accepted 8 February 2017, Available online 24 February 2017, Version of Record 24 February 2017.

论文官网地址:https://doi.org/10.1016/j.joi.2017.02.005