Artículo

Can peer review accolade awards motivate reviewers? A large-scale quasi-natural experiment

Resumen

The utilization of accolade awards to motivate reviewers is widespread, but their effectiveness remains uncertain. We aim to explore how receiving an accolade award affects reviewers’ subsequent number of reviews. In contrast to small-scale, unrepresentative experiments, we perform a large-scale, global, and all-disciplinary analysis based on quasi-natural experiments. By integrating the Publons, ORCID, MAG, SciSciNet, and OpenAlex databases, a large dataset that tracks the reviewers’ annual number of reviews and their bibliometric indicators is compiled, encompassing 179,794 individuals. Among them, 6605 individuals who receive the “Publons Global Peer Review Award” in 2018 are constituted as the experimental group. Those non-winners are then matched to form a control group. Using propensity score matching (PSM), 711 and 762 reviewers are matched as the experimental and control groups respectively. An analysis employing the difference-in-differences (DiD) method is conducted to examine the impact of an accolade award on reviewers’ subsequent number of reviews. It is found that, following the receipt of an accolade award, reviewers, on average, reviews about four fewer manuscripts, with the reduction exhibiting a V-shaped pattern. Additional analyses are conducted to examine how individual differences and socio-economic factors influence the awarding effects. Besides, we analyze the mechanisms underlying the awarding effect and propose strategies to motivate reviewers. In brief, the sharp decrease in marginal utility of accolades, the voluntary nature of peer review, and the unexpected properties of accolade awards are the potential mechanisms that generate the negative effect. The academic community should reassess the existing incentive strategies for reviewers.
de Oliveira Dias, Kalina Coeli Costa (57219159963); de Souza Batista, Patrícia Serpa (57219157934); Fernandes, Maria Andréa (57212429703); Zaccara, Ana Aline Lacet (55972735100); de Oliveira, Thaís Costa (57219165216); de Vasconcelos, Monica Ferreira (55843696600); de Magalhães Oliveira, Amanda Maritsa (57219159688); de Andrade, Fernanda Ferreira (57219157064)
Dissertations and theses on palliative care in pediatric oncology: a bibliometric study; [Dissertações e teses sobre cuidados paliativos em oncologia pediátrica: estudo bibliométrico]; [Tesis de maestría y doctorado sobre cuidados paliativos en oncología pediátrica: estudio bibliométrico]
2020
10.37689/ACTAAPE/2020AO02642
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85091521290&doi=10.37689%2fACTAAPE%2f2020AO02642&partnerID=40&md5=1c496b1635900cd1f2eeb5fc23c080c3
All Open Access; Gold Open Access
Scopus
Artículo obtenido de:
Scopus
Fuente
0 0 votos
Califica el artículo
Campus Samborondón
Vía Samborondón Km. 13.5
Call Center: 5150400
metricas@ecotec.edu.ec
Facebook Instagram Youtube

Mapa del sitio