Artículo

The usefulness of personal publication lists in research evaluation

Resumen

This article addresses the question of whether personal publication lists should be used as a data source in research evaluation, or whether, as is widespread in practice, existing databases, such as Web of Science, can be used instead. For this purpose, an empirical study was carried out in which all business administration university professors (n = 233) of a non-English-speaking country, namely Austria, were ranked in several ways (e.g., full or fractional counting, consideration or non-consideration of journal rankings). All rankings were based on the number of published journal articles (n = 4246; observation period: 10 years). In one case, the personal publication lists and in the other case, the Web of Science were used as data source for these rankings. The rankings created in these two ways were compared with each other. The results show that the choice of the data source has a major influence on the ranking results. For researchers from non-English-speaking countries with (many) publications in their respective national languages, an exclusive use of international databases, such as Web of Science in our case, cannot fully consider the whole research performance. In these cases, the use of personal publication lists seems to make a lot of sense, at least for several ranking variants, despite the effort involved. The main contribution of our study is that we compare personal publication lists as a data source with Web of Science which is often used in research evaluations. In addition, this comparison is not, as usual, input-related (based on the degree of coverage in the two data sources) but impact-related (based on rankings that are created based on the publications contained in the two data sources).
Céspedes, Lucía (58664604300); Kozlowski, Diego (58708470400); Pradier, Carolina (59256828500); Sainte-Marie, Maxime Holmberg (48361689700); Shokida, Natsumi Solange (59256719700); Benz, Pierre (57195608832); Poitras, Constance (58109068600); Ninkov, Anton Boudreau (57193712658); Ebrahimy, Saeideh (59158038800); Ayeni, Philips (57193542400); Filali, Sarra (59358049900); Li, Bing (58660645000); Larivière, Vincent (14028805600)
Evaluating the linguistic coverage of OpenAlex: An assessment of metadata accuracy and completeness
2025
10.1002/asi.24979
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85214668836&doi=10.1002%2fasi.24979&partnerID=40&md5=c8cd84d2b9d6c968d953583ae72d53e0
Chaire UNESCO sur la Science Ouverte, École de bibliothéconomie et des sciences de l’information, Université de Montréal, Montreal, QC, Canada; Consortium Érudit, Université de Montréal, Montreal, QC, Canada; Danish Centre for Studies in Research and Research Policy, Department of Political Sciences, Aarhus University, Aarhus, Denmark; Department of Design, Media and Educational Science, University of Southern Denmark, Odense, Denmark; Department of Knowledge and Information Science, Shiraz University, Shiraz, Iran; Chancellor Paterson Library, Lakehead University, Thunder Bay, ON, Canada; Centre interuniversitaire de recherche sur la science et la technologie, Université du Québec à Montréal, Montreal, QC, Canada; Institute of Science and S&T Management, Dalian University of Technology, Dalian, China; Department of Science and Innovation, National Research Foundation Centre of Excellence in Scientometrics and Science, Technology and Innovation Policy, Stellenbosch University, Stellenbosch, South Africa; Observatoire des sciences et des technologies, Université du Québec à Montréal, Montreal, QC, Canada
All Open Access; Hybrid Gold Open Access
Scopus
Artículo obtenido de:
Scopus
Fuente
0 0 votos
Califica el artículo
Campus Samborondón
Vía Samborondón Km. 13.5
Call Center: 5150400
metricas@ecotec.edu.ec
Facebook Instagram Youtube

Mapa del sitio