{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T11:52:11Z","timestamp":1776858731516,"version":"3.51.2"},"reference-count":38,"publisher":"Editorial CSIC","issue":"3","license":[{"start":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T00:00:00Z","timestamp":1767830400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Rev. esp. doc. Cient"],"abstract":"<jats:p>The risks of using an evaluation system based solely on quantitative indicators have been the subject of much debate. The reform proposed by the European Commission calls for researchers to be assessed on their intrinsic merits and achievements, rather than on the number of publications and the channels through which they are published. It promotes qualitative evaluation through peer review, supported by the responsible use of quantitative analysis. The aim of this study is to identify trends and developments in the implementation of the new evaluation practices proposed in the European Agreement on the Reform of Research Evaluation. To achieve this objective, a literature review was carried out, focusing on the reform of research evaluation recommended by the European Commission, and an analysis of the action plans submitted to Zenodo. The results show that a small number of institutions are taking the first steps towards implementing the proposed changes, compared to the signatory members of the Coalition for Advancing Research for Assessment (CoARA).<\/jats:p>","DOI":"10.3989\/redc.2025.3.1636","type":"journal-article","created":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T07:36:00Z","timestamp":1767857760000},"page":"1636","source":"Crossref","is-referenced-by-count":0,"title":["Mudan\u00e7as nas pr\u00e1ticas de avalia\u00e7\u00e3o da investiga\u00e7\u00e3o: o Acordo Europeu, tend\u00eancias e desenvolvimentos"],"prefix":"10.3989","volume":"48","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5530-6435","authenticated-orcid":false,"given":"Rosa","family":"Silva","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7755-6168","authenticated-orcid":false,"given":"Maria Manuel","family":"Borges","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1745-8937","authenticated-orcid":false,"given":"Paulo","family":"Vaz","sequence":"additional","affiliation":[]}],"member":"2373","published-online":{"date-parts":[[2026,1,8]]},"reference":[{"issue":"2","key":"ref0","doi-asserted-by":"publisher","first-page":"1","DOI":"10.6018\/analesdoc.397551","article-title":"Influencia de las redes sociales acad\u00e9micas en la construcci\u00f3n de la identidad digital latinoamericana","volume":"23","author":"Artigas","year":"2020","unstructured":"Artigas, W., & Casanova, I. (2020). Influencia de las redes sociales acad\u00e9micas en la construcci\u00f3n de la identidad digital latinoamericana. Anales de Documentaci\u00f3n, 23(2), 1-13.","journal-title":"Anales de Documentaci\u00f3n"},{"key":"ref1","unstructured":"ASCB. (2012). Declara\u00e7\u00e3o de S\u00e3o Francisco sobre avalia\u00e7\u00e3o da pesquisa (DORA). Annual Meeting of The American Society for Cell Biology, San Francisco. Available at: https:\/\/sfdora.org\/read\/read-the-declaration-portugues-brasileiro\/."},{"key":"ref2","doi-asserted-by":"publisher","unstructured":"Bonn, N. A., De Vries, R. G., & Pinxten, W. (2022). The failure of success: Four lessons learned in five years of research on research integrity and research assessments. BMC Research Notes, 15(1). Scopus.","DOI":"10.1186\/s13104-022-06191-0"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1101\/2020.06.22.165654","article-title":"Advancing science or advancing careers? Researchers' opinions on success indicators (p","author":"Bonn","year":"2020","unstructured":"Bonn, N. A., & Pinxten, W. (2020). Advancing science or advancing careers? Researchers' opinions on success indicators (p. 2020.06.22.165654). bioRxiv.","journal-title":"2020"},{"key":"ref4","unstructured":"Bracke, N. (2022). The evaluation of research and researchers: Current trends and developments."},{"key":"ref5","unstructured":"Breindl, F. (2024). MU publishes its vision for research assessment reform. Available at: https:\/\/www.em.muni.cz\/en\/science\/17159-mu-publishes-its-vision-for-research-assessment-reform."},{"key":"ref6","unstructured":"Brekke, K. W. (2023). NTNU Action Plan for the implementation of the CoARA commitments."},{"key":"ref7","unstructured":"Caduff, C., Brunner, P., & Raab, A. (2023). BFH Action Plan for Responsible Research Assessment: 2024 and Beyond. Available at: https:\/\/zenodo.org\/records\/10301375."},{"key":"ref8","unstructured":"Cerrato-Rodriguez, B., & Larraz Rada, V. (2024). CoARA Action Plan 2023. University of Andorra, Andorra."},{"key":"ref9","unstructured":"CoARA. (2022). CoARA: The Agreement. CoARA. Available at: https:\/\/coara.eu\/."},{"key":"ref10","unstructured":"CoARA. (2023). CoARA Boost Project. CoARA. Available at: https:\/\/coara.eu\/coalition\/coara-boost-project\/."},{"key":"ref11","unstructured":"CoARA. (2024). Membership. CoARA. Available at: https:\/\/coara.eu\/coalition\/membership\/."},{"key":"ref12","unstructured":"CoARA. (s.d.a). Coalition for Advancing Research Assessment. CoARA. Available at: https:\/\/coara.eu\/."},{"key":"ref13","unstructured":"CoARA. (s.d.b). The Commitments. CoARA. Available at: https:\/\/coara.eu\/agreement\/the-commitments\/."},{"issue":"2","key":"ref14","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1007\/s11192-009-0146-3","article-title":"Software survey: VOSviewer, a computer program for bibliometric mapping","volume":"84","author":"Eck","year":"2010","unstructured":"Eck, N. J. van, & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523-538.","journal-title":"Scientometrics"},{"key":"ref15","unstructured":"European Commission, Directorate-General for Research and Innovation, Peters, I., Frodeman, R., & Wilsdon, J. (2017). Next-generation metrics: Responsible metrics and evaluation for open science. Publications Office. Available at: https:\/\/data.europa.eu\/doi\/10.2777\/337729."},{"key":"ref16","unstructured":"Ghent University. (2023). Reforming Research Assessment: Ghent University's commitment to implement the European Agreement on Reforming Research Assessment. Action Plan 2023-2027. Zenodo."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1038\/520429a","article-title":"The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","unstructured":"Hicks, D., Wouters, P., Waltman, L., & de Rijcke, S. (2015). The Leiden Manifesto for research metrics. Nature, 520, 429-431.","journal-title":"Nature"},{"issue":"46","key":"ref18","doi-asserted-by":"publisher","first-page":"16569","DOI":"10.1073\/pnas.0507655102","article-title":"An index to quantify an individual's scientific research output","volume":"102","author":"Hirsch","year":"2005","unstructured":"Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569-16572.","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"ref19","unstructured":"Jaekel, M., & \u0160imukovi\u010d, E. (2024). CoARA Action Plan for the ZHAW Zurich University of Applied Sciences."},{"key":"ref20","unstructured":"Kallio, M., Rauhala, M., & Sipola, T. (2023). CoARA Action Plan 2023. University of Oulu, Finland. Zenodo. DOI: https:\/\/doi.org\/10.5281\/zenodo.10039478."},{"key":"ref21","doi-asserted-by":"publisher","unstructured":"Latour, B., & Woolgar, S. (1986). Laboratory life: The construction of scientific facts. Princeton University Press. chrome extension:\/\/efaidnbmnnnibpcajpcglclefindmkaj\/. Available at: https:\/\/sites.tufts.edu\/histmath\/files\/2015\/11\/LatourLabLif.pdf.","DOI":"10.1515\/9781400820412"},{"key":"ref22","unstructured":"Loughborough University. (2023). Loughborough University CoARA Action Plan."},{"issue":"1","key":"ref23","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1007\/s11192-020-03690-4","article-title":"Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: A multidisciplinary comparison of coverage via citations","volume":"126","author":"Mart\u00edn-Mart\u00edn","year":"2021","unstructured":"Mart\u00edn-Mart\u00edn, A., Thelwall, M., Orduna-Malea, E., & Delgado L\u00f3pez-C\u00f3zar, E. (2021). Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: A multidisciplinary comparison of coverage via citations. Scientometrics, 126(1), 871-906.","journal-title":"Scientometrics"},{"key":"ref24","unstructured":"Masaryk University, & Petr, M. (2023). Masaryk University CoARA Action Plan v1."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1590\/s0104-59702017000300005","article-title":"A avalia\u00e7\u00e3o da produtividade cient\u00edfica","author":"Mattedi","year":"2017","unstructured":"Mattedi, M. A., & Spiess, M. R. (2017). A avalia\u00e7\u00e3o da produtividade cient\u00edfica. Hist\u00f3ria, Ci\u00eancias, Sa\u00fade-Manguinhos, 24, 623-643.","journal-title":"Hist\u00f3ria Ci\u00eancias Sa\u00fade-Manguinhos 24"},{"issue":"2","key":"ref26","doi-asserted-by":"publisher","first-page":"152","DOI":"10.11613\/BM.2015.016","article-title":"Altmetrics - A complement to conventional metrics","volume":"25","author":"Melero","year":"2015","unstructured":"Melero, R. (2015). Altmetrics - A complement to conventional metrics. Biochemia Medica, 25(2), 152-160. Scopus.","journal-title":"Biochemia Medica"},{"key":"ref27","unstructured":"Murkett, G., & Young, H. (2023). Reforming Research Assessment at Strathclyde: A five-year CoARA action plan. Available at: https:\/\/zenodo.org\/records\/10017553."},{"key":"ref28","unstructured":"N\u00e4reaho, S., Haataja, M., & Ylimaunu, J. (2024). CoARA Action Plan 2024-2027 Metropolia University of Applied Sciences. Available at: https:\/\/zenodo.org\/records\/10616969."},{"key":"ref29","unstructured":"Norsted, K. S. (2023). \u00d8stfold University College CoARA Action Plan."},{"issue":"5","key":"ref30","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1016\/j.emj.2023.08.006","article-title":"Reflections on the diffusion of management and organization research in the context of open science in Europe","volume":"41","author":"Rodriguez-Pomeda","year":"2023","unstructured":"Rodriguez-Pomeda, J., Casani, F., & Serrano-L\u00f3pez, A. E. (2023). Reflections on the diffusion of management and organization research in the context of open science in Europe. European Management Journal, 41(5), 664-672.","journal-title":"European Management Journal"},{"key":"ref31","unstructured":"Saugmann, P. M., Schoch, H., Dahle, S., \u0130\u015fler, D., Pilia, S., & Lewandowska, A. (2023). Eurodoc Statement on \"Commitments to Developing a Eurodoc CoARA Action Plan\"."},{"key":"ref32","unstructured":"Science Europe, European University Association, & Stroobants, K. (2022). Agreement on reforming research assessment. Comiss\u00e3o Europeia. Available at: https:\/\/www.scienceeurope.org\/media\/y41ks1wh\/20220720-rra-agreement.pdf."},{"key":"ref33","unstructured":"The Metric Tide. (2015). The Metric Tide Full Report Exec Summary. Available at: https:\/\/www.ukri.org\/wp-content\/uploads\/2021\/12\/RE-151221-TheMetricTideFullReportExecSummary.pdf."},{"key":"ref34","unstructured":"University of Luxembourg. (2024). University of Luxembourg CoARA Action Plan. Zenodo."},{"key":"ref35","unstructured":"Vuolteenaho, M., P\u00e4iv\u00e4rinne, T., Juvonen, S., & Kelkka, T. (2023). CoARA Action Plan Laurea University of Applied Sciences 2023. Available at: https:\/\/zenodo.org\/records\/10406054."},{"key":"ref36","unstructured":"Wilfong, E., & Bendiscioli, S. (2024). Action plan: Aligning research assessment practices with CoARA. Available at: https:\/\/zenodo.org\/records\/10633943."},{"key":"ref37","unstructured":"Zelenika, S., & Jakomini\u0107 Marot, N. (2024). University of Rijeka Reform of Research Assessment: CoARA Action Plan 2024-2027."}],"container-title":["Revista Espa\u00f1ola de Documentaci\u00f3n Cient\u00edfica"],"original-title":[],"link":[{"URL":"https:\/\/redc.revistas.csic.es\/index.php\/redc\/article\/download\/1636\/2463","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/redc.revistas.csic.es\/index.php\/redc\/article\/download\/1636\/2464","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/redc.revistas.csic.es\/index.php\/redc\/article\/download\/1636\/2465","content-type":"text\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/redc.revistas.csic.es\/index.php\/redc\/article\/download\/1636\/2464","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T11:23:16Z","timestamp":1776856996000},"score":1,"resource":{"primary":{"URL":"https:\/\/redc.revistas.csic.es\/index.php\/redc\/article\/view\/1636"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,8]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,1,8]]}},"URL":"https:\/\/doi.org\/10.3989\/redc.2025.3.1636","relation":{},"ISSN":["1988-4621","0210-0614"],"issn-type":[{"value":"1988-4621","type":"electronic"},{"value":"0210-0614","type":"print"}],"subject":[],"published":{"date-parts":[[2026,1,8]]}}}