{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T00:26:29Z","timestamp":1780446389187,"version":"3.54.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T00:00:00Z","timestamp":1710115200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T00:00:00Z","timestamp":1710115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["EPUC3M02"],"award-info":[{"award-number":["EPUC3M02"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["88887.687378\/2022-00"],"award-info":[{"award-number":["88887.687378\/2022-00"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad Carlos III"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Although funding acknowledgements (FAs) have been around for nearly three decades, there are not yet enough theoretical and practical studies of them to enable FAs to be considered a consolidated area of research. Fortunately, newly published findings and promising data sources presented in recent years have helped better our understanding of the process of scientific creation and communication and provide evidence of the importance of FAs. This paper seeks to help demonstrate the crucial role FAs play in evaluating research funding\u2019s performance. A methodology based on the use of linked open metadata from diverse sources is presented for this purpose. The methodology highlights the important work analysts do to increase the accuracy, solidity, and diversity of the results of FA-based quantitative studies by gathering and analysing the data furnished by funding organisations. Lastly, the projects funded by the Spanish National Science and Research Agency from 2008 to 2020 are evaluated to verify the method\u2019s usefulness, robustness, and reproducibility. Also, a new unit of analysis is introduced, funders, to create a new type of co-occurrence network: co-funding. In conclusion, funding agencies\u2019 experts and analysts will find that this methodology gives them a valuable instrument for boosting the quality and efficacy of their activities, complying with transparency and accountability requirements, and quantifying the scope of funding results.<\/jats:p>","DOI":"10.1007\/s11192-024-04975-8","type":"journal-article","created":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T16:02:47Z","timestamp":1710172967000},"page":"5841-5868","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Public funding accountability: a linked open data-based methodology for analysing the scientific productivity and influence of funded projects"],"prefix":"10.1007","volume":"129","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1188-3481","authenticated-orcid":false,"given":"Antonio","family":"Perianes-Rodr\u00edguez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Olmeda-G\u00f3mez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalia R.","family":"Delbianco","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Cl\u00e1udia Cabrini","family":"Gr\u00e1cio","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,11]]},"reference":[{"key":"4975_CR1","unstructured":"AEI. (2022). Presentation. [Online]. Madrid: Agencia Estatal de Investigaci\u00f3n. <https:\/\/www.aei.gob.es\/en\/about-aei\/presentation>. [Accessed: 03\/01\/2024]."},{"issue":"1","key":"4975_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2020.101102","volume":"15","author":"B \u00c1lvarez-Bornstein","year":"2021","unstructured":"\u00c1lvarez-Bornstein, B., & Bordons, M. (2021). Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines. Journal of Informetrics, 15(1), 101102. https:\/\/doi.org\/10.1016\/j.joi.2020.101102","journal-title":"Journal of Informetrics"},{"issue":"4","key":"4975_CR3","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1093\/reseval\/rvaa038","volume":"29","author":"B \u00c1lvarez-Bornstein","year":"2020","unstructured":"\u00c1lvarez-Bornstein, B., & Montesi, M. (2020). Funding acknowledgements in scientific publications: A literature review. Research Evaluation, 29(4), 469\u2013488. https:\/\/doi.org\/10.1093\/reseval\/rvaa038","journal-title":"Research Evaluation"},{"issue":"3","key":"4975_CR4","doi-asserted-by":"publisher","first-page":"1793","DOI":"10.1007\/s11192-017-2453-4","volume":"112","author":"B \u00c1lvarez-Bornstein","year":"2017","unstructured":"\u00c1lvarez-Bornstein, B., Morillo, F., & Bordons, M. (2017). Funding acknowledgments in the Web of Science: Completeness and accuracy of collected data. Scientometrics, 112(3), 1793\u20131812. https:\/\/doi.org\/10.1007\/s11192-017-2453-4","journal-title":"Scientometrics"},{"key":"4975_CR5","unstructured":"ANR. (2022). Missions. [Online]. Paris: Agence National de la Recherche. <https:\/\/anr.fr\/en\/anrs-role-in-research\/about-us\/missions\/>. [Accessed: 03\/01\/2024]."},{"key":"4975_CR6","unstructured":"Boyack KW. (2009). Linking grants to articles: characterization of NIH grant information indexed in Medline. [Online]. Proceedings of ISSI 2009, p. 730\u2013741. <https:\/\/www.issi-society.org\/proceedings\/issi_2009\/ISSI2009-proc-vol2_Aug2009_batch1-paper-22.pdf>. [Accessed: 03\/01\/2024]."},{"issue":"5","key":"4975_CR7","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1002\/asi.10230","volume":"54","author":"KW Boyack","year":"2003","unstructured":"Boyack, K. W., & Borner, K. (2003). Indicator-assisted evaluation and funding of research: Visualizing the influence of grants on the number and citation counts of research papers. Journal of the American Society for Information Science and Technology, 54(5), 447\u2013461. https:\/\/doi.org\/10.1002\/asi.10230","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"4975_CR8","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1136\/amiajnl-2011-000213","volume":"18","author":"KW Boyack","year":"2011","unstructured":"Boyack, K. W., & Jordan, P. (2011). Metrics Associated with NIH Funding: A high-level view. Journal of the American Medical Informatics Association, 18(4), 423\u2013431. https:\/\/doi.org\/10.1136\/amiajnl-2011-000213","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"1","key":"4975_CR9","doi-asserted-by":"publisher","first-page":"59","DOI":"10.3152\/147154401781777141","volume":"10","author":"L Butler","year":"2001","unstructured":"Butler, L. (2001). Revisiting bibliometric issues using new empirical data. Research Evaluation, 10(1), 59\u201365. https:\/\/doi.org\/10.3152\/147154401781777141","journal-title":"Research Evaluation"},{"key":"4975_CR10","unstructured":"Clarivate. (2018). InCites. Indicators handbook. [Online]. Philadelphia: Clarivate. <https:\/\/tinyurl.com\/2n37d44e>. [Accessed: 03\/01\/2024]."},{"issue":"2","key":"4975_CR11","doi-asserted-by":"publisher","first-page":"172","DOI":"10.3989\/redc.1995.v18.i2.654","volume":"18","author":"B Cronin","year":"1995","unstructured":"Cronin, B., & Weaver, S. (1995). The praxis of acknowledgment: From bibliometrics to influmetrics. Revista Espa\u00f1ola De Documentacion Cientifica, 18(2), 172\u2013177. https:\/\/doi.org\/10.3989\/redc.1995.v18.i2.654","journal-title":"Revista Espa\u00f1ola De Documentacion Cientifica"},{"key":"4975_CR12","unstructured":"ERC. (2022). ERC at a glance. [Online]. Brussels: European Research Council. <https:\/\/erc.europa.eu\/about-erc\/erc-glance>. [Accessed: 03\/01\/2024]."},{"key":"4975_CR13","doi-asserted-by":"publisher","first-page":"e65263","DOI":"10.1371\/journal.pone.0065263","volume":"8","author":"JM Fortin","year":"2013","unstructured":"Fortin, J. M., & Currie, D. J. (2013). Big science vs. little science: How scientific impact scales with funding. PLoS ONE, 8, e65263. https:\/\/doi.org\/10.1371\/journal.pone.0065263","journal-title":"PLoS ONE"},{"issue":"3","key":"4975_CR14","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1002\/asi.23406","volume":"67","author":"A Gok","year":"2015","unstructured":"Gok, A., Rigby, J., & Shapira, P. (2015). The impact of research funding on scientific outputs: Evidence from six smaller European countries. Journal of the Association for Information Science and Technology, 67(3), 715\u2013730. https:\/\/doi.org\/10.1002\/asi.23406","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"4975_CR15","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1002\/asi.23737","volume":"68","author":"N Grassano","year":"2017","unstructured":"Grassano, N., Rotolo, D., Hutton, J., Lang, F., & Hopkins, M. M. (2017). Funding data from publication acknowledgments: Coverage, uses, and limitations. Journal of the Association for Information Science and Technology, 68(4), 999\u20131017. https:\/\/doi.org\/10.1002\/asi.23737","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4975_CR16","volume-title":"An\u00e1lise multivariada de dados","author":"JF Hair","year":"2005","unstructured":"Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (2005). An\u00e1lise multivariada de dados. Bookman."},{"issue":"3","key":"4975_CR17","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1162\/qss_a_00210","volume":"3","author":"B Kramer","year":"2022","unstructured":"Kramer, B., & de Jonge, H. (2022). The availability and completeness of open funder metadata: Case study for publications funded by the Dutch Research Council. Quantitative Science Studies, 3(3), 583\u2013599. https:\/\/doi.org\/10.1162\/qss_a_00210","journal-title":"Quantitative Science Studies"},{"key":"4975_CR18","doi-asserted-by":"publisher","DOI":"10.4337\/9781800883086.00005","volume-title":"Handbook of public research funding","author":"B Lepori","year":"2023","unstructured":"Lepori, B., Jongbloed, B., & Hicks, D. (2023). Introduction. Understanding vertical and horizontal complexities in public research funding. In B. Lepori, B. Jongbloed, & D. Hicks (Eds.), Handbook of public research funding. Edward Elgar. https:\/\/doi.org\/10.4337\/9781800883086.00005"},{"issue":"1","key":"4975_CR19","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1093\/rev\/7.1.7","volume":"7","author":"M MacLean","year":"1998","unstructured":"MacLean, M., Davies, C., Lewison, G., & Anderson, J. (1998). Evaluating the research activity and impact of funding agencies. Research Evaluation, 7(1), 7\u201316. https:\/\/doi.org\/10.1093\/rev\/7.1.7","journal-title":"Research Evaluation"},{"key":"4975_CR20","doi-asserted-by":"publisher","unstructured":"Mugabushaka AM. (2020). Linking Publications to funding at project level: a curated dataset of publications reported by FP7 projects. arXiv. DOI: https:\/\/doi.org\/10.48550\/arXiv.2011.07880.","DOI":"10.48550\/arXiv.2011.07880"},{"key":"4975_CR21","doi-asserted-by":"publisher","unstructured":"Mugabushaka AM. (2022). Practically all Scopus-indexed journals are also indexed in open scholarly infrastructures: a contribution to the assessment of data quality in open scholarly data infrastructures. [Pre-print]. Brussels: ERC. 6 p. DOI: https:\/\/doi.org\/10.5281\/zenodo.7307474.","DOI":"10.5281\/zenodo.7307474"},{"issue":"3","key":"4975_CR22","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1162\/qss_a_00212","volume":"3","author":"AM Mugabushaka","year":"2022","unstructured":"Mugabushaka, A. M., van Eck, N. J., & Waltman, L. (2022). Funding COVID-19 research: insights from an exploratory analysis using open data infrastructures. Quantitative Science Studies, 3(3), 560\u2013582. https:\/\/doi.org\/10.1162\/qss_a_00212","journal-title":"Quantitative Science Studies"},{"key":"4975_CR23","unstructured":"NSF. (2022). At a glance. [Online]. Alexandria [Virginia]: National Science Foundation. <https:\/\/www.nsf.gov\/about\/glance.jsp>. [Accessed: 03\/01\/2024]."},{"issue":"1","key":"4975_CR24","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s11192-016-1953-y","volume":"108","author":"A Paul-Hus","year":"2016","unstructured":"Paul-Hus, A., Desrochers, N., & Costas, R. (2016). Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science. Scientometrics, 108(1), 167\u2013182. https:\/\/doi.org\/10.1007\/s11192-016-1953-y","journal-title":"Scientometrics"},{"issue":"4","key":"4975_CR25","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.1016\/j.joi.2016.10.006","volume":"10","author":"A Perianes-Rodr\u00edguez","year":"2016","unstructured":"Perianes-Rodr\u00edguez, A., Waltman, L., & van Eck, N. J. (2016). Constructing bibliometric networks: A comparison between full and fractional counting. Journal of Informetrics, 10(4), 1178\u20131195. https:\/\/doi.org\/10.1016\/j.joi.2016.10.006","journal-title":"Journal of Informetrics"},{"key":"4975_CR26","first-page":"7","volume":"26","author":"J Priem","year":"2022","unstructured":"Priem, J., Piwowar, H., & Orr, R. (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. International Conference on Science and Technology Indicators, 26, 7\u20139.","journal-title":"International Conference on Science and Technology Indicators"},{"key":"4975_CR27","volume-title":"Estat\u00edstica multivariada aplicada","author":"E Reis","year":"2001","unstructured":"Reis, E. (2001). Estat\u00edstica multivariada aplicada. S\u00edlabo."},{"issue":"5","key":"4975_CR28","doi-asserted-by":"publisher","first-page":"365","DOI":"10.3152\/095820211X13164389670392","volume":"20","author":"J Rigby","year":"2011","unstructured":"Rigby, J. (2011). Systematic grant and funding body acknowledgement data for publications: New dimensions and new controversies for research policy and evaluation. Research Evaluation, 20(5), 365\u2013375. https:\/\/doi.org\/10.3152\/095820211X13164389670392","journal-title":"Research Evaluation"},{"key":"4975_CR29","unstructured":"Roberge G, B\u00e9dard-Vall\u00e9e A, Rivest M. (2021). Bibliometrics indicators for the science and Engineeering Indicators 2022. Montreal: Science-Metrix. [Online]. < https:\/\/www.science-metrix.com\/wp-content\/uploads\/2021\/10\/Technical_Documentation_Bibliometrics_SEI_2022_2021-09-14.pdf>. [Accessed: 03\/01\/2024]."},{"key":"4975_CR30","unstructured":"ROR. (2022). About Research Organization Registry. [Online]. Oakland: California Digital Library. <https:\/\/ror.org\/about\/>. [Accessed: 03\/01\/2024]."},{"issue":"3","key":"4975_CR31","doi-asserted-by":"publisher","first-page":"790","DOI":"10.1002\/asi.23713","volume":"68","author":"L Tang","year":"2017","unstructured":"Tang, L., Hu, G., & Liu, W. (2017). Funding acknowledgment analysis: Queries and caveats. Journal of the Association for Information Science and Technology, 68(3), 790\u2013794. https:\/\/doi.org\/10.1002\/asi.23713","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4975_CR32","doi-asserted-by":"publisher","first-page":"6085","DOI":"10.1007\/s11192-023-04836-w","volume":"128","author":"M Thelwall","year":"2023","unstructured":"Thelwall, M., Simrick, S., Viney, I., & van den Besselaar, P. (2023). What is research funding, how does it influence research, and how is it recorded? Key dimensions of variation. Scientometrics, 128, 6085\u20136106. https:\/\/doi.org\/10.1007\/s11192-023-04836-w","journal-title":"Scientometrics"},{"key":"4975_CR33","doi-asserted-by":"publisher","DOI":"10.31222\/osf.io\/smxe5","volume-title":"Crossref as a source of open bibliographic metadata","author":"NJ van Eck","year":"2022","unstructured":"van Eck, N. J., & Waltman, L. (2022). Crossref as a source of open bibliographic metadata. Centre for Science and Technology Studies. https:\/\/doi.org\/10.31222\/osf.io\/smxe5"},{"key":"4975_CR34","volume-title":"Bioestat\u00edstica: t\u00f3picos avan\u00e7ados. Testes n\u00e3o param\u00e9tricos, testes diagn\u00f3sticos, medidas de associa\u00e7\u00e3o e concord\u00e2ncia","author":"S Vieira","year":"2003","unstructured":"Vieira, S. (2003). Bioestat\u00edstica: t\u00f3picos avan\u00e7ados. Testes n\u00e3o param\u00e9tricos, testes diagn\u00f3sticos, medidas de associa\u00e7\u00e3o e concord\u00e2ncia. Elsevier."},{"key":"4975_CR35","unstructured":"Yegros-Yegros A, Costas R. (2013). Analysis of the web of science funding acknowledgement information for the design of indicators on external funding attraction. [Online]. Proceedings of ISSI 2013, p. 84\u201395. <https:\/\/www.issi-society.org\/proceedings\/issi_2013\/ISSI_Proceedings_Volume_I.pdf>. [Accessed: 03\/01\/2024]."},{"issue":"2","key":"4975_CR36","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1007\/s11192-010-0191-y","volume":"84","author":"D Zhao","year":"2010","unstructured":"Zhao, D. (2010). Characteristics and impact of grant-funded research: A case study of the library and information science field. Scientometrics, 84(2), 293\u2013306. https:\/\/doi.org\/10.1007\/s11192-010-0191-y","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-04975-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-024-04975-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-04975-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T11:58:51Z","timestamp":1732276731000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-024-04975-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,11]]},"references-count":36,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["4975"],"URL":"https:\/\/doi.org\/10.1007\/s11192-024-04975-8","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,11]]},"assertion":[{"value":"13 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}