{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T04:54:11Z","timestamp":1792472051445,"version":"4.5.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T00:00:00Z","timestamp":1783036800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T00:00:00Z","timestamp":1783036800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100019187","name":"HORIZON EUROPE Widening Participation and Strengthening the European Research Area","doi-asserted-by":"publisher","award":["101094853"],"award-info":[{"award-number":["101094853"]}],"id":[{"id":"10.13039\/100019187","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Res Integr Peer Rev"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Research reproducibility \u2013 the ability of others to independently verify scientific findings by following the same methods and data \u2013 is a fundamental aspect of research integrity. When this fails, trust in evidence is undermined and research resources are wasted. Reproducibility measures describe the standards that define reproducible research, and reproducibility interventions are the actions used to improve those standards. There is little agreement on which practices and initiatives should be prioritised for implementation in practice. This study aimed to establish expert consensus on the key measures and interventions that should be prioritised to strengthen research reproducibility.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a Delphi consensus study as part of the EU Horizon Europe iRISE project. Experts from five stakeholder groups (researchers, editors, publishers, funders, and policymakers) evaluated reproducibility measures and interventions identified through prior literature mapping across two online survey rounds, followed by a final virtual consensus panel. Items were rated on a 10-point Likert scale, with consensus defined a priori as agreement by at least 70% of panellists assigning high-priority scores, corresponding to scores of eight to ten on the Likert scale.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Seventy-three panellists from 34 countries participated in the first round, with high retention rates in the subsequent round. Consensus was achieved on eight reproducibility measures and six reproducibility interventions in the first round. Prioritised measures included methodological quality, reporting quality, code and data availability and reuse, computational reproducibility, transparency of research plan, reproducible workflow practices, trial registration, and materials availability and reuse. Prioritised interventions included data management training, data quality checks\/feedback, statistical training, data sharing policy\/guidelines, protocol\/trial registration, and reproducible code\/analysis training.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The prioritised measures and interventions provide a structured foundation for improving research reproducibility across disciplines. The findings can inform the development of institutional training curricula in data management and statistical methods, policies supporting data sharing and trial registration, and future empirical evaluation of these practices across research contexts.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s41073-026-00217-y","type":"journal-article","created":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T22:04:09Z","timestamp":1783029849000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Prioritising measures and interventions to strengthen research reproducibility: a Delphi consultation study"],"prefix":"10.1186","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-6741-1010","authenticated-orcid":false,"given":"Dora","family":"Pejdo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8719-7277","authenticated-orcid":false,"given":"Ivan","family":"Buljan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6272-0917","authenticated-orcid":false,"given":"Ana","family":"Maru\u0161i\u0107","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,3]]},"reference":[{"key":"217_CR1","doi-asserted-by":"crossref","unstructured":"Ioannidis JPA. Why most published research findings are false. In: Wikipedia. 2005.","DOI":"10.1371\/journal.pmed.0020124"},{"issue":"1","key":"217_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41562-016-0021","volume":"1","author":"MR Munaf\u00f2","year":"2017","unstructured":"Munaf\u00f2 MR, Nosek BA, Bishop DVM, Button KS, Chambers CD, Percie du Sert N, et al. A manifesto for reproducible science. Nat Hum Behav. 2017;1(1):1. https:\/\/doi.org\/10.1038\/s41562-016-0021.","journal-title":"Nat Hum Behav"},{"issue":"7604","key":"217_CR3","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","volume":"533","author":"M Baker","year":"2016","unstructured":"Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533(7604):452\u20134. https:\/\/doi.org\/10.1038\/533452a.","journal-title":"Nature"},{"issue":"1","key":"217_CR4","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s40614-019-00193-3","volume":"42","author":"S Laraway","year":"2019","unstructured":"Laraway S, Snycerski S, Pradhan S, Huitema BE. An overview of scientific reproducibility: consideration of relevant issues for behavior science\/analysis. Perspect Behav Sci. 2019;42(1):33\u201357. https:\/\/doi.org\/10.1007\/s40614-019-00193-3.","journal-title":"Perspect Behav Sci"},{"issue":"1","key":"217_CR5","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1161\/CIRCRESAHA.114.303819","volume":"116","author":"CG Begley","year":"2015","unstructured":"Begley CG, Ioannidis JPA. Reproducibility in science. Circ Res. 2015;116(1):116\u201326. https:\/\/doi.org\/10.1161\/CIRCRESAHA.114.303819.","journal-title":"Circ Res"},{"issue":"6168","key":"217_CR6","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1126\/science.1250475","volume":"343","author":"M McNutt","year":"2014","unstructured":"McNutt M. Reproducibility. Science. 2014;343(6168):229\u2013229. https:\/\/doi.org\/10.1126\/science.1250475.","journal-title":"Science"},{"key":"217_CR7","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1016\/j.envint.2016.01.005","volume":"92\u201393","author":"AA Rooney","year":"2016","unstructured":"Rooney AA, Cooper GS, Jahnke GD, Lam J, Morgan RL, Boyles AL, et al. How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards. Environ Int. 2016;92\u201393:617\u201329. https:\/\/doi.org\/10.1016\/j.envint.2016.01.005.","journal-title":"Environ Int"},{"key":"217_CR8","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1186\/s13104-022-06030-2","volume":"15","author":"M Macleod","year":"2022","unstructured":"Macleod M. Improving the reproducibility and integrity of research: what can different stakeholders contribute? BMC Res Notes. 2022;15:146. https:\/\/doi.org\/10.1186\/s13104-022-06030-2. PubMed PMID: 35468858; PubMed Central PMCID: PMC9036698.","journal-title":"BMC Res Notes"},{"issue":"1","key":"217_CR9","doi-asserted-by":"publisher","first-page":"251524592312138","DOI":"10.1177\/25152459231213808","volume":"7","author":"RT Thibault","year":"2024","unstructured":"Thibault RT, Bailey-Rodriguez D, Bartlett JE, Blazey P, Green RJ, Pownall M, et al. A Delphi study to strengthen research-methods training in undergraduate psychology programs. Adv Methods Pract Psychol Sci. 2024;7(1):25152459231213810. https:\/\/doi.org\/10.1177\/25152459231213808.","journal-title":"Adv Methods Pract Psychol Sci"},{"key":"217_CR10","unstructured":"National Academies of Sciences E, Affairs P and G, Committee on Science E, Information B on RD and, Sciences D on E and P, Statistics C on A and T, et al. Improving reproducibility and replicability. In: Reproducibility and Replicability in Science. National Academies Press (US); 2019. Available from: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK547525\/. Cited 12 Feb 2024."},{"issue":"341","key":"217_CR11","doi-asserted-by":"publisher","first-page":"341ps12","DOI":"10.1126\/scitranslmed.aaf5027","volume":"8","author":"SN Goodman","year":"2016","unstructured":"Goodman SN, Fanelli D, Ioannidis JPA. What does research reproducibility mean? Sci Transl Med. 2016;8(341):341ps12. https:\/\/doi.org\/10.1126\/scitranslmed.aaf5027. PubMed PMID: 27252173.","journal-title":"Sci Transl Med"},{"key":"217_CR12","unstructured":"Hair K, Sena E, Wever K, McCann S, Nilsonne G, Fanelli D, et al. iRise Part B v3.pdf. 2022 Apr 25. Available from: https:\/\/osf.io\/eagn6. Cited 13 Jan 2026."},{"key":"217_CR13","unstructured":"Hair K, McCann S, Sena E, Smith S. iRISE SOLES. 2023 Nov 30. Available from: https:\/\/osf.io\/9hzcv. cited 23 Dec 2025."},{"issue":"2","key":"217_CR14","doi-asserted-by":"publisher","first-page":"e101117","DOI":"10.15252\/embj.2018101117PubMedPMID:30518534;PubMedCentralPMCID:PMC6331711","volume":"38","author":"U Dirnagl","year":"2019","unstructured":"Dirnagl U. Rethinking research reproducibility. EMBO J. 2019;38(2):e101117. https:\/\/doi.org\/10.15252\/embj.2018101117PubMedPMID:30518534;PubMedCentralPMCID:PMC6331711.","journal-title":"EMBO J"},{"issue":"11","key":"217_CR15","doi-asserted-by":"publisher","first-page":"2584","DOI":"10.1073\/pnas.1708290115","volume":"115","author":"V Stodden","year":"2018","unstructured":"Stodden V, Seiler J, Ma Z. An empirical analysis of journal policy effectiveness for computational reproducibility. Proc Natl Acad Sci. 2018;115(11):2584\u20139. https:\/\/doi.org\/10.1073\/pnas.1708290115.","journal-title":"Proc Natl Acad Sci"},{"issue":"3","key":"217_CR16","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","volume":"9","author":"N Dalkey","year":"1963","unstructured":"Dalkey N, Helmer O. An experimental application of the DELPHI method to the use of experts. Manage Sci. 1963;9(3):458\u201367. https:\/\/doi.org\/10.1287\/mnsc.9.3.458.","journal-title":"Manage Sci"},{"key":"217_CR17","unstructured":"Habibi A, Sarafrazi A, Izadyar S. Delphi Technique Theoretical Framework in Qualitative Research. Vol. 3. 2014;3(4):8\u201313."},{"key":"217_CR18","unstructured":"Pejdo D, Buljan I, Marusic A. Prioritizing interventions and reproducibility measures to improve research reproducibility: a Delphi consultation method. 2024 Oct 29. Available from: https:\/\/osf.io\/bkgde. Cited 23 Dec 2025."},{"issue":"8","key":"217_CR19","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1177\/0269216317690685","volume":"31","author":"S J\u00fcnger","year":"2017","unstructured":"J\u00fcnger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and REporting DElphi studies (CREDES) in palliative care: Recommendations based on a methodological systematic review. Palliat Med. 2017;31(8):684\u2013706. https:\/\/doi.org\/10.1177\/0269216317690685. PubMed PMID: 28190381.","journal-title":"Palliat Med"},{"issue":"0","key":"217_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/08870446.2022.2139830","volume":"0","author":"E Norris","year":"2022","unstructured":"Norris E, Prescott A, Noone C, Green JA, Reynolds J, Grant SP, et al. Establishing open science research priorities in health psychology: A research prioritisation Delphi exercise. Psychol Health. 2022;0(0):1\u201325. https:\/\/doi.org\/10.1080\/08870446.2022.2139830.","journal-title":"Psychol Health"},{"issue":"2","key":"217_CR21","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.enfie.2020.09.003","volume":"32","author":"A Romero-Collado","year":"2021","unstructured":"Romero-Collado A. Essential elements to elaborate a study with the (e)Delphi method. Enferm Intensiva Engl Ed. 2021;32(2):100\u20134. https:\/\/doi.org\/10.1016\/j.enfie.2020.09.003.","journal-title":"Enferm Intensiva Engl Ed"},{"issue":"8","key":"217_CR22","doi-asserted-by":"publisher","first-page":"1525","DOI":"10.1016\/j.techfore.2012.04.013","volume":"79","author":"HA von der Gracht","year":"2012","unstructured":"von der Gracht HA. Consensus measurement in Delphi studies: Review and implications for future quality assurance. Technol Forecast Soc Change. 2012;79(8):1525\u201336. https:\/\/doi.org\/10.1016\/j.techfore.2012.04.013.","journal-title":"Technol Forecast Soc Change"},{"issue":"9","key":"217_CR23","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1177\/1049732305276687","volume":"15","author":"HF Hsieh","year":"2005","unstructured":"Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277\u201388. https:\/\/doi.org\/10.1177\/1049732305276687.","journal-title":"Qual Health Res"},{"issue":"1","key":"217_CR24","doi-asserted-by":"publisher","first-page":"334","DOI":"10.3758\/s13428-021-01644-z","volume":"54","author":"R L\u00f3pez-Nicol\u00e1s","year":"2022","unstructured":"L\u00f3pez-Nicol\u00e1s R, L\u00f3pez-L\u00f3pez JA, Rubio-Aparicio M, S\u00e1nchez-Meca J. A meta-review of transparency and reproducibility-related reporting practices in published meta-analyses on clinical psychological interventions (2000\u20132020). Behav Res Methods. 2022;54(1):334\u201349. https:\/\/doi.org\/10.3758\/s13428-021-01644-z. PubMed PMID: 34173943; PubMed Central PMCID: PMC8863703.","journal-title":"Behav Res Methods"},{"issue":"4","key":"217_CR25","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1007\/s10869-020-09695-3","volume":"36","author":"AA Toth","year":"2021","unstructured":"Toth AA, Banks GC, Mellor D, O\u2019Boyle EH, Dickson A, Davis DJ, et al. Study preregistration: An evaluation of a method for transparent reporting. J Bus Psychol. 2021;36(4):553\u201371. https:\/\/doi.org\/10.1007\/s10869-020-09695-3.","journal-title":"J Bus Psychol"},{"issue":"1","key":"217_CR26","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1186\/s12916-018-1168-6","volume":"16","author":"L Trinquart","year":"2018","unstructured":"Trinquart L, Dunn AG, Bourgeois FT. Registration of published randomized trials: a systematic review and meta-analysis. BMC Med. 2018;16(1):173. https:\/\/doi.org\/10.1186\/s12916-018-1168-6.","journal-title":"BMC Med"},{"issue":"4","key":"217_CR27","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1038\/nbt.3780","volume":"35","author":"BK Beaulieu-Jones","year":"2017","unstructured":"Beaulieu-Jones BK, Greene CS. Reproducibility of computational workflows is automated using continuous analysis. Nat Biotechnol. 2017;35(4):342\u20136. https:\/\/doi.org\/10.1038\/nbt.3780. PubMed PMID: 28288103; PubMed Central PMCID: PMC6103790.","journal-title":"Nat Biotechnol"},{"key":"217_CR28","doi-asserted-by":"publisher","first-page":"e11140","DOI":"10.7717\/peerj.11140","volume":"9","author":"S Samuel","year":"2021","unstructured":"Samuel S, K\u00f6nig-Ries B. Understanding experiments and research practices for reproducibility: An exploratory study. PeerJ. 2021;9:e11140. https:\/\/doi.org\/10.7717\/peerj.11140. PubMed PMID: 33976964; PubMed Central PMCID: PMC8067906.","journal-title":"PeerJ"},{"issue":"4","key":"217_CR29","doi-asserted-by":"publisher","first-page":"242057","DOI":"10.1098\/rsos.242057","volume":"12","author":"L Dudda","year":"2025","unstructured":"Dudda L, Kormann E, Kozula M, DeVito NJ, Klebel T, Dewi APM, et al. Open Science interventions to improve reproducibility and replicability of research: a scoping review. R Soc Open Sci. 2025;12(4):242057. https:\/\/doi.org\/10.1098\/rsos.242057. PubMed PMID: 40206851; PubMed Central PMCID: PMC11979971.","journal-title":"R Soc Open Sci"},{"key":"217_CR30","doi-asserted-by":"publisher","unstructured":"Hrynaszkiewicz I, Simons N, Hussain A, Grant R, Goudie S. Developing a Research Data Policy Framework for All Journals and Publishers. Data Sci J. 2020;19(1). https:\/\/doi.org\/10.5334\/dsj-2020-005","DOI":"10.5334\/dsj-2020-005"},{"issue":"6","key":"217_CR31","doi-asserted-by":"publisher","first-page":"240286","DOI":"10.1098\/rsos.240286","volume":"11","author":"NL Cole","year":"2024","unstructured":"Cole NL, Kormann E, Klebel T, Apartis S, Ross-Hellauer T. The societal impact of Open Science: a scoping review. R Soc Open Sci. 2024;11(6):240286. https:\/\/doi.org\/10.1098\/rsos.240286.","journal-title":"R Soc Open Sci"},{"key":"217_CR32","doi-asserted-by":"publisher","unstructured":"Hair K, Wilson E, Wong C, Tsang A, Macleod MR, Bannach-Brown A. Systematic Online Living Evidence Summaries: emerging tools to accelerate evidence synthesis. MetaArXiv; 2022. Available from: https:\/\/osf.io\/nbe5q, https:\/\/doi.org\/10.31222\/osf.io\/nbe5q. Cited 12 Nov 2025.","DOI":"10.31222\/osf.io\/nbe5q"},{"key":"217_CR33","doi-asserted-by":"publisher","first-page":"101401","DOI":"10.1016\/j.mex.2021.101401","volume":"8","author":"D Beiderbeck","year":"2021","unstructured":"Beiderbeck D, Frevel N, von der Gracht HA, Schmidt SL, Schweitzer VM. Preparing, conducting, and analyzing Delphi surveys: cross-disciplinary practices, new directions, and advancements. MethodsX. 2021;8:101401. https:\/\/doi.org\/10.1016\/j.mex.2021.101401. PubMed PMID: 34430297; PubMed Central PMCID: PMC8374446.","journal-title":"MethodsX"},{"issue":"2","key":"217_CR34","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.evalprogplan.2009.06.006","volume":"33","author":"MR Geist","year":"2010","unstructured":"Geist MR. Using the Delphi method to engage stakeholders: a comparison of two studies. Eval Program Plann. 2010;33(2):147\u201354. https:\/\/doi.org\/10.1016\/j.evalprogplan.2009.06.006. Challenges in Evaluation of Environmental Education Programs and Policies.","journal-title":"Eval Program Plann"},{"issue":"1","key":"217_CR35","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-024-02738-3","volume":"14","author":"J Schifano","year":"2025","unstructured":"Schifano J, Niederberger M. How Delphi studies in the health sciences find consensus: a scoping review. Syst Rev. 2025;14(1):14. https:\/\/doi.org\/10.1186\/s13643-024-02738-3.","journal-title":"Syst Rev"}],"container-title":["Research Integrity and Peer Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41073-026-00217-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41073-026-00217-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41073-026-00217-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T22:04:15Z","timestamp":1783029855000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41073-026-00217-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,3]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["217"],"URL":"https:\/\/doi.org\/10.1186\/s41073-026-00217-y","relation":{},"ISSN":["2058-8615"],"issn-type":[{"value":"2058-8615","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,3]]},"assertion":[{"value":"30 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 July 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The\n                      Ethics Committee of the University of Split School of Medicine (Reg. No.\n                      2181-198-03-24-24-0067\n                      ). All participants provided informed consent prior to taking part in the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"31"}}