{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T02:54:18Z","timestamp":1775012058282,"version":"3.50.1"},"reference-count":42,"publisher":"BMJ","issue":"1","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["Gut"],"accepted":{"date-parts":[[2024,9,27]]},"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Artificial intelligence (AI) holds significant potential for enhancing quality of gastrointestinal (GI) endoscopy, but the adoption of AI in clinical practice is hampered by the lack of rigorous standardisation and development methodology ensuring generalisability. The aim of the Quality Assessment of pre-clinical AI studies in Diagnostic Endoscopy (QUAIDE) Explanation and Checklist was to develop recommendations for standardised design and reporting of preclinical AI studies in GI endoscopy.<\/jats:p>\n                  <jats:p>The recommendations were developed based on a formal consensus approach with an international multidisciplinary panel of 32 experts among endoscopists and computer scientists. The Delphi methodology was employed to achieve consensus on statements, with a predetermined threshold of 80% agreement. A maximum three rounds of voting were permitted.<\/jats:p>\n                  <jats:p>Consensus was reached on 18 key recommendations, covering 6 key domains: data acquisition and annotation (6 statements), outcome reporting (3 statements), experimental setup and algorithm architecture (4 statements) and result presentation and interpretation (5 statements). QUAIDE provides recommendations on how to properly design (1. Methods, statements 1\u201314), present results (2. Results, statements 15\u201316) and integrate and interpret the obtained results (3. Discussion, statements 17\u201318).<\/jats:p>\n                  <jats:p>The QUAIDE framework offers practical guidance for authors, readers, editors and reviewers involved in AI preclinical studies in GI endoscopy, aiming at improving design and reporting, thereby promoting research standardisation and accelerating the translation of AI innovations into clinical practice.<\/jats:p>","DOI":"10.1136\/gutjnl-2024-332820","type":"journal-article","created":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T13:21:21Z","timestamp":1728998481000},"page":"153-161","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":17,"title":["QUAIDE - Quality assessment of AI preclinical studies in diagnostic endoscopy"],"prefix":"10.1136","volume":"74","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1797-3864","authenticated-orcid":false,"given":"Giulio","family":"Antonelli","sequence":"first","affiliation":[{"name":"Gastroenterology and Digestive Endoscopy Unit, Ospedale dei Castelli, Ariccia, Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2691-7522","authenticated-orcid":false,"given":"Diogo","family":"Libanio","sequence":"additional","affiliation":[{"name":"MEDCIDS, Faculty of Medicine, University of Porto, Porto, Portugal"}]},{"given":"Albert Jeroen","family":"De Groof","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3593-2356","authenticated-orcid":false,"given":"Fons","family":"van der Sommen","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, VCA group, University of Technology, Eindhoven, The Netherlands"}]},{"given":"Pietro","family":"Mascagni","sequence":"additional","affiliation":[{"name":"IHU Strasbourg, Strasbourg, France"},{"name":"Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7750-5064","authenticated-orcid":false,"given":"Pieter","family":"Sinonquel","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium"},{"name":"Department of Translational Research for Gastrointestinal Disorders (TARGID), KU Leuven, Leuven, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5167-8776","authenticated-orcid":false,"given":"Mohamed","family":"Abdelrahim","sequence":"additional","affiliation":[{"name":"Royal Devon and Exeter Hospital, Exeter, UK"}]},{"given":"Omer","family":"Ahmad","sequence":"additional","affiliation":[{"name":"University College London, London, UK"}]},{"given":"Tyler","family":"Berzin","sequence":"additional","affiliation":[{"name":"Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1241-2083","authenticated-orcid":false,"given":"Pradeep","family":"Bhandari","sequence":"additional","affiliation":[{"name":"Endoscopy Department, Portsmouth Hospitals University NHS Trust, Portsmouth, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9653-6886","authenticated-orcid":false,"given":"Michael","family":"Bretthauer","sequence":"additional","affiliation":[{"name":"Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway"}]},{"given":"Miguel","family":"Coimbra","sequence":"additional","affiliation":[{"name":"INESC TEC, Faculdade de Ci\u00eancias, University of Porto, Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4363-0745","authenticated-orcid":false,"given":"Evelien","family":"Dekker","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7765-035X","authenticated-orcid":false,"given":"Alanna","family":"Ebigbo","sequence":"additional","affiliation":[{"name":"III Medizinische Klinik, UniversitatsKlinikum Augsburg, Augsburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2222-1843","authenticated-orcid":false,"given":"Tom","family":"Eelbode","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering (ESAT\/PSI), Medical Imaging Research Center, KU Leuven, Leuven, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7084-6157","authenticated-orcid":false,"given":"Leonardo","family":"Frazzoni","sequence":"additional","affiliation":[{"name":"Gastroenterology and Endoscopy Unit, Forl\u00ec-Cesena Hospitals, AUSL Romagna, Forl\u00ec, Italy"}]},{"given":"Seth A","family":"Gross","sequence":"additional","affiliation":[{"name":"Division of Gastroenterology and Hepatology, New York University Langone Health, New York, New York, USA"}]},{"given":"Ryu","family":"Ishihara","sequence":"additional","affiliation":[{"name":"Osaka International Cancer Institute, Osaka, Japan"}]},{"given":"Michal Filip","family":"Kaminski","sequence":"additional","affiliation":[{"name":"Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway"},{"name":"Department of Gastroenterological Oncology, Maria Sklodowska-Curie Memorial Cancer Center and Institute of Oncology, Warsaw, Poland"},{"name":"Medical Center for Postgraduate Education, Warsaw, Poland"}]},{"given":"Helmut","family":"Messmann","sequence":"additional","affiliation":[{"name":"III Medizinische Klinik, UniversitatsKlinikum Augsburg, Augsburg, Germany"}]},{"given":"Yuichi","family":"Mori","sequence":"additional","affiliation":[{"name":"Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway"},{"name":"Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan"}]},{"given":"Nicolas","family":"Padoy","sequence":"additional","affiliation":[{"name":"IHU Strasbourg, Strasbourg, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2621-9225","authenticated-orcid":false,"given":"Sravanthi","family":"Parasa","sequence":"additional","affiliation":[{"name":"Swedish Medical Center, Seattle, Washington, USA"}]},{"given":"Nastazja Dagny","family":"Pilonis","sequence":"additional","affiliation":[{"name":"Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway"},{"name":"Department of Gastroenterological Oncology, Maria Sklodowska-Curie Memorial Cancer Center and Institute of Oncology, Warsaw, Poland"},{"name":"Medical Center for Postgraduate Education, Warsaw, Poland"}]},{"given":"Francesco","family":"Renna","sequence":"additional","affiliation":[{"name":"INESC TEC, Faculdade de Ci\u00eancias, University of Porto, Porto, Portugal"}]},{"given":"Alessandro","family":"Repici","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy"},{"name":"Endoscopy Unit, Humanitas Clinical and Research Center - IRCCS, Rozzano, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7037-5233","authenticated-orcid":false,"given":"Cem","family":"Simsek","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Hacettepe University, Ankara, Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3909-9012","authenticated-orcid":false,"given":"Marco","family":"Spadaccini","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy"},{"name":"Endoscopy Unit, Humanitas Clinical and Research Center - IRCCS, Rozzano, Italy"}]},{"given":"Raf","family":"Bisschops","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium"},{"name":"Department of Translational Research for Gastrointestinal Disorders (TARGID), KU Leuven, Leuven, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7548-6955","authenticated-orcid":false,"given":"Jacques J G H M","family":"Bergman","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7167-1459","authenticated-orcid":false,"given":"Cesare","family":"Hassan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy"},{"name":"Endoscopy Unit, Humanitas Clinical and Research Center - IRCCS, Rozzano, Italy"}]},{"given":"Mario","family":"Dinis Ribeiro","sequence":"additional","affiliation":[{"name":"MEDCIDS, Faculty of Medicine, University of Porto, Porto, Portugal"},{"name":"RISE@CI-IPOP (Health Research Network), Porto Comprehensive Cancer Centre (Porto.CCC), Porto, Portugal"}]}],"member":"239","published-online":{"date-parts":[[2024,10,15]]},"reference":[{"key":"2025121220473106000_74.1.153.1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra2302038"},{"key":"2025121220473106000_74.1.153.2","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.tgie.2019.150636","article-title":"Barriers and pitfalls for artificial intelligence in gastroenterology: Ethical and regulatory issues","volume":"22","author":"Ahmad","year":"2020","journal-title":"Tech Innov Gastrointest Endosc"},{"key":"2025121220473106000_74.1.153.3","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2020-321922"},{"key":"2025121220473106000_74.1.153.4","doi-asserted-by":"crossref","first-page":"919","DOI":"10.7326\/M23-2865","article-title":"Computer-Aided Diagnosis for Leaving Colorectal Polyps In Situ: A Systematic Review and Meta-analysis","volume":"177","author":"Hassan","year":"2024","journal-title":"Ann Intern Med"},{"key":"2025121220473106000_74.1.153.5","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.7326\/M22-3678","article-title":"Real-Time Computer-Aided Detection of Colorectal Neoplasia During Colonoscopy\u202f: A Systematic Review and Meta-analysis","volume":"176","author":"Hassan","year":"2023","journal-title":"Ann Intern Med"},{"key":"2025121220473106000_74.1.153.6","first-page":"03139","article-title":"Consensus statements on the current landscape of artificial intelligence applications in endoscopy, addressing roadblocks, and advancing artificial intelligence in gastroenterology","volume":"S0016-5107","author":"Parasa","year":"2024","journal-title":"Gastrointest Endosc"},{"key":"2025121220473106000_74.1.153.7","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1055\/a-1950-5694","article-title":"Expected value of artificial intelligence in gastrointestinal endoscopy: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement","volume":"54","author":"Messmann","year":"2022","journal-title":"Endoscopy"},{"key":"2025121220473106000_74.1.153.8","doi-asserted-by":"publisher","DOI":"10.1016\/j.gie.2020.06.059"},{"key":"2025121220473106000_74.1.153.9","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1111\/den.14531","article-title":"Benefits and challenges in implementation of artificial intelligence in colonoscopy: World Endoscopy Organization position statement","volume":"35","author":"Mori","year":"2023","journal-title":"Dig Endosc"},{"key":"2025121220473106000_74.1.153.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.gie.2020.06.035"},{"key":"2025121220473106000_74.1.153.11","first-page":"114","article-title":"Current and future implications of artificial intelligence in colonoscopy","volume":"36","author":"Antonelli","year":"2023","journal-title":"Ann Gastroenterol"},{"key":"2025121220473106000_74.1.153.12","doi-asserted-by":"crossref","first-page":"E1474","DOI":"10.1055\/a-1907-6569","article-title":"Artificial intelligence in gastroenterology: Where are we heading?","volume":"10","author":"Koleth","year":"2022","journal-title":"Endosc Int Open"},{"key":"2025121220473106000_74.1.153.13","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2022.33946","article-title":"Randomized Clinical Trials of Machine Learning Interventions in Health Care: A Systematic Review","volume":"5","author":"Plana","year":"2022","journal-title":"JAMA Netw Open"},{"key":"2025121220473106000_74.1.153.14","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2019-320466"},{"key":"2025121220473106000_74.1.153.15","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.gie.2019.03.019","article-title":"Quality assurance of computer-aided detection and diagnosis in colonoscopy","volume":"90","author":"Vinsard","year":"2019","journal-title":"Gastrointest Endosc"},{"key":"2025121220473106000_74.1.153.16","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1016\/j.cgh.2023.11.029","article-title":"Lack of Effectiveness of Computer Aided Detection for Colorectal Neoplasia: A Systematic Review and Meta-Analysis of Nonrandomized Studies","volume":"22","author":"Patel","year":"2024","journal-title":"Clin Gastroenterol Hepatol"},{"key":"2025121220473106000_74.1.153.17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.03.004"},{"key":"2025121220473106000_74.1.153.18","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2022.21243"},{"key":"2025121220473106000_74.1.153.19","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.m3164","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI Extension","volume":"370","author":"Liu","year":"2020","journal-title":"BMJ"},{"key":"2025121220473106000_74.1.153.20","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.m3210","article-title":"Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI Extension","volume":"370","author":"Rivera","year":"2020","journal-title":"BMJ"},{"key":"2025121220473106000_74.1.153.21","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2020-047709","article-title":"Developing a reporting guideline for artificial intelligence-centred diagnostic test accuracy studies: the STARD-AI protocol","volume":"11","author":"Sounderajah","year":"2021","journal-title":"BMJ Open"},{"key":"2025121220473106000_74.1.153.22","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1016\/S2468-1253(22)00232-1","article-title":"Clinical trial designs for artificial intelligence in gastrointestinal endoscopy","volume":"7","author":"Mori","year":"2022","journal-title":"Lancet Gastroenterol Hepatol"},{"key":"2025121220473106000_74.1.153.23","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-022-01772-9"},{"key":"2025121220473106000_74.1.153.24","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1053\/j.gastro.2019.11.030","article-title":"Deep-Learning System Detects Neoplasia in Patients With Barrett\u2019s Esophagus With Higher Accuracy Than Endoscopists in a Multistep Training and Validation Study With Benchmarking","volume":"158","author":"de Groof","year":"2020","journal-title":"Gastroenterology"},{"key":"2025121220473106000_74.1.153.25","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2003.11.002"},{"key":"2025121220473106000_74.1.153.26","doi-asserted-by":"publisher","DOI":"10.3748\/wjg.v25.i14.1666"},{"key":"2025121220473106000_74.1.153.27","first-page":"3","volume-title":"Domain Adapt Represent Transf Afford Healthc AI Resour Diverse Glob Health Third MICCAI Workshop DART 2021 First MICCAI Workshop FAIR 2021 Held Conjunction MICCAI 2021 Strasbou","volume":"12968","author":"Hosseinzadeh Taher","year":"2021"},{"key":"2025121220473106000_74.1.153.28","doi-asserted-by":"publisher","DOI":"10.1016\/S0016-5107(03)02159-X"},{"key":"2025121220473106000_74.1.153.29","doi-asserted-by":"crossref","DOI":"10.1038\/s41597-024-03359-0","article-title":"REAL-Colon: A dataset for developing real-world AI applications in colonoscopy","volume":"11","author":"Biffi","year":"2024","journal-title":"Sci Data"},{"key":"2025121220473106000_74.1.153.30","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2021-326271"},{"key":"2025121220473106000_74.1.153.31","doi-asserted-by":"crossref","DOI":"10.1155\/2022\/5314671","article-title":"Leakage Prediction in Machine Learning Models When Using Data from Sports Wearable Sensors","volume":"2022","author":"Dong","year":"2022","journal-title":"Comput Intell Neurosci"},{"key":"2025121220473106000_74.1.153.32","doi-asserted-by":"crossref","first-page":"3023","DOI":"10.3390\/diagnostics13193023","article-title":"The Advent of Domain Adaptation into Artificial Intelligence for Gastrointestinal Endoscopy and Medical Imaging","volume":"13","author":"Kim","year":"2023","journal-title":"Diagnostics (Basel)"},{"key":"2025121220473106000_74.1.153.33","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1055\/a-1306-7590","article-title":"Establishing key research questions for the implementation of artificial intelligence in colonoscopy: a modified Delphi method","volume":"53","author":"Ahmad","year":"2021","journal-title":"Endoscopy"},{"key":"2025121220473106000_74.1.153.34","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1177\/2050640619837443","article-title":"The Argos project: The development of a computer\u2010aided detection system to improve detection of Barrett\u2019s neoplasia on white light endoscopy","volume":"7","author":"de Groof","year":"2019","journal-title":"UEG Journal"},{"key":"2025121220473106000_74.1.153.35","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-022-18751-2","article-title":"Experimental evidence of effective human-AI collaboration in medical decision-making","volume":"12","author":"Reverberi","year":"2022","journal-title":"Sci Rep"},{"key":"2025121220473106000_74.1.153.36","doi-asserted-by":"crossref","first-page":"189","DOI":"10.4258\/hir.2021.27.3.189","article-title":"Impact of the Choice of Cross-Validation Techniques on the Results of Machine Learning-Based Diagnostic Applications","volume":"27","author":"Tougui","year":"2021","journal-title":"Healthc Inform Res"},{"key":"2025121220473106000_74.1.153.37","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.m689","article-title":"Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies","volume":"368","author":"Nagendran","year":"2020","journal-title":"BMJ"},{"key":"2025121220473106000_74.1.153.38","doi-asserted-by":"crossref","first-page":"605","DOI":"10.3748\/wjg.v28.i5.605","article-title":"Machine learning models and over-fitting considerations","volume":"28","author":"Charilaou","year":"2022","journal-title":"World J Gastroenterol"},{"key":"2025121220473106000_74.1.153.39","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2019-319914"},{"key":"2025121220473106000_74.1.153.40","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.329.7458.168"},{"key":"2025121220473106000_74.1.153.41","doi-asserted-by":"crossref","DOI":"10.1056\/NEJM197507312930513","article-title":"Letter: Nomogram for Bayes\u2019s theorem","volume":"293","author":"Fagan","year":"1975","journal-title":"N Engl J Med"},{"key":"2025121220473106000_74.1.153.42","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1016\/j.gie.2021.01.010","article-title":"Meta-analyses of machine learning in endoscopy: stacking apples and oranges","volume":"93","author":"de Groof","year":"2021","journal-title":"Gastrointest Endosc"}],"container-title":["Gut"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/gutjnl-2024-332820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T04:47:39Z","timestamp":1765601259000},"score":1,"resource":{"primary":{"URL":"https:\/\/gut.bmj.com\/lookup\/doi\/10.1136\/gutjnl-2024-332820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,15]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12,10]]},"published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1136\/gutjnl-2024-332820"],"URL":"https:\/\/doi.org\/10.1136\/gutjnl-2024-332820","relation":{},"ISSN":["0017-5749","1468-3288"],"issn-type":[{"value":"0017-5749","type":"print"},{"value":"1468-3288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,15]]}}}