{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T06:03:54Z","timestamp":1767420234651,"version":"3.48.0"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T00:00:00Z","timestamp":1762214400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The Mayo endoscopic score (MES) provides a criterion-based, but still subjective, human assessment of endoscopy and related endpoints in therapeutic clinical trials in ulcerative colitis (UC). A novel solution to address issues of reproducibility is the use of machine learning (ML) models to standardize MES evaluations. Broader applicability of this solution requires an understanding of the models and related performance characteristics. The objective of this study is to provide a systematic review on training and testing of ML MES prediction models on full-length endoscopic videos from patients with UC.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>PubMed\/MEDLINE, EMBASE, and Web of Science were systematically searched on December 31, 2024, and supplemented by reference checks and Google search to identify studies on training or testing of ML models to produce an automated MES grade on endoscopic procedure videos in UC.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 7 studies met the inclusion criteria, and of those, 5 were eligible for reporting on model performance. Accuracy in predicting ordinal MES grades (0, 1, 2, 3) ranged from 56.8% to 83.3%. Accuracy in predicting MES 0, 1 vs 2, 3 and MES 0 vs 1, 2, 3 (each aligned with a definition of endoscopic improvement and remission in trials) ranged from 84% to 90.2% and from 90% to 95.5%, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Our review demonstrates strong performance characteristics of ML models to assess the MES on endoscopic videos in UC, potentially offering a standardized and reproducible solution to measure endoscopic severity. Further research will investigate the impact of this technology on clinical trial outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ibd\/izaf232","type":"journal-article","created":{"date-parts":[[2025,11,9]],"date-time":"2025-11-09T07:37:17Z","timestamp":1762673837000},"page":"159-168","source":"Crossref","is-referenced-by-count":0,"title":["Machine Learning Models for the Assessment of the Mayo Endoscopic Score in Ulcerative Colitis Trial Endpoints: A Systematic Review"],"prefix":"10.1093","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5647-1723","authenticated-orcid":false,"given":"David T","family":"Rubin","sequence":"first","affiliation":[{"name":"Inflammatory Bowel Disease Center, University of Chicago Medicine , Chicago, IL,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2088-091X","authenticated-orcid":false,"given":"Walter","family":"Reinisch","sequence":"additional","affiliation":[{"name":"Division of Gastroenterology and Hepatology, Department of Internal Medicine III, Medical University of Vienna , Vienna,","place":["Austria"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1536-8436","authenticated-orcid":false,"given":"Neeraj","family":"Narula","sequence":"additional","affiliation":[{"name":"Farncombe Family Digestive Health Research Institute, Division of Gastroenterology, Department of Medicine, McMaster University , Hamilton, ON,","place":["Canada"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8272-7228","authenticated-orcid":false,"given":"Daniel R","family":"Colucci","sequence":"additional","affiliation":[{"name":"Iterative Health Inc. , Cambridge, MA,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Eastman","sequence":"additional","affiliation":[{"name":"Eli Lilly and Company , Indianapolis, IN,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Klaus","family":"Gottlieb","sequence":"additional","affiliation":[{"name":"Eli Lilly and Company , Indianapolis, IN,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ana P","family":"Lacerda","sequence":"additional","affiliation":[{"name":"AbbVie Inc. , North Chicago, IL,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F Stephen","family":"Laroux","sequence":"additional","affiliation":[{"name":"AbbVie Bioresearch Center , Worcester, MA,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Irene","family":"Modesto","sequence":"additional","affiliation":[{"name":"Pfizer Inc. , New York, NY,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emma E","family":"Navajas","sequence":"additional","affiliation":[{"name":"Iterative Health Inc. , Cambridge, MA,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles C","family":"Owen","sequence":"additional","affiliation":[{"name":"Eli Lilly and Company , Indianapolis, IN,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yeli","family":"Wang","sequence":"additional","affiliation":[{"name":"Iterative Health Inc. , Cambridge, MA,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shrujal","family":"Baxi","sequence":"additional","affiliation":[{"name":"Iterative Health Inc. , Cambridge, MA,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,11,4]]},"reference":[{"key":"2026010301014000400_izaf232-B1","doi-asserted-by":"crossref","first-page":"1756","DOI":"10.1016\/S0140-6736(16)32126-2","article-title":"Ulcerative colitis","volume":"389","author":"Ungaro","year":"2017","journal-title":"Lancet"},{"key":"2026010301014000400_izaf232-B2","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1053\/j.gastro.2011.06.054","article-title":"Early mucosal healing with infliximab is associated with improved long-term clinical outcomes in ulcerative colitis","volume":"141","author":"Colombel","year":"2011","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B3","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1016\/j.gie.2017.07.028","article-title":"Impact of mucosal inflammation on risk of colorectal neoplasia in patients with ulcerative colitis: a systematic review and meta-analysis","volume":"86","author":"Flores","year":"2017","journal-title":"Gastrointest Endosc"},{"key":"2026010301014000400_izaf232-B4","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1016\/j.cgh.2016.01.015","article-title":"Mucosal healing is associated with improved long-term outcomes of patients with ulcerative colitis: a systematic review and meta-analysis","volume":"14","author":"Shah","year":"2016","journal-title":"Clin Gastroenterol Hepatol"},{"key":"2026010301014000400_izaf232-B5","doi-asserted-by":"crossref","first-page":"1859","DOI":"10.1097\/MIB.0000000000000816","article-title":"Endoscopic mucosal healing predicts favorable clinical outcomes in inflammatory bowel disease: a meta-analysis","volume":"22","author":"Reinink","year":"2016","journal-title":"Inflamm Bowel Dis"},{"author":"Food and Drug Administration","key":"2026010301014000400_izaf232-B6"},{"author":"European Medicines Agency","key":"2026010301014000400_izaf232-B7"},{"key":"2026010301014000400_izaf232-B8","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1016\/j.dld.2014.07.010","article-title":"Inter-observer agreement in endoscopic scoring systems: preliminary report of an ongoing study from the Italian Group for Inflammatory Bowel Disease (IG-IBD)","volume":"46","author":"Daperno","year":"2014","journal-title":"Dig Liver Dis"},{"key":"2026010301014000400_izaf232-B9","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1093\/ibd\/izx066","article-title":"Disagreement among gastroenterologists using the mayo and Rutgeerts endoscopic scores","volume":"24","author":"Fernandes","year":"2018","journal-title":"Inflamm Bowel Dis"},{"key":"2026010301014000400_izaf232-B10","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1093\/jcag\/gwz022","article-title":"Do you see what I see? An assessment of endoscopic lesions recognition and description by gastroenterology trainees and staff physicians","volume":"3","author":"Hart","year":"2020","journal-title":"J Can Assoc Gastroenterol"},{"key":"2026010301014000400_izaf232-B11","doi-asserted-by":"crossref","first-page":"213","DOI":"10.3390\/diagnostics10040213","article-title":"Inter-observer agreement of a new endoscopic score for ulcerative colitis activity: preliminary experience","volume":"10","author":"Principi","year":"2020","journal-title":"Diagnostics (Basel)."},{"key":"2026010301014000400_izaf232-B12","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1111\/apt.16626","article-title":"Agreement between local and central reading of endoscopic disease activity in ulcerative colitis: results from the tofacitinib OCTAVE trials","volume":"54","author":"Feagan","year":"2021","journal-title":"Aliment Pharmacol Ther"},{"key":"2026010301014000400_izaf232-B13","doi-asserted-by":"crossref","DOI":"10.1093\/ibd\/izae051","article-title":"Inter- and intraobserver variability on endoscopic scoring systems in Crohn\u2019s disease and ulcerative colitis: a systematic review and meta-analysis","volume":"30","author":"Hashash","year":"2024","journal-title":"Inflamm Bowel Dis"},{"key":"2026010301014000400_izaf232-B14","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1136\/gutjnl-2020-320690","article-title":"Endoscopy and central reading in inflammatory bowel disease clinical trials: achievements, challenges and future developments","volume":"70","author":"Gottlieb","year":"2021","journal-title":"Gut"},{"key":"2026010301014000400_izaf232-B15","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1093\/ecco-jcc\/jjad134","article-title":"Alternative endoscopy reading paradigms determine score reliability and effect size in ulcerative colitis","volume":"18","author":"Reinisch","year":"2024","journal-title":"J Crohns Colitis"},{"key":"2026010301014000400_izaf232-B16","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1002\/ueg2.12455","article-title":"Comparison of treatment effect between phase 2 and phase 3 trials in patients with inflammatory bowel disease","volume":"11","author":"Wils","year":"2023","journal-title":"United European Gastroenterol J"},{"key":"2026010301014000400_izaf232-B17","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1053\/j.gastro.2019.08.058","article-title":"Application of artificial intelligence to gastroenterology and hepatology","volume":"158","author":"Le Berre","year":"2020","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B18","doi-asserted-by":"crossref","first-page":"2035","DOI":"10.1136\/gutjnl-2019-320466","article-title":"Machine learning in GI endoscopy: practical guidance in how to interpret a novel field","volume":"69","author":"van der Sommen","year":"2020","journal-title":"Gut"},{"key":"2026010301014000400_izaf232-B19","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1007\/s10620-021-07086-z","article-title":"Artificial Intelligence in endoscopy","volume":"67","author":"Okagawa","year":"2022","journal-title":"Dig Dis Sci"},{"key":"2026010301014000400_izaf232-B20","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1053\/j.gastro.2022.05.028","article-title":"Computer-aided detection improves adenomas per colonoscopy for screening and surveillance colonoscopy: a randomized trial","volume":"163","author":"Shaukat","year":"2022","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B21","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.gie.2020.06.059","article-title":"Performance of artificial intelligence in colonoscopy for adenoma and polyp detection: a systematic review and meta-analysis","volume":"93","author":"Hassan","year":"2021","journal-title":"Gastrointest Endosc"},{"key":"2026010301014000400_izaf232-B22","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/j.cgh.2023.09.008","article-title":"A Computer-Aided Detection (CADe) system significantly improves polyp detection in routine practice","volume":"22","author":"Keswani","year":"2024","journal-title":"Clin Gastroenterol Hepatol"},{"key":"2026010301014000400_izaf232-B23","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.gie.2018.10.020","article-title":"Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitis","volume":"89","author":"Ozawa","year":"2019","journal-title":"Gastrointest Endosc"},{"key":"2026010301014000400_izaf232-B24","doi-asserted-by":"crossref","first-page":"2150","DOI":"10.1053\/j.gastro.2020.02.012","article-title":"Development and validation of a deep neural network for accurate evaluation of endoscopic images from patients with ulcerative colitis","volume":"158","author":"Takenaka","year":"2020","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B25","doi-asserted-by":"crossref","first-page":"165","DOI":"10.5217\/ir.2021.00079","article-title":"Artificial intelligence for endoscopy in inflammatory bowel disease","volume":"20","author":"Takenaka","year":"2022","journal-title":"Intest Res"},{"key":"2026010301014000400_izaf232-B26","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1053\/j.gastro.2021.12.238","article-title":"Artificial Intelligence for disease assessment in inflammatory bowel disease: how will it change our practice?","volume":"162","author":"Stidham","year":"2022","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B27","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"2026010301014000400_izaf232-B28","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: the kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem Med (Zagreb)"},{"key":"2026010301014000400_izaf232-B29","doi-asserted-by":"crossref","first-page":"529","DOI":"10.7326\/0003-4819-155-8-201110180-00009","article-title":"QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies","volume":"155","author":"Whiting","year":"2011","journal-title":"Ann Intern Med"},{"key":"2026010301014000400_izaf232-B30","doi-asserted-by":"crossref","first-page":"e193963","DOI":"10.1001\/jamanetworkopen.2019.3963","article-title":"Performance of a deep learning model vs human reviewers in grading endoscopic disease severity of patients with ulcerative colitis","volume":"2","author":"Stidham","year":"2019","journal-title":"JAMA Netw Open"},{"key":"2026010301014000400_izaf232-B31","doi-asserted-by":"crossref","first-page":"2631774521990623","DOI":"10.1177\/2631774521990623","article-title":"Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data","volume":"14","author":"Gutierrez Becker","year":"2021","journal-title":"Ther Adv Gastrointest Endosc"},{"key":"2026010301014000400_izaf232-B32","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1053\/j.gastro.2020.10.024","article-title":"Central reading of ulcerative colitis clinical trial videos using neural networks","volume":"160","author":"Gottlieb","year":"2021","journal-title":"Gastroenterology"},{"journal-title":"arXiv","article-title":"Automatic estimation of ulcerative colitis severity from endoscopy videos using ordinal multi-instance learning","author":"Schwab","key":"2026010301014000400_izaf232-B33"},{"key":"2026010301014000400_izaf232-B34","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1016\/j.gie.2020.08.011","article-title":"Fully automated endoscopic disease activity assessment in ulcerative colitis","volume":"93","author":"Yao","year":"2021","journal-title":"Gastrointest Endosc"},{"key":"2026010301014000400_izaf232-B35","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1093\/ecco-jcc\/jjac152","article-title":"Application of deep learning models to improve ulcerative colitis endoscopic disease activity scoring under multiple scoring systems","volume":"17","author":"Byrne","year":"2023","journal-title":"J Crohns Colitis"},{"key":"2026010301014000400_izaf232-B36","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1016\/j.gastha.2023.06.003","article-title":"Development of a novel ulcerative colitis endoscopic mayo score prediction model using machine Learning","volume":"2","author":"Rubin","year":"2023","journal-title":"Gastro Hep Adv"},{"key":"2026010301014000400_izaf232-B37","doi-asserted-by":"crossref","first-page":"e240300","DOI":"10.1148\/ryai.240300","article-title":"Checklist for Artificial Intelligence in Medical Imaging (CLAIM): 2024 update","volume":"6","author":"Tejani","year":"2024","journal-title":"Radiol Artif Intell"},{"key":"2026010301014000400_izaf232-B38","doi-asserted-by":"crossref","first-page":"e48763","DOI":"10.2196\/48763","article-title":"Consolidated reporting guidelines for prognostic and diagnostic machine learning modeling studies: development and validation","volume":"25","author":"Klement","year":"2023","journal-title":"J Med Internet Res."},{"key":"2026010301014000400_izaf232-B39","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1038\/s41591-020-0941-1","article-title":"Developing specific reporting guidelines for diagnostic accuracy studies assessing AI interventions: The STARD-AI Steering Group","volume":"26","author":"Sounderajah","year":"2020","journal-title":"Nat Med"},{"author":"Food and Drug Administration","key":"2026010301014000400_izaf232-B40"},{"key":"2026010301014000400_izaf232-B41","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1053\/j.gastro.2019.08.020","article-title":"Competition for clinical trials in inflammatory bowel diseases","volume":"157","author":"Harris","year":"2019","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B42","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1093\/ecco-jcc\/jjac120","article-title":"Time to endorse a sensitive method for scoring endoscopic activity of ulcerative colitis in clinical research","volume":"17","author":"Narula","year":"2023","journal-title":"J Crohns Colitis"},{"key":"2026010301014000400_izaf232-B43","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1053\/j.gastro.2023.09.049","article-title":"Using computer vision to improve endoscopic disease quantification in therapeutic clinical trials of ulcerative colitis","volume":"166","author":"Stidham","year":"2024","journal-title":"Gastroenterology"},{"key":"2026010301014000400_izaf232-B44","doi-asserted-by":"crossref","first-page":"jjae187","DOI":"10.1093\/ecco-jcc\/jjae187","article-title":"Ulcerative Colitis Severity Classification and Localized Extent (UC-SCALE): an artificial intelligence scoring system for a spatial assessment of disease severity in ulcerative colitis","volume":"19","author":"Gutierrez-Becker","year":"2025","journal-title":"J Crohns Colitis"}],"container-title":["Inflammatory Bowel Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ibdjournal\/article-pdf\/32\/1\/159\/65237845\/izaf232.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ibdjournal\/article-pdf\/32\/1\/159\/65237845\/izaf232.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T06:01:52Z","timestamp":1767420112000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ibdjournal\/article\/32\/1\/159\/8316265"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,4]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,11,4]]},"published-print":{"date-parts":[[2026,1,1]]}},"URL":"https:\/\/doi.org\/10.1093\/ibd\/izaf232","relation":{},"ISSN":["1078-0998","1536-4844"],"issn-type":[{"type":"print","value":"1078-0998"},{"type":"electronic","value":"1536-4844"}],"subject":[],"published-other":{"date-parts":[[2026,1]]},"published":{"date-parts":[[2025,11,4]]}}}