{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T16:45:16Z","timestamp":1790786716524,"version":"4.1.0"},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T00:00:00Z","timestamp":1750636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004312","name":"Eli Lilly and Company","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004312","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,7,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background and Aims<\/jats:title>\n                  <jats:p>Artificial intelligence (AI)-enabled endoscopy and histology offer accurate, objective, and rapid assessment of disease activity in ulcerative colitis (UC). Emerging multi-source AI models may enhance standardized disease evaluation and outcome prediction. This investigation aimed to develop a novel AI model fusing endoscopic and histologic features to improve the assessment of disease remission and response to therapy in UC clinical trials.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>A novel multimodal AI model was developed that fuses endoscopic videos and histologic whole-slide images from a Phase 2 clinical trial of Mirikizumab in UC (NCT02589665). Informative endoscopic frames were predicted using convolutional neural networks and processed with BioMedCLIP, while histologic features were extracted using the CONCH foundational model. Multimodal features were then integrated via multi-head self-attention to generate a patient-level assessment. Model performance for assessing histologic remission (HR) and treatment response at weeks 12 and 52, based on histologic endpoints, was evaluated by cross-validation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The fusion model outperformed single-modality assessments for HR, achieving a sensitivity of 89.72% (95% CI, 82.35-94.76), specificity of 89.67% (95% CI, 84.34-93.67), and accuracy of 89.69% (95% CI, 85.61-92.94). It showed a sensitivity of 97.96% (95% CI, 89.15-99.95), specificity of 86.84% (95% CI, 71.91-95.59), and accuracy of 93.10% (95% CI, 85.59-97.43) for assessing HR at week 52. Substantial agreement was observed between the AI-fusion model and central readout.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This novel tool significantly advances precision medicine in clinical trials by potentially standardizing central readouts and enabling automated disease assessment.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/ecco-jcc\/jjaf108","type":"journal-article","created":{"date-parts":[[2025,6,28]],"date-time":"2025-06-28T19:18:25Z","timestamp":1751138305000},"source":"Crossref","is-referenced-by-count":10,"title":["Endo-Histo foundational fusion model: a novel artificial intelligence for assessing histologic remission and response to therapy in ulcerative colitis clinical trial"],"prefix":"10.1093","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3142-9550","authenticated-orcid":false,"given":"Marietta","family":"Iacucci","sequence":"first","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0544-0414","authenticated-orcid":false,"given":"Giovanni","family":"Santacroce","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo","family":"Meseguer","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Investigaci\u00f3n e Innovaci\u00f3n en Tecnolog\u00eda Centarada en el Ser Humano, HUMAN-tech, Universitat Polit\u00e8cnica de Val\u00e8ncia , Val\u00e8ncia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alejandro","family":"Di\u00e9guez","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Investigaci\u00f3n e Innovaci\u00f3n en Tecnolog\u00eda Centarada en el Ser Humano, HUMAN-tech, Universitat Polit\u00e8cnica de Val\u00e8ncia , Val\u00e8ncia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rocio","family":"Del Amor","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Investigaci\u00f3n e Innovaci\u00f3n en Tecnolog\u00eda Centarada en el Ser Humano, HUMAN-tech, Universitat Polit\u00e8cnica de Val\u00e8ncia , Val\u00e8ncia,","place":["Spain"]},{"name":"Artikode Intelligence S.L. , Valencia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bisi Bode","family":"Kolawole","sequence":"additional","affiliation":[{"name":"School of Engineering, London South Bank University , London,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ujwala","family":"Chaudhari","sequence":"additional","affiliation":[{"name":"School of Engineering, London South Bank University , London,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irene","family":"Zammarchi","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Hayes","sequence":"additional","affiliation":[{"name":"Department of Histopathology, Cork University Hospital , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rory","family":"Crotty","sequence":"additional","affiliation":[{"name":"Department of Histopathology, Cork University Hospital , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davide","family":"Zardo","sequence":"additional","affiliation":[{"name":"Department of Pathology, San Bortolo Hospital , Vicenza,","place":["Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasuharu","family":"Maeda","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miguel","family":"Puga-Tejada","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilaria","family":"Ditonno","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentina","family":"Vadori","sequence":"additional","affiliation":[{"name":"School of Engineering, London South Bank University , London,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Louise","family":"Burke","sequence":"additional","affiliation":[{"name":"Department of Histopathology, Cork University Hospital , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ferdinando","family":"D\u2019Amico","sequence":"additional","affiliation":[{"name":"Gastroenterology and Endoscopy, IRCCS San Raffaele Hospital and Vita Salute San Raffaele University , Milan,","place":["Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1713-7797","authenticated-orcid":false,"given":"Subrata","family":"Ghosh","sequence":"additional","affiliation":[{"name":"APC Microbiome Ireland, College of Medicine and Health, University College of Cork , Cork,","place":["Ireland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Enrico","family":"Grisan","sequence":"additional","affiliation":[{"name":"School of Engineering, London South Bank University , London,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valery","family":"Naranjo","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Investigaci\u00f3n e Innovaci\u00f3n en Tecnolog\u00eda Centarada en el Ser Humano, HUMAN-tech, Universitat Polit\u00e8cnica de Val\u00e8ncia , Val\u00e8ncia,","place":["Spain"]},{"name":"Artikode Intelligence S.L. , Valencia,","place":["Spain"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"2025070909220688500_CIT0001","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1111\/apt.17261","article-title":"Non-invasive monitoring and treat-to-target approach are cost-effective in patients with mild\u2013moderate ulcerative colitis","volume":"57","author":"Cortesi","year":"2023","journal-title":"Aliment Pharmacol Ther."},{"key":"2025070909220688500_CIT0002","doi-asserted-by":"publisher","first-page":"1570","DOI":"10.1053\/j.gastro.2020.12.031","article-title":"STRIDE-II: an update on the Selecting Therapeutic Targets in Inflammatory Bowel Disease (STRIDE) initiative of the International Organization for the Study of IBD (IOIBD): determining therapeutic goals for treat-to-target strategies in IBD","volume":"160","author":"Turner","year":"2021","journal-title":"Gastroenterology."},{"key":"2025070909220688500_CIT0003","doi-asserted-by":"publisher","first-page":"1800","DOI":"10.1016\/j.cgh.2020.09.046","article-title":"Treat to target: the role of histologic healing in inflammatory bowel diseases: a systematic review and meta-analysis","volume":"19","author":"Gupta","year":"2021","journal-title":"Clin Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0004","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1053\/j.gastro.2014.08.003","article-title":"Converging goals of treatment of inflammatory bowel disease from clinical trials and practice","volume":"148","author":"Levesque","year":"2015","journal-title":"Gastroenterology."},{"key":"2025070909220688500_CIT0005","doi-asserted-by":"publisher","first-page":"2164","DOI":"10.1136\/gutjnl-2023-329964","article-title":"Different levels of healing in inflammatory bowel diseases: mucosal, histological, transmural, barrier and complete healing","volume":"72","author":"Neurath","year":"2023","journal-title":"Gut."},{"key":"2025070909220688500_CIT0006","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1093\/ecco-jcc\/jjaa110","article-title":"ECCO Position paper: harmonization of the approach to ulcerative colitis histopathology","volume":"14","author":"Magro","year":"2020","journal-title":"J Crohns Colitis."},{"key":"2025070909220688500_CIT0007","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1093\/ecco-jcc\/jjy114","article-title":"ECCO-ESGAR guideline for diagnostic assessment in IBD Part 2: IBD scores and general principles and technical aspects","volume":"13","author":"Sturm","year":"2019","journal-title":"J Crohns Colitis."},{"key":"2025070909220688500_CIT0008","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1016\/S2468-1253(24)00053-0","article-title":"Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease","volume":"9","author":"Iacucci","year":"2024","journal-title":"Lancet Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0009","doi-asserted-by":"publisher","first-page":"1180","DOI":"10.1053\/j.gastro.2023.02.031","article-title":"Artificial intelligence enabled histological prediction of remission or activity and clinical outcomes in ulcerative colitis","volume":"164","author":"Iacucci","year":"2023","journal-title":"Gastroenterology."},{"key":"2025070909220688500_CIT0010","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1055\/a-1960-3645","article-title":"A virtual chromoendoscopy artificial intelligence system to detect endoscopic and histologic activity\/remission and predict clinical outcomes in ulcerative colitis","volume":"55","author":"Iacucci","year":"2023","journal-title":"Endoscopy."},{"key":"2025070909220688500_CIT0011","doi-asserted-by":"publisher","first-page":"1302","DOI":"10.1056\/NEJMra1907607","article-title":"Newer biologic and small-molecule therapies for inflammatory bowel disease","volume":"385","author":"Baumgart","year":"2021","journal-title":"N Engl J Med."},{"key":"2025070909220688500_CIT0012","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1053\/j.gastro.2023.09.049","article-title":"Using computer vision to improve endoscopic disease quantification in therapeutic clinical trials of ulcerative colitis","volume":"166","author":"Stidham","year":"2024","journal-title":"Gastroenterology."},{"key":"2025070909220688500_CIT0013","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1053\/j.gastro.2019.08.043","article-title":"Efficacy and safety of mirikizumab in a randomized phase 2 study of patients with ulcerative colitis","volume":"158","author":"Sandborn","year":"2020","journal-title":"Gastroenterology."},{"key":"2025070909220688500_CIT0014","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1136\/gut.47.3.404","article-title":"Reproducible grading scale for histological assessment of inflammation in ulcerative colitis","volume":"47","author":"Geboes","year":"2000","journal-title":"Gut."},{"key":"2025070909220688500_CIT0015","article-title":"BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs","author":"Zhang","year":"2023"},{"key":"2025070909220688500_CIT0016","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1038\/s41591-024-02856-4","article-title":"A visual-language foundation model for computational pathology","volume":"30","author":"Lu","year":"2024","journal-title":"Nat Med."},{"key":"2025070909220688500_CIT0017","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1706.03762","article-title":"Attention is all you need","author":"Vaswani","year":"2017"},{"key":"2025070909220688500_CIT0018","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1802.04712","article-title":"Attention-based deep multiple instance learning","author":"Ilse","year":"2018"},{"key":"2025070909220688500_CIT0019","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics."},{"key":"2025070909220688500_CIT0020","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1016\/j.cgh.2024.07.010","article-title":"Endoscopic, histologic, and composite endpoints in patients with ulcerative colitis treated with etrasimod","volume":"23","author":"Magro","year":"2024","journal-title":"Clin Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0021","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1016\/j.gie.2023.04.2074","article-title":"Diagnostic accuracy of convolutional neural network\u2013based machine learning algorithms in endoscopic severity prediction of ulcerative colitis: a systematic review and meta-analysis","volume":"98","author":"Jahagirdar","year":"2023","journal-title":"Gastrointest Endosc."},{"key":"2025070909220688500_CIT0022","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.dld.2023.11.005","article-title":"Can artificial intelligence replace endoscopists when assessing mucosal healing in ulcerative colitis? A systematic review and diagnostic test accuracy meta-analysis","volume":"56","author":"Rimondi","year":"2023","journal-title":"Dig Liver Dis."},{"key":"2025070909220688500_CIT0023","doi-asserted-by":"publisher","first-page":"428","DOI":"10.1016\/j.cgh.2024.05.048","article-title":"How artificial intelligence will transform clinical care, research, and trials for inflammatory bowel disease","volume":"23","author":"Silverman","year":"2024","journal-title":"Clin Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0024","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1136\/gutjnl-2021-326376","article-title":"PICaSSO Histologic Remission Index (PHRI) in ulcerative colitis: development of a novel simplified histological score for monitoring mucosal healing and predicting clinical outcomes and its applicability in an artificial intelligence system","volume":"71","author":"Gui","year":"2022","journal-title":"Gut."},{"key":"2025070909220688500_CIT0025","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1111\/den.14493","article-title":"Development and validation of an artificial intelligence-based system for predicting colorectal cancer invasion depth using multi-modal data","volume":"35","author":"Yao","year":"2023","journal-title":"Dig Endosc."},{"key":"2025070909220688500_CIT0026","doi-asserted-by":"publisher","first-page":"1350","DOI":"10.1002\/ueg2.12663","article-title":"Multi-OMICs orchestration enabled by artificial intelligence in inflammatory bowel disease: an exciting future","volume":"12","author":"Iacucci","year":"2024","journal-title":"United European Gastroenterol J."},{"key":"2025070909220688500_CIT0027","doi-asserted-by":"publisher","first-page":"100255","DOI":"10.1016\/j.labinv.2023.100255","article-title":"Revolutionizing digital pathology with the power of generative artificial intelligence and foundation models","volume":"103","author":"Waqas","year":"2023","journal-title":"Lab Investig."},{"key":"2025070909220688500_CIT0028","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1093\/jcag\/gwad034","article-title":"Managing ulcerative colitis and Crohn\u2019s disease: should the target be endoscopy, histology, or both","volume":"7","author":"Magro","year":"2024","journal-title":"J Can Assoc Gastroenterol."},{"key":"2025070909220688500_CIT0029","doi-asserted-by":"publisher","first-page":"1280","DOI":"10.1016\/j.cgh.2020.01.017","article-title":"Positioning therapies in ulcerative colitis","volume":"18","author":"Danese","year":"2020","journal-title":"Clin Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0030","doi-asserted-by":"publisher","DOI":"10.1093\/ecco-jcc\/jjae198","article-title":"Artificial intelligence-enabled histology exhibits comparable accuracy to pathologists in assessing histological remission in ulcerative colitis: a systematic review, meta-analysis and meta-regression","volume":"19","author":"Puga-Tejada","year":"2025","journal-title":"J Crohns Colitis."},{"key":"2025070909220688500_CIT0031","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1038\/s41575-025-01051-1","article-title":"AI-enabled \u201cendo-histo-omics\u201d: breaking down intestinal barriers in IBD","volume":"22","author":"Iacucci","year":"2025","journal-title":"Nat Rev Gastroenterol Hepatol."},{"key":"2025070909220688500_CIT0032","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1111\/den.14672","article-title":"Present and future of endoscopy precision for inflammatory bowel disease","volume":"36","author":"Santacroce","year":"2023","journal-title":"Dig Endosc."},{"key":"2025070909220688500_CIT0033","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1136\/gutjnl-2024-332894","article-title":"Endocytoscopy with automated multispectral intestinal barrier pathology imaging for assessment of deep healing to predict outcomes in ulcerative colitis","volume":"73","author":"Majumder","year":"2024","journal-title":"Gut."},{"key":"2025070909220688500_CIT0034","doi-asserted-by":"publisher","first-page":"17562848251325525","DOI":"10.1177\/17562848251325525","article-title":"Rediscovering histology\u2014the application of artificial intelligence in inflammatory bowel disease histologic assessment","volume":"18","author":"Santacroce","year":"2025","journal-title":"Therap Adv Gastroenterol."}],"container-title":["Journal of Crohn's and Colitis"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ecco-jcc\/advance-article-pdf\/doi\/10.1093\/ecco-jcc\/jjaf108\/63546064\/jjaf108.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ecco-jcc\/article-pdf\/19\/7\/jjaf108\/63546064\/jjaf108.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ecco-jcc\/article-pdf\/19\/7\/jjaf108\/63546064\/jjaf108.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,9]],"date-time":"2025-07-09T13:22:15Z","timestamp":1752067335000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ecco-jcc\/article\/doi\/10.1093\/ecco-jcc\/jjaf108\/8171544"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":34,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,7,3]]}},"URL":"https:\/\/doi.org\/10.1093\/ecco-jcc\/jjaf108","relation":{},"ISSN":["1873-9946","1876-4479"],"issn-type":[{"value":"1873-9946","type":"print"},{"value":"1876-4479","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,7]]},"published":{"date-parts":[[2025,6,23]]},"article-number":"jjaf108"}}