{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T01:01:59Z","timestamp":1790298119970,"version":"4.1.0"},"reference-count":41,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T00:00:00Z","timestamp":1757548800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Cell Dev. Biol."],"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>To develop and evaluate deep learning (DL) models for detecting multiple retinal diseases using bimodal imaging of color fundus photography (CFP) and optical coherence tomography (OCT), assessing diagnostic performance and generalizability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This cross-sectional study utilized 1445 CFP-OCT pairs from 1,029 patients across three hospitals. Five bimodal models developed, and the model with best performance (Fusion-MIL) was tested and compared with CFP-MIL and OCT-MIL. Models were trained on 710 pairs (Maestro device), validated on 241, and tested on 255 (dataset 1). Additional tests used different devices and scanning patterns: 88 pairs (dataset 2, DRI-OCT), 91 (dataset 3, DRI-OCT), 60 (dataset 4, Visucam\/VG200 OCT). Seven retinal conditions, including normal, diabetic retinopathy, dry and wet age-related macular degeneration, pathologic myopia (PM), epiretinal membran, and macular edema, were assessed. PM ATN (atrophy, traction, neovascularization) classification was trained and tested on another 1,184 pairs. Area under receiver operating characteristic curve (AUC) was calculated to evaluated the performance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Fusion-MIL achieved mean AUC 0.985 (95% CI 0.971\u20130.999) in dataset 2, outperforming CFP-MIL (0.876,\n                      <jats:italic>P<\/jats:italic>\n                      &amp;lt; 0.001) and OCT-MIL (0.982,\n                      <jats:italic>P<\/jats:italic>\n                      = 0.337), as well as in dataset 3 (0.978 vs. 0.913,\n                      <jats:italic>P<\/jats:italic>\n                      &amp;lt; 0.001 and 0.962,\n                      <jats:italic>P<\/jats:italic>\n                      = 0.025) and dataset 4 (0.962 vs. 0.962,\n                      <jats:italic>P<\/jats:italic>\n                      &amp;lt; 0.001 and 0.962,\n                      <jats:italic>P<\/jats:italic>\n                      = 0.079). Fusion-MIL also achieved superior accuracy. In ATN classification, AUC ranges 0.902\u20130.997 for atrophy, 0.869\u20130.982 for traction, and 0.742\u20130.976 for neovascularization.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Bimodal Fusion-MIL improved diagnosis over single-modal models, showing strong generalizability across devices and detailed grading ability, valuable for various scenarios.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fcell.2025.1665173","type":"journal-article","created":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T05:25:56Z","timestamp":1757568356000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Diagnostic performance and generalizability of deep learning for multiple retinal diseases using bimodal imaging of fundus photography and optical coherence tomography"],"prefix":"10.3389","volume":"13","author":[{"given":"Xingwang","family":"Gu","sequence":"first","affiliation":[{"name":"Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences","place":["Beijing, China"]},{"name":"Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Zhou","sequence":"additional","affiliation":[{"name":"Vistel AI Lab, Visionary Intelligence Ltd.","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianchun","family":"Zhao","sequence":"additional","affiliation":[{"name":"Vistel AI Lab, Visionary Intelligence Ltd.","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongzhe","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Nuclear Medicine, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinlei","family":"Pan","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Zhejiang University","place":["Hangzhou, Zhejiang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences","place":["Beijing, China"]},{"name":"Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bilei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Hunan Provincial People\u2019s Hospital","place":["Changsha, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuelin","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Peking University Third Hospital","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Song","family":"Xia","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Guizhou Provincial People\u2019s Hospital","place":["Guiyang, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hailan","family":"Lin","sequence":"additional","affiliation":[{"name":"Key Lab of DEKE, Renmin University of China","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Lab of DEKE, Renmin University of China","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dayong","family":"Ding","sequence":"additional","affiliation":[{"name":"Vistel AI Lab, Visionary Intelligence Ltd.","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xirong","family":"Li","sequence":"additional","affiliation":[{"name":"Key Lab of DEKE, Renmin University of China","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shan","family":"Wu","sequence":"additional","affiliation":[{"name":"Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences","place":["Beijing, China"]},{"name":"Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Youxin","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences","place":["Beijing, China"]},{"name":"Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,9,11]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"22","DOI":"10.22608\/apo.2017504","article-title":"Multimodal imaging in diabetic macular edema","volume":"7","author":"Ac\u00f3n","year":"2018","journal-title":"Asia Pac J. Ophthalmol. (Phila)."},{"key":"B2","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1186\/s12911-025-02944-6","article-title":"The role of explainable artificial intelligence in disease prediction: a systematic literature review and future research directions","volume":"25","author":"Alkhanbouli","year":"2025","journal-title":"BMC Med. Inf. Decis. Mak."},{"key":"B3","doi-asserted-by":"publisher","first-page":"e339","DOI":"10.1016\/s2214-109x(13)70113-x","article-title":"Causes of vision loss worldwide, 1990-2010: a systematic analysis","volume":"1","author":"Bourne","year":"2013","journal-title":"Lancet Glob. Health"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1093\/jamia\/ocaa302","article-title":"Multimodal, multitask, multiattention (M3) deep learning detection of reticular pseudodrusen: toward automated and accessible classification of age-related macular degeneration","volume":"28","author":"Chen","year":"2021","journal-title":"J. Am. Med. Inf. Assoc."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","article-title":"Clinically applicable deep learning for diagnosis and referral in retinal disease","volume":"24","author":"De Fauw","year":"2018","journal-title":"Nat. Med."},{"key":"B6","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1364\/boe.408573","article-title":"Deep-learning based multi-modal retinal image registration for the longitudinal analysis of patients with age-related macular degeneration","volume":"12","author":"De Silva","year":"2021","journal-title":"Biomed. Opt. Express"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1444763","DOI":"10.3389\/frobt.2024.1444763","article-title":"Enhancing interpretability and accuracy of AI models in healthcare: a comprehensive review on challenges and future directions","volume":"11","author":"Ennab","year":"2024","journal-title":"Front. Robot. AI"},{"key":"B8","volume-title":"Transparency for machine learning-enabled medical devices: guiding principles","year":"2021"},{"key":"B9","doi-asserted-by":"publisher","first-page":"AMD48","DOI":"10.1167\/iovs.18-24158","article-title":"Multimodal imaging of nonneovascular age-related macular degeneration","volume":"59","author":"Garrity","year":"2018","journal-title":"Invest Ophthalmol. Vis. Sci."},{"key":"B10","doi-asserted-by":"publisher","first-page":"2308","DOI":"10.18240\/ijo.2024.12.20","article-title":"Development and research status of intelligent ophthalmology in China","volume":"17","author":"Gong","year":"2024","journal-title":"Int. J. Ophthalmol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"57796","DOI":"10.1109\/ACCESS.2022.3178372","article-title":"A comprehensive review of deep learning strategies in retinal disease diagnosis using fundus images","volume":"10","author":"Goutam","year":"2022","journal-title":"IEEE Access"},{"key":"B12","first-page":"770","volume-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"B13","doi-asserted-by":"publisher","first-page":"105302","DOI":"10.1016\/j.compbiomed.2022.105302","article-title":"Multimodal image encoding pre-training for diabetic retinopathy grading","volume":"143","author":"Hervella","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"B14","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1007\/s10586-025-05281-5","article-title":"Explainable artificial intelligence for medical imaging systems using deep learning: a comprehensive review","volume":"28","author":"Houssein","year":"2025","journal-title":"Clust. Comput."},{"key":"B15","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/s0002-9394(03)00792-x","article-title":"Optical coherence tomography to detect and manage retinal disease and glaucoma","volume":"137","author":"Jaffe","year":"2004","journal-title":"Am. J. Ophthalmol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"e512","DOI":"10.1111\/aos.14928","article-title":"Multimodal deep learning with feature level fusion for identification of choroidal neovascularization activity in age-related macular degeneration","volume":"100","author":"Jin","year":"2022","journal-title":"Acta Ophthalmol."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.survophthal.2025.07.003","article-title":"Multimodal artificial intelligence in ophthalmology: applications, challenges, and future directions","author":"Jin","year":"2025","journal-title":"Surv. Ophthalmol."},{"key":"B18","doi-asserted-by":"publisher","first-page":"e28868","DOI":"10.2196\/28868","article-title":"A multimodal imaging-based deep learning model for detecting treatment-requiring retinal vascular diseases: model development and validation study","volume":"9","author":"Kang","year":"2021","journal-title":"JMIR Med. Inf."},{"key":"B19","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3390\/photonics5020009","article-title":"Advances in retinal optical imaging","volume":"5","author":"Li","year":"2018","journal-title":"Photonics"},{"key":"B20","doi-asserted-by":"publisher","first-page":"4023","DOI":"10.1109\/tmi.2020.3008871","article-title":"Self-Supervised feature learning via exploiting multi-modal data for retinal disease diagnosis","volume":"39","author":"Li","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B21","doi-asserted-by":"publisher","first-page":"108635","DOI":"10.1016\/j.compbiomed.2024.108635","article-title":"A review of deep learning-based information fusion techniques for multimodal medical image classification","volume":"177","author":"Li","year":"2024","journal-title":"Comput. Biol. Med."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1136\/bjophthalmol-2019-315338","article-title":"Prediction of OCT images of short-term response to anti-VEGF treatment for neovascular age-related macular degeneration using generative adversarial network","volume":"104","author":"Liu","year":"2020","journal-title":"Br. J. Ophthalmol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1038\/s41746-025-01461-0","article-title":"Multimodal machine learning enables AI chatbot to diagnose ophthalmic diseases and provide high-quality medical responses","volume":"8","author":"Ma","year":"2025","journal-title":"Digit. Med."},{"key":"B24","doi-asserted-by":"publisher","first-page":"e0237352","DOI":"10.1371\/journal.pone.0237352","article-title":"Optical coherence tomography and color fundus photography in the screening of age-related macular degeneration: a comparative, population-based study","volume":"15","author":"Midena","year":"2020","journal-title":"PLoS One"},{"key":"B25","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s12910-025-01243-z","article-title":"Evaluating accountability, transparency, and bias in AI-assisted healthcare decision-making: a qualitative study of healthcare professionals\u2019 perspectives in the UK","volume":"26","author":"Nouis","year":"2025","journal-title":"BMC Med. Ethics"},{"key":"B26","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1167\/tvst.13.12.31","article-title":"A deep learning network for accurate retinal multidisease diagnosis using multiview fusion of en face and B-scan images: a multicenter study","volume":"13","author":"Ou","year":"2024","journal-title":"Transl. Vis. Sci. Technol."},{"key":"B27","doi-asserted-by":"publisher","first-page":"588","DOI":"10.1136\/bjophthalmol-2019-314336","article-title":"Estimated number of ophthalmologists worldwide (International Council of Ophthalmology update): will we meet the needs?","volume":"104","author":"Resnikoff","year":"2020","journal-title":"Br. J. Ophthalmol."},{"key":"B28","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.preteyeres.2018.10.005","article-title":"Myopic maculopathy: current status and proposal for a new classification and grading system (ATN)","volume":"69","author":"Ruiz-Medrano","year":"2019","journal-title":"Prog. Retin Eye Res."},{"key":"B29","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1136\/bjo.2004.060863","article-title":"Correlation of optical coherence tomography, with or without additional colour fundus photography, with stereo fundus fluorescein angiography in diagnosing choroidal neovascular membranes","volume":"89","author":"Sandhu","year":"2005","journal-title":"Br. J. Ophthalmol."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.preteyeres.2018.07.004","article-title":"Artificial intelligence in retina","volume":"67","author":"Schmidt-Erfurth","year":"2018","journal-title":"Prog. Retin Eye Res."},{"key":"B31","doi-asserted-by":"publisher","first-page":"26802","DOI":"10.1038\/s41598-024-78515-y","article-title":"Multi-modal representation learning in retinal imaging using self-supervised learning for enhanced clinical predictions","volume":"14","author":"S\u00fckei","year":"2024","journal-title":"Sci. Rep."},{"key":"B32","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1136\/bjophthalmol-2018-313173","article-title":"Artificial intelligence and deep learning in ophthalmology","volume":"103","author":"Ting","year":"2019","journal-title":"Br. J. Ophthalmol."},{"key":"B33","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1097\/icu.0000000000000524","article-title":"Multimodal imaging of diabetic retinopathy","volume":"29","author":"Tran","year":"2018","journal-title":"Curr. Opin. Ophthalmol."},{"key":"B34","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1186\/s40662-024-00405-1","article-title":"Advances and prospects of multi-modal ophthalmic artificial intelligence based on deep learning: a review","volume":"11","author":"Wang","year":"2024","journal-title":"Eye Vis."},{"key":"B35","doi-asserted-by":"publisher","first-page":"2906","DOI":"10.1016\/j.scib.2024.06.037","article-title":"Multi-rater Prism: learning self-calibrated medical image segmentation from multiple raters","volume":"69","author":"Wu","year":"2024","journal-title":"Sci. Bull. (Beijing)"},{"key":"B36","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.ophtha.2021.07.032","article-title":"Multimodal machine learning using visual fields and peripapillary circular OCT scans in detection of glaucomatous optic neuropathy","volume":"129","author":"Xiong","year":"2022","journal-title":"Ophthalmology"},{"key":"B37","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1136\/bjophthalmol-2020-315817","article-title":"Automated diagnoses of age-related macular degeneration and polypoidal choroidal vasculopathy using bi-modal deep convolutional neural networks","volume":"105","author":"Xu","year":"2021","journal-title":"Br. J. Ophthalmol."},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1136\/bjo-2024-326252","article-title":"Enhancing pathological myopia diagnosis: a bimodal artificial intelligence approach integrating fundus and optical coherence tomography imaging for precise atrophy, traction and neovascularisation grading","author":"Xu","year":"2025","journal-title":"Br. J. Ophthalmol."},{"key":"B39","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s00417-019-04493-x","article-title":"Utility of a public-available artificial intelligence in diagnosis of polypoidal choroidal vasculopathy","volume":"258","author":"Yang","year":"2020","journal-title":"Graefes Arch. Clin. Exp. Ophthalmol."},{"key":"B40","doi-asserted-by":"publisher","first-page":"1001673","DOI":"10.3389\/fmed.2022.1001673","article-title":"Publication trends of artificial intelligence in retina in 10 years: where do we stand?","volume":"9","author":"Yang","year":"2022","journal-title":"Front. Med. (Lausanne)"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1361","DOI":"10.18240\/ijo.2023.09.02","article-title":"Guidelines on clinical research evaluation of artificial intelligence in ophthalmology","volume":"16","author":"Yang","year":"2023","journal-title":"Int. J. Ophthalmol."}],"updated-by":[{"DOI":"10.3389\/fcell.2026.1813162","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T00:00:00Z","timestamp":1773273600000}}],"container-title":["Frontiers in Cell and Developmental Biology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcell.2025.1665173\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T10:38:24Z","timestamp":1773311904000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcell.2025.1665173\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,11]]},"references-count":41,"alternative-id":["10.3389\/fcell.2025.1665173"],"URL":"https:\/\/doi.org\/10.3389\/fcell.2025.1665173","relation":{},"ISSN":["2296-634X"],"issn-type":[{"value":"2296-634X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,11]]},"article-number":"1665173"}}