{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T04:54:19Z","timestamp":1774932859062,"version":"3.50.1"},"reference-count":24,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T00:00:00Z","timestamp":1738713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background: Retinal diseases are emerging as a significant health concern, making early detection and prompt treatment crucial to prevent visual impairment. Optical coherence tomography (OCT) is the preferred imaging modality for non-invasive diagnosis. Both diabetic macular edema (DME) and macular edema secondary to retinal vein occlusion (RVO) present an increase in retinal thickness, posing etiologic diagnostic challenges for non-specialists in retinal diseases. The lack of research on deep learning classification of macular edema secondary to RVO using OCT images motivated us to propose a convolutional neural network model for this task. Methods: The VGG-19 network was fine-tuned with a public dataset to classify OCT images. This network was then used to develop three models: unimodal\u2014the input is only the OCT B-scan; multimodal\u2014the inputs are the OCT B-scan and diabetes information, and multi-image\u2014the inputs are the OCT B-scan, the infrared image, and the diabetes information. Seven hundred sixty-six patients from ULS S\u00e3o Jo\u00e3o were selected, comprising 208 healthy eyes, 207 with macular edema secondary to RVO, 218 with DME, and 200 with other pathologies. The performance metrics include accuracy, precision, recall, F0.5 score, and area under the receiver operating characteristic curve (AUROC). Results: The multi-image model achieved better results, with an accuracy of 95.20%, precision of 95.43%, recall of 95.20%, F0.5-score of 95.32%, F1-score of 95.21%, and AUROC of 99.59% on the classification task between four classes. Conclusions: This study presents a novel method to distinguish macular edema secondary to RVO and DME using diabetes diagnosis, OCT, and infrared images. This research aims to provide a reliable tool for ophthalmologists, improving the accuracy and speed of diagnoses.<\/jats:p>","DOI":"10.3390\/jcm14031008","type":"journal-article","created":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T05:50:36Z","timestamp":1738734636000},"page":"1008","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Deep Learning to Distinguish Edema Secondary to Retinal Vein Occlusion and Diabetic Macular Edema: A Multimodal Approach Using OCT and Infrared Imaging"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5001-5539","authenticated-orcid":false,"given":"Guilherme","family":"Barbosa","sequence":"first","affiliation":[{"name":"INEGI\u2014Instituto de Ci\u00eancia e Inova\u00e7\u00e3o em Engenharia Mec\u00e2nica e Engenharia Industrial, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0729-7008","authenticated-orcid":false,"given":"Eduardo","family":"Carvalho","sequence":"additional","affiliation":[{"name":"INEGI\u2014Instituto de Ci\u00eancia e Inova\u00e7\u00e3o em Engenharia Mec\u00e2nica e Engenharia Industrial, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3979-0874","authenticated-orcid":false,"given":"Ana","family":"Guerra","sequence":"additional","affiliation":[{"name":"INEGI\u2014Instituto de Ci\u00eancia e Inova\u00e7\u00e3o em Engenharia Mec\u00e2nica e Engenharia Industrial, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7079-9554","authenticated-orcid":false,"given":"S\u00f3nia","family":"Torres-Costa","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, CHUSJ\u2014Centro Hospitalar e Universit\u00e1rio de S\u00e3o Jo\u00e3o, 4200-319 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4633-8600","authenticated-orcid":false,"given":"Nilza","family":"Rami\u00e3o","sequence":"additional","affiliation":[{"name":"INEGI\u2014Instituto de Ci\u00eancia e Inova\u00e7\u00e3o em Engenharia Mec\u00e2nica e Engenharia Industrial, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3326-6345","authenticated-orcid":false,"given":"Marco L. P.","family":"Parente","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Faculdade de Engenharia, Universidade do Porto, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4718-0910","authenticated-orcid":false,"given":"Manuel","family":"Falc\u00e3o","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, CHUSJ\u2014Centro Hospitalar e Universit\u00e1rio de S\u00e3o Jo\u00e3o, 4200-319 Porto, Portugal"},{"name":"Department of Surgery and Physiology, Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1038\/s41433-022-02007-4","article-title":"Retinal vein occlusion (RVO) guideline: Executive summary","volume":"36","author":"Nicholson","year":"2022","journal-title":"Eye"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1016\/j.survophthal.2018.04.005","article-title":"Ischemic retinal vein occlusion: Characterizing the more severe spectrum of retinal vein occlusion","volume":"63","author":"Khayat","year":"2018","journal-title":"Surv. Ophthalmol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.ophtha.2009.07.017","article-title":"The Prevalence of Retinal Vein Occlusion: Pooled Data from Population Studies from the United States, Europe, Asia, and Australia","volume":"117","author":"Rogers","year":"2010","journal-title":"Ophthalmology"},{"key":"ref_4","unstructured":"Bille, J.F.A., Donner, S., Fischer, S., and M\u00fcller, J. (2019). Optical Coherence Tomography (OCT): Principle and Technical Realization. High Resolution Imaging in Microscopy and Ophthalmology: New Frontiers in Biomedical Optics, Springer. Frank Review Book Chapter NBK554044 [Bookaccession]."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1167\/tvst.5.2.3","article-title":"Automated Retinal Image Analysis for Evaluation of Focal Hyperpigmentary Changes in Intermediate Age-Related Macular Degeneration","volume":"5","author":"Saur","year":"2016","journal-title":"Transl. Vis. Sci. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hussain, M.A., Bhuiyan, A., Luu, C.D., Theodore Smith, R., Guymer, R.H., Ishikawa, H., Schuman, J.S., and Ramamohanarao, K. (2018). Classification of healthy and diseased retina using SD-OCT imaging and Random Forest algorithm. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0198281"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.oret.2016.12.009","article-title":"Deep learning is effective for the classification of OCT images of normal versus Age-related Macular Degeneration","volume":"1","author":"Lee","year":"2017","journal-title":"Ophthalmol. Retin."},{"key":"ref_8","first-page":"1","article-title":"On OCT Image Classification via Deep Learning","volume":"11","author":"Wang","year":"2019","journal-title":"IEEE Photonics J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1007\/s00417-018-04224-8","article-title":"Fully automated detection of retinal disorders by image-based deep learning","volume":"257","author":"Li","year":"2019","journal-title":"Graefe\u2019s Arch. Clin. Exp. Ophthalmol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Choi, J.Y., Yoo, T.K., Seo, J.G., Kwak, J., Um, T.T., and Rim, T.H. (2017). Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0187336"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e000924","DOI":"10.1136\/bmjophth-2021-000924","article-title":"Deep learning-based classification of retinal vascular diseases using ultra-widefield colour fundus photographs","volume":"7","author":"Abitbol","year":"2022","journal-title":"BMJ Open Ophthalmol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1730501","DOI":"10.1155\/2022\/1730501","article-title":"Hypermixed Convolutional Neural Network for Retinal Vein Occlusion Classification","volume":"2022","author":"Zhang","year":"2022","journal-title":"Dis. Markers"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4988256","DOI":"10.1155\/2022\/4988256","article-title":"Development and Application of an Intelligent Diagnosis System for Retinal Vein Occlusion Based on Deep Learning","volume":"2022","author":"Xu","year":"2022","journal-title":"Dis. Markers"},{"key":"ref_16","unstructured":"Kermany, D.S., Zhang, K., and Goldbaum, M.H. (2018). Large Dataset of Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images. Mendeley Data, 3."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Pin, K., Nam, Y., Ha, S., and Han, J.W. (2021, January 15\u201317). Deep Learning Based on Ensemble to Diagnose of Retinal Disease using Optical Coherence Tomography. Proceedings of the 2021 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.","DOI":"10.1109\/CSCI54926.2021.00174"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Khan, A., Pin, K., Aziz, A., Han, J.W., and Nam, Y. (2023). Optical Coherence Tomography Image Classification Using Hybrid Deep Learning and Ant Colony Optimization. Sensors, 23.","DOI":"10.3390\/s23156706"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kulyabin, M., Zhdanov, A., Nikiforova, A., Stepichev, A., Kuznetsova, A., Ronkin, M., Borisov, V., Bogachev, A., Korotkich, S., and Constable, P.A. (2023). OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methods. arXiv.","DOI":"10.1038\/s41597-024-03182-7"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1038\/s41597-024-03182-7","article-title":"OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methods","volume":"11","author":"Kulyabin","year":"2023","journal-title":"Sci. Data"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101871","DOI":"10.1016\/j.artmed.2020.101871","article-title":"Speckle reduction of OCT via super resolution reconstruction and its application on retinal layer segmentation","volume":"106","author":"Yan","year":"2020","journal-title":"Artif. Intell. Med."},{"key":"ref_22","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kim, H.E., Cosa-Linan, A., Santhanam, N., Jannesari, M., Maros, M.E., and Ganslandt, T. (2022). Transfer learning for medical image classification: A literature review. BMC Med. Imaging, 22.","DOI":"10.1186\/s12880-022-00793-7"}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/14\/3\/1008\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:27:12Z","timestamp":1760027232000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/14\/3\/1008"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,5]]},"references-count":24,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["jcm14031008"],"URL":"https:\/\/doi.org\/10.3390\/jcm14031008","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,5]]}}}