{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T15:24:04Z","timestamp":1787671444930,"version":"build-2736575974"},"reference-count":30,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T00:00:00Z","timestamp":1656460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurosci."],"abstract":"<jats:p>Glaucoma is an optic neuropathy that leads to characteristic visual field defects. However, there is no cure for glaucoma, so the diagnosis of its severity is essential for its prevention. In this paper, we propose a multimodal classification architecture based on deep learning for the severity diagnosis of glaucoma. In this architecture, a gray scale image of the visual field is first reconstructed with a higher resolution in the preprocessing stage, and more subtle feature information is provided for glaucoma diagnosis. We then use multimodal fusion technology to integrate fundus images and gray scale images of the visual field as the input of this architecture. Finally, the inherent limitation of convolutional neural networks (CNNs) is addressed by replacing the original classifier with the proposed classifier. Our architecture is trained and tested on the datasets provided by the First Affiliated Hospital of Kunming Medical University, and the results show that the proposed architecture achieves superior performance for glaucoma diagnosis.<\/jats:p>","DOI":"10.3389\/fnins.2022.939472","type":"journal-article","created":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T08:05:16Z","timestamp":1656489916000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["A Multimodal Classification Architecture for the Severity Diagnosis of Glaucoma Based on Deep Learning"],"prefix":"10.3389","volume":"16","author":[{"given":"Sanli","family":"Yi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaoxu","family":"Qian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"YunQing","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianfeng","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,6,29]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-019-0842-8","article-title":"Two-stage framework for optic disc localization and glaucoma classification in retinal fundus images using deep learning","volume":"19","author":"Bajwa","year":"2020","journal-title":"BMC Medical Inform. Decis. Mak."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2415-11-20","article-title":"Integration and fusion of standard automated perimetry and optical coherence tomography data for improved automated glaucoma diagnostics","volume":"11","author":"Bizios","year":"2011","journal-title":"BMC Ophthalmol."},{"key":"B3","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1016\/j.ajo.2021.11.008","article-title":"Deep learning image analysis of optical coherence tomography angiography measured vessel density improves classification of healthy and glaucoma eyes","volume":"236","author":"Bowd","year":"2022","journal-title":"Am. J. Ophthalmol."},{"key":"B4","doi-asserted-by":"publisher","first-page":"936","DOI":"10.1016\/j.ajo.2014.01.024","article-title":"Glaucomatous optic neuropathy evaluation (GONE) project: the effect of monoscopic versus stereoscopic viewing conditions on optic nerve evaluation","volume":"157","author":"Chan","year":"2014","journal-title":"Am. J. Ophthalmol."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10916-019-1303-8","article-title":"Combination of enhanced depth imaging optical coherence tomography and fundus images for glaucoma screening","volume":"43","author":"Chen","year":"2019","journal-title":"J. Med. Syst."},{"key":"B6","volume-title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","author":"Dosovitskiy","year":"2020"},{"key":"B7","doi-asserted-by":"publisher","first-page":"393","DOI":"10.18240\/ijo.2021.03.10","article-title":"High interpretable machine learning classifier for early glaucoma diagnosis","volume":"14","author":"Escamez","year":"2021","journal-title":"Int. J. Ophthalmol."},{"key":"B8","doi-asserted-by":"publisher","first-page":"102329","DOI":"10.1016\/j.bspc.2020.102329","article-title":"Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network","volume":"66","author":"Gour","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"B9","doi-asserted-by":"publisher","first-page":"2567","DOI":"10.1007\/s11517-020-02237-2","article-title":"Automated glaucoma screening method based on image segmentation and feature extraction","volume":"58","author":"Guo","year":"2020","journal-title":"Med. Biol. Eng. Comput."},{"key":"B10","first-page":"770","article-title":"\u201cDeep residual learning for image recognition,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern","author":"He","year":"2016"},{"key":"B11","volume-title":"Densely Connected Convolutional Networks","author":"Huang","year":"2016"},{"key":"B12","article-title":"\u201cSqueezeNet: AlexNet-Level accuracy with 50x fewer parameters and <0.5MB model size,\u201d","volume-title":"International Conference on Learning Representations (ICLR)","author":"Iandola","year":"2017"},{"key":"B13","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1007\/s11517-022-02510-6","article-title":"Glaucoma disease diagnosis with an artifcial algae-based deep learning algorithm","volume":"60","author":"Ibrahim","year":"2022","journal-title":"Med. Biol. Eng. Comp"},{"key":"B14","doi-asserted-by":"publisher","first-page":"945","DOI":"10.1117\/12.2548546","article-title":"Cup-disc and retinal nerve fiber layer features fusion for diagnosis glaucoma","volume":"11314","author":"Kang","year":"2020","journal-title":"Comp. Aided Diagn"},{"key":"B15","article-title":"Web applicable computer-aided diagnosis of glaucoma using deep learning","author":"Kim","year":"2018"},{"key":"B16","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"ACM"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12880-019-0339-z","article-title":"Correction to: automatic differentiation of Glaucoma visual field from non-glaucoma visual field using deep convolutional neural network","volume":"19","author":"Li","year":"2019","journal-title":"BMC Med. Imaging"},{"key":"B18","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/978-3-319-03005-0_2","article-title":"Multiple modality fusion for glaucoma diagnosis","volume":"42","author":"Liu","year":"2014","journal-title":"IFMBE Proc."},{"key":"B19","article-title":"Do you even need attention? a stack of feed-forward layers does surprisingly well on imagenet","volume-title":"arXiv [Preprint]","author":"Melas-Kyriazi","year":"2021"},{"key":"B20","doi-asserted-by":"publisher","first-page":"112067212097734","DOI":"10.1177\/1120672120977346","article-title":"Applications of deep learning in detection of glaucoma: a systematic review","volume":"31","author":"Mirzania","year":"2020","journal-title":"Eur. J. Ophthalmol."},{"key":"B21","doi-asserted-by":"publisher","first-page":"1428","DOI":"10.1007\/s10278-020-00383-5","article-title":"Extraction of retinal layers through convolution neural network (CNN) in an OCTImage for glaucoma diagnosis","volume":"33","author":"Raja","year":"2020","journal-title":"J. Digit. Imaging"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10792-021-01878-y","article-title":"Visual field-based grading of disease severity in newly diagnosed primary open angle glaucoma patients presenting to a tertiary eye care centre in India","volume":"41","author":"Rajendrababu","year":"2021","journal-title":"Int. Ophthalmol."},{"key":"B23","volume-title":"Very Deep Convolutional Networks for Large-Scale Image Recognition. Computer Science","author":"Simonyan","year":"2014"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11517-020-02307-5","article-title":"An enhanced deep image model for glaucoma diagnosis using feature-based detection in retinal fundus","volume":"59","author":"Singh","year":"2021","journal-title":"Med. Biol. Eng. Comp."},{"key":"B25","article-title":"Attention is all you need","volume-title":"Adv. Neural Inf. Process. Syst","author":"Vaswani","year":"2017"},{"key":"B26","doi-asserted-by":"publisher","first-page":"212499","DOI":"10.1109\/ACCESS.2020.3040275","article-title":"Multi-label classification of fundus images with EfficientNet","volume":"8","author":"Wang","year":"2020","journal-title":"IEEEAccess"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1517","DOI":"10.1007\/s00417-009-1121-7","article-title":"Glaucoma detection and evaluation through pattern recognition in standard automated perimetry data","volume":"247","author":"Wroblewski","year":"2009","journal-title":"Graefes Arch. Clin. Exp. Ophthalmol."},{"key":"B28","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.ajo.2020.03.035","article-title":"Efficacy for differentiating nonglaucomatous versus glaucomatous optic neuropathy using deep learning systems","volume":"216","author":"Yang","year":"2020","journal-title":"Am. J. Ophthalmol."},{"key":"B29","volume-title":"TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation","author":"Yao","year":"2021"},{"key":"B30","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1097\/ICU.0000000000000552","article-title":"Artificial intelligence in glaucoma","volume":"30","author":"Zheng","year":"2019","journal-title":"Curr. Opin. Ophthalmol."}],"container-title":["Frontiers in Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2022.939472\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T08:05:53Z","timestamp":1656489953000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2022.939472\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,29]]},"references-count":30,"alternative-id":["10.3389\/fnins.2022.939472"],"URL":"https:\/\/doi.org\/10.3389\/fnins.2022.939472","relation":{},"ISSN":["1662-453X"],"issn-type":[{"value":"1662-453X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,29]]},"article-number":"939472"}}