{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T16:48:46Z","timestamp":1780418926418,"version":"3.54.1"},"reference-count":44,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T00:00:00Z","timestamp":1626912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background: Laguna-ONhE is an application for the colorimetric analysis of optic nerve images, which topographically assesses the cup and the presence of haemoglobin. Its latest version has been fully automated with five deep learning models. In this paper, perimetry in combination with Laguna-ONhE or Cirrus-OCT was evaluated. Methods: The morphology and perfusion estimated by Laguna ONhE were compiled into a \u201cGlobin Distribution Function\u201d (GDF). Visual field irregularity was measured with the usual pattern standard deviation (PSD) and the threshold coefficient of variation (TCV), which analyses its harmony without taking into account age-corrected values. In total, 477 normal eyes, 235 confirmed, and 98 suspected glaucoma cases were examined with Cirrus-OCT and different fundus cameras and perimeters. Results: The best Receiver Operating Characteristic (ROC) analysis results for confirmed and suspected glaucoma were obtained with the combination of GDF and TCV (AUC: 0.995 and 0.935, respectively. Sensitivities: 94.5% and 45.9%, respectively, for 99% specificity). The best combination of OCT and perimetry was obtained with the vertical cup\/disc ratio and PSD (AUC: 0.988 and 0.847, respectively. Sensitivities: 84.7% and 18.4%, respectively, for 99% specificity). Conclusion: Using Laguna ONhE, morphology, perfusion, and function can be mutually enhanced with the methods described for the purpose of glaucoma assessment, providing early sensitivity.<\/jats:p>","DOI":"10.3390\/jcm10153231","type":"journal-article","created":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T22:35:31Z","timestamp":1626993331000},"page":"3231","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Fully Automated Colorimetric Analysis of the Optic Nerve Aided by Deep Learning and Its Association with Perimetry and OCT for the Study of Glaucoma"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0749-5774","authenticated-orcid":false,"given":"Marta","family":"Gonzalez-Hernandez","sequence":"first","affiliation":[{"name":"INSOFT S.L., 25 de Julio, 34, 38004 Santa Cruz de Tenerife, Spain"},{"name":"Ophthalmology Department, Hospital Universitario de Canarias, Carretera Ofra s\/n, 38320 San Cristobal de La Laguna, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7397-7160","authenticated-orcid":false,"given":"Daniel","family":"Gonzalez-Hernandez","sequence":"additional","affiliation":[{"name":"INSOFT S.L., 25 de Julio, 34, 38004 Santa Cruz de Tenerife, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Perez-Barbudo","sequence":"additional","affiliation":[{"name":"INSOFT S.L., 25 de Julio, 34, 38004 Santa Cruz de Tenerife, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2242-3285","authenticated-orcid":false,"given":"Paloma","family":"Rodriguez-Esteve","sequence":"additional","affiliation":[{"name":"Facultad de Ciencias de la Salud, Universidad de La Laguna, C\/Sta, Mar\u00eda Soledad s\/n, 38200 San Cristobal de La Laguna, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9569-2358","authenticated-orcid":false,"given":"Nisamar","family":"Betancor-Caro","sequence":"additional","affiliation":[{"name":"Facultad de Ciencias de la Salud, Universidad de La Laguna, C\/Sta, Mar\u00eda Soledad s\/n, 38200 San Cristobal de La Laguna, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuel","family":"Gonzalez de la Rosa","sequence":"additional","affiliation":[{"name":"INSOFT S.L., 25 de Julio, 34, 38004 Santa Cruz de Tenerife, Spain"},{"name":"Facultad de Ciencias de la Salud, Universidad de La Laguna, C\/Sta, Mar\u00eda Soledad s\/n, 38200 San Cristobal de La Laguna, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.1016\/j.ophtha.2014.05.013","article-title":"Global prevalence of glaucoma and projections of glaucoma burden through 2040: A systematic review and meta-analysis","volume":"121","author":"Tham","year":"2014","journal-title":"Ophthalmology"},{"key":"ref_2","first-page":"814","article-title":"Fundoscopy of nerve fiber layer defects in glaucoma","volume":"12","author":"Hoyt","year":"1973","journal-title":"Investig. Ophthalmol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3127","DOI":"10.1364\/BOE.3.003127","article-title":"Quantitative OCT angiography of optic nerve head blood flow","volume":"3","author":"Jia","year":"2012","journal-title":"Biomed. Opt. Express"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1167\/iovs.12-10761","article-title":"Measuring haemoglobin levels in the optic nerve head: Comparisons with other structural and functional parameters of glaucoma","volume":"54","author":"Sigut","year":"2013","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1562","DOI":"10.1167\/iovs.14-15592","article-title":"Estimation of the relative amount of haemoglobin in the cup and neuroretinal rim using stereoscopic color fundus images","volume":"56","author":"Sigut","year":"2015","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.oftal.2014.09.007","article-title":"Correlaci\u00f3n de la relaci\u00f3n excavaci\u00f3n\/papila \u00f3ptica medida mediante HRT-III, SD-OCT y el dispositivo de colorimetr\u00eda fotogr\u00e1fica Laguna OnhE","volume":"90","author":"Hernandez","year":"2015","journal-title":"Arch. Soc. Esp. Oftalmol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1111\/aos.13050","article-title":"Glaucoma diagnostic capacity of optic nerve head haemoglobin measures compared with spectral domain OCT and HRT III confocal tomography","volume":"94","author":"Rosa","year":"2016","journal-title":"Acta Ophthalmol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ferreras, A. (2016). Glaucoma imaging: Measuring haemoglobin levels in the optic nerve head for glaucoma management. Glaucoma Imaging, Springer.","DOI":"10.1007\/978-3-319-18959-8"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1097\/IJG.0000000000000160","article-title":"Reproducibility of optic nerve head haemoglobin measures","volume":"25","year":"2016","journal-title":"J. Glaucoma"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"798","DOI":"10.3109\/02713683.2015.1062112","article-title":"Estimating the amount of haemoglobin in the neuroretinal rim using color images and OCT","volume":"41","author":"Sigut","year":"2016","journal-title":"Curr. Eye Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"387","DOI":"10.3928\/01913913-20170801-02","article-title":"Preliminary study of the differences in optic nerve head haemoglobin measures between patients with and without childhood glaucoma","volume":"54","year":"2017","journal-title":"J. Pediatric Ophthalmol. Strabismus"},{"key":"ref_12","first-page":"2340236","article-title":"Relationship between retinal nerve fiber layer thickness and haemoglobin present in the optic nerve head in glaucoma","volume":"2017","year":"2017","journal-title":"J. Ophthalmol."},{"key":"ref_13","first-page":"1000760","article-title":"Segmentation of the optic nerve head based on Deep Learning to determine its haemoglobin content in normal and glaucomatous subjects","volume":"9","year":"2018","journal-title":"J. Clin. Exp. Opthamol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.survophthal.2018.09.002","article-title":"The current state of artificial intelligence in ophthalmology","volume":"64","author":"Kapoor","year":"2019","journal-title":"Surv. Ophthalmol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"14665","DOI":"10.1038\/s41598-018-33013-w","article-title":"Development of a deep residual learning algorithm to screen for glaucoma from fundus photography","volume":"8","author":"Shibata","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5\u20139 October 2015, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mendez-Hernandez, C., Wang, S., Arribas-Pardo, P., Salazar-Qui\u00f1ones, L., G\u00fcemes-Villahoz, N., Fernandez-Perez, C., and Garcia-Feijoo, J. (2020). Diagnostic validity of optic nerve head colorimetric assessment and optical coherence tomography angiography in patients with glaucoma. Br. J. Ophthalmol.","DOI":"10.1136\/bjophthalmol-2020-316455"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1177\/1120672118762668","article-title":"New visual field indices of disharmony for early diagnosis of glaucoma, alone or associated with conventional parameters","volume":"28","year":"2018","journal-title":"Eur. J. Ophthalmol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1177\/112067210901900315","article-title":"Linear regression analysis of the cumulative defect curve by sectors and other criteria of glaucomatous visual field progression","volume":"19","year":"2009","journal-title":"Eur. J. Ophthalmol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1097\/IJG.0b013e318239c1a3","article-title":"A Strategy for averaged estimates of visual field threshold: Spark","volume":"22","year":"2013","journal-title":"J. Glaucoma"},{"key":"ref_21","unstructured":"Wall, M., and Wild, J. (1997). Accuracy of the Tendency Oriented Perimetry (TOP) in the Octopus 1-2-3 Perimeter. Perimetry Update 1996\/1997, Kugler Publications."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1056\/NEJM197810262991705","article-title":"Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests","volume":"299","author":"Ransohoff","year":"1978","journal-title":"N. Engl. J. Med."},{"key":"ref_23","first-page":"5","article-title":"Gold standards may bias clinical test validation","volume":"6","year":"2020","journal-title":"ARS Clin. Acad."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach","volume":"44","author":"Delong","year":"1988","journal-title":"Biometrics"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1111\/ceo.13381","article-title":"Current state and future prospects of artificial intelligence in ophthalmology: A re-view","volume":"47","author":"Hogarty","year":"2019","journal-title":"Clin. Exp. Ophthalmol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.ins.2018.01.051","article-title":"Deep convolution neural network for accurate diagnosis of glaucoma using digital fundus images","volume":"441","author":"Raghavendra","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1353","DOI":"10.1001\/jamaophthalmol.2019.3501","article-title":"Development and Validation of a Deep Learning System to Detect Glaucomatous Optic Neuropathy Using Fundus Photographs","volume":"137","author":"Liu","year":"2019","journal-title":"JAMA Ophthalmol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1016\/j.ophtha.2018.01.023","article-title":"Efficacy of a Deep Learning System for Detecting Glaucomatous Optic Neuropathy Based on Color Fundus Photographs","volume":"125","author":"Li","year":"2018","journal-title":"Ophthalmology"},{"key":"ref_29","first-page":"1555","article-title":"Application of artificial intelligence in ophthalmology","volume":"11","author":"Du","year":"2018","journal-title":"Int. J. Ophthalmol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1007\/s10384-019-00659-6","article-title":"Evaluation of deep convolutional neural networks for glaucoma detection","volume":"63","author":"Phan","year":"2019","journal-title":"Jpn. J. Ophthalmol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"16685","DOI":"10.1038\/s41598-018-35044-9","article-title":"Performance of Deep Learning Architectures and Transfer Learning for Detecting Glaucomatous Optic Neuropathy in Fundus Photographs","volume":"8","author":"Christopher","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.ajo.2019.01.011","article-title":"A Deep Learning Algorithm to Quantify Neuroretinal Rim Loss From Optic Disc Photographs","volume":"201","author":"Thompson","year":"2019","journal-title":"Am. J. Ophthalmol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1136\/bjo.2008.154815","article-title":"Structure-function relationship depends on glaucoma severity","volume":"93","author":"Pablo","year":"2009","journal-title":"Br. J. Ophthalmol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1442-9071.2012.02770.x","article-title":"Structure\u2013function relationship in glaucoma: Past thinking and current concepts","volume":"40","author":"Malik","year":"2012","journal-title":"Clin. Exp. Ophthalmol."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, X., Trmal, J., Povey, D., and Khudanpur, S. (2014, January 4\u20139). Improving deep neural network acoustic models using generalized maxout networks. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6853589"},{"key":"ref_36","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 1). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_38","unstructured":"ImageNet Project (2020, November 09). Stanford Vision Lab, Stanford University, Princeton University. Available online: http:\/\/www.image-net.org\/."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_40","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1016\/j.ergon.2011.05.001","article-title":"Learning curve models and applications: Literature review and research directions","volume":"41","author":"Anzanello","year":"2011","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning: With Applications in R, Springer-Verlag.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_43","unstructured":"Adebayo, J., Muelly, M., Liccardi, I., and Kim, B. (2020). Debugging Tests for Model Explanations. arXiv."},{"key":"ref_44","unstructured":"Hoffer, E., Hubara, I., and Soudry, D. (2017, January 4). Train longer, generalize better: Closing the generalization gap in large batch training of neural networks. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/15\/3231\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:33:19Z","timestamp":1760164399000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/15\/3231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,22]]},"references-count":44,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["jcm10153231"],"URL":"https:\/\/doi.org\/10.3390\/jcm10153231","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,22]]}}}