{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T17:52:50Z","timestamp":1791049970894,"version":"4.1.0"},"reference-count":77,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the statutory funds of the Department of Artificial Intelligence, Wroclaw University of Science and Technology"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Multiple studies presented satisfactory performances for the treatment of various ocular diseases. To date, there has been no study that describes a multiclass model, medically accurate, and trained on large diverse dataset. No study has addressed a class imbalance problem in one giant dataset originating from multiple large diverse eye fundus image collections. To ensure a real-life clinical environment and mitigate the problem of biased medical image data, 22 publicly available datasets were merged. To secure medical validity only Diabetic Retinopathy (DR), Age-Related Macular Degeneration (AMD) and Glaucoma (GL) were included. The state-of-the-art models ConvNext, RegNet and ResNet were utilized. In the resulting dataset, there were 86,415 normal, 3787 GL, 632 AMD and 34,379 DR fundus images. ConvNextTiny achieved the best results in terms of recognizing most of the examined eye diseases with the most metrics. The overall accuracy was 80.46 \u00b1 1.48. Specific accuracy values were: 80.01 \u00b1 1.10 for normal eye fundus, 97.20 \u00b1 0.66 for GL, 98.14 \u00b1 0.31 for AMD, 80.66 \u00b1 1.27 for DR. A suitable screening model for the most prevalent retinal diseases in ageing societies was designed. The model was developed on a diverse, combined large dataset which made the obtained results less biased and more generalizable.<\/jats:p>","DOI":"10.3390\/diagnostics13111904","type":"journal-article","created":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T02:04:21Z","timestamp":1685412261000},"page":"1904","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Counteracting Data Bias and Class Imbalance\u2014Towards a Useful and Reliable Retinal Disease Recognition System"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1089-4429","authenticated-orcid":false,"given":"Adam R.","family":"Ch\u0142opowiec","sequence":"first","affiliation":[{"name":"Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrze\u017ce Wyspianskiego 27, 50-370 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Konrad","family":"Karanowski","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrze\u017ce Wyspianskiego 27, 50-370 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4030-9101","authenticated-orcid":false,"given":"Tomasz","family":"Skrzypczak","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, Wroclaw Medical University, Wybrze\u017ce Ludwika Pasteura 1, 50-367 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mateusz","family":"Grzesiuk","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrze\u017ce Wyspianskiego 27, 50-370 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0460-6483","authenticated-orcid":false,"given":"Adrian B.","family":"Ch\u0142opowiec","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrze\u017ce Wyspianskiego 27, 50-370 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7687-9002","authenticated-orcid":false,"given":"Martin","family":"Tabakov","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Wroclaw University of Science and Technology, Wybrze\u017ce Wyspianskiego 27, 50-370 Wroclaw, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,29]]},"reference":[{"key":"ref_1","unstructured":"WHO (2022, October 13). Blindness and Vision Impairment. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/blindness-and-visual-impairment."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e888","DOI":"10.1016\/S2214-109X(17)30293-0","article-title":"Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: A systematic review and meta-analysis","volume":"5","author":"Bourne","year":"2017","journal-title":"Lancet Glob. Health"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1038\/s41433-019-0383-5","article-title":"Failing to plan and planning to fail. Can we predict the future growth of demand on UK Eye Care Services?","volume":"33","author":"Buchan","year":"2019","journal-title":"Eye"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1001\/archopht.125.3.406","article-title":"Access to Care: Eye Care Provider Workforce Considerations in 2020","volume":"125","author":"Lee","year":"2007","journal-title":"Arch. Ophthalmol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e486","DOI":"10.1016\/S2589-7500(21)00086-8","article-title":"Application of Comprehensive Artificial intelligence Retinal Expert (CARE) system: A national real-world evidence study","volume":"3","author":"Lin","year":"2021","journal-title":"Lancet Digit. Health"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1001\/jamaophthalmol.2018.6156","article-title":"Assessment of deep generative models for high-resolution synthetic retinal image generation of age-related macular degeneration","volume":"137","author":"Burlina","year":"2019","journal-title":"JAMA Ophthalmol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1001\/jamaophthalmol.2019.2004","article-title":"Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in India","volume":"137","author":"Gulshan","year":"2019","journal-title":"JAMA Ophthalmol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.1056\/NEJMoa1917130","article-title":"Artificial intelligence to detect papilledema from ocular fundus photographs","volume":"382","author":"Milea","year":"2020","journal-title":"N. Engl. J. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.ophtha.2019.05.029","article-title":"Development and validation of deep learning models for screening multiple abnormal findings in retinal fundus images","volume":"127","author":"Son","year":"2020","journal-title":"Ophthalmology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1136\/bjo.85.3.261","article-title":"World blindness: A 21st century perspective","volume":"85","author":"Taylor","year":"2001","journal-title":"Br. J. Ophthalmol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bulut, B., Kal\u0131n, V., G\u00fcne\u015f, B.B., and Khazhin, R. (2020, January 15\u201317). Deep Learning Approach For Detection Of Retinal Abnormalities Based On Color Fundus Images. Proceedings of the 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), Istanbul, Turkey.","DOI":"10.1109\/ASYU50717.2020.9259870"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chellaswamy, C., Geetha, T.S., Ramasubramanian, B., Abirami, R., Archana, B., and Bharathi, A.D. (2022, January 25\u201327). Optimized Convolutional Neural Network based Multiple Eye Disease Detection and Information Sharing System. Proceedings of the 2022 6th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India.","DOI":"10.1109\/ICICCS53718.2022.9788334"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"102329","DOI":"10.1016\/j.bspc.2020.102329","article-title":"Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network","volume":"66","author":"Gour","year":"2021","journal-title":"Biomed. Signal. Process. Control."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e27822","DOI":"10.2196\/27822","article-title":"Application of an Anomaly Detection Model to Screen for Ocular Diseases Using Color Retinal Fundus Images: Design and Evaluation Study","volume":"23","author":"Han","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_15","first-page":"1","article-title":"Deep Learning for Ocular Disease Recognition: An Inner-Class Balance","volume":"2022","author":"Khan","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_16","first-page":"1079","article-title":"Development and evaluation of a deep learning model for the detection of multiple fundus diseases based on colour fundus photography","volume":"106","author":"Li","year":"2022","journal-title":"Br. J. Ophthalmol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"105648","DOI":"10.1016\/j.compbiomed.2022.105648","article-title":"Optimized convolution neural network based multiple eye disease detection","volume":"146","author":"Muthukannan","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"043016","DOI":"10.1117\/1.JEI.31.4.043016","article-title":"Optimized convolutional neural network-based comprehensive early diagnosis method for multiple eye disease recognition","volume":"31","author":"Rathakrishnan","year":"2022","journal-title":"J. Electron. Imaging"},{"key":"ref_19","unstructured":"Shanggong Medical Technology Co., Ltd. (2022, October 03). ODIR-5K. Available online: https:\/\/odir2019.grand-challenge.org\/dataset\/."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s43856-021-00028-w","article-title":"Mitigating bias in machine learning for medicine","volume":"1","author":"Vokinger","year":"2021","journal-title":"Commun. Med."},{"key":"ref_21","first-page":"978","article-title":"Class Imbalance Problem","volume":"Volume 10","author":"Sammut","year":"2011","journal-title":"Encyclopedia of Machine Learning"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lee, H., Park, M., and Kim, J. (2016, January 25\u201328). Plankton classification on imbalanced large scale database via convolutional neural networks with transfer learning. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533053"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0192-5","article-title":"Survey on deep learning with class imbalance","volume":"6","author":"Johnson","year":"2019","journal-title":"J. Big Data"},{"key":"ref_24","unstructured":"Brad, M.D., Feldman, H., and Alpa, S. (2022, October 03). Cataract. Available online: https:\/\/eyewiki.aao.org\/Cataract."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 19\u201324). A convnet for the 2020s. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Radosavovic, R.P., Kosaraju, R., Girshick, K., and Doll\u00e1r, P.H. (2020, January 14\u201319). Designing network design spaces. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition.","DOI":"10.1109\/CVPR42600.2020.01044"},{"key":"ref_27","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Horta, A., Joshi, N., Pekala, M., Pacheco, K.D., Kong, J., Bressler, N., Freund, D.E., and Burlina, P. (2017, January 18\u201321). A hybrid approach for incorporating deep visual features and side channel information with applications to AMD detection. Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico.","DOI":"10.1109\/ICMLA.2017.00-75"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Islam, M.T., Imran, S.A., Arefeen, A., Hasan, M., and Shahnaz, C. (2019, January 28\u201330). Source and camera independent ophthalmic disease recognition from fundus image using neural network. Proceedings of the 2019 IEEE International Conference on Signal Processing, Information, Communication & Systems (SPICSCON), Dhaka, Bangladesh.","DOI":"10.1109\/SPICSCON48833.2019.9065162"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.future.2018.05.001","article-title":"Age-related macular degeneration detection using deep convolutional neural network","volume":"87","author":"Tan","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.gltp.2021.08.027","article-title":"ResNet-50 vs VGG-19 vs training from scratch: A comparative analysis of the segmentation and classification of Pneumonia from chest X-ray images","volume":"2","author":"Ikechukwu","year":"2021","journal-title":"Glob. Transit. Proc."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Reddy, S.B., and Juliet, D.S. (2019, January 4\u20136). Transfer learning with ResNet-50 for malaria cell-image classification. Proceedings of the 2019 International Conference on Communication and Signal Processing (ICCSP), Chennai, India.","DOI":"10.1109\/ICCSP.2019.8697909"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., and Guo, B. (2021, January 19\u201325). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Nashville, TN, USA.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_36","unstructured":"Goyal, P., Duval, Q., Seessel, I., Caron, M., Misra, I., Sagun, L., and Bojanowski, P. (2022). Vision models are more robust and fair when pretrained on uncurated images without supervision. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Azzuni, H., Ridzuan, M., Xu, M., and Yaqub, M. (2022). Color Space-based HoVer-Net for Nuclei Instance Segmentation and Classification. arXiv.","DOI":"10.1109\/ISBIC56247.2022.9854725"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lihacova, I., Bondarenko, A., Chizhov, Y., Uteshev, D., Bliznuks, D., Kiss, N., and Lihachev, A. (2022). Multi-Class CNN for Classification of Multispectral and Autofluorescence Skin Lesion Clinical Images. J. Clin. Med., 11.","DOI":"10.3390\/jcm11102833"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5314","DOI":"10.1109\/TPAMI.2022.3206148","article-title":"Resmlp: Feedforward networks for image classification with data-efficient training","volume":"45","author":"Touvron","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","unstructured":"Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., and J\u00e9gou, H. (2021, January 18\u201324). Training data-efficient image transformers & distillation through attention. Proceedings of the International Conference on Machine Learning, PMLR, Virtual Event."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Marcel, S., and Rodriguez, Y. (2010, January 25\u201329). Torchvision the machine-vision package of torch. Proceedings of the 18th ACM international conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1874254"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Althnian, A., AlSaeed, D., Al-Baity, H., Samha, A., Bin Dris, A., Alzakari, N., Elwafa, A.A., and Kurdi, H. (2021). Impact of dataset size on classification performance: An empirical evaluation in the medical domain. Appl. Sci., 11.","DOI":"10.3390\/app11020796"},{"key":"ref_43","unstructured":"Perez, L., and Wang, J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.jocs.2018.12.003","article-title":"Multi-grade brain tumor classification using deep CNN with extensive data augmentation","volume":"30","author":"Sajjad","year":"2019","journal-title":"J. Comput. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sedigh, P., Sadeghian, R., and Masouleh, M.T. (2019, January 20\u201321). Generating synthetic medical images by using GAN to improve CNN performance in skin cancer classification. Proceedings of the 2019 7th International Conference on Robotics and Mechatronics (ICRoM), IEEE, Tehran, Iran.","DOI":"10.1109\/ICRoM48714.2019.9071823"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and flexible image augmentations. Information, 11.","DOI":"10.3390\/info11020125"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.irbm.2013.01.010","article-title":"TeleOphta: Machine learning and image processing methods for teleophthalmology","volume":"34","author":"Cazuguel","year":"2013","journal-title":"IRBM"},{"key":"ref_48","unstructured":"DeVries, T., and Taylor, G.W. (2017). Improved regularization of convolutional neural networks with cutout. arXiv."},{"key":"ref_49","unstructured":"Biewald, L. (2023, May 24). Experiment Tracking with Weights and Biases. Available online: https:\/\/www.wandb.com\/."},{"key":"ref_50","unstructured":"Liu, L., Jiang, H., He, P., Chen, W., Liu, X., Gao, J., and Han, J. (2019). On the variance of the adaptive learning rate and beyond. arXiv."},{"key":"ref_51","unstructured":"Loshchilov, I., and Hutter, F. (2016). Sgdr: Stochastic gradient descent with warm restarts. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1007730.1007733","article-title":"Special issue on learning from imbalanced data sets","volume":"6","author":"Chawla","year":"2004","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Van Hulse, J., Khoshgoftaar, T.M., and Napolitano, A. (2007, January 20\u201324). Experimental perspectives on learning from imbalanced data. Proceedings of the 24th International Conference on MACHINE Learning, Corvalis, OR, USA.","DOI":"10.1145\/1273496.1273614"},{"key":"ref_54","first-page":"1","article-title":"CNNs for automatic glaucoma assessment using fundus images: An extensive validation","volume":"18","author":"Morales","year":"2019","journal-title":"Biomed. Eng. Online"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"5200","DOI":"10.1167\/iovs.16-19964","article-title":"Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning","volume":"57","author":"Lou","year":"2016","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1167\/iovs.14-15949","article-title":"Accuracy assessment of intra-and intervisit fundus image registration for diabetic retinopathy screening","volume":"56","author":"Adal","year":"2015","journal-title":"Investig. Ophthalmol. Vis. Sci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"014503","DOI":"10.1117\/1.JMI.4.1.014503","article-title":"DR HAGIS\u2014A fundus image database for the automatic extraction of retinal surface vessels from diabetic patients","volume":"4","author":"Holm","year":"2017","journal-title":"J. Med. Imaging"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Pires, R., Jelinek, H.F., Wainer, J., Valle, E., and Rocha, A. (2014). Advancing bag-of-visual-words representations for lesion classification in retinal images. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0096814"},{"key":"ref_59","unstructured":"Drive (2022, December 12). Digital Retinal Images for Vessel Extraction. Available online: https:\/\/drive.grand-challenge.org\/."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"4022","DOI":"10.24996\/ijs.2022.63.9.32","article-title":"Glaucoma Diagnosis Based on Retinal Fundus Image: A Review","volume":"63","author":"Mahdi","year":"2022","journal-title":"Iraqi J. Sci."},{"key":"ref_61","unstructured":"Kaggle, E. (2022, December 01). Kaggle Diabetic Retinopathy Detection. Available online: https:\/\/www.kaggle.com\/c\/diabetic-retinopathy-detection\/data."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Almazroa, A.A., Alodhayb, S., Osman, E., Ramadan, E., Hummadi, M., Dlaim, M., Alkatee, M., Raahemifar, K., and Lakshminarayanan, V. (2018, January 10\u201315). Retinal fundus images for glaucoma analysis: The RIGA dataset. Proceedings of the Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications, SPIE, Houston, TX, USA.","DOI":"10.1117\/12.2293584"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"101570","DOI":"10.1016\/j.media.2019.101570","article-title":"REFUGE Challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs","volume":"59","author":"Orlando","year":"2020","journal-title":"Med. Image Anal."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Takahashi, H., Tampo, H., Arai, Y., Inoue, Y., and Kawashima, H. (2017). Applying artificial intelligence to disease staging: Deep learning for improved staging of diabetic retinopathy. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0179790"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1001\/jamaophthalmol.2013.1743","article-title":"Automated analysis of retinal images for detection of referable diabetic retinopathy","volume":"131","author":"Folk","year":"2013","journal-title":"JAMA Ophthalmol."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Li, L., Xu, M., Wang, X., Jiang, L., and Liu, H. (2019, January 15\u201320). Attention based glaucoma detection: A large-scale database and CNN model. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01082"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"161","DOI":"10.5566\/ias.2346","article-title":"Rim-one dl: A unified retinal image database for assessing glaucoma using deep learning","volume":"39","author":"Batista","year":"2020","journal-title":"Image Anal. Stereol."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TMI.2009.2033909","article-title":"Retinopathy online challenge: Automatic detection of microaneurysms in digital color fundus photographs","volume":"29","author":"Niemeijer","year":"2009","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1109\/42.845178","article-title":"Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response","volume":"19","author":"Hoover","year":"2000","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"748","DOI":"10.1016\/j.jfranklin.2008.04.009","article-title":"Enhancement of blood vessels in digital fundus photographs via the application of multiscale line operators","volume":"345","author":"Farnell","year":"2008","journal-title":"J. Frankl. Inst."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Pachade, S., Porwal, P., Thulkar, D., Kokare, M., Deshmukh, G., Sahasrabuddhe, V., Giancardo, L., Quellec, G., and M\u00e9riaudeau, F. (2021). Retinal fundus multi-disease image dataset (RFMiD): A dataset for multi-disease detection research. Data, 6.","DOI":"10.3390\/data6020014"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-022-09954-8","article-title":"On evaluation metrics for medical applications of artificial intelligence","volume":"12","author":"Hicks","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"4462","DOI":"10.1021\/acs.molpharmaceut.7b00578","article-title":"Comparison of deep learning with multiple machine learning methods and metrics using diverse drug discovery data sets","volume":"14","author":"Korotcov","year":"2017","journal-title":"Mol. Pharm."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1136\/bmj.311.7013.1131","article-title":"Sensitivity and specificity of photography and direct ophthalmoscopy in screening for sight threatening eye disease: The Liverpool diabetic eye study","volume":"311","author":"Harding","year":"1995","journal-title":"BMJ"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"241","DOI":"10.2478\/jccm-2021-0022","article-title":"Accuracy of Diagnostic Tests","volume":"7","author":"Santini","year":"2021","journal-title":"J. Crit. Care Med."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1109\/TKDE.2005.50","article-title":"Using AUC and accuracy in evaluating learning algorithms","volume":"17","author":"Huang","year":"2005","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1111\/j.1525-1497.2004.30091.x","article-title":"The use of \u201coverall accuracy\u201d to evaluate the validity of screening or diagnostic tests","volume":"19","author":"Alberg","year":"2004","journal-title":"J. Gen. Intern. Med."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/11\/1904\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:44:31Z","timestamp":1760125471000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/11\/1904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":77,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["diagnostics13111904"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics13111904","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,29]]}}}