{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T19:44:01Z","timestamp":1783712641429,"version":"3.55.0"},"reference-count":30,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T00:00:00Z","timestamp":1736380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Diabetic retinopathy, a common complication of diabetes, is further exacerbated by factors such as hypertension and obesity. This study introduces the Diabetic Retinopathy Compact Convolutional Transformer (DRCCT) model, which combines convolutional and transformer techniques to enhance the classification of retinal images. The DRCCT model achieved an impressive average F1-score of 0.97, reflecting its high accuracy in detecting true positives while minimizing false positives. Over 100 training epochs, the model demonstrated outstanding generalization capabilities, achieving a remarkable training accuracy of 99% and a validation accuracy of 95%. This consistent improvement underscores the model\u2019s robust learning process and its effectiveness in avoiding overfitting. On a newly evaluated dataset, the model attained precision and recall scores of 96.93% and 98.89%, respectively, indicating a well-balanced handling of false positives and false negatives. The model\u2019s ability to classify retinal images into five distinct diabetic retinopathy categories demonstrates its potential to significantly improve automated diagnosis and aid in clinical decision-making.<\/jats:p>","DOI":"10.3390\/bdcc9010009","type":"journal-article","created":{"date-parts":[[2025,1,9]],"date-time":"2025-01-09T07:59:42Z","timestamp":1736409582000},"page":"9","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["DRCCT: Enhancing Diabetic Retinopathy Classification with a Compact Convolutional Transformer"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-3688-9992","authenticated-orcid":false,"given":"Mohamed","family":"Touati","sequence":"first","affiliation":[{"name":"Lab-STICC\/UMR CNRS 6285, University of Brest, F-29238 Brest, France"},{"name":"The National Higher Engineering School of Tunis, University of Tunis, Tunis 1008, Tunisia"},{"name":"Laboratory of Human Genetics, Faculty of Medicine of Tunis, University of Tunis El Manar, Tunis 1007, Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5982-7123","authenticated-orcid":false,"given":"Rabeb","family":"Touati","sequence":"additional","affiliation":[{"name":"Laboratory of Human Genetics, Faculty of Medicine of Tunis, University of Tunis El Manar, Tunis 1007, Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurent","family":"Nana","sequence":"additional","affiliation":[{"name":"Lab-STICC\/UMR CNRS 6285, University of Brest, F-29238 Brest, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1529-663X","authenticated-orcid":false,"given":"Faouzi","family":"Benzarti","sequence":"additional","affiliation":[{"name":"The National Higher Engineering School of Tunis, University of Tunis, Tunis 1008, Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8939-8948","authenticated-orcid":false,"given":"Sadok","family":"Ben Yahia","sequence":"additional","affiliation":[{"name":"The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, 6400 Sonderborg, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bidwai, P., Gite, S., Pahuja, K., and Kotecha, K. (2022). A Systematic Literature Review on Diabetic Retinopathy Using an Artificial Intel-Ligence Approach. Big Data Cogn. Comput., 6.","DOI":"10.3390\/bdcc6040152"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Subramanian, S., Mishra, S., Patil, S., Shaw, K., and Aghajari, E. (2022). Machine Learning Styles for Diabetic Retinopathy Detection: A Review and Bibliometric Analysis. Big Data Cogn. Comput., 6.","DOI":"10.3390\/bdcc6040154"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102802","DOI":"10.1016\/j.media.2023.102802","article-title":"Transformers in Medical Imaging: A Survey","volume":"88","author":"Shamshad","year":"2023","journal-title":"Med. Image Anal."},{"key":"ref_4","first-page":"669","article-title":"A Deep Learning Model for Diabetic Retinopathy Classification","volume":"Volume 669","author":"Motahhir","year":"2023","journal-title":"Digital Technologies and Applications, Proceedings of the ICDTA 2023, Fez, Morocco, 27\u201328 January 2023"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Touati, M., Nana, L., and Benzarti, F. (2024, January 1\u20134). Enhancing diabetic retinopathy classification: A fusion of ResNet50 with attention mechanism. Proceedings of the IEEE\/IFAC 10th International Conference on Control, Decision and Information Technologies (CoDIT), Valletta, Malta.","DOI":"10.1109\/CoDIT62066.2024.10708076"},{"key":"ref_6","first-page":"16.1","article-title":"Using MobileNetV2 to Classify the Severity of Diabetic Retinopathy","volume":"21","author":"Sheikh","year":"2020","journal-title":"Int. J. Simul.-Syst. Sci. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gao, J., Leung, C., and Miao, C. (2019, January 18\u201321). Diabetic Retinopathy Classification Using an Efficient Convolutional Neural Network. Proceedings of the 2019 IEEE International Conference on Agents (ICA), Jinan, China.","DOI":"10.1109\/AGENTS.2019.8929191"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TASE.2020.2981637","article-title":"Diabetic retinopathy diagnosis using multichannel generative adversarial network with semisupervision","volume":"18","author":"Wang","year":"2020","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yaqoob, M.K., Ali, S.F., Bilal, M., Hanif, M.S., and Al-Saggaf, U.M. (2021). ResNet-based deep features and random forest classifier for diabetic retinopathy detection. Sensors, 21.","DOI":"10.3390\/s21113883"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dharmana, M.M., and Aiswarya, M.S. (2020, January 15\u201317). Pre-diagnosis of Diabetic Retinopathy using Blob Detection. Proceedings of the 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India.","DOI":"10.1109\/ICIRCA48905.2020.9183241"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Toledo-Cort\u00e9s, S., De La Pava, M., Perdomo, O., and Gonz\u00e1lez, F.A. (2020, January 8). Hybrid Deep Learning Gaussian Process for Diabetic Retinopathy Diagnosis and Uncertainty Quantification. Proceedings of the International Workshop on Ophthalmic Medical Image Analysis, Lima, Peru.","DOI":"10.1007\/978-3-030-63419-3_21"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vo, H.H., and Verma, A. (2016, January 11\u201313). New deep neural nets for fine-grained diabetic retinopathy recognition on hybrid color space. Proceedings of the 2016 IEEE International Symposium on Multimedia (ISM), San Jose, CA, USA.","DOI":"10.1109\/ISM.2016.0049"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"85","DOI":"10.26599\/NBE.2023.9290041","article-title":"An Enhancing Diabetic Retinopathy Classification and Segmentation based on TaNet","volume":"16","author":"Vani","year":"2024","journal-title":"Nano Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"20552076231203676","DOI":"10.1177\/20552076231203676","article-title":"Enhancing diabetic retinopathy classification using deep learning","volume":"9","author":"Alwakid","year":"2023","journal-title":"Digit. Health"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"117546","DOI":"10.1109\/ACCESS.2023.3326528","article-title":"Vision transformer model for predicting the severity of diabetic retinopathy in fundus photography-based retina images","volume":"11","author":"Nazih","year":"2023","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Al-Hammuri, K., Gebali, F., Kanan, A., and Chelvan, I.T. (2023). Vision transformer architecture and applications in digital health: A tutorial and survey. Vis. Comput. Ind. Biomed. Art, 6.","DOI":"10.1186\/s42492-023-00140-9"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Khan, I.U., Raiaan, M.A.K., Fatema, K., Azam, S., Rashid, R.u., Mukta, S.H., Jonkman, M., and De Boer, F. (2023). A Computer-Aided Diagnostic System to Identify Diabetic Retinopathy, Utilizing a Modified Compact Convolutional Transformer and Low-Resolution Images to Reduce Computation Time. Biomedicines, 11.","DOI":"10.3390\/biomedicines11061566"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bashir, I., Sajid, M.Z., Kalsoom, R., Ali Khan, N., Qureshi, I., Abbas, F., and Abbas, Q. (2023). RDS-DR: An Improved Deep Learning Model for Classifying Severity Levels of Diabetic Retinopathy. Diagnostics, 13.","DOI":"10.3390\/diagnostics13193116"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/s13755-022-00181-z","article-title":"Features extraction using encoded local binary pattern for detection and grading diabetic retinopathy","volume":"10","author":"Berbar","year":"2022","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"R., Y., Raja Sarobin M., V., Panjanathan, R., S., G.J., and L., J.A. (2022). Diabetic Retinopathy Classification Using CNN and Hybrid Deep Convolutional Neural Networks. Symmetry, 14.","DOI":"10.3390\/sym14091932"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s44163-023-00049-5","article-title":"Evaluation of artificial intelligence techniques in disease diagnosis and prediction","volume":"3","author":"Kaplanoglu","year":"2023","journal-title":"Discov. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, Y., Cai, Z., Qiu, S., and Xu, P. (2024). Vision transformer with masked autoencoders for referable diabetic retinopathy classification based on large-size retina image. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0299265"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kumar, N.S., and Karthikeyan, B.R. (2021, January 16\u201319). Diabetic Retinopathy Detection using CNN, Transformer and MLP based Architectures. Proceedings of the 2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Hualien City, Taiwan. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/9651024.","DOI":"10.1109\/ISPACS51563.2021.9651024"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"7850","DOI":"10.1002\/mp.15312","article-title":"Vision Transformer-based recognition of diabetic retinopathy grade","volume":"48","author":"Wu","year":"2021","journal-title":"Med. Phys."},{"key":"ref_25","unstructured":"Islam, K. (2022). Recent advances in vision transformer: A survey and outlook of recent work. arXiv."},{"key":"ref_26","unstructured":"Hassani, A., Walton, S., Shah, N., Abuduweili, A., Li, J., and Shi, H. (2021). Escaping the Big Data Paradigm with Compact Transformers. arXiv."},{"key":"ref_27","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, Z., Yin, Y., Shi, J., Fang, W., Li, H., and Wang, X. (2017, January 11\u201313). Zoom-in-net: Deep mining lesions for diabetic retinopathy detection. Proceedings of the Medical Image Computing and Computer Assisted Intervention MICCAI 2017: 20th International Conference, Quebec City, QC, Canada. Part III.","DOI":"10.1007\/978-3-319-66179-7_31"},{"key":"ref_29","first-page":"88","article-title":"Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learning","volume":"16","author":"Jagielski","year":"2018","journal-title":"IEEE Secur. Priv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/TMSCS.2015.2494021","article-title":"Energy-Efficient Long-Term Continuous Personal Health Monitoring","volume":"1","author":"Nia","year":"2015","journal-title":"IEEE Trans. Multi-Scale Comput. Syst."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/1\/9\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:25:42Z","timestamp":1759919142000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/1\/9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,9]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["bdcc9010009"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9010009","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,9]]}}}