{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T17:01:05Z","timestamp":1790787665523,"version":"4.1.0"},"reference-count":39,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T00:00:00Z","timestamp":1774310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["82101116"],"award-info":[{"award-number":["82101116"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science and Technology Projects in Guangzhou","award":["2025A04J3477"],"award-info":[{"award-number":["2025A04J3477"]}]},{"name":"Medical Scientific Research Foundation of Guangdong Province","award":["B2025400"],"award-info":[{"award-number":["B2025400"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Diabetic retinopathy (DR) is the largest cause of permanent vision loss in the working-age population, making automated grading critical for timely therapeutic intervention. While recent deep learning algorithms have improved feature discrimination, modern state-of-the-art systems have two fundamental drawbacks. First, most models rely on standard Convolutional Neural Networks, which struggle to capture long-range relationships and lack semantic reasoning, resulting in visual findings that do not correlate with clinical knowledge. Second, present approaches often consider grading as a nominal classification or a pure ordinal regression task, failing to strike a compromise between high classification accuracy and severity-consistent predictions (Quadratic Weighted Kappa). To address these challenges, we propose Dual-SwinOrd, a novel framework that integrates a hierarchical Vision Transformer with a semantically guided dual-head mechanism. Specifically, we use a Swin Transformer backbone to extract hierarchical features, effectively capturing global retinal structures. To handle diverse lesion scales, we incorporate a Progressive Lesion-aware Kernel Attention (PLKA) module and a Semantic Prior Modulation (SPM) module guided by PubMedCLIP, bridging the gap between visual features and medical linguistic priors. In addition, we propose a Dual-Head learning strategy that decouples the optimization objective into two parallel streams: a Classification Head to maximize diagnostic accuracy and an Ordinal Regression Head (DPE) to enforce rank-consistency. This design effectively mitigates the trade-off between precision and ordinality. Extensive experiments on the APTOS 2019 and DDR datasets demonstrate that Dual-SwinOrd achieves state-of-the-art performance, yielding an Accuracy of 87.98% and a Quadratic Weighted Kappa (QWK) of 0.9370 on the APTOS 2019 dataset, as well as an Accuracy of 86.54% and a QWK of 0.9040 on the DDR dataset.<\/jats:p>","DOI":"10.3390\/bioengineering13040374","type":"journal-article","created":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T08:02:49Z","timestamp":1774339369000},"page":"374","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Dual-SwinOrd: A Dual-Head Swin Transformer with Semantic Prior Injection for Ordinal Diabetic Retinopathy Grading"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7975-7377","authenticated-orcid":false,"given":"Wenjuan","family":"Yu","sequence":"first","affiliation":[{"name":"The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-0194-1332","authenticated-orcid":false,"given":"Xiaonan","family":"Si","sequence":"additional","affiliation":[{"name":"The School of Biomedical Engineering, University of Science and Technology of China, Hefei 230027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingxiang","family":"Zhong","sequence":"additional","affiliation":[{"name":"The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"},{"name":"Department of Ophthalmology, Shenzhen Bright Star Eye Hospital, Shenzhen 518002, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3397","DOI":"10.1109\/JBHI.2020.3012547","article-title":"Simultaneous diagnosis of severity and features of diabetic retinopathy in fundus photography using deep learning","volume":"24","author":"Wang","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"556","DOI":"10.2337\/dc11-1909","article-title":"Global prevalence and major risk factors of diabetic retinopathy","volume":"35","author":"Yau","year":"2012","journal-title":"Diabetes Care"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2686","DOI":"10.1109\/JBHI.2020.3041848","article-title":"Convolutional network with twofold feature augmentation for diabetic retinopathy recognition from multi-modal images","volume":"25","author":"Hua","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.4103\/ijo.IJO_1989_18","article-title":"Artificial intelligence in diabetic retinopathy: A natural step to the future","volume":"67","author":"Padhy","year":"2019","journal-title":"Indian J. Ophthalmol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Al-Tawil, M., Mahafzah, B.A., Al Tawil, A., and Aljarah, I. (2023). Bio-inspired machine learning approach to Type 2 Diabetes Detection. Symmetry, 15.","DOI":"10.3390\/sym15030764"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018). Cbam: Convolutional block attention module. Computer Vision\u2014ECCV 2018, Proceedings of the 15th European Conference, Munich, Germany, 8\u201314 September 2018, Springer.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"123523","DOI":"10.1016\/j.eswa.2024.123523","article-title":"A deep integrative approach for diabetic retinopathy classification with synergistic channel-spatial and self-attention mechanism","volume":"249","author":"Madarapu","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_10","unstructured":"Khan, S.U.R., Asim, M.N., Vollmer, S., and Dengel, A. (2025). AI-Driven Diabetic Retinopathy Diagnosis Enhancement through Image Processing and Salp Swarm Algorithm-Optimized Ensemble Network. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105472","DOI":"10.1016\/j.compbiomed.2022.105472","article-title":"Grading diabetic retinopathy and prostate cancer diagnostic images with deep quantum ordinal regression","volume":"145","author":"Useche","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_12","unstructured":"Eslami, S., De Melo, G., and Meinel, C. (2021). Does clip benefit visual question answering in the medical domain as much as it does in the general domain?. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Aadiwal, V., Tanwar, V., Sharma, B., and Yadav, D.P. (2025). Gastrointestinal Lesion Detection Using Ensemble Deep Learning Through Global Contextual Information. Bioengineering, 12.","DOI":"10.3390\/bioengineering12121329"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ebiaredoh-Mienye, S.A., Swart, T.G., Esenogho, E., and Mienye, I.D. (2022). A machine learning method with filter-based feature selection for improved prediction of chronic kidney disease. Bioengineering, 9.","DOI":"10.3390\/bioengineering9080350"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"68467","DOI":"10.1007\/s11042-024-18356-z","article-title":"Adaptive ensembling of multi-modal deep spatial representations for diabetic retinopathy diagnosis","volume":"83","author":"Veeranjaneyulu","year":"2024","journal-title":"Multimed. Tools Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"167","DOI":"10.31642\/JoKMC\/2018\/100225","article-title":"Diabetic retinopathy classification using swin transformer with multi wavelet","volume":"10","author":"Dihin","year":"2023","journal-title":"J. Kufa Math. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2216","DOI":"10.1109\/JBHI.2021.3119519","article-title":"Joint learning of multi-level tasks for diabetic retinopathy grading on low-resolution fundus images","volume":"26","author":"Wang","year":"2021","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Niu, Z., Zhou, M., Wang, L., Gao, X., and Hua, G. (2016, January 27\u201330). Ordinal regression with multiple output cnn for age estimation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.532"},{"key":"ref_19","unstructured":"Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021). Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning, PMLR."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3876","DOI":"10.18653\/v1\/2022.emnlp-main.256","article-title":"Medclip: Contrastive learning from unpaired medical images and text","volume":"Volume 2022","author":"Wang","year":"2022","journal-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lin, W., Zhao, Z., Zhang, X., Wu, C., Zhang, Y., Wang, Y., and Xie, W. (2023). Pmc-clip: Contrastive language-image pre-training using biomedical documents. Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2023, Proceedings of the 26th International Conference, Vancouver, BC, Canada, 8\u201312 October 2023, Springer.","DOI":"10.1007\/978-3-031-43993-3_51"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109462","DOI":"10.1016\/j.asoc.2022.109462","article-title":"Classification of diabetic retinopathy with feature selection over deep features using nature-inspired wrapper methods","volume":"128","author":"Canayaz","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.ins.2019.06.011","article-title":"Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening","volume":"501","author":"Li","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_24","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1109\/TMI.2020.3023463","article-title":"CABNet: Category attention block for imbalanced diabetic retinopathy grading","volume":"40","author":"He","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15105","DOI":"10.1007\/s10489-021-03043-5","article-title":"Hinge attention network: A joint model for diabetic retinopathy severity grading: NS Shaik and TK Cherukuri","volume":"52","author":"Shaik","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"104370","DOI":"10.1016\/j.bspc.2022.104370","article-title":"Attention-driven cascaded network for diabetic retinopathy grading from fundus images","volume":"80","author":"Yue","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"107993","DOI":"10.1016\/j.compbiomed.2024.107993","article-title":"CRA-Net: Transformer guided category-relation attention network for diabetic retinopathy grading","volume":"170","author":"Zang","year":"2024","journal-title":"Comput. Biol. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2826","DOI":"10.1609\/aaai.v35i4.16388","article-title":"Deep multi-task learning for diabetic retinopathy grading in fundus images","volume":"35","author":"Wang","year":"2021","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/s13246-021-01012-3","article-title":"Diabetic retinopathy classification based on multipath CNN and machine learning classifiers","volume":"44","author":"Gayathri","year":"2021","journal-title":"Phys. Eng. Sci. Med."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"102115","DOI":"10.1016\/j.bspc.2020.102115","article-title":"A lightweight CNN for Diabetic Retinopathy classification from fundus images","volume":"62","author":"Gayathri","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.matpr.2022.01.466","article-title":"Binary classification of DR-diabetic retinopathy using CNN with fundus colour images","volume":"58","author":"Padmanayana","year":"2022","journal-title":"Mater. Today Proc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"27505","DOI":"10.1007\/s10489-023-04949-y","article-title":"Joint ordinal regression and multiclass classification for diabetic retinopathy grading with transformers and CNNs fusion network: L Ma et al","volume":"53","author":"Ma","year":"2023","journal-title":"Appl. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Obayya, M., Nemri, N., Nour, M.K., Al Duhayyim, M., Mohsen, H., Rizwanullah, M., Sarwar Zamani, A., and Motwakel, A. (2022). Explainable artificial intelligence enabled teleophthalmology for diabetic retinopathy grading and classification. Appl. Sci., 12.","DOI":"10.3390\/app12178749"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1167\/tvst.11.7.10","article-title":"A diabetic retinopathy classification framework based on deep-learning analysis of OCT angiography","volume":"11","author":"Zang","year":"2022","journal-title":"Transl. Vis. Sci. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.cmpb.2019.06.016","article-title":"Classification of diabetes-related retinal diseases using a deep learning approach in optical coherence tomography","volume":"178","author":"Perdomo","year":"2019","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1089\/tmj.2015.0068","article-title":"Fundus photography in the 21st century\u2014A review of recent technological advances and their implications for worldwide healthcare","volume":"22","author":"Panwar","year":"2016","journal-title":"Telemed. e-Health"}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/4\/374\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T08:45:30Z","timestamp":1774341930000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/4\/374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,24]]},"references-count":39,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["bioengineering13040374"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering13040374","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,24]]}}}