{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,1]],"date-time":"2025-10-01T15:57:13Z","timestamp":1759334233412,"version":"build-2065373602"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,9,30]],"date-time":"2025-09-30T00:00:00Z","timestamp":1759190400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,30]],"date-time":"2025-09-30T00:00:00Z","timestamp":1759190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"King Fahd University of Petroleum and Minerals, SDAIA-KFUPM Joint Research Center for Artificial Intelligence","award":["JRCAI-RG-14"],"award-info":[{"award-number":["JRCAI-RG-14"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Diabetic retinopathy is a leading cause of vision loss, necessitating early, accurate detection. Automated deep learning models show promise but struggle with the complexity of retinal images and limited labeled data. Due to domain differences, traditional transfer learning from datasets like ImageNet often fails in medical imaging. Self-supervised learning (SSL) offers a solution by enabling models to learn directly from medical data, but its success depends on the backbone architecture. Convolutional Neural Networks (CNNs) focus on local features, which can be limiting. To address this, we propose the Multi-scale Self-Supervised Learning (MsSSL) model, combining Vision Transformers (ViTs) for global context and CNNs with a Feature Pyramid Network (FPN) for multi-scale feature extraction. These features are refined through a Deep Learner module, improving spatial resolution and capturing high-level and fine-grained information. The MsSSL model significantly enhances DR grading, outperforming traditional methods, and underscores the value of domain-specific pretraining and advanced model integration in medical imaging.<\/jats:p>","DOI":"10.1038\/s41598-025-85685-w","type":"journal-article","created":{"date-parts":[[2025,9,30]],"date-time":"2025-09-30T13:02:09Z","timestamp":1759237329000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Multi scale self supervised learning for deep knowledge transfer in diabetic retinopathy grading"],"prefix":"10.1038","volume":"15","author":[{"given":"Wadha","family":"Almattar","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saeed","family":"Anwar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sadam","family":"Al-Azani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fakhri Alam","family":"Khan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,9,30]]},"reference":[{"key":"85685_CR1","unstructured":"WHO. World health organization (2023)."},{"key":"85685_CR2","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1186\/s12880-024-01253-0","volume":"24","author":"B VanBerlo","year":"2024","unstructured":"VanBerlo, B., Hoey, J. & Wong, A. A survey of the impact of self-supervised pretraining for diagnostic tasks in medical x-ray, ct, mri, and ultrasound. BMC Med. Imaging 24, 79 (2024).","journal-title":"BMC Med. Imaging"},{"key":"85685_CR3","unstructured":"Raghu, M., Zhang, C., Kleinberg, J. & Bengio, S. Transfusion: Understanding transfer learning for medical imaging. Adv. Neural Inf. Process. Syst. 32 (2019)."},{"key":"85685_CR4","doi-asserted-by":"crossref","unstructured":"Shurrab S, D.\u00a0R. Self-supervised learning methods and applications in medical imaging analysis: a survey. PeerJ Comput. Sci.  8, e1045 (2022).","DOI":"10.7717\/peerj-cs.1045"},{"key":"85685_CR5","doi-asserted-by":"crossref","unstructured":"Newell, A. & Deng, J. How useful is self-supervised pretraining for visual tasks? In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 7345\u20137354 (2020).","DOI":"10.1109\/CVPR42600.2020.00737"},{"key":"85685_CR6","doi-asserted-by":"crossref","unstructured":"Huang, Y., Lin, L., Cheng, P., Lyu, J. & Tang, X. Lesion-based contrastive learning for diabetic retinopathy grading from fundus images. In International Conference on Medical Image Computing and Computer-Assisted Intervention (2021).","DOI":"10.1007\/978-3-030-87196-3_11"},{"key":"85685_CR7","unstructured":"Chen, T., Kornblith, S., Norouzi, M. & Hinton, G. A simple framework for contrastive learning of visual representations. In International conference on machine learning, 1597\u20131607 (PMLR, 2020)."},{"key":"85685_CR8","first-page":"9912","volume":"33","author":"M Caron","year":"2020","unstructured":"Caron, M. et al. Unsupervised learning of visual features by contrasting cluster assignments. Adv. Neural. Inf. Process. Syst. 33, 9912\u20139924 (2020).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"85685_CR9","doi-asserted-by":"crossref","unstructured":"Caron, M. et al. Emerging properties in self-supervised vision transformers. In Proceedings of the IEEE\/CVF international conference on computer vision, 9650\u20139660 (2021).","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"85685_CR10","unstructured":"Truong, T., Mohammadi, S. & Lenga, M. How transferable are self-supervised features in medical image classification tasks? In Machine Learning for Health, 54\u201374 (PMLR, 2021)."},{"key":"85685_CR11","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"85685_CR12","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1609\/aaai.v36i1.19894","volume":"36","author":"Y-H Cao","year":"2022","unstructured":"Cao, Y.-H. & Wu, J. A random cnn sees objects: One inductive bias of cnn and its applications. In Proceedings Of The AAAI Conference On Artificial Intelligence 36, 194\u2013202 (2022).","journal-title":"In Proceedings Of The AAAI Conference On Artificial Intelligence"},{"key":"85685_CR13","doi-asserted-by":"crossref","unstructured":"Lin, T. -Y. et al. Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2117\u20132125 (2017).","DOI":"10.1109\/CVPR.2017.106"},{"key":"85685_CR14","unstructured":"Dosovitskiy, A. et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint[SPACE]arXiv:2010.11929 (2020)."},{"key":"85685_CR15","doi-asserted-by":"crossref","unstructured":"Farahani, A., Voghoei, S., Rasheed, K. & Arabnia, H.\u00a0R. A brief review of domain adaptation. In Advances in data science and information engineering: proceedings from ICDATA 2020 and IKE 2020 877\u2013894 (2021).","DOI":"10.1007\/978-3-030-71704-9_65"},{"key":"85685_CR16","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, 248\u2013255 (Ieee, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"85685_CR17","unstructured":"Raghu, M., Zhang, C., Kleinberg, J. & Bengio, S. Transfusion: Understanding transfer learning for medical imaging. Adv. Neural Inf. Process. Syst. 32 (2019)."},{"key":"85685_CR18","doi-asserted-by":"crossref","unstructured":"Ke, A., Ellsworth, W., Banerjee, O., Ng, A.\u00a0Y. & Rajpurkar, P. Chextransfer: performance and parameter efficiency of imagenet models for chest x-ray interpretation. In Proceedings of the conference on health, inference, and learning, 116\u2013124 (2021).","DOI":"10.1145\/3450439.3451867"},{"key":"85685_CR19","doi-asserted-by":"crossref","unstructured":"He, K., Girshick, R. & Doll\u00e1r, P. Rethinking imagenet pre-training. In Proceedings of the IEEE\/CVF international conference on computer vision, 4918\u20134927 (2019).","DOI":"10.1109\/ICCV.2019.00502"},{"key":"85685_CR20","doi-asserted-by":"crossref","unstructured":"Azizi, S. et al. Big self-supervised models advance medical image classification. In Proceedings of the IEEE\/CVF international conference on computer vision, 3478\u20133488 (2021).","DOI":"10.1109\/ICCV48922.2021.00346"},{"key":"85685_CR21","doi-asserted-by":"crossref","unstructured":"Almattar, W., Luqman, H. & Khan, F.\u00a0A. Diabetic retinopathy grading review: Current techniques and future directions. Image Vis. Comput. 104821 (2023).","DOI":"10.1016\/j.imavis.2023.104821"},{"key":"85685_CR22","unstructured":"Huang, Y., Lyu, J., Cheng, P., Tam, R. & Tang, X. Ssit: Saliency-guided self-supervised image transformer for diabetic retinopathy grading. IEEE Trans. Med. Imaging (2022)."},{"key":"85685_CR23","unstructured":"Dosovitskiy, A., Springenberg, J.\u00a0T., Riedmiller, M. & Brox, T. Discriminative unsupervised feature learning with convolutional neural networks. Adv. Neural Inf. Process. Syst. 27 (2014)."},{"key":"85685_CR24","doi-asserted-by":"crossref","unstructured":"Adak, C., Karkera, T., Chattopadhyay, S. & Saqib, M. Detecting severity of diabetic retinopathy from fundus images using ensembled transformers. arXiv preprint[SPACE]arXiv:2301.00973 (2023).","DOI":"10.1016\/j.neucom.2024.127991"},{"key":"85685_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2023.116919","volume":"113","author":"Y Chen","year":"2023","unstructured":"Chen, Y., Zhu, X., Li, Y., Wei, Y. & Ye, L. Enhanced semantic feature pyramid network for small object detection. Signal Process. Image Commun. 113, 116919 (2023).","journal-title":"Signal Process. Image Commun."},{"key":"85685_CR26","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention\u2013MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18, 234\u2013241 (Springer, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"85685_CR27","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2117\u20132125 (2017).","DOI":"10.1109\/CVPR.2017.106"},{"key":"85685_CR28","doi-asserted-by":"crossref","unstructured":"Wang, K., Liew, J.\u00a0H., Zou, Y., Zhou, D. & Feng, J. Panet: Few-shot image semantic segmentation with prototype alignment. In proceedings of the IEEE\/CVF international conference on computer vision, 9197\u20139206 (2019).","DOI":"10.1109\/ICCV.2019.00929"},{"key":"85685_CR29","doi-asserted-by":"crossref","unstructured":"Wang, N. et al. Nas-fcos: Fast neural architecture search for object detection. In proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, 11943\u201311951 (2020).","DOI":"10.1109\/CVPR42600.2020.01196"},{"key":"85685_CR30","unstructured":"Almattar, W., Anwar, S., , S., Al Azani & Khan, F.\u00a0A. Efficient knowledge transfer using channel-guided contrastive self-supervised learning for diabetic retinopathy severity grading with limited data. submitted for publication (2024)."},{"key":"85685_CR31","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y. & Kweon, I.\u00a0S. Cbam: Convolutional block attention module. In Proceedings of the European conference on computer vision (ECCV), 3\u201319 (2018).","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"85685_CR32","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, 248\u2013255 (Ieee, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"85685_CR33","doi-asserted-by":"publisher","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition, https:\/\/doi.org\/10.48550\/ARXIV.1409.1556 (2014).","DOI":"10.48550\/ARXIV.1409.1556"},{"key":"85685_CR34","unstructured":"Tan, M. & Le, Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning, 6105\u20136114 (PMLR, 2019)."},{"key":"85685_CR35","doi-asserted-by":"publisher","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision, https:\/\/doi.org\/10.48550\/ARXIV.1512.00567 (2015).","DOI":"10.48550\/ARXIV.1512.00567"},{"key":"85685_CR36","doi-asserted-by":"publisher","first-page":"511","DOI":"10.1016\/j.ins.2019.06.011","volume":"501","author":"T Li","year":"2019","unstructured":"Li, T. et al. Diagnostic assessment of deep learning algorithms for diabetic retinopathy screening. Inf. Sci. 501, 511\u2013522 (2019).","journal-title":"Inf. Sci."},{"key":"85685_CR37","unstructured":"APTOS2019. Diabetic retinopathy detection, (2019)."},{"key":"85685_CR38","doi-asserted-by":"crossref","unstructured":"Gangwar, A.\u00a0K. & Ravi, V. Diabetic retinopathy detection using transfer learning and deep learning. In Evolution in Computational Intelligence: Frontiers in Intelligent Computing: Theory and Applications (FICTA 2020), Volume 1, 679\u2013689 (Springer, 2021).","DOI":"10.1007\/978-981-15-5788-0_64"},{"key":"85685_CR39","doi-asserted-by":"publisher","first-page":"2015","DOI":"10.1007\/s11517-022-02564-6","volume":"60","author":"E AbdelMaksoud","year":"2022","unstructured":"AbdelMaksoud, E., Barakat, S. & Elmogy, M. A computer-aided diagnosis system for detecting various diabetic retinopathy grades based on a hybrid deep learning technique. Med. Biol. Eng. Comput. 60, 2015\u20132038 (2022).","journal-title":"Med. Biol. Eng. Comput."},{"key":"85685_CR40","doi-asserted-by":"crossref","unstructured":"Kassani, S.\u00a0H. et al. Diabetic retinopathy classification using a modified xception architecture. In 2019 IEEE international symposium on signal processing and information technology (ISSPIT), 1\u20136 (IEEE, 2019).","DOI":"10.1109\/ISSPIT47144.2019.9001846"},{"key":"85685_CR41","doi-asserted-by":"crossref","unstructured":"Caron, M. et al. Emerging properties in self-supervised vision transformers. In Proceedings of the IEEE\/CVF international conference on computer vision, 9650\u20139660 (2021).","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"85685_CR42","doi-asserted-by":"crossref","unstructured":"Bi, Q. et al. Self-supervised cross-level consistency learning for fundus image classification. In ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1781\u20131785 (IEEE, 2024).","DOI":"10.1109\/ICASSP48485.2024.10448211"},{"key":"85685_CR43","doi-asserted-by":"crossref","unstructured":"Chhipa, P.\u00a0C. et al. Functional knowledge transfer with self-supervised representation learning. In 2023 IEEE International Conference on Image Processing (ICIP), 3339\u20133343 (IEEE, 2023).","DOI":"10.1109\/ICIP49359.2023.10222142"},{"key":"85685_CR44","doi-asserted-by":"crossref","unstructured":"Ohri, K., Kumar, M. & Sukheja, D. Self-supervised approach for diabetic retinopathy severity detection using vision transformer. Progress in Artificial Intelligence 1\u201319 (2024).","DOI":"10.1007\/s13748-024-00325-0"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-85685-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-85685-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-85685-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,30]],"date-time":"2025-09-30T13:02:40Z","timestamp":1759237360000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-85685-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,30]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["85685"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-85685-w","relation":{},"ISSN":["2045-2322"],"issn-type":[{"type":"electronic","value":"2045-2322"}],"subject":[],"published":{"date-parts":[[2025,9,30]]},"assertion":[{"value":"27 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 January 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"33742"}}