{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T16:27:33Z","timestamp":1781195253294,"version":"3.54.1"},"reference-count":37,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Tianshan Innovation Team of Xinjiang Uygur Autonomous Region","award":["2020D14044"],"award-info":[{"award-number":["2020D14044"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Doctors usually diagnose a disease by evaluating the pattern of abnormal blood vessels in the fundus. At present, the segmentation of fundus blood vessels based on deep learning has achieved great success, but it still faces the problems of low accuracy and capillary rupture. A good vessel segmentation method can guide the early diagnosis of eye diseases, so we propose a novel hybrid Transformer network (HT-Net) for fundus imaging analysis. HT-Net can improve the vessel segmentation quality by capturing detailed local information and implementing long-range information interactions, and it mainly consists of the following blocks. The feature fusion block (FFB) is embedded in the shallow levels, and FFB enriches the feature space. In addition, the feature refinement block (FRB) is added to the shallow position of the network, which solves the problem of vessel scale change by fusing multi-scale feature information to improve the accuracy of segmentation. Finally, HT-Net\u2019s bottom-level position can capture remote dependencies by combining the Transformer and CNN. We prove the performance of HT-Net on the DRIVE, CHASE_DB1, and STARE datasets. The experiment shows that FFB and FRB can effectively improve the quality of microvessel segmentation by extracting multi-scale information. Embedding efficient self-attention mechanisms in the network can effectively improve the vessel segmentation accuracy. The HT-Net exceeds most existing methods, indicating that it can perform the task of vessel segmentation competently.<\/jats:p>","DOI":"10.3390\/s22186782","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T04:18:32Z","timestamp":1662610712000},"page":"6782","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["HT-Net: A Hybrid Transformer Network for Fundus Vessel Segmentation"],"prefix":"10.3390","volume":"22","author":[{"given":"Xiaolong","family":"Hu","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0210-2273","authenticated-orcid":false,"given":"Liejun","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3116-1811","authenticated-orcid":false,"given":"Yongming","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1016\/j.compmedimag.2009.06.003","article-title":"Algorithms for digital image processing in diabetic retinopathy","volume":"33","author":"Winder","year":"2009","journal-title":"Comput. Medical Imaging Graph."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Irshad, S., and Akram, M.U. (2014, January 11\u201313). Classification of retinal vessels into arteries and veins for detection of hypertensive retinopathy. Proceedings of the 2014 Cairo International Biomedical Engineering Conference (CIBEC), Giza, Egypt.","DOI":"10.1109\/CIBEC.2014.7020937"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1001\/jamaophthalmol.2014.3616","article-title":"Retinal Vascular Layers Imaged by Fluorescein Angiography and Optical Coherence Tomography Angiography","volume":"133","author":"Spaide","year":"2015","journal-title":"JAMA Ophthalmol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Girshick, R.B., Donahue, J., and Darrell, T. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhang, S., Wen, L., and Bian, X. (2018, January 18\u201322). Single-Shot Refinement Neural Network for Object Detection. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00442"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention MICCAI 2015\u201418th International Conference, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.knosys.2019.04.025","article-title":"DUNet: A deformable network for retinal vessel segmentation","volume":"178","author":"Jin","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, H., Wang, Y., and Wan, C. (2020, January 20\u201324). MAU-Net: A Retinal Vessels Segmentation Method. Proceedings of the 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society, EMBC, Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9176093"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1109\/TFUZZ.2018.2889018","article-title":"Superpixel-Based Fast Fuzzy C-Means Clustering for Color Image Segmentation","volume":"27","author":"Lei","year":"2019","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105928","DOI":"10.1016\/j.asoc.2019.105928","article-title":"Fuzzy C-Means clustering through SSIM and patch for image segmentation","volume":"87","author":"Tang","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1016\/j.patcog.2012.12.014","article-title":"Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition","volume":"46","author":"Wang","year":"2013","journal-title":"Pattern Recognit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1016\/j.patcog.2011.09.019","article-title":"Retinal vessel segmentation using a probabilistic tracking method","volume":"45","author":"Yin","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, Q., You, J., and Bourennane, S. (2006, January 8\u201311). A Multiscale Approach to Retinal Vessel Segmentation Using Gabor Filters and Scale Multiplication. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Taipei, Taiwan.","DOI":"10.1109\/ICSMC.2006.384665"},{"key":"ref_15","unstructured":"Zhuang, J. (2018). LadderNet: Multi-path networks based on U-Net for medical image segmentation. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, B., Qiu, S., and He, H. (2019, January 13\u201317). Dual Encoding U-Net for Retinal Vessel Segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention MICCAI, Shenzhen, China.","DOI":"10.1007\/978-3-030-32239-7_10"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"034004","DOI":"10.1117\/1.JMI.6.3.034004","article-title":"Retinal vessel segmentation using dense U-net with multiscale inputs","volume":"6","author":"Yue","year":"2019","journal-title":"J. Med. Imaging"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Guo, C., Szemenyei, M., and Pei, Y. (2019, January 28\u201330). SD-Unet: A Structured Dropout U-Net for Retinal Vessel Segmentation. Proceedings of the 19th IEEE International Conference on Bioinformatics and Bioengineering, BIBE 2019, Athens, Greece.","DOI":"10.1109\/BIBE.2019.00085"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guo, C., Szemenyei, M., and Yi, Y. (2021, January 10\u201315). SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation. Proceedings of the 25th International Conference on Pattern Recognition, ICPR 2020, Virtual Event\/Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9413346"},{"key":"ref_20","first-page":"4467","article-title":"Multimodal Transformer With Multi-View Visual Representation for Image Captioning","volume":"30","author":"Yu","year":"2020","journal-title":"IEEE"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xu, S., and Quan, H. (2021, January 9\u201312). ECT-NAS: Searching Efficient CNN-Transformers Architecture for Medical Image Segmentation. Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2021, Houston, TX, USA.","DOI":"10.1109\/BIBM52615.2021.9669734"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huang, Z., Liao, J., and Cai, G. (2021, January 19\u201321). TransDE: A Transformer and Double Encoder Network for Medical Image Segmentation. Proceedings of the 2021 11th International Conference on Information Technology in Medicine and Education (ITME), Fujian, China.","DOI":"10.1109\/ITME53901.2021.00081"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"108765","DOI":"10.1016\/j.asoc.2022.108765","article-title":"CT-based severity assessment for COVID-19 using weakly supervised non-local CNN","volume":"121","author":"Karthik","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_24","unstructured":"Dosovitskiy, A., Beyer, L., and Weissenborn, D. (2021, January 3\u20137). An Image is Worth 16 \u00d7 16 Words: Transformers for Image Recognition at Scale. Proceedings of the 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gao, Y., Zhou, M., and Metaxas, D.N. (October, January 27). UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention-MICCAI 2021-24th International Conference, Strasbourg, Franc.","DOI":"10.1007\/978-3-030-87199-4_6"},{"key":"ref_26","unstructured":"Ghiasi, G., Lin, T., and Le, Q.V. (2018, January 3\u20138). DropBlock: A regularization method for convolutional networks. Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS, Montr\u00e9al, QC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ding, X., Zhang, X., Han, J., and Ding, G. (2021, January 19\u201325). Diverse Branch Block: Building a Convolution as an Inception-Like Unit. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, Virtual.","DOI":"10.1109\/CVPR46437.2021.01074"},{"key":"ref_28","unstructured":"Yu, F., and Koltun, V. (2016, January 2\u20134). Multi-Scale Context Aggregation by Dilated Convolutions. Proceedings of the International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the Computer Vision-ECCV 2018-15th European Conference, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TMI.2004.825627","article-title":"Ridge-based vessel segmentation in color images of the retina","volume":"23","author":"Staal","year":"2004","journal-title":"IEEE Trans. Medical Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2538","DOI":"10.1109\/TBME.2012.2205687","article-title":"An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation","volume":"59","author":"Fraz","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1109\/42.845178","article-title":"Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response","volume":"19","author":"Hoover","year":"2000","journal-title":"IEEE Trans. Medical Imaging"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Chen, Y., and Zhang, K. (2021, January 10\u201315). PCANet: Pyramid Context-aware Network for Retinal Vessel Segmentation. Proceedings of the 25th International Conference on Pattern Recognition, ICPR 2020, Virtual Event\/Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412773"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Li, L., Verma, M., and Nakashima, Y. (2020, January 1\u20135). IterNet: Retinal Image Segmentation Utilizing Structural Redundancy in Vessel Networks. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, WACV 2020, Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093621"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"102025","DOI":"10.1016\/j.media.2021.102025","article-title":"SCS-Net: A Scale and Context Sensitive Network for Retinal Vessel Segmentation","volume":"70","author":"Wu","year":"2021","journal-title":"Medical Image Anal."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/JBHI.2018.2872813","article-title":"A Three-Stage Deep Learning Model for Accurate Retinal Vessel Segmentation","volume":"23","author":"Yan","year":"2019","journal-title":"IEEE J. Biomed. Health Informatics"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TBME.2018.2828137","article-title":"Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation","volume":"65","author":"Yan","year":"2018","journal-title":"IEEE Trans. Biomed. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6782\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:25:27Z","timestamp":1760142327000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6782"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":37,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22186782"],"URL":"https:\/\/doi.org\/10.3390\/s22186782","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]}}}