{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T16:09:28Z","timestamp":1780675768609,"version":"3.54.1"},"reference-count":48,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T00:00:00Z","timestamp":1729641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62273279"],"award-info":[{"award-number":["62273279"]}]},{"name":"National Natural Science Foundation of China","award":["GZC20232105"],"award-info":[{"award-number":["GZC20232105"]}]},{"name":"National Natural Science Foundation of China","award":["CX2024043"],"award-info":[{"award-number":["CX2024043"]}]},{"name":"National Funded Postdoctoral Researcher Program of China","award":["62273279"],"award-info":[{"award-number":["62273279"]}]},{"name":"National Funded Postdoctoral Researcher Program of China","award":["GZC20232105"],"award-info":[{"award-number":["GZC20232105"]}]},{"name":"National Funded Postdoctoral Researcher Program of China","award":["CX2024043"],"award-info":[{"award-number":["CX2024043"]}]},{"name":"Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University","award":["62273279"],"award-info":[{"award-number":["62273279"]}]},{"name":"Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University","award":["GZC20232105"],"award-info":[{"award-number":["GZC20232105"]}]},{"name":"Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University","award":["CX2024043"],"award-info":[{"award-number":["CX2024043"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Infrared multi-band small and dim target detection is an important research direction in the fields of modern remote sensing and military surveillance. However, achieving high-precision detection remains challenging due to the small scale, low contrast of small and dim targets, and their susceptibility to complex background interference. This paper innovatively proposes a dual-band infrared small and dim target detection method (MM-IRSTD). In this framework, we integrate a convolutional self-attention mechanism module and a self-distillation mechanism to achieve end-to-end dual-band infrared small and dim target detection. The Conv-Based Self-Attention module consists of a convolutional self-attention mechanism and a multilayer perceptron, effectively extracting and integrating input features, thereby enhancing the performance and expressive capability of the model. Additionally, this module incorporates a dynamic weight mechanism to achieve adaptive feature fusion, significantly reducing computational complexity and enhancing the model\u2019s global perception capability. During model training, we use a spatial and channel similarity self-distillation mechanism to drive model updates, addressing the similarity discrepancy between long-wave and mid-wave image features extracted through deep learning, thus improving the model\u2019s performance and generalization capability. Furthermore, to better learn and detect edge features in images, this paper designs an edge extraction method based on Sobel. Finally, comparative experiments and ablation studies validate the advancement and effectiveness of our proposed method.<\/jats:p>","DOI":"10.3390\/rs16213937","type":"journal-article","created":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T04:28:43Z","timestamp":1729657723000},"page":"3937","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["MM-IRSTD: Conv Self-Attention-Based Multi-Modal Small and Dim Target Detection in Infrared Dual-Band Images"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-9649-2354","authenticated-orcid":false,"given":"Junyan","family":"Yang","sequence":"first","affiliation":[{"name":"School of Astronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"},{"name":"Shanghai Academy of Spaceflight Technology, Shanghai 201109, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5482-4844","authenticated-orcid":false,"given":"Zhihui","family":"Ye","sequence":"additional","affiliation":[{"name":"School of Astronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8964-8871","authenticated-orcid":false,"given":"Jian","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Astronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8730-8475","authenticated-orcid":false,"given":"Dongfang","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Academy of Spaceflight Technology, Shanghai 201109, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3908-5607","authenticated-orcid":false,"given":"Lingbian","family":"Du","sequence":"additional","affiliation":[{"name":"Shanghai Academy of Spaceflight Technology, Shanghai 201109, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6861-1391","authenticated-orcid":false,"given":"Shaoyi","family":"Li","sequence":"additional","affiliation":[{"name":"School of Astronautics, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yang, X., Li, S., Niu, S., Yan, B., and Meng, Z. (2024). Graph-based Spatio-Temporal Semantic Reasoning Model for Anti-occlusion Infrared Aerial Target Recognition. IEEE Trans. Multimed., 1\u201315.","DOI":"10.1109\/TMM.2024.3408051"},{"key":"ref_2","first-page":"5004614","article-title":"Anti-Occlusion Infrared Aerial Target Recognition with Vision-Inspired Dual-Stream Graph Network","volume":"52","author":"Yang","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","first-page":"6346","article-title":"MF-GCN: Motion Flow-Based Graph Network Learning Dynamics for Aerial IR Target Recognition","volume":"59","author":"Yang","year":"2023","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104612","DOI":"10.1016\/j.infrared.2023.104612","article-title":"Joint spatio-temporal features and sea background prior for infrared dim and small target detection","volume":"130","author":"Tian","year":"2023","journal-title":"Infrared Phys. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1016\/j.patcog.2009.12.023","article-title":"Analysis of new top-hat transformation and the application for infrared dim small target detection","volume":"43","author":"Bai","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2013.2242477","article-title":"A Local Contrast Method for Small Infrared Target Detection","volume":"52","author":"Chen","year":"2013","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3752","DOI":"10.1109\/JSTARS.2017.2700023","article-title":"Reweighted infrared patch-tensor model with both nonlocal and local priors for single-frame small target detection","volume":"10","author":"Dai","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"124385","DOI":"10.1016\/j.eswa.2024.124385","article-title":"CS-ViG-UNet: Infrared small and dim target detection based on cycle shift vision graph convolution network","volume":"254","author":"Lin","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201322). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_16","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_17","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_18","unstructured":"Jocher, G., Chaurasia, A., Stoken, A., Borovec, J., Kwon, Y., Michael, K., Fang, J., Yifu, Z., Wong, C., and Montes, D. (2024, July 22). YOLOv5 by Ultralytics, Version 7.0. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_19","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv."},{"key":"ref_20","unstructured":"Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_22","unstructured":"Jocher, G., Chaurasia, A., and Qiu, J. (2024, July 22). Ultralytics YOLO, Version 8.0.0. Available online: https:\/\/github.com\/ultralytics\/ultralytics."},{"key":"ref_23","unstructured":"Wang, C.Y., Yeh, I.H., and Liao, H.-Y.M. (2024). Yolov9: Learning what you want to learn using programmable gradient information. arXiv."},{"key":"ref_24","unstructured":"Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., and Ding, G. (2024). Yolov10: Real-time end-to-end object detection. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Part I 14.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_26","unstructured":"Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). Dssd: Deconvolutional single shot detector. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_28","unstructured":"Zhu, X., Su, W., Lu, L., Li, B., Wang, X., and Dai, J. (2020). Deformable detr: Deformable transformers for end-to-end object detection. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sun, Z., Cao, S., Yang, Y., and Kitani, K.M. (2021, January 11\u201317). Rethinking transformer-based set prediction for object detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00359"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dai, Z., Cai, B., Lin, Y., and Chen, J. (2021, January 20\u201325). Up-detr: Unsupervised pre-training for object detection with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00165"},{"key":"ref_31","unstructured":"Zheng, M., Gao, P., Zhang, R., Li, K., Wang, X., Li, H., and Dong, H. (2020). End-to-end object detection with adaptive clustering transformer. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.infrared.2018.08.025","article-title":"Multi-band composite detection and recognition of aerial infrared point targets","volume":"94","author":"Kou","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, J., Gong, W., Zhang, T., Zhang, Y., Deng, W., and Liu, H. (2022, January 16\u201318). Multi-band Image Fusion With Infrared Broad Spectrum For Low And Slow Small Target Recognition. Proceedings of the 2022 International Conference on Artificial Intelligence and Computer Information Technology (AICIT), Yichang, China.","DOI":"10.1109\/AICIT55386.2022.9930170"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"105172","DOI":"10.1016\/j.infrared.2024.105172","article-title":"Infrared differential detection and band selection for space-based aerial targets under complex backgrounds","volume":"138","author":"Guo","year":"2024","journal-title":"Infrared Phys. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1015002","DOI":"10.3788\/AOS201737.1015002","article-title":"Convolutional neural network based multi-band ship target recognition with feature fusion","volume":"37","author":"Liu","year":"2017","journal-title":"Acta Opt. Sin."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, D., Fan, L., Ma, H., and Xu, Z. (2023, January 4\u20136). Performance Analysis of Ship Target Recognition in Multi-Band Infrared Images Based on Deep Learning. Proceedings of the 2023 7th International Conference on Transportation Information and Safety (ICTIS), Xi\u2019an, China.","DOI":"10.1109\/ICTIS60134.2023.10243868"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, T., Zhang, D., and Liu, Y. (2023, January 16\u201318). Research on Camouflage Target Detection Method Based on Dual Band Optics and SAR Image Fusion. Proceedings of the International Conference on Image, Vision and Intelligent Systems, Baoding, China.","DOI":"10.1007\/978-981-97-0855-0_31"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"6723","DOI":"10.1007\/s00371-022-02759-w","article-title":"Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion","volume":"39","author":"Yin","year":"2023","journal-title":"Vis. Comput."},{"key":"ref_39","first-page":"282","article-title":"An object detection algorithm based on decision-level fusion of visible and infrared images","volume":"45","author":"Dahai","year":"2023","journal-title":"Infrared Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zheng, X., Yang, Q., Si, P., and Wu, Q. (2022). A multi-stage visible and infrared image fusion network based on attention mechanism. Sensors, 22.","DOI":"10.3390\/s22103651"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"13232","DOI":"10.1109\/TNNLS.2023.3266452","article-title":"LRAF-Net: Long-Range Attention Fusion Network for Visible\u2013Infrared Object Detection","volume":"35","author":"Fu","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"104670","DOI":"10.1016\/j.infrared.2023.104670","article-title":"Spatial infrared objects discrimination based on multi-channel CNN with attention mechanism","volume":"132","author":"Zhang","year":"2023","journal-title":"Infrared Phys. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"102147","DOI":"10.1016\/j.inffus.2023.102147","article-title":"CrossFuse: A novel cross attention mechanism based infrared and visible image fusion approach","volume":"103","author":"Li","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_44","first-page":"20210290-1","article-title":"Ground infrared target detection method based on a parallel attention mechanism","volume":"51","author":"Zhao","year":"2022","journal-title":"Infrared Laser Eng."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wang, X., Lu, R., Bi, H., and Li, Y. (2023). An Infrared Small Target Detection Method Based on Attention Mechanism. Sensors, 23.","DOI":"10.3390\/s23208608"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5004813","DOI":"10.1109\/TGRS.2023.3327317","article-title":"IR-TransDet: Infrared dim and small target detection with IR-transformer","volume":"61","author":"Lin","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"10097","DOI":"10.1109\/JSTARS.2024.3389958","article-title":"EGISD-YOLO: Edge Guidance Network for Infrared Ship Target Detection","volume":"17","author":"Zhan","year":"2024","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_48","unstructured":"Wang, K., Gao, X., Zhao, Y., Li, X., Dou, D., and Xu, C.-Z. (2019, January 6\u20139). Pay attention to features, transfer learn faster CNNs. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/21\/3937\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:18:13Z","timestamp":1760113093000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/21\/3937"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,23]]},"references-count":48,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["rs16213937"],"URL":"https:\/\/doi.org\/10.3390\/rs16213937","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,23]]}}}