{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T01:03:22Z","timestamp":1768093402699,"version":"3.49.0"},"reference-count":48,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,7,27]],"date-time":"2023-07-27T00:00:00Z","timestamp":1690416000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62001443"],"award-info":[{"award-number":["62001443"]}]},{"name":"National Natural Science Foundation of China","award":["ZR2020QE294"],"award-info":[{"award-number":["ZR2020QE294"]}]},{"name":"National Natural Science Foundation of China","award":["BK20210064"],"award-info":[{"award-number":["BK20210064"]}]},{"name":"National Natural Science Foundation of China","award":["K20221046"],"award-info":[{"award-number":["K20221046"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["62001443"],"award-info":[{"award-number":["62001443"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["ZR2020QE294"],"award-info":[{"award-number":["ZR2020QE294"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["BK20210064"],"award-info":[{"award-number":["BK20210064"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["K20221046"],"award-info":[{"award-number":["K20221046"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["62001443"],"award-info":[{"award-number":["62001443"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["ZR2020QE294"],"award-info":[{"award-number":["ZR2020QE294"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["BK20210064"],"award-info":[{"award-number":["BK20210064"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["K20221046"],"award-info":[{"award-number":["K20221046"]}]},{"name":"Wuxi Innovation and Entrepreneurship Fund \u201cTaihu Light\u201d Science and Technology (Fundamental Research)","award":["62001443"],"award-info":[{"award-number":["62001443"]}]},{"name":"Wuxi Innovation and Entrepreneurship Fund \u201cTaihu Light\u201d Science and Technology (Fundamental Research)","award":["ZR2020QE294"],"award-info":[{"award-number":["ZR2020QE294"]}]},{"name":"Wuxi Innovation and Entrepreneurship Fund \u201cTaihu Light\u201d Science and Technology (Fundamental Research)","award":["BK20210064"],"award-info":[{"award-number":["BK20210064"]}]},{"name":"Wuxi Innovation and Entrepreneurship Fund \u201cTaihu Light\u201d Science and Technology (Fundamental Research)","award":["K20221046"],"award-info":[{"award-number":["K20221046"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Infrared dim and small target detection is a key technology for various detection tasks. However, due to the lack of shape, texture, and other information, it is a challenging task to detect dim and small targets. Recently, since many traditional algorithms ignore the global information of infrared images, they generate some false alarms in complicated environments. To address this problem, in this paper, a coarse-to-fine deep learning-based method was proposed to detect dim and small targets. Firstly, a coarse-to-fine detection framework integrating deep learning and background prediction was applied for detecting targets. The framework contains a coarse detection module and a fine detection module. In the coarse detection stage, Region Proposal Network (RPN) is employed to generate masks in target candidate regions. Then, to further optimize the result, inpainting is utilized to predict the background using the global semantics of images. In this paper, an inpainting algorithm with a mask-aware dynamic filtering module was incorporated into the fine detection stage to estimate the background of the candidate targets. Finally, compared with existing algorithms, the experimental results indicate that the proposed framework has effective detection capability and robustness for complex surroundings.<\/jats:p>","DOI":"10.3390\/rs15153749","type":"journal-article","created":{"date-parts":[[2023,7,28]],"date-time":"2023-07-28T02:08:00Z","timestamp":1690510080000},"page":"3749","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Infrared Dim and Small Target Detection Based on Background Prediction"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7897-2297","authenticated-orcid":false,"given":"Jiankang","family":"Ma","sequence":"first","affiliation":[{"name":"Underwater Vehicle Laboratory, School of Information Science and Engineering, Ocean University of China, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoran","family":"Guo","sequence":"additional","affiliation":[{"name":"Underwater Vehicle Laboratory, School of Information Science and Engineering, Ocean University of China, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9562-4558","authenticated-orcid":false,"given":"Shenghui","family":"Rong","sequence":"additional","affiliation":[{"name":"Underwater Vehicle Laboratory, School of Information Science and Engineering, Ocean University of China, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8900-2691","authenticated-orcid":false,"given":"Junjie","family":"Feng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Safety and Control for Chemicals, SINOPEC Research Institute of Safety Engineering Co., Ltd., 339 Songling Road, Qingdao 266100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6826-4721","authenticated-orcid":false,"given":"Bo","family":"He","sequence":"additional","affiliation":[{"name":"Underwater Vehicle Laboratory, School of Information Science and Engineering, Ocean University of China, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rawat, S.S., Alghamdi, S., Kumar, G., Alotaibi, Y., Khalaf, O.I., and Verma, L.P. (2022). Infrared small target detection based on partial sum minimization and total variation. Mathematics, 10.","DOI":"10.3390\/math10040671"},{"key":"ref_2","unstructured":"Zhang, W., Cong, M., and Wang, L. (2003, January 14\u201317). Algorithms for optical weak small targets detection and tracking. Proceedings of the International Conference on Neural Networks and Signal Processing, Nanjing, China."},{"key":"ref_3","unstructured":"Jiao, J., and Lingda, W. (2017, January 2\u20134). Infrared dim small target detection method based on background prediction and high-order statistics. Proceedings of the International Conference on Image, Vision and Computing (ICIVC), Chengdu, China."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2634","DOI":"10.1109\/TCSVT.2019.2922036","article-title":"Background Modeling in the Fourier Domain for Maritime Infrared Target Detection","volume":"30","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hu, Z., and Su, Y. (2021, January 23\u201325). An infrared dim and small target image preprocessing algorithm based on improved bilateral filtering. Proceedings of the International Conference on Computer, Blockchain and Financial Development (CBFD), Nanjing, China.","DOI":"10.1109\/CBFD52659.2021.00022"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2013.2242477","article-title":"A Local Contrast Method for Small Infrared Target Detection","volume":"52","author":"Chen","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2168","DOI":"10.1109\/LGRS.2014.2323236","article-title":"A Robust Infrared Small Target Detection Algorithm Based on Human Visual System","volume":"11","author":"Han","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1109\/LGRS.2018.2790909","article-title":"Infrared Small Target Detection Utilizing the Multiscale Relative Local Contrast Measure","volume":"15","author":"Han","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1822","DOI":"10.1109\/LGRS.2019.2954578","article-title":"A Local Contrast Method for Infrared Small-Target Detection Utilizing a Tri-Layer Window","volume":"17","author":"Han","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1109\/LGRS.2020.2976208","article-title":"Local Gradient Field Feature Contrast Measure for Infrared Small Target Detection","volume":"18","author":"Xiong","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, X., Xu, W., Tao, S., Gao, T., Feng, Q., and Piao, Y. (2022). Total Variation Weighted Low-Rank Constraint for Infrared Dim Small Target Detection. Remote Sens., 14.","DOI":"10.3390\/rs14184615"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"10708","DOI":"10.1109\/TGRS.2020.3037938","article-title":"Edge and Corner Awareness-Based Spatial-Temporal Tensor Model for Infrared Small-Target Detection","volume":"59","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4996","DOI":"10.1109\/TIP.2013.2281420","article-title":"Infrared patch-image model for small target detection in a single image","volume":"22","author":"Gao","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3752","DOI":"10.1109\/JSTARS.2017.2700023","article-title":"Reweighted Infrared Patch-Tensor Model With Both Nonlocal and Local Priors for Single-Frame Small Target Detection","volume":"10","author":"Dai","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, L., and Peng, Z. (2019). Infrared Small Target Detection Based on Partial Sum of the Tensor Nuclear Norm. Remote Sens., 11.","DOI":"10.3390\/rs11040382"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9813","DOI":"10.1109\/TGRS.2020.3044958","article-title":"Attentional Local Contrast Networks for Infrared Small Target Detection","volume":"59","author":"Dai","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","first-page":"1","article-title":"Interior Attention-Aware Network for Infrared Small Target Detection","volume":"60","author":"Wang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, G., Wang, W., and Tan, S. (2022). IRSTFormer: A Hierarchical Vision Transformer for Infrared Small Target Detection. Remote Sens., 14.","DOI":"10.3390\/rs14143258"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1109\/TPAMI.2016.2578328","article-title":"Object Instance Segmentation and Fine-Grained Localization Using Hypercolumns","volume":"39","author":"Hariharan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LGRS.2022.3141584","article-title":"RISTDnet: Robust Infrared Small Target Detection Network","volume":"19","author":"Hou","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, H., Wan, Z., Huang, W., Song, Y., Han, X., and Liao, J. (2021, January 20\u201325). PD-GAN: Probabilistic diverse GAN for image inpainting. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00925"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lin, Y., and Xie, H. (2020, January 27\u201329). Face gender recognition based on face recognition feature vectors. Proceedings of the IEEE International Conference on Information Systems and Computer Aided Education (ICISCAE), Dalian, China.","DOI":"10.1109\/ICISCAE51034.2020.9236905"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4016","DOI":"10.1109\/TMM.2021.3111491","article-title":"Deep generative model for image inpainting with local binary pattern learning and spatial attention","volume":"24","author":"Wu","year":"2021","journal-title":"IEEE Trans. Multimed."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4855","DOI":"10.1109\/TIP.2021.3076310","article-title":"Image inpainting by end-to-end cascaded refinement with mask awareness","volume":"30","author":"Zhu","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Deshpande, S.D., Er, M.H., Venkateswarlu, R., and Chan, P. (1999, January 20\u201322). Max-mean and max-median filters for detection of small targets. Proceedings of the Signal and Data Processing of Small Targets, Denver, CO, USA.","DOI":"10.1117\/12.364049"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1016\/j.patcog.2009.12.023","article-title":"Analysis of new top-hat transformation and the application for infrared dim small target detection","volume":"43","author":"Bai","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.patcog.2016.04.002","article-title":"Multiscale patch-based contrast measure for small infrared target detection","volume":"58","author":"Wei","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1109\/LGRS.2020.3004978","article-title":"Infrared Small Target Detection Based on the Weighted Strengthened Local Contrast Measure","volume":"18","author":"Han","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","first-page":"1","article-title":"Robust Infrared Small Target Detection via Multidirectional Derivative-Based Weighted Contrast Measure","volume":"19","author":"Lu","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","first-page":"1","article-title":"Infrared Dim and Small Target Detection Based on Strengthened Robust Local Contrast Measure","volume":"19","author":"Li","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.infrared.2017.12.018","article-title":"Infrared small target detection based on local intensity and gradient properties","volume":"89","author":"Zhang","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.infrared.2019.06.003","article-title":"Small infrared target detection using absolute average difference weighted by cumulative directional derivatives","volume":"101","author":"Aghaziyarati","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, L., Peng, L., Zhang, T., Cao, S., and Peng, Z. (2018). Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2,1 Norm. Remote Sens., 10.","DOI":"10.3390\/rs10111821"},{"key":"ref_34","unstructured":"Wang, H., Zhou, L., and Wang, L. (November, January 27). Miss detection vs. false alarm: Adversarial learning for small object segmentation in infrared images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1109\/TIP.2022.3199107","article-title":"Dense Nested Attention Network for Infrared Small Target Detection","volume":"32","author":"Li","year":"2022","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, T., Li, L., Cao, S., Pu, T., and Peng, Z. (2023). Attention-Guided Pyramid Context Networks for Detecting Infrared Small Target Under Complex Background. IEEE Trans. Aerosp. Electron. Syst., 1\u201313.","DOI":"10.1109\/TAES.2023.3238703"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3979","DOI":"10.1109\/TAES.2022.3159308","article-title":"Local Patch Network with Global Attention for Infrared Small Target Detection","volume":"58","author":"Chen","year":"2022","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1784","DOI":"10.1109\/TIP.2020.3048629","article-title":"Dynamic selection network for image inpainting","volume":"30","author":"Wang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A.A. (2016, January 27\u201330). Context encoders: Feature learning by inpainting. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.278"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., and Li, H. (2017, January 21\u201326). High-resolution image inpainting using multi-scale neural patch synthesis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.434"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Liu, G., Reda, F.A., Shih, K.J., Wang, T.C., Tao, A., and Catanzaro, B. (2018, January 8\u201314). Image inpainting for irregular holes using partial convolutions. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liu, H., Wan, Z., Huang, W., Song, Y., Han, X., Liao, J., Jiang, B., and Liu, W. (2021, January 20\u201325). Deflocnet: Deep image editing via flexible low-level controls. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01062"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1109\/TCSVT.2021.3075039","article-title":"IID-Net: Image inpainting detection network via neural architecture search and attention","volume":"32","author":"Wu","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"48451","DOI":"10.1109\/ACCESS.2020.2979348","article-title":"PiiGAN: Generative adversarial networks for pluralistic image inpainting","volume":"8","author":"Cai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_45","unstructured":"Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., and Garnett, R. (2015). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Dai, Y., Wu, Y., Zhou, F., and Barnard, K. (2021, January 5\u20139). Asymmetric contextual modulation for infrared small target detection. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Virtual.","DOI":"10.1109\/WACV48630.2021.00099"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, M., Zhang, R., Yang, Y., Bai, H., Zhang, J., and Guo, J. (2022, January 18\u201324). ISNet: Shape Matters for Infrared Small Target Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00095"},{"key":"ref_48","first-page":"291","article-title":"A dataset for infrared detection and tracking of dim-small aircraft targets under ground\/air background","volume":"5","author":"Hui","year":"2020","journal-title":"China Sci. Data"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3749\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:21:00Z","timestamp":1760127660000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3749"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,27]]},"references-count":48,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15153749"],"URL":"https:\/\/doi.org\/10.3390\/rs15153749","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,27]]}}}