{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T01:57:45Z","timestamp":1771034265499,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2019,8,21]],"date-time":"2019-08-21T00:00:00Z","timestamp":1566345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61571096"],"award-info":[{"award-number":["61571096"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61775030"],"award-info":[{"award-number":["61775030"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Key Laboratory Fund of Beam Control, Chinese Academy of Science","award":["2017LBC003"],"award-info":[{"award-number":["2017LBC003"]}]},{"name":"Sichuan Science and Technology Program","award":["2019YJ0167"],"award-info":[{"award-number":["2019YJ0167"]}]},{"name":"Minnan Normal University Teaching Reform","award":["JG201918"],"award-info":[{"award-number":["JG201918"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Thermal infrared (TIR) target tracking is a challenging task as it entails learning an effective model to identify the target in the situation of poor target visibility and clutter background. The sparse representation, as a typical appearance modeling approach, has been successfully exploited in the TIR target tracking. However, the discriminative information of the target and its surrounding background is usually neglected in the sparse coding process. To address this issue, we propose a mask sparse representation (MaskSR) model, which combines sparse coding together with high-level semantic features for TIR target tracking. We first obtain the pixel-wise labeling results of the target and its surrounding background in the last frame, and then use such results to train target-specific deep networks using a supervised manner. According to the output features of the deep networks, the high-level pixel-wise discriminative map of the target area is obtained. We introduce the binarized discriminative map as a mask template to the sparse representation and develop a novel algorithm to collaboratively represent the reliable target part and unreliable target part partitioned with the mask template, which explicitly indicates different discriminant capabilities by label 1 and 0. The proposed MaskSR model controls the superiority of the reliable target part in the reconstruction process via a weighted scheme. We solve this multi-parameter constrained problem by a customized alternating direction method of multipliers (ADMM) method. This model is applied to achieve TIR target tracking in the particle filter framework. To improve the sampling effectiveness and decrease the computation cost at the same time, a discriminative particle selection strategy based on kernelized correlation filter is proposed to replace the previous random sampling for searching useful candidates. Our proposed tracking method was tested on the VOT-TIR2016 benchmark. The experiment results show that the proposed method has a significant superiority compared with various state-of-the-art methods in TIR target tracking.<\/jats:p>","DOI":"10.3390\/rs11171967","type":"journal-article","created":{"date-parts":[[2019,8,21]],"date-time":"2019-08-21T11:19:06Z","timestamp":1566386346000},"page":"1967","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Mask Sparse Representation Based on Semantic Features for Thermal Infrared Target Tracking"],"prefix":"10.3390","volume":"11","author":[{"given":"Meihui","family":"Li","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"},{"name":"The Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"given":"Lingbing","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3290-654X","authenticated-orcid":false,"given":"Yingpin","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Physics and Information, Minnan Normal University, Zhangzhou 363000, China"}]},{"given":"Suqi","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"},{"name":"The Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"given":"Feiyi","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"},{"name":"The Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4148-3331","authenticated-orcid":false,"given":"Zhenming","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"},{"name":"The Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu 610054, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/TSMC.2016.2627052","article-title":"Grayscale-Thermal Object Tracking via Multitask Laplacian Sparse Representation","volume":"47","author":"Li","year":"2017","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, L., Peng, L., Zhang, T., Cao, S., and Peng, Z. (2018). Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2,1 Norm. Remote Sens., 10.","DOI":"10.3390\/rs10111821"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, L., and Peng, Z. (2019). Infrared Small Target Detection Based on Partial Sum of the Tensor Nuclear Norm. Remote Sens., 11.","DOI":"10.3390\/rs11040382"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, T., Wu, H., Liu, Y., Peng, L., Yang, C., and Peng, Z. (2019). Infrared Small Target Detection Based on Non-Convex Optimization with Lp-Norm Constraint. Remote Sens., 11.","DOI":"10.3390\/rs11050559"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.patrec.2017.10.026","article-title":"Dense structural learning for infrared object tracking at 200+ Frames per Second","volume":"100","author":"Yu","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_6","unstructured":"Berg, A., Ahlberg, J., and Felsberg, M. (July, January 26). Channel coded distribution field tracking for thermal infrared imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.knosys.2017.07.032","article-title":"Deep convolutional neural networks for thermal infrared object tracking","volume":"134","author":"Liu","year":"2017","journal-title":"Knowl. Based Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.knosys.2018.12.011","article-title":"Hierarchical spatial-aware Siamese network for thermal infrared object tracking","volume":"166","author":"Li","year":"2019","journal-title":"Knowl. Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.infrared.2017.09.003","article-title":"Infrared dim moving target tracking via sparsity-based discriminative classifier and convolutional network","volume":"86","author":"Qian","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"42790","DOI":"10.1109\/ACCESS.2018.2859595","article-title":"Multiple-Model Fully Convolutional Neural Networks for Single Object Tracking on Thermal Infrared Video","volume":"6","author":"Zulkifley","year":"2018","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1837","DOI":"10.1109\/TIP.2018.2879249","article-title":"Synthetic Data Generation for End-to-End Thermal Infrared Tracking","volume":"28","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"529","DOI":"10.3390\/a8030529","article-title":"A Parallel Search Strategy Based on Sparse Representation for Infrared Target Tracking","volume":"8","author":"Shi","year":"2015","journal-title":"Algorithms"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/LGRS.2015.2506758","article-title":"Infrared Target Tracking Based on Robust Low-Rank Sparse Learning","volume":"13","author":"He","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gao, S.J., and Jhang, S.T. (2016, January 11\u201314). Infrared Target Tracking Using Multi-Feature Joint Sparse Representation. Proceedings of the International Conference on Research in Adaptive and Convergent Systems, Odense, Denmark.","DOI":"10.1145\/2987386.2987392"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.infrared.2017.10.003","article-title":"Infrared small target tracking based on sample constrained particle filtering and sparse representation","volume":"87","author":"Zhang","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_16","unstructured":"Lan, X., Ye, M., Zhang, S., Zhou, H., and Yuen, P.C. (2018). Modality-correlation-aware sparse representation for RGB-infrared object tracking. Pattern Recognit. Lett., in press."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6518","DOI":"10.1364\/AO.53.006518","article-title":"Real-time infrared target tracking based on l1 minimization and compressive features","volume":"53","author":"Li","year":"2014","journal-title":"Appl. Opt."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wan, M., Gu, G., Qian, W., Ren, K., Chen, Q., Zhang, H., and Maldague, X. (2018). Total Variation Regularization Term-Based Low-Rank and Sparse Matrix Representation Model for Infrared Moving Target Tracking. Remote Sens., 10.","DOI":"10.3390\/rs10040510"},{"key":"ref_19","unstructured":"Bao, C., Wu, Y., Ling, H., and Ji, H. (2012, January 16\u201321). Real time robust l1 tracker using accelerated proximal gradient approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_20","unstructured":"Zhang, T., Ghanem, B., Liu, S., and Ahuja, N. (2012, January 16\u201321). Robust visual tracking via multi-task sparse learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_21","unstructured":"Jia, X., Lu, H., and Yang, M. (2012, January 16\u201321). Visual tracking via adaptive structural local sparse appearance model. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4478","DOI":"10.1109\/TIP.2018.2839916","article-title":"Visual Tracking With Weighted Adaptive Local Sparse Appearance Model via Spatio-Temporal Context Learning","volume":"27","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1109\/TPAMI.2018.2797082","article-title":"Robust Structural Sparse Tracking","volume":"41","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ma, C., Huang, J.B., Yang, X., and Yang, M.H. (2015;, January 7\u201313). Hierarchical convolutional features for visual tracking. Proceedings of the IEEE international conference on computer vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.352"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, X., Ma, D., Ouyang, X., Jiang, S., Gan, L., and Agam, G. (2018, January 13\u201319). Layered optical flow estimation using a deep neural network with a soft mask. Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), Morgan Kaufmann, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/163"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, Q., Yuan, D., and He, Z. (2017, January 15\u201317). Thermal infrared object tracking via Siamese convolutional neural networks. Proceedings of the International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), Shenzhen, China.","DOI":"10.1109\/SPAC.2017.8304241"},{"key":"ref_27","unstructured":"Gundogdu, E., Koc, A., Solmaz, B., Hammoud, R.I., and Aydin Alatan, A. (July, January 26). Evaluation of feature channels for correlation-filter-based visual object tracking in infrared spectrum. Proceedings of the IEEE Conference on Computer Vision and Pattern recognition Workshops (CVPRW), Las Vegas, NV, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.infrared.2016.01.008","article-title":"Dim moving target tracking algorithm based on particle discriminative sparse representation","volume":"75","author":"Li","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.infrared.2016.01.021","article-title":"Joint detection and tracking of size-varying infrared targets based on block-wise sparse decomposition","volume":"76","author":"Li","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, C., Zhao, N., Lu, Y., Zhu, C., and Tang, J. (2017, January 23\u201327). Weighted Sparse Representation Regularized Graph Learning for RGB-T Object Tracking. Proceedings of the 25th ACM International Conference on Multimedia, New York, NY, USA.","DOI":"10.1145\/3123266.3123289"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"67761","DOI":"10.1109\/ACCESS.2019.2916895","article-title":"Online Non-negative Multi-modality Feature Template Learning for RGB-assisted Infrared Tracking","volume":"7","author":"Lan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9887","DOI":"10.1109\/TIE.2019.2898618","article-title":"Learning Modality-Consistency Feature Templates: A Robust RGB-Infrared Tracking System","volume":"66","author":"Lan","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5743","DOI":"10.1109\/TIP.2016.2614135","article-title":"Learning Collaborative Sparse Representation for Grayscale-Thermal Tracking","volume":"25","author":"Li","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","unstructured":"Li, Y., Zhu, J., and Hoi, S.C. (2015, January 7\u201312). Real-Time Part-Based Visual Tracking via Adaptive Correlation Filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.ins.2014.12.022","article-title":"Robust infrared target tracking based on particle filter with embedded saliency detection","volume":"301","author":"Wang","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s00521-016-2460-z","article-title":"Hierarchical search strategy in particle filter framework to track infrared target","volume":"29","author":"Shi","year":"2018","journal-title":"Neural Comput. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1109\/TFUZZ.2015.2471811","article-title":"Rough-Set-Theoretic Fuzzy Cues-Based Object Tracking Under Improved Particle Filter Framework","volume":"24","author":"Chiranjeevi","year":"2016","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1109\/TPAMI.2018.2797062","article-title":"Learning Multi-Task Correlation Particle Filters for Visual Tracking","volume":"41","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhu, J., and Hoi, S.C. (2015, January 7\u201312). Reliable patch trackers: Robust visual tracking by exploiting reliable patches. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298632"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Qi, Y., Zhang, S., Qin, L., Yao, H., Huang, Q., Lim, J., and Yang, M.H. (2016, January 27). Hedged deep tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.466"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1109\/TPAMI.2016.2609928","article-title":"Discriminative Scale Space Tracking","volume":"39","author":"Danelljan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Felsberg, M., Kristan, M., Matas, J., Leonardis, A., Pflugfelder, R., H\u00e4ger, G., Berg, A., Eldesokey, A., Ahlberg, J., and \u010cehovin, L. (2016, January 8\u201316). The Thermal Infrared Visual Object Tracking VOT-TIR2016 Challenge Results. Proceedings of the International Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-48881-3_55"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Tang, M., and Feng, J. (2015, January 7\u201313). Multi-kernel correlation filter for visual tracking. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.348"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.knosys.2016.09.014","article-title":"A multi-view model for visual tracking via correlation filters","volume":"113","author":"Li","year":"2016","journal-title":"Knowl. Based Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Possegger, H., Mauthner, T., and Bischof, H. (2015, January 7\u201312). In defense of color-based model-free tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298823"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Montero, A.S., Lang, J., and Laganiere, R. (2015, January 7\u201313). Scalable kernel correlation filter with sparse feature integration. Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.80"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Shahbaz Khan, F., and Felsberg, M. (2015, January 7\u201313). Learning Spatially Regularized Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.490"},{"key":"ref_49","unstructured":"Felsberg, M., Berg, A., Hager, G., Ahlberg, J., Kristan, M., Matas, J., Leonardis, A., Cehovin, L., Fernandez, G., and Voj\u00edr, T. (2015, January 7\u201313). The thermal infrared visual object tracking VOT-TIR2015 challenge results. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Santiago, Chile."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1016\/j.jvcir.2016.04.018","article-title":"Deformable part-based tracking by coupled global and local correlation filters","volume":"38","author":"Akin","year":"2016","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_51","first-page":"1849","article-title":"Deformable parts correlation filters for robust visual tracking","volume":"48","author":"Zajc","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"4182","DOI":"10.1109\/TCYB.2016.2626275","article-title":"Geometric Hypergraph Learning for Visual Tracking","volume":"47","author":"Du","year":"2017","journal-title":"IEEE Trans. Cybern."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/17\/1967\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:12:46Z","timestamp":1760188366000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/17\/1967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,21]]},"references-count":52,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["rs11171967"],"URL":"https:\/\/doi.org\/10.3390\/rs11171967","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,21]]}}}