{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T14:34:06Z","timestamp":1762007646000,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,14]],"date-time":"2018-11-14T00:00:00Z","timestamp":1542153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61771028"],"award-info":[{"award-number":["61771028"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The joint detection and tracking of multiple targets from raw thermal infrared (TIR) image observations plays a significant role in the video surveillance field, and it has extensive applied foreground and practical value. In this paper, a novel multiple-target track-before-detect (TBD) method, which is based on background subtraction within the framework of labeled random finite sets (RFS) is presented. First, a background subtraction method based on a random selection strategy is exploited to obtain the foreground probability map from a TIR sequence. Second, in the foreground probability map, the probability of each pixel belonging to a target is calculated by non-overlapping multi-target likelihood. Finally, a    \u03b4    generalized labeled multi-Bernoulli (   \u03b4   -GLMB) filter is employed to produce the states of multi-target along with their labels. Unlike other RFS-based filters, the proposed approach describes the target state by a pixel set instead of a single point. To meet the requirement of factual application, some extra procedures, including pixel sampling and update, target merging and splitting, and new birth target initialization, are incorporated into the algorithm. The experimental results show that the proposed method performs better in multi-target detection than six compared methods. Also, the method is effective for the continuous tracking of multi-targets.<\/jats:p>","DOI":"10.3390\/s18113944","type":"journal-article","created":{"date-parts":[[2018,11,14]],"date-time":"2018-11-14T10:58:22Z","timestamp":1542193102000},"page":"3944","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Detection and Tracking of Moving Targets for Thermal Infrared Video Sequences"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9347-3020","authenticated-orcid":false,"given":"Chenming","family":"Li","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]},{"given":"Wenguang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s00138-013-0570-5","article-title":"Thermal cameras and applications: A survey","volume":"25","author":"Gade","year":"2014","journal-title":"Mach. Vis. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.infrared.2013.08.014","article-title":"Background subtraction based level sets for human segmentation in thermal infrared surveillance systems","volume":"61","author":"Tan","year":"2013","journal-title":"Infrared Phys. Technol."},{"key":"ref_3","unstructured":"Berg, A., Ahlberg, J., and Felsberg, M. (July, January 26). Channel Coded Distribution Field Tracking for Thermal Infrared Imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1109\/TSP.2012.2222389","article-title":"Visual Tracking in Background Subtracted Image Sequences via Multi-Bernoulli Filtering","volume":"61","author":"Hoseinnezhad","year":"2013","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shaikh, S.H., Saeed, K., and Chaki, N. (2014). Moving Object Detection Using Background Subtraction, Springer International Publishing.","DOI":"10.1007\/978-3-319-07386-6"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4768","DOI":"10.1109\/TIP.2016.2598691","article-title":"Universal Background Subtraction Using Word Consensus Models","volume":"25","author":"Bilodeau","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5239","DOI":"10.1109\/TIP.2016.2605004","article-title":"A Robust Approach for the Background Subtraction Based on Multi-Layered Self-Organizing Maps","volume":"25","author":"Gemignani","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"824","DOI":"10.1049\/iet-its.2014.0236","article-title":"Review of pedestrian detection techniques in automotive far-infrared video","volume":"9","author":"Hurney","year":"2015","journal-title":"Iet Intell. Transp. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1109\/JSTSP.2013.2256415","article-title":"An Efficient Multi-Frame Track-Before-Detect Algorithm for Multi-Target Tracking","volume":"7","author":"Yi","year":"2013","journal-title":"J. Sel. Top. Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2516","DOI":"10.1109\/TAES.2017.2702259","article-title":"Track-Before-Detect Strategies for Radar Detection in G0-distributed Clutter","volume":"53","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_11","unstructured":"Vermaak, J., Maskell, S., Briers, M., and Perez, P. (2008, January 12\u201315). Bayesian visual tracking with existence process. Proceedings of the IEEE International Conference on Image Processing, San Diego, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1016\/j.imavis.2006.07.027","article-title":"A particle filter for joint detection and tracking of color objects","volume":"25","author":"Czyz","year":"2007","journal-title":"Image Vis. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Punithakumar, K., and Kirubarajan, T. (2005, January 24\u201325). A sequential Monte Carlo probability hypothesis density algorithm for multitarget track-before-detect. Proceedings of the SPIE\u2014The International Society for Optical Engineering, Boston, MA, USA.","DOI":"10.1117\/12.618438"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"30839","DOI":"10.3390\/s151229829","article-title":"Labeled RFS-Based Track-Before-Detect for Multiple Maneuvering Targets in the Infrared Focal Plane Array","volume":"15","author":"Li","year":"2015","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1109\/TAES.2003.1261119","article-title":"Multitarget Bayes filtering via first-order multitarget moments","volume":"39","author":"Mahler","year":"2004","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1109\/TAES.2007.4441756","article-title":"PHD filters of higher order in target number","volume":"43","author":"Mahler","year":"2008","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_17","first-page":"409","article-title":"The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations","volume":"2","author":"Vo","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3625","DOI":"10.1016\/j.patcog.2012.04.004","article-title":"Visual tracking of numerous targets via multi-Bernoulli filtering of image data","volume":"45","author":"Hoseinnezhad","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1016\/j.sigpro.2013.08.002","article-title":"Entropy distribution and coverage rate-based birth intensity estimation in GM-PHD filter for multi-target visual tracking","volume":"94","author":"Zhou","year":"2014","journal-title":"Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3460","DOI":"10.1109\/TSP.2013.2259822","article-title":"Labeled Random Finite Sets and Multi-Object Conjugate Priors","volume":"61","author":"Vo","year":"2013","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6554","DOI":"10.1109\/TSP.2014.2364014","article-title":"Labeled Random Finite Sets and the Bayes Multi-Target Tracking Filter","volume":"62","author":"Vo","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Papi, F., Vo, B.T., Bocquel, M., and Vo, B.N. (2013, January 25\u201328). Multi-target Track-Before-Detect using labeled random finite set. Proceedings of the 2013 International Conference on Control, Automation and Information Sciences (ICCAIS), Nha Trang, Vietnam.","DOI":"10.1109\/ICCAIS.2013.6720540"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5487","DOI":"10.1109\/TSP.2015.2454478","article-title":"Generalized Labeled Multi-Bernoulli Approximation of Multi-Object Densities","volume":"63","author":"Papi","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TIP.2010.2101613","article-title":"ViBe: A Universal Background Subtraction Algorithm for Video Sequences","volume":"20","author":"Barnich","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1109\/JPROC.2002.801448","article-title":"Background and foreground modeling using nonparametric kernel density estimation for visual surveillance","volume":"90","author":"Elgammal","year":"2002","journal-title":"Proc. IEEE"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zivkovic, Z. (2004, January 23\u201326). Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the 17th International Conference on Pattern Recogntion, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1333992"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.trit.2016.03.005","article-title":"Background modeling methods in video analysis: A review and comparative evaluation","volume":"1","author":"Xu","year":"2016","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Haritaoglu, I., Harwood, D., and David, L.S. (2000). W4: Real-Time Surveillance of People and Their Activities, IEEE Computer Society.","DOI":"10.1109\/34.868683"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Punchihewa, Y., Papi, F., and Hoseinnezhad, R. (2014, January 2\u20135). Multiple target tracking in video data using labeled random finite set. Proceedings of the International Conference on Control, Automation and Information Sciences, Gwangju, South Korea.","DOI":"10.1109\/ICCAIS.2014.7020543"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3246","DOI":"10.1109\/TSP.2014.2323064","article-title":"The Labeled Multi-Bernoulli Filter","volume":"62","author":"Reuter","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_31","unstructured":"Papi, F., and Gostar, A.K. (2010, January 24\u201328). Bayesian Track-Before-Detect for closely spaced targets. Proceedings of the IEEE 2010 International Conference on Signal Processing Conference, Beijing, China."},{"key":"ref_32","unstructured":"Ester, M., Kriegel, H.P., and Xu, X. (1996, January 2\u20134). A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the International Conference on Knowledge Discovery and Data Mining, Portland, OR, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.cviu.2006.06.010","article-title":"Background-subtraction using contour-based fusion of thermal and visible imagery","volume":"106","author":"Davis","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wu, Z., Fuller, N., Theriault, D., and Betke, M. (2014, January 23\u201328). A thermal infrared video benchmark for visual analysis. Proceedings of the 10th IEEE Workshop on Perception Beyond the Visible Spectrum, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.39"},{"key":"ref_35","unstructured":"Liu, Q., and He, Z. (arXiv, 2018). PTB-TIR: A Thermal Infrared Pedestrian Tracking Benchmark, arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hofmann, M., Tiefenbacher, P., and Rigoll, G. (2012, January 16\u201321). Background segmentation with feedback: The Pixel-Based Adaptive Segmenter. Proceedings of the Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238925"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.infrared.2016.12.021","article-title":"Proposal generation method for object detection in infrared image","volume":"81","author":"Sun","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"A488","DOI":"10.1137\/130934271","article-title":"Orthogonal Rank-One Matrix Pursuit for Low Rank Matrix Completion","volume":"37","author":"Wang","year":"2014","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_39","unstructured":"Yi, X., Park, D., Chen, Y., and Caramanis, C. (2016). Fast Algorithms for Robust PCA via Gradient Descent, Neural Information Processing Systems Foundation Inc."},{"key":"ref_40","unstructured":"Sobral, A. (2013, January 3\u20135). BGSLibrary: An OpenCV C++ Background Subtraction Library. Proceedings of the IX Workshop De Visio Computacional, Rio de Janeiro, Brazil."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3447","DOI":"10.1109\/TSP.2008.920469","article-title":"A consistent metric for performance evaluation of multi-object filters","volume":"56","author":"Schuhmacher","year":"2008","journal-title":"IEEE Trans. Signal Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3944\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:29:43Z","timestamp":1760196583000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3944"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,14]]},"references-count":41,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["s18113944"],"URL":"https:\/\/doi.org\/10.3390\/s18113944","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,11,14]]}}}