{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:10:21Z","timestamp":1760227821477,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Xi\u2019an Technological University","award":["302020665"],"award-info":[{"award-number":["302020665"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Recently due to the good balance between performance and tracking speed, the discriminative correlation filter (DCF) has become a popular and excellent tracking method in short-term tracking. Computing the correlation of a response map can be efficiently performed in the Fourier domain by the discrete Fourier transform (DFT) of the input, where the DFT of an image has symmetry in the Fourier domain. However, most of the correlation filter (CF)-based trackers cannot deal with the tracking results and lack the effective mechanism to adjust the tracked errors during the tracking process, thus usually perform poorly in long-term tracking. In this paper, we propose a long-term tracking framework, which includes a tracking-by-detection part and redetection part. The tracking-by-detection part is built on a DCF framework, by integrating with a multifeature fusion model, which can effectively improve the discriminant ability of the correlation filter for some challenging situations, such as occlusion and color change. The redetection part can search the tracked object in a larger region and refine the tracking results after the tracking has failed. Benefited by the proposed redetection strategy, the tracking results are re-evaluated and refined, if it is necessary, in each frame. Moreover, the reliable estimation module in the redetection part can effectively identify whether the tracking results are correct and determine whether the redetector needs to open. The proposed redetection part utilizes a saliency detection algorithm, which is fast and valid for object detection in a limited region. These two parts can be integrated into DCF-based tracking methods to improve the long-term tracking performance and robustness. Extensive experiments on OTB2015 and VOT2016 benchmarks show that our proposed long-term tracking method has a proven effectiveness and high efficiency compared with various tracking methods.<\/jats:p>","DOI":"10.3390\/sym14050911","type":"journal-article","created":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T08:21:25Z","timestamp":1651652485000},"page":"911","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Learning Multifeature Correlation Filter and Saliency Redetection for Long-Term Object Tracking"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5706-7930","authenticated-orcid":false,"given":"Liqiang","family":"Liu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Xi\u2019an Technological University, Xi\u2019an 710021, China"}]},{"given":"Tiantian","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Physics and Optoelectronic Engineering, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Yanfang","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Xi\u2019an Technological University, Xi\u2019an 710021, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1109\/TPAMI.2013.230","article-title":"Visual tracking: An experimental survey","volume":"36","author":"Smeulders","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/1177352.1177355","article-title":"Object tracking: A survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.patcog.2017.11.007","article-title":"Deep visual tracking: Review and experimental comparison","volume":"76","author":"Li","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_4","first-page":"1779","article-title":"Robust Visual Tracking via Convolutional Networks without Training","volume":"25","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jang, J., and Jiang, H. (2021, January 20\u201325). MeanShift++: Extremely Fast Mode-Seeking With Applications to Segmentation and Object Tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00409"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sundararaman, R., De Almeida Braga, C., Marchand, E., and Pettr\u00e9, J. (2021, January 20\u201325). Tracking Pedestrian Heads in Dense Crowd. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00386"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1049\/iet-ipr.2019.0944","article-title":"End-to-end learning interpolation for object tracking in low frame-rate video","volume":"14","author":"Liu","year":"2020","journal-title":"IET Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, F., and Wang, X. (2021). Adaptive Spatial-Temporal Regularization for Correlation Filters Based Visual Object Tracking. Symmetry, 13.","DOI":"10.3390\/sym13091665"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Khan, M.J., Rahman, M., Amin, Y., and Tenhunen, H. (2019). Low-Rank Multi-Channel Features for Robust Visual Object Tracking. Symmetry, 11.","DOI":"10.3390\/sym11091155"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","author":"Henriques","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1007\/s00371-019-01634-5","article-title":"Part-based visual tracking with spatially regularized correlation filters","volume":"36","author":"Zhang","year":"2019","journal-title":"Vis. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gong, L., and Wang, C. (2019). Research on Moving Target Tracking Based on FDRIG Optical Flow. Symmetry, 11.","DOI":"10.3390\/sym11091122"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, T., Wang, G., and Yang, Q. (2015, January 7\u201312). Real-time part-based visual tracking via adaptive correlation filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299124"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, S., Zhang, T., Cao, X., and Xu, C. (2016, January 27\u201330). Structural Correlation Filter for Robust Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.467"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Supancic, J.S., and Ramanan, D. (2013, January 23\u201328). Self-paced learning for long-term tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.308"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lebeda, K., Hadfield, S., Matas, J., and Bowden, R. (2013, January 23\u201328). Long-term tracking through failure cases. Proceedings of the IEEE International Conference on Computer Vision Workshops (CVPRW), Portland, OR, USA.","DOI":"10.1109\/ICCVW.2013.26"},{"key":"ref_17","unstructured":"Lee, H., Choi, S., and Kim, C. (2018, January 8\u201314). A memory model based on the siamese network for long-term tracking. Proceedings of the European Conference on Computer Vision Workshops (ECCVW), Glasgow, UK."},{"key":"ref_18","unstructured":"Zhang, Y., Wang, D., Wang, L., Qi, J., and Lu, H. (2018). Learning regression and verification networks for long-term visual tracking. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H.S. (2016, January 27\u201330). Staple: Complementary Learners for Real-Time Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.156"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1109\/TPAMI.2014.2388226","article-title":"Object Tracking Benchmark","volume":"37","author":"Wu","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"Matej, K., Ales, L., Jiri, M., Michael, F., Roman, P.P., Luka, C., Tomas, V., Gustav, H., Alan, L., and Gustavo, F. (2016, January 8). The visual object tracking VOT2016 challenge results. Proceedings of the European Conference on Computer Vision Workshops (ECCVW), Munich, Germany."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13\u201318). Visual object tracking using adaptive correlation filters. Proceedings of the Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, CVPR, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539960"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Danelljan, M., H\u00e4ger, G., Khan, F.S., and Michael, F. (2014, January 1\u20135). Accurate scale estimation for robust tracking. Proceedings of the 2014 British Machine Vision Conference, Nottingham, UK.","DOI":"10.5244\/C.28.65"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, Y., and Zhu, J. (2014, January 6\u20137). A scale adaptive kernel correlation filter tracker with feature integration. Proceedings of the European Conference on Computer Vision Workshops (ECCVW), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16181-5_18"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Khan, F.S., and Felsberg, M. (2015, January 11\u201318). Learning Spatially Regularized Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.490"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Galoogahi, H.K., Fagg, A., and Lucey, S. (2017, January 22\u201329). Learning Background-Aware Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.129"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Khan, F.S., and Felsberg, M. (2015, January 7\u201313). Convolutional Features for Correlation Filter Based Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.84"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ma, C., Huang, J.B., Yang, X., and Yang, M.H. (2015, January 7\u201312). Hierarchical convolutional features for visual tracking. Proceedings of the IEEE International Conference on Computer Vision (CVPR), Boston, MA, USA.","DOI":"10.1109\/ICCV.2015.352"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Robinson, A., Shahbaz, K.F., and Felsberg, M. (2017, January 21\u201326). ECO: Efficient Convolution Operators for Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.733"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., and Torr, P.H.S. (2017, January 21\u201326). End-to-End Representation Learning for Correlation Filter Based Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.531"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1109\/TPAMI.2011.239","article-title":"Tracking-learning-detection","volume":"34","author":"Kalal","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, M., Liu, Y., and Huang, Z. (2017, January 21\u201326). Large margin object tracking with circulant feature maps. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.510"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ma, S., and Sclaroff, S. (2014, January 6\u201312). Meem: Robust tracking via multiple experts using entropy minimization. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10599-4_13"},{"key":"ref_34","unstructured":"Wei, Z., Lu, H., and Yang, M.H. (2012, January 16\u201321). Robust object tracking via sparsity-based collaborative model. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, T., Bibi, A., and Ghanem, B. (2016, January 27\u201330). In defense of sparse tracking: Circulant sparse tracker. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.421"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., and Tao, D. (2015, January 7\u201312). Multistore tracker (muster): A cognitive psychology inspired approach to object tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298675"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ma, C., Yang, X., Zhang, C.Y., and Yang, M. (2015, January 7\u201312). Long-term correlation tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299177"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Fan, H., and Ling, H. (2017, January 21\u201326). Parallel tracking and verifying: A framework for real-time and high accuracy visual tracking. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/ICCV.2017.585"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"4739","DOI":"10.1109\/TCSVT.2019.2957748","article-title":"Contour-Aware Long-Term Tracking with Reliable Re-Detection","volume":"30","author":"Tang","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1109\/TCSVT.2018.2816570","article-title":"Reliable Re-Detection for Long-Term Tracking","volume":"29","author":"Wang","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, N., Zhou, W., Tian, Q., Hong, R., Wang, M., and Li, H. (2018, January 18\u201323). Multicue correlation filters for robust visual tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00509"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liu, L., Cao, J., and Niu, Y. (2017, January 8\u201311). Visual Saliency Detection Based on Region Contrast and Guided Filter. Proceedings of the 2nd IEEE International Conference on Computational Intelligence and Applications (ICCIA), Beijing, China.","DOI":"10.1109\/CIAPP.2017.8167232"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wu, Y., Lim, J., and Yang, M. (2013, January 23\u201328). Online Object Tracking: A Benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.312"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Khan, F.S., and Felsberg, M. (2016, January 27\u201330). Adaptive Decontamination of the Training Set: A Unified Formulation for Discriminative Visual Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.159"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Mueller, M., Smith, N., and Ghanem, B. (2017, January 21\u201326). Context-aware correlation filter tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.152"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Henriques, J.F., Caseiro, R., Martins, P., and Batista, J. (2012). Exploiting the Circulant Structure of Tracking-by-Detection with Kernels. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-33765-9_50"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Possegger, H., Mauthner, T., and Bischof, H. (2015, January 7\u201312). In Defense of Color-based Model-free Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298823"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2137","DOI":"10.1109\/TPAMI.2016.2516982","article-title":"A Novel Performance Evaluation Methodology for Single-Target Trackers","volume":"38","author":"Matej","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Thakur, N., and Han, C.Y. (2021). An Ambient Intelligence-Based Human Behavior Monitoring Framework for Ubiquitous Environments. Information, 12.","DOI":"10.3390\/info12020081"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/5\/911\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:04:13Z","timestamp":1760137453000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/5\/911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["sym14050911"],"URL":"https:\/\/doi.org\/10.3390\/sym14050911","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2022,4,29]]}}}