{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:08:33Z","timestamp":1760242113258,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,12,26]],"date-time":"2018-12-26T00:00:00Z","timestamp":1545782400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Promotion Program for Young and Middle-aged Teacher in Science and Technology Research of Huaqiao University;National Natural Science Foundation of China;Natural Science Foundation of Fujian Province, China;Quanzhou scientific and technological planning p","award":["Grant ZQN-PY518; Grant 61605048; Grant 2015J01256 and Grant 2016J01300; Grant 2015Z120 and Grant 2017G024; Grant 17014084014"],"award-info":[{"award-number":["Grant ZQN-PY518; Grant 61605048; Grant 2015J01256 and Grant 2016J01300; Grant 2015Z120 and Grant 2017G024; Grant 17014084014"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Discriminative correlation filters (DCFs) have been shown to perform superiorly in visual object tracking. However, visual tracking is still challenging when the target objects undergo complex scenarios such as occlusion, deformation, scale changes and illumination changes. In this paper, we utilize the hierarchical features of convolutional neural networks (CNNs) and learn a spatial-temporal context correlation filter on convolutional layers. Then, the translation is estimated by fusing the response score of the filters on the three convolutional layers. In terms of scale estimation, we learn a discriminative correlation filter to estimate scale from the best confidence results. Furthermore, we proposed a re-detection activation discrimination method to improve the robustness of visual tracking in the case of tracking failure and an adaptive model update method to reduce tracking drift caused by noisy updates. We evaluate the proposed tracker with DCFs and deep features on OTB benchmark datasets. The tracking results demonstrated that the proposed algorithm is superior to several state-of-the-art DCF methods in terms of accuracy and robustness.<\/jats:p>","DOI":"10.3390\/a12010008","type":"journal-article","created":{"date-parts":[[2018,12,26]],"date-time":"2018-12-26T11:31:21Z","timestamp":1545823881000},"page":"8","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Robust Visual Tracking Algorithm Based on Spatial-Temporal Context Hierarchical Response Fusion"],"prefix":"10.3390","volume":"12","author":[{"given":"Wancheng","family":"Zhang","sequence":"first","affiliation":[{"name":"College of Engineering, Huaqiao University, Quanzhou 362021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanmin","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China"},{"name":"The Key Laboratory for Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhi","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Engineering, Huaqiao University, Quanzhou 362021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongzhao","family":"Du","sequence":"additional","affiliation":[{"name":"College of Engineering, Huaqiao University, Quanzhou 362021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daxin","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Mathematics and Computer Science, Quanzhou Normal University, Quanzhou 362021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peizhong","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Engineering, Huaqiao University, Quanzhou 362021, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,12,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1109\/TPAMI.2013.230","article-title":"Visual Tracking: An Experimental Survey","volume":"36","author":"Smeulders","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/1177352.1177355","article-title":"Object tracking: A survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wu, Y., Lim, J., and Yang, M.H. (2013, January 23\u201328). Online Object Tracking: A Benchmark. Proceedings of the IEEE Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.312"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1109\/TPAMI.2014.2388226","article-title":"Object Tracking Benchmark","volume":"37","author":"Wu","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bolme, D.S., Beveridge, J.R., Draper, B.A., and Lui, Y.M. (2010, January 13\u201318). Visual object tracking using adaptive correlation filters. Proceedings of the IEEE Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539960"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","author":"Henriques","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20135). ImageNet classification with deep convolutional neural networks. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_8","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition. In Proceedings of the International Conference on Learning Representation, arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ma, C., Huang, J.B., Yang, X., and Yang, M.H. (2015, January 7\u201313). Hierarchical Convolutional Features for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.352"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zhang, L., Yang, M.H., and Zhang, D. (arXiv, 2013). Fast tracking via spatio-temporal context learning, arXiv.","DOI":"10.1007\/978-3-319-10602-1_9"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ma, C., Yang, X., Zhang, C., and Yang, M.H. (2015, January 7\u201312). Long-term correlation tracking. Proceedings of the IEEE Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299177"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mueller, M., Smith, N., and Ghanem, B. (2017, January 21\u201326). Context-Aware Correlation Filter Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.152"},{"key":"ref_14","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision & Pattern Recognition, San Diego, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zitnick, C.L., and Doll\u00e1r, P. (2014, January 6\u201312). Edge Boxes: Locating Object Proposals from Edges. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_26"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Danelljan, M., H\u00e4ger, G., and Khan, F.S. (2014, January 1\u20135). Accurate scale estimation for robust visual tracking. Proceedings of the British Machine Vision Conference, Nottingham, UK.","DOI":"10.5244\/C.28.65"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bertinetto, L., Valmadre, J., Golodetz, S., Miksik, O., and Torr, P.H. (2016, January 27\u201330). Staple: Complementary Learners for Real-Time Tracking. Proceedings of the IEEE Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.156"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ning, J., Yang, J., Jiang, S., Zhang, L., and Yang, M.H. (2016, January 27\u201330). Object Tracking via Dual Linear Structured SVM and Explicit Feature Map. Proceedings of the IEEE Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.462"},{"key":"ref_19","unstructured":"Rui, C., Martins, P., and Batista, J. (2012, January 7\u201313). Exploiting the circulant structure of tracking-by-detection with kernels. Proceedings of the European Conference on Computer Vision, Florence, Italy."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-3-319-10602-1_9","article-title":"Fast Visual Tracking via Dense Spatio-temporal Context Learning","volume":"Volume 8693","author":"Zhang","year":"2014","journal-title":"ECCV 2014 Computer Vision\u2014ECCV 2014"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Shahbaz Khan, F., and Felsberg, M. (2015, January 7\u201313). Learning Spatially Regularized Correlation Filters for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.490"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, M., Liu, Y., and Huang, Z. (2017, January 21\u201326). Large Margin Object Tracking with Circulant Feature Maps. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.510"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Robinson, A., Khan, F.S., and Felsberg, M. (2016, January 11\u201314). Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46454-1_29"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Bhat, G., Khan, F.S., and Felsberg, M. (2017, January 21\u201326). ECO: Efficient Convolution Operators for Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.733"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"B18","DOI":"10.1364\/AO.49.000B18","article-title":"Spectral fringe-adjusted joint transform correlation","volume":"49","author":"Alam","year":"2010","journal-title":"Appl. Opt."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.1109\/TGRS.2015.2476480","article-title":"Multiclass Object Detection with Single Query in Hyperspectral Imagery Using Class-Associative Spectral Fringe-Adjusted Joint Transform Correlation","volume":"54","author":"Sidike","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","unstructured":"Krieger, E., Aspiras, T., Asari, V.K., Krucki, K., Wauligman, B., Diskin, Y., and Salva, K. (2018). Vehicle tracking in full motion video using the progressively expanded neural network (PENNet) tracker. Proc. SPIE, 10649."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.optlastec.2017.04.011","article-title":"Deterministic object tracking using Gaussian ringlet and directional edge features","volume":"95","author":"Krieger","year":"2017","journal-title":"Opt. Laser Technol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, M., Wang, Q., Xing, J., Gao, J., Peng, P., Hu, W., and Maybank, S. (2018, January 8\u201314). Visual Tracking via Spatially Aligned Correlation Filters Network. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_29"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R.W.H., and Yang, M.H. (2018, January 18\u201323). VITAL: VIsual Tracking via Adversarial Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00937"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Shahbaz Khan, F., and Felsberg, M. (2015, January 7\u201313). Convolutional Features for Correlation Filter Based Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision Workshop, Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.84"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1109\/TNN.2010.2066286","article-title":"Human tracking using convolutional neural networks","volume":"21","author":"Fan","year":"2010","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1109\/TIP.2015.2510583","article-title":"DeepTrack: Learning Discriminative Feature Representations by Convolutional Neural Networks for Visual Tracking","volume":"25","author":"Li","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","first-page":"1779","article-title":"Robust Visual Tracking via Convolutional Networks Without Training","volume":"25","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R.W., and Yang, M.H. (2017, January 21\u201326). CREST: Convolutional Residual Learning for Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision, Honolulu, HI, USA.","DOI":"10.1109\/ICCV.2017.279"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Huang, G., Zou, W., Du, D., and Huang, C. (2017, January 22\u201329). UCT: Learning Unified Convolutional Networks for Real-Time Visual Tracking. Proceedings of the IEEE International Conference on Computer Vision Workshop, Venice, Italy.","DOI":"10.1109\/ICCVW.2017.231"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yao, Y., Wu, X., Zhang, L., Shan, S., and Zuo, W. (arXiv, 2018). Joint Representation and Truncated Inference Learning for Correlation Filter based Tracking, arXiv.","DOI":"10.1007\/978-3-030-01240-3_34"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, T., Xu, C., and Yang, M.H. (2017, January 21\u201326). Multi-task Correlation Particle Filter for Robust Object Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.512"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/TIP.2015.2403231","article-title":"Video tracking using learned hierarchical features","volume":"24","author":"Wang","year":"2015","journal-title":"IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hariharan, B., Arbel\u00e1ez, P., Girshick, R., and Malik, J. (2015, January 7\u201312). Hypercolumns for object segmentation and fine-grained localization. Proceedings of the IEEE Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Valmadre, J., Bertinetto, L., Henriques, J., Vedaldi, A., and Torr, P.H.S. (2017, January 21\u201326). End-to-End Representation Learning for Correlation Filter Based Tracking. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.531"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hua, G., and J\u00e9gou, H. (2016). Fully-Convolutional Siamese Networks for Object Tracking. Computer Vision\u2014ECCV 2016 Workshops. ECCV 2016, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-48881-3"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Bibi, A., Mueller, M., and Ghanem, B. (2016). Target Response Adaptation for Correlation Filter Tracking. Computer Vision\u2014ECCV 2016, Springer.","DOI":"10.1007\/978-3-319-46466-4_25"},{"key":"ref_44","unstructured":"Hong, S., You, T., Kwak, S., and Han, B. (2015, January 6\u201311). Online tracking by learning discriminative saliency map with convolutional neural network. Proceedings of the International Conference on International Conference on Machine Learning, Lille, France."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/1\/8\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:36:13Z","timestamp":1760196973000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/1\/8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12,26]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["a12010008"],"URL":"https:\/\/doi.org\/10.3390\/a12010008","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2018,12,26]]}}}