{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:24:31Z","timestamp":1760239471064,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T00:00:00Z","timestamp":1605225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The embedded visual tracking system has higher requirements for real-time performance and system resources, and this is a challenge for visual tracking systems with available hardware resources. The major focus of this study is evaluating the results of hardware optimization methods. These optimization techniques provide efficient utilization based on limited hardware resources. This paper also uses a pragmatic approach to investigate the real-time performance effect by implementing and optimizing a kernel correlation filter (KCF) tracking algorithm based on a vision digital signal processor (vision DSP). We examine and analyze the impact factors of the tracking system, which include DP (data parallelism), IP (instruction parallelism), and the characteristics of parallel processing of the DSP core and iDMA (integrated direct memory access). Moreover, we utilize a time-sharing strategy to increase the system runtime speed. These research results are also applicable to other machine vision algorithms. In addition, we introduced a scale filter to overcome the disadvantages of KCF for scale transformation. The experimental results demonstrate that the use of system resources and real-time tracking speed also satisfies the expected requirements, and the tracking algorithm with a scale filter can realize almost the same accuracy as the DSST (discriminative scale space tracking) algorithm under a vision DSP environment.<\/jats:p>","DOI":"10.3390\/s20226494","type":"journal-article","created":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T10:32:47Z","timestamp":1605263567000},"page":"6494","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Study on the Moving Target Tracking Based on Vision DSP"],"prefix":"10.3390","volume":"20","author":[{"given":"Xuan","family":"Gong","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9745-8565","authenticated-orcid":false,"given":"Zichun","family":"Le","sequence":"additional","affiliation":[{"name":"College of Science, Zhejiang University of Technology, Hangzhou 310023, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5837-4492","authenticated-orcid":false,"given":"Hui","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China"}]},{"given":"Yukun","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2012.07.005","article-title":"Intelligent multi-camera video surveillance: A review","volume":"34","author":"Wang","year":"2013","journal-title":"Pattern Recognit. Lett."},{"doi-asserted-by":"crossref","unstructured":"Pfister, T., Charles, J., and Zisserman, A. (2015, January 7\u201313). Flowing convnets for human pose estimation in videos. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","key":"ref_2","DOI":"10.1109\/ICCV.2015.222"},{"doi-asserted-by":"crossref","unstructured":"Chois, W., and Savarese, S. (2012, January 7\u201313). A unified framework for multi-target tracking and collective activity recognition. Proceedings of the 12th European Conference on Computer Vision (ECCV), Florence, Italy.","key":"ref_3","DOI":"10.1007\/978-3-642-33765-9_16"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1109\/TSMCC.2004.829274","article-title":"A survey on visual surveillance of object motion and behaviors","volume":"34","author":"Hu","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"doi-asserted-by":"crossref","unstructured":"Henriques, J.F., Rui, C., and Martins, P. (2012, January 7\u201313). Exploiting the circulant structure of tracking-by-detection with kernels. Proceedings of the European Conference on Computer Vision, Florence, Italy.","key":"ref_5","DOI":"10.1007\/978-3-642-33765-9_50"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","article-title":"High-Speed Tracking with Kernelized Correlation Filters","volume":"37","year":"2015","journal-title":"IEEE TPAMI"},{"doi-asserted-by":"crossref","unstructured":"Danelljan, M. (2014, January 1\u20135). Accurate Scale Estimation for Robust Visual Tracking. Proceedings of the British Machine Vision Conference, Nottingham, UK.","key":"ref_7","DOI":"10.5244\/C.28.65"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1109\/TPAMI.2016.2609928","article-title":"Discriminative Scale Space Tracking","volume":"39","author":"Danelljan","year":"2017","journal-title":"IEEE TPAMI"},{"doi-asserted-by":"crossref","unstructured":"Bolme, D.S., Beveridge, J.R., and Draper, B. (2010, January 13\u201318). Visual object tracking using adaptive correlation filters. Proceedings of the 23rd IEEE CVPR, San Francisco, CA, USA.","key":"ref_9","DOI":"10.1109\/CVPR.2010.5539960"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1109\/TPAMI.2009.167","article-title":"Object Detection with Discriminatively Trained Part-Based Models","volume":"32","author":"Felzenszwalb","year":"2010","journal-title":"IEEE TPAMI"},{"doi-asserted-by":"crossref","unstructured":"Danelijan, M. (2014, January 24\u201327). Adaptive color attributes for real-time visual tracking. Proceedings of the 27th IEEE CVPR, Columbus, OH, USA.","key":"ref_11","DOI":"10.1109\/CVPR.2014.143"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1109\/TCSVT.2018.2816570","article-title":"Reliable Re-detection for Long-term Tracking","volume":"29","author":"Wang","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2289","DOI":"10.1109\/TMM.2018.2803518","article-title":"Real-Time Long-Term Tracking with Prediction-Detection-Correction","volume":"20","author":"Liang","year":"2018","journal-title":"IEEE Trans. Multimed."},{"doi-asserted-by":"crossref","unstructured":"Hao, W. (2011, January 24\u201326). Designing and Development of Multi-DSP real-time image processing system based on FPGA. Proceedings of the 2011 International Conference on Computer Science and Network Technology, Harbin, China.","key":"ref_14","DOI":"10.1109\/ICCSNT.2011.6182189"},{"doi-asserted-by":"crossref","unstructured":"Rao, M.V.G., Kumar, P.R., and Prasad, A.M. (2016, January 23\u201325). Implementation of real time image processing system with FPGA and DSP. Proceedings of the 2016 International Conference on Microelectronics, Computing and Communications (MicroCom), Natl Inst Technol, Dept Elect & Commun Engn, Durgapur, India.","key":"ref_15","DOI":"10.1109\/MicroCom.2016.7522496"},{"doi-asserted-by":"crossref","unstructured":"Wang, Q., and Gao, Z. (2008, January 20\u201322). Study on a Real-Time Image Object Tracking System. Proceedings of the International Symposium on Computer Science and Computational Technology, Shanghai, China.","key":"ref_16","DOI":"10.1109\/ISCSCT.2008.193"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1007\/s11554-014-0413-2","article-title":"FPGA\u2013DSP co-processing for feature tracking in smart video sensors","volume":"11","author":"Tomasi","year":"2016","journal-title":"J. Real-Time Image Process."},{"doi-asserted-by":"crossref","unstructured":"Lei, Y., Wang, R., and Wu, J. (2015, January 4\u201315). Implementation of Small Target Tracking based on C-STC with multi-core DSP. Proceedings of the 5th International Conference on Computer Sciences and Automation Engineering (ICCSAE), Sanya, China.","key":"ref_18","DOI":"10.2991\/iccsae-15.2016.114"},{"doi-asserted-by":"crossref","unstructured":"Li, X.H., Xiang, Q., and Cheng, J.F. (2017, January 11\u201312). Application of Dual DSP Target Tracking System Based on SVM. Proceedings of the 2017 7th International Conference on Manufacturing Science and Engineering (ICMSE), Zhuhai, China.","key":"ref_19","DOI":"10.2991\/icmse-17.2017.28"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1007\/s11760-013-0590-7","article-title":"Algorithm and code optimizations for real-time passive ranging by imaging detection on single DSP","volume":"9","author":"Fu","year":"2015","journal-title":"Signal Image Video Process."},{"unstructured":"Guo, J.C., Chen, M.J., and Wu, X.J. (2011, January 20\u201321). Moving Target Tracking System Based on DSP. Proceedings of the International Conference on Applied Informatics and Communication (ICAIC 2011), Xian, China.","key":"ref_21"},{"key":"ref_22","first-page":"8966","article-title":"Design of airborne target tracking accelerator based on KCF","volume":"23","author":"Yang","year":"2019","journal-title":"J. Eng."},{"doi-asserted-by":"crossref","unstructured":"Conti, G., Quintana, M., Malag\u00f3n, P., and Jim\u00e9nez, D. (2020). An FPGA Based Tracking Implementation for Parkinson\u2019s Patients. Sensors, 20.","key":"ref_23","DOI":"10.3390\/s20113189"},{"key":"ref_24","first-page":"87","article-title":"Embedded Target Tracking System Based on DSP","volume":"28","author":"Shi","year":"2019","journal-title":"Comput. Syst. Appl."},{"key":"ref_25","first-page":"131","article-title":"Regularized least-squares classification","volume":"190","author":"Rifkin","year":"2003","journal-title":"Nato Sci. Ser. Sub Ser. III Comput. Syst. Sci."},{"key":"ref_26","first-page":"36","article-title":"The implementation and improvement of tracking algorithm with kernel correlation filter based on TMS320C6678","volume":"44","author":"Wang","year":"2018","journal-title":"Appl. Electron. Tech."},{"doi-asserted-by":"crossref","unstructured":"Yan, A., Li, J., Sun, B., and Wang, Y. (2020, January 23\u201325). Research on Moving Target Tracking System Based on FPGA. Proceedings of the 2020 Chinese Control and Decision Conference (CCDC), Hefei, China.","key":"ref_27","DOI":"10.1109\/CCDC49329.2020.9164073"},{"doi-asserted-by":"crossref","unstructured":"Yang, L., He, Z., and Fan, D. (2019, January 9\u201311). Binarized depthwise separable neural network for object tracking in fpga. Proceedings of the 2019 on Great Lakes Symposium on VLSI, Tysons Corner, VA, USA.","key":"ref_28","DOI":"10.1145\/3299874.3318034"},{"doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","key":"ref_29","DOI":"10.1109\/ICIP.2016.7533003"},{"doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple online and realtime tracking with a deep association metric. Proceedings of the 24th IEEE International Conference on Image Processing (ICIP), Beijing, China.","key":"ref_30","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1007\/s11263-019-01180-6","article-title":"Multi-target tracking in multiple non-overlapping cameras using fast-constrained dominant sets","volume":"127","author":"Tesfaye","year":"2019","journal-title":"Int. J. Comput. Vision"},{"doi-asserted-by":"crossref","unstructured":"Ristani, E., and Tomasi, C. (2018, January 18\u201322). Features for multi-target multi-camera tracking and re-identification. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","key":"ref_32","DOI":"10.1109\/CVPR.2018.00632"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6494\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:33:15Z","timestamp":1760178795000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6494"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,13]]},"references-count":32,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20226494"],"URL":"https:\/\/doi.org\/10.3390\/s20226494","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,13]]}}}