{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T16:49:10Z","timestamp":1781282950007,"version":"3.54.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T00:00:00Z","timestamp":1623801600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T00:00:00Z","timestamp":1623801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National key research and development program of China","award":["2018AAA0102700"],"award-info":[{"award-number":["2018AAA0102700"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Image Video Proc."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With the increasing application of computer vision technology in autonomous driving, robot, and other mobile devices, more and more attention has been paid to the implementation of target detection and tracking algorithms on embedded platforms. The real-time performance and robustness of algorithms are two hot research topics and challenges in this field. In order to solve the problems of poor real-time tracking performance of embedded systems using convolutional neural networks and low robustness of tracking algorithms for complex scenes, this paper proposes a fast and accurate real-time video detection and tracking algorithm suitable for embedded systems. The algorithm combines the object detection model of single-shot multibox detection in deep convolution networks and the kernel correlation filters tracking algorithm, what is more, it accelerates the single-shot multibox detection model using field-programmable gate arrays, which satisfies the real-time performance of the algorithm on the embedded platform. To solve the problem of model contamination after the kernel correlation filters algorithm fails to track in complex scenes, an improvement in the validity detection mechanism of tracking results is proposed that solves the problem of the traditional kernel correlation filters algorithm not being able to robustly track for a long time. In order to solve the problem that the missed rate of the single-shot multibox detection model is high under the conditions of motion blur or illumination variation, a strategy to reduce missed rate is proposed that effectively reduces the missed detection. The experimental results on the embedded platform show that the algorithm can achieve real-time tracking of the object in the video and can automatically reposition the object to continue tracking after the object tracking fails.<\/jats:p>","DOI":"10.1186\/s13640-021-00561-7","type":"journal-article","created":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T09:03:03Z","timestamp":1623834183000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Real-time embedded object detection and tracking system in Zynq SoC"],"prefix":"10.1186","volume":"2021","author":[{"given":"Qingbo","family":"Ji","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chong","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6421-3481","authenticated-orcid":false,"given":"Changbo","family":"Hou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xun","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,6,16]]},"reference":[{"key":"561_CR1","doi-asserted-by":"publisher","unstructured":"L. Hongmei, H. Lin, Z. Ruiqiang, L. Lei, W. Diangang, L. Jiazhou, in 2020 International Conference on Computer Engineering and Intelligent Control (ICCEIC). Object tracking in video sequence based on Kalman filter, (2020), pp. 106\u2013110. https:\/\/doi.org\/10.1109\/ICCEIC51584.2020.00029.","DOI":"10.1109\/ICCEIC51584.2020.00029"},{"issue":"1","key":"561_CR2","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s00138-018-0981-4","volume":"30","author":"Y. Wang","year":"2019","unstructured":"Y. Wang, W. Shi, S. Wu, Robust UAV-based tracking using hybrid classifiers. Mach. Vis. Appl.30(1), 125\u2013137 (2019). https:\/\/doi.org\/10.1007\/s00138-018-0981-4.","journal-title":"Mach. Vis. Appl."},{"issue":"8","key":"561_CR3","doi-asserted-by":"publisher","first-page":"10773","DOI":"10.1007\/s11042-018-6638-5","volume":"78","author":"R. Iguernaissi","year":"2019","unstructured":"R. Iguernaissi, D. Merad, K. Aziz, P. Drap, People tracking in multi-camera systems: a review. Multimed. Tools Appl.78(8), 10773\u201310793 (2019). https:\/\/doi.org\/10.1007\/s11042-018-6638-5.","journal-title":"Multimed. Tools Appl."},{"issue":"9","key":"561_CR4","doi-asserted-by":"publisher","first-page":"1987","DOI":"10.3390\/s19091987","volume":"19","author":"H. Zhang","year":"2019","unstructured":"H. Zhang, Z. Zhang, L. Zhang, Y. Yang, Q. Kang, D. Sun, Object tracking for a smart city using IoT and edge computing. Sensors. 19(9), 1987 (2019). https:\/\/doi.org\/10.3390\/s19091987.","journal-title":"Sensors"},{"issue":"9","key":"561_CR5","doi-asserted-by":"publisher","first-page":"1834","DOI":"10.1109\/TPAMI.2014.2388226","volume":"37","author":"Y. Wu","year":"2015","unstructured":"Y. Wu, J. Lim, M. -H. Yang, Object tracking benchmark. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1834\u20131848 (2015). https:\/\/doi.org\/10.1109\/TPAMI.2014.2388226.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"561_CR6","first-page":"702","volume-title":"Computer Vision ? ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol. 7575","author":"J. F. Henriques","year":"2012","unstructured":"J. F. Henriques, R. Caseiro, P. Martins, J. Batista, in Computer Vision ? ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol. 7575, ed. by A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid. Exploiting the circulant structure of tracking-by-detection with kernels (SpringerPlatz, 2012), pp. 702\u2013715."},{"issue":"3","key":"561_CR7","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","volume":"37","author":"J. F. Henriques","year":"2015","unstructured":"J. F. Henriques, R. Caseiro, P. Martins, J. Batista, High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell.37(3), 583\u2013596 (2015). https:\/\/doi.org\/10.1109\/TPAMI.2014.2345390.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"10","key":"561_CR8","doi-asserted-by":"publisher","first-page":"2096","DOI":"10.1109\/TPAMI.2015.2509974","volume":"38","author":"S. Hare","year":"2016","unstructured":"S. Hare, S. Golodetz, A. Saffari, V. Vineet, M. -M. Cheng, S. L. Hicks, P. H. S. Torr, Struck: structured output tracking with kernels. IEEE Trans. Pattern Anal. Mach. Intell.38(10), 2096\u20132109 (2016). https:\/\/doi.org\/10.1109\/TPAMI.2015.2509974.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"561_CR9","doi-asserted-by":"publisher","unstructured":"L. Bertinetto, J. Valmadre, S. Golodetz, O. Miksik, P. H. S. Torr, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Staple: complementary learners for real-time tracking (IEEESeattle, p. 2016. https:\/\/doi.org\/10.1109\/CVPR.2016.156.","DOI":"10.1109\/CVPR.2016.156"},{"key":"561_CR10","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1016\/j.asoc.2015.06.048","volume":"77","author":"Y. Chen","year":"2016","unstructured":"Y. Chen, X. Yang, B. Zhong, S. Pan, D. Chen, H. Zhang, CNNTracker: online discriminative object tracking via deep convolutional neural network. Appl. Soft Comput.77:, 1088\u20131098 (2016). https:\/\/doi.org\/10.1016\/j.asoc.2015.06.048.","journal-title":"Appl. Soft Comput."},{"key":"561_CR11","doi-asserted-by":"publisher","first-page":"9872","DOI":"10.1109\/ACCESS.2018.2890127","volume":"6","author":"K. Zhang","year":"2019","unstructured":"K. Zhang, Y. Guo, X. Wang, J. Yuan, Q. Ding, Multiple feature reweight DenseNet for image classification. IEEE Access. 6:, 9872\u20139880 (2019). https:\/\/doi.org\/10.1109\/ACCESS.2018.2890127.","journal-title":"IEEE Access"},{"key":"561_CR12","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1109\/CVPR.2016.98","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"T. Kong","year":"2016","unstructured":"T. Kong, A. Yao, Y. Chen, F. Sun, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). HyperNet: towards accurate region proposal generation and joint object detectionIEEESeattle, 2016), pp. 845\u2013853. https:\/\/doi.org\/10.1109\/CVPR.2016.98."},{"key":"561_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/CVPR.2017.106","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"T. -Y. Lin","year":"2017","unstructured":"T. -Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, S. Belongie, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Feature pyramid networks for object detection (IEEEHonolulu, 2017), pp. 1\u20138. https:\/\/doi.org\/10.1109\/CVPR.2017.106."},{"key":"561_CR14","doi-asserted-by":"publisher","first-page":"5562","DOI":"10.1109\/ICCV.2017.593","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"N. Bodla","year":"2017","unstructured":"N. Bodla, B. Singh, R. Chellappa, L. S. Davis, in Proceedings of the IEEE International Conference on Computer Vision (ICCV). Soft-NMS - improving object detection with one line of code (IEEEVenice, 2017), pp. 5562\u20135570. https:\/\/doi.org\/10.1109\/ICCV.2017.593."},{"key":"561_CR15","doi-asserted-by":"crossref","unstructured":"S. M. Marvasti-Zadeh, L. Cheng, H. Ghanei-Yakhdan, S. Kasaei, Deep learning for visual tracking: a comprehensive survey. IEEE Trans. Intell. Transp. Syst.https:\/\/doi.org\/10.1109\/TITS.2020.3046478.","DOI":"10.1109\/TITS.2020.3046478"},{"issue":"4","key":"561_CR16","doi-asserted-by":"publisher","first-page":"1834","DOI":"10.1109\/TIP.2015.2510583","volume":"25","author":"H. Li","year":"2016","unstructured":"H. Li, Y. Li, F. Porikli, DeepTrack: learning discriminative feature representations online for robust visual tracking. IEEE Trans. Image Process. 25(4), 1834\u20131848 (2016). https:\/\/doi.org\/10.1109\/TIP.2015.2510583.","journal-title":"IEEE Trans. Image Process"},{"key":"561_CR17","doi-asserted-by":"publisher","first-page":"3119","DOI":"10.1109\/ICCV.2015.357","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"L. Wang","year":"2015","unstructured":"L. Wang, W. Ouyang, X. Wang, H. Lu, in Proceedings of the IEEE International Conference on Computer Vision (ICCV). Visual tracking with fully convolutional networks (IEEESantiago, 2015), pp. 3119\u20133127. https:\/\/doi.org\/10.1109\/ICCV.2015.357."},{"key":"561_CR18","doi-asserted-by":"crossref","unstructured":"Y. Gao, Z. Hu, H. W. F. Yeung, Y. Y. Chung, X. Tian, L. Lin, in IEEE Transactions on Circuits and Systems for Video Technology, vol. 30. Unifying temporal context and multi-feature with update-pacing framework for visual tracking, (2020), pp. 1078\u20131091. https:\/\/10.1109\/TCSVT.2019.2902883.","DOI":"10.1109\/TCSVT.2019.2902883"},{"key":"561_CR19","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/978-3-319-46448-0_2","volume-title":"Computer Vision ? ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol. 9905","author":"W. Liu","year":"2016","unstructured":"W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. -Y. Fu, A. C. Berg, in Computer Vision ? ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol. 9905, ed. by B. Leibe, J. Matas, N. Sebe, and M. Welling. SSD: single shot multibox detector (SpringerCham, 2016), pp. 21\u201337. https:\/\/doi.org\/10.1007\/978-3-319-46448-0_2."},{"issue":"9","key":"561_CR20","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1049\/iet-ipr.2017.1043","volume":"12","author":"M. Jiang","year":"2018","unstructured":"M. Jiang, J. Shen, J. Kong, H. Huo, Regularisation learning of correlation filters for robust visual tracking. IET Image Process.12(9), 1586\u20131594 (2018). https:\/\/doi.org\/10.1049\/iet-ipr.2017.1043.","journal-title":"IET Image Process."},{"issue":"2","key":"561_CR21","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1007\/s10618-012-0249-y","volume":"26","author":"Y. Zhen","year":"2013","unstructured":"Y. Zhen, D. -Y. Yeung, Active hashing and its application to image and text retrieval. Data Min. Knowl. Disc.26(2), 255\u2013274 (2013). https:\/\/doi.org\/10.1007\/s10618-012-0249-y.","journal-title":"Data Min. Knowl. Disc."},{"key":"561_CR22","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1016\/j.neucom.2019.03.009","volume":"341","author":"Z. Zhan","year":"2019","unstructured":"Z. Zhan, X. Yang, Y. Li, C. Pang, Video deblurring via motion compensation and adaptive information fusion. Neurocomputing. 341:, 88\u201398 (2019).","journal-title":"Neurocomputing"},{"key":"561_CR23","first-page":"886","volume-title":"2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), vol. 1.","author":"N. Dalal","year":"2005","unstructured":"N. Dalal, B. Triggs, in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), vol. 1.Histograms of oriented gradients for human detection (IEEESan Diego, 2005), pp. 886\u2013893."},{"key":"561_CR24","unstructured":"Xilinx, Zynq UltraScale+ MPSoC ZCU104 Evaluation Kit Quick Start Guide. Available: https:\/\/www.xilinx.com\/support\/documentation\/boards_and_kits\/zcu104\/xtp482-zcu104-quickstart.pdf. Accessed May 2018."},{"key":"561_CR25","unstructured":"Xilinx, SDSoC environment user guide. Available: https:\/\/www.xilinx.com\/support\/documentation\/sw_manuals\/xilinx2019_1\/ug1027-sdsoc-user-guide.pdf. Accessed May 2019."},{"key":"561_CR26","unstructured":"Xilinx, DNNDK user guide. Available: https:\/\/www.xilinx.com\/support\/documentation\/user_guides\/ug1327-dnndk-user-guide.pdf. Accessed Apr 2019."},{"key":"561_CR27","unstructured":"Xilinx, Xilinx AI SDK user guide. Available: https:\/\/www.xilinx.com\/support\/documentation\/user_guides\/ug1354-xilinx-ai-sdk.pdf. Accessed Apr 2019."},{"key":"561_CR28","unstructured":"Xilinx, Xilinx AI SDK programming guide. Available: https:\/\/www.xilinx.com\/support\/documentation\/sw_manuals\/vitis_ai\/1_1\/ug1355-xilinx-ai-sdk-programming-guide.pdf. Accessed Apr 2019."},{"key":"561_CR29","doi-asserted-by":"publisher","unstructured":"M. Everingham, G. L. Van, C. K. I. Williams, J. Winn, A. Zisserman, The Pascal Visual Object Classes (VOC) Challenge. Int. J. Comput. Vis.88(2), 303\u2013338. https:\/\/doi.org\/10.1007\/s11263-009-0275-4.","DOI":"10.1007\/s11263-009-0275-4"},{"issue":"1","key":"561_CR30","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","volume":"111","author":"M. Everingham","year":"2015","unstructured":"M. Everingham, S. M. A. Eslami, G. L. Van, C. K. I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge: a retrospective. Int. J. Comput. Vis.111(1), 98\u2013136 (2015). https:\/\/doi.org\/10.1007\/s11263-014-0733-5.","journal-title":"Int. J. Comput. Vis."},{"key":"561_CR31","doi-asserted-by":"publisher","unstructured":"S. Yang, P. Luo, C. C. Loy, X. Tanal, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). WIDER FACE: a face detection benchmark (IEEESeattle, p. 2016. https:\/\/doi.org\/10.1109\/CVPR.2016.596.","DOI":"10.1109\/CVPR.2016.596"},{"key":"561_CR32","unstructured":"Xilinx, ZCU104 board user. Available: https:\/\/www.xilinx.com\/support\/documentation\/boards_and_kits\/zcu104\/ug1267-zcu104-eval-bd.pdf. Accessed Oct 2018."}],"container-title":["EURASIP Journal on Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-021-00561-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13640-021-00561-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-021-00561-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T09:09:14Z","timestamp":1623834554000},"score":1,"resource":{"primary":{"URL":"https:\/\/jivp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13640-021-00561-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,16]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["561"],"URL":"https:\/\/doi.org\/10.1186\/s13640-021-00561-7","relation":{},"ISSN":["1687-5281"],"issn-type":[{"value":"1687-5281","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,16]]},"assertion":[{"value":"26 June 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"21"}}