{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T15:03:11Z","timestamp":1780066991844,"version":"3.54.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Ministry of Research and Technology\/National Research and Innovation Agency (Penelitian Disertasi Doktor) and the School of Electrical Engineering and Informatics Institut Teknologi Bandung"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Real-time object tracking and occlusion handling are critical research areas in computer vision and machine learning. Developing an efficient and accurate object-tracking method that can operate in real-time while handling occlusion is essential for various applications, including surveillance, autonomous driving, and robotics. However, relying solely on a single hand-crafted feature results in less robust tracking. As a hand-crafted feature extraction technique, HOG effectively detects edges and contours, which is essential in localizing objects in images. However, it does not capture fine details in object appearance and is sensitive to changes in lighting conditions. On the other hand, the grayscale feature has computational efficiency and robustness to changes in lighting conditions. The deep feature can extract features that express the image in more detail and discriminate between different objects. By fusing different features, the tracking method can overcome the limitations of individual features and capture a complete representation of the object. The deep features can be generated with transfer learning networks. However, selecting the right network is difficult, even in real-time applications. This study integrated the deep feature architecture and hand-crafted features HOG and grayscale in the KCF method to solve this problem. The object images were obtained through at least three convolution blocks of transfer learning architecture, such as Xception, DenseNet, VGG16, and MobileNet. Once the deep feature was extracted, the HOG and grayscale features were computed and combined into a single stack. In the KCF method, the stacked features acquired the actual object location by conveying a maximum response. The result shows that this proposed method, especially in the combination of Xception, grayscale, and HOG features, can be implemented in real-time applications with a small center location error.<\/jats:p>","DOI":"10.1186\/s40537-023-00813-5","type":"journal-article","created":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T16:03:22Z","timestamp":1693584202000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Deep features fusion for KCF-based moving object tracking"],"prefix":"10.1186","volume":"10","author":[{"given":"Devira Anggi","family":"Maharani","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carmadi","family":"Machbub","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lenni","family":"Yulianti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pranoto Hidaya","family":"Rusmin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,1]]},"reference":[{"key":"813_CR1","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1109\/JAS.2020.1003530","volume":"8","author":"Y Liu","year":"2021","unstructured":"Liu Y, Meng Z, Zou Y, Cao M. Visual object tracking and servoing control of a nano-scale quadrotor: system, algorithms, and experiments. IEEE\/CAA J Autom Sin. 2021;8:344\u201360.","journal-title":"IEEE\/CAA J Autom Sin"},{"key":"813_CR2","doi-asserted-by":"publisher","first-page":"3783","DOI":"10.1109\/TVT.2020.2973656","volume":"69","author":"S Cui","year":"2020","unstructured":"Cui S, Wang Y, Wang S, Wang R, Wang W, Tan M. Real-time perception and positioning for creature picking of an underwater vehicle. IEEE Trans Veh Technol. 2020;69:3783\u201392.","journal-title":"IEEE Trans Veh Technol"},{"key":"813_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-020-00296-8","volume":"7","author":"B Padmaja","year":"2020","unstructured":"Padmaja B, Myneni MB, Krishna Rao Patro E. A comparison on visual prediction models for MAMO (multi activity-multi object) recognition using deep learning. J Big Data. 2020;7:1\u201315.","journal-title":"J Big Data"},{"key":"813_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-019-0212-5","volume":"6","author":"G Sreenu","year":"2019","unstructured":"Sreenu G, Saleem Durai MA. Intelligent video surveillance: a review through deep learning techniques for crowd analysis. J Big Data. 2019;6:1\u201327.","journal-title":"J Big Data"},{"key":"813_CR5","doi-asserted-by":"crossref","unstructured":"Bolme DS, Beveridge JR, Draper BA, Lui YM. Visual object tracking using adaptive correlation filters. In: 2010 IEEE computer society conference on computer vision and pattern recognition. 2010. p. 2544\u201350.","DOI":"10.1109\/CVPR.2010.5539960"},{"key":"813_CR6","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s13640-022-00582-w","volume":"2022","author":"J Zhang","year":"2022","unstructured":"Zhang J, Liu H, He Y, Kuang LD, Chen X. Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking. EURASIP J Image Video Process. 2022;2022:4.","journal-title":"EURASIP J Image Video Process"},{"key":"813_CR7","doi-asserted-by":"publisher","first-page":"345","DOI":"10.3390\/electronics11030345","volume":"11","author":"B Khan","year":"2022","unstructured":"Khan B, Jalil A, Ali A, Alkhaledi K, Mehmood K, Cheema KM, et al. Multiple cues-based robust visual object tracking method. Electronics. 2022;11:345.","journal-title":"Electronics"},{"key":"813_CR8","doi-asserted-by":"publisher","first-page":"73544","DOI":"10.1109\/ACCESS.2021.3080308","volume":"9","author":"F Zhao","year":"2021","unstructured":"Zhao F, Hui K, Wang T, Zhang Z, Chen Y. A KCF-based incremental target tracking method with constant update speed. IEEE Access. 2021;9:73544\u201360.","journal-title":"IEEE Access"},{"key":"813_CR9","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","volume":"37","author":"JF Henriques","year":"2014","unstructured":"Henriques JF, Caseiro R, Martins P, Batista J. High-speed tracking with kernelized correlation filters. IEEE Trans Pattern Anal Mach Intell. 2014;37:583\u201396.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"813_CR10","first-page":"1","volume":"2021","author":"Y Chen","year":"2021","unstructured":"Chen Y, Sheng R. Single-object tracking algorithm based on two-step spatiotemporal deep feature fusion in a complex surveillance scenario. Math Probl Eng. 2021;2021:1\u201311.","journal-title":"Math Probl Eng"},{"key":"813_CR11","doi-asserted-by":"crossref","unstructured":"Maharani DA, Machbub C, Rusmin PH, Yulianti L. Feature fusion with deep neural network in kernelized correlation filters tracker. In: 2021 IEEE 11th international conference on system engineering and technology (ICSET). 2021. p. 363\u20137.","DOI":"10.1109\/ICSET53708.2021.9612567"},{"key":"813_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2022.e12716","volume":"9","author":"F Kinasih","year":"2023","unstructured":"Kinasih F, Machbub C, Yulianti L, Rohman AS. Two-stage multiple object detection using CNN and correlative filter for accuracy improvement. Heliyon. 2023;9: e12716.","journal-title":"Heliyon"},{"key":"813_CR13","doi-asserted-by":"publisher","first-page":"36948","DOI":"10.1109\/ACCESS.2020.2975224","volume":"8","author":"M Ding","year":"2020","unstructured":"Ding M, Chen WH, Wei L, Cao YF, Zhang ZY. Visual tracking with online assessment and improved sampling strategy. IEEE Access. 2020;8:36948\u201362.","journal-title":"IEEE Access"},{"key":"813_CR14","doi-asserted-by":"crossref","unstructured":"Harris C, Stephens M. A combined corner and edge detector. In: Alvey vision conference. 1988. p. 10\u20135244.","DOI":"10.5244\/C.2.23"},{"key":"813_CR15","doi-asserted-by":"crossref","unstructured":"Lowe DG. Object recognition from local scale-invariant features. In: Proceedings of the seventh IEEE international conference on computer vision. 1999. p. 1150\u20137.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"813_CR16","doi-asserted-by":"crossref","unstructured":"Bertinetto L, Valmadre J, Henriques JF, Vedaldi A, Torr PHS. Fully-convolutional siamese networks for object tracking. In: Computer vision\u2013ECCV 2016 workshops: Amsterdam, the Netherlands, October 8\u201310 and 15\u201316, 2016, proceedings, Part II 14. 2016. p. 850\u201365.","DOI":"10.1007\/978-3-319-48881-3_56"},{"key":"813_CR17","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1109\/34.1000236","volume":"24","author":"D Comaniciu","year":"2002","unstructured":"Comaniciu D, Meer P. Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell. 2002;24:603\u201319.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"813_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-022-00682-4","volume":"10","author":"ER AlBasiouny","year":"2023","unstructured":"AlBasiouny ER, Attia AF, Abdelmunim HE, Abbas HM. Robust visual tracking using very deep generative model. J Big Data. 2023;10:1\u201326.","journal-title":"J Big Data"},{"key":"813_CR19","doi-asserted-by":"publisher","first-page":"68638","DOI":"10.1109\/ACCESS.2020.2986498","volume":"8","author":"Y Xie","year":"2020","unstructured":"Xie Y, Shen J, Wu C. Affine geometrical region CNN for object tracking. IEEE Access. 2020;8:68638\u201348.","journal-title":"IEEE Access"},{"key":"813_CR20","doi-asserted-by":"publisher","first-page":"76416","DOI":"10.1109\/ACCESS.2019.2922494","volume":"7","author":"C Li","year":"2019","unstructured":"Li C, Yang B. Adaptive weighted CNN features integration for correlation filter tracking. IEEE Access. 2019;7:76416\u201327.","journal-title":"IEEE Access"},{"key":"813_CR21","doi-asserted-by":"publisher","first-page":"69575","DOI":"10.1109\/ACCESS.2019.2919332","volume":"7","author":"A Rohan","year":"2019","unstructured":"Rohan A, Rabah M, Kim SH. Convolutional neural network-based real-time object detection and tracking for parrot AR drone 2. IEEE Access. 2019;7:69575\u201384.","journal-title":"IEEE Access"},{"key":"813_CR22","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1109\/TCSVT.2015.2406231","volume":"26","author":"J Ding","year":"2015","unstructured":"Ding J, Huang Y, Liu W, Huang K. Severely blurred object tracking by learning deep image representations. IEEE Trans Circuits Syst Video Technol. 2015;26:319\u201331.","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"813_CR23","doi-asserted-by":"crossref","unstructured":"Ma C, Huang J Bin, Yang X, Yang MH. Hierarchical convolutional features for visual tracking. In: Proceedings of the IEEE international conference on computer vision. 2015. p. 3074\u201382.","DOI":"10.1109\/ICCV.2015.352"},{"key":"813_CR24","doi-asserted-by":"crossref","unstructured":"Nam H, Han B. Learning multi-domain convolutional neural networks for visual tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. p. 4293\u2013302.","DOI":"10.1109\/CVPR.2016.465"},{"key":"813_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2023.103776","volume":"91","author":"Y Chen","year":"2023","unstructured":"Chen Y, Xia R, Zou K, Yang K. FFTI: image inpainting algorithm via features fusion and two-steps inpainting. J Vis Commun Image Represent. 2023;91: 103776.","journal-title":"J Vis Commun Image Represent"},{"key":"813_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13042-023-01811-y","volume":"14","author":"Y Chen","year":"2023","unstructured":"Chen Y, Xia R, Zou K, Yang K. RNON: image inpainting via repair network and optimization network. Int J Mach Learn Cybern. 2023;14:1\u201317.","journal-title":"Int J Mach Learn Cybern"},{"key":"813_CR27","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-023-02795-0","author":"Y Chen","year":"2023","unstructured":"Chen Y, Xia R, Yang K, Zou K. MFFN: image super-resolution via multi-level features fusion network. Vis Comput. 2023. https:\/\/doi.org\/10.1007\/s00371-023-02795-0.","journal-title":"Vis Comput"},{"key":"813_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-023-15313-0","author":"Y Chen","year":"2023","unstructured":"Chen Y, Xia R, Yang K, Zou K. DGCA: high resolution image inpainting via DR-GAN and contextual attention. Multimed Tools Appl. 2023. https:\/\/doi.org\/10.1007\/s11042-023-15313-0.","journal-title":"Multimed Tools Appl"},{"key":"813_CR29","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1109\/TII.2021.3098317","volume":"18","author":"J Zhang","year":"2021","unstructured":"Zhang J, Bhuiyan MZA, Yang X, Singh AK, Hsu DF, Luo E. Trustworthy target tracking with collaborative deep reinforcement learning in EdgeAI-aided IoT. IEEE Trans Ind Inform. 2021;18:1301\u20139.","journal-title":"IEEE Trans Ind Inform"},{"key":"813_CR30","doi-asserted-by":"publisher","DOI":"10.1080\/09540091.2023.2182487","author":"H Li","year":"2023","unstructured":"Li H, Wang D, Zhang J, Li Z, Ma T. Image super-resolution reconstruction based on multi-scale dual-attention. Connect Sci. 2023. https:\/\/doi.org\/10.1080\/09540091.2023.2182487.","journal-title":"Connect Sci"},{"key":"813_CR31","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2015. p. 1\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"813_CR32","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the Inception Architecture for Computer Vision. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2016;2818\u201326.","DOI":"10.1109\/CVPR.2016.308"},{"key":"813_CR33","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.3390\/rs10071119","volume":"10","author":"M Mahdianpari","year":"2018","unstructured":"Mahdianpari M, Salehi B, Rezaee M, Mohammadimanesh F, Zhang Y. Very deep convolutional neural networks for complex land cover mapping using multispectral remote sensing imagery. Remote Sens. 2018;10:1119.","journal-title":"Remote Sens"},{"key":"813_CR34","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. p. 4700\u20138.","DOI":"10.1109\/CVPR.2017.243"},{"key":"813_CR35","unstructured":"Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, et al. MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv Preprint. 2017. https:\/\/arxiv.org\/abs\/170404861."},{"key":"813_CR36","unstructured":"Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv Prepr. 2014. https:\/\/arxiv.org\/abs\/14091556."},{"key":"813_CR37","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017;60:84\u201390.","journal-title":"Commun ACM"},{"key":"813_CR38","doi-asserted-by":"publisher","DOI":"10.1155\/2017\/1605959","author":"T Zhou","year":"2017","unstructured":"Zhou T, Zhu M, Zeng D, Yang H. Scale adaptive kernelized correlation filter tracker with feature fusion. Math Probl Eng. 2017. https:\/\/doi.org\/10.1155\/2017\/1605959.","journal-title":"Math Probl Eng"},{"key":"813_CR39","doi-asserted-by":"publisher","first-page":"172988141877658","DOI":"10.1177\/1729881418776582","volume":"15","author":"F Yue","year":"2018","unstructured":"Yue F, Li X. Improved kernelized correlation filter algorithm and application in the optoelectronic tracking system. Int J Adv Robot Syst. 2018;15:1729881418776582.","journal-title":"Int J Adv Robot Syst"},{"key":"813_CR40","doi-asserted-by":"publisher","first-page":"2154","DOI":"10.3390\/app8112154","volume":"8","author":"X Wang","year":"2018","unstructured":"Wang X, Wang G, Zhao Z, Zhang Y, Duan B. An improved kernelized correlation filter algorithm for underwater target tracking. Appl Sci. 2018;8:2154.","journal-title":"Appl Sci"},{"key":"813_CR41","doi-asserted-by":"crossref","unstructured":"Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), vol. 1. 2005. p. 886\u201393.","DOI":"10.1109\/CVPR.2005.177"},{"key":"813_CR42","unstructured":"Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv Preprint. 2016. https:\/\/arxiv.org\/abs\/160304467."},{"key":"813_CR43","doi-asserted-by":"crossref","unstructured":"Wu Y, Lim J, Yang MH. Online object tracking: a benchmark. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2013. p. 2411\u20138.","DOI":"10.1109\/CVPR.2013.312"},{"key":"813_CR44","doi-asserted-by":"publisher","first-page":"2405","DOI":"10.1109\/JSEN.2019.2954331","volume":"20","author":"PG Bhat","year":"2019","unstructured":"Bhat PG, Subudhi BN, Veerakumar T, Laxmi V, Gaur MS. Multi-feature fusion in particle filter framework for visual tracking. IEEE Sens J IEEE. 2019;20:2405\u201315.","journal-title":"IEEE Sens J IEEE"},{"key":"813_CR45","first-page":"6008","volume":"34","author":"R Xia","year":"2022","unstructured":"Xia R, Chen Y, Ren B. Improved anti-occlusion object tracking algorithm using unscented Rauch-Tung-Striebel smoother and kernel correlation filter. J King Saud Univ Comput Inf Sci. 2022;34:6008\u201318.","journal-title":"J King Saud Univ Comput Inf Sci"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00813-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00813-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00813-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,27]],"date-time":"2024-10-27T10:12:38Z","timestamp":1730023958000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00813-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,1]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["813"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00813-5","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,1]]},"assertion":[{"value":"27 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The author reports no potential competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"136"}}