{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T07:53:30Z","timestamp":1776326010435,"version":"3.50.1"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2021,1,19]],"date-time":"2021-01-19T00:00:00Z","timestamp":1611014400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,19]],"date-time":"2021-01-19T00:00:00Z","timestamp":1611014400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Robust and high-performance visual multi-object tracking is a big challenge in computer vision, especially in a drone scenario. In this paper, an online Multi-Object Tracking (MOT) approach in the UAV system is proposed to handle small target detections and class imbalance challenges, which integrates the merits of deep high-resolution representation network and data association method in a unified framework. Specifically, while applying tracking-by-detection architecture to our tracking framework, a Hierarchical Deep High-resolution network (HDHNet) is proposed, which encourages the model to handle different types and scales of targets, and extract more effective and comprehensive features during online learning. After that, the extracted features are fed into different prediction networks for interesting targets recognition. Besides, an adjustable fusion loss function is proposed by combining focal loss and GIoU loss to solve the problems of class imbalance and hard samples. During the tracking process, these detection results are applied to an improved DeepSORT MOT algorithm in each frame, which is available to make full use of the target appearance features to match one by one on a practical basis. The experimental results on the VisDrone2019 MOT benchmark show that the proposed UAV MOT system achieves the highest accuracy and the best robustness compared with state-of-the-art methods.<\/jats:p>","DOI":"10.1007\/s11042-020-10427-1","type":"journal-article","created":{"date-parts":[[2021,1,19]],"date-time":"2021-01-19T16:02:53Z","timestamp":1611072173000},"page":"13911-13929","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Multiple objects tracking in the UAV system based on hierarchical deep high-resolution network"],"prefix":"10.1007","volume":"80","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5586-4170","authenticated-orcid":false,"given":"Wei","family":"Huang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoshu","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingchao","family":"Dong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huaiyu","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,1,19]]},"reference":[{"key":"10427_CR1","doi-asserted-by":"crossref","unstructured":"Bernardin K, Stiefelhagen R (2008) Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP Journal on Image and Video Processing, 2008, 1\u201310","DOI":"10.1155\/2008\/246309"},{"key":"10427_CR2","doi-asserted-by":"crossref","unstructured":"Bertinetto L, Valmadre J, Henriques JF, Vedaldi A, Torr PH (2016) Fully-convolutional siamese networks for object tracking. In European conference on computer vision (pp. 850\u2013865). Springer, Cham","DOI":"10.1007\/978-3-319-48881-3_56"},{"key":"10427_CR3","doi-asserted-by":"crossref","unstructured":"Bewley A, Ge Z, Ott L, Ramos F, Upcroft B (2016) Simple online and realtime tracking. In 2016 IEEE International Conference on Image Processing (ICIP) (pp. 3464\u20133468). IEEE","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"10427_CR4","doi-asserted-by":"crossref","unstructured":"Bochinski E, Eiselein V, Sikora T (2017) High-speed tracking-by-detection without using image information. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1\u20136). IEEE","DOI":"10.1109\/AVSS.2017.8078516"},{"key":"10427_CR5","doi-asserted-by":"crossref","unstructured":"Cai Z, Vasconcelos N (2018) Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6154\u20136162)","DOI":"10.1109\/CVPR.2018.00644"},{"key":"10427_CR6","doi-asserted-by":"crossref","unstructured":"Chen B, Wang D, Li P, Wang S, Lu H (2018) Real-time'Actor-Critic'Tracking. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 318\u2013334)","DOI":"10.1007\/978-3-030-01234-2_20"},{"key":"10427_CR7","doi-asserted-by":"crossref","unstructured":"Chen K, Pang J, Wang J, Xiong Y, Li X, Sun S ... Loy CC (2019) Hybrid task cascade for instance segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4974\u20134983)","DOI":"10.1109\/CVPR.2019.00511"},{"key":"10427_CR8","unstructured":"Chen K, Wang J, Pang J, Cao Y, Xiong Y, Li X, ... Zhang Z (2019) MMDetection: Open mmlab detection toolbox and benchmark. arXiv preprint arXiv:1906.07155"},{"key":"10427_CR9","doi-asserted-by":"crossref","unstructured":"Chen Y, Wang J, Liu S, Chen X, Xiong J, Xie J, Yang K (2019) Multiscale fast correlation filtering tracking algorithm based on a feature fusion model. Concurrency and Computation: Practice and Experience, e5533","DOI":"10.1002\/cpe.5533"},{"issue":"12","key":"10427_CR10","doi-asserted-by":"publisher","first-page":"4855","DOI":"10.1007\/s12652-018-01171-4","volume":"10","author":"Y Chen","year":"2019","unstructured":"Chen Y, Wang J, Xia R, Zhang Q, Cao Z, Yang K (2019) The visual object tracking algorithm research based on adaptive combination kernel. J Ambient Intell Humanized Comput 10(12):4855\u20134867","journal-title":"J Ambient Intell Humanized Comput"},{"issue":"11","key":"10427_CR11","doi-asserted-by":"publisher","first-page":"2316","DOI":"10.3390\/app9112316","volume":"9","author":"Y Chen","year":"2019","unstructured":"Chen Y, Wang J, Chen X, Sangaiah AK, Yang K, Cao Z (2019) Image super-resolution algorithm based on dual-channel convolutional neural networks. Appl Sci 9(11):2316","journal-title":"Appl Sci"},{"key":"10427_CR12","doi-asserted-by":"crossref","unstructured":"Chen Y, Tao J, Zhang Q, Yang K, Chen X, Xiong J, ... Xie J (2020) Saliency Detection via the Improved Hierarchical Principal Component Analysis Method. Wireless Communications and Mobile Computing, 2020","DOI":"10.1155\/2020\/8822777"},{"key":"10427_CR13","doi-asserted-by":"crossref","unstructured":"Chu Q, Ouyang W, Li H, Wang X, Liu B, Yu N (2017) Online multi-object tracking using CNN-based single object tracker with spatial-temporal attention mechanism. In Proceedings of the IEEE International Conference on Computer Vision (pp. 4836\u20134845)","DOI":"10.1109\/ICCV.2017.518"},{"key":"10427_CR14","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.neucom.2019.11.023","volume":"381","author":"G Ciaparrone","year":"2020","unstructured":"Ciaparrone G, S\u00e1nchez FL, Tabik S, Troiano L, Tagliaferri R, Herrera F (2020) Deep learning in video multi-object tracking: A survey. Neurocomputing 381:61\u201388","journal-title":"Neurocomputing"},{"issue":"7","key":"10427_CR15","doi-asserted-by":"publisher","first-page":"3636","DOI":"10.1109\/TIP.2019.2899267","volume":"28","author":"J Deng","year":"2019","unstructured":"Deng J, Trigeorgis G, Zhou Y, Zafeiriou S (2019) Joint multi-view face alignment in the wild. IEEE Transactions on Image Processing 28(7):3636\u20133648","journal-title":"IEEE Transactions on Image Processing"},{"key":"10427_CR16","doi-asserted-by":"crossref","unstructured":"Fan, D. P., Wang, W., Cheng, M. M., & Shen, J. (2019). Shifting more attention to video salient object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 8554\u20138564).","DOI":"10.1109\/CVPR.2019.00875"},{"key":"10427_CR17","doi-asserted-by":"crossref","unstructured":"Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580\u2013587)","DOI":"10.1109\/CVPR.2014.81"},{"key":"10427_CR18","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770\u2013778)","DOI":"10.1109\/CVPR.2016.90"},{"key":"10427_CR19","doi-asserted-by":"crossref","unstructured":"Henriques JF, Caseiro R, Martins P, Batista J (2012) Exploiting the circulant structure of tracking-by-detection with kernels. In European conference on computer vision (pp. 702\u2013715). Springer, Berlin, Heidelberg","DOI":"10.1007\/978-3-642-33765-9_50"},{"issue":"3","key":"10427_CR20","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","volume":"37","author":"JF Henriques","year":"2014","unstructured":"Henriques JF, Caseiro R, Martins P, Batista J (2014) High-speed tracking with kernelized correlation filters. IEEE trans pattern analysis machine intell 37(3):583\u2013596","journal-title":"IEEE trans pattern analysis machine intell"},{"key":"10427_CR21","unstructured":"Hu P, Wen L, Du D, Bian X, Hu Q, Ling H (2020) Vision Meets Drones: Past, Present and Future. arXiv preprint arXiv:2001.06303"},{"key":"10427_CR22","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700\u20134708)","DOI":"10.1109\/CVPR.2017.243"},{"key":"10427_CR23","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/j.patcog.2017.11.007","volume":"76","author":"P Li","year":"2018","unstructured":"Li P, Wang D, Wang L, Lu H (2018) Deep visual tracking: Review and experimental comparison. Pattern Recognition 76:323\u2013338","journal-title":"Pattern Recognition"},{"key":"10427_CR24","doi-asserted-by":"crossref","unstructured":"Li B, Yan J, Wu W, Zhu Z, Hu X (2018) High performance visual tracking with siamese region proposal network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 8971\u20138980)","DOI":"10.1109\/CVPR.2018.00935"},{"key":"10427_CR25","doi-asserted-by":"crossref","unstructured":"Li B, Wu W, Wang Q, Zhang F, Xing J, Yan J (2019) Siamrpn++: Evolution of siamese visual tracking with very deep networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 4282\u20134291)","DOI":"10.1109\/CVPR.2019.00441"},{"key":"10427_CR26","doi-asserted-by":"crossref","unstructured":"Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, ... Zitnick CL (2014) Microsoft coco: Common objects in context. In European conference on computer vision (pp. 740\u2013755). Springer, Cham","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"10427_CR27","doi-asserted-by":"crossref","unstructured":"Lin TY, Goyal P, Girshick R, He K, Doll\u00e1r P (2017) Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision (pp. 2980\u20132988)","DOI":"10.1109\/ICCV.2017.324"},{"key":"10427_CR28","unstructured":"Luo W, Xing J, Milan A, Zhang X, Liu W, Zhao X, Kim TK (2014) Multiple object tracking: A literature review. arXiv preprint arXiv:1409.7618"},{"key":"10427_CR29","unstructured":"Marvasti-Zadeh SM, Cheng L, Ghanei-Yakhdan H, Kasaei S (2019) Deep learning for visual tracking: A comprehensive survey. arXiv preprint arXiv:1912.00535"},{"key":"10427_CR30","unstructured":"Mills-Tettey GA, Stentz A, Dias MB (2007) The dynamic hungarian algorithm for the assignment problem with changing costs"},{"key":"10427_CR31","doi-asserted-by":"crossref","unstructured":"Neubeck A, Van Gool L (2006) Efficient non-maximum suppression. In 18th International Conference on Pattern Recognition (ICPR'06) (Vol. 3, pp. 850\u2013855). IEEE","DOI":"10.1109\/ICPR.2006.479"},{"key":"10427_CR32","doi-asserted-by":"crossref","unstructured":"Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In European conference on computer vision (pp. 483\u2013499). Springer, Cham","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"10427_CR33","doi-asserted-by":"crossref","unstructured":"Peng X, Feris RS, Wang X, Metaxas DN (2016) A recurrent encoder-decoder network for sequential face alignment. In European conference on computer vision (pp. 38\u201356). Springer, Cham","DOI":"10.1007\/978-3-319-46448-0_3"},{"key":"10427_CR34","doi-asserted-by":"crossref","unstructured":"Pirsiavash H, Ramanan D, Fowlkes CC (2011) Globally-optimal greedy algorithms for tracking a variable number of objects. In CVPR 2011 (pp. 1201\u20131208). IEEE","DOI":"10.1109\/CVPR.2011.5995604"},{"key":"10427_CR35","unstructured":"Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems (pp. 91\u201399)"},{"key":"10427_CR36","doi-asserted-by":"crossref","unstructured":"Ren L, Lu J, Wang Z, Tian Q, Zhou J (2018) Collaborative deep reinforcement learning for multi-object tracking. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 586\u2013602)","DOI":"10.1007\/978-3-030-01219-9_36"},{"key":"10427_CR37","doi-asserted-by":"crossref","unstructured":"Rezatofighi H, Tsoi N, Gwak J, Sadeghian A, Reid I, Savarese S (2019) Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 658\u2013666)","DOI":"10.1109\/CVPR.2019.00075"},{"key":"10427_CR38","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234\u2013241). Springer, Cham","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"10427_CR39","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556"},{"key":"10427_CR40","doi-asserted-by":"crossref","unstructured":"Sun D, Yang X, Liu MY, Kautz J (2018) Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 8934\u20138943)","DOI":"10.1109\/CVPR.2018.00931"},{"key":"10427_CR41","unstructured":"Sun K, Zhao Y, Jiang B, Cheng T, Xiao B, Liu D, ... Wang J (2019) High-resolution representations for labeling pixels and regions. arXiv preprint arXiv:1904.04514"},{"key":"10427_CR42","unstructured":"Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2016) Inception-v4, inception-resnet and the impact of residual connections on learning. arXiv preprint arXiv:1602.07261"},{"key":"10427_CR43","doi-asserted-by":"crossref","unstructured":"Tang S, Andres B, Andriluka M, Schiele B (2016) Multi-person tracking by multicut and deep matching. In European Conference on Computer Vision (pp. 100\u2013111). Springer, Cham","DOI":"10.1007\/978-3-319-48881-3_8"},{"key":"10427_CR44","doi-asserted-by":"crossref","unstructured":"Voigtlaender P, Krause M, Osep A, Luiten J, Sekar BBG, Geiger A, Leibe B (2019) MOTS: Multi-object tracking and segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 7942\u20137951)","DOI":"10.1109\/CVPR.2019.00813"},{"issue":"5","key":"10427_CR45","doi-asserted-by":"publisher","first-page":"2368","DOI":"10.1109\/TIP.2017.2787612","volume":"27","author":"W Wang","year":"2017","unstructured":"Wang W, Shen J (2017) Deep visual attention prediction. IEEE Trans Image Process 27(5):2368\u20132378","journal-title":"IEEE Trans Image Process"},{"key":"10427_CR46","unstructured":"Wang Z, Zheng L, Liu Y, Wang S (2019) Towards Real-Time Multi-Object Tracking. arXiv preprint arXiv:1909.12605"},{"key":"10427_CR47","doi-asserted-by":"crossref","unstructured":"Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. In 2017 IEEE international conference on image processing (ICIP) (pp. 3645\u20133649). IEEE","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"10427_CR48","doi-asserted-by":"crossref","unstructured":"Wu B, Nevatia R (2006) Tracking of multiple, partially occluded humans based on static body part detection. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) (Vol. 1, pp. 951\u2013958). IEEE","DOI":"10.1109\/CVPR.2006.312"},{"key":"10427_CR49","unstructured":"Xu Y, Ban Y, Alameda-Pineda X, Horaud R (2019) DeepMOT: A Differentiable Framework for Training Multiple Object Trackers. arXiv preprint arXiv:1906.06618"},{"key":"10427_CR50","doi-asserted-by":"crossref","unstructured":"Yang J, Liu Q, Zhang K (2017) Stacked hourglass network for robust facial landmark localisation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 79\u201387)","DOI":"10.1109\/CVPRW.2017.253"},{"key":"10427_CR51","doi-asserted-by":"crossref","unstructured":"Yu F, Wang D, Shelhamer E, Darrell T (2018) Deep layer aggregation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2403\u20132412)","DOI":"10.1109\/CVPR.2018.00255"},{"key":"10427_CR52","unstructured":"Zhang L, Li Y, Nevatia R (2008) Global data association for multi-object tracking using network flows. In 2008 IEEE Conference on Computer Vision and Pattern Recognition (pp. 1\u20138). IEEE"},{"key":"10427_CR53","doi-asserted-by":"crossref","unstructured":"Zhang P, Zhong Y, Li X (2019) SlimYOLOv3: Narrower, faster and better for real-time UAV applications. In Proceedings of the IEEE International Conference on Computer Vision Workshops (pp. 0\u20130)","DOI":"10.1109\/ICCVW.2019.00011"},{"key":"10427_CR54","doi-asserted-by":"publisher","first-page":"29742","DOI":"10.1109\/ACCESS.2020.2972338","volume":"8","author":"J Zhang","year":"2020","unstructured":"Zhang J, Xie Z, Sun J, Zou X, Wang J (2020) A cascaded R-CNN with multiscale attention and imbalanced samples for traffic sign detection. IEEE Access 8:29742\u201329754","journal-title":"IEEE Access"},{"key":"10427_CR55","doi-asserted-by":"crossref","unstructured":"Zhao JX, Liu JJ, Fan DP, Cao Y, Yang J, Cheng MM (2019) EGNet: Edge guidance network for salient object detection. In Proceedings of the IEEE International Conference on Computer Vision (pp. 8779\u20138788)","DOI":"10.1109\/ICCV.2019.00887"},{"key":"10427_CR56","unstructured":"Zhou X, Wang D, Kr\u00e4henb\u00fchl P (2019) Objects as points. arXiv preprint arXiv:1904.07850"},{"key":"10427_CR57","doi-asserted-by":"crossref","unstructured":"Zhu J, Yang H, Liu N, Kim M, Zhang W, Yang MH (2018) Online multi-object tracking with dual matching attention networks. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 366\u2013382)","DOI":"10.1007\/978-3-030-01228-1_23"},{"key":"10427_CR58","doi-asserted-by":"crossref","unstructured":"Zhu Z, Wang Q, Li B, Wu W, Yan J, Hu W (2018) Distractor-aware siamese networks for visual object tracking. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 101\u2013117)","DOI":"10.1007\/978-3-030-01240-3_7"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10427-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-10427-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-10427-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T17:25:54Z","timestamp":1724347554000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-10427-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,19]]},"references-count":58,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2021,4]]}},"alternative-id":["10427"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-10427-1","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,19]]},"assertion":[{"value":"14 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 December 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 January 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}