{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T10:51:43Z","timestamp":1761648703624,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,9,29]],"date-time":"2019-09-29T00:00:00Z","timestamp":1569715200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61672429","61502364"],"award-info":[{"award-number":["61672429","61502364"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, UAV technology has developed rapidly. Due to the mobility, low cost, and variable monitoring altitude of UAVs, multiple-object detection and tracking in aerial videos has become a research hotspot in the field of computer vision. However, due to camera motion, small target size, target adhesion, and unpredictable target motion, it is still difficult to detect and track targets of interest in aerial videos, especially in the case of a low frame rate where the target position changes too much. In this paper, we propose a multiple-object-tracking algorithm based on dense-trajectory voting in aerial videos. The method models the multiple-target-tracking problem as a voting problem of the dense-optical-flow trajectory to the target ID, which can be applied to aerial-surveillance scenes and is robust to low-frame-rate videos. More specifically, we first built an aerial video dataset for vehicle targets, including a training dataset and a diverse test dataset. Based on this, we trained the neural network model by using a deep-learning method to detect vehicles in aerial videos. Thereafter, we calculated the dense optical flow in adjacent frames, and generated effective dense-optical-flow trajectories in each detection bounding box at the current time. When target IDs of optical-flow trajectories are known, the voting results of the optical-flow trajectories in each detection bounding box are counted. Finally, similarity between detection objects in adjacent frames was measured based on the voting results, and tracking results were obtained by data association. In order to evaluate the performance of this algorithm, we conducted experiments on self-built test datasets. A large number of experimental results showed that the proposed algorithm could obtain good target-tracking results in various complex scenarios, and performance was still robust at a low frame rate by changing the video frame rate. In addition, we carried out qualitative and quantitative comparison experiments between the algorithm and three state-of-the-art tracking algorithms, which further proved that this algorithm could not only obtain good tracking results in aerial videos with a normal frame rate, but also had excellent performance under low-frame-rate conditions.<\/jats:p>","DOI":"10.3390\/rs11192278","type":"journal-article","created":{"date-parts":[[2019,9,30]],"date-time":"2019-09-30T05:58:33Z","timestamp":1569823113000},"page":"2278","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Multiple-Object-Tracking Algorithm Based on Dense Trajectory Voting in Aerial Videos"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5180-2316","authenticated-orcid":false,"given":"Tao","family":"Yang","sequence":"first","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongdong","family":"Li","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi","family":"Bai","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangbing","family":"Zhang","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sen","family":"Li","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miao","family":"Wang","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuoyue","family":"Zhang","sequence":"additional","affiliation":[{"name":"National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, SAIIP, School of Computer Science, Northwestern Polytechnical University, Xi\u2019an 710129, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9043-8633","authenticated-orcid":false,"given":"Jing","family":"Li","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/5.959344","article-title":"Aerial video surveillance and exploitation","volume":"89","author":"Kumar","year":"2001","journal-title":"Proc. IEEE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"25763","DOI":"10.1109\/ACCESS.2019.2900167","article-title":"Panoramic uav surveillance and recycling system based on structure-free camera array","volume":"7","author":"Yang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1109\/TITS.2016.2595526","article-title":"Real-Time Bidirectional Traffic Flow Parameter Estimation From Aerial Videos","volume":"18","author":"Ke","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"101160","DOI":"10.1109\/ACCESS.2019.2929760","article-title":"Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera","volume":"7","author":"Zhao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/TCYB.2016.2625320","article-title":"Correlation-Based Tracking of Multiple Targets With Hierarchical Layered Structure","volume":"48","author":"Cao","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"76731","DOI":"10.1109\/ACCESS.2019.2921315","article-title":"Remote Sensing Target Tracking in UAV Aerial Video Based on Saliency Enhanced MDnet","volume":"7","author":"Bi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1947","DOI":"10.1109\/TAES.2017.2677746","article-title":"A Scalable Multitarget Tracking System for Cooperative Unmanned Aerial Vehicles","volume":"53","author":"Farmani","year":"2017","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bhattacharya, S., Idrees, H., Saleemi, I., Ali, S., and Shah, M. (2011). Moving object detection and tracking in forward looking infra-red aerial imagery. Machine Vision Beyond Visible Spectrum, Springer.","DOI":"10.1007\/978-3-642-11568-4_10"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Andres, B., Kroeger, T., Briggman, K.L., Denk, W., Korogod, N., Knott, G., Koethe, U., and Hamprecht, F.A. (2012, January 7\u201313). Globally Optimal Closed-Surface Segmentation for Connectomics. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33712-3_56"},{"key":"ref_10","unstructured":"Uzkent, B., Hoffman, M.J., and Vodacek, A. (July, January 26). Real-Time Vehicle Tracking in Aerial Video Using Hyperspectral Features. Proceedings of the Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, X., Yang, T., and Li, J. (2018). Real-Time Ground Vehicle Detection in Aerial Infrared Imagery Based on Convolutional Neural Network. Electronics, 7.","DOI":"10.3390\/electronics7060078"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1109\/TPAMI.2013.242","article-title":"Segmentation of Moving Objects by Long Term Video Analysis","volume":"36","author":"Ochs","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Keuper, M., Andres, B., and Brox, T. (2015, January 7\u201313). Motion Trajectory Segmentation via Minimum Cost Multicuts. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.374"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, J., Dai, Y., Li, C., Shu, J., Li, D., Yang, T., and Lu, Z. (2019). Visual Detail Augmented Mapping for Small Aerial Target Detection. Remote. Sens., 11.","DOI":"10.3390\/rs11010014"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xiao, J., Cheng, H., Sawhney, H., and Han, F. (2010, January 13\u201318). Vehicle detection and tracking in wide field-of-view aerial video. Proceedings of the Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540151"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Szottka, I., and Butenuth, M. (2011, January 11\u201313). Tracking multiple vehicles in airborne image sequences of complex urban environments. Proceedings of the Urban Remote Sensing Event, Munich, Germany.","DOI":"10.1109\/JURSE.2011.5764707"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, Y., Zhang, Z., and Wang, Y. (2012, January 12\u201315). Moving Object Detection in Aerial Video. Proceedings of the International Conference on Machine Learning and Applications, Boca Raton, FL, USA.","DOI":"10.1109\/ICMLA.2012.206"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Al-Kaff, A., G\u00f3mez-Silva, M.J., Moreno, F.M., de la Escalera, A., and Armingol, J.M. (2019). An appearance-based tracking algorithm for aerial search and rescue purposes. Sensors, 19.","DOI":"10.3390\/s19030652"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, T., Pennisi, A., Li, Z., Zhang, Y., and Sahli, H. (2018). A Hierarchical Association Framework for Multi-Object Tracking in Airborne Videos. Remote. Sens., 10.","DOI":"10.20944\/preprints201807.0238.v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/TIM.2015.2509318","article-title":"Robust visual detection\u2014learning\u2014tracking framework for autonomous aerial refueling of UAVs","volume":"65","author":"Yin","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing, Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wojke, N., and Bewley, A. (2018, January 12\u201315). Deep Cosine Metric Learning for Person Re-identification. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00087"},{"key":"ref_24","unstructured":"Bochinski, E., Eiselein, V., and Sikora, T. (September, January 29). High-speed tracking-by-detection without using image information. Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance, Lecce, Italy."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1109\/TITS.2014.2331353","article-title":"Efficient Road Detection and Tracking for Unmanned Aerial Vehicle","volume":"16","author":"Zhou","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","unstructured":"Redmon, J., and Farhadi, A. (2019, March 01). YOLOv3: An Incremental Improvement. CoRR, Available online: http:\/\/xxx.lanl.gov\/abs\/1804.02767."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Nav. Res. Logist. Q."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_29","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, Available online: https:\/\/papers.nips.cc\/paper\/5638-faster-r-cnn-towards-real-time-object-detection-with-region-proposal-networks.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., and Berg, A.C. (2016, January 8\u201316). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_31","unstructured":"Tzutalin (2019, March 01). LabelImg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_32","unstructured":"UA-DETRAC (2019, March 01). Available online: http:\/\/detrac-db.rit.albany.edu\/."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hosang, J., Benenson, R., and Schiele, B. (2017, January 21\u201326). Learning Non-maximum Suppression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.685"},{"key":"ref_34","unstructured":"Farneback, G. (July, January 29). Two-Frame Motion Estimation Based on Polynomial Expansion. Proceedings of the Scandinavian Conference on Image Analysis, Halmstad, Sweden."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"246309","DOI":"10.1155\/2008\/246309","article-title":"Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics","volume":"2008","author":"Bernardin","year":"2008","journal-title":"EURASIP J. Image Video Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/19\/2278\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:25:58Z","timestamp":1760189158000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/19\/2278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,29]]},"references-count":35,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["rs11192278"],"URL":"https:\/\/doi.org\/10.3390\/rs11192278","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,9,29]]}}}