{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T21:24:04Z","timestamp":1785446644775,"version":"3.56.0"},"reference-count":48,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T00:00:00Z","timestamp":1647388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Accurate and robust drone detection is an important and challenging task. However, on this issue, previous research, whether based on appearance or motion features, has not yet provided a satisfactory solution, especially under a complex background. To this end, the present work proposes a motion-based method termed the Multi-Scale Space Kinematic detection method (MUSAK). It fully leverages the motion patterns by extracting 3D, pseudo 3D and 2D kinematic parameters at three scale spaces according to the keypoints quality and builds three Gated Recurrent Unit (GRU)-based detection branches for drone recognition. The MUSAK method is evaluated on a hybrid dataset named multiscale UAV dataset (MUD), consisting of public datasets and self-collected data with motion labels. The experimental results show that MUSAK improves the performance by a large margin, a 95% increase in average precision (AP), compared with the previous state-of-the-art (SOTA) motion-based methods, and the hybrid MUSAK method, which integrates with the appearance-based method Faster Region-based Convolutional Neural Network (Faster R-CNN), achieves a new SOTA performance on AP metrics (AP, APM, and APS).<\/jats:p>","DOI":"10.3390\/rs14061434","type":"journal-article","created":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T22:15:04Z","timestamp":1647468904000},"page":"1434","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["MUSAK: A Multi-Scale Space Kinematic Method for Drone Detection"],"prefix":"10.3390","volume":"14","author":[{"given":"Sunxiangyu","family":"Liu","sequence":"first","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China"},{"name":"School of Aerospace Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guitao","family":"Li","sequence":"additional","affiliation":[{"name":"School of Aerospace Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yafeng","family":"Zhan","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Heidger, R., Lambercy, V., and Lambers, D. (2021, January 21\u201322). Tracking Analysis of Drone Detection Systems at Airports: Methodology and Results. Proceedings of the 2021 21st International Radar Symposium (IRS), Virtual Conference, Berlin, Germany.","DOI":"10.23919\/IRS51887.2021.9466192"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"53040","DOI":"10.1109\/ACCESS.2019.2912200","article-title":"Review of deep learning algorithms and architectures","volume":"7","author":"Shrestha","year":"2019","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Chauhan, N.K., and Singh, K. (2018, January 28\u201329). A review on conventional machine learning vs. deep learning. Proceedings of the 2018 International Conference on Computing, Power and Communication Technologies (GUCON), Greater Noida, India.","DOI":"10.1109\/GUCON.2018.8675097"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Coluccia, A., Fascista, A., Schumann, A., Sommer, L., Ghenescu, M., Piatrik, T., De Cubber, G., Nalamati, M., Kapoor, A., and Saqib, M. (2019, January 18\u201321). Drone-vs-bird detection challenge at ieee avss2019. Proceedings of the 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Taipei, Taiwan.","DOI":"10.1109\/AVSS.2019.8909876"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Coluccia, A., Fascista, A., Schumann, A., Sommer, L., Dimou, A., Zarpalas, D., M\u00e9ndez, M., de la Iglesia, D., Gonz\u00e1lez, I., and Mercier, J.-P. (2021). Drone vs. Bird Detection: Deep Learning Algorithms and Results from a Grand Challenge. Sensors, 21.","DOI":"10.3390\/s21082824"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sommer, L., Schumann, A., M\u00fcller, T., Schuchert, T., and Beyerer, J. (September, January 29). Flying object detection for automatic UAV recognition. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.","DOI":"10.1109\/AVSS.2017.8078557"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Koksal, A., Ince, K.G., and Alatan, A. (2020, January 14\u201319). Effect of annotation errors on drone detection with YOLOv3. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00523"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Schumann, A., Sommer, L., M\u00fcller, T., and Voth, S. (2018, January 12). An image processing pipeline for long range UAV detection. Proceedings of the Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures, Berlin, Germany.","DOI":"10.1117\/12.2325735"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Isaac-Medina, B.K., Poyser, M., Organisciak, D., Willcocks, C.G., Breckon, T.P., and Shum, H.P. (2021, January 11\u201317). Unmanned aerial vehicle visual detection and tracking using deep neural networks: A performance benchmark. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Virtual Conference, Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00142"},{"key":"ref_10","unstructured":"(2022, March 01). Detection Leaderboard for COCO Detection Task 2020. Available online: https:\/\/cocodataset.org\/#detection-leaderboard."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Van Der Smagt, P., Cremers, D., and Brox, T. (2015, January 7\u201313). Flownet: Learning optical flow with convolutional networks. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.316"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., and Brox, T. (2017, January 21\u201326). Flownet 2.0: Evolution of optical flow estimation with deep networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.179"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, Z., Li, S., Howard-Jenkins, H., Prisacariu, V., and Chen, M. (2020, January 1\u20135). Flownet3d++: Geometric losses for deep scene flow estimation. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093302"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhu, X., Xiong, Y., Dai, J., Yuan, L., and Wei, Y. (2017, January 21\u201326). Deep feature flow for video recognition. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.441"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhu, X., Wang, Y., Dai, J., Yuan, L., and Wei, Y. (2017, January 22\u201329). Flow-guided feature aggregation for video object detection. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.52"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4233","DOI":"10.1109\/TIP.2019.2903656","article-title":"KalmanFlow 2.0: Efficient video optical flow estimation via context-aware kalman filtering","volume":"28","author":"Bao","year":"2019","journal-title":"IEEE Trans. Image Processing"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"DelMarco, S., and Webb, H. (2018, January 16\u201317). Mathematical aspects of transit photometry for small UAV detection in video. Proceedings of the Mobile Multimedia\/Image Processing, Security, and Applications 2018, Orlando, FL, USA.","DOI":"10.1117\/12.2303889"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Srigrarom, S., Chew, K.H., Da Lee, D.M., and Ratsamee, P. (2020, January 23\u201326). Drone versus bird flights: Classification by trajectories characterization. Proceedings of the 2020 59th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), Chiang Mai, Thailand.","DOI":"10.23919\/SICE48898.2020.9240313"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rozantsev, A., Sinha, S.N., Dey, D., and Fua, P. (2017, January 21\u201326). Flight dynamics-based recovery of a UAV trajectory using ground cameras. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.266"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/TPAMI.2016.2564408","article-title":"Detecting Flying Objects Using a Single Moving Camera","volume":"39","author":"Rozantsev","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2748","DOI":"10.1109\/TCSVT.2017.2764959","article-title":"Glance and stare: Trapping flying birds in aerial videos by adaptive deep spatio-temporal features","volume":"29","author":"Tian","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"124451","DOI":"10.1109\/ACCESS.2020.3006191","article-title":"Adaptive Inattentional Framework for Video Object Detection With Reward-Conditional Training","volume":"8","author":"Sampedro","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Saqib, M., Khan, S.D., Sharma, N., and Blumenstein, M. (September, January 29). A study on detecting drones using deep convolutional neural networks. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.","DOI":"10.1109\/AVSS.2017.8078541"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Aker, C., and Kalkan, S. (September, January 29). Using deep networks for drone detection. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.","DOI":"10.1109\/AVSS.2017.8078539"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Carrio, A., Vemprala, S., Ripoll, A., Saripalli, S., and Campoy, P. (2018, January 1\u20135). Drone detection using depth maps. Proceedings of the 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593405"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Craye, C., and Ardjoune, S. (2019, January 18\u201321). Spatio-temporal semantic segmentation for drone detection. Proceedings of the 2019 16th IEEE International conference on advanced video and signal based surveillance (AVSS), Taipei, Taiwan.","DOI":"10.1109\/AVSS.2019.8909854"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Magoulianitis, V., Ataloglou, D., Dimou, A., Zarpalas, D., and Daras, P. (2019, January 18\u201321). Does deep super-resolution enhance uav detection?. Proceedings of the 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Taipei, Taiwan.","DOI":"10.1109\/AVSS.2019.8909865"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11\u201317). TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Virtual Conference, Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00312"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, Z., Gao, G., Sun, L., and Fang, L. (2020, January 14\u201319). IPG-net: Image pyramid guidance network for small object detection. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00521"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, J., Liang, X., Wei, Y., Xu, T., Feng, J., and Yan, S. (2017, January 21\u201326). Perceptual generative adversarial networks for small object detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.211"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1007\/s11263-020-01375-2","article-title":"Hota: A higher order metric for evaluating multi-object tracking","volume":"129","author":"Luiten","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yan, B., Zhang, H., Xu, L., Chen, Y., and Lu, H. (2021). A Novel 4D Track-before-Detect Approach for Weak Targets Detection in Clutter Regions. Remote Sens., 13.","DOI":"10.3390\/rs13234942"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Shen, L., Wang, X., and Hu, H.-M. (2020, January 6\u20138). Drone Video Object Detection using Convolutional Neural Networks with Time Domain Motion Features. Proceedings of the 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), Shenzhen, China.","DOI":"10.1109\/MIPR49039.2020.00039"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"135845","DOI":"10.1109\/ACCESS.2021.3110395","article-title":"Dim and Small Target Detection in Multi-Frame Sequence Using Bi-Conv-LSTM and 3D-Conv Structure","volume":"9","author":"Liu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Van Droogenbroeck, M., and Paquot, O. (2012, January 16\u201321). Background subtraction: Experiments and improvements for ViBe. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238924"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Danelljan, M., Hager, G., Shahbaz Khan, F., and Felsberg, M. (2015, January 7\u201313). Learning spatially regularized correlation filters for visual tracking. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.490"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1514","DOI":"10.1109\/LSP.2016.2601085","article-title":"Joint tracking and ground plane estimation","volume":"23","author":"Kwon","year":"2016","journal-title":"IEEE Signal Processing Lett."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Qiao, S., Zhu, Y., Adam, H., Yuille, A., and Chen, L.-C. (2021, January 19\u201325). Vip-deeplab: Learning visual perception with depth-aware video panoptic segmentation. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00399"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: Efficient perspective-n-point camera pose estimation","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1109\/34.845378","article-title":"Contour matching using epipolar geometry","volume":"22","author":"Han","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, H., and Zhang, G. (2006, January 13). A new fast edge-matching algorithm based on corner constraint and edge constraint. Proceedings of the 2006 Sixth International Symposium on Instrumentation and Control Technology: Sensors, Automatic Measurement, Control, and Computer Simulation, Beijing, China.","DOI":"10.1117\/12.717813"},{"key":"ref_43","unstructured":"Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv."},{"key":"ref_44","unstructured":"Jiang, N., Wang, K., Peng, X., Yu, X., Wang, Q., Xing, J., Li, G., Zhao, J., Guo, G., and Han, Z. (2021). Anti-UAV: A large multi-modal benchmark for UAV tracking. arXiv."},{"key":"ref_45","unstructured":"(2022, March 01). Multiscale UAV Dataset. Available online: https:\/\/cloud.tsinghua.edu.cn\/d\/32c29683cdd3490cb090."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? the kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kim, M., Jeong, J., and Kim, S. (2021). ECAP-YOLO: Efficient Channel Attention Pyramid YOLO for Small Object Detection in Aerial Image. Remote Sens., 13.","DOI":"10.3390\/rs13234851"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"23805","DOI":"10.3390\/s150923805","article-title":"Vision-Based Detection and Distance Estimation of Micro Unmanned Aerial Vehicles","volume":"15","author":"Kalkan","year":"2015","journal-title":"Sensors"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1434\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:37:28Z","timestamp":1760135848000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1434"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":48,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["rs14061434"],"URL":"https:\/\/doi.org\/10.3390\/rs14061434","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,16]]}}}