{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T16:23:03Z","timestamp":1783614183420,"version":"3.55.0"},"reference-count":41,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T00:00:00Z","timestamp":1600300800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 108-2221-E-006-071-MY3"],"award-info":[{"award-number":["MOST 108-2221-E-006-071-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Distance information of an obstacle is important for obstacle avoidance in many applications, and could be used to determine the potential risk of object collision. In this study, the detection of a moving fixed-wing unmanned aerial vehicle (UAV) with deep learning-based distance estimation to conduct a feasibility study of sense and avoid (SAA) and mid-air collision avoidance of UAVs is proposed by using a monocular camera to detect and track an incoming UAV. A quadrotor is regarded as an owned UAV, and it is able to estimate the distance of an incoming fixed-wing intruder. The adopted object detection method is based on the you only look once (YOLO) object detector. Deep neural network (DNN) and convolutional neural network (CNN) methods are applied to exam their performance in the distance estimation of moving objects. The feature extraction of fixed-wing UAVs is based on the VGG-16 model, and then its result is applied to the distance network to estimate the object distance. The proposed model is trained by using synthetic images from animation software and validated by using both synthetic and real flight videos. The results show that the proposed active vision-based scheme is able to detect and track a moving UAV with high detection accuracy and low distance errors.<\/jats:p>","DOI":"10.3390\/rs12183035","type":"journal-article","created":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T08:29:43Z","timestamp":1600331383000},"page":"3035","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Detection of a Moving UAV Based on Deep Learning-Based Distance Estimation"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3471-3290","authenticated-orcid":false,"given":"Ying-Chih","family":"Lai","sequence":"first","affiliation":[{"name":"Department of Aeronautics and Aeronautics, National Cheng Kung University, Tainan 701, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zong-Ying","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Aeronautics and Aeronautics, National Cheng Kung University, Tainan 701, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-013-0120-x","article-title":"UAV for 3D mapping applications: A review","volume":"6","author":"Nex","year":"2014","journal-title":"Appl. Geomat."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xu, S., Savvaris, A., He, S., Shin, H.-S., and Tsourdos, A. (2018, January 12\u201315). Real-time implementation of YOLO + JPDA for small scale UAV multiple object tracking. Proceedings of the 2018 International Conference on Unmanned Aircraft Systems (ICUAS), Dallas, TX, USA.","DOI":"10.1109\/ICUAS.2018.8453398"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, J., Ye, D.H., Chung, T., Kolsch, M., Wachs, J., and Bouman, C. (2016, January 9\u201314). Multi-target detection and tracking from a single camera in Unmanned Aerial Vehicles (UAVs). Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759733"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ammour, N., Alhichri, H., Bazi, Y., Benjdira, B., Alajlan, N., and Zuair, M. (2017). Deep learning approach for car detection in UAV imagery. Remote Sens., 9.","DOI":"10.3390\/rs9040312"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1109\/JSTARS.2013.2250921","article-title":"Characterization of rice paddies by a UAV-mounted miniature hyperspectral sensor system","volume":"6","author":"Uto","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4383","DOI":"10.1109\/LRA.2018.2867237","article-title":"Learning to Detect Aircraft for Long-Range Vision-Based Sense-and-Avoid Systems","volume":"3","author":"James","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MAES.2016.160116","article-title":"Sense and avoid for unmanned aircraft systems","volume":"31","author":"Fasano","year":"2016","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.paerosci.2015.01.001","article-title":"Sense and avoid technologies with applications to unmanned aircraft systems: Review and prospects","volume":"74","author":"Yu","year":"2015","journal-title":"Prog. Aerosp. Sci."},{"key":"ref_9","unstructured":"Carnie, R., Walker, R., and Corke, P. (2006, January 15\u201319). Image processing algorithms for UAV \u201csense and avoid\u201d. Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA 2006), Orlando, FL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1002\/rob.21443","article-title":"Characterization of Sky-region Morphological-temporal Airborne Collision Detection","volume":"30","author":"Lai","year":"2013","journal-title":"J. Field Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Nussberger, A., Grabner, H., and Van Gool, L. (2014, January 27\u201330). Aerial object tracking from an airborne platform. Proceedings of the 2014 International Conference on Unmanned Aircraft Systems (ICUAS), Orlando, FL, UAS.","DOI":"10.1109\/ICUAS.2014.6842386"},{"key":"ref_12","unstructured":"Zhu, Q., Yeh, M.-C., Cheng, K.-T., and Avidan, S. (2006, January 17\u201322). Fast human detection using a cascade of histograms of oriented gradients. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_14","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1049\/el.2015.2092","article-title":"Cascaded split-level colour Haar-like features for object detection","volume":"51","author":"Liu","year":"2015","journal-title":"Electron. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4661","DOI":"10.2352\/ISSN.2470-1173.2018.10.IMAWM-466","article-title":"Deep Learning for Moving Object Detection and Tracking from a Single Camera in Unmanned Aerial Vehicles (UAVs)","volume":"2018","author":"Ye","year":"2018","journal-title":"Electron. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object detection with deep learning: A review","volume":"30","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_18","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_21","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Saqib, M., Khan, S.D., Sharma, N., and Blumenstein, M. (September, January 29). A study on detecting drones using deep convolutional neural networks. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.","DOI":"10.1109\/AVSS.2017.8078541"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Schumann, A., Sommer, L., Klatte, J., Schuchert, T., and Beyerer, J. (September, January 29). Deep cross-domain flying object classification for robust UAV detection. Proceedings of the 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy.","DOI":"10.1109\/AVSS.2017.8078558"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Opromolla, R., Fasano, G., and Accardo, D. (2018). A vision-based approach to UAV detection and tracking in cooperative applications. Sensors, 18.","DOI":"10.3390\/s18103391"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jin, R., Jiang, J., Qi, Y., Lin, D., and Song, T. (2019). Drone detection and pose estimation using relational graph networks. Sensors, 19.","DOI":"10.3390\/s19061479"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wu, M., Xie, W., Shi, X., Shao, P., and Shi, Z. (2018, January 6\u20138). Real-time drone detection using deep learning approach. Proceedings of the International Conference on Machine Learning and Intelligent Communications, Hangzhou, China.","DOI":"10.1007\/978-3-030-00557-3_3"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2723","DOI":"10.1109\/TITS.2015.2421482","article-title":"Robust vehicle detection and distance estimation under challenging lighting conditions","volume":"16","author":"Rezaei","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Monajjemi, M., Mohaimenianpour, S., and Vaughan, R. (2016, January 9\u201314). UAV, come to me: End-to-end, multi-scale situated HRI with an uninstrumented human and a distant UAV. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759649"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10846-018-0816-6","article-title":"Three dimensional intruder closest point of approach estimation based-on monocular image parameters in aircraft sense and avoid","volume":"93","author":"Bauer","year":"2019","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1017\/S0263574719000158","article-title":"Monocular Vision-based Sense and Avoid of UAV Using Nonlinear Model Predictive Control","volume":"37","author":"Zhang","year":"2019","journal-title":"Robotica"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, C., Zhang, H., Dong, Y., and Wei, S. (2019). Automatic ship detection based on RetinaNet using multi-resolution Gaofen-3 imagery. Remote Sens., 11.","DOI":"10.3390\/rs11050531"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Luo, X., Tian, X., Zhang, H., Hou, W., Leng, G., Xu, W., Jia, H., He, X., Wang, M., and Zhang, J. (2020). Fast Automatic Vehicle Detection in UAV Images Using Convolutional Neural Networks. Remote Sens., 12.","DOI":"10.3390\/rs12121994"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ophoff, T., Puttemans, S., Kalogirou, V., Robin, J.-P., and Goedem\u00e9, T. (2020). Vehicle and Vessel Detection on Satellite Imagery: A Comparative Study on Single-Shot Detectors. Remote Sens., 12.","DOI":"10.3390\/rs12071217"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ponce, H., Brieva, J., and Moya-Albor, E. (2018, January 8\u201313). Distance estimation using a bio-inspired optical flow strategy applied to neuro-robotics. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio, Brazil.","DOI":"10.1109\/IJCNN.2018.8489597"},{"key":"ref_35","unstructured":"Haseeb, M.A., Guan, J., Risti\u0107-Durrant, D., and Gr\u00e4ser, A. (2018, January 1). DisNet: A novel method for distance estimation from monocular camera. Proceedings of the 10th Planning, Perception and Navigation for Intelligent Vehicles (PPNIV18), Madrid, Spain."},{"key":"ref_36","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jensen, M.B., Nasrollahi, K., and Moeslund, T.B. (2017, January 21\u201326). Evaluating state-of-the-art object detector on challenging traffic light data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.122"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 5\u201312). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_39","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_40","unstructured":"Agarap, A.F. (2018). Deep learning using rectified linear units (relu). arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Opromolla, R., Inchingolo, G., and Fasano, G. (2019). Airborne visual detection and tracking of cooperative UAVs exploiting deep learning. Sensors, 19.","DOI":"10.3390\/s19194332"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/3035\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:10:55Z","timestamp":1760177455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/3035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,17]]},"references-count":41,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["rs12183035"],"URL":"https:\/\/doi.org\/10.3390\/rs12183035","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,17]]}}}