{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T06:50:48Z","timestamp":1780642248811,"version":"3.54.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T00:00:00Z","timestamp":1563926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T00:00:00Z","timestamp":1563926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["IPSJ T Comput Vis Appl"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Commercial Unmanned aerial vehicle (UAV) industry, which is publicly known as <jats:italic>drone<\/jats:italic>, has seen a tremendous increase in last few years, making these devices highly accessible to public. This phenomenon has immediately raised security concerns due to fact that these devices can intentionally or unintentionally cause serious hazards. In order to protect critical locations, the academia and industry have proposed several solutions in recent years. Computer vision is extensively used to detect drones autonomously compared to other proposed solutions such as RADAR, acoustics and RF signal analysis thanks to its robustness. Among these computer vision-based approaches, we see the preference of deep learning algorithms thanks to their effectiveness. In this paper, we are presenting an autonomous drone detection and tracking system which uses a static wide-angle camera and a lower-angle camera mounted on a rotating turret. In order to use memory and time efficiently, we propose a combined multi-frame deep learning detection technique, where the frame coming from the zoomed camera on the turret is overlaid on the wide-angle static camera\u2019s frame. With this approach, we are able to build an efficient pipeline where the initial detection of small sized aerial intruders on the main image plane and their detection on the zoomed image plane is performed simultaneously, minimizing the cost of resource exhaustive detection algorithm. In addition to this, we present the integral system including tracking algorithms, deep learning classification architectures and the protocols.<\/jats:p>","DOI":"10.1186\/s41074-019-0059-x","type":"journal-article","created":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T14:04:55Z","timestamp":1563977095000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":133,"title":["Deep learning-based strategies for the detection and tracking of drones using several cameras"],"prefix":"10.1186","volume":"11","author":[{"given":"Eren","family":"Unlu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emmanuel","family":"Zenou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas","family":"Riviere","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul-Edouard","family":"Dupouy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,7,24]]},"reference":[{"key":"59_CR1","unstructured":"Valentak Z (2018) Drone market share analysis. http:\/\/www.dronesglobe.com\/news\/drone-market-share-analysis-predictions-2018\/."},{"key":"59_CR2","unstructured":"Jansen B (2015) Drone crash at white house reveals security risks. USA Today."},{"key":"59_CR3","unstructured":"Jouan A (2014) Survols de centrales: un expert reconnu s\u2019 inqui\u00e8te. http:\/\/www.lefigaro.fr\/actualite-france\/2014\/11\/25\/01016-20141125ARTFIG00024-survols-de-centrales-un-expert-reconnu-s-inquiete.php."},{"key":"59_CR4","unstructured":"Serna J (2016) Lufthansa jet and drone nearly collide near lax. LA Times."},{"key":"59_CR5","unstructured":"Gallagher S (2013) German chancellor\u2019s drone \u2018attack\u2019 shows the threat of weaponized uavs. Ars Technica."},{"key":"59_CR6","unstructured":"Dinan S (2017) Drones become latest tool drug cartels use to smuggle drugs into u.s. https:\/\/www.washingtontimes.com\/news\/2017\/aug\/20\/mexican-drug-cartels-using-drones-to-smuggle-heroi\/."},{"key":"59_CR7","unstructured":"Zhang L, Young S (2018) China busts smugglers using drones to transport smartphones: state media. https:\/\/www.reuters.com\/article\/us-china-crime-smartphones-smugglers\/china-busts-smugglers-using-drones-to-transport-smartphones-state-media-idUSKBN1H60BT."},{"key":"59_CR8","unstructured":"BBC (2018) Charges over drone drug smuggling into prisons. https:\/\/www.bbc.com\/news\/uk-england-43413134."},{"key":"59_CR9","doi-asserted-by":"crossref","unstructured":"Nguyen P, Ravindranatha M, Nguyen A, Han R, Vu T (2016) Investigating cost-effective rf-based detection of drones In: Proceedings of the 2nd Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian Use, 17\u201322.. ACM.","DOI":"10.1145\/2935620.2935632"},{"key":"59_CR10","doi-asserted-by":"crossref","unstructured":"Liu H, Wei Z, Chen Y, Pan J, Lin L, Ren Y (2017) Drone detection based on an audio-assisted camera array In: Multimedia Big Data (BigMM), 2017 IEEE Third International Conference On, 402\u2013406.. IEEE.","DOI":"10.1109\/BigMM.2017.57"},{"key":"59_CR11","doi-asserted-by":"crossref","unstructured":"Hommes A, Shoykhetbrod A, Noetel D, Stanko S, Laurenzis M, Hengy S, Christnacher F (2016) Detection of acoustic, electro-optical and radar signatures of small unmanned aerial vehicles In: Target and Background Signatures II, vol. 9997, 999701.. International Society for Optics and Photonics.","DOI":"10.1117\/12.2242180"},{"key":"59_CR12","doi-asserted-by":"crossref","unstructured":"Hammer M, Hebel M, Laurenzis M, Arens M (2018) Lidar-based detection and tracking of small uavs In: Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures, vol. 10799, 107990.. International Society for Optics and Photonics.","DOI":"10.1117\/12.2325702"},{"key":"59_CR13","doi-asserted-by":"crossref","unstructured":"M\u00fcller T (2017) Robust drone detection for day\/night counter-uav with static vis and swir cameras In: Ground\/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR VIII, vol. 10190, 1019018.. International Society for Optics and Photonics.","DOI":"10.1117\/12.2262575"},{"key":"59_CR14","doi-asserted-by":"crossref","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 779\u2013788.","DOI":"10.1109\/CVPR.2016.91"},{"key":"59_CR15","doi-asserted-by":"crossref","unstructured":"Mendis GJ, Randeny T, Wei J, Madanayake A (2016) Deep learning based doppler radar for micro uas detection and classification In: Military Communications Conference, MILCOM 2016-2016 IEEE, 924\u2013929.. IEEE.","DOI":"10.1109\/MILCOM.2016.7795448"},{"key":"59_CR16","doi-asserted-by":"crossref","unstructured":"Ganti SR, Kim Y (2016) Implementation of detection and tracking mechanism for small uas In: Unmanned Aircraft Systems (ICUAS), 2016 International Conference On, 1254\u20131260.. IEEE.","DOI":"10.1109\/ICUAS.2016.7502513"},{"key":"59_CR17","doi-asserted-by":"crossref","unstructured":"Drozdowicz J, Wielgo M, Samczynski P, Kulpa K, Krzonkalla J, Mordzonek M, Bryl M, Jakielaszek Z (2016) 35 ghz fmcw drone detection system In: Radar Symposium (IRS), 2016 17th International, 1\u20134.. IEEE.","DOI":"10.1109\/IRS.2016.7497351"},{"key":"59_CR18","doi-asserted-by":"crossref","unstructured":"Kwag Y-K, Woo I-S, Kwak H-Y, Jung Y-H (2016) Multi-mode sdr radar platform for small air-vehicle drone detection In: Radar (RADAR), 2016 CIE International Conference On, 1\u20134.. IEEE.","DOI":"10.1109\/RADAR.2016.8059254"},{"key":"59_CR19","doi-asserted-by":"crossref","unstructured":"Laurenzis M, Hengy S, Hommes A, Kloeppel F, Shoykhetbrod A, Geibig T, Johannes W, Naz P, Christnacher F (2017) Multi-sensor field trials for detection and tracking of multiple small unmanned aerial vehicles flying at low altitude In: Signal Processing, Sensor\/Information Fusion, and Target Recognition XXVI, vol. 10200, 102001.. International Society for Optics and Photonics.","DOI":"10.1117\/12.2261930"},{"key":"59_CR20","doi-asserted-by":"crossref","unstructured":"Kim BH, Khan D, Bohak C, Kim JK, Choi W, Lee HJ, Kim MY (2018) Ladar data generation fused with virtual targets and visualization for small drone detection system In: Technologies for Optical Countermeasures XV, vol. 10797, 107970.. International Society for Optics and Photonics.","DOI":"10.1117\/12.2500525"},{"key":"59_CR21","unstructured":"Hauzenberger L, Holmberg Ohlsson E (2015) Drone detection using audio analysis."},{"issue":"9","key":"59_CR22","doi-asserted-by":"publisher","first-page":"155014771773292","DOI":"10.1177\/1550147717732920","volume":"13","author":"SY Nam","year":"2017","unstructured":"Nam SY, Joshi GP (2017) Unmanned aerial vehicle localization using distributed sensors. Int J Distrib Sensor Networks 13(9):1550147717732920.","journal-title":"Int J Distrib Sensor Networks"},{"issue":"7553","key":"59_CR23","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436.","journal-title":"Nature"},{"key":"59_CR24","doi-asserted-by":"crossref","unstructured":"Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: Closing the gap to human-level performance in face verification In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1701\u20131708.","DOI":"10.1109\/CVPR.2014.220"},{"key":"59_CR25","doi-asserted-by":"crossref","unstructured":"Schumann A, Sommer L, Klatte J, Schuchert T, Beyerer J (2017) Deep cross-domain flying object classification for robust uav detection In: Advanced Video and Signal Based Surveillance (AVSS), 2017 14th IEEE International Conference On, 1\u20136.. IEEE.","DOI":"10.1109\/AVSS.2017.8078558"},{"key":"59_CR26","doi-asserted-by":"crossref","unstructured":"Aker C, Kalkan S (2017) Using deep networks for drone detection. arXiv preprint arXiv:1706.05726.","DOI":"10.1109\/AVSS.2017.8078539"},{"key":"59_CR27","doi-asserted-by":"crossref","unstructured":"Saqib M, Khan SD, Sharma N, Blumenstein M (2017) A study on detecting drones using deep convolutional neural networks In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 1\u20135.. IEEE.","DOI":"10.1109\/AVSS.2017.8078541"},{"key":"59_CR28","unstructured":"(2018) How Droneshield works?. https:\/\/www.droneshield.com\/how-droneshield-works\/. Accessed: 22 Oct 2018."},{"key":"59_CR29","doi-asserted-by":"crossref","unstructured":"(2018) Introduction to Dedrones Airspace Security Platform. https:\/\/www.dedrone.com\/webinars\/introduction-to-dedrones-airspace-security-platform-11-28-2018. Accessed: 22 Oct 2018.","DOI":"10.1201\/b16134-7"},{"key":"59_CR30","unstructured":"(2018) Gryphon Skylight System. Detect, track and classify moving objects in your airspace. https:\/\/www.srcinc.com\/pdf\/Radars-and-Sensors-Gryphon-Skylight.pdf. Accessed: 22 Oct 2018."},{"issue":"4","key":"59_CR31","first-page":"83","volume":"14","author":"H Fan","year":"2018","unstructured":"Fan H, Zheng L, Yan C, Yang Y (2018) Unsupervised person re-identification: Clustering and fine-tuning. ACM Trans Multimed Comput Commun Appl (TOMM) 14(4):83.","journal-title":"ACM Trans Multimed Comput Commun Appl (TOMM)"},{"key":"59_CR32","doi-asserted-by":"crossref","unstructured":"Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: A benchmark In: Proceedings of the IEEE International Conference on Computer Vision, 1116\u20131124.","DOI":"10.1109\/ICCV.2015.133"},{"key":"59_CR33","unstructured":"Redmon J, Farhadi A (2018) Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767."},{"key":"59_CR34","unstructured":"Cheng B, Wei Y, Shi H, Feris R, Xiong J, Huang T (2018) Decoupled classification refinement: Hard false positive suppression for object detection. arXiv preprint arXiv:1810.04002."},{"issue":"3","key":"59_CR35","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1109\/TSMCC.2004.829274","volume":"34","author":"W Hu","year":"2004","unstructured":"Hu W, Tan T, Wang L, Maybank S (2004) A survey on visual surveillance of object motion and behaviors. IEEE Trans Syst Man Cybern Part C (Appl Rev) 34(3):334\u2013352.","journal-title":"IEEE Trans Syst Man Cybern Part C (Appl Rev)"},{"key":"59_CR36","doi-asserted-by":"crossref","unstructured":"Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. IEEE.","DOI":"10.1109\/ICIP.2017.8296962"},{"issue":"1","key":"59_CR37","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1109\/7.745696","volume":"35","author":"H Wang","year":"1999","unstructured":"Wang H, Kirubarajan T, Bar-Shalom Y (1999) Precision large scale air traffic surveillance using imm\/assignment estimators. IEEE Trans Aerosp Electron Syst 35(1):255\u2013266.","journal-title":"IEEE Trans Aerosp Electron Syst"},{"issue":"4","key":"59_CR38","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1145\/1177352.1177355","volume":"38","author":"A Yilmaz","year":"2006","unstructured":"Yilmaz A, Javed O, Shah M (2006) Object tracking: A survey. ACM Comput Surv (CSUR) 38(4):13.","journal-title":"ACM Comput Surv (CSUR)"},{"key":"59_CR39","doi-asserted-by":"crossref","unstructured":"Dong X, Zheng L, Ma F, Yang Y, Meng D (2018) Few-example object detection with model communication. IEEE Trans Pattern Anal Mach Intell.","DOI":"10.1109\/TPAMI.2018.2844853"},{"key":"59_CR40","unstructured":"Lienhart R, Maydt J (2002) An extended set of haar-like features for rapid object detection In: Image Processing. 2002. Proceedings. 2002 International Conference On, vol. 1.. IEEE."},{"key":"59_CR41","doi-asserted-by":"crossref","unstructured":"Zivkovic Z (2004) Improved adaptive gaussian mixture model for background subtraction In: Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference On, vol. 2, 28\u201331.. IEEE.","DOI":"10.1109\/ICPR.2004.1333992"},{"key":"59_CR42","doi-asserted-by":"crossref","unstructured":"Wu Y, Lin Y, Dong X, Yan Y, Bian W, Yang Y (2019) Progressive learning for person re-identification with one example. IEEE Trans Image Process.","DOI":"10.1109\/TIP.2019.2891895"},{"key":"59_CR43","doi-asserted-by":"crossref","unstructured":"Coluccia A, Ghenescu M, Piatrik T, De Cubber G, Schumann A, Sommer L, Klatte J, Schuchert T, Beyerer J, Farhadi M, et al (2017) Drone-vs-bird detection challenge at ieee avss2017 In: Advanced Video and Signal Based Surveillance (AVSS), 2017 14th IEEE International Conference On, 1\u20136.. IEEE.","DOI":"10.1109\/AVSS.2017.8078464"}],"container-title":["IPSJ Transactions on Computer Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-019-0059-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41074-019-0059-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-019-0059-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:14:27Z","timestamp":1627647267000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41074-019-0059-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,24]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["59"],"URL":"https:\/\/doi.org\/10.1186\/s41074-019-0059-x","relation":{},"ISSN":["1882-6695"],"issn-type":[{"value":"1882-6695","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,24]]},"assertion":[{"value":"21 November 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 May 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"7"}}