{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:29:41Z","timestamp":1775665781032,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T00:00:00Z","timestamp":1680220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Prince Sultan University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Unmanned aerial vehicles (UAVs) equipped with computer vision capabilities have been widely utilized in several remote sensing applications, such as precision agriculture, environmental monitoring, and surveillance. However, the commercial usage of these UAVs in such applications is mostly performed manually, with humans being responsible for data observation or offline processing after data collection due to the lack of on board AI on edge. Other technical methods rely on the cloud computation offloading of AI applications, where inference is conducted on video streams, which can be unscalable and infeasible due to remote cloud servers\u2019 limited connectivity and high latency. To overcome these issues, this paper presents a new approach to using edge computing in drones to enable the processing of extensive AI tasks onboard UAVs for remote sensing. We propose a cloud\u2013edge hybrid system architecture where the edge is responsible for processing AI tasks and the cloud is responsible for data storage, manipulation, and visualization. We designed AERO, a UAV brain system with onboard AI capability using GPU-enabled edge devices. AERO is a novel multi-stage deep learning module that combines object detection (YOLOv4 and YOLOv7) and tracking (DeepSort) with TensorRT accelerators to capture objects of interest with high accuracy and transmit data to the cloud in real time without redundancy. AERO processes the detected objects over multiple consecutive frames to maximize detection accuracy. The experiments show a reduced false positive rate (0.7%), a low percentage of tracking identity switches (1.6%), and an average inference speed of 15.5 FPS on a Jetson Xavier AGX edge device.<\/jats:p>","DOI":"10.3390\/rs15071873","type":"journal-article","created":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T08:27:27Z","timestamp":1680251247000},"page":"1873","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["AERO: AI-Enabled Remote Sensing Observation with Onboard Edge Computing in UAVs"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3787-7423","authenticated-orcid":false,"given":"Anis","family":"Koubaa","sequence":"first","affiliation":[{"name":"College of Computer & Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0795-132X","authenticated-orcid":false,"given":"Adel","family":"Ammar","sequence":"additional","affiliation":[{"name":"College of Computer & Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0518-852X","authenticated-orcid":false,"given":"Mohamed","family":"Abdelkader","sequence":"additional","affiliation":[{"name":"College of Computer & Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia"}]},{"given":"Yasser","family":"Alhabashi","sequence":"additional","affiliation":[{"name":"College of Computer & Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6381-4250","authenticated-orcid":false,"given":"Lahouari","family":"Ghouti","sequence":"additional","affiliation":[{"name":"College of Computer & Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,31]]},"reference":[{"key":"ref_1","unstructured":"Zanelli, E., and B\u00f6decke, H. (2022). Global Drone Market Report 2022\u20132030, Drone Industry Insights. Technical report."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ammar, A., Koubaa, A., and Benjdira, B. (2021). Deep-Learning-Based Automated Palm Tree Counting and Geolocation in Large Farms from Aerial Geotagged Images. Agronomy, 11.","DOI":"10.3390\/agronomy11081458"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gallego, V., Rossi, M., and Brunelli, D. (2015, January 13\u201315). Unmanned aerial gas leakage localization and mapping using microdrones. Proceedings of the 2015 IEEE Sensors Applications Symposium (SAS), Zadar, Croatia.","DOI":"10.1109\/SAS.2015.7133629"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Abdelkader, M., Shaqura, M., Claudel, C.G., and Gueaieb, W. (2013, January 28\u201331). A UAV based system for real time flash flood monitoring in desert environments using Lagrangian microsensors. Proceedings of the 2013 International Conference on Unmanned Aircraft Systems (ICUAS), Atlanta, GA, USA.","DOI":"10.1109\/ICUAS.2013.6564670"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Abdelkader, M., Shaqura, M., Ghommem, M., Collier, N., Calo, V., and Claudel, C. (2014, January 27\u201330). Optimal multi-agent path planning for fast inverse modeling in UAV-based flood sensing applications. Proceedings of the 2014 International Conference on Unmanned Aircraft Systems (ICUAS), Orlando, FL, USA.","DOI":"10.1109\/ICUAS.2014.6842239"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Benjdira, B., Bazi, Y., Koubaa, A., and Ouni, K. (2019). Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images. Remote Sens., 11.","DOI":"10.3390\/rs11111369"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Benjdira, B., Ammar, A., Koubaa, A., and Ouni, K. (2020). Data-Efficient Domain Adaptation for Semantic Segmentation of Aerial Imagery Using Generative Adversarial Networks. Appl. Sci., 10.","DOI":"10.3390\/app10031092"},{"key":"ref_8","unstructured":"(2023, March 01). Gulf News, Saudi Arabia: 131 People Went Missing in Desert Last Year. Available online: https:\/\/gulfnews.com\/world\/gulf\/saudi\/saudi-arabia-131-people-went-missing-in-desert-last-year-1.78403752."},{"key":"ref_9","unstructured":"Kobaa, A. (2022). System and Method for Service Oriented Cloud Based Management of Internet-of-Drones. (US11473913B2), U.S. Patent."},{"key":"ref_10","unstructured":"(2023, March 01). Fortune Buisness Insights, Drone Surveillance Market. Available online: https:\/\/www.fortunebusinessinsights.com\/industry-reports\/drone-surveillance-market-100511."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ammar, A., Koubaa, A., Ahmed, M., Saad, A., and Benjdira, B. (2021). Vehicle detection from aerial images using deep learning: A comparative study. Electronics, 10.","DOI":"10.3390\/electronics10070820"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yeom, S., and Cho, I.J. (2019). Detection and tracking of moving pedestrians with a small unmanned aerial vehicle. Appl. Sci., 9.","DOI":"10.3390\/app9163359"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ding, J., Zhang, J., Zhan, Z., Tang, X., and Wang, X. (2022). A Precision Efficient Method for Collapsed Building Detection in Post-Earthquake UAV Images Based on the Improved NMS Algorithm and Faster R-CNN. Remote Sens., 14.","DOI":"10.3390\/rs14030663"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Koubaa, A., Ammar, A., Alahdab, M., Kanhouch, A., and Azar, A.T. (2020). DeepBrain: Experimental Evaluation of Cloud-Based Computation Offloading and Edge Computing in the Internet-of-Drones for Deep Learning Applications. Sensors, 20.","DOI":"10.3390\/s20185240"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hossain, S., and Lee, D.j. (2019). Deep learning-based real-time multiple-object detection and tracking from aerial imagery via a flying robot with GPU-based embedded devices. Sensors, 19.","DOI":"10.3390\/s19153371"},{"key":"ref_16","unstructured":"Queralta, J.P., Raitoharju, J., Gia, T.N., Passalis, N., and Westerlund, T. (2020). Autosos: Towards multi-uav systems supporting maritime search and rescue with lightweight ai and edge computing. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Vasilopoulos, E., Vosinakis, G., Krommyda, M., Karagiannidis, L., Ouzounoglou, E., and Amditis, A. (2022). A Comparative Study of Autonomous Object Detection Algorithms in the Maritime Environment Using a UAV Platform. Computation, 10.","DOI":"10.3390\/computation10030042"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"281","DOI":"10.14358\/PERS.81.4.281","article-title":"Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs)","volume":"81","author":"Pajares","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-013-0120-x","article-title":"UAV for 3D mapping applications: A review","volume":"6","author":"Nex","year":"2014","journal-title":"Appl. Geomat."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.rse.2015.12.029","article-title":"UAVs as remote sensing platform in glaciology: Present applications and future prospects","volume":"175","author":"Bhardwaj","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2427","DOI":"10.1080\/01431161.2016.1252477","article-title":"Forestry applications of UAVs in Europe: A review","volume":"38","author":"Torresan","year":"2017","journal-title":"Int. J. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.3390\/rs11121443","article-title":"Unmanned Aerial Vehicle for Remote Sensing Applications\u2014A Review","volume":"11","author":"Yao","year":"2019","journal-title":"Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Messous, M.A., Hellwagner, H., Senouci, S.M., Emini, D., and Schnieders, D. (2020, January 7\u201311). Edge computing for visual navigation and mapping in a UAV network. Proceedings of the ICC 2020\u20132020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9149087"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5723","DOI":"10.1109\/TVT.2020.2982508","article-title":"Path Planning for UAV-Mounted Mobile Edge Computing with Deep Reinforcement Learning","volume":"69","author":"Liu","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_25","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing Atari with Deep Reinforcement Learning. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"131996","DOI":"10.1109\/ACCESS.2022.3229171","article-title":"Cellular Network-Supported Machine Learning Techniques for Autonomous UAV Trajectory Planning","volume":"10","author":"Afifi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2630","DOI":"10.1109\/JSAC.2022.3191329","article-title":"Multiagent Collaborative Learning for UAV Enabled Wireless Networks","volume":"40","author":"Xia","year":"2022","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"10863","DOI":"10.1109\/TVT.2022.3182647","article-title":"Digital twin assisted task offloading for aerial edge computing and networks","volume":"71","author":"Li","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"21676","DOI":"10.1109\/JIOT.2022.3182119","article-title":"Deep Graph-based Reinforcement Learning for Joint Cruise Control and Task Offloading for Aerial Edge Internet-of-Things (EdgeIoT)","volume":"9","author":"Li","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6716","DOI":"10.1109\/TVT.2022.3160746","article-title":"Path Planning for the Dynamic UAV-Aided Wireless Systems Using Monte Carlo Tree Search","volume":"71","author":"Qian","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1109\/TNET.2022.3140796","article-title":"Task Offloading for Post-Disaster Rescue in Unmanned Aerial Vehicles Networks","volume":"30","author":"Wang","year":"2022","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5629","DOI":"10.1109\/TWC.2022.3142365","article-title":"Online Trajectory and Resource Optimization for Stochastic UAV-Enabled MEC Systems","volume":"21","author":"Yang","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"10640","DOI":"10.1109\/JIOT.2021.3123429","article-title":"Computation Bits Maximization in UAV-Enabled Mobile-Edge Computing System","volume":"9","author":"Lyu","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1108\/WJE-12-2016-0148","article-title":"Determining optimal policy for emergency department using Markov decision process","volume":"14","author":"Hamasha","year":"2017","journal-title":"World J. Eng."},{"key":"ref_35","first-page":"2905","article-title":"An Efficient Medical Image Deep Fusion Model Based on Convolutional Neural Networks","volume":"74","author":"Sedik","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"663","DOI":"10.3390\/axioms11120663","article-title":"Sketch-Based Retrieval Approach Using Artificial Intelligence Algorithms for Deep Vision Feature Extraction","volume":"11","author":"Sabry","year":"2022","journal-title":"Axioms"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Meier, L., Honegger, D., and Pollefeys, M. (2015, January 26\u201330). PX4: A node-based multithreaded open source robotics framework for deeply embedded platforms. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7140074"},{"key":"ref_38","unstructured":"Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple online and realtime tracking with a deep association metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Shafi, O., Rai, C., Sen, R., and Ananthanarayanan, G. (2021, January 7\u20139). Demystifying TensorRT: Characterizing Neural Network Inference Engine on Nvidia Edge Devices. Proceedings of the 2021 IEEE International Symposium on Workload Characterization (IISWC), Storrs, CT, USA.","DOI":"10.1109\/IISWC53511.2021.00030"},{"key":"ref_41","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AN, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ammar, A., Koubaa, A., Boulila, W., Benjdira, B., and Alhabashi, Y. (2023). A Multi-Stage Deep-Learning-Based Vehicle and License Plate Recognition System with Real-Time Edge Inference. Sensors, 23.","DOI":"10.3390\/s23042120"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1109\/TNSE.2021.3055835","article-title":"Cloud Versus Edge Deployment Strategies of Real-Time Face Recognition Inference","volume":"9","author":"Koubaa","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"7380","DOI":"10.1109\/TPAMI.2021.3119563","article-title":"Detection and Tracking Meet Drones Challenge","volume":"44","author":"Zhu","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Krichen, M., Adoni, W.Y.H., Mihoub, A., Alzahrani, M.Y., and Nahhal, T. (2022, January 22\u201324). Security Challenges for Drone Communications: Possible Threats, Attacks and Countermeasures. Proceedings of the 2022 2nd International Conference of Smart Systems and Emerging Technologies (SMARTTECH), Riyadh, Saudi Arabia.","DOI":"10.1109\/SMARTTECH54121.2022.00048"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Ko, Y., Kim, J., Duguma, D.G., Astillo, P.V., You, I., and Pau, G. (2021). Drone secure communication protocol for future sensitive applications in military zone. Sensors, 21.","DOI":"10.3390\/s21062057"},{"key":"ref_48","unstructured":"Khan, N.A., Jhanjhi, N.Z., Brohi, S.N., and Nayyar, A. (2020). Drones in Smart-Cities, Elsevier."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1873\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:07:33Z","timestamp":1760123253000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1873"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,31]]},"references-count":48,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["rs15071873"],"URL":"https:\/\/doi.org\/10.3390\/rs15071873","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,31]]}}}