{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,15]],"date-time":"2025-08-15T01:05:34Z","timestamp":1755219934137,"version":"3.43.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"name":"National Science Foundation (NSF) CNS core","award":["1909520 and 2246698"],"award-info":[{"award-number":["1909520 and 2246698"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2025,8,31]]},"abstract":"<jats:p>\n            Edge computing and AI can potentially empower Unmanned Aerial Vehicle (UAV) systems with automated decision-making and resource support for monitoring in future science tasks such as emergency response, search and rescue, inspections, and wildfires. However, it is challenging to achieve autonomous and robust monitoring in such systems, given the dynamic environmental situations, the limited capabilities, and the unbalanced load of the UAVs. For instance, the monitoring activity levels at different locations might vary, which leads to an unbalanced monitoring load for the corresponding UAVs. Moreover, the UAVs require regular recharging\/maintenance and can have malfunctions that will disrupt the monitoring task. In this article, we develop a novel proactive and robust Edge-UAV framework named\n            <jats:italic toggle=\"yes\">PREUS<\/jats:italic>\n            to enable autonomous and efficient monitoring of dynamic environments when faced with dynamic environment situations and various UAV workload stresses that can jeopardize the monitoring performance. PREUS features a unique design to handle the varying UAV workload stress of the monitored area. It incorporates novel spatial, temporal, and proactive exploration vs. exploitation planning to balance the UAVs\u2019 workloads in various locations with fluctuating activities. In addition, PREUS includes novel Deep Reinforcement Learning (DRL) design specialized to maximize coverage in the complex environments and provides faster and stabler decision-making capabilities than the existing methods. The positive impact brought by PREUS is demonstrated in terms of the achieved monitoring performance, including coverage and balanced UAV load.\n          <\/jats:p>","DOI":"10.1145\/3733836","type":"journal-article","created":{"date-parts":[[2025,5,6]],"date-time":"2025-05-06T10:45:56Z","timestamp":1746528356000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["PREUS: Proactive and Robust Edge-UAV Systems for Autonomous Monitoring in Dynamic Environments"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5960-0663","authenticated-orcid":false,"given":"Ismail","family":"Alqerm","sequence":"first","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8226-4183","authenticated-orcid":false,"given":"Nuo","family":"Cheng","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4881-5711","authenticated-orcid":false,"given":"Jianli","family":"Pan","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,8,7]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"Yun Chao Hu Milan Patel Dario Sabella Nurit Sprecher and Valerie Young. 2015. Mobile Edge Computing\u2014A Key Technology towards 5G. ETSI White Paper 11.11 1\u201316."},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2009.82"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA46639.2022.9812025"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2019.2920284"},{"key":"e_1_3_1_6_2","unstructured":"Jayson Boubin Codi Burley Peida Han Bowen Li Barry Porter and Christopher Stewart. 2021. Programming and deploying autonomous swarms using multi-agent reinforcement learning. arXiv:2105.10605. Retrieved from https:\/\/arxiv.org\/abs\/2105.10605"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3396864.3399701"},{"issue":"8","key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"1768","DOI":"10.2514\/1.G004106","article-title":"Distributed wildfire surveillance with autonomous aircraft using deep reinforcement learning","volume":"42","author":"Julian Kyle","year":"2019","unstructured":"Kyle Julian and Mykel Kochenderfer. 2019. Distributed wildfire surveillance with autonomous aircraft using deep reinforcement learning. Journal of Guidance, Control, and Dynamics 42, 8 (2019), 1768\u20131778.","journal-title":"Journal of Guidance, Control, and Dynamics"},{"key":"e_1_3_1_9_2","first-page":"1","volume-title":"Proceedings of the 27th European Signal Processing Conference (EUSIPCO)","author":"Baldazo D.","year":"2019","unstructured":"D. Baldazo, J. Parras, and S. Zazo. 2019. Decentralized multi-agent deep reinforcement learning in swarms of drones for flood monitoring. In Proceedings of the 27th European Signal Processing Conference (EUSIPCO), 1\u20135."},{"issue":"1300","key":"e_1_3_1_10_2","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1017\/aer.2021.112","article-title":"Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning","volume":"126","author":"Xu D.","year":"2022","unstructured":"D. Xu and G. Chen. 2022. Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning. The Aeronautical Journal 126, 1300 (2022), 932\u2013951.","journal-title":"The Aeronautical Journal"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2988249"},{"key":"e_1_3_1_12_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2022.3227558","article-title":"A reinforcement learning-based fire warning and suppression system using unmanned aerial vehicles","volume":"72","author":"Panahi F. H.","year":"2022","unstructured":"F. H. Panahi, F. H. Panahi, and T. Ohtsuki. 2022. A reinforcement learning-based fire warning and suppression system using unmanned aerial vehicles. IEEE Transactions on Instrumentation and Measurement 72 (2022), 1\u201316.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.011.2000648"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2022.3143175"},{"key":"e_1_3_1_15_2","first-page":"143","volume-title":"Proceedings of the 2023 International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT)","author":"Kapoor R.","year":"2023","unstructured":"R. Kapoor, R. Kumar, A. Kapoor, R. Kapoor, and Gurumurthy. 2023. Artificial intelligence based real time surveillance and object localization system. In Proceedings of the 2023 International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT), 143\u2013147."},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2010.85"},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","unstructured":"Vincent Francois-Lavet Peter Henderson Riashat Islam Marc G. Bellemare and Joelle Pineau. 2018. An introduction to deep reinforcement learning. Foundations and Trends in Machine Learning 11 3\u20134 (2018) 219\u2013354.","DOI":"10.1561\/2200000071"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2987820"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3122801"},{"issue":"3","key":"e_1_3_1_20_2","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1080\/15472450.2019.1652826","article-title":"An efficient multiple access control protocol for directional dense urban traffic surveillance system","volume":"24","author":"Yan Zhongjiang","year":"2020","unstructured":"Zhongjiang Yan, Bo Li, Qianqian Li, and Mao Yang. 2020. An efficient multiple access control protocol for directional dense urban traffic surveillance system. Journal of Intelligent Transportation Systems 24, 3, (2020), 237\u2013253.","journal-title":"Journal of Intelligent Transportation Systems"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2705560"},{"key":"e_1_3_1_22_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Communications (ICC)","author":"Challita U.","year":"2018","unstructured":"U. Challita, W. Saad, and C. Bettstetter. 2018. Deep reinforcement learning for interference-aware path planning of cellular-connected UAVs. In Proceedings of the IEEE International Conference on Communications (ICC), 1\u20137."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2933002"},{"key":"e_1_3_1_24_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Communications (ICC)","author":"Xu R.","year":"2018","unstructured":"R. Xu, S. Y. Nikouei, Y. Chen, A. Polunchenko, S. Song, C. Deng, and T. R. Faughnan. 2018. Real-time human objects tracking for smart surveillance at the edge. In Proceedings of the IEEE International Conference on Communications (ICC), 1\u20136."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2971780"},{"issue":"10","key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"7900","DOI":"10.1109\/TNNLS.2022.3146976","article-title":"Game of drones: Multi-UAV pursuit-evasion game with online motion planning by deep reinforcement learning","volume":"34","author":"Zhang R.","year":"2023","unstructured":"R. Zhang, Q. Zong, X. Zhang, L. Dou, and B. Tian. 2023. Game of drones: Multi-UAV pursuit-evasion game with online motion planning by deep reinforcement learning. IEEE Transactions on Neural Networks and Learning Systems 34, 10 (2023), 7900\u20137909.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"5","key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"2940","DOI":"10.1109\/TNSE.2022.3171600","article-title":"Trajectory design and resource allocation for multi-UAV networks: Deep reinforcement learning approaches","volume":"10","author":"Chang Z.","year":"2023","unstructured":"Z. Chang, H. Deng, L. You, G. Min, S. Garg, and G. Kaddoum. 2023. Trajectory design and resource allocation for multi-UAV networks: Deep reinforcement learning approaches. IEEE Transactions on Network Science and Engineering 10, 5 (2023), 2940\u20132951.","journal-title":"IEEE Transactions on Network Science and Engineering"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1109\/ICCAR55106.2022.9782602","volume-title":"Proceedings of the 2022 8th International Conference on Control, Automation and Robotics (ICCAR)","author":"Seel A.","year":"2022","unstructured":"A. Seel, F. Kreutzjans, B. Kuster, M. Stonis, and L. Overmeyer. 2022. Deep reinforcement learning based UAV for indoor navigation and exploration in unknown environments. In Proceedings of the 2022 8th International Conference on Control, Automation and Robotics (ICCAR), 388\u2013393."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2022.3143839"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2022.3141876"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2023.3277850"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1109\/ICUAS51884.2021.9476756","volume-title":"Proceedings of the 2021 International Conference on Unmanned Aircraft Systems (ICUAS)","author":"Peake A.","year":"2021","unstructured":"A. Peake, J. McCalmon, Y. Zhang, D. Myers, S. Alqahtani, and P. Pauca. 2021. Deep reinforcement learning for adaptive exploration of unknown environments. In Proceedings of the 2021 International Conference on Unmanned Aircraft Systems (ICUAS), 265\u2013274."},{"key":"e_1_3_1_33_2","unstructured":"P. Xu Z. Wen H. Zhao and Q. Gu. 2020. Neural contextual bandits with deep representation and shallow exploration. arXiv:2105.10605. Retrieved from https:\/\/arxiv.org\/abs\/2012.01780"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3733836","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T14:26:34Z","timestamp":1754576794000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3733836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,7]]},"references-count":32,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8,31]]}},"alternative-id":["10.1145\/3733836"],"URL":"https:\/\/doi.org\/10.1145\/3733836","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2025,8,7]]},"assertion":[{"value":"2024-05-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}