{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T09:21:19Z","timestamp":1767345679949,"version":"3.41.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T00:00:00Z","timestamp":1721001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"crossref","award":["DP220101823 and LE220100078"],"award-info":[{"award-number":["DP220101823 and LE220100078"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2024,8,31]]},"abstract":"<jats:p>We propose a novel framework for achieving precision landing in drone services. The proposed framework consists of two distinct decoupled modules, each designed to address a specific aspect of landing accuracy. The first module is concerned with intrinsic errors, where new error models are introduced. This includes a spherical error model that takes into account the orientation of the drone. Additionally, we propose a live position correction algorithm that employs the error models to correct for intrinsic errors in real time. The second module focuses on external wind forces and presents an aerodynamics model with wind generation to simulate the drone\u2019s physical environment. We utilize reinforcement learning to train the drone in simulation with the goal of landing precisely under dynamic wind conditions. Experimental results, conducted through simulations and validated in the physical world, demonstrate that our proposed framework significantly increases landing accuracy while maintaining a low onboard computational cost.<\/jats:p>","DOI":"10.1145\/3670997","type":"journal-article","created":{"date-parts":[[2024,6,4]],"date-time":"2024-06-04T11:28:37Z","timestamp":1717500517000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Using Reinforcement Learning and Error Models for Drone Precise Landing"],"prefix":"10.1145","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-9737-138X","authenticated-orcid":false,"given":"Sepehr","family":"Saryazdi","sequence":"first","affiliation":[{"name":"School of Computer Science, University of Sydney, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7938-4438","authenticated-orcid":false,"given":"Balsam","family":"Alkouz","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1254-8092","authenticated-orcid":false,"given":"Athman","family":"Bouguettaya","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Sydney, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8005-1534","authenticated-orcid":false,"given":"Abdallah","family":"Lakhdari","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Sydney, Australia"}]}],"member":"320","published-online":{"date-parts":[[2024,7,15]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2021.3114266"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3137362"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA40945.2020.9196703"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS49710.2020.00065"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2022.107017"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2021.3051273"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2022.3203033"},{"key":"e_1_3_2_9_2","unstructured":"Grand View Research. n.d. Commercial Drone Market Size & Growth Analysis Report 2030. Retrieved June 5 2024 from https:\/\/www.grandviewresearch.com\/industry-analysis\/global-commercial-drones-market"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Tingting Liang Liang Chen Jian Wu Hai Dong and Athman Bouguettaya. 2016. Meta-path based service recommendation in heterogeneous information networks. In Service-Oriented Computing. Lecture Notes in Computer Science Vol. 9936. Springer 371\u2013386.","DOI":"10.1007\/978-3-319-46295-0_23"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2010.34"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2010.10.004"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAIS.2016.7822448"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICUAS.2015.7152282"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3448891.3448899"},{"key":"e_1_3_2_16_2","unstructured":"Wing. 2021. Check Out the World\u2019s First Rooftop Drone Delivery Service. Retrieved June 5 2024 from https:\/\/blog.wing.com\/2021\/10\/check-out-worlds-first-rooftop-drone.html"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3129917"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2020.2998718"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/PerComWorkshops53856.2022.9767410"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.23919\/ICCAS.2017.8204466"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-015-0271-6"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-009-9355-5"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.2514\/6.2021-1018"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18093171"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913495721"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","unstructured":"Balsam Alkouz and Athman Bouguettaya. 2021. A reinforcement learning approach for re-allocating drone swarm services. In Service-Oriented Computing. Lecture Notes in Computer Science Vol. 13121. Springer 643\u2013651.","DOI":"10.1007\/978-3-030-91431-8_40"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS60048.2023.00068"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIC52973.2021.00019"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS55610.2022.00052"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICUAS.2018.8453468"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCDC55256.2022.10034053"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/SAS51076.2021.9530091"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3129917"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1177\/0020294019847688"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3390\/aerospace9110634"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19061351"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/s23042016"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22020464"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8794351"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2020.04.004"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-015-0270-7"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.17577\/IJERTCONV5IS09057"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.3389\/fmats.2022.904056"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.3390\/robotics9010008"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/su14148825"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387168.3387199"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9340876"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS51168.2021.9635857"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-019-01356-4"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ELEKTRO49696.2020.9130233"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infrared.2022.104147"},{"key":"e_1_3_2_52_2","first-page":"285","volume-title":"Intelligent Robotics and Autonomous Agents","author":"Arkin Ronald C.","year":"2005","unstructured":"Ronald C. Arkin. 2005. Principles of robot motion. In Intelligent Robotics and Autonomous Agents. MIT Press, 285."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2005.1570091"},{"key":"e_1_3_2_54_2","unstructured":"D. P. Hardin T. J. Michaels and E. B. Saff. 2016. A comparison of popular point configurations on \\(\\mathbb {S}^2\\) . arXiv:1607.04590 (2016)."},{"key":"e_1_3_2_55_2","unstructured":"Adi Ben-Israel and Thomas N. E. Greville. 2003. Generalized Inverses: Theory and Applications (2nd ed.). CMS Books in Mathematics. Springer."},{"key":"e_1_3_2_56_2","doi-asserted-by":"crossref","unstructured":"Zhaocong Yuan Adam W. Hall Siqi Zhou Lukas Brunke Melissa Greeff Jacopo Panerati and Angela P. Schoellig. 2022. Safe-Control-Gym: A unified benchmark suite for safe learning-based control and reinforcement learning in robotics. IEEE Robotics and Automation Letters 7 4 (2022) 11142\u201311149.","DOI":"10.1109\/LRA.2022.3196132"},{"key":"e_1_3_2_57_2","unstructured":"Julian F\u00f6rster. 2015. Drag coefficients. In System Identification of the Crazyflie 2.0 Nano Quadrocopter. ETH Zurich 39\u201351."},{"key":"e_1_3_2_58_2","first-page":"31","volume-title":"Automation and Control Engineering","author":"Busoniu Lucian","year":"2009","unstructured":"Lucian Busoniu, Robert Babuska, Bart De Schutter, and Damien Ernst. 2009. Reinforcement learning and dynamic programming using function approximators. In Automation and Control Engineering. CRC Press, 31\u201337."},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(89)90020-8"},{"key":"e_1_3_2_60_2","first-page":"1","article-title":"Stable-Baselines3: Reliable reinforcement learning implementations","volume":"22","author":"Raffin Antonin","year":"2021","unstructured":"Antonin Raffin, Ashley Hill, Adam Gleave, Anssi Kanervisto, Maximilian Ernestus, and Noah Dormann. 2021. Stable-Baselines3: Reliable reinforcement learning implementations. Journal of Machine Learning Research 22 (2021), 1\u20138.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_61_2","unstructured":"Bitcraze AB. 2023. Commander API. Retrieved June 5 2024 from https:\/\/www.bitcraze.io\/documentation\/repository\/crazyflie-lib-python\/master\/api\/cflib\/crazyflie\/commander\/"}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3670997","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3670997","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:55Z","timestamp":1750295395000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3670997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,15]]},"references-count":60,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,8,31]]}},"alternative-id":["10.1145\/3670997"],"URL":"https:\/\/doi.org\/10.1145\/3670997","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"type":"print","value":"1533-5399"},{"type":"electronic","value":"1557-6051"}],"subject":[],"published":{"date-parts":[[2024,7,15]]},"assertion":[{"value":"2023-07-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-27","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}