{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T21:36:29Z","timestamp":1773437789417,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,24]],"date-time":"2021-06-24T00:00:00Z","timestamp":1624492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,24]]},"DOI":"10.1145\/3458305.3478446","type":"proceedings-article","created":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T22:23:12Z","timestamp":1632349392000},"page":"261-266","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["QPlane"],"prefix":"10.1145","author":[{"given":"David J.","family":"Richter","sequence":"first","affiliation":[{"name":"Purdue University Northwest"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ricardo A.","family":"Calix","sequence":"additional","affiliation":[{"name":"Purdue University Northwest"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,22]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"adderbyte. Github. Gym XPlane. Retrieved May 31 2021 from https:\/\/github.com\/adderbyte\/GYM_XPLANE_ML  adderbyte. Github. Gym XPlane. Retrieved May 31 2021 from https:\/\/github.com\/adderbyte\/GYM_XPLANE_ML"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.2514\/6.2004-4923"},{"key":"e_1_3_2_2_3_1","unstructured":"Christopher Berner Greg Brockman Brooke Chan Vicki Cheung Przemys\u0142aw D\u0119biak Christy Dennison David Farhi Quirin Fischer Shariq Hashme Chris Hesse etal 2019. Dota 2 with large scale deep reinforcement learning. arXiv preprint arXiv:1912.06680 (2019).  Christopher Berner Greg Brockman Brooke Chan Vicki Cheung Przemys\u0142aw D\u0119biak Christy Dennison David Farhi Quirin Fischer Shariq Hashme Chris Hesse et al. 2019. Dota 2 with large scale deep reinforcement learning. arXiv preprint arXiv:1912.06680 (2019)."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICUAS.2019.8798254"},{"key":"e_1_3_2_2_5_1","volume-title":"Openai gym. arXiv preprint arXiv:1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Openai gym. arXiv preprint arXiv:1606.01540 ( 2016 ). Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016)."},{"key":"e_1_3_2_2_6_1","volume-title":"Q-Reinforcement Learning - Goal Oriented Intelligence. Retrieved","year":"2021","unstructured":"DeepLizard. DeepLizard.com. Q-Reinforcement Learning - Goal Oriented Intelligence. Retrieved May 31, 2021 from https:\/\/deeplizard.com\/learn\/playlist\/PLZbbT5o_s2xoWNVdDudn51XM8lOuZ_Njv DeepLizard. DeepLizard.com. Q-Reinforcement Learning - Goal Oriented Intelligence. Retrieved May 31, 2021 from https:\/\/deeplizard.com\/learn\/playlist\/PLZbbT5o_s2xoWNVdDudn51XM8lOuZ_Njv"},{"key":"e_1_3_2_2_7_1","volume-title":"Learning to Fly -- Building an Autopilot System based on Neural Networks and Reinforcement Learning. Master\u2019s thesis. FernUniversit\u00e4t Hagen","author":"Eckstein Felix","unstructured":"Felix Eckstein . 2020. Learning to Fly -- Building an Autopilot System based on Neural Networks and Reinforcement Learning. Master\u2019s thesis. FernUniversit\u00e4t Hagen , Hagen, Germany . Felix Eckstein. 2020. Learning to Fly -- Building an Autopilot System based on Neural Networks and Reinforcement Learning. Master\u2019s thesis. FernUniversit\u00e4t Hagen, Hagen, Germany."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-90-481-8764-5_20"},{"key":"e_1_3_2_2_9_1","volume-title":"Advances in neural information processing systems 23","author":"Hasselt Hado","year":"2010","unstructured":"Hado Hasselt . 2010. Double Q-learning. Advances in neural information processing systems 23 ( 2010 ), 2613--2621. Hado Hasselt. 2010. Double Q-learning. Advances in neural information processing systems 23 (2010), 2613--2621."},{"key":"e_1_3_2_2_10_1","unstructured":"Joshua P Kim. 2016. Evaluation of Unmanned Aircraft Flying Qualities Using JSBSim. (2016).  Joshua P Kim. 2016. Evaluation of Unmanned Aircraft Flying Qualities Using JSBSim. (2016)."},{"key":"e_1_3_2_2_11_1","volume-title":"Retrieved","author":"Kinsley Harrison","year":"2021","unstructured":"Harrison Kinsley . Pythonprogramming.net. Q-Learning introduction and Q Table -- Reinforcement Learning w\/ Python . Retrieved May 31, 2021 from https:\/\/pythonprogramming.net\/q-learning-reinforcement-learning-python-tutorial\/ Harrison Kinsley. Pythonprogramming.net. Q-Learning introduction and Q Table -- Reinforcement Learning w\/ Python. Retrieved May 31, 2021 from https:\/\/pythonprogramming.net\/q-learning-reinforcement-learning-python-tutorial\/"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301273"},{"key":"e_1_3_2_2_13_1","volume-title":"Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , and Martin Riedmiller . 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 ( 2013 ). Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski etal 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.  Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_2_15_1","unstructured":"NASA. Github. XPlaneConnect. Retrieved May 31 2021 from https:\/\/github.com\/nasa\/XPlaneConnect  NASA. Github. XPlaneConnect. Retrieved May 31 2021 from https:\/\/github.com\/nasa\/XPlaneConnect"},{"key":"e_1_3_2_2_16_1","volume-title":"Proceedings of the USENIX Annual Technical Conference","volume":"686","author":"Perry Alexander R","year":"2004","unstructured":"Alexander R Perry . 2004 . The flightgear flight simulator . In Proceedings of the USENIX Annual Technical Conference , Vol. 686 . Alexander R Perry. 2004. The flightgear flight simulator. In Proceedings of the USENIX Annual Technical Conference, Vol. 686."},{"key":"e_1_3_2_2_17_1","volume-title":"Autonomous Control of Simulated Fixed Wing Aircraft using Deep Reinforcement Learning. Master\u2019s thesis","author":"Rennie Gordon","unstructured":"Gordon Rennie . 2018. Autonomous Control of Simulated Fixed Wing Aircraft using Deep Reinforcement Learning. Master\u2019s thesis . The University of Bath , Bath, United Kingdom. Gordon Rennie. 2018. Autonomous Control of Simulated Fixed Wing Aircraft using Deep Reinforcement Learning. Master\u2019s thesis. The University of Bath, Bath, United Kingdom."},{"key":"e_1_3_2_2_18_1","unstructured":"Laminar Research. XPlane.com. XPlane. Retrieved May 31 2021 from https:\/\/www.xplane.com\/  Laminar Research. XPlane.com. XPlane. Retrieved May 31 2021 from https:\/\/www.xplane.com\/"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2010.5673378"},{"key":"e_1_3_2_2_20_1","volume-title":"Video. Retrieved","author":"Richter David J.","year":"2020","unstructured":"David J. Richter , Ricardo A. Calix . 2020 . QPlane result video . Video. Retrieved May 31, 2021 from https:\/\/www.youtube.com\/watch?v=zd5ldaWiCjI David J. Richter, Ricardo A. Calix. 2020. QPlane result video. Video. Retrieved May 31, 2021 from https:\/\/www.youtube.com\/watch?v=zd5ldaWiCjI"},{"key":"e_1_3_2_2_21_1","volume-title":"Retrieved","author":"Richter David J.","year":"2021","unstructured":"David J. Richter . Github. QPlane Fixed Wing Flight Simulation Environment for Reinforcement Learning . Retrieved May 31, 2021 from https:\/\/github.com\/JDatPNW\/QPlane David J. Richter. Github. QPlane Fixed Wing Flight Simulation Environment for Reinforcement Learning. Retrieved May 31, 2021 from https:\/\/github.com\/JDatPNW\/QPlane"},{"key":"e_1_3_2_2_22_1","volume-title":"A survey of deep reinforcement learning in video games. arXiv preprint arXiv:1912.10944","author":"Shao Kun","year":"2019","unstructured":"Kun Shao , Zhentao Tang , Yuanheng Zhu , Nannan Li , and Dongbin Zhao . 2019. A survey of deep reinforcement learning in video games. arXiv preprint arXiv:1912.10944 ( 2019 ). Kun Shao, Zhentao Tang, Yuanheng Zhu, Nannan Li, and Dongbin Zhao. 2019. A survey of deep reinforcement learning in video games. arXiv preprint arXiv:1912.10944 (2019)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","unstructured":"David Silver Julian Schrittwieser Karen Simonyan Ioannis Antonoglou Aja Huang Arthur Guez Thomas Hubert Lucas Baker Matthew Lai Adrian Bolton etal 2017. Mastering the game of go without human knowledge. nature 550 7676 (2017) 354--359.  David Silver Julian Schrittwieser Karen Simonyan Ioannis Antonoglou Aja Huang Arthur Guez Thomas Hubert Lucas Baker Matthew Lai Adrian Bolton et al. 2017. Mastering the game of go without human knowledge. nature 550 7676 (2017) 354--359.","DOI":"10.1038\/nature24270"},{"key":"e_1_3_2_2_24_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","unstructured":"Richard S Sutton and Andrew G Barto . 2018. Reinforcement learning: An introduction . MIT press . Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/203330.203343"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_3_2_2_27_1","volume-title":"AIP Conference Proceedings","volume":"1648","author":"Vogeltanz Tom\u00e1\u0161","year":"2015","unstructured":"Tom\u00e1\u0161 Vogeltanz and Roman Ja\u0161ek . 2015 . JSBSim library for flight dynamics modelling of a mini-UAV . In AIP Conference Proceedings , Vol. 1648 . AIP Publishing LLC, 550015. Tom\u00e1\u0161 Vogeltanz and Roman Ja\u0161ek. 2015. JSBSim library for flight dynamics modelling of a mini-UAV. In AIP Conference Proceedings, Vol. 1648. AIP Publishing LLC, 550015."},{"key":"e_1_3_2_2_28_1","volume-title":"Machine learning 8, 3-4","author":"Watkins Christopher JCH","year":"1992","unstructured":"Christopher JCH Watkins and Peter Dayan . 1992. Q-learning. Machine learning 8, 3-4 ( 1992 ), 279--292. Christopher JCH Watkins and Peter Dayan. 1992. Q-learning. Machine learning 8, 3-4 (1992), 279--292."},{"key":"e_1_3_2_2_29_1","volume-title":"Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs. In 2020 3rd International Conference on Unmanned Systems (ICUS). IEEE, 239--244","author":"Zhen Yan","year":"2020","unstructured":"Yan Zhen , Mingrui Hao , and Wendi Sun . 2020 . Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs. In 2020 3rd International Conference on Unmanned Systems (ICUS). IEEE, 239--244 . Yan Zhen, Mingrui Hao, and Wendi Sun. 2020. Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs. In 2020 3rd International Conference on Unmanned Systems (ICUS). IEEE, 239--244."}],"event":{"name":"MMSys '21: 12th ACM Multimedia Systems Conference","location":"Istanbul Turkey","acronym":"MMSys '21","sponsor":["SIGMM ACM Special Interest Group on Multimedia","SIGCOMM ACM Special Interest Group on Data Communication","SIGMOBILE ACM Special Interest Group on Mobility of Systems, Users, Data and Computing"]},"container-title":["Proceedings of the 12th ACM Multimedia Systems Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3458305.3478446","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3458305.3478446","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:19Z","timestamp":1750195699000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3458305.3478446"}},"subtitle":["An Open-Source Reinforcement Learning Toolkit for Autonomous Fixed Wing Aircraft Simulation"],"short-title":[],"issued":{"date-parts":[[2021,6,24]]},"references-count":29,"alternative-id":["10.1145\/3458305.3478446","10.1145\/3458305"],"URL":"https:\/\/doi.org\/10.1145\/3458305.3478446","relation":{},"subject":[],"published":{"date-parts":[[2021,6,24]]},"assertion":[{"value":"2021-09-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}