{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T19:14:09Z","timestamp":1778094849511,"version":"3.51.4"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2009,7,1]],"date-time":"2009-07-01T00:00:00Z","timestamp":1246406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2009,7]]},"abstract":"<jats:p>Autonomous helicopter flight is widely regarded to be a highly challenging control problem. As helicopters are highly unstable and exhibit complicated dynamical behavior, it is particularly difficult to design controllers that achieve high performance over a broad flight regime.<\/jats:p>\n          <jats:p>While these aircraft are notoriously difficult to control, there are expert human pilots who are nonetheless capable of demonstrating a wide variety of maneuvers, including aerobatic maneuvers at the edge of the helicopter's performance envelope. In this paper, we present algorithms for modeling and control that leverage these demonstrations to build high-performance control systems for autonomous helicopters. More specifically, we detail our experiences with the Stanford Autonomous Helicopter, which is now capable of extreme aerobatic flight meeting or exceeding the performance of our own expert pilot.<\/jats:p>","DOI":"10.1145\/1538788.1538812","type":"journal-article","created":{"date-parts":[[2009,6,30]],"date-time":"2009-06-30T13:10:17Z","timestamp":1246367417000},"page":"97-105","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":81,"title":["Apprenticeship learning for helicopter control"],"prefix":"10.1145","volume":"52","author":[{"given":"Adam","family":"Coates","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pieter","family":"Abbeel","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew Y.","family":"Ng","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2009,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Abbeel P. Coates A. Hunter T. Ng A.Y. Autonomous autorotation of an RC helicopter. ISER11 (2008).  Abbeel P. Coates A. Hunter T. Ng A.Y. Autonomous autorotation of an RC helicopter. ISER11 (2008).","DOI":"10.1007\/978-3-642-00196-3_45"},{"key":"e_1_2_1_2_1","first-page":"1","article-title":"An application of reinforcement learning to aerobatic helicopter flight","volume":"19","author":"Abbeel P.","year":"2007","journal-title":"NIPS"},{"key":"e_1_2_1_3_1","first-page":"1","article-title":"Learning vehicular dynamics, with application to modeling helicopters","volume":"18","author":"Abbeel P.","year":"2006","journal-title":"NIPS"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015430"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143845"},{"key":"e_1_2_1_6_1","volume-title":"MIT Press","author":"An C.H.","year":"1988"},{"key":"e_1_2_1_7_1","volume-title":"Prentice-Hall","author":"Anderson B.","year":"1989"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of ICML","author":"Atkeson C.","year":"1997"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2001.932842"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of UAI","author":"Boutilier C.","year":"1996"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2006.886952"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390175"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Dempster A.P. Laird N.M. Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. (1977).  Dempster A.P. Laird N.M. Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc . (1977).","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_2_1_14_1","volume-title":"Navigation and Control Conference","author":"Gavrilets V.","year":"2002"},{"key":"e_1_2_1_15_1","volume-title":"Elsevier","author":"Jacobson D.H.","year":"1970"},{"key":"e_1_2_1_16_1","volume-title":"Carnegie Mellon University","author":"La Civita M.","year":"2003"},{"key":"e_1_2_1_17_1","article-title":"Design and flight testing of a high-bandwidth H \u221e loop shaping controller for a robotic helicopter","volume":"29","author":"La Civita M.","journal-title":"J. Guid. Control. Dynam."},{"key":"e_1_2_1_18_1","volume-title":"Cambridge University Press","author":"Leishman J.","year":"2000"},{"key":"e_1_2_1_19_1","volume-title":"University of Toronto","author":"Listgarten J.","year":"2006"},{"key":"e_1_2_1_20_1","first-page":"17","article-title":"Multiple alignment of continuous time series","author":"Listgarten J.","year":"2005","journal-title":"NIPS"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2836(70)90057-4"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of UAI","author":"Neu G.","year":"2007"},{"key":"e_1_2_1_23_1","volume-title":"ISER","author":"Ng A.Y.","year":"2004"},{"key":"e_1_2_1_24_1","first-page":"16","article-title":"Autnonomous helicopter flight via reinforcement learning","author":"Ng A.Y.","year":"2004","journal-title":"NIPS"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of ICML","author":"Ng A.Y.","year":"2000"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of IJCAI","author":"Ramachandran D.","year":"2007"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143936"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2003.1241651"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASSP.1978.1163055"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Saripalli S. Montgomery J. Sukhatme G. Visually-guided landing of an unmanned aerial vehicle 2003.  Saripalli S. Montgomery J. Sukhatme G. Visually-guided landing of an unmanned aerial vehicle 2003.","DOI":"10.1109\/TRA.2003.810239"},{"key":"e_1_2_1_31_1","volume-title":"American Institute of Aeronautics and Astronautics","author":"Seddon J.","year":"1990"},{"key":"e_1_2_1_32_1","first-page":"20","article-title":"A game-theoretic approach to apprenticeship learning","author":"Syed U.","year":"2008","journal-title":"NIPS"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1538788.1538812","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1538788.1538812","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:38:47Z","timestamp":1750253927000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1538788.1538812"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,7]]},"references-count":32,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2009,7]]}},"alternative-id":["10.1145\/1538788.1538812"],"URL":"https:\/\/doi.org\/10.1145\/1538788.1538812","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,7]]},"assertion":[{"value":"2009-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}