{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T16:57:42Z","timestamp":1784998662759,"version":"3.55.0"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T00:00:00Z","timestamp":1634601600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T00:00:00Z","timestamp":1634601600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100011021","name":"National Centre of Competence in Research Robotics","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100011021","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Robot"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents a novel system for autonomous, vision-based drone racing combining learned data abstraction, nonlinear filtering, and time-optimal trajectory planning. The system has successfully been deployed at the first autonomous drone racing world championship: the <jats:italic>2019 AlphaPilot Challenge<\/jats:italic>. Contrary to traditional drone racing systems, which only detect the next gate, our approach makes use of any visible gate and takes advantage of multiple, simultaneous gate detections to compensate for drift in the state estimate and build a global map of the gates. The global map and drift-compensated state estimate allow the drone to navigate through the race course even when the gates are not immediately visible and further enable to plan a near time-optimal path through the race course in real time based on approximate drone dynamics. The proposed system has been demonstrated to successfully guide the drone through tight race courses reaching speeds up to <jats:inline-formula><jats:alternatives><jats:tex-math>$${8}\\,{\\hbox {m}\/\\hbox {s}}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mrow>\n                    <mml:mn>8<\/mml:mn>\n                    <mml:mspace\/>\n                    <mml:mrow>\n                      <mml:mtext>m<\/mml:mtext>\n                      <mml:mo>\/<\/mml:mo>\n                      <mml:mtext>s<\/mml:mtext>\n                    <\/mml:mrow>\n                  <\/mml:mrow>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula> and ranked second at the <jats:italic>2019 AlphaPilot Challenge<\/jats:italic>.<\/jats:p>","DOI":"10.1007\/s10514-021-10011-y","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T12:24:24Z","timestamp":1634646264000},"page":"307-320","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":98,"title":["AlphaPilot: autonomous drone racing"],"prefix":"10.1007","volume":"46","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9585-1278","authenticated-orcid":false,"given":"Philipp","family":"Foehn","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8280-7884","authenticated-orcid":false,"given":"Dario","family":"Brescianini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6094-5901","authenticated-orcid":false,"given":"Elia","family":"Kaufmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6952-1205","authenticated-orcid":false,"given":"Titus","family":"Cieslewski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2223-4265","authenticated-orcid":false,"given":"Mathias","family":"Gehrig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5091-1860","authenticated-orcid":false,"given":"Manasi","family":"Muglikar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3831-6778","authenticated-orcid":false,"given":"Davide","family":"Scaramuzza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,10,19]]},"reference":[{"key":"10011_CR1","volume-title":"Dynamic programming and optimal control","author":"Dimitri P Bertsekas","year":"1995","unstructured":"Bertsekas, Dimitri P. (1995). Dynamic programming and optimal control (Vol. 1). MA: Athena scientific Belmont."},{"key":"10011_CR2","doi-asserted-by":"crossref","unstructured":"Bloesch, Michael, Omari, Sammy, Hutter, Marco, & Siegwart, Roland. (2015). Robust visual inertial odometry using a direct EKF-based approach.","DOI":"10.1109\/IROS.2015.7353389"},{"key":"10011_CR3","doi-asserted-by":"crossref","unstructured":"Brescianini, D., & D\u00e2Andrea, R., (2018). Tilt-prioritized quadrocopter attitude control. IEEE Transactions on Control Systems Technology, 28(2), 376\u2013387.","DOI":"10.1109\/TCST.2018.2873224"},{"issue":"6","key":"10011_CR4","doi-asserted-by":"publisher","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","volume":"32","author":"C Cadena","year":"2016","unstructured":"Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., et al. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309\u20131332.","journal-title":"IEEE Transactions on Robotics"},{"key":"10011_CR5","doi-asserted-by":"crossref","unstructured":"Cao, Zhe., Simon, Tomas., Wei, Shih-En., and Sheikh, Yaser .(2017). Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291\u20137299.","DOI":"10.1109\/CVPR.2017.143"},{"key":"10011_CR6","doi-asserted-by":"crossref","unstructured":"Delmerico J, & Scaramuzza D. (2018). A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots.","DOI":"10.1109\/ICRA.2018.8460664"},{"key":"10011_CR7","doi-asserted-by":"crossref","unstructured":"Delmerico J, Cieslewski T, Rebecq H, Faessler M, & Scaramuzza D. (2019). Are we ready for autonomous drone racing? the UZH-FPV drone racing dataset.","DOI":"10.1109\/ICRA.2019.8793887"},{"key":"10011_CR8","unstructured":"Douglas Brent West. (2001). Introduction to graph theory (Vol. 2). NJ: Prentice hall Upper Saddle River."},{"key":"10011_CR9","unstructured":"Elia K, M Gehrig, P Foehn, R Ranftl, A Dosovitskiy, V Koltun, and D Scaramuzza. (2018) Beauty and the beast: Optimal methods meet learning for drone racing. IEEE International Conference on Robotics and Automation (ICRA), pp 690\u2013696."},{"key":"10011_CR10","doi-asserted-by":"crossref","unstructured":"Falanga, Davide., Foehn, Philipp., Lu, Peng., and Scaramuzza, Davide .(2018). Pampc: Perception-aware model predictive control for quadrotors. In: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1\u20138.","DOI":"10.1109\/IROS.2018.8593739"},{"key":"10011_CR11","unstructured":"Foehn, Philipp and Scaramuzza, Davide (2020) CPC: Complementary progress constraints for time-optimal quadrotor trajectories. Preprint arXiv:2007.06255."},{"key":"10011_CR12","doi-asserted-by":"crossref","unstructured":"Foehn, P., Brescianini, D., Kaufmann, E., Cieslewski, T., Gehrig, M., Muglikar, M., and Scaramuzza. D.(2020). Alphapilot: Autonomous drone racing. In Robotics: Science and Systems (RSS). 10.15607\/RSS.2020.XVI.081.","DOI":"10.15607\/RSS.2020.XVI.081"},{"issue":"2","key":"10011_CR13","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1109\/TRO.2016.2623335","volume":"33","author":"Christian Forster","year":"2017","unstructured":"Forster, Christian, Zhang, Zichao, Gassner, Michael, Werlberger, Manuel, & Scaramuzza, Davide. (2017a). SVO: Semidirect visual odometry for monocular and multicamera systems. IEEE Transactions on Robotics, 33(2), 249\u2013265. https:\/\/doi.org\/10.1109\/TRO.2016.2623335","journal-title":"IEEE Transactions on Robotics"},{"issue":"1","key":"10011_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TRO.2016.2597321","volume":"33","author":"Christian Forster","year":"2017","unstructured":"Forster, Christian, Carlone, Luca, Dellaert, Frank, & Scaramuzza, Davide. (2017b). On-manifold preintegration for real-time visual-inertial odometry. IEEE Transactions on Robotics, 33(1), 1\u201321. https:\/\/doi.org\/10.1109\/TRO.2016.2597321","journal-title":"IEEE Transactions on Robotics"},{"key":"10011_CR15","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21842","author":"Fei Gao","year":"2019","unstructured":"Gao, Fei, William, Wu., Gao, Wenliang, & Shen, Shaojie. (2019). Flying on point clouds: Online trajectory generation and autonomous navigation for quadrotors in cluttered environments. Journal of Field Robotics. https:\/\/doi.org\/10.1002\/rob.21842","journal-title":"Journal of Field Robotics"},{"key":"10011_CR16","doi-asserted-by":"crossref","unstructured":"Guerra, Winter., Tal, Ezra., Murali, Varun., Ryou, Gilhyun., and Karaman, Sertac.(2019). Flightgoggles: Photorealistic sensor simulation for perception-driven robotics using photogrammetry and virtual reality. arXiv:1905.11377.","DOI":"10.1109\/IROS40897.2019.8968116"},{"key":"10011_CR17","doi-asserted-by":"publisher","unstructured":"Hehn, M., Ritz, R., & D\u00e2Adrea, R., (2012). Performance benchmarking of quadrotor systems using time-optimal control. Autonomous Robots,. https:\/\/doi.org\/10.1007\/s10514-012-9282-3.","DOI":"10.1007\/s10514-012-9282-3"},{"issue":"1","key":"10011_CR18","doi-asserted-by":"publisher","first-page":"8189","DOI":"10.1016\/j.ifacol.2017.08.1267","volume":"50","author":"JM Kai","year":"2017","unstructured":"Kai, J. M., Allibert, G., Hua, M. D., & Hamel, T. (2017). Nonlinear feedback control of quadrotors exploiting first-order drag effects. IFAC-PapersOnLine, 50(1), 8189\u20138195.","journal-title":"IFAC-PapersOnLine"},{"issue":"1","key":"10011_CR19","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1115\/1.3662552","volume":"82","author":"Rudolf E Kalman","year":"1960","unstructured":"Kalman, Rudolf E. (1960). A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 82(1), 35\u201345.","journal-title":"Journal of Basic Engineering"},{"issue":"1\u20132","key":"10011_CR20","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1002\/nav.3800020109","volume":"2","author":"HW Kuhn","year":"1955","unstructured":"Kuhn, H. W. (1955). The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1\u20132), 83\u201397.","journal-title":"Naval Research Logistics Quarterly"},{"key":"10011_CR21","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511546877","volume-title":"Planning algorithms","author":"SM LaValle","year":"2006","unstructured":"LaValle, S. M. (2006). Planning algorithms. Cambridge Cambridge Cambridge Cambridge: Cambridge University Press."},{"key":"10011_CR22","doi-asserted-by":"crossref","unstructured":"Li, Shuo., van\u00a0der Horst, Erik.,Duernay, Philipp., De Wagter, Christophe., and de\u00a0Croon, Guido.(2019). Visual model-predictive localization for computationally efficient autonomous racing of a 72-gram drone. arXiv:1905.10110.","DOI":"10.1002\/rob.21956"},{"key":"10011_CR23","unstructured":"Loock, W.\u00a0Van., Pipeleers, G., and Swevers, J.(2013). Time-optimal quadrotor flight. In IEEE European Control of Conference (ECC). 10.23919\/ECC.2013.6669253."},{"issue":"3","key":"10011_CR24","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1137\/0315023","volume":"150","author":"H Maurer","year":"1977","unstructured":"Maurer, H. (1977). On optimal control problems with bounded state variables and control appearing linearly. SIAM Journal on Control and Optimization, 150(3), 345\u2013362.","journal-title":"SIAM Journal on Control and Optimization"},{"key":"10011_CR25","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911434236","author":"D Mellinger","year":"2012","unstructured":"Mellinger, D., Michael, N., & Kumar, V. (2012). Trajectory generation and control for precise aggressive maneuvers with quadrotors. The International Journal of Robotics Research. https:\/\/doi.org\/10.1177\/0278364911434236","journal-title":"The International Journal of Robotics Research"},{"issue":"1","key":"10011_CR26","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/MRA.2016.2646090","volume":"24","author":"H Moon","year":"2017","unstructured":"Moon, H., Sun, Y., Baltes, J., & Kim, S. J. (2017). The IROS 2016 competitions. IEEE Robotics Automation Magazine, 24(1), 20\u201329.","journal-title":"IEEE Robotics Automation Magazine"},{"key":"10011_CR27","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s11370-018-00271-6","volume":"12","author":"H Moon","year":"2019","unstructured":"Moon, H., Martinez-Carranza, J., Cieslewski, T., Faessler, M., Falanga, D., Simovic, A., et al. (2019). Challenges and implemented technologies used in autonomous drone racing. Intelligent Service Robotics, 12, 137\u2013148.","journal-title":"Intelligent Service Robotics"},{"key":"10011_CR28","doi-asserted-by":"crossref","unstructured":"Mourikis, Anastasios\u00a0I., and Roumeliotis, S.I.(April 2007). A multi-state constraint Kalman filter for vision-aided inertial navigation. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3565\u20133572.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"10011_CR29","doi-asserted-by":"publisher","unstructured":"Mueller MW., Hehn M., and D\u2019Andrea R.(2015). A computationally efficient motion primitive for quadrocopter trajectory generation. IEEE Transactions on Robotics. doi: https:\/\/doi.org\/10.1109\/TRO.2015.2479878.","DOI":"10.1109\/TRO.2015.2479878."},{"issue":"4","key":"10011_CR30","doi-asserted-by":"publisher","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","volume":"34","author":"Tong Qin","year":"2018","unstructured":"Qin, Tong, Li, Peiliang, & Shen, Shaojie. (2018). VINS-Mono: A robust and versatile monocular visual-inertial state estimator. IEEE Transactions on Robotics, 34(4), 1004\u20131020. https:\/\/doi.org\/10.1109\/TRO.2018.2853729","journal-title":"IEEE Transactions on Robotics"},{"key":"10011_CR31","doi-asserted-by":"crossref","unstructured":"Ronneberger, Olaf., Fischer, Philipp., and Brox, Thomas .(2015). U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, pp. 234\u2013241. Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"10011_CR32","doi-asserted-by":"crossref","unstructured":"Ryou, G., Tal, E., and Karaman, S.(2020). Multi-fidelity black-box optimization for time-optimal quadrotor maneuvers. Robotics: Science and Systems (RSS). 10.15607\/RSS.2020.XVI.032.","DOI":"10.15607\/RSS.2020.XVI.032"},{"issue":"4","key":"10011_CR33","first-page":"439","volume":"410","author":"Malcolm D Shuster","year":"1993","unstructured":"Shuster, Malcolm D. (1993). Survey of attitude representations. Journal of the Astronautical Sciences, 410(4), 439\u2013517.","journal-title":"Journal of the Astronautical Sciences"},{"key":"10011_CR34","doi-asserted-by":"crossref","unstructured":"Spasojevic, Igor, Murali, Varun, & Karaman, Sertac. (2020). Joint feature selection and time optimal path parametrization for high speed vision-aided navigation.","DOI":"10.1109\/IROS45743.2020.9341654"},{"issue":"3","key":"10011_CR35","doi-asserted-by":"publisher","first-page":"2539","DOI":"10.1109\/LRA.2018.2808368","volume":"3","author":"J Sunggoo","year":"2018","unstructured":"Sunggoo, J., Sunyou, H., Heemin, S., & Shim, D. H. (2018). Perception, guidance, and navigation for indoor autonomous drone racing using deep learning. IEEE Robotics and Automation Letters, 3(3), 2539\u20132544. https:\/\/doi.org\/10.1109\/LRA.2018.2808368","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10011_CR36","doi-asserted-by":"crossref","unstructured":"Szeliski, Richard .(2010). Computer Vision: Algorithms and Applications. Texts in Computer Science. Springer. ISBN 9781848829343.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"10011_CR37","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2019.2927938","author":"B Zhou","year":"2019","unstructured":"Zhou, B., Gao, F., Wang, L., Liu, C., & Shen, S. (2019). Robust and efficient quadrotor trajectory generation for fast autonomous flight. IEEE Robotics and Automation Letters. https:\/\/doi.org\/10.1109\/LRA.2019.2927938","journal-title":"IEEE Robotics and Automation Letters"}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-021-10011-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10514-021-10011-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-021-10011-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,5]],"date-time":"2022-02-05T09:08:32Z","timestamp":1644052112000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10514-021-10011-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,19]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10011"],"URL":"https:\/\/doi.org\/10.1007\/s10514-021-10011-y","relation":{},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"value":"0929-5593","type":"print"},{"value":"1573-7527","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,19]]},"assertion":[{"value":"8 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}