{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T22:38:48Z","timestamp":1776465528759,"version":"3.51.2"},"reference-count":88,"publisher":"American Association for the Advancement of Science (AAAS)","issue":"90","content-domain":{"domain":["www.science.org"],"crossmark-restriction":true},"short-container-title":["Sci. Robot."],"published-print":{"date-parts":[[2024,5,15]]},"abstract":"<jats:p>Biological sensing and processing is asynchronous and sparse, leading to low-latency and energy-efficient perception and action. In robotics, neuromorphic hardware for event-based vision and spiking neural networks promises to exhibit similar characteristics. However, robotic implementations have been limited to basic tasks with low-dimensional sensory inputs and motor actions because of the restricted network size in current embedded neuromorphic processors and the difficulties of training spiking neural networks. Here, we present a fully neuromorphic vision-to-control pipeline for controlling a flying drone. Specifically, we trained a spiking neural network that accepts raw event-based camera data and outputs low-level control actions for performing autonomous vision-based flight. The vision part of the network, consisting of five layers and 28,800 neurons, maps incoming raw events to ego-motion estimates and was trained with self-supervised learning on real event data. The control part consists of a single decoding layer and was learned with an evolutionary algorithm in a drone simulator. Robotic experiments show a successful sim-to-real transfer of the fully learned neuromorphic pipeline. The drone could accurately control its ego-motion, allowing for hovering, landing, and maneuvering sideways\u2014even while yawing at the same time. The neuromorphic pipeline runs on board on Intel\u2019s Loihi neuromorphic processor with an execution frequency of 200 hertz, consuming 0.94 watt of idle power and a mere additional 7 to 12 milliwatts when running the network. These results illustrate the potential of neuromorphic sensing and processing for enabling insect-sized intelligent robots.<\/jats:p>","DOI":"10.1126\/scirobotics.adi0591","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T17:59:00Z","timestamp":1715795940000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark","source":"Crossref","is-referenced-by-count":67,"title":["Fully neuromorphic vision and control for autonomous drone flight"],"prefix":"10.1126","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9478-7195","authenticated-orcid":true,"given":"F.","family":"Paredes-Vall\u00e9s","sequence":"first","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5190-7145","authenticated-orcid":true,"given":"J. J.","family":"Hagenaars","sequence":"additional","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7414-5021","authenticated-orcid":true,"given":"J.","family":"Dupeyroux","sequence":"additional","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5733-1677","authenticated-orcid":true,"given":"S.","family":"Stroobants","sequence":"additional","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7834-3204","authenticated-orcid":true,"given":"Y.","family":"Xu","sequence":"additional","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8265-1496","authenticated-orcid":true,"given":"G. C. H. E.","family":"de Croon","sequence":"additional","affiliation":[{"name":"Micro Air Vehicle Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, Netherlands."}]}],"member":"221","reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","unstructured":"D. Cire\u015fan U. Meier J. Masci J. Schmidhuber A committee of neural networks for traffic sign classification in Proceedings of the 2011 International Joint Conference on Neural Networks (IEEE 2011) pp. 1918\u20131921.","DOI":"10.1109\/IJCNN.2011.6033458"},{"key":"e_1_3_2_3_2","unstructured":"X. Cheng Y. Zhong M. Harandi Y. Dai X. Chang H. Li T. Drummond Z. Ge Hierarchical neural architecture search for deep stereo matching in Advances in Neural Information Processing Systems H. Larochelle M. Ranzato R. Hadsell M. F. Balcan H. Lin Eds. (Curran Associates 2020) vol. 33 pp. 22158\u201322169."},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"X. Gu Z. Fan S. Zhu Z. Dai F. Tan P. Tan Cascade cost volume for high-resolution multi-view stereo and stereo matching in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2020) pp. 2495\u20132504.","DOI":"10.1109\/CVPR42600.2020.00257"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"E. Ilg N. Mayer T. Saikia M. Keuper A. Dosovitskiy T. Brox FlowNet 2.0: Evolution of optical flow estimation with deep networks in Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2017) pp. 2462\u20132470.","DOI":"10.1109\/CVPR.2017.179"},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"D. Sun X. Yang M.-Y. Liu J. Kautz PWC-Net: CNNs for optical flow using pyramid warping and cost volume in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE 2018) pp. 8934\u20138943.","DOI":"10.1109\/CVPR.2018.00931"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Z. Teed J. Deng RAFT: Recurrent all-pairs field transforms for optical flow in Computer Vision\u2014ECCV 2020 Lecture Notes in Computer Science (Springer 2020) vol. 12347 pp. 402\u2013419.","DOI":"10.1007\/978-3-030-58536-5_24"},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Y. Yuan X. Chen X. Chen J. Wang Segmentation transformer: Object-contextual representations for semantic segmentation in Computer Vision\u2014ECCV 2020 Lecture Notes in Computer Science (Springer 2020) vol. 12347 pp. 173\u2013190.","DOI":"10.1007\/978-3-030-58539-6_11"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Z. Liu H. Hu Y. Lin Z. Yao Z. Xie Y. Wei J. Ning Y. Cao Z. Zhang L. Dong F. Wei B. Guo Swin transformer V2: Scaling up capacity and resolution in Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2022) pp. 12009\u201312019.","DOI":"10.1109\/CVPR52688.2022.01170"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"R. Girshick Fast R-CNN in Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV) (IEEE 2015) pp. 1440\u20131448.","DOI":"10.1109\/ICCV.2015.169"},{"key":"e_1_3_2_11_2","unstructured":"J. Redmon A. Farhadi YOLOv3: An incremental improvement. arXiv:1804.02767 [cs.CV] (2018)."},{"key":"e_1_3_2_12_2","doi-asserted-by":"crossref","unstructured":"M. Xu Z. Zhang H. Hu J. Wang L. Wang F. Wei X. Bai Z. Liu End-to-end semi-supervised object detection with soft teacher in Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) (IEEE 2021) pp. 3060\u20133069.","DOI":"10.1109\/ICCV48922.2021.00305"},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","unstructured":"R. Garg V. K. B.G. G. Carneiro I. Reid Unsupervised CNN for single view depth estimation: Geometry to the rescue in Computer Vision\u2014ECCV 2016 Lecture Notes in Computer Science (Springer 2016) vol. 9912 pp. 740\u2013756.","DOI":"10.1007\/978-3-319-46484-8_45"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","unstructured":"C. Godard O. Mac Aodha G. J. Brostow Unsupervised monocular depth estimation with left-right consistency in Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2017) pp. 270\u2013279.","DOI":"10.1109\/CVPR.2017.699"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"W. Yuan X. Gu Z. Dai S. Zhu P. Tan NeW CRFs: Neural window fully-connected CRFs for monocular depth estimation in Proceedings of the 2022 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2022) pp. 3916\u20133925.","DOI":"10.1109\/CVPR52688.2022.00389"},{"key":"e_1_3_2_16_2","unstructured":"NVIDIA embedded systems for next-gen autonomous machines; https:\/\/nvidia.com\/en-us\/autonomous-machines\/embedded-systems\/."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.288.5469.1189"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abl8419"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.3008413"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","unstructured":"A. Z. Zhu L. Yuan K. Chaney K. Daniilidis EV-FlowNet: Self-supervised optical flow estimation for event-based cameras in Robotics: Science and Systems XIV (Robotics: Science and Systems Foundation 2018).","DOI":"10.15607\/RSS.2018.XIV.062"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","unstructured":"A. Z. Zhu L. Yuan K. Chaney K. Daniilidis Unsupervised event-based learning of optical flow depth and egomotion in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPRW) (IEEE 2019) pp. 989\u2013997.","DOI":"10.1109\/CVPRW.2019.00216"},{"key":"e_1_3_2_22_2","doi-asserted-by":"crossref","unstructured":"M. Gehrig M. Millh\u00e4usler D. Gehrig D. Scaramuzza E-RAFT: Dense optical flow from event cameras in 2021 International Conference on 3D Vision (3DV) (IEEE 2021) pp. 197\u2013206.","DOI":"10.1109\/3DV53792.2021.00030"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","unstructured":"F. Paredes-Valles G. C. H. E. de Croon Back to event basics: Self-supervised learning of image reconstruction for event cameras via photometric constancy in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2021) pp. 3446\u20133455.","DOI":"10.1109\/CVPR46437.2021.00345"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2903179"},{"key":"e_1_3_2_25_2","unstructured":"J. Hagenaars F. Paredes-Vall\u00e9s G. C. H. E. de Croon Self-supervised learning of event-based optical flow with spiking neural networks in Advances in Neural Information Processing Systems M. Ranzato A. Beygelzimer Y. Dauphin P. S. Liang J. Wortman Vaughan Eds. (Curran Associates 2021) vol. 34 pp. 7167\u20137179."},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","unstructured":"F. Paredes-Vall\u00e9s K. Y. W. Scheper C. De Wagter G. C. H. E. de Croon Taming contrast maximization for learning sequential low-latency event-based optical flow. arXiv:2303.05214 [cs.CV] (2023).","DOI":"10.1109\/ICCV51070.2023.00889"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(97)00011-7"},{"key":"e_1_3_2_28_2","unstructured":"A. Gr\u00fcning S. M. Bohte Spiking neural networks: Principles and challenges in ESANN 2014 Proceedings. European Symposium on Artificial Neural Networks (ESANN 2014)."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2021.3067593"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/JETCAS.2023.3330432"},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","unstructured":"P. Sterling S. Laughlin Principles of Neural Design (MIT Press 2015).","DOI":"10.7551\/mitpress\/9780262028707.001.0001"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1248955"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00774"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2018.12.002"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2019.2931595"},{"key":"e_1_3_2_36_2","first-page":"1","article-title":"The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks","author":"Zenke F.","year":"2021","unstructured":"F. Zenke, T. P. Vogels, The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks. Neural Comput. 33, 1\u201327 (2021).","journal-title":"Neural Comput."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.07.091"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"W. Fang Z. Yu Y. Chen T. Masquelier T. Huang Y. Tian Incorporating learnable membrane time constant to enhance learning of spiking neural networks in Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV) (IEEE 2021) pp. 2661\u20132671.","DOI":"10.1109\/ICCV48922.2021.00266"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.adg3679"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2015.00141"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2018.112130359"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"A. Vitale A. Renner C. Nauer D. Scaramuzza Y. Sandamirskaya Event-driven vision and control for UAVs on a neuromorphic chip in 2021 IEEE International Conference on Robotics and Automation (ICRA) (ICRA) (IEEE 2021) pp. 103\u2013109.","DOI":"10.1109\/ICRA48506.2021.9560881"},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"F. Galluppi C. Denk M. C. Meiner T. C. Stewart L. A. Plana C. Eliasmith S. Furber J. Conradt Event-based neural computing on an autonomous mobile platform in 2014 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2014) pp. 2862\u20132867.","DOI":"10.1109\/ICRA.2014.6907270"},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","unstructured":"D. Floreano C. Mattiussi Evolution of spiking neural controllers for autonomous vision-based robots in Evolutionary Robotics. From Intelligent Robotics to Artificial Life Lecture Notes in Computer Science (Springer 2001) vol. 2217 pp. 38\u201361.","DOI":"10.1007\/3-540-45502-7_2"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Z. Bing C. Meschede K. Huang G. Chen F. Rohrbein M. Akl A. Knoll End to end learning of spiking neural network based on R-STDP for a lane keeping vehicle in Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2018) pp. 4725\u20134732.","DOI":"10.1109\/ICRA.2018.8460482"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2017.00028"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(81)90009-1"},{"key":"e_1_3_2_48_2","doi-asserted-by":"crossref","unstructured":"J. Dupeyroux J. J. Hagenaars F. Paredes-Vall\u00e9s G. C. H. E. de Croon Neuromorphic control for optic-flow-based landing of MAVs using the Loihi processor in 2021 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2021) pp. 96\u2013102.","DOI":"10.1109\/ICRA48506.2021.9560937"},{"key":"e_1_3_2_49_2","unstructured":"H. Rebecq D. Gehrig D. Scaramuzza ESIM: An open event camera simulator in Conference on Robot Learning (MLResearchPress 2018) pp. 969\u2013982."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3190\/11\/1\/016004"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.2014.2342715"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1260\/1756-8293.5.4.287"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21764"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.3012129"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2011.11.001"},{"key":"e_1_3_2_56_2","unstructured":"S. Baker A. Datta T. Kanade \u201cParameterizing homographies\u201d (Tech. Rep. CMU-RI-TR-06-11 Robotics Institute 2006)."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.1980.0057"},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","unstructured":"G. Gallego H. Rebecq D. Scaramuzza A unifying contrast maximization framework for event cameras with applications to motion depth and optical flow estimation in Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (IEEE 2018) pp. 3867\u20133876.","DOI":"10.1109\/CVPR.2018.00407"},{"key":"e_1_3_2_59_2","doi-asserted-by":"crossref","unstructured":"G. Gallego M. Gehrig D. Scaramuzza Focus is all you need: Loss functions for event-based vision in Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2019) pp. 12280\u201312289.","DOI":"10.1109\/CVPR.2019.01256"},{"key":"e_1_3_2_60_2","unstructured":"D. DeTone T. Malisiewicz A. Rabinovich Deep image homography estimation. arXiv:1606.03798 [cs.CV] (2016)."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2809549"},{"key":"e_1_3_2_62_2","doi-asserted-by":"crossref","unstructured":"N. J. Sanket C. M. Parameshwara C. D. Singh A. V. Kuruttukulam C. Ferm\u00fcller D. Scaramuzza Y. Aloimonos EVDodgeNet: Deep dynamic obstacle dodging with event cameras in Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2020) pp. 10651\u201310657.","DOI":"10.1109\/ICRA40945.2020.9196877"},{"key":"e_1_3_2_63_2","doi-asserted-by":"crossref","unstructured":"Y. Ma S. Soatto J. Ko\u0161eck\u00e1 S. S. Sastry An Invitation to 3-D Vision: From Images to Geometric Models (Springer 2004).","DOI":"10.1007\/978-0-387-21779-6"},{"key":"e_1_3_2_64_2","first-page":"8290","article-title":"How do neural networks estimate optical flow? A neuropsychology-inspired study","volume":"44","author":"de Jong D. B.","year":"2021","unstructured":"D. B. de Jong, F. Paredes-Vall\u00e9s, G. C. de Croon, How do neural networks estimate optical flow? A neuropsychology-inspired study. IEEE Trans. Pattern Anal. Mach. Intell. 44, 8290\u20138305 (2021).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.55417\/fr.2022042"},{"key":"e_1_3_2_66_2","doi-asserted-by":"crossref","unstructured":"B. Boroujerdian H. Genc S. Krishnan W. Cui A. Faust V. Reddi MAVBench: Micro aerial vehicle benchmarking in 2018 51st Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO) (IEEE 2018) pp. 894\u2013907.","DOI":"10.1109\/MICRO.2018.00077"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aat0350"},{"key":"e_1_3_2_68_2","doi-asserted-by":"crossref","unstructured":"R. K. Stagsted A. Vitale A. Renner L. B. Larsen A. L. Christensen Y. Sandamirskaya Event-based PID controller fully realized in neuromorphic hardware: A one DoF study in Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2021) pp. 10939\u201310944.","DOI":"10.1109\/IROS45743.2020.9340861"},{"key":"e_1_3_2_69_2","doi-asserted-by":"crossref","unstructured":"S. Stroobants J. Dupeyroux G. De Croon Design and implementation of a parsimonious neuromorphic PID for onboard altitude control for MAVs using neuromorphic processors in Proceedings of the International Conference on Neuromorphic Systems 2022 (ACM 2022) pp. 1\u20137.","DOI":"10.1145\/3546790.3546799"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2023.3273520"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22030773"},{"key":"e_1_3_2_72_2","doi-asserted-by":"crossref","unstructured":"A. Mitrokhin C. Ferm\u00fcller C. Parameshwara Y. Aloimonos Event-based moving object detection and tracking in 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2018) pp. 1\u20139.","DOI":"10.1109\/IROS.2018.8593805"},{"key":"e_1_3_2_73_2","doi-asserted-by":"crossref","unstructured":"P. Charbonnier L. Blanc-Feraud G. Aubert M. Barlaud Two deterministic half-quadratic regularization algorithms for computed imaging in Proceedings of 1st International Conference on Image Processing (IEEE 1994) pp. 168\u2013172.","DOI":"10.1109\/ICIP.1994.413553"},{"key":"e_1_3_2_74_2","doi-asserted-by":"crossref","unstructured":"T. Stoffregen L. Kleeman Event cameras contrast maximization and reward functions: An analysis in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2019) pp. 12300\u201312308.","DOI":"10.1109\/CVPR.2019.01258"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.3390\/s23073699"},{"key":"e_1_3_2_76_2","unstructured":"D. P. Kingma J. Ba Adam: A method for stochastic optimization. arXiv:1412.6980v9 [cs.LG] (2017)."},{"key":"e_1_3_2_77_2","unstructured":"Y. Song S. Naji E. Kaufmann A. Loquercio D. Scaramuzza Flightmare: A flexible quadrotor simulator in Conference on Robot Learning (MLResearch Press 2020)."},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.2968071"},{"key":"e_1_3_2_79_2","doi-asserted-by":"crossref","unstructured":"P. Corke Robotics Vision and Control vol. 73 of Springer Tracts in Advanced Robotics (Springer 2011).","DOI":"10.1007\/978-3-642-20144-8"},{"key":"e_1_3_2_80_2","doi-asserted-by":"crossref","unstructured":"J. Tobin R. Fong A. Ray J. Schneider W. Zaremba P. Abbeel Domain randomization for transferring deep neural networks from simulation to the real world in 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2017) pp. 23\u201330.","DOI":"10.1109\/IROS.2017.8202133"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1162\/ARTL_a_00227"},{"key":"e_1_3_2_82_2","unstructured":"P. R. Cohen Empirical Methods for Artificial Intelligence Vol. 139 (MIT Press 1995)."},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.21105\/joss.04901"},{"key":"e_1_3_2_84_2","doi-asserted-by":"crossref","unstructured":"Y. Hu S.-C. Liu T. Delbruck V2e: From video frames to realistic DVS events in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (IEEE 2021) pp. 1312\u20131321.","DOI":"10.1109\/CVPRW53098.2021.00144"},{"key":"e_1_3_2_85_2","doi-asserted-by":"crossref","unstructured":"A. Dosovitskiy P. Fischer E. Ilg P. Hausser C. Hazirbas V. Golkov P. Van Der Smagt D. Cremers T. Brox FlowNet: Learning optical flow with convolutional networks in Proceedings of the IEEE International Conference on Computer Vision (ICCV) (IEEE 2015) pp. 2758\u20132766.","DOI":"10.1109\/ICCV.2015.316"},{"key":"e_1_3_2_86_2","doi-asserted-by":"crossref","unstructured":"E. Ilg T. Saikia M. Keuper T. Brox Occlusions motion and depth boundaries with a generic network for disparity optical flow or scene flow estimation in Proceedings of the European Conference on Computer Vision (ECCV) vol. 11216 of Lecture Notes in Computer Science (Springer 2018) pp. 614\u2013630.","DOI":"10.1007\/978-3-030-01258-8_38"},{"key":"e_1_3_2_87_2","doi-asserted-by":"crossref","unstructured":"R. J. Bouwmeester F. Paredes-Vall\u00e9s G. C. H. E. de Croon NanoFlowNet: Real-time dense optical flow on a nano quadcopter in 2023 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2023) pp. 1996\u20132003.","DOI":"10.1109\/ICRA48891.2023.10161258"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.add5139"},{"key":"e_1_3_2_89_2","doi-asserted-by":"crossref","unstructured":"E. Kaufmann L. Bauersfeld D. Scaramuzza A benchmark comparison of learned control policies for agile quadrotor flight in 2022 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2022).","DOI":"10.1109\/ICRA46639.2022.9811564"}],"updated-by":[{"DOI":"10.1126\/scirobotics.adr0223","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T00:00:00Z","timestamp":1719360000000}}],"container-title":["Science Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.science.org\/doi\/pdf\/10.1126\/scirobotics.adi0591","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T03:22:38Z","timestamp":1731986558000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.adi0591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,15]]},"references-count":88,"journal-issue":{"issue":"90","published-print":{"date-parts":[[2024,5,15]]}},"alternative-id":["10.1126\/scirobotics.adi0591"],"URL":"https:\/\/doi.org\/10.1126\/scirobotics.adi0591","relation":{"correction":[{"id-type":"doi","id":"10.1126\/scirobotics.adr0223","asserted-by":"object"}]},"ISSN":["2470-9476"],"issn-type":[{"value":"2470-9476","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,15]]},"assertion":[{"value":"2023-04-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"eadi0591"}}