{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T19:25:20Z","timestamp":1789586720706,"version":"build-2803163510"},"reference-count":47,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","award":["NNX16AO69A"],"award-info":[{"award-number":["NNX16AO69A"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["FA9550-12-1-0395"],"award-info":[{"award-number":["FA9550-12-1-0395"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["OAC 1920147"],"award-info":[{"award-number":["OAC 1920147"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Physiol."],"abstract":"<jats:p>Were astronauts forced to land on the surface of Mars using manual control of their vehicle, they would not have familiar gravitational cues because Mars\u2019 gravity is only 0.38 g. They could become susceptible to spatial disorientation, potentially causing mission ending crashes. In our earlier studies, we secured blindfolded participants into a Multi-Axis Rotation System (MARS) device that was programmed to behave like an inverted pendulum. Participants used a joystick to stabilize around the balance point. We created a spaceflight analog condition by having participants dynamically balance in the horizontal roll plane, where they did not tilt relative to the gravitational vertical and therefore could not use gravitational cues to determine their position. We found 90% of participants in our spaceflight analog condition reported spatial disorientation and all of them showed it in their data. There was a high rate of crashing into boundaries that were set at \u00b1 60<jats:sup>\u00b0<\/jats:sup> from the balance point. Our goal was to see whether we could use deep learning to predict the occurrence of crashes before they happened. We used stacked gated recurrent units (GRU) to predict crash events 800 ms in advance with an AUC (area under the curve) value of 99%. When we prioritized reducing false negatives we found it resulted in more false positives. We found that false negatives occurred when participants made destabilizing joystick deflections that rapidly moved the MARS away from the balance point. These unpredictable destabilizing joystick deflections, which occurred in the duration of time after the input data, are likely a result of spatial disorientation. If our model could work in real time, we calculated that immediate human action would result in the prevention of 80.7% of crashes, however, if we accounted for human reaction times (\u223c400 ms), only 30.3% of crashes could be prevented, suggesting that one solution could be an AI taking temporary control of the spacecraft during these moments.<\/jats:p>","DOI":"10.3389\/fphys.2022.806357","type":"journal-article","created":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T09:32:33Z","timestamp":1643362353000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Crash Prediction Using Deep Learning in a Disorienting Spaceflight Analog Balancing Task"],"prefix":"10.3389","volume":"13","author":[{"given":"Yonglin","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vivekanand Pandey","family":"Vimal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James R.","family":"Lackner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"DiZio","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengyu","family":"Hong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,1,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1986","DOI":"10.1152\/jn.00611.2019","article-title":"The effect of hypergravity on upright balance and voluntary sway.","volume":"124","author":"Bakshi","year":"2020","journal-title":"J. Neurophysiol."},{"key":"B2","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s00221-009-1779-4","article-title":"Perceived timing of vestibular stimulation relative to touch, light and sound.","volume":"198","author":"Barnett-Cowan","year":"2009","journal-title":"Exp. Brain Res."},{"key":"B3","doi-asserted-by":"publisher","first-page":"267","DOI":"10.2466\/pms.100.1.267-274","article-title":"Effects of directional uncertainty on visually-guided joystick pointing.","volume":"100","author":"Berryhill","year":"2005","journal-title":"Percept. Mot. Skills"},{"key":"B4","first-page":"1031","article-title":"Spatial disorientation in US Army rotary-wing operations.","volume":"69","author":"Braithwaite","year":"1998","journal-title":"Aviat. Space Environ. Med."},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1179","article-title":"Learning phrase representations using RNN encoder-decoder for statistical machine translation.","author":"Cho","year":"2014","journal-title":"arXiv"},{"key":"B6","doi-asserted-by":"publisher","first-page":"2037","DOI":"10.1152\/jn.00476.2019","article-title":"Challenges to the central nervous system during human spaceflight missions to Mars.","volume":"123","author":"Cl\u00e9ment","year":"2020","journal-title":"J. Neurophysiol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1109\/mis.2002.999222","article-title":"Virtual collaborations with the real: NASA\u2019s new era in space exploration.","volume":"17","author":"Cooke","year":"2002","journal-title":"IEEE Intell. Syst."},{"key":"B8","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1111\/j.2517-6161.1958.tb00292.x","article-title":"The regression analysis of binary sequences.","volume":"20","author":"Cox","year":"1958","journal-title":"J. R. Stat. Soc. Ser. B (Methodological)"},{"key":"B9","article-title":"Use of real-time, predictive human modeling for spatial disorientation detection and mitigation","author":"Daiker","year":"2018","journal-title":"Proceedings of the Modsim World 2018 Conference"},{"key":"B10","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1504\/IJRAM.2007.011988","article-title":"Why the pilot cannot be blamed: a cautionary note about excessive reliance on technology.","volume":"7","author":"Dalcher","year":"2007","journal-title":"Int. J. Risk Assess. Manag."},{"key":"B11","doi-asserted-by":"publisher","first-page":"3948","DOI":"10.1109\/IROS.2017.8206247","article-title":"Learning to fly by crashing","author":"Gandhi","year":"2017","journal-title":"Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS): IEEE"},{"key":"B12","doi-asserted-by":"publisher","first-page":"739","DOI":"10.3357\/asem.3196.2012","article-title":"Ten years of spatial disorientation in US Army rotary-wing operations.","volume":"83","author":"Gaydos","year":"2012","journal-title":"Aviat. Space Environ. Med."},{"key":"B13","doi-asserted-by":"publisher","first-page":"717","DOI":"10.3357\/asem.3048.2011","article-title":"Spatial disorientation: decades of pilot fatalities.","volume":"82","author":"Gibb","year":"2011","journal-title":"Aviat. Space Environ. Med."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory.","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comp."},{"key":"B15","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in automation: integrating empirical evidence on factors that influence trust.","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum. Factors"},{"key":"B16","doi-asserted-by":"publisher","first-page":"598","DOI":"10.2514\/1.G003724","article-title":"Deep neural network compression for aircraft collision avoidance systems.","volume":"42","author":"Julian","year":"2019","journal-title":"J. Guid. Control Dyn."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0253308","article-title":"Convolutional neural networks for sentence classification","author":"Kim","year":"2014","journal-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)"},{"key":"B18","author":"Lambert","year":"1973","journal-title":"Computational Methods in Ordinary Differential Equations. Introductory Mathematics for Scientists and Engineers."},{"key":"B19","doi-asserted-by":"publisher","first-page":"410","DOI":"10.1016\/j.neucom.2020.06.038","article-title":"Cooperative control for swarming systems based on reinforcement learning in unknown dynamic environment.","volume":"410","author":"Lan","year":"2020","journal-title":"Neurocomputing"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2016.00096","article-title":"The neurovestibular challenges of astronauts and balance patients: some past countermeasures and two alternative approaches to elicitation, assessment and mitigation.","volume":"10","author":"Lawson","year":"2016","journal-title":"Front. Syst. Neurosci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning.","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"B22","first-page":"2","article-title":"Handwritten digit recognition with a back-propagation network","author":"LeCun","year":"1989","journal-title":"Advances in Neural Information Processing Systems"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-39058-9","article-title":"Long-duration spaceflight adversely affects post-landing operator proficiency.","volume":"9","author":"Moore","year":"2019","journal-title":"Sci. Rep."},{"key":"B24","year":"2021","journal-title":"Human Research Roadmap: A Risk Reduction Strategy for Human Space Exploration."},{"key":"B25","author":"Newman","year":"2007","journal-title":"An Overview of Spatial Disorientation as a Factor in Aviation Accidents and Incidents."},{"key":"B26","doi-asserted-by":"publisher","first-page":"993","DOI":"10.3357\/AMHP.4853.2017","article-title":"Gravitational and somatosensory influences on control and perception of roll balance.","volume":"88","author":"Panic","year":"2017","journal-title":"Aerospace Med. Hum. Perform."},{"key":"B27","doi-asserted-by":"publisher","first-page":"3600","DOI":"10.1152\/jn.00737.2014","article-title":"Direction of balance and perception of the upright are perceptually dissociable.","volume":"113","author":"Panic","year":"2015","journal-title":"J. Neurophysiol."},{"key":"B28","article-title":"How to construct deep recurrent neural networks.","author":"Pascanu","year":"2013","journal-title":"arXiv"},{"key":"B29","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MITS.2019.2903539","article-title":"Rough set based method for vehicle collision risk assessment through inferring Driver\u2019s braking actions in near-crash situations.","volume":"11","author":"Peng","year":"2019","journal-title":"IEEE Intell. Trans. Syst. Magaz."},{"key":"B30","article-title":"Autonomous ship navigation under deep learning and the challenges in COLREGs","author":"Perera","year":"2018","journal-title":"Proceedings of the 37th International Conference on Offshore Mechanics and Arctic Engineering: American Society of Mechanical Engineers), V11BT12A005"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2021.104406","article-title":"An insight into crash avoidance and overtaking advice systems for autonomous vehicles: a review, challenges and solutions.","volume":"104","author":"Perumal","year":"2021","journal-title":"Eng. Applic. Artif. Intell."},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202","article-title":"Deep contextualized word representations.","author":"Peters","year":"2018","journal-title":"arXiv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"919","DOI":"10.3357\/ASEM.3971.2014","article-title":"Spatial disorientation mishap trends in the US Air Force 1993\u20132013.","volume":"85","author":"Poisson","year":"2014","journal-title":"Aviat. Space Environ. Med."},{"key":"B34","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.1056\/NEJMoa1705129","article-title":"Effects of spaceflight on astronaut brain structure as indicated on MRI.","volume":"377","author":"Roberts","year":"2017","journal-title":"New Engl. J. Med."},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.21236\/AD0256582","author":"Rosenblatt","year":"1961","journal-title":"Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms."},{"key":"B36","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1109\/51.827409","article-title":"An instrumentation solution for reducing spatial disorientation mishaps.","volume":"19","author":"Rupert","year":"2000","journal-title":"IEEE Eng. Med. Biol. Magaz."},{"key":"B37","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1007\/978-3-319-67615-9_10","article-title":"Neural knowledge tracing","author":"Sha","year":"2017","journal-title":"Proceedings of the International Conference on Brain Function Assessment in Learning"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2015.00115","article-title":"Trends in sensorimotor research and countermeasures for exploration-class space flights.","volume":"9","author":"Shelhamer","year":"2015","journal-title":"Front. Syst. Neurosci."},{"key":"B39","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1016\/j.comcom.2020.06.028","article-title":"SSGRU: A novel hybrid stacked GRU-based traffic volume prediction approach in a road network.","volume":"160","author":"Sun","year":"2020","journal-title":"Comput. Commun."},{"key":"B40","doi-asserted-by":"publisher","first-page":"3495","DOI":"10.1007\/s00221-017-5068-3","article-title":"Learning dynamic balancing in the roll plane with and without gravitational cues.","volume":"235","author":"Vimal","year":"2017","journal-title":"Exp. Brain Res."},{"key":"B41","doi-asserted-by":"publisher","first-page":"2775","DOI":"10.1007\/s00221-019-05631-x","article-title":"Learning and long-term retention of dynamic self-stabilization skills.","volume":"237","author":"Vimal","year":"2019","journal-title":"Exp. Brain Res."},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00221-021-06239-w","article-title":"The role of spatial acuity in a dynamic balancing task without gravitational cues.","author":"Vimal","year":"2021","journal-title":"Exp. Brain Res."},{"key":"B43","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1007\/s00221-015-4469-4","article-title":"Learning dynamic control of body roll orientation.","volume":"234","author":"Vimal","year":"2016","journal-title":"Exp. Brain Res."},{"key":"B44","doi-asserted-by":"publisher","first-page":"1321","DOI":"10.1007\/s00221-018-5216-4","article-title":"Learning dynamic control of body yaw orientation.","volume":"236","author":"Vimal","year":"2018","journal-title":"Exp. Brain Res."},{"key":"B45","doi-asserted-by":"publisher","first-page":"479","DOI":"10.3357\/AMHP.5552.2020","article-title":"Characterizing individual differences in a dynamic stabilization task using machine learning.","volume":"91","author":"Vimal","year":"2020","journal-title":"Aerospace Med. Hum. Perform."},{"key":"B46","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/b978-0-08-042361-6.50063-5","article-title":"Designing for situation awareness and trust in automation.","volume":"28","author":"Wickens","year":"1995","journal-title":"IFAC Proc. Volumes"},{"key":"B47","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1109\/ICDMW.2016.0032","article-title":"Stick must fall: Using machine learning to predict human error in virtual balancing task","author":"Zgonnikova","year":"2016","journal-title":"Proceedings of the 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW): IEEE"}],"container-title":["Frontiers in Physiology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2022.806357\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T09:32:45Z","timestamp":1643362365000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2022.806357\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,28]]},"references-count":47,"alternative-id":["10.3389\/fphys.2022.806357"],"URL":"https:\/\/doi.org\/10.3389\/fphys.2022.806357","relation":{},"ISSN":["1664-042X"],"issn-type":[{"value":"1664-042X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,28]]},"article-number":"806357"}}