{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T13:09:38Z","timestamp":1777900178352,"version":"3.51.4"},"reference-count":34,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:p>Biosensing techniques are progressing rapidly, promising the emergence of sophisticated virtual reality (VR) headsets with versatile biosensing enabling an objective, yet unobtrusive way to monitor the user\u2019s physiology. Additionally, modern artificial intelligence (AI) methods provide interpretations of multimodal data to obtain personalised estimations of the users\u2019 oculomotor behaviour, visual perception, and cognitive state, and their possibilities extend to controlling, adapting, and even creating the virtual audiovisual content in real-time. This article proposes a visionary approach for personalised virtual content adaptation via novel and precise oculomotor feature extraction from a freely moving user and sophisticated AI algorithms for cognitive state estimation. The approach is presented with an example use-case of a VR flight simulation session explaining in detail how cognitive workload, decrease in alertness level, and cybersickness symptoms could be modified in real-time by using the methods and embedded stimuli. We believe the envisioned approach will lead to significant cost savings and societal impact and will thus be a necessity in future VR setups. For instance, it will increase the efficiency of a VR training session by optimizing the task difficulty based on the user\u2019s cognitive load and decrease the probability of human errors by guiding visual perception via content adaptation.<\/jats:p>","DOI":"10.3389\/frvir.2024.1423756","type":"journal-article","created":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T04:34:30Z","timestamp":1726806870000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Head-area sensing in virtual reality: future visions for visual perception and cognitive state estimation"],"prefix":"10.3389","volume":"5","author":[{"given":"K.","family":"Pettersson","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Tervonen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Heininen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"M\u00e4ntyj\u00e4rvi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,9,20]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1145\/3343031.3350947","article-title":"360-degree video gaze behaviour: a ground-truth data set and a classification algorithm for eye movements","volume-title":"Proceedings of the 27th ACM international conference on multimedia","author":"Agtzidis","year":"2019"},{"key":"B2","first-page":"1M6","article-title":"Most naturally occurring human saccades have magnitudes of 15 degrees or less","author":"Bahill","year":"","journal-title":"Investig. Ophthalmol."},{"key":"B3","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/0025-5564(75)90075-9","article-title":"The main sequence, a tool for studying human eye movements","volume":"24","author":"Bahill","year":"","journal-title":"Math. Biosci."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3670008","article-title":"Are you feeling sick?\u2019 A systematic literature review of cybersickness in virtual reality","volume":"56","author":"Biswas","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"B5","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1111\/j.1469-8986.2008.00654.x","article-title":"The pupil as a measure of emotional arousal and autonomic activation","volume":"45","author":"Bradley","year":"2008","journal-title":"Psychophysiology"},{"key":"B6","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/978-1-4615-1163-2_4","article-title":"Startle reflex modulation: perception, attention, and emotion","volume-title":"Experimental methods in neuropsychologyNeuropsychology and cognition","author":"Bradley","year":"2003"},{"key":"B7","doi-asserted-by":"publisher","first-page":"295","DOI":"10.3233\/VES-180632","article-title":"Relationship between motion sickness susceptibility and vestibulo-ocular reflex gain and phase","volume":"28","author":"Cl\u00e9ment","year":"2018","journal-title":"J. Vestib. Res."},{"key":"B8","doi-asserted-by":"publisher","first-page":"107547","DOI":"10.1016\/j.neuropsychologia.2020.107547","article-title":"Keeping an eye on visual search patterns in visuospatial neglect: a systematic review","volume":"146","author":"Cox","year":"2020","journal-title":"Neuropsychologia"},{"key":"B9","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1016\/j.apergo.2011.01.003","article-title":"Main sequence: an index for detecting mental workload variation in complex tasks","volume":"42","author":"Di Stasi","year":"2011","journal-title":"Appl. Ergon."},{"key":"B10","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1109\/TAFFC.2019.2927337","article-title":"Review on psychological stress detection using biosignals","volume":"13","author":"Giannakakis","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"B11","doi-asserted-by":"publisher","first-page":"694567","DOI":"10.3389\/frvir.2021.694567","article-title":"A systematic review of physiological measurements, factors, methods, and applications in virtual reality","volume":"2","author":"Halbig","year":"2021","journal-title":"Front. Virtual Real."},{"key":"B12","doi-asserted-by":"publisher","first-page":"14304","DOI":"10.1038\/s41598-020-71125-4","article-title":"Active vision in immersive, 360\u00b0 real-world environments","volume":"10","author":"Haskins","year":"2020","journal-title":"Sci. Rep."},{"key":"B13","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.jneumeth.2010.01.010","article-title":"Improving the saccade peak velocity measurement for detecting fatigue","volume":"187","author":"Hirvonen","year":"2010","journal-title":"J. Neurosci. Methods"},{"key":"B14","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.neubiorev.2016.08.020","article-title":"Spontaneous eye blink rate as predictor of dopamine-related cognitive function\u2014a review","volume":"71","author":"Jongkees","year":"2016","journal-title":"Neurosci. and Biobehav. Rev."},{"key":"B15","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/S0301-0082(98)00098-7","article-title":"The neurobiology of startle","volume":"59","author":"Koch","year":"1999","journal-title":"Prog. Neurobiol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1037\/a0018883","article-title":"A meta-analysis of the impact of short-term sleep deprivation on cognitive variables","volume":"136","author":"Lim","year":"2010","journal-title":"Psychol. Bull."},{"key":"B17","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1109\/ISMAR50242.2020.00068","article-title":"Towards real-time recognition of users mental workload using integrated physiological sensors into a VR HMD","volume-title":"2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)","author":"Luong","year":"2020"},{"key":"B18","doi-asserted-by":"publisher","first-page":"20308","DOI":"10.1038\/s41598-022-24552-4","article-title":"Eye movement behavior in a real-world virtual reality task reveals ADHD in children","volume":"12","author":"Merzon","year":"2022","journal-title":"Sci. Rep."},{"key":"B19","first-page":"1","article-title":"An experimental protocol for exploration of stress in an immersive VR scenario with EEG","volume-title":"2022 7th south-east europe design automation, computer engineering, computer Networks and social media conference (SEEDA-CECNSM), ioannina, Greece","author":"Miltiadous","year":"2022"},{"key":"B20","first-page":"683","article-title":"Selecting feature sets and comparing classification methods for cognitive state estimation","volume-title":"Presented at the 2020 IEEE 20th international conference on bioinformatics and bioengineering (BIBE)","author":"Pettersson","year":"2020"},{"key":"B21","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1007\/s42486-022-00103-8","article-title":"Bio-physiological-signals-based VR cybersickness detection","volume":"4","author":"Qu","year":"2022","journal-title":"CCF Trans. Pervasive Comp. Interact."},{"key":"B22","doi-asserted-by":"publisher","first-page":"107289","DOI":"10.1016\/j.chb.2022.107289","article-title":"What is XR? Towards a framework for augmented and virtual reality","volume":"133","author":"Rauschnabel","year":"2022","journal-title":"Comput. Hum. Behav."},{"key":"B23","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1037\/0033-2909.124.3.372","article-title":"Eye movements in reading and information processing: 20 years of research","volume":"124","author":"Rayner","year":"1998","journal-title":"Psychol. Bull."},{"key":"B24","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1080\/00140130701817062","article-title":"Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?","volume":"51","author":"Schleicher","year":"2008","journal-title":"Ergonomics"},{"key":"B25","doi-asserted-by":"publisher","first-page":"104681","DOI":"10.1016\/j.compedu.2022.104681","article-title":"A review study on eye-tracking technology usage in immersive virtual reality learning environments","volume":"196","author":"Shadiev","year":"2023","journal-title":"Comput. and Educ."},{"key":"B26","doi-asserted-by":"publisher","first-page":"2220","DOI":"10.1038\/s41598-018-20588-7","article-title":"Stationary gaze entropy predicts lane departure events in sleep-deprived drivers","volume":"8","author":"Shiferaw","year":"2018","journal-title":"Sci. Rep."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1653","DOI":"10.3758\/s13428-021-01763-7","article-title":"Evaluating eye movement event detection: a review of the state of the art","volume":"55","author":"Startsev","year":"2022","journal-title":"Behav. Res."},{"key":"B28","doi-asserted-by":"publisher","first-page":"4643","DOI":"10.1113\/JP277779","article-title":"Distinct pattern of oculomotor impairment associated with acute sleep loss and circadian misalignment","volume":"597","author":"Stone","year":"2019","journal-title":"J. Physiol."},{"key":"B29","doi-asserted-by":"publisher","first-page":"2060","DOI":"10.1109\/TNSRE.2022.3192571","article-title":"Automated stress recognition using supervised learning classifiers by interactive virtual reality scenes","volume":"30","author":"Tao","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1294286","DOI":"10.3389\/fnrgo.2023.1294286","article-title":"Explainable stress type classification captures physiologically relevant responses in the Maastricht Acute Stress Test","volume":"4","author":"Tervonen","year":"2023","journal-title":"Front. Neuroergonomics"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1113\/JP280395","article-title":"Dose-dependent sensorimotor impairment in humanocular tracking after acute low-dose alcohol administration","volume":"599","author":"Tyson","year":"2021","journal-title":"J. Physiology"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.3390\/app12031027","article-title":"Eye-tracking in interactive virtual environments: implementation and evaluation","volume":"12","author":"Ugwitz","year":"2022","journal-title":"Appl. Sci."},{"key":"B33","doi-asserted-by":"publisher","first-page":"153","DOI":"10.2147\/EB.S82670","article-title":"Traumatic brain injury and vestibulo-ocular function: current challenges and future prospects","volume":"8","author":"Wallace","year":"2016","journal-title":"EB"},{"key":"B34","doi-asserted-by":"publisher","first-page":"107607","DOI":"10.1016\/j.chb.2022.107607","article-title":"Virtual reality-supported biofeedback for stress management: beneficial effects on heart rate variability and user experience","volume":"141","author":"Weibel","year":"2023","journal-title":"Comput. Hum. Behav."}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2024.1423756\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T12:57:38Z","timestamp":1727269058000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2024.1423756\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,20]]},"references-count":34,"alternative-id":["10.3389\/frvir.2024.1423756"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2024.1423756","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,20]]},"article-number":"1423756"}}