{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,9]],"date-time":"2025-11-09T03:52:23Z","timestamp":1762660343384,"version":"3.41.2"},"reference-count":99,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:p><jats:bold>Background and objective:<\/jats:bold> EPELI (Executive Performance of Everyday LIving) is a Virtual Reality (VR) task that was developed to study goal-directed behavior in everyday life contexts in children. In this study, we had 72 typically developing 9- to 13-year-old children to play EPELI with an immersive version implemented with a head-mounted display (HMD) and a non-immersive version employing a flat screen display (FSD) in a counterbalanced order to see if the two versions yield similar results. The children\u2019s everyday executive functions were assessed with the parent-rated Behavior Rating Inventory for Executive Functions (BRIEF) questionnaire. To assess the applicability of EPELI for online testing, half of the flat screen display version gameplays were conducted remotely and the rest in the laboratory.<\/jats:p><jats:p><jats:bold>Results:<\/jats:bold> All EPELI performance measures were correlated across the versions. The children\u2019s performance was mostly similar in the two versions, but small effects reflecting higher performance in FSD-EPELI were found in the measures of Total score, Task efficacy, and Time-based prospective memory score. The children engaged in more active time monitoring in FSD-EPELI. While the children evaluated the feeling of presence and usability of both versions favorably, most children preferred HMD-EPELI, and evaluated its environment to be more involving and realistic. Both versions showed only negligible problems with the interface quality. No differences in task performance or subjective evaluations were found between the home-based and laboratory-based assessments of FSD-EPELI. In both EPELI versions, the efficacy measures were correlated with BRIEF on the first assessment, but not on the second. This raises questions about the stability of the associations reported between executive function tasks and questionnaires.<\/jats:p><jats:p><jats:bold>Conclusions:<\/jats:bold> Both the HMD and FSD versions of EPELI are viable tools for the naturalistic assessment of goal-directed behavior in children. While the HMD version provides a more immersive user experience and naturalistic movement tracking, the FSD version can maximize scalability, reachability, and cost efficacy, as it can be used with common hardware and remotely. Taken together, the findings highlight similarities between the HMD and FSD versions of a cognitively complex VR task, but also underline the specific advantages of these common presentation modes.<\/jats:p>","DOI":"10.3389\/frvir.2023.1138240","type":"journal-article","created":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T10:45:52Z","timestamp":1685097952000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Assessing goal-directed behavior in virtual reality with the neuropsychological task EPELI: children prefer head-mounted display but flat screen provides a viable performance measure for remote testing"],"prefix":"10.3389","volume":"4","author":[{"given":"Erik","family":"Seesj\u00e4rvi","sequence":"first","affiliation":[]},{"given":"Matti","family":"Laine","sequence":"additional","affiliation":[]},{"given":"Kaisla","family":"Kasteenpohja","sequence":"additional","affiliation":[]},{"given":"Juha","family":"Salmi","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"205566832110671","DOI":"10.1177\/20556683211067174","article-title":"Comparing the usability of a virtual reality manual wheelchair simulator in two display conditions","volume":"9","author":"Alapakkam Govindarajan","year":"2022","journal-title":"J. Rehabilitation Assistive Technol. Eng."},{"key":"B2","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1080\/13803395.2012.740002","article-title":"Validity of the virtual reality Stroop task (VRST) in active duty military","volume":"35","author":"Armstrong","year":"2013","journal-title":"J. Clin. Exp. Neuropsychology"},{"unstructured":"gridExtra: Miscellaneous functions for \u201cgrid\u201d graphics\n            AuguieB.\n          2017","key":"B3"},{"key":"B4","doi-asserted-by":"publisher","first-page":"e16792","DOI":"10.2196\/16792","article-title":"Comparing web-based and lab-based cognitive assessment using the Cambridge neuropsychological test automated battery: A within-subjects counterbalanced study","volume":"22","author":"Backx","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"B5","doi-asserted-by":"publisher","first-page":"571","DOI":"10.3390\/brainsci11050571","article-title":"A virtual kitchen protocol to measure everyday memory functioning for meal preparation","volume":"11","author":"Barnett","year":"2021","journal-title":"Brain Sci."},{"key":"B6","doi-asserted-by":"publisher","first-page":"e0275119","DOI":"10.1371\/journal.pone.0275119","article-title":"Comparing virtual reality, desktop-based 3D, and 2D versions of a category learning experiment","volume":"17","author":"Barrett","year":"2022","journal-title":"PLOS ONE"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"J. Stat. Softw."},{"key":"B8","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1093\/arclin\/acs027","article-title":"Computerized neuropsychological assessment devices: Joint position paper of the American Academy of clinical Neuropsychology and the national Academy of Neuropsychology","volume":"27","author":"Bauer","year":"2012","journal-title":"Archives Clin. Neuropsychology"},{"key":"B9","doi-asserted-by":"publisher","first-page":"2815","DOI":"10.21105\/joss.02815","article-title":"effectsize: Estimation of effect size indices and standardized parameters","volume":"5","author":"Ben-Shachar","year":"2020","journal-title":"J. Open Source Softw."},{"key":"B10","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1038\/nrn3122","article-title":"Virtual reality in neuroscience research and therapy","volume":"12","author":"Bohil","year":"2011","journal-title":"Nat. Rev. Neurosci."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1514","DOI":"10.1177\/1541931213601863","article-title":"Comparison of a head-mounted display and flat screen display during a micro-UAV target detection task","volume":"61","author":"Brooks","year":"2017","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"B12","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1017\/S1355617706060310","article-title":"The case for the development and use of \u201cecologically valid\u201d measures of executive function in experimental and clinical neuropsychology","volume":"12","author":"Burgess","year":"2006","journal-title":"J. Int. Neuropsychological Soc."},{"key":"B13","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1080\/09084280903297891","article-title":"Utilizing virtual reality to improve the ecological validity of clinical Neuropsychology: An fMRI case study elucidating the neural basis of planning by comparing the tower of london with a three-dimensional navigation task","volume":"16","author":"Campbell","year":"2009","journal-title":"Appl. Neuropsychol."},{"key":"B14","doi-asserted-by":"publisher","first-page":"103936","DOI":"10.1016\/j.apergo.2022.103936","article-title":"Presence in video games: A systematic review and meta-analysis of the effects of game design choices","volume":"107","author":"Caroux","year":"2023","journal-title":"Appl. Ergon."},{"key":"B15","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.acn.2007.08.010","article-title":"Assessment of executive functions: Review of instruments and identification of critical issues","volume":"23","author":"Chan","year":"2008","journal-title":"Archives Clin. Neuropsychology"},{"key":"B16","doi-asserted-by":"publisher","first-page":"69566","DOI":"10.1109\/access.2020.2966564","article-title":"Examining the effects of HMDs\/FSDs and gender differences on cognitive processing ability and user experience of the Stroop task-embedded virtual reality driving system (STEVRDS)","volume":"8","author":"Chang","year":"2020","journal-title":"IEEE Access"},{"key":"B17","doi-asserted-by":"publisher","first-page":"0560","DOI":"10.1089\/cyber.2020.0560","article-title":"The virtual cooking task: A preliminary comparison between neuropsychological and ecological virtual reality tests to assess executive functions alterations in patients affected by alcohol use disorder","volume":"2020","author":"Chicchi Giglioli","year":"2021","journal-title":"Cyberpsychology, Behav. Soc. Netw."},{"key":"B18","doi-asserted-by":"publisher","first-page":"405","DOI":"10.3389\/fnbeh.2014.00405","article-title":"Virtual multiple errands test (VMET): A virtual reality-based tool to detect early executive functions deficit in Parkinson's disease","volume":"8","author":"Cipresso","year":"2014","journal-title":"Front. Behav. Neurosci."},{"key":"B19","doi-asserted-by":"publisher","first-page":"2086","DOI":"10.3389\/fpsyg.2018.02086","article-title":"The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature","volume":"9","author":"Cipresso","year":"2018","journal-title":"Front. Psychol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"130","DOI":"10.3390\/virtualworlds1020008","article-title":"Virtual reality induced symptoms and effects: Concerns, causes, assessment & mitigation","volume":"1","author":"Conner","year":"2022","journal-title":"Virtual Worlds"},{"key":"B21","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.acn.2004.06.002","article-title":"Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tests?","volume":"20","author":"Constantinou","year":"2005","journal-title":"Archives Clin. Neuropsychology"},{"key":"B22","doi-asserted-by":"publisher","first-page":"e57410","DOI":"10.1371\/journal.pone.0057410","article-title":"Evaluating amazon\u2019s mechanical Turk as a tool for experimental behavioral research","volume":"8","author":"Crump","year":"2013","journal-title":"PLoS ONE"},{"key":"B23","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1017\/S1355617704102191","article-title":"Reliability and validity of the delis-kaplan executive function system: An update","volume":"10","author":"Delis","year":"2004","journal-title":"J. Int. Neuropsychological Soc."},{"key":"B24","doi-asserted-by":"publisher","first-page":"2006","DOI":"10.1111\/bjet.13030","article-title":"Immersive virtual reality in K\u201012 and higher education: A 10\u2010year systematic review of empirical research","volume":"51","author":"Di Natale","year":"2020","journal-title":"Br. J. Educ. Technol."},{"key":"B25","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1080\/09297049.2013.792332","article-title":"AULA virtual reality test as an attention measure: Convergent validity with Conners\u2019 Continuous Performance Test","volume":"20","author":"D\u00edaz-Orueta","year":"2014","journal-title":"Child. Neuropsychol."},{"unstructured":"data.table: Extension of `data.frame\n            DowleM.\n            SrinivasanA.\n          2021","key":"B26"},{"key":"B27","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1093\/arclin\/acr120","article-title":"Evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods","volume":"27","author":"Duff","year":"2012","journal-title":"Archives Clin. Neuropsychology"},{"key":"B28","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1080\/13854046.2016.1190405","article-title":"Online cognition: Factors facilitating reliable online neuropsychological test results","volume":"31","author":"Feenstra","year":"2017","journal-title":"Clin. Neuropsychologist"},{"unstructured":"R package stringi: Character string processing facilities\n            GagolewskiM.\n          2020","key":"B29"},{"key":"B30","doi-asserted-by":"publisher","first-page":"847","DOI":"10.3758\/s13423-012-0296-9","article-title":"Is the web as good as the lab? Comparable performance from web and lab in cognitive\/perceptual experiments","volume":"19","author":"Germine","year":"2012","journal-title":"Psychonomic Bull. Rev."},{"volume-title":"Behavior rating inventory of executive function: Brief","year":"2000","author":"Gioia","key":"B31"},{"key":"B32","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1111\/1468-0017.00196","article-title":"Psychology, philosophy, and cognitive science: Reflections on the history and philosophy of experimental Psychology","volume":"17","author":"Hatfield","year":"2002","journal-title":"Mind Lang."},{"key":"B33","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1080\/13854046.2010.526785","article-title":"Official position of the American Academy of clinical Neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administrations in clinical and forensic contexts","volume":"24","author":"Heilbronner","year":"2010","journal-title":"Clin. Neuropsychologist"},{"key":"B34","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1080\/09084282.2011.643955","article-title":"Development of a Novel, ecologically oriented virtual reality measure of executive function: The multitasking in the city test","volume":"19","author":"Jovanovski","year":"2012","journal-title":"Appl. Neuropsychol. Adult"},{"key":"B35","doi-asserted-by":"publisher","first-page":"e0280717","DOI":"10.1371\/journal.pone.0280717","article-title":"Assessment of goal-directed behavior with the 3D videogame EPELI: Psychometric features in a web-based adult sample","volume":"18","author":"Jylkk\u00e4","year":"2023","journal-title":"PLOS ONE"},{"key":"B36","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1207\/s15327108ijap0303_3","article-title":"Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness","volume":"3","author":"Kennedy","year":"1993","journal-title":"Int. J. Aviat. Psychol."},{"key":"B37","doi-asserted-by":"publisher","first-page":"517","DOI":"10.3200\/JRLP.142.5.517-532","article-title":"Cognitive load and task condition in event- and time-based prospective memory: An experimental investigation","volume":"142","author":"Khan","year":"2008","journal-title":"J. Psychol."},{"key":"B38","doi-asserted-by":"publisher","first-page":"665","DOI":"10.5351\/CSAM.2015.22.6.665","article-title":"ppcor: An R package for a fast calculation to semi-partial correlation coefficients","volume":"22","author":"Kim","year":"2015","journal-title":"Commun. Stat. Appl. Methods"},{"key":"B39","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1080\/23808985.2020.1792790","article-title":"Does virtual reality help to cut the Gordian knot between ecological validity and experimental control?","volume":"44","author":"Kothgassner","year":"2020","journal-title":"Ann. Int. Commun. Assoc."},{"key":"B40","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1017\/S1355617720000764","article-title":"Validation of the virtual reality everyday assessment lab (VR-EAL): An immersive virtual reality neuropsychological battery with enhanced ecological validity","volume":"27","author":"Kourtesis","year":"2021","journal-title":"J. Int. Neuropsychological Soc."},{"key":"B41","doi-asserted-by":"publisher","first-page":"417","DOI":"10.3389\/fnhum.2019.00417","article-title":"Validation of the virtual reality neuroscience questionnaire: Maximum duration of immersive virtual reality sessions without the presence of pertinent adverse symptomatology","volume":"13","author":"Kourtesis","year":"2019","journal-title":"Front. Hum. Neurosci."},{"key":"B42","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3389\/fcomp.2019.00012","article-title":"Guidelines for the development of immersive virtual reality software for cognitive neuroscience and Neuropsychology: The development of virtual reality everyday assessment lab (VR-EAL), a neuropsychological test battery in immersive virtual reality","volume":"1","author":"Kourtesis","year":"2020","journal-title":"Front. Comput. Sci."},{"key":"B43","doi-asserted-by":"publisher","first-page":"100151","DOI":"10.1016\/j.chbr.2021.100151","article-title":"How immersive virtual reality methods may meet the criteria of the national Academy of Neuropsychology and American Academy of clinical Neuropsychology: A software review of the virtual reality everyday assessment lab (VR-EAL)","volume":"4","author":"Kourtesis","year":"2021","journal-title":"Comput. Hum. Behav. Rep."},{"key":"B44","doi-asserted-by":"publisher","first-page":"e16724","DOI":"10.2196\/16724","article-title":"Multidimensional evaluation of virtual reality paradigms in clinical Neuropsychology: Application of the VR-check framework","volume":"22","author":"Krohn","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v082.i13","article-title":"lmerTest package: Tests in linear mixed effects models","volume":"82","author":"Kuznetsova","year":"2017","journal-title":"J. Stat. Softw."},{"key":"B46","doi-asserted-by":"publisher","first-page":"1438","DOI":"10.1162\/jocn_a_01560","article-title":"Enhanced attention using head-mounted virtual reality","volume":"32","author":"Li","year":"2020","journal-title":"J. Cognitive Neurosci."},{"key":"B47","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/j.learninstruc.2017.12.007","article-title":"Adding immersive virtual reality to a science lab simulation causes more presence but less learning","volume":"60","author":"Makransky","year":"2019","journal-title":"Learn. Instr."},{"key":"B48","article-title":"Diving head-first into virtual reality: Evaluating HMD control schemes for VR games","author":"Martel","year":"2015","journal-title":"FDG"},{"key":"B99","doi-asserted-by":"publisher","first-page":"20308","DOI":"10.1038\/s41598-022-24552-4","article-title":"Eye movement behavior in a real-world virtual reality task reveals ADHD in children","volume":"12","author":"Merzon","year":"2022","journal-title":"Sci. Rep."},{"key":"B49","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1080\/09602011.2014.941295","article-title":"Test\u2013retest consistency of virtual week: A task to investigate prospective memory","volume":"25","author":"Mioni","year":"2015","journal-title":"Neuropsychol. Rehabil."},{"key":"B50","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1163\/22134468-bja10034","article-title":"Time compression in virtual reality","volume":"9","author":"Mullen","year":"2021","journal-title":"Timing & Time Percept."},{"key":"B51","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1080\/13854046.2016.1144793","article-title":"Virtual reality measures in neuropsychological assessment: A meta-analytic review","volume":"30","author":"Negu\u021b","year":"2016","journal-title":"Clin. Neuropsychologist"},{"key":"B52","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.jneumeth.2018.03.010","article-title":"The virtual shop: A new immersive virtual reality environment and scenario for the assessment of everyday memory","volume":"303","author":"Ouellet","year":"2018","journal-title":"J. Neurosci. Methods"},{"key":"B53","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-92052-8_8","article-title":"Effectiveness of virtual reality survival horror games for the emotional elicitation: Preliminary insights using resident evil 7: Biohazard","volume-title":"Universal access in human-computer interaction. Virtual, augmented, and intelligent environments","author":"Pallavicini","year":"2018"},{"key":"B54","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1145\/3341215.3355736","article-title":"Comparing player experience in video games played in virtual reality or on desktop displays: Immersion, flow, and positive emotions","volume":"2019","author":"Pallavicini","year":"2019","journal-title":"Ext. Abstr. Annu. Symposium Computer-Human Interact. Play Companion Ext. Abstr."},{"key":"B55","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1177\/1046878119831420","article-title":"Gaming in virtual reality: What changes in terms of usability, emotional response and sense of presence compared to non-immersive video games?","volume":"50","author":"Pallavicini","year":"2019","journal-title":"Simul. Gaming"},{"key":"B56","doi-asserted-by":"publisher","first-page":"587698","DOI":"10.3389\/frvir.2020.587698","article-title":"Cybersickness in head-mounted displays is caused by differences in the user\u2019s virtual and physical head pose","volume":"1","author":"Palmisano","year":"2020","journal-title":"Front. Virtual Real."},{"key":"B57","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1111\/bjop.12290","article-title":"Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape","volume":"109","author":"Pan","year":"2018","journal-title":"Br. J. Psychol."},{"key":"B58","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.3233\/JAD-170295","article-title":"Validity of a newly developed measure of memory: Feasibility study of the virtual environment grocery store","volume":"59","author":"Parsons","year":"2017","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"B59","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1080\/09602011.2015.1109524","article-title":"The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical Neuropsychology","volume":"27","author":"Parsons","year":"2017","journal-title":"Neuropsychol. Rehabil."},{"key":"B60","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/978-1-4939-9482-3_11","article-title":"A review of virtual classroom environments for neuropsychological assessment","volume-title":"Virtual reality for psychological and neurocognitive interventions","author":"Parsons","year":"2019"},{"key":"B61","doi-asserted-by":"publisher","first-page":"660","DOI":"10.3389\/fnhum.2015.00660","article-title":"Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences","volume":"9","author":"Parsons","year":"2015","journal-title":"Front. Hum. Neurosci."},{"unstructured":"patchwork: The composer of plots\n            PedersenT. L.\n          2020","key":"B62"},{"key":"B63","doi-asserted-by":"publisher","first-page":"12304","DOI":"10.1111\/jnp.12304","article-title":"Virtual reality technology in neuropsychological testing: A systematic review","volume":"55","author":"Pieri","year":"2023","journal-title":"J. Neuropsychology"},{"key":"B64","doi-asserted-by":"publisher","first-page":"e27641","DOI":"10.2196\/27641","article-title":"A Novel virtual reality assessment of functional cognition: Validation study","volume":"24","author":"Porffy","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"B66","doi-asserted-by":"crossref","first-page":"9","DOI":"10.4324\/9780203344187-5","article-title":"Introduction: Methodologies and models in the study of executive function","volume-title":"Methodology of frontal and executive function","author":"Rabbitt","year":"2004"},{"volume-title":"R: A language and environment for statistical computing","year":"2020","key":"B65"},{"key":"B67","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/09602010802469074","article-title":"Validation of the Virtual MET as an assessment tool for executive functions","volume":"19","author":"Rand","year":"2009","journal-title":"Neuropsychol. Rehabil."},{"key":"B68","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1162\/PRES_a_00077","article-title":"Validating the neuro VR-based virtual version of the multiple errands test: Preliminary results","volume":"21","author":"Raspelli","year":"2012","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"B69","doi-asserted-by":"publisher","first-page":"S43","DOI":"10.1002\/acp.770","article-title":"Virtual week and actual week: Age-related differences in prospective memory","volume":"14","author":"Rendell","year":"2000","journal-title":"Appl. Cogn. Psychol."},{"key":"B70","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.neuroscience.2005.12.061","article-title":"The multi-component model of working memory: Explorations in experimental cognitive Psychology","volume":"139","author":"Repov\u0161","year":"2006","journal-title":"Neuroscience"},{"volume-title":"psych: Procedures for psychological, psychometric, and personality research","year":"2020","author":"Revelle","key":"B71"},{"key":"B72","doi-asserted-by":"publisher","first-page":"1628","DOI":"10.1016\/j.apmr.2020.01.019","article-title":"Measurement properties of the multiple errands test: A systematic review","volume":"101","author":"Rotenberg","year":"2020","journal-title":"Archives Phys. Med. Rehabilitation"},{"key":"B73","doi-asserted-by":"publisher","first-page":"e21","DOI":"10.1016\/j.scog.2014.01.004","article-title":"Virtual reality functional capacity assessment in schizophrenia: Preliminary data regarding feasibility and correlations with cognitive and functional capacity performance","volume":"1","author":"Ruse","year":"2014","journal-title":"Schizophrenia Res. Cognition"},{"key":"B74","doi-asserted-by":"publisher","first-page":"1770","DOI":"10.1007\/s00426-022-01770-z","article-title":"Epeli: A novel virtual reality task for the assessment of goal-directed behavior in real-life contexts","volume":"22","author":"Seesj\u00e4rvi","year":"","journal-title":"Psychol. Res."},{"key":"B75","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1177\/10870547211044214","article-title":"Quantifying ADHD symptoms in open-ended everyday life contexts with a new virtual reality task","volume":"26","author":"Seesj\u00e4rvi","year":"","journal-title":"J. Atten. Disord."},{"key":"B76","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1093\/brain\/114.2.727","article-title":"Deficits in strategy application following frontal lobe damage in man","volume":"114","author":"Shallice","year":"1991","journal-title":"Brain"},{"key":"B77","doi-asserted-by":"publisher","first-page":"2072","DOI":"10.1177\/1541931213602001","article-title":"Gaming on the rift: How virtual reality affects game user satisfaction","volume":"61","author":"Shelstad","year":"2017","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"B78","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1111\/bjop.12305","article-title":"Immersion and the illusion of presence in virtual reality","volume":"109","author":"Slater","year":"2018","journal-title":"Br. J. Psychol."},{"key":"B79","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3389\/frobt.2016.00074","article-title":"Enhancing our lives with immersive virtual reality","volume":"3","author":"Slater","year":"2016","journal-title":"Front. Robotics AI"},{"key":"B80","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.psychres.2007.01.003","article-title":"Malingering and uncooperativeness in psychiatric and psychological assessment: Prevalence and effects in a German sample of claimants","volume":"157","author":"Stevens","year":"2008","journal-title":"Psychiatry Res."},{"key":"B81","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.chb.2018.04.019","article-title":"The state of immersive technology research: A literature analysis","volume":"86","author":"Suh","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"B82","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1145\/2793107.2793117","article-title":"Exploring gameplay experiences on the Oculus rift","volume-title":"Proceedings of the 2015 annual symposium on computer-human interaction in play","author":"Tan","year":"2015"},{"key":"B83","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1007\/s10055-020-00466-2","article-title":"Effects of dynamic field-of-view restriction on cybersickness and presence in HMD-based virtual reality","volume":"25","author":"Teixeira","year":"2021","journal-title":"Virtual Real."},{"key":"B84","doi-asserted-by":"publisher","first-page":"2509","DOI":"10.3389\/fpsyg.2019.02509","article-title":"Immersive versus non-immersive experience: Exploring the feasibility of memory assessment through 360\u00b0 technology","volume":"10","author":"Ventura","year":"2019","journal-title":"Front. Psychol."},{"key":"B85","first-page":"2982","article-title":"Evaluating VR driving simulation from a player experience perspective","author":"Walch","year":"2017"},{"key":"B86","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1080\/09602011.2020.1862679","article-title":"The Oxford digital multiple errands test (OxMET): Validation of a simplified computer tablet based multiple errands test","volume":"32","author":"Webb","year":"2021","journal-title":"Neuropsychol. Rehabil."},{"volume-title":"WAIS-III: Wechsler adult intelligence scale","year":"1997","author":"Wechsler","key":"B87"},{"key":"B88","doi-asserted-by":"publisher","first-page":"158","DOI":"10.3389\/fpsyg.2019.00158","article-title":"Presence and cybersickness in virtual reality are negatively related: A review","volume":"10","author":"Weech","year":"2019","journal-title":"Front. Psychol."},{"key":"B89","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1348\/174866410X521434","article-title":"Memory in traumatic brain injury: The effects of injury severity and effort on the wechsler memory scale-III: WMS-III and TBI","volume":"5","author":"West","year":"2011","journal-title":"J. Neuropsychology"},{"key":"B90","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.21105\/joss.01686","article-title":"Welcome to the tidyverse","volume":"4","author":"Wickham","year":"2019","journal-title":"J. Open Source Softw."},{"key":"B91","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24277-4","volume-title":"ggplot2: Elegant graphics for data analysis","author":"Wickham","year":"2016"},{"unstructured":"stringr: Simple, consistent wrappers for common string operations\n            WickhamH.\n          2019","key":"B92"},{"unstructured":"dplyr: A Grammar of Data Manipulation\n            WickhamH.\n            Fran\u00e7oisR.\n            HenryL.\n            M\u00fcllerK.\n          2021","key":"B98"},{"key":"B93","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1162\/105474605323384654","article-title":"The factor structure of the presence questionnaire","volume":"14","author":"Witmer","year":"2005","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"B94","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.acn.2006.06.002","article-title":"The California verbal learning test \u2013 second edition: Test-retest reliability, practice effects, and reliable change indices for the standard and alternate forms","volume":"21","author":"Woods","year":"2006","journal-title":"Archives Clin. Neuropsychology"},{"volume-title":"The ICD-10 classification of mental and behavioural disorders: Clinical descriptions and diagnostic guidelines","year":"1992","article-title":"World Health organization","key":"B95"},{"key":"B96","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-22602-2_18","article-title":"The effects of immersion in a virtual reality game: Presence and physical activity","volume-title":"HCI in games","author":"Yao","year":"2019"},{"key":"B97","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1080\/09658211.2021.1995435","article-title":"The Geneva space cruiser: A fully self-administered online tool to assess prospective memory across the adult lifespan","volume":"1","author":"Zuber","year":"2021","journal-title":"Memory"}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2023.1138240\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T10:46:05Z","timestamp":1685097965000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2023.1138240\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":99,"alternative-id":["10.3389\/frvir.2023.1138240"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2023.1138240","relation":{},"ISSN":["2673-4192"],"issn-type":[{"type":"electronic","value":"2673-4192"}],"subject":[],"published":{"date-parts":[[2023,5,26]]},"article-number":"1138240"}}