{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:22:31Z","timestamp":1777126951413,"version":"3.51.4"},"reference-count":31,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T00:00:00Z","timestamp":1673827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"UK Medical Research Council","award":["MR\/N013700\/1"],"award-info":[{"award-number":["MR\/N013700\/1"]}]},{"name":"King\u2019s College London MRC Doctoral Training Partnership in Biomedical Sciences","award":["MR\/N013700\/1"],"award-info":[{"award-number":["MR\/N013700\/1"]}]},{"name":"National Institute for Health Research (NIHR) Maudsley Biomedical Research Centre at South London","award":["MR\/N013700\/1"],"award-info":[{"award-number":["MR\/N013700\/1"]}]},{"name":"Maudsley NHS Foundation Trust and King\u2019s College London","award":["MR\/N013700\/1"],"award-info":[{"award-number":["MR\/N013700\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cognitive impairment features in neuropsychiatric conditions and when undiagnosed can have a severe impact on the affected individual\u2019s safety and ability to perform daily tasks. Virtual Reality (VR) systems are increasingly being explored for the recognition, diagnosis and treatment of cognitive impairment. In this paper, we describe novel VR-derived measures of cognitive performance and show their correspondence with clinically-validated cognitive performance measures. We use an immersive VR environment called VStore where participants complete a simulated supermarket shopping task. People with psychosis (k=26) and non-patient controls (k=128) participated in the study, spanning ages 20\u201379 years. The individuals were split into two cohorts, a homogeneous non-patient cohort (k=99 non-patient participants) and a heterogeneous cohort (k=26 patients, k=29 non-patient participants). Participants\u2019 spatio-temporal behaviour in VStore is used to extract four features, namely, route optimality score, proportional distance score, execution error score, and hesitation score using the Traveling Salesman Problem and explore-exploit decision mathematics. These extracted features are mapped to seven validated cognitive performance scores, via linear regression models. The most statistically important feature is found to be the hesitation score. When combined with the remaining extracted features, the multiple linear regression model resulted in statistically significant results with R2 = 0.369, F-Stat = 7.158, p(F-Stat) = 0.000128.<\/jats:p>","DOI":"10.3390\/s23021026","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T03:10:34Z","timestamp":1673838634000},"page":"1026","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Automatic Detection of Cognitive Impairment with Virtual Reality"],"prefix":"10.3390","volume":"23","author":[{"given":"Farzana A.","family":"Mannan","sequence":"first","affiliation":[{"name":"Department of Engineering, King\u2019s College London, London WC2R 2LS, UK"}]},{"given":"Lilla A.","family":"Porffy","sequence":"additional","affiliation":[{"name":"Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King\u2019s College London, London SE5 8AF, UK"}]},{"given":"Dan W.","family":"Joyce","sequence":"additional","affiliation":[{"name":"Department of Primary Care and Mental Health, Institute of Population Health, University of Liverpool, Liverpool L69 3BX, UK"}]},{"given":"Sukhwinder S.","family":"Shergill","sequence":"additional","affiliation":[{"name":"Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King\u2019s College London, London SE5 8AF, UK"},{"name":"Kent and Medway Medical School, Canterbury CT2 7NZ, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7213-6359","authenticated-orcid":false,"given":"Oya","family":"Celiktutan","sequence":"additional","affiliation":[{"name":"Department of Engineering, King\u2019s College London, London WC2R 2LS, UK"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1038\/nrd3628","article-title":"Cognitive dysfunction in psychiatric disorders: Characteristics, causes and the quest for improved therapy","volume":"11","author":"Millan","year":"2012","journal-title":"Nat. Rev. Drug Discov."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e57","DOI":"10.1192\/j.eurpsy.2022.2315","article-title":"European Psychiatric Association guidance on treatment of cognitive impairment in schizophrenia","volume":"65","author":"Vita","year":"2022","journal-title":"Eur. Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-Benito, J., Guilera, G., Pino, \u00d3., Rojo, E., Tabar\u00e9s-Seisdedos, R., Safont, G., Mart\u00ednez-Ar\u00e1n, A., Franco, M., Cuesta, M.J., and Crespo-Facorro, B. (2013). The screen for cognitive impairment in psychiatry: Diagnostic-specific standardization in psychiatric ill patients. BMC Psychiatry, 13.","DOI":"10.1186\/1471-244X-13-127"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1093\/schbul\/sbp095","article-title":"A brief cognitive assessment tool for schizophrenia: Construction of a tool for clinicians","volume":"37","author":"Hurford","year":"2011","journal-title":"Schizophr. Bull."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.schres.2004.09.006","article-title":"The MATRICS initiative: Developing a consensus cognitive battery for clinical trials","volume":"72","author":"Green","year":"2004","journal-title":"Schizophr. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1076\/jcen.20.3.310.823","article-title":"The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary clinical validity","volume":"20","author":"Randolph","year":"1998","journal-title":"J. Clin. Exp. Neuropsychol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.jpsychires.2021.12.002","article-title":"Cognition Assessment in Virtual Reality: Validity and feasibility of a novel virtual reality test for real-life cognitive functions in mood disorders and psychosis spectrum disorders","volume":"145","author":"Miskowiak","year":"2022","journal-title":"J. Psychiatr. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.jneumeth.2018.03.010","article-title":"The Virtual Shop: A new immersive virtual reality environment and scenario for the assessment of everyday memory","volume":"303","author":"Ouellet","year":"2018","journal-title":"J. Neurosci. Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.1093\/brain\/awz116","article-title":"Differentiation of mild cognitive impairment using an entorhinal cortex-based test of virtual reality navigation","volume":"142","author":"Howett","year":"2019","journal-title":"Brain"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e27641","DOI":"10.2196\/27641","article-title":"A Novel Virtual Reality Assessment of Functional Cognition: Validation Study","volume":"24","author":"Porffy","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1002\/wps.20809","article-title":"The clinical characterization of the patient with primary psychosis aimed at personalization of management","volume":"20","author":"Maj","year":"2021","journal-title":"World Psychiatry"},{"key":"ref_12","unstructured":"Education, O.M. (2022, November 23). Mini-Mental-State Examination. Available online: https:\/\/oxfordmedicaleducation.com\/geriatrics\/mini-mental-state-examination-mmse\/."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2386","DOI":"10.1001\/jama.1993.03500180078038","article-title":"Population-based norms for the Mini-Mental State Examination by age and educational level","volume":"269","author":"Crum","year":"1993","journal-title":"JAMA"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/13803395.2011.589374","article-title":"MoCA: Normative study for the Portuguese population","volume":"33","author":"Freitas","year":"2011","journal-title":"J. Exp. Clin. Neuropsychol."},{"key":"ref_16","unstructured":"Schulman, K. (2022, November 23). Clock Drawing Test. Available online: https:\/\/www.cgakit.com\/m-1-clock-test."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1111\/j.1525-1497.2005.40069.x","article-title":"Drawing Clocks and Driving Cars","volume":"20","author":"Freund","year":"2005","journal-title":"J. Gen. Intern. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1080\/13825585.2010.530221","article-title":"The usefulness of the story recall test in patients with mild cognitive impairment and AD","volume":"18","author":"Baek","year":"2011","journal-title":"Aging Neuropsychol. Cogn."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"95","DOI":"10.3233\/JAD-201017","article-title":"Egocentric and Allocentric Spatial Memory in Mild Cognitive Impairment withReal-World and Virtual Navigation Tasks: A Systematic Review","volume":"79","author":"Tuena","year":"2021","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1016\/j.neuropsychologia.2011.12.013","article-title":"Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer\u2019s disease: Influence of active and passive encoding","volume":"50","author":"Plancher","year":"2012","journal-title":"Neuropsychologia"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Alzheimer\u2019s-Association (2019). Alzheimer\u2019s Disease facts and figures. Alzheimer\u2019s Dement, 15, 321\u2013387.","DOI":"10.1016\/j.jalz.2019.01.010"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Horan, B., Heckenberg, R., Maruff, P., and Wright, B. (2020). Development of a new virtual reality test of cognition: assessing the test-retest reliability, convergent and ecological validity of CONVIRT. BMC Psychol., 8.","DOI":"10.1186\/s40359-020-00429-x"},{"key":"ref_23","first-page":"1983","article-title":"Mood is a key determinant of cognitive performance in community-dwelling older adults: a cross-sectional analysis","volume":"35","author":"Santos","year":"2013","journal-title":"Off. J. Am. Aging Assoc."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bolandzadeh, N., Kordin, K., Salowitz, N., Davis, J., Hsu, L., Chan, A., Sharma, D., Blohm, G., and Liu-Ambrose, T. (2015). Predicting Cognitive Function from Clinical Measures of Physical Function and Health Status in Older Adults. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0119075"},{"key":"ref_25","first-page":"1","article-title":"Predicting progression and cognitive decline in amyloid-positive patients with Alzheimer\u2019s disease","volume":"13","author":"Dansson","year":"2021","journal-title":"Alzheimer\u2019s Res. Ther."},{"key":"ref_26","unstructured":"(2022, November 23). Vitae VR Homepage. Vitae VR. Available online: https:\/\/www.vitaevr.com."},{"key":"ref_27","first-page":"875197","article-title":"VStore: Feasibility and acceptability of a novel virtual reality functional cognition task","volume":"3","author":"Porffy","year":"2022","journal-title":"Frontiers"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1093\/arclin\/acaa076","article-title":"An examination of reliable change methods for measuring cognitive change with the Cogstate Computerized Battery: Research and clinical implications","volume":"36","author":"Gates","year":"2021","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_29","unstructured":"Guo, J., and Wei, A. (2022, November 23). NP-Completeness. Available online: https:\/\/math.mit.edu\/research\/highschool\/primes\/circle\/documents\/2022\/Jessica%20&%20Audrey.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1002\/net.21864","article-title":"Dynamic programming approaches for the traveling salesman problem with drone","volume":"72","author":"Bouman","year":"2018","journal-title":"Networks"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"100196","DOI":"10.1016\/j.scog.2021.100196","article-title":"Computational methods for integrative evaluation of confidence, accuracy, and reaction time in facial affect recognition in schizophrenia","volume":"25","author":"Badal","year":"2021","journal-title":"Schizophr. Res. Cogn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/1026\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:07:07Z","timestamp":1760119627000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/1026"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,16]]},"references-count":31,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23021026"],"URL":"https:\/\/doi.org\/10.3390\/s23021026","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,16]]}}}