{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:46:22Z","timestamp":1772138782722,"version":"3.50.1"},"reference-count":61,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Previous studies on obsessive\u2013compulsive disorder (OCD) showed impairments in executive domains, particularly in cognitive inhibition. In this perspective, the use of virtual reality showed huge potential in the assessment of executive functions; however, unfortunately, to date, no study on the assessment of these patients took advantage of the use of virtual environments. One of the main problems faced within assessment protocols is the use of a limited number of variables and tools when tailoring a personalized program. The main aim of this study was to provide a heuristic decision tree for the future development of tailored assessment protocols. To this purpose, we conducted a study that involved 58 participants (29 OCD patients and 29 controls) to collect both classic neuropsychological data and precise data based on a validated protocol in virtual reality for the assessment of executive functions, namely, the VMET (virtual multiple errands test). In order to provide clear indications for working on executive functions with these patients, we carried out a cross-validation based on three learning algorithms and computationally defined two decision trees. We found that, by using three neuropsychological tests and two VMET scores, it was possible to discriminate OCD patients from controls, opening a novel scenario for future assessment protocols based on virtual reality and computational techniques.<\/jats:p>","DOI":"10.3390\/jcm8111975","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T10:56:34Z","timestamp":1573728994000},"page":"1975","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Computational Approach for the Assessment of Executive Functions in Patients with Obsessive\u2013Compulsive Disorder"],"prefix":"10.3390","volume":"8","author":[{"given":"Elisa","family":"Pedroli","sequence":"first","affiliation":[{"name":"Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Via Magnasco 2, 20149 Milano, Italy"},{"name":"Faculty of Psychology, eCampus University, Via Isimbardi, 10, 22060 Novedrate, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7464-1263","authenticated-orcid":false,"given":"Filippo","family":"La Paglia","sequence":"additional","affiliation":[{"name":"Department of Experimental Biomedicine and Clinical Neuroscience, University of Palermo, Piazza Marina, 61, 90133 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0662-7678","authenticated-orcid":false,"given":"Pietro","family":"Cipresso","sequence":"additional","affiliation":[{"name":"Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Via Magnasco 2, 20149 Milano, Italy"},{"name":"Psychology Department, Catholic University of Milan, Largo Gemelli 1, 20123 Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Caterina","family":"La Cascia","sequence":"additional","affiliation":[{"name":"Department of Experimental Biomedicine and Clinical Neuroscience, University of Palermo, Piazza Marina, 61, 90133 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3657-106X","authenticated-orcid":false,"given":"Giuseppe","family":"Riva","sequence":"additional","affiliation":[{"name":"Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Via Magnasco 2, 20149 Milano, Italy"},{"name":"Psychology Department, Catholic University of Milan, Largo Gemelli 1, 20123 Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniele","family":"La Barbera","sequence":"additional","affiliation":[{"name":"Department of Experimental Biomedicine and Clinical Neuroscience, University of Palermo, Piazza Marina, 61, 90133 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"key":"ref_1","unstructured":"APA (2013). Diagnostic and Statistical Manual of Mental Disorders-DSM-5, American Psychiatric Publishing."},{"key":"ref_2","first-page":"503","article-title":"Mental health-getting beyond stigma and categories","volume":"78","author":"Garfinkel","year":"2000","journal-title":"Bull. World Health Organ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.janxdis.2003.12.001","article-title":"Memory and attention in Obsessive-Compulsive Disorder: A review","volume":"19","author":"Muller","year":"2005","journal-title":"J. Anxiety Disord."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s00213-010-1963-z","article-title":"Impaired visuospatial associative memory and attention in obsessive compulsive disorder but no evidence for differential dopaminergic modulation","volume":"212","author":"Craig","year":"2010","journal-title":"Psychopharmacology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1016\/S0028-3932(99)00134-7","article-title":"The cognitive and neuroanatomical correlates of multitasking","volume":"38","author":"Burgess","year":"2000","journal-title":"Neuropsychologia"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.acn.2007.08.010","article-title":"Assessment of executive functions: Review of instruments and identification of critical issues","volume":"23","author":"Chan","year":"2008","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1016\/S0140-6736(99)90438-5","article-title":"Importance of deficits in executive functions","volume":"354","author":"Grafman","year":"1999","journal-title":"Lancet"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1093\/arclin\/acr022","article-title":"Neuropsychological Impairments and Their Association with Obsessive-Compulsive Symptom Severity in Obsessive-Compulsive Disorder","volume":"26","author":"Abramovitch","year":"2011","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"984","DOI":"10.1136\/bmj.312.7036.984a","article-title":"Current Controversies in the Anxiety Disorders","volume":"312","author":"Lader","year":"1996","journal-title":"BMJ"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1037\/a0018653","article-title":"Do organizational strategies mediate nonverbal memory impairment in drug-na\u00efve patients with obsessive-compulsive disorder?","volume":"24","author":"Shin","year":"2010","journal-title":"Neuropsychology"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.psychres.2008.02.006","article-title":"Comparable performance of patients with obsessive\u2013compulsive disorder (OCD) and healthy controls for verbal and nonverbal memory accuracy and confidence: Time to forget the forgetfulness hypothesis of OCD?","volume":"166","author":"Moritz","year":"2009","journal-title":"Psychiatry Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1016\/j.cpr.2013.09.004","article-title":"The neuropsychology of adult obsessive\u2013compulsive disorder: A meta-analysis","volume":"33","author":"Abramovitch","year":"2013","journal-title":"Clin. Psychol. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1038\/nrn3746","article-title":"Obsessive-compulsive disorder: An integrative genetic and neurobiological perspective","volume":"15","author":"Pauls","year":"2014","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.eurpsy.2006.05.001","article-title":"Impaired response inhibition in obsessive compulsive disorder","volume":"22","author":"Penades","year":"2007","journal-title":"Eur. Psychiatry"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"15","DOI":"10.3233\/NRE-1996-7103","article-title":"Hazards of blind analysis of neuropsychological test data in assessing cognitive disability: The role of confounding factors","volume":"7","author":"Sbordone","year":"1996","journal-title":"Neurorehabilitation"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/j.tics.2006.10.005","article-title":"Spatial memory: How egocentric and allocentric combine","volume":"10","author":"Burgess","year":"2006","journal-title":"Trends Cogn. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1080\/09602010802469074","article-title":"Validation of the Virtual MET as an assessment tool for executive functions","volume":"19","author":"Rand","year":"2009","journal-title":"Neuropsychol. Rehabil."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1097\/00001199-200210000-00002","article-title":"Virtual reality and neuropsychology: Upgrading the current tools","volume":"17","author":"Schultheis","year":"2002","journal-title":"J. Head Trauma Rehabil."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1089\/cpb.2005.8.220","article-title":"Virtual reality in psychotherapy: Review","volume":"8","author":"Riva","year":"2005","journal-title":"Cyberpsychol. Behav."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1089\/109493102321018169","article-title":"Virtual reality exposure therapy for World Trade Center post-traumatic stress disorder: A case report","volume":"5","author":"Difede","year":"2002","journal-title":"Cyberpsychol. Behav."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s10055-013-0237-6","article-title":"Toward a validation of cyber-interventions for stress disorders based on stress inoculation training: A systematic review","volume":"18","author":"Serino","year":"2014","journal-title":"Virtual Real."},{"key":"ref_22","first-page":"524","article-title":"The effects of a mobile stress management protocol on nurses working with cancer patients: A preliminary controlled study","volume":"173","author":"Villani","year":"2012","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Safir, M.P., Wallach, H.S., and Bar-Zvi, M. (2011). Virtual reality cognitive-behavior therapy for public speaking anxiety: One-year follow-up. Behav. Modif.","DOI":"10.1177\/0145445511429999"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/s00779-011-0467-0","article-title":"Virtual reality and mobile phones in the treatment of generalized anxiety disorders: A phase-2 clinical trial","volume":"17","author":"Repetto","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1016\/j.psychres.2015.10.025","article-title":"Out of body, out of space: Impaired reference frame processing in eating disorders","volume":"230","author":"Serino","year":"2015","journal-title":"Psychiatry Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"226","DOI":"10.3389\/fnbeh.2015.00226","article-title":"Assessment and rehabilitation of neglect using virtual reality: A systematic review","volume":"9","author":"Pedroli","year":"2015","journal-title":"Front. Behav. Neuroscience."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cipresso, P., Pedroli, E., Serino, S., Semonella, M., Tuena, C., Colombo, D., Pallavicini, E., and Riva, G. (2018). Assessment of Unilateral Spatial Neglect using a free mobile application for Italian clinicians. Front. Psychol., 9.","DOI":"10.3389\/fpsyg.2018.02241"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"405","DOI":"10.3389\/fnbeh.2014.00405","article-title":"Virtual multiple errands test (VMET): A virtual reality-based tool to detect early executive functions deficit in Parkinson\u2019s disease","volume":"8","author":"Cipresso","year":"2014","journal-title":"Frontiers in Behavioral Neuroscience."},{"key":"ref_29","first-page":"92","article-title":"Validation of a Neuro Virtual Reality-based version of the Multiple Errands Test for the assessment of executive functions","volume":"167","author":"Raspelli","year":"2010","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_30","first-page":"53","article-title":"Decision Making and Cognitive Behavioral Flexibility in a OCD Sample: A Study in a Virtual Environment","volume":"219","author":"Rizzo","year":"2016","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1089\/cyber.2015.0229","article-title":"Virtual Reality Body Swapping: A Tool for Modifying the Allocentric Memory of the Body","volume":"19","author":"Serino","year":"2016","journal-title":"Cyberpsychol. Behav. Soc. Netw."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.neulet.2015.06.057","article-title":"Do not get lost in translation: The role of egocentric heading in spatial orientation","volume":"602","author":"Serino","year":"2015","journal-title":"Neurosci. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ferrucci, R., Serino, S., Ruggiero, F., Repetto, C., Colombo, D., Pedroli, E., Marceglia, S., Riva, G., and Priori, A. (2019). Cerebellar Transcranial Direct Current Stimulation (tDCS), Leaves Virtual Navigation Performance Unchanged. Front. Neurosci., 13.","DOI":"10.3389\/fnins.2019.00198"},{"key":"ref_34","first-page":"158","article-title":"Cognitive rehabilitation of schizophrenia through NeuroVR training","volume":"191","author":"Rizzo","year":"2013","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1007\/s00221-013-3471-y","article-title":"Break in volition: A virtual reality study in patients with obsessive-compulsive disorder","volume":"229","author":"Cipresso","year":"2013","journal-title":"Exp. Brain Res."},{"key":"ref_36","first-page":"40","article-title":"Cognitive assessment of OCD patients: NeuroVR vs neuropsychological test","volume":"199","author":"Rizzo","year":"2014","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1089\/cyber.2017.0107","article-title":"A virtual reality game to assess obsessive-compulsive disorder","volume":"20","author":"Kasanmoentalib","year":"2017","journal-title":"Cyberpsychol. Behav. Soc. Netw."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1002\/da.22785","article-title":"Does neuropsychological performance in OCD relate to different symptoms? A meta-analysis comparing the symmetry and obsessing dimensions","volume":"35","author":"Bragdon","year":"2018","journal-title":"Depress. Anxiety"},{"key":"ref_39","first-page":"13","article-title":"How Strong are Passwords Used to Protect Personal Health Information in Clinical Trials?","volume":"13","author":"Moreau","year":"2011","journal-title":"J. Med. Internet Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1111\/j.1468-1331.1996.tb00423.x","article-title":"Mini-Mental State Examination: A normative study in Italian elderly population","volume":"3","author":"Magni","year":"1996","journal-title":"Eur. J. Neurol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1007\/s10072-012-1130-x","article-title":"Forward and backward span for verbal and visuo-spatial data: Standardization and normative data from an Italian adult population","volume":"34","author":"Monaco","year":"2012","journal-title":"Neurol. Sci."},{"key":"ref_42","first-page":"278","article-title":"Tre test clinici di memoria verbale a lungo termine: Taratura su soggetti normali","volume":"47","author":"Novelli","year":"1986","journal-title":"Arch. Psicol. Neurol. Psichiatr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1007\/s10072-005-0443-4","article-title":"The Frontal Assessment Battery (FAB): Normative values in an Italian population sample","volume":"26","author":"Appollonio","year":"2005","journal-title":"Neurol. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/BF03324425","article-title":"Variability of trail making test, symbol digit test and line trait test in normal people. A normative study taking into account age-dependent decline and sociobiological variables","volume":"14","author":"Amodio","year":"2002","journal-title":"Aging Clin. Exp. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/BF02337583","article-title":"Problem solving ability in aging and dementia: Normative data on a non-verbal test","volume":"8","author":"Allamanno","year":"1987","journal-title":"Ital. J. Neurol. Sci."},{"key":"ref_46","first-page":"477","article-title":"Tre test clinici di ricerca e produzione lessicale. Taratura su sogetti normali","volume":"47","author":"Novelli","year":"1986","journal-title":"Arch. Psicol. Neurol. Psichiatr."},{"key":"ref_47","first-page":"493","article-title":"NeuroVR 2-a free virtual reality platform for the assessment and treatment in behavioral health care","volume":"163","author":"Riva","year":"2011","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Cipresso, P., Serino, S., and Riva, G. (2016). Psychometric assessment and behavioral experiments using a free virtual reality platform and computational science. BMC Med. Inform. Decis. Mak., 16, (1).","DOI":"10.1186\/s12911-016-0276-5"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1162\/PRES_a_00077","article-title":"Validating the Neuro VR-based virtual version of the Multiple Errands Test: Preliminary results","volume":"21","author":"Raspelli","year":"2012","journal-title":"Presence Teleoper. Virtual Environ."},{"key":"ref_50","unstructured":"Love, J., Selker, R., Marsman, M., Jamil, T., Dropmann, D., Verhagen, A.J., and Wagenmakers, E.J. (2015). JASP (Version 0.7.1.4)[Computer Software], JASP Project. Available online: https:\/\/jasp-stats.org."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Caruana, R., and Niculescu-Mizil, A. (2006, January 25). An empirical comparison of supervised learning algorithms. Proceedings of the ACM 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143865"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Suthaharan, S. (2016). Supervised Learning Algorithms. Machine Learning Models and Algorithms for Big Data Classification, Springer.","DOI":"10.1007\/978-1-4899-7641-3"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.patcog.2014.07.025","article-title":"Optimizing area under the ROC curve using semi-supervised learning","volume":"48","author":"Wang","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_54","unstructured":"Kotsiantis, S.B., Zaharakis, I., and Pintelas, P. (2019, October 16). Supervised Machine Learning: A Review of Classification Techniques. Available online: https:\/\/datajobs.com\/data-science-repo\/Supervised-Learning-[SB-Kotsiantis].pdf URL."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Davis, J., and Goadrich, M. (2006, January 25). The relationship between Precision-Recall and ROC curves. Proceedings of the ACM 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143874"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_57","unstructured":"Wagacha, P.W. (2019, October 16). Induction of Decision Trees. Available online: https:\/\/www.researchgate.net\/profile\/Peter_Wagacha\/publication\/283569199_Instance_Based_Learning\/links\/563f951808ae34e98c4e723a\/Instance-Based-Learning.pdf URL."},{"key":"ref_58","first-page":"1","article-title":"A Review of Splitting Criteria for Decision Tree Induction","volume":"7","author":"Sheth","year":"2015","journal-title":"Fuzzy Syst."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1725","DOI":"10.3389\/fpsyg.2015.01725","article-title":"Modeling behavior dynamics using computational psychometrics within virtual worlds","volume":"6","author":"Cipresso","year":"2015","journal-title":"Front. Psychol."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Macniven, J.A. (2015). Neuropsychological Formulation: A Clinical Casebook, Springer.","DOI":"10.1007\/978-3-319-18338-1"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Savage, G. (2016). Cognitive Neuropsychological Formulation. Neuropsychological Formulation, Springer.","DOI":"10.1007\/978-3-319-18338-1_13"}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/8\/11\/1975\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:24Z","timestamp":1760189664000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/8\/11\/1975"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,14]]},"references-count":61,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["jcm8111975"],"URL":"https:\/\/doi.org\/10.3390\/jcm8111975","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,14]]}}}