{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T09:31:59Z","timestamp":1775640719462,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,11,16]],"date-time":"2020-11-16T00:00:00Z","timestamp":1605484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Horizon 2020 WIDESPREAD-2018-2020 TEAMING Phase 2","award":["857155"],"award-info":[{"award-number":["857155"]}]},{"name":"Program for Innovation and Competitiveness","award":["BG16RFOP002-1.005"],"award-info":[{"award-number":["BG16RFOP002-1.005"]}]},{"DOI":"10.13039\/501100003336","name":"Bulgarian National Science Fund","doi-asserted-by":"publisher","award":["KP-06-N32\/5"],"award-info":[{"award-number":["KP-06-N32\/5"]}],"id":[{"id":"10.13039\/501100003336","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Cognitive disorders remain a major cause of disability in Multiple Sclerosis (MS). They lead to unemployment, the need for daily assistance, and a poor quality of life. The understanding of the origin, factors, processes, and consequences of cognitive disfunction is key to its prevention, early diagnosis, and rehabilitation. The neuropsychological testing and continuous monitoring of cognitive status as part of the overall evaluation of patients with MS in parallel with clinical and paraclinical examinations are highly recommended. In order to improve health and disease understanding, a close linkage between fundamental, clinical, epidemiological, and socio-economic research is required. The effective sharing of data, standardized data processing, and the linkage of such data with large-scale cohort studies is a prerequisite for the translation of research findings into the clinical setting. In this context, this paper proposes a software platform for the cognitive assessment and rehabilitation of patients with MS called CogniSoft. The platform automates the Beck Depression Inventory (BDI-II) test and diagnostic tests for the evaluation of memory and executive functions based on the nature of Brief International Cognitive Assessment for MS (BICAMS), as well as implementing a set of games for cognitive rehabilitation based on BICAMS. The software architecture, core modules, and technologies used for their implementation are presented. Special attention is given to the development of cognitive tests for diagnostics and rehabilitation. Their automation enables better perception, avoids bias as a result of conducting the classic paper tests of various neurophysiologists, provides easy administration, and allows data collection in a uniform manner, which further enables analysis using statistical and machine learning algorithms. The CogniSoft platform is registered as medical software by the Bulgarian Drug Agency and it is currently deployed in the Neurological Clinic of the National Hospital of Cardiology in Sofia, Bulgaria. The first experiments prove the feasibility of the platform, showing that it saves time and financial resources while providing subjectivity in the interpretation of the cognitive test results.<\/jats:p>","DOI":"10.3390\/computers9040093","type":"journal-article","created":{"date-parts":[[2020,11,16]],"date-time":"2020-11-16T11:04:20Z","timestamp":1605524660000},"page":"93","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["CogniSoft: A Platform for the Automation of Cognitive Assessment and Rehabilitation of Multiple Sclerosis"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9920-8877","authenticated-orcid":false,"given":"Dessislava","family":"Petrova-Antonova","sequence":"first","affiliation":[{"name":"GATE Institute, Sofia University, 1113 Sofia, Bulgaria"}]},{"given":"Ivaylo","family":"Spasov","sequence":"additional","affiliation":[{"name":"Rila Solutions, 1113 Sofia, Bulgaria"}]},{"given":"Yanita","family":"Petkova","sequence":"additional","affiliation":[{"name":"Rila Solutions, 1113 Sofia, Bulgaria"}]},{"given":"Ilina","family":"Manova","sequence":"additional","affiliation":[{"name":"Rila Solutions, 1113 Sofia, Bulgaria"}]},{"given":"Sylvia","family":"Ilieva","sequence":"additional","affiliation":[{"name":"GATE Institute, Sofia University, 1113 Sofia, Bulgaria"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"331","DOI":"10.3389\/fneur.2018.00331","article-title":"Investigating domain-specific cognitive impairment among patients with multiple sclerosis using touchscreen cognitive testing in routine clinical care","volume":"9","author":"Cotter","year":"2018","journal-title":"Front. Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1097\/WNN.0000000000000188","article-title":"Why Sex Matters: A Cognitive Study of People with Multiple Sclerosis","volume":"32","author":"Donaldson","year":"2019","journal-title":"Cogn. Behav. Neurol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1007\/s00415-010-5736-8","article-title":"Predicting employment status in multiple sclerosis patients: The utility of the MS functional composite","volume":"258","author":"Honarmand","year":"2011","journal-title":"J. Neurol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.1177\/1352458514532398","article-title":"Cognitive impairment in patients with multiple sclerosis predicts worse caregiver\u2019s health-related quality of life","volume":"20","author":"Mitchell","year":"2014","journal-title":"Mult. Scler. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.msard.2019.01.051","article-title":"Validity of a multi-domain computerized cognitive assessment battery for patients with multiple sclerosis, Multiple sclerosis and related disorders","volume":"30","author":"Golan","year":"2019","journal-title":"Mult. Scler. Relat. Disord."},{"key":"ref_6","unstructured":"IBM (2020, February 20). Bringing Big Data to the Enterprise. Available online: http:\/\/www-01.ibm.com\/software\/data\/bigdata\/what-is-big-data.html."},{"key":"ref_7","unstructured":"(2020, February 22). MIT Technology Review. Available online: https:\/\/www.technologyreview.com\/business-report\/data-driven-health-care\/free\/."},{"key":"ref_8","unstructured":"Van Rijmenam, M. (2020, February 22). Four Ways Big Data Will Revolutionize Education. Available online: https:\/\/datafloq.com\/read\/big-data-will-revolutionize-learning\/2016."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gervasi, O., Murgante, B., Misra, S., Garau, C., Ble\u010di\u0107, I., Taniar, D., Apduhan, B.O., Rocha, A.M.A.C., Tarantino, E., and Torre, C.M. (2020). A Digital Twin Platform for Diagnostics and Rehabilitation of Multiple Sclerosis. Proceedings of the 20th International Conference on Computational Science and its Applications (ICCSA 2020), Cagliari, Italy, 1\u20134 June 2020, Springer. Theoretical Computer Science and General Issues.","DOI":"10.1007\/978-3-030-58817-5"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1002\/gps.4852","article-title":"A systematic review of the diagnostic accuracy of automated tests for cognitive impairment","volume":"33","author":"Aslam","year":"2018","journal-title":"Int. J. Geriatr. Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/j.jalz.2008.07.003","article-title":"Status of computerized cognitive testing in aging: A systematic review","volume":"4","author":"Wild","year":"2008","journal-title":"Alzheimers Dement."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1177\/1533317514522852","article-title":"Computerized cognitive testing for older adults: A review","volume":"30","author":"Zygouris","year":"2015","journal-title":"Am. J. Alzheimers Dis. Other Dement."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.msard.2012.05.001","article-title":"Computerized cognitive testing for patients with multiple sclerosis","volume":"1","author":"Lapshin","year":"2012","journal-title":"Mult. Scler. Relat. Disord"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1159\/000157885","article-title":"Short-term cognitive training improves mental efficiency and mood in patients with multiple sclerosis","volume":"60","author":"Brenk","year":"2008","journal-title":"Eur. Neurol."},{"key":"ref_15","unstructured":"Baller, G., Kalbe, E., Kaesberg, S., and Kessler, J. (2010). NEUROvitalis. Ein Neuropsychologisches Grup-Penprogramm zur F\u00f6rderung der Geistigen Leistungsf\u00e4higket, ProLog. NEUROvitalis. A neuro-psychological group training for the improvement of cognitive performance."},{"key":"ref_16","first-page":"109","article-title":"BrainStim\u2014hirnstimulation als Pr\u00e4ventions- und Therapiemassnahme?","volume":"4","author":"Penner","year":"2007","journal-title":"Neurogeriatrie"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"143","DOI":"10.3233\/NRE-2010-0546","article-title":"Home-based personalized cognitive training in MS patients: A study of adherence and cognitive performance","volume":"26","author":"Shatil","year":"2010","journal-title":"NeuroRehabilitation"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1016\/j.neurol.2009.06.008","article-title":"Cognitive rehabilitation in multiple sclerosis: Preliminary results and presentation of a new program","volume":"166","author":"Brissart","year":"2010","journal-title":"Rev. Neurol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1177\/0269215511434997","article-title":"A randomized controlled trial of a cognitive rehabilitation intervention for persons with multiple sclerosis","volume":"26","author":"Stuifbergen","year":"2012","journal-title":"Clin Rehabil."},{"key":"ref_20","unstructured":"RehaCom (2003). Computer-Aided Cognitive Rehabilitation, HASOMED GmbH."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1177\/1352458513501571","article-title":"Computer-assisted rehabilitation of attention in patients with MS: Results of randomized, double blind trial","volume":"20","author":"Amato","year":"2014","journal-title":"Mult. Scler."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1159\/000485669","article-title":"The Symbol-Digit Modalities Test in mild cognitive impairment: Evidence from Parkinson\u2019s disease patients","volume":"79","author":"Pascoe","year":"2018","journal-title":"Eur. Neurol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1177\/1352458506070750","article-title":"Screening for cognitive impairment in multiple sclerosis using the Symbol Digit Modalities Test","volume":"13","author":"Parmenter","year":"2007","journal-title":"Mult. Scler."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1177\/1352458517743091","article-title":"Imaging patterns of gray and white matter abnormalities associated with PASAT and SDMT performance in relapsing-remitting multiple sclerosis","volume":"25","author":"Riccitelli","year":"2019","journal-title":"Mult. Scler."},{"key":"ref_25","unstructured":"Benedict, R. (1997). Brief Visuospatial Memory Test-Revised: Professional Manual, Psychological Assessment Resources."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1080\/13854046.2017.1354071","article-title":"Influence of nationality on the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS)","volume":"32","author":"Smerbeck","year":"2018","journal-title":"Clin. Neuropsychol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/S1474-4422(14)70250-9","article-title":"Clinical and imaging assessment of cognitive dysfunction in multiple sclerosis","volume":"14","author":"Rocca","year":"2015","journal-title":"Lancet Neurol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1093\/arclin\/acs099","article-title":"Development of the Greek Verbal Learning Test: Reliability, construct validity, and normative standards","volume":"28","author":"Vlahou","year":"2012","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1080\/13854046.2012.725101","article-title":"Cross cultural validation of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS) and the brief international cognitive assessment for multiple sclerosis (BICAMS)","volume":"26","author":"Dusankova","year":"2012","journal-title":"Clin. Neuropsychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1177\/1352458511431076","article-title":"Recommendations for a brief international cognitive assessment for multiple sclerosis (BICAMS)","volume":"18","author":"Langdon","year":"2012","journal-title":"Mult. Scler."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sousa, C., Rigueiro-Neves, M., Miranda, T., Alegria, P., Vale, J., Passos, A.M., Langdon, D., and Sa, M.J. (2018). Validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) in the Portuguese population with multiple sclerosis. BMC Neurol., 18.","DOI":"10.1186\/s12883-018-1175-4"},{"key":"ref_32","unstructured":"(2020, September 20). Karolinska Institute. Available online: https:\/\/ki.se\/en\/kind\/recognize-emotions-with-eu-emotion-video-material."},{"key":"ref_33","unstructured":"Todorova, L., and Ignatova, V. Computerized neuropsychological test battery CogniSoft for assessment of cognition in patients with multiple sclerosis. Bioautomation, accepted."},{"key":"ref_34","unstructured":"Ignatova, V., Stoyanova, T., and Haralanov, L. (2020, January 13\u201315). Results from a current pilot study for approbation of a computer system CogniSoft for diagnosis and rehabilitation of cognitive impairments in persons with multiple sclerosis. Proceedings of the IX International Congress of Psychology, Sofia, Bulgaria. accepted."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/9\/4\/93\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:33:49Z","timestamp":1760178829000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/9\/4\/93"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,16]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["computers9040093"],"URL":"https:\/\/doi.org\/10.3390\/computers9040093","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,16]]}}}