{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T02:57:07Z","timestamp":1789527427059,"version":"build-2803163510"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T00:00:00Z","timestamp":1773100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Detecting subtle cognitive decline in chronic central nervous system (CNS) disease is hampered by practice effects, motor confounds, and the lack of premorbid baselines. Smartphone testing offers frequent unsupervised assessments but requires rigorous validation and internal quality control. Therefore, we aimed to develop and validate smartphone-based verbal and spatial memory tasks, derive composite digital biomarkers, and determine their utility for monitoring cognitive impairment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      In a prospective study (2018\u20132025) we enrolled 315 adults [41 healthy donors, 217 people with Multiple Sclerosis (MS), 57 other CNS disorders]. Participants completed 5,875 verbal and 2,588 spatial trials on the Neurological Functions Test Suite App. We extracted fourteen digital biomarkers reflecting individualized Sensory-Motor Processing Thresholds (iSMPT), adjusted test latencies and test accuracies, and split the MS cohort into training (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u2009145) and validation (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u200972) sets. Ordinal logistic regression generated composite scores that were tested in the held-out cohort. Reliability (intraclass correlation coefficient, ICC) and criterion validity (Spearman Rho, R\u00b2, Lin's concordance) were calculated;\n                      <jats:italic>p<\/jats:italic>\n                      -values\u2009&amp;lt;\u20090.05 were considered significant.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The spatial memory composite separated healthy donors from relapsing-remitting multiple sclerosis (RR-MS), progressive MS, non-inflammatory and inflammatory neurological diseases, and radiologically\/clinically isolated syndromes (all\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;lt;\u20090.05), outperforming all single biomarkers. With iSMPT included, it correlated most strongly with global disability [Expanded Disability Status scale [EDSS], Neurological exam composite [NeurEx]; Rho\u2009=\u20090.62\u20130.63,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;lt;\u20090.001] and lesion volume (Rho\u2009=\u20090.71,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009=\u20090.008); without iSMPT it tracked cognitive subscores [EDSS Functional System Score 7 (FSS7), NeurEx panel 1; Rho\u2009=\u20090.50\u20130.53,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;lt;\u20090.001] and Combinatorial MRI Score of CNS tissue destruction (COMRIS-CTD; Rho\u2009=\u20090.63,\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&amp;lt;\u20090.001). Test\u2013retest reliability was good (ICC\u2009=\u20090.813 with iSMPT; 0.713 without). A linear model using spatial memory biomarkers predicted Symbol Digit Modalities Test (SDMT) scores in an independent cohort (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u200963; R\u00b2\u2009=\u20090.53, Rho\u2009=\u20090.74, concordance\u2009=\u20090.66), enabling a 95% prediction envelope for real-time quality control.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The spatial memory composite provides a rapid, reliable, and sensory-motor delay-adjusted digital marker of mild cognitive dysfunction. Coupled with SDMT, it enhances unsupervised monitoring and internal quality assurance across diverse CNS disorders.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fdgth.2026.1680389","type":"journal-article","created":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T06:41:10Z","timestamp":1773124870000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Assessing verbal and spatial memory via smartphone"],"prefix":"10.3389","volume":"8","author":[{"given":"Peter","family":"Kosa","sequence":"first","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amir Moghadam","family":"Ahmadi","sequence":"additional","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marie","family":"Kanu","sequence":"additional","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yolanda","family":"Mejia","sequence":"additional","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darwing","family":"Padilla-Rolon","sequence":"additional","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bibiana","family":"Bielekova","sequence":"additional","affiliation":[{"name":"Neuroimmunological Diseases Section, Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, National Institutes of Health","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,10]]},"reference":[{"key":"B1","volume-title":"Neuropsychological Assessment","author":"Lezak","year":"2012"},{"key":"B2","doi-asserted-by":"publisher","first-page":"87","DOI":"10.3390\/neurosci6030087","article-title":"An update on new approaches to cognitive assessment in multiple sclerosis","volume":"6","author":"Balconi","year":"2025","journal-title":"NeuroSci"},{"key":"B3","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1001\/jamaneurol.2020.4920","article-title":"Identifying the distinct cognitive phenotypes in multiple sclerosis","volume":"78","author":"De Meo","year":"2021","journal-title":"JAMA Neurol"},{"key":"B4","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1186\/s12883-024-03943-2","article-title":"Comparing cognitive impairment using MACFIMS in patients with multiple sclerosis and healthy controls: a systematic review and meta-analysis","volume":"24","author":"Nasirzadeh","year":"2024","journal-title":"BMC Neurol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1017\/S1355617706060723","article-title":"Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS)","volume":"12","author":"Benedict","year":"2006","journal-title":"J Int Neuropsychol Soc"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1032","DOI":"10.1080\/13854046.2016.1189597","article-title":"Assessing the criterion validity of four highly abbreviated measures from the minimal assessment of cognitive function in multiple sclerosis (MACFIMS)","volume":"30","author":"Gromisch","year":"2016","journal-title":"Clin Neuropsychol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1186\/1471-2377-12-55","article-title":"Brief international cognitive assessment for MS (BICAMS): international standards for validation","volume":"12","author":"Benedict","year":"2012","journal-title":"BMC Neurol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.1111\/ene.12463","article-title":"The symbol digit modalities test as sentinel test for cognitive impairment in multiple sclerosis","volume":"21","author":"Van Schependom","year":"2014","journal-title":"Eur J Neurol"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1007\/s40120-025-00736-8","article-title":"Evaluating cognitive outcomes in multiple sclerosis: real-world impact of ozanimod on processing speed using BICAMS","volume":"14","author":"Zanghi","year":"2025","journal-title":"Neurol Ther"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1016\/S0140-6736(18)30475-6","article-title":"Siponimod versus placebo in secondary progressive multiple sclerosis (EXPAND): a double-blind, randomised, phase 3 study","volume":"391","author":"Kappos","year":"2018","journal-title":"Lancet"},{"key":"B11","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1056\/NEJMoa1601277","article-title":"Ocrelizumab versus interferon Beta-1a in relapsing multiple sclerosis","volume":"376","author":"Hauser","year":"2016","journal-title":"N Engl J Med"},{"key":"B12","doi-asserted-by":"publisher","first-page":"714682","DOI":"10.3389\/fmedt.2021.714682","article-title":"Assessment of smartphone-based spiral tracing in multiple sclerosis reveals intra-individual reproducibility as a major determinant of the clinical utility of the digital test","volume":"3","author":"Messan","year":"2021","journal-title":"Front Med Technol"},{"key":"B13","doi-asserted-by":"publisher","first-page":"740","DOI":"10.3389\/fneur.2018.00740","article-title":"Identifying and quantifying neurological disability via smartphone","volume":"9","author":"Boukhvalova","year":"2018","journal-title":"Front Neurol"},{"key":"B14","doi-asserted-by":"publisher","first-page":"358","DOI":"10.3389\/fneur.2019.00358","article-title":"Smartphone level test measures disability in several neurological domains for patients with multiple sclerosis","volume":"10","author":"Boukhvalova","year":"2019","journal-title":"Front Neurol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1038\/s41746-021-00401-y","article-title":"Smartphone-based symbol-digit modalities test reliably captures brain damage in multiple sclerosis","volume":"4","author":"Pham","year":"2021","journal-title":"NPJ Digit Med"},{"key":"B16","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1186\/s12883-025-04038-2","article-title":"Smartphone postural sway and pronator drift tests as measures of neurological disability","volume":"25","author":"Calcagni","year":"2025","journal-title":"BMC Neurol"},{"key":"B17","doi-asserted-by":"publisher","first-page":"2036","DOI":"10.1126\/science.134.3495.2036","article-title":"Repetition and paired associates learning","volume":"134","author":"Kristofferson","year":"1961","journal-title":"Science"},{"key":"B18","doi-asserted-by":"publisher","first-page":"103905","DOI":"10.1016\/j.actpsy.2023.103905","article-title":"Autistic traits are associated with enhanced working memory capacity for abstract visual stimuli","volume":"236","author":"Nicholls","year":"2023","journal-title":"Acta Psychol (Amst)"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1016\/S0028-3932(98)00159-6","article-title":"Pattern span: a tool for unwelding visuo-spatial memory","volume":"37","author":"Della Sala","year":"1999","journal-title":"Neuropsychologia"},{"key":"B20","volume-title":"Visuo-spatial Working Memory","author":"Logie","year":"1995"},{"key":"B21","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1006\/brcg.1998.1039","article-title":"The Corsi block-tapping task: methodological and theoretical considerations","volume":"38","author":"Berch","year":"1998","journal-title":"Brain Cogn"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1002\/acn3.640","article-title":"Neurex: digitalized neurological examination offers a novel high-resolution disability scale","volume":"5","author":"Kosa","year":"2018","journal-title":"Ann Clin Transl Neurol"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1444","DOI":"10.1212\/WNL.33.11.1444","article-title":"Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS)","volume":"33","author":"Kurtzke","year":"1983","journal-title":"Neurology"},{"key":"B24","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1016\/j.msard.2015.08.009","article-title":"Novel composite MRI scale correlates highly with disability in multiple sclerosis patients","volume":"4","author":"Kosa","year":"2015","journal-title":"Mult Scler Relat Disord"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1026442","DOI":"10.3389\/fradi.2022.1026442","article-title":"Machine learning-optimized combinatorial MRI scale (COMRISv2) correlates highly with cognitive and physical disability scales in multiple sclerosis patients","volume":"2","author":"Kelly","year":"2022","journal-title":"Front Radiol"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1524","DOI":"10.1016\/j.neuroimage.2009.09.005","article-title":"A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions","volume":"49","author":"Shiee","year":"2010","journal-title":"NeuroImage"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v028.i05","article-title":"Building predictive models in R using the caret package","volume":"28","author":"Kuhn","year":"2008","journal-title":"J Stat Softw"},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-21706-2","volume-title":"Modern Applied Statistics with S","author":"Venables","year":"2002"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"J Stat Softw"},{"key":"B30","volume-title":"R: A Language and Environment for Statistical Computing","year":"2024"},{"key":"B31","doi-asserted-by":"publisher","first-page":"2055217316634754","DOI":"10.1177\/2055217316634754","article-title":"Accuracy and precision of smartphone applications and commercially available motion sensors in multiple sclerosis","volume":"2","author":"Balto","year":"2016","journal-title":"Mult Scler J Exp Transl Clin"},{"key":"B32","doi-asserted-by":"publisher","first-page":"e162","DOI":"10.1212\/NXI.0000000000000162","article-title":"Evaluating more naturalistic outcome measures: a 1-year smartphone study in multiple sclerosis","volume":"2","author":"Bove","year":"2015","journal-title":"Neurol Neuroimmunol Neuroinflamm"},{"key":"B33","doi-asserted-by":"publisher","first-page":"054002","DOI":"10.1088\/1361-6579\/ab8771","article-title":"Smartphone-based remote assessment of upper extremity function for multiple sclerosis using the FLOODLIGHT draw a shape test","volume":"41","author":"Creagh","year":"2020","journal-title":"Physiol Meas"},{"key":"B34","doi-asserted-by":"publisher","first-page":"540930","DOI":"10.3389\/fspor.2020.540930","article-title":"The validity, reliability, and sensitivity of a smartphone-based seated postural control assessment in wheelchair users: a pilot study","volume":"2","author":"Frechette","year":"2020","journal-title":"Front Sports Act Living"},{"key":"B35","doi-asserted-by":"publisher","first-page":"e14863","DOI":"10.2196\/14863","article-title":"Adherence and satisfaction of smartphone- and smartwatch-based remote active testing and passive monitoring in people with multiple sclerosis: nonrandomized interventional feasibility study","volume":"21","author":"Midaglia","year":"2019","journal-title":"J Med Internet Res"},{"key":"B36","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.3390\/brainsci15101084","article-title":"Mobile typing as a window into sensorimotor and cognitive function","volume":"15","author":"Viviani","year":"2025","journal-title":"Brain Sci"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.1080\/14737175.2025.2580468","article-title":"Mobile health technologies for the management of Parkinson\u2019s disease","volume":"15","author":"Bougea","year":"2025","journal-title":"Expert Rev Neurother"},{"key":"B38","doi-asserted-by":"publisher","first-page":"106782","DOI":"10.1016\/j.msard.2025.106782","article-title":"Mobile-based cognitive screening tools in multiple sclerosis: scoping literature and app store review","volume":"104","author":"Gromisch","year":"2025","journal-title":"Mult Scler Relat Disord"},{"key":"B39","doi-asserted-by":"publisher","first-page":"e73331","DOI":"10.2196\/73331","article-title":"Digital innovations for clinical assessment in acquired brain injury: scoping review","volume":"27","author":"O'Brien","year":"2025","journal-title":"J Med Internet Res"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1418","DOI":"10.1056\/NEJMoa1501481","article-title":"Daclizumab HYP versus interferon beta-1a in relapsing multiple sclerosis","volume":"373","author":"Kappos","year":"2015","journal-title":"N Engl J Med"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2026.1680389\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T06:41:13Z","timestamp":1773124873000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2026.1680389\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,10]]},"references-count":40,"alternative-id":["10.3389\/fdgth.2026.1680389"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2026.1680389","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,10]]},"article-number":"1680389"}}