{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T02:12:04Z","timestamp":1772503924857,"version":"3.50.1"},"reference-count":50,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T00:00:00Z","timestamp":1734307200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy","doi-asserted-by":"publisher","award":["20014701"],"award-info":[{"award-number":["20014701"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Existing computerized cognitive tests (CCTs) lack speech recognition, which limits their assessment of language function. Therefore, we developed CogMo, a self-administered CCT that uses automatic speech recognition (ASR) to assess multi-domain cognitive functions, including language. This study investigated the validity and reliability of CogMo in discriminating cognitive impairments. CogMo automatically provides CCT results; however, manual scoring using recorded audio was performed to verify its ASR accuracy. The mini\u2013mental state examination (MMSE) was used to assess cognitive functions. Pearson\u2019s correlation was used to analyze the relationship between the MMSE and CogMo results, intraclass correlation coefficient (ICC) was used to evaluate the test-retest reliability of CogMo, and receiver operating characteristic (ROC) analysis validated its diagnostic accuracy for cognitive impairments. Data of 100 participants (70 with normal cognition, 30 with cognitive impairment), mean age 74.6\u00b17.4 years, were analyzed. The CogMo scores indicated significant differences in cognitive levels for all test items, including manual and automatic scoring for the speech recognition test, and a very high correlation (r = 0.98) between the manual and automatic CogMo scores. Additionally, the total CogMo and MMSE scores exhibited a strong correlation (r = 0.89). Moreover, CogMo exhibited high test-retest reliability (ICC = 0.94) and ROC analysis yielded an area under the curve of 0.89 (sensitivity = 90.0%, specificity = 82.9%) at a cutoff value of 68.8 points. The CogMo demonstrated adequate validity and reliability for discriminating multi-domain cognitive impairment, including language function, in community-dwelling older adults.<\/jats:p>","DOI":"10.1371\/journal.pone.0315745","type":"journal-article","created":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T18:27:52Z","timestamp":1734373672000},"page":"e0315745","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Development and validation of a self-administered computerized cognitive assessment based on automatic speech recognition"],"prefix":"10.1371","volume":"19","author":[{"given":"Hyun-Ho","family":"Kong","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kwangsoo","family":"Shin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong-Seok","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aryun","family":"Kim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyeon-Seong","family":"Joo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5922-4135","authenticated-orcid":true,"given":"Min Woo","family":"Oh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9533-848X","authenticated-orcid":true,"given":"Jeonghwan","family":"Lee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,12,16]]},"reference":[{"key":"pone.0315745.ref001","doi-asserted-by":"crossref","first-page":"604","DOI":"10.46234\/ccdcw2021.160","article-title":"Major Trends in Population Growth Around the World.","volume":"10","author":"D Gu","year":"2021","journal-title":"China CDC Wkly."},{"key":"pone.0315745.ref002","doi-asserted-by":"crossref","first-page":"e105","DOI":"10.1016\/S2468-2667(21)00249-8","article-title":"Estimation of the global prevalence of dementia in 2019 and forecasted prevalence in 2050: an analysis for the Global Burden of Disease Study 2019","volume":"7","author":"GBD 2019 Dementia Forecasting Collaborators","year":"2022","journal-title":"Lancet Public Health"},{"key":"pone.0315745.ref003","doi-asserted-by":"crossref","first-page":"29","DOI":"10.12779\/dnd.2012.11.2.29","article-title":"Activities of Daily Living and Dementia.","volume":"11","author":"Y Yang","year":"2012","journal-title":"Dement Neurocognitive Disord."},{"key":"pone.0315745.ref004","doi-asserted-by":"crossref","first-page":"e164","DOI":"10.1212\/WNL.0000000000201564","article-title":"Associations of Social Isolation and Loneliness With Later Dementia","volume":"99","author":"C Shen","year":"2022","journal-title":"Neurology"},{"key":"pone.0315745.ref005","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1136\/jnnp.2005.072983","article-title":"Quality of life in dementia: more than just cognition. An analysis of associations with quality of life in dementia","volume":"77","author":"S Banerjee","year":"2006","journal-title":"J Neurol Neurosurg Psychiatry"},{"key":"pone.0315745.ref006","article-title":") Global status report on the public health response to dementia","author":"World Health Organization","year":"2021"},{"key":"pone.0315745.ref007","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1001\/archneur.56.3.303","article-title":"Mild Cognitive Impairment: Clinical Characterization and Outcome","volume":"56","author":"RC Petersen","year":"1999","journal-title":"Arch Neurol"},{"key":"pone.0315745.ref008","first-page":"22","volume":"404","author":"RC Petersen","year":"2016","journal-title":"Mild Cognitive Impairment. Contin Lifelong Learn Neurol"},{"key":"pone.0315745.ref009","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1111\/j.1365-2796.2004.01388.x","article-title":"Mild cognitive impairment as a diagnostic entity","volume":"256","author":"RC Petersen","year":"2004","journal-title":"J Intern Med"},{"key":"pone.0315745.ref010","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1016\/S1474-4422(23)00274-0","article-title":"Preparing for disease-modifying therapies in Alzheimer\u2019s disease","volume":"22","author":"CRS Belder","year":"2023","journal-title":"Lancet Neurol"},{"key":"pone.0315745.ref011","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1212\/WNL.0000000000004826","article-title":"Practice guideline update summary: Mild cognitive impairment","volume":"90","author":"RC Petersen","year":"2018","journal-title":"Neurology"},{"key":"pone.0315745.ref012","doi-asserted-by":"crossref","first-page":"1589","DOI":"10.1001\/jama.2019.4782","article-title":"Diagnosis and Management of Dementia: Review","volume":"322","author":"Z Arvanitakis","year":"2019","journal-title":"JAMA"},{"key":"pone.0315745.ref013","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.jalz.2007.07.011","article-title":"Neuropsychological testing and assessment for dementia.","volume":"3","author":"C Jacova","year":"2007","journal-title":"Alzheimers Dementa"},{"key":"pone.0315745.ref014","doi-asserted-by":"crossref","first-page":"e743","DOI":"10.1093\/geront\/gny126","article-title":"Can MoCA and MMSE Be Interchangeable Cognitive Screening Tools? A Systematic Review.","volume":"59","author":"GSA Siqueira","year":"2018","journal-title":"The Gerontologist."},{"issue":"3","key":"pone.0315745.ref015","doi-asserted-by":"crossref","first-page":"214","DOI":"10.3928\/19404921-20090421-06","article-title":"A review of translations and adaptations of the Mini-Mental State Examination in languages other than English and Spanish.","volume":"2","author":"MR Steis","year":"2009","journal-title":"Res Gerontol Nurs"},{"key":"pone.0315745.ref016","first-page":"267","article-title":"Current State of Self-Administered Brief Computerized Cognitive Assessments for Detection of Cognitive Disorders in Older Adults: A Systematic Review.","volume":"8","author":"E Tsoy","year":"2021","journal-title":"J Prev Alzheimers Dis."},{"key":"pone.0315745.ref017","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1177\/1533317514522852","article-title":"Computerized Cognitive Testing for Older Adults: A Review","volume":"30","author":"S Zygouris","year":"2015","journal-title":"Am J Alzheimers Dis Dementias"},{"key":"pone.0315745.ref018","first-page":"181","article-title":"Identifying mild cognitive impairment and mild Alzheimer\u2019s disease based on spontaneous speech using ASR and linguistic features. Computer Speech &","volume":"53","author":"G Gosztolya","year":"2019","journal-title":"Language"},{"issue":"2","key":"pone.0315745.ref019","doi-asserted-by":"crossref","first-page":"130","DOI":"10.2174\/1567205014666171121114930","article-title":"A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech.","volume":"15","author":"L Toth","year":"2018","journal-title":"Curr Alzheimer Res"},{"issue":"4","key":"pone.0315745.ref020","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.3390\/s22041583","article-title":"Using automatic speech recognition to assess Thai speech language fluency in the Montreal Cognitive Assessment (MoCA).","volume":"22","author":"P Kantithammakorn","year":"2022","journal-title":"Sensors"},{"key":"pone.0315745.ref021","doi-asserted-by":"crossref","first-page":"131858","DOI":"10.1109\/ACCESS.2021.3112535","article-title":"Automatic speech recognition: systematic literature review.","volume":"9","author":"S Alharbi","year":"2021","journal-title":"IEEE Access"},{"key":"pone.0315745.ref022","doi-asserted-by":"crossref","unstructured":"Plauche M, Nallasamy U, Pal J, Wooters C, Ramachandran D, editors. Speech recognition for illiterate access to information and technology. 2006 International Conference on Information and Communication Technologies and Development; 2006 May 25\u201326; Berkeley, CA, USA.","DOI":"10.1109\/ICTD.2006.301842"},{"issue":"1","key":"pone.0315745.ref023","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1159\/000533188","article-title":"Validation of an automated speech analysis of cognitive tasks within a semiautomated phone assessment.","volume":"7","author":"D Ter Huurne","year":"2023","journal-title":"Digit Biomark."},{"issue":"2","key":"pone.0315745.ref024","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1001\/archopht.1990.01070040138048","article-title":"Blindness and visual impairment in an American urban population: the Baltimore Eye Survey","volume":"108","author":"JM Tielsch","year":"1990","journal-title":"Arch Ophthalmol"},{"issue":"4","key":"pone.0315745.ref025","doi-asserted-by":"crossref","first-page":"213","DOI":"10.21848\/asr.220077","article-title":"Reliability and validity of the Korean matrix sentence-in-noise recognition test for older listeners with normal hearing and with hearing impairment","volume":"18","author":"Y Jung","year":"2022","journal-title":"Audiol Speech Res"},{"key":"pone.0315745.ref026","doi-asserted-by":"crossref","first-page":"e0163792","DOI":"10.1371\/journal.pone.0163792","article-title":"The Validity and Reliability of the Mini-Mental State Examination-2 for Detecting Mild Cognitive Impairment and Alzheimer\u2019s Disease in a Korean Population.","volume":"11","author":"MJ Baek","year":"2016","journal-title":"PLoS ONE."},{"key":"pone.0315745.ref027","first-page":"300","article-title":"A validity study on the Korean Mini-Mental State Examination (K-MMSE) in dementia patients.","author":"Y Kang","year":"1997","journal-title":"J Korean Neurol Assoc"},{"key":"pone.0315745.ref028","unstructured":"Google Cloud [Internet]. Sunnyvale: Google; c2024 [cited 2024 Nov 22]. Available from: https:\/\/cloud.google.com\/speech-to-text\/?hl=ko."},{"issue":"2","key":"pone.0315745.ref029","doi-asserted-by":"crossref","first-page":"49","DOI":"10.21315\/eimj2019.11.2.6","article-title":"ABC of content validation and content validity index calculation","volume":"11","author":"MSB Yusoff","year":"2019","journal-title":"Education in Medicine Journal"},{"key":"pone.0315745.ref030","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1213\/ANE.0000000000002864","article-title":"Correlation Coefficients: Appropriate Use and Interpretation.","volume":"126","author":"P Schober","year":"2018","journal-title":"Anesth Analg."},{"key":"pone.0315745.ref031","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.","volume":"6","author":"DV Cicchetti","year":"1994","journal-title":"Psychol Assess"},{"key":"pone.0315745.ref032","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1159\/000084558","article-title":"Diagnostic Accuracy of Mini-Mental Status Examination and Revised Hasegawa Dementia Scale for Alzheimer\u2019s Disease.","volume":"19","author":"KW Kim","year":"2005","journal-title":"Dement Geriatr Cogn Disord."},{"key":"pone.0315745.ref033","first-page":"29","article-title":"The accuracy of the MMSE in detecting cognitive impairment when administered by general practitioners: A prospective observational study.","volume":"9","author":"the \"Progetto Alzheimer\" Working Group","year":"2005","journal-title":"BMC Fam Pract."},{"key":"pone.0315745.ref034","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1017\/S1041610218001370","article-title":"Is the Montreal Cognitive Assessment (MoCA) screening superior to the Mini-Mental State Examination (MMSE) in the detection of mild cognitive impairment (MCI) and Alzheimer\u2019s Disease (AD) in the elderly?","volume":"31","author":"TCC Pinto","year":"2019","journal-title":"Int Psychogeriatr."},{"key":"pone.0315745.ref035","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1186\/s12888-022-03730-8","article-title":"A systematic review and meta-analysis of studies on screening for mild cognitive impairment in primary healthcare.","volume":"22","author":"L Karimi","year":"2022","journal-title":"BMC Psychiatry"},{"key":"pone.0315745.ref036","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.12740\/PP\/45368","article-title":"Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis.","volume":"50","author":"N Ciesielska","year":"2016","journal-title":"Psychiatr Pol."},{"key":"pone.0315745.ref037","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1002\/gps.4852","article-title":"A systematic review of the diagnostic accuracy of automated tests for cognitive impairment.","volume":"33","author":"RW Aslam","year":"2018","journal-title":"Int J Geriatr Psychiatry"},{"key":"pone.0315745.ref038","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1111\/j.1532-5415.1992.tb01992.x","article-title":"The Mini-Mental State Examination: A Comprehensive Review.","volume":"40","author":"TN Tombaugh","year":"1992","journal-title":"J Am Geriatr Soc"},{"key":"pone.0315745.ref039","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.ajp.2019.09.022","article-title":"Validity and reliability of hindi translated version of Montreal cognitive assessment in older adults.","volume":"45","author":"M Gupta","year":"2019","journal-title":"Asian J Psychiatry"},{"key":"pone.0315745.ref040","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1159\/000232589","article-title":"The Validity, Reliability and Clinical Utility of the Hong Kong Montreal Cognitive Assessment (HK-MoCA) in Patients with Cerebral Small Vessel Disease.","volume":"28","author":"A Wong","year":"2009","journal-title":"Dement Geriatr Cogn Disord"},{"key":"pone.0315745.ref041","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.3233\/JAD-170196","article-title":"Computerized Cognitive Screen (CoCoSc): A Self-Administered Computerized Test for Screening for Cognitive Impairment in Community Social Centers.","volume":"59","author":"A Wong","year":"2017","journal-title":"J Alzheimers Dis"},{"key":"pone.0315745.ref042","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1111\/ggi.13836","article-title":"Development and validity of the Computer-Based Cognitive Assessment Tool for intervention in community-dwelling older individuals","volume":"20","author":"J Takahashi","year":"2020","journal-title":"Geriatr Gerontol Int"},{"key":"pone.0315745.ref043","doi-asserted-by":"crossref","first-page":"899729","DOI":"10.3389\/fpsyt.2022.899729","article-title":"A voice recognition-based digital cognitive screener for dementia detection in the community: Development and validation study","volume":"13","author":"X Zhao","year":"2022","journal-title":"Front Psychiatry"},{"key":"pone.0315745.ref044","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1080\/13825585.2021.1927961","article-title":"Reliability and Validity of a Home-Based Self-Administered Computerized Test of Learning and Memory Using Speech Recognition.","volume":"29","author":"RS Mackin","year":"2022","journal-title":"Aging Neuropsychol Cogn."},{"key":"pone.0315745.ref045","first-page":"1","article-title":"Validity, feasibility, and effectiveness of a voice\u2013recognition based digital cognitive screener for dementia and mild cognitive impairment in community\u2013dwelling older Chinese adults: A large\u2013scale implementation study.","author":"X Zhao","year":"2024","journal-title":"Alzheimers Dement."},{"key":"pone.0315745.ref046","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1044\/2018_JSLHR-L-18-0232","article-title":"Language Performance of Individuals at Risk for Mild Cognitive Impairment.","volume":"62","author":"KC McCullough","year":"2019","journal-title":"J Speech Lang Hear Res"},{"key":"pone.0315745.ref047","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1111\/j.1474-7766.2005.00333.x","article-title":"The Mini Mental State Examination.","volume":"5","author":"B Ridha","year":"2005","journal-title":"Pract Neurol."},{"key":"pone.0315745.ref048","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1037\/h0023552","article-title":"Compliance without pressure: The foot-in-the-door technique.","volume":"4","author":"JL Freedman","year":"1966","journal-title":"J Pers Soc Psychol"},{"key":"pone.0315745.ref049","first-page":"260","article-title":"Computer-based evaluation of Alzheimer\u2019s disease and mild cognitive impairment patients during a picture description task.","volume":"10","author":"L Hern\u00e1ndez-Dom\u00ednguez","year":"2018","journal-title":"Alzheimers Dement"},{"issue":"1","key":"pone.0315745.ref050","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1080\/02687038.2017.1303441","article-title":"Severity of Alzheimer\u2019s disease and language features in picture descriptions.","volume":"32","author":"G Kav\u00e9","year":"2018","journal-title":"Aphasiology."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0315745","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T18:28:08Z","timestamp":1734373688000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0315745"}},"subtitle":[],"editor":[{"given":"Tamlyn Julie","family":"Watermeyer","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,12,16]]},"references-count":50,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12,16]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0315745","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,16]]}}}