{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T10:36:35Z","timestamp":1781606195611,"version":"3.54.5"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Japanese Grants-in-Aid for Scientific Research (KAKENHI)","award":["YYH3Y07"],"award-info":[{"award-number":["YYH3Y07"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>A growing focus among scientists has been on researching the techniques of automatic detection of dementia that can be applied to the speech samples of individuals with dementia. Leveraging the rapid advancements in Deep Learning (DL) and Natural Language Processing (NLP), these techniques have shown great potential in dementia detection. In this context, this paper proposes a method for dementia detection from the transcribed speech of subjects. Unlike conventional methods that rely on advanced language models to address the ability of the subject to make coherent and meaningful sentences, our approach relies on the center of focus of the subjects and how it changes over time as the subject describes the content of the cookie theft image, a commonly used image for evaluating one\u2019s cognitive abilities. To do so, we divide the cookie theft image into regions of interest, and identify, in each sentence spoken by the subject, which regions are being talked about. We employed a Long Short-Term Memory (LSTM) neural network to learn different patterns of dementia subjects and control ones and used it to perform a 10-fold cross validation-based classification. Our experimental results on the Pitt corpus from the DementiaBank resulted in a 82.9% accuracy at the subject level and 81.0% at the sample level. By employing data-augmentation techniques, the accuracy at both levels was increased to 83.6% and 82.1%, respectively. The performance of our proposed method outperforms most of the conventional methods, which reach, at best, an accuracy equal to 81.5% at the subject level.<\/jats:p>","DOI":"10.3390\/info15010002","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T11:17:24Z","timestamp":1702984644000},"page":"2","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Dementia Detection from Speech: What If Language Models Are Not the Answer?"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7055-9318","authenticated-orcid":false,"given":"Mondher","family":"Bouazizi","sequence":"first","affiliation":[{"name":"Faculty of Science and Technology, Keio University, Yokohama 223-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7249-1149","authenticated-orcid":false,"given":"Chuheng","family":"Zheng","sequence":"additional","affiliation":[{"name":"Gradudate School of Science and Technology, Keio University, Yokohama 223-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9483-1419","authenticated-orcid":false,"given":"Siyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"Faculty of Science and Technology, Keio University, Yokohama 223-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3961-1426","authenticated-orcid":false,"given":"Tomoaki","family":"Ohtsuki","sequence":"additional","affiliation":[{"name":"Faculty of Science and Technology, Keio University, Yokohama 223-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"key":"ref_1","unstructured":"Bourgeois, J.A., Seaman, J., and Servis, M.E. (2008). The American Psychiatric Publishing Textbook of Psychiatry, American Psychiatric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1970","DOI":"10.1016\/S0140-6736(13)61139-3","article-title":"World health assembly adopts comprehensive mental health action plan 2013\u20132020","volume":"381","author":"Saxena","year":"2013","journal-title":"Lancet"},{"key":"ref_3","unstructured":"World Health Organization (2023, November 01). Dementia\u2014Key Facts. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/dementia."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2964","DOI":"10.1001\/archinte.160.19.2964","article-title":"The detection of dementia in the primary care setting","volume":"160","author":"Valcour","year":"2000","journal-title":"Arch. Intern. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1159\/000017241","article-title":"Detection of dementia in primary care: The Link\u00f6ping study","volume":"11","author":"Skoog","year":"2000","journal-title":"Dement. Geriatr. Cogn. Disord."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1159\/000509379","article-title":"Detection and prediction of incident Alzheimer dementia over a 10-year or longer medical history: A population-based study in primary care","volume":"49","author":"Grande","year":"2021","journal-title":"Dement. Geriatr. Cogn. Disord."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"90319","DOI":"10.1109\/ACCESS.2021.3090474","article-title":"DEMNET: A deep learning model for early diagnosis of Alzheimer diseases and dementia from MR images","volume":"9","author":"Murugan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wankerl, S., N\u00f6th, E., and Evert, S. (2017, January 20\u201324). An N-Gram Based Approach to the Automatic Diagnosis of Alzheimer\u2019s Disease from Spoken Language. Proceedings of the Interspeech, Stockholm, Sweden.","DOI":"10.21437\/Interspeech.2017-1572"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Fritsch, J., Wankerl, S., and N\u00f6th, E. (2019, January 12\u201317). Automatic diagnosis of Alzheimer\u2019s disease using neural network language models. Proceedings of the ICASSP 2019\u20142019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8682690"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cohen, T., and Pakhomov, S. (2020). A tale of two perplexities: Sensitivity of neural language models to lexical retrieval deficits in dementia of the Alzheimer\u2019s type. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.176"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bouazizi, M., Zheng, C., and Ohtsuki, T. (2022, January 21\u201323). Dementia Detection Using Language Models and Transfer Learning. Proceedings of the 2022 5th International Conference on Software Engineering and Information Management (ICSIM), ICSIM 2022, New York, NY, USA.","DOI":"10.1145\/3520084.3520108"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"92294","DOI":"10.1109\/ACCESS.2022.3203068","article-title":"An Evaluation on Information Composition in Dementia Detection Based on Speech","volume":"10","author":"Zheng","year":"2022","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"716670","DOI":"10.3389\/fnhum.2021.716670","article-title":"Classification of Alzheimer\u2019s disease leveraging multi-task machine learning analysis of speech and eye-movement data","volume":"15","author":"Jang","year":"2021","journal-title":"Front. Hum. Neurosci."},{"key":"ref_14","unstructured":"MacWhinney, B. (2023, December 01). TalkBank. Available online: http:\/\/talkbank.org."},{"key":"ref_15","first-page":"1877","article-title":"Language Models are Few-Shot Learners","volume":"Volume 33","author":"Larochelle","year":"2020","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.1109\/TASL.2011.2112351","article-title":"Spoken language derived measures for detecting mild cognitive impairment","volume":"19","author":"Roark","year":"2011","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"624683","DOI":"10.3389\/fcomp.2021.624683","article-title":"Exploring deep transfer learning techniques for Alzheimer\u2019s dementia detection","volume":"3","author":"Zhu","year":"2021","journal-title":"Front. Comput. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jarrold, W., Peintner, B., Wilkins, D., Vergryi, D., Richey, C., Gorno-Tempini, M.L., and Ogar, J. (2014, January 22\u201327). Aided diagnosis of dementia type through computer-based analysis of spontaneous speech. Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, Baltimore, MD, USA.","DOI":"10.3115\/v1\/W14-3204"},{"key":"ref_19","unstructured":"Luz, S., de la Fuente, S., and Albert, P. (2018). A method for analysis of patient speech in dialogue for dementia detection. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"130","DOI":"10.2174\/1567205014666171121114930","article-title":"A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech","volume":"15","author":"Hoffmann","year":"2018","journal-title":"Curr. Alzheimer Res."},{"key":"ref_21","first-page":"112","article-title":"Automatic speech analysis for the assessment of patients with predementia and Alzheimer\u2019s disease","volume":"1","author":"Satt","year":"2015","journal-title":"Alzheimer\u2019s Dement. Diagn. Assess. Dis. Monit."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sundermeyer, M., Schl\u00fcter, R., and Ney, H. (2014, January 14\u201318). rwthlm\u2014The RWTH Aachen University neural network language modeling toolkit. Proceedings of the Fifteenth Annual Conference of the International Speech Communication Association, Singapore.","DOI":"10.21437\/Interspeech.2014-475"},{"key":"ref_23","unstructured":"Merity, S., Keskar, N.S., and Socher, R. (2017). Regularizing and optimizing LSTM language models. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rodrigues Makiuchi, M., Warnita, T., Uto, K., and Shinoda, K. (2019, January 21). Multimodal fusion of bert-cnn and gated cnn representations for depression detection. Proceedings of the 9th International on Audio\/Visual Emotion Challenge and Workshop, Nice, France.","DOI":"10.1145\/3347320.3357694"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rutowski, T., Shriberg, E., Harati, A., Lu, Y., Chlebek, P., and Oliveira, R. (2020, January 5\u20137). Depression and anxiety prediction using deep language models and transfer learning. Proceedings of the 2020 7th International Conference on Behavioural and Social Computing (BESC), Bournemouth, UK.","DOI":"10.1109\/BESC51023.2020.9348290"},{"key":"ref_26","unstructured":"Orabi, A.H., Buddhitha, P., Orabi, M.H., and Inkpen, D. (2018, January 5). Deep learning for depression detection of twitter users. Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, New Orleans, LA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hayati, M.F.M., Ali, M.A.M., and Rosli, A.N.M. (2022, January 7\u20139). Depression Detection on Malay Dialects Using GPT-3. Proceedings of the 2022 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia.","DOI":"10.1109\/IECBES54088.2022.10079554"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Attas, D., Power, N., Smithies, J., Bee, C., Aadahl, V., Kellett, S., Blackmore, C., and Christensen, H. (2022). Automated Detection of the Competency of Delivering Guided Self-Help for Anxiety via Speech and Language Processing. Appl. Sci., 12.","DOI":"10.3390\/app12178608"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e29749","DOI":"10.2196\/29749","article-title":"The role of machine learning in diagnosing bipolar disorder: Scoping review","volume":"23","author":"Jan","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1038\/s41746-022-00589-7","article-title":"Natural language processing applied to mental illness detection: A narrative review","volume":"5","author":"Zhang","year":"2022","journal-title":"NPJ Digit. Med."},{"key":"ref_31","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Howard, J., and Ruder, S. (2018). Universal language model fine-tuning for text classification. arXiv.","DOI":"10.18653\/v1\/P18-1031"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Pradier, C., Sakarovitch, C., Le Duff, F., Layese, R., Metelkina, A., Anthony, S., Tifratene, K., and Robert, P. (2014). The Mini Mental State Examination at the Time of Alzheimer\u2019s Disease and Related Disorders Diagnosis, According to Age, Education, Gender and Place of Residence: A Cross-Sectional Study among the French National Alzheimer Database. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0103630"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/1\/2\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:41:33Z","timestamp":1760132493000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/1\/2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["info15010002"],"URL":"https:\/\/doi.org\/10.3390\/info15010002","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,19]]}}}