{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T06:30:44Z","timestamp":1793687444649,"version":"4.5.1"},"reference-count":56,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T00:00:00Z","timestamp":1644883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Brain Sciences"],"abstract":"<jats:p>Dementia is a neurodegenerative disease that leads to the development of cognitive deficits, such as aphasia, apraxia, and agnosia. It is currently considered one of the most significant major medical problems worldwide, primarily affecting the elderly. This condition gradually impairs the patient\u2019s cognition, eventually leading to the inability to perform everyday tasks without assistance. Since dementia is an incurable disease, early detection plays an important role in delaying its progression. Because of this, tools and methods have been developed to help accurately diagnose patients in their early stages. State-of-the-art methods have shown that the use of syntactic-type linguistic features provides a sensitive and noninvasive tool for detecting dementia in its early stages. However, these methods lack relevant semantic information. In this work, we propose a novel methodology, based on the semantic features approach, by using sentence embeddings computed by Siamese BERT networks (SBERT), along with support vector machine (SVM), K-nearest neighbors (KNN), random forest, and an artificial neural network (ANN) as classifiers. Our methodology extracted 17 features that provide demographic, lexical, syntactic, and semantic information from 550 oral production samples of elderly controls and people with Alzheimer\u2019s disease, provided by the DementiaBank Pitt Corpus database. To quantify the relevance of the extracted features for the dementia classification task, we calculated the mutual information score, which demonstrates a dependence between our features and the MMSE score. The experimental classification performance metrics, such as the accuracy, precision, recall, and F1 score (77, 80, 80, and 80%, respectively), validate that our methodology performs better than syntax-based methods and the BERT approach when only the linguistic features are used.<\/jats:p>","DOI":"10.3390\/brainsci12020270","type":"journal-article","created":{"date-parts":[[2022,2,15]],"date-time":"2022-02-15T22:43:22Z","timestamp":1644965002000},"page":"270","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["Semantic Feature Extraction Using SBERT for Dementia Detection"],"prefix":"10.3390","volume":"12","author":[{"given":"Yamanki","family":"Santander-Cruz","sequence":"first","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Aut\u00f3noma de Quer\u00e9taro, Queretaro C.P. 76010, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6353-0864","authenticated-orcid":false,"given":"Sebasti\u00e1n","family":"Salazar-Colores","sequence":"additional","affiliation":[{"name":"Centro de Investigaciones en \u00d3ptica, Leon C.P. 37150, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9740-0358","authenticated-orcid":false,"given":"Wilfrido Jacobo","family":"Paredes-Garc\u00eda","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Aut\u00f3noma de Quer\u00e9taro, Queretaro C.P. 76010, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Humberto","family":"Guendulain-Arenas","sequence":"additional","affiliation":[{"name":"Departamento de Geriatr\u00eda, Instituto Mexicano del Seguro Social, San Juan del Rio C.P. 76800, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2695-1934","authenticated-orcid":false,"given":"Sa\u00fal","family":"Tovar-Arriaga","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda, Universidad Aut\u00f3noma de Quer\u00e9taro, Queretaro C.P. 76010, Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,15]]},"reference":[{"key":"ref_1","unstructured":"American Psychiatric Association (2014). DSM-5: Manual Diagn\u00f3stico y Estad\u00edstico de los Trastornos Mentales, American Psychiatric Association."},{"key":"ref_2","unstructured":"(2021, December 03). \u201cAlzheimer y Demencia,\u201d Alzheimer\u2019s Disease and Dementia. Available online: https:\/\/www.alz.org\/alzheimer-demencia."},{"key":"ref_3","unstructured":"Dhakal, A., and Bobrin, B.D. (2021, July 01). Cognitive Deficits, Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK559052\/."},{"key":"ref_4","first-page":"575","article-title":"Abordaje diagn\u00f3stico y terap\u00e9utico de la demencia en atenci\u00f3n primaria","volume":"27","author":"Carazo","year":"2001","journal-title":"SEMER.-Med. Fam."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S401","DOI":"10.1016\/j.euroneuro.2018.11.608","article-title":"Social stigma towards people with mental disorders among the psychiatrists, general practitioners and young doctors(interns)","volume":"29","author":"Kandratsenia","year":"2019","journal-title":"Eur. Neuropsychopharmacol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.regg.2018.12.007","article-title":"Prevalencia de demencia en adultos mayores de Am\u00e9rica Latina: Revisi\u00f3n sistem\u00e1tica","volume":"54","author":"Sanabria","year":"2019","journal-title":"Revista Esp. Geriatr. Gerontol."},{"key":"ref_7","unstructured":"Alvarado, A.J.M., and Navarro, S.G.A. (2017). Factores de riesgo y detecci\u00f3n temprana de la enfermedad de Alzheimer y otras demencias. La Enfermedad de Alzheimer y Otras Demencias Como Problema Nacional de Salud, Consejo Nacional de Ciencia y Tecnolog\u00eda (CONACYT)."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1159\/000242438","article-title":"Semantic Markers in the Diagnosis of Neurodegenerative Dementias","volume":"28","author":"Cuetos","year":"2009","journal-title":"Dement. Geriatr. Cogn. Disord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"195","DOI":"10.3389\/fnagi.2015.00195","article-title":"Speaking in Alzheimer\u2019s Disease, is That an Early Sign? Importance of Changes in Language Abilities in Alzheimer\u2019s Disease","volume":"7","author":"Szatloczki","year":"2015","journal-title":"Front. Aging Neurosci."},{"key":"ref_10","unstructured":"del Rosario, C.-U. (2010, January 01). Demencias: Los Problemas de Lenguaje Como Hallazgos Tempranos. Available online: https:\/\/repository.urosario.edu.co\/handle\/10336\/27488."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1080\/02687030600911419","article-title":"Picture description in neurologically normal adults: Concepts and topic coherence","volume":"21","author":"MacKenzie","year":"2007","journal-title":"Aphasiology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1590\/S1980-57642014DN83000010","article-title":"Analysis of word number and content in discourse of patients with mild to moderate Alzheimer\u2019s disease","volume":"8","author":"Minett","year":"2014","journal-title":"Dement. Neuropsychol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ibrahim, M., and Ahmad, R. (2010, January 7\u201310). Class diagram extraction from textual requirements using natural language processing (NLP) techniques. Proceedings of the 2010 Second International Conference on Computer Research and Development, Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICCRD.2010.71"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ismail, R., Abu Bakar, Z., and Rahman, N.A. (2015). Extracting Knowledge from English Translated Quran Using Nlp Pattern. J. Teknol., 77.","DOI":"10.11113\/jt.v77.6515"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"04015014","DOI":"10.1061\/(ASCE)CP.1943-5487.0000346","article-title":"Semantic NLP-Based Information Extraction from Construction Regulatory Documents for Automated Compliance Checking","volume":"30","author":"Zhang","year":"2016","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_16","unstructured":"(2020, April 03). DementiaBank. Available online: https:\/\/dementia.talkbank.org\/."},{"key":"ref_17","unstructured":"Brierley, C. (2021, August 11). AI could Detect Dementia Years before Symptoms Appear. Available online: https:\/\/www.cam.ac.uk\/stories\/AIdementia."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1002\/pnp.721","article-title":"Artificial intelligence as an aid to diagnosing dementia: An overview","volume":"25","author":"Dashwood","year":"2021","journal-title":"Prog. Neurol. Psychiatry"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Masrani, V., Murray, G., Field, T., and Carenini, G. (2017, January 4). Detecting dementia through retrospective analysis of routine blog posts by bloggers with dementia. Proceedings of the BioNLP 2017 Workshop, Vancouver, BC, Canada.","DOI":"10.18653\/v1\/W17-2329"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2081","DOI":"10.1109\/TASL.2011.2112351","article-title":"Spoken Language Derived Measures for Detecting Mild Cognitive Impairment","volume":"19","author":"Roark","year":"2011","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e10493","DOI":"10.2196\/10493","article-title":"Unsupervised Machine Learning to Identify High Likelihood of Dementia in Population-Based Surveys: Development and Validation Study","volume":"20","author":"Bayen","year":"2018","journal-title":"J. Med. Internet Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Na, K.-S. (2019). Prediction of future cognitive impairment among the community elderly: A machine-learning based approach. Sci. Rep., 9.","DOI":"10.1038\/s41598-019-39478-7"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.1093\/geroni\/igx004.5084","article-title":"An Automated approach to identifying patients with dementia using electronic medical records","volume":"1","author":"Jennings","year":"2017","journal-title":"Innov. Aging"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Nori, V.S., Hane, C.A., Martin, D.C., Kravetz, A.D., and Sanghavi, D.M. (2019). Identifying incident dementia by applying machine learning to a very large administrative claims dataset. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0203246"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Karlekar, S., Niu, T., and Bansal, M. (2018, January 1\u20136). Detecting linguistic characteristics of Alzheimer\u2019s dementia by interpreting neural models. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-2110"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rosas, D.S., Arriaga, S.T., and Fernandez, M.A.A. (2019, January 11\u201313). Search for dementiapatterns in transcribed conversations using natural language processing. Proceedings of the 2019 16th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), Mexico City, Mexico.","DOI":"10.1109\/ICEEE.2019.8884572"},{"key":"ref_27","unstructured":"(2021, December 03). Carolina Conversations. Available online: https:\/\/carolinaconversations.musc.edu\/ccc\/about\/who."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"100583","DOI":"10.1016\/j.eclinm.2020.100583","article-title":"Linguistic markers predict onset of Alzheimer\u2019s disease","volume":"28","author":"Eyigoz","year":"2020","journal-title":"eClinicalMedicine"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"279","DOI":"10.2105\/AJPH.41.3.279","article-title":"Epidemiological Approaches to Heart Disease: The Framingham Study","volume":"41","author":"Dawber","year":"1951","journal-title":"Am. J. Public Health"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sarawgi, U., Zulfikar, W., Soliman, N., and Maes, P. (2020). Multimodal Inductive Transfer Learning for Detection of Alzheimer\u2019s Dementia and its Severity. arXiv.","DOI":"10.21437\/Interspeech.2020-3137"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gonzalez-Atienza, M., Peinado, A.M., and Gonzalez-Lopez, J.A. (2021, January 24\u201325). An Automatic System for Dementia Detection using Acoustic and Linguistic Features. Proceedings of the IberSPEECH 2021, Valladolid, Spain.","DOI":"10.21437\/IberSPEECH.2021-56"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mukherji, D., Mukherji, M., and Mukherji, N. (2021). Early Detection of Alzheimer\u2019s Disease with Low-Cost Neuropsychological Tests: A Novel Predict-Diagnose Approach Using Recurrent Neural Networks, Cold Spring Harbor Laboratory.","DOI":"10.1101\/2021.01.17.21249822"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Linz, N., Troger, J., Alexandersson, J., Wolters, M., Konig, A., and Robert, P. (2017, January 18\u201321). Predicting dementia screening and staging scores from semantic verbal fluency performance. Proceedings of the 2017 IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA.","DOI":"10.1109\/ICDMW.2017.100"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Luz, S., Haider, F., de la Fuente, S., Fromm, D., and MacWhinney, B. (2020, January 25\u201329). Alzheimer\u2019s dementia recognition through spontaneous speech: The ADReSS challenge. Proceedings of the Interspeech 2020, Shanghai, China.","DOI":"10.21437\/Interspeech.2020-2571"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Balagopalan, A., Eyre, B., Rudzicz, F., and Novikova, J. (2020). To BERT or not to BERT: Comparing speech and language-based approaches for Alzheimer\u2019s disease detection. Proc. Interspeech, 2167\u20132171.","DOI":"10.21437\/Interspeech.2020-2557"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1001\/archneur.1994.00540180063015","article-title":"The Natural History of Alzheimer\u2019s Disease","volume":"51","author":"Becker","year":"1994","journal-title":"Arch. Neurol."},{"key":"ref_37","first-page":"156","article-title":"The CHILDES Project: Tools for Analyzing Talk","volume":"70","author":"Pye","year":"1994","journal-title":"Linguist. Soc. Am."},{"key":"ref_38","unstructured":"Jurafsky, D., and Martin, J.H. (2009). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, Prentice Hall."},{"key":"ref_39","unstructured":"Lang, P. (2012). Translation quality checking in language tool: Marcin Mi\u0142kowski. Corpus Data across Languages and Disciplines, Peter Lang."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Adilov, S. (2021). Generative Pre-Training from Molecules, Cambridge University Press (CUP).","DOI":"10.26434\/chemrxiv-2021-5fwjd"},{"key":"ref_41","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Reimers, N., and Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. arXiv.","DOI":"10.18653\/v1\/D19-1410"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.ins.2015.02.024","article-title":"Learning similarity with cosine similarity ensemble","volume":"307","author":"Xia","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_44","unstructured":"Gelbukh, A. (2006, January 13\u201317). Fifth Mexican international conference on artificial intelligence. Proceedings of the 2006 Fifth Mexican International Conference on Artificial Intelligence, Apizaco, Mexico."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zar, J.H. (2005). Spearman Rank Correlation Coefficient. SpringerReference, Springer.","DOI":"10.1002\/0470011815.b2a15150"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Boyle, B.E. (1976). Feature selection using mutual information. Computer Oriented Learning Processes, Springer.","DOI":"10.1007\/978-94-010-1545-5_14"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bierbrauer, J. (2018). Shannon entropy and the basics of information theory. Introduction to Coding Theory, CRC Press.","DOI":"10.1201\/9781482296372"},{"key":"ref_48","unstructured":"Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, MIT Press."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Nelli, F. (2018). Machine Learning with scikit-learn. Python Data Analytics, Apress.","DOI":"10.1007\/978-1-4842-3913-1"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press.","DOI":"10.1017\/CBO9781107298019"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Shawe-Taylor, J., and Cristianini, N. (2000). Support Vector Machines. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, Cambridge University Press.","DOI":"10.1017\/CBO9780511801389"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zou, J., Han, Y., and So, S.-S. (2008). Overview of artificial neural networks. Methods in Molecular BiologyTM, Humana Press.","DOI":"10.1007\/978-1-60327-101-1_2"},{"key":"ref_53","unstructured":"API Documentation (2021, August 11). TensorFlow. Available online: https:\/\/www.tensorflow.org\/api_docs."},{"key":"ref_54","unstructured":"Humaira, H., and Rasyidah, R. (2018, January 24\u201325). Determining the appropiate cluster number using Elbow method for K-Means algorithm. Proceedings of the 2nd Workshop on Multidisciplinary and Applications (WMA), Padang, Indonesia."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Jin, H., Song, Q., and Hu, X. (2019, January 4\u20138). Auto-Keras: An efficient neural architecture search system. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330648"},{"key":"ref_56","unstructured":"Aceves-Fernandez, M. (2021, December 01). Inteligencia Artificial para Programadores con Prisa. Available online: https:\/\/www.amazon.com\/Inteligencia-Artificial-Programadores-Prisa-Spanish\/dp\/B0975W63NJ."}],"container-title":["Brain Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3425\/12\/2\/270\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:19:59Z","timestamp":1760134799000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3425\/12\/2\/270"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,15]]},"references-count":56,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["brainsci12020270"],"URL":"https:\/\/doi.org\/10.3390\/brainsci12020270","relation":{},"ISSN":["2076-3425"],"issn-type":[{"value":"2076-3425","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,15]]}}}