{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T02:29:55Z","timestamp":1776824995853,"version":"3.51.2"},"reference-count":42,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002873","name":"Chulalongkorn University Technology Center and Thailand Science Research and Innovation Fund","doi-asserted-by":"publisher","award":["CU_FRB640001_01_2"],"award-info":[{"award-number":["CU_FRB640001_01_2"]}],"id":[{"id":"10.13039\/501100002873","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Thailand Center of Excellence for Life Sciences, Ministry of Higher Education, Science, Research and Innovation","award":["CU_FRB640001_01_2"],"award-info":[{"award-number":["CU_FRB640001_01_2"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Mild cognitive impairment (MCI) is an early stage of cognitive decline or memory loss, commonly found among the elderly. A phonemic verbal fluency (PVF) task is a standard cognitive test that participants are asked to produce words starting with given letters, such as \u201cF\u201d in English and \u201c\u0e01\u201d \/k\/ in Thai. With state-of-the-art machine learning techniques, features extracted from the PVF data have been widely used to detect MCI. The PVF features, including acoustic features, semantic features, and word grouping, have been studied in many languages but not Thai. However, applying the same PVF feature extraction methods used in English to Thai yields unpleasant results due to different language characteristics. This study performs analytical feature extraction on Thai PVF data to classify MCI patients. In particular, we propose novel approaches to extract features based on phonemic clustering (ability to cluster words by phonemes) and switching (ability to shift between clusters) for the Thai PVF data. The comparison results of the three classifiers revealed that the support vector machine performed the best with an area under the receiver operating characteristic curve (AUC) of 0.733 (N = 100). Furthermore, our implemented guidelines extracted efficient features, which support the machine learning models regarding MCI detection on Thai PVF data.<\/jats:p>","DOI":"10.3390\/s22155813","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T23:33:01Z","timestamp":1659569581000},"page":"5813","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Selecting the Most Important Features for Predicting Mild Cognitive Impairment from Thai Verbal Fluency Assessments"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5545-4339","authenticated-orcid":false,"given":"Suppat","family":"Metarugcheep","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8590-3107","authenticated-orcid":false,"given":"Proadpran","family":"Punyabukkana","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4007-1124","authenticated-orcid":false,"given":"Dittaya","family":"Wanvarie","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Faculty of Science, Chulalongkorn University, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Solaphat","family":"Hemrungrojn","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Faculty of Medicine, Chulalongkorn University, Bangkok 10330, Thailand"},{"name":"Cognitive Fitness and Biopsychological Technology Research Unit, Chulalongkorn University, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaipat","family":"Chunharas","sequence":"additional","affiliation":[{"name":"Cognitive Clinical & Computational Neuroscience Research Unit, Department of Internal Medicine, Faculty of Medicine, Chulalongkorn University, Bangkok 10330, Thailand"},{"name":"Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ploy N.","family":"Pratanwanich","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Faculty of Science, Chulalongkorn University, Bangkok 10330, Thailand"},{"name":"Chula Intelligent and Complex Systems Research Unit, Chulalongkorn University, Bangkok 10330, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,3]]},"reference":[{"key":"ref_1","unstructured":"(2021, August 17). Number of Population from Registration by Age Group Province and Region: 2011\u20132020. Available online: http:\/\/statbbi.nso.go.th\/staticreport\/page\/sector\/th\/01.aspx."},{"key":"ref_2","first-page":"110","article-title":"Prevalence and risk factors of mild cognitive impairment in menopausal women at HRH Princess Maha Chakri Sirindhorn Medical Center","volume":"21","author":"Puapornpong","year":"2013","journal-title":"Thai J. Obstet. Gynaecol."},{"key":"ref_3","first-page":"55","article-title":"Prevalence of mild cognitive impairment (MCI) in pre-retirement period of hospital staff","volume":"63","author":"Rattanawat","year":"2018","journal-title":"J. Psychiatr. Assoc. Thail."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2551","DOI":"10.1001\/jama.2014.13806","article-title":"The diagnosis and management of mild cognitive impairment: A clinical review","volume":"312","author":"Langa","year":"2014","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1016\/S0140-6736(06)68542-5","article-title":"Mild cognitive impairment","volume":"367","author":"Gauthier","year":"2006","journal-title":"Lancet"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhai, Y., Chao, Q., Li, H., Wang, B., Xu, R., Wang, N., Han, Y., He, X., Jia, X., and Wang, X. (2016). Application and Revision of montreal cognitive assessment in China\u2019s military retirees with mild cognitive impairment. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0145547"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Fengler, S., Kessler, J., Timmermann, L., Zapf, A., Elben, S., Wojtecki, L., Tucha, O., and Kalbe, E. (2016). Screening for cognitive impairment in Parkinson\u2019s disease: Improving the diagnostic utility of the MoCA through subtest weighting. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0159318"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lee, M.T., Chang, W.Y., and Jang, Y. (2018). Psychometric and diagnostic properties of the Taiwan version of the Quick Mild Cognitive Impairment screen. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0207851"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.3390\/s22041583","article-title":"Using Automatic Speech Recognition to Assess Thai Speech Language Fluency in the Montreal Cognitive Assessment (MoCA)","volume":"22","author":"Kantithammakorn","year":"2022","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chi, Y.K., Han, J.W., Jeong, H., Park, J.Y., Kim, T.H., Lee, J.J., Lee, S.B., Park, J.H., Yoon, J.C., and Kim, J.L. (2014). Development of a screening algorithm for Alzheimer\u2019s disease using categorical verbal fluency. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0084111"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101195","DOI":"10.1016\/j.csl.2021.101195","article-title":"Verbal fluency in normal aging and cognitive decline: Results of a longitudinal study","volume":"68","author":"Frankenberg","year":"2021","journal-title":"Comput. Speech Lang."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6926","DOI":"10.1038\/s41598-021-85981-1","article-title":"Comprehensive verbal fluency features predict executive function performance","volume":"11","author":"Amunts","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Woods, D.L., Wyma, J.M., Herron, T.J., and Yund, E.W. (2016). Computerized analysis of verbal fluency: Normative data and the effects of repeated testing, simulated malingering, and traumatic brain injury. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0166439"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"130","DOI":"10.2174\/1567205014666171121114930","article-title":"A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech","volume":"15","author":"Hoffmann","year":"2018","journal-title":"Curr. Alzheimer Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1017\/S1355617706060590","article-title":"Verbal fluency patterns in amnestic mild cognitive impairment are characteristic of Alzheimer\u2019s type dementia","volume":"12","author":"Murphy","year":"2006","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1621","DOI":"10.1212\/WNL.55.11.1621","article-title":"The FAB: A frontal assessment battery at bedside","volume":"55","author":"Dubois","year":"2000","journal-title":"Neurology"},{"key":"ref_18","first-page":"91","article-title":"Verbal fluency in the Thai elderly, elderly with mild cognitive impairment and elderly with dementia","volume":"26","author":"Charernboon","year":"2018","journal-title":"J. Ment. Health Thail."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1017\/S0025100300004746","article-title":"Thai","volume":"23","author":"Tingsabadh","year":"1993","journal-title":"J. Int. Phon. Assoc."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hemrungrojn, S., Tangwongchai, S., and Charoenboon, T. (Dement. Geriatr. Cogn. Disord., 2021). Use of the Montreal Cognitive Assessment Thai version (MoCA) to discriminate amnestic mild cognitive impairment from Alzheimer\u2019s disease and healthy controls: Machine learning results. Running head: MoCA and amnestic mild cognitive impairment, Dement. Geriatr. Cogn. Disord., preprints.","DOI":"10.1159\/000517822"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1037\/0894-4105.11.1.138","article-title":"Clustering and switching as two components of verbal fluency: Evidence from younger and older healthy adults","volume":"11","author":"Troyer","year":"1997","journal-title":"Neuropsychology"},{"key":"ref_22","unstructured":"Ryan, J.O., Pakhomov, S., Marino, S., Bernick, C., and Banks, S. (2013, January 4\u20139). Computerized analysis of a verbal fluency test. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Sofia, Bulgaria."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1093\/arclin\/acv030","article-title":"Verbal fluency and early memory decline: Results from the Wisconsin registry for Alzheimer\u2019s prevention","volume":"30","author":"Mueller","year":"2015","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.neuropsychologia.2013.12.010","article-title":"Lexical factors and cerebral regions influencing verbal fluency performance in MCI","volume":"54","author":"Clark","year":"2014","journal-title":"Neuropsychologia"},{"key":"ref_25","first-page":"707","article-title":"Binary codes capable of correcting deletions, insertions, and reversals","volume":"10","author":"Levenshtein","year":"1966","journal-title":"Sov. Phys. Dokl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s41109-018-0068-1","article-title":"The orthographic similarity structure of English words: Insights from network science","volume":"3","author":"Siew","year":"2018","journal-title":"Appl. Netw. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-02156-5","article-title":"Semantic similarity from natural language and ontology analysis","volume":"Volume 8","author":"Harispe","year":"2015","journal-title":"Synthesis Lectures on Human Language Technologies"},{"key":"ref_28","unstructured":"Lindsay, H., Linz, N., Tr\u00f6ger, J., and Alexandersson, J. (2019, January 12\u201313). Automatic data-driven approaches for evaluating the phonemic verbal fluency task with healthy adults. Proceedings of the 3rd International Conference on Natural Language and Speech Processing, Trento, Italy."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lindsay, H., Mueller, P., Linz, N., Zeghari, R., Mina, M.M., K\u00f6nig, A., and Tr\u00f6ger, J. (2021, January 11). Dissociating semantic and phonemic search strategies in the phonemic verbal fluency task in early Dementia. Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access, Online.","DOI":"10.18653\/v1\/2021.clpsych-1.4"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"29","DOI":"10.3109\/17549500903137256","article-title":"Temporal parameters of spontaneous speech in Alzheimer\u2019s disease","volume":"12","author":"Hoffmann","year":"2010","journal-title":"Int. J. Speech-Lang. Pathol"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"T\u00f3th, L., Gosztolya, G., Vincze, V., Hoffmann, I., Szatl\u00f3czki, G., Bir\u00f3, E., Zsura, F., P\u00e1k\u00e1ski, M., and K\u00e1lm\u00e1n, J. (2015, January 6). Automatic detection of mild cognitive impairment from spontaneous speech using ASR. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-568"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"101198","DOI":"10.1016\/j.csl.2021.101198","article-title":"Paralinguistic and linguistic fluency features for Alzheimer\u2019s disease detection","volume":"68","author":"Campbell","year":"2021","journal-title":"Comput. Speech Lang."},{"key":"ref_33","unstructured":"Robert, J., Webbie, M., Larrosa, A., Acacio, D., and McMellen, J. (2021, August 17). Pydub. Available online: http:\/\/pydub.com\/."},{"key":"ref_34","unstructured":"Phatthiyaphaibun, W., Chaovavanich, K., Polpanumas, C., Suriyawongkul, A., Lowphansirikul, L., and Chormai, P. (2021, August 17). PyThaiNLP: Thai Natural Language Processing in Python. Available online: https:\/\/github.com\/PyThaiNLP\/pythainlp."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1016\/S0028-3932(97)00152-8","article-title":"Clustering and switching on verbal fluency: The effects of focal frontal-and temporal-lobe lesions","volume":"36","author":"Troyer","year":"1998","journal-title":"Neuropsychologia"},{"key":"ref_36","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"131","DOI":"10.3233\/IDA-1997-1302","article-title":"Feature selection for classification","volume":"1","author":"Dash","year":"1997","journal-title":"Intell. Data Anal."},{"key":"ref_38","unstructured":"Liu, H., and Setiono, R. (1995, January 5\u20138). Chi2: Feature selection and discretization of numeric attributes. Proceedings of the 7th IEEE International Conference on Tools with Artificial Intelligence, Herndon, VA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","article-title":"Receiver operating characteristic curve in diagnostic test assessment","volume":"5","author":"Mandrekar","year":"2010","journal-title":"J. Thorac. Oncol."},{"key":"ref_40","first-page":"627","article-title":"Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation","volume":"4","year":"2013","journal-title":"Casp. J. Intern. Med."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","article-title":"From local explanations to global understanding with explainable AI for trees","volume":"2","author":"Lundberg","year":"2020","journal-title":"Nat. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5813\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:03:50Z","timestamp":1760141030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,3]]},"references-count":42,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155813"],"URL":"https:\/\/doi.org\/10.3390\/s22155813","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,3]]}}}