{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T07:58:20Z","timestamp":1764403100955,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T00:00:00Z","timestamp":1630368000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2019S1A5A2A03052093"],"award-info":[{"award-number":["2019S1A5A2A03052093"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>There are many ways to communicate with people, the most representative of which is a conversation. A smooth conversation should not only be written in a grammatically appropriate manner, but also deal with the subject of conversation; this is known as language ability. In the past, this ability has been evaluated by language analysis\/therapy experts. However, this process is time-consuming and costly. In this study, the researchers developed a Hallym Systematic Analyzer of Korean language to automate the conversation analysis process traditionally conducted by language analysis\/treatment experts. However, current morpheme analyzers or parsing analyzers can only evaluate certain elements of a conversation. Therefore, in this paper, we added the ability to analyze the topic manipulation skills (the number of topics and the rate of topic maintenance) using the existing Hallym Systematic Analyzer of Korean language. The purpose of this study was to utilize the topic modeling technique to automatically evaluate topic manipulation skills. By quantitatively evaluating the topic management capabilities that were previously evaluated in a conventional manner, it was possible to automatically analyze language ability in a wider range of aspects. The experimental results show that the automatic analysis methodology presented in this study achieved a very high level of correlation with language analysis\/therapy professionals.<\/jats:p>","DOI":"10.3390\/info12090359","type":"journal-article","created":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T08:42:32Z","timestamp":1630399352000},"page":"359","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Topic Modeling for Analyzing Topic Manipulation Skills"],"prefix":"10.3390","volume":"12","author":[{"given":"Seok-Ju","family":"Hwang","sequence":"first","affiliation":[{"name":"Department of Convergence Software, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yoon-Kyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Speech Pathology and Audiology, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jong-Dae","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Convergence Software, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"},{"name":"Bio-IT Center, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chan-Young","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Convergence Software, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"},{"name":"Bio-IT Center, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1645-4173","authenticated-orcid":false,"given":"Yu-Seop","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Convergence Software, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"},{"name":"Bio-IT Center, Hallym University, Chuncheon-si 24252, Gangwon-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,31]]},"reference":[{"key":"ref_1","first-page":"66","article-title":"Conversational turn-taking and topic manipulation skills in conversations of school-age low-achievers in language learning","volume":"17","author":"Heo","year":"2012","journal-title":"Commun. Sci. Disord."},{"key":"ref_2","first-page":"293","article-title":"Turn-Taking Characteristics of children with Specific Impairment and Normal Children","volume":"6","author":"Lee","year":"2001","journal-title":"Commun. Sci. Disord."},{"key":"ref_3","first-page":"7","article-title":"A Study on the accuracy of consonants in pre-school children using the picture consonant test","volume":"1","author":"Kim","year":"1996","journal-title":"Commun. Sci. Disord."},{"key":"ref_4","first-page":"294","article-title":"The coda error patterns of children aged from 2 to 5","volume":"7","author":"Hong","year":"2002","journal-title":"Korean J. Commun. Disord."},{"key":"ref_5","first-page":"8","article-title":"What reading does for the mind","volume":"22","author":"Cunningham","year":"1998","journal-title":"Am. Educ."},{"key":"ref_6","first-page":"65","article-title":"A Study of Korean Elementary School Students\u2019 Usage of English Vocabulary Learning Strategies","volume":"39","author":"Shin","year":"2017","journal-title":"J. Foreign Stud."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"25","DOI":"10.12963\/csd.17364","article-title":"Development of topic management skills in conversation of school-aged children","volume":"22","author":"Park","year":"2017","journal-title":"Commun. Sci. Disord."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"270","DOI":"10.12963\/csd.18478","article-title":"Development of conversational skills from late children to adolescent","volume":"23","author":"Yang","year":"2018","journal-title":"Commun. Sci. Disord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1044\/jshr.2703.350","article-title":"Development of topic manipulation skills in discourse","volume":"27","author":"Brinton","year":"1984","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1177\/014272379301303806","article-title":"The performance of eight-to ten-year-olds on measures of conversational skilfulness","volume":"13","author":"Johnson","year":"1993","journal-title":"First Lang."},{"key":"ref_11","unstructured":"Nippold, M.A. (2016). Later Language Development: School-Age Children, Adolescents, and Young Adults, PRO-ED, Inc."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Beilinson, J.S., and Olswang, L.B. (2003). Facilitating peer-group entry in kindergartners with impairments in social communication. Lang. Speech Hear. Serv. Sch., 154\u2013166.","DOI":"10.1044\/0161-1461(2003\/013)"},{"key":"ref_13","unstructured":"Lee, H.Y. (2015). Effects of Social Story Based Group Language Treatment on Basic Emotional Vocabulary Comprehension of School-Aged Children with Autism Spectrum Disorders. [Master\u2019s Thesis, Ewha Womans University]."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"206","DOI":"10.12963\/csd.16303","article-title":"The relationship between evidentiality development and theory of mind in school-aged children","volume":"21","author":"Lee","year":"2016","journal-title":"Commun. Sci. Disord."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1177\/026565900001600103","article-title":"Teaching pragmatics to language-learning disabled children: A treatment outcome study","volume":"16","author":"Richardson","year":"2000","journal-title":"Child Lang. Teach. Ther."},{"key":"ref_16","first-page":"115","article-title":"The Effects of Conversational Skills Intervention Through Group Program on Conversational Turn-Taking and Topic Manipulation Skills of School-Age Children with Language Delay","volume":"28","author":"Park","year":"2019","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_17","unstructured":"Choi, J.E., Oh, B.D., Heo, T.-S., and Kim, Y.-S. (2018, January 12\u201313). Automatic Analysis Service for Korean Speaking by Age. Proceedings of the 30th Annual Conference on Human and Cognitive Language Technology, Seoul, Korea."},{"key":"ref_18","unstructured":"Hwang, S.J., Oh, B.D., Lee, Y.K., and Kim, Y.S. (2019, January 18\u201320). Hallym Systematic Analyzer of Korean (H-SAK) ver.1.0. Proceedings of the Korean Institute of Information Scientists and Engineers, Pyeongchang, Korean."},{"key":"ref_19","unstructured":"Heo, T.S., Lee, Y.K., and Kim, Y.S. (2019, January 11\u201312). Detection of Topic Changes in Child Speech Using Sent2Vec. Proceedings of the 31st Annual Conference on Human & Cognitive Language Technology, Daejeon, Korean."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1044\/2019_LSHSS-19-00032","article-title":"Using Computerized Language Analysis to Evaluate Grammatical Skills","volume":"51","author":"Finestack","year":"2020","journal-title":"Lang. Speech Hear. Serv. Sch."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1007\/BF02402175","article-title":"A computerized language analysis system","volume":"5","author":"Borden","year":"1971","journal-title":"Comput. Humanit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"12","DOI":"10.12963\/csd.13002","article-title":"Conversational turn-taking and topic manipulation skills of children with high-functioning autism spectrum disorders","volume":"18","author":"Choi","year":"2013","journal-title":"Commun. Sci. Disord."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1097\/00011363-198503000-00005","article-title":"The development of discourse topic skills by infants and young children","volume":"5","author":"Foster","year":"1985","journal-title":"Top. Lang. Disord."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1177\/0142723710370538","article-title":"Discourse topic management and discussion skills in middle childhood: The effects of age and task","volume":"30","author":"Baines","year":"2010","journal-title":"First Lang."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1044\/0161-1461.2801.03","article-title":"The ability of children with language impairment to manipulate topic in a structured task","volume":"28","author":"Brinton","year":"1997","journal-title":"Lang. Speech Hear. Serv. Sch."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1044\/jshr.3204.857","article-title":"Conversational topics of 4-year-olds","volume":"32","author":"Johnson","year":"1989","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_27","first-page":"1403","article-title":"Measurement of the number of topics in children\u2019s speech using LDA and Affinity propagation algorithm","volume":"46","author":"Oh","year":"2019","journal-title":"Korean Inst. Inf. Sci. Eng."},{"key":"ref_28","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn."},{"key":"ref_29","first-page":"161","article-title":"The Use of Grammatical Morphemes of School-aged Children with Specific Language Impairment According to Discourse Type","volume":"19","author":"Jung","year":"2010","journal-title":"J. Speech Lang. Hear. Res."},{"key":"ref_30","first-page":"23","article-title":"The Relationship among the Reading and Writing Abilities and Oral Language Skills of School-Aged Low-Achievers in Language Learning","volume":"16","author":"Heo","year":"2011","journal-title":"Commun. Sci. Disord"},{"key":"ref_31","first-page":"219","article-title":"A Study on the Expressive Lexical Abilities of Elementary School Students","volume":"38","author":"Lee","year":"2008","journal-title":"J. CheongRam Korean Lang. Educ."},{"key":"ref_32","first-page":"93","article-title":"School-Aged Children and Adults\u2019s Core Vocabularyfor the Development of an Augmentative andAlternative Communication Tool","volume":"8","author":"Kim","year":"2003","journal-title":"Korean J. Commun. Disord."},{"key":"ref_33","first-page":"1046","article-title":"KKMA: A tool for utilizing Sejong corpus based on relational database","volume":"16","author":"Lee","year":"2010","journal-title":"J. KIISE Comput. Pract. Lett."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/9\/359\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:53:27Z","timestamp":1760165607000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/9\/359"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,31]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["info12090359"],"URL":"https:\/\/doi.org\/10.3390\/info12090359","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2021,8,31]]}}}