{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T13:45:44Z","timestamp":1775915144398,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T00:00:00Z","timestamp":1747958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["21K17794"],"award-info":[{"award-number":["21K17794"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ritsumeikan University","award":["21K17794"],"award-info":[{"award-number":["21K17794"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>This study explores the effects of interacting with AI vs. human interlocutors on English language learners\u2019 speaking performance in a game-based learning context. We developed Taboo Talks, a word-guessing game in which learners alternated between giving and guessing clues with either an AI or a human partner. To evaluate the impact of interaction mode on oral proficiency, participants completed a story retelling task, assessed using complexity, accuracy, and fluency (CAF) metrics. Each participant engaged in both partner conditions, with group order counterbalanced. The results from the retelling task indicated modest improvements in fluency and complexity, particularly following interaction with the AI partner. Accuracy scores remained largely stable across conditions. Post-task reflections revealed that learners perceived AI partners as less intimidating, facilitating more relaxed language production, though concerns were noted regarding limited responsiveness. Qualitative analysis of the gameplay transcripts further revealed contrasting interactional patterns: AI partners elicited more structured interactions whereas human partners prompted more spontaneous and variable interactions. These findings suggest that AI-mediated gameplay can enhance specific dimensions of spoken language development and may serve as a complementary resource alongside human interaction.<\/jats:p>","DOI":"10.3390\/info16060427","type":"journal-article","created":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T09:58:09Z","timestamp":1747994289000},"page":"427","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Enhancing EFL Speaking Skills with AI-Powered Word Guessing: A Comparison of Human and AI Partners"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4114-4049","authenticated-orcid":false,"given":"Mondheera","family":"Pituxcoosuvarn","sequence":"first","affiliation":[{"name":"Faculty of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan"}]},{"given":"Midori","family":"Tanimura","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8310-2007","authenticated-orcid":false,"given":"Yohei","family":"Murakami","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan"}]},{"given":"Jeremy Stewart","family":"White","sequence":"additional","affiliation":[{"name":"Faculty of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2025,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"280","DOI":"10.36348\/sijll.2023.v06i07.005","article-title":"The Challenges of Spoken English Fluency among EFL Learners in Saudi Universities","volume":"6","author":"Elbashir","year":"2023","journal-title":"Sch. Int. J. Linguist. Lit."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1515\/jccall-2022-0032","article-title":"Conversational agents in language learning","volume":"4","author":"Xiao","year":"2024","journal-title":"J. China-Comput.-Assist. Lang. Learn."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nadeem, M., Oroszlanyova, M., and Farag, W. (2023). Effect of Digital Game-Based Learning on Student Engagement and Motivation. Computers, 12.","DOI":"10.3390\/computers12090177"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3674","DOI":"10.1016\/j.procs.2024.09.189","article-title":"Taboo Talks: Enhancing ESL Speaking Skills through Language Model Integration in Interactive Games","volume":"246","author":"Pituxcoosuvarn","year":"2024","journal-title":"Procedia Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Skehan, P. (1998). A Cognitive Approach to Language Learning, Oxford University Press.","DOI":"10.1177\/003368829802900209"},{"key":"ref_6","unstructured":"Ellis, R. (2003). Task-Based Language Learning and Teaching, Oxford University Press."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Tessmer, M. (2013). Planning and Conducting Formative Evaluations, Routledge.","DOI":"10.4324\/9780203061978"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ritchie, W.C., and Bhatia, T.K. (1996). The Role of the Linguistic Environment in Second Language Acquisition. Handbook of Second Language Acquisition, Academic Press.","DOI":"10.1016\/B978-012589042-7\/50003-7"},{"key":"ref_9","unstructured":"Gass, S., and Madden, C. (1985). Communicative competence: Some roles of comprehensible input and comprehensible output in its development. Input in Second Language Acquisition, Newbury House."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1177\/0033688220953225","article-title":"Collaborative Pre-Task Planning Processes and Second-Language Task Performance","volume":"53","author":"Leeming","year":"2022","journal-title":"RELC J."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rassaei, E. (2023). The Interplay between Corrective Feedback Timing and Foreign Language Anxiety in L2 Development. Lang. Teach. Res.","DOI":"10.1177\/13621688231195141"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1177\/0033688220945418","article-title":"Language Learner Engagement During Speaking Tasks: A Longitudinal Study","volume":"53","author":"Aubrey","year":"2022","journal-title":"RELC J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.29000\/rumelide.1379355","article-title":"Mobile Assisted Language Learning: Investigating English Speaking Performance and Satisfaction","volume":"\u00d613","author":"Elverici","year":"2023","journal-title":"Rumelide Dil Edeb. Ara\u015ft\u0131rmalar\u0131 Derg."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1558\/cj.v16i3.253-276","article-title":"Software That Listens","volume":"16","author":"Wachowicz","year":"2013","journal-title":"CALICO J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1080\/10494820.2018.1451896","article-title":"Implementing Interactive Courseware into EFL Business Writing: Computational Assessment and Learning Satisfaction","volume":"27","author":"Tsai","year":"2018","journal-title":"Interact. Learn. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1558\/cj.v25i2.241-259","article-title":"Beyond Motivation","volume":"25","author":"Kim","year":"2013","journal-title":"CALICO J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1080\/10494820.2016.1172243","article-title":"Web 2.0 in Computer-Assisted Language Learning: A Research Synthesis and Implications for Instructional Design and Educational Practice","volume":"25","author":"Parmaxi","year":"2016","journal-title":"Interact. Learn. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1232","DOI":"10.1111\/bjet.12305","article-title":"The Use of Help Options in Multimedia Listening Environments to Aid Language Learning: A Review","volume":"47","author":"Mohsen","year":"2015","journal-title":"Br. J. Educ. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2400429","DOI":"10.1002\/aisy.202400429","article-title":"Large Language Model-Based Chatbots in Higher Education","volume":"7","author":"Yigci","year":"2024","journal-title":"Adv. Intell. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zou, B., Li, Q., and Luo, W. (2023). Supporting Speaking Practice by Social Network-Based Interaction in Artificial Intelligence (AI)-Assisted Language Learning. Sustainability, 15.","DOI":"10.3390\/su15042872"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gao, Y., Nuchged, B., Li, Y., and Peng, L. (2023). An Investigation of Applying Large Language Models to Spoken Language Learning. Appl. Sci., 14.","DOI":"10.3390\/app14010224"},{"key":"ref_22","first-page":"750","article-title":"The Role Of Artificial Intelligence (AI) In Developing English Language Learner\u2019s Communication Skills","volume":"6","author":"Rusmiyanto","year":"2023","journal-title":"J. Educ."},{"key":"ref_23","first-page":"1276","article-title":"A Systematic Review of Large Language Models and Their Implications in Medical Education","volume":"58","author":"Lucas","year":"2024","journal-title":"Med. Educ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Park, Y.J., Pillai, A., Deng, J., Guo, E., Gupta, M., Paget, M., and Naugler, C. (2024). Assessing the Research Landscape and Clinical Utility of Large Language Models: A Scoping Review. BMC Med. Inform. Decis. Mak., 24.","DOI":"10.1186\/s12911-024-02459-6"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e56764","DOI":"10.2196\/56764","article-title":"Large Language Models and User Trust: Consequence of Self-Referential Learning Loop and the Deskilling of Health Care Professionals","volume":"26","author":"Choudhury","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jo\u0161t, G., Taneski, V., and Karakati\u010d, S. (2024). The Impact of Large Language Models on Programming Education and Student Learning Outcomes. Appl. Sci., 14.","DOI":"10.3390\/app14104115"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1038\/s41746-024-01157-x","article-title":"The Ethics of ChatGPT in Medicine and Healthcare: A Systematic Review on Large Language Models (LLMs)","volume":"7","author":"Haltaufderheide","year":"2024","journal-title":"NPJ Digit. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1767","DOI":"10.1111\/2041-210X.14396","article-title":"Should We Still Teach or Learn Coding? A Postgraduate Student Perspective on the Use of Large Language Models for Coding in Ecology and Evolution","volume":"15","author":"Campbell","year":"2024","journal-title":"Methods Ecol. Evol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1080\/00461520.2015.1122533","article-title":"Foundations of game-based learning","volume":"50","author":"Plass","year":"2015","journal-title":"Educ. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100160","DOI":"10.1016\/j.caeo.2024.100160","article-title":"Digital game-based language learning for vocabulary development","volume":"6","author":"Chowdhury","year":"2024","journal-title":"Comput. Educ. Open"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1057\/s41599-024-04073-3","article-title":"Gamifying language education: The impact of digital game-based learning on Chinese EFL learners","volume":"11","author":"Zhou","year":"2024","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.26803\/ijlter.23.3.1","article-title":"Theories, principles, and game elements that support digital game-based language learning (DGBLL): A systematic review","volume":"23","author":"Esteban","year":"2024","journal-title":"Int. J. Learn. Teach. Educ. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"172","DOI":"10.31849\/elsya.v6i2.19819","article-title":"Students\u2019 Perceptions on the Effectiveness of the Taboo Game in Enhancing English Vocabulary Acquisition","volume":"6","author":"Lestari","year":"2024","journal-title":"Elsya J. Engl. Lang. Stud."},{"key":"ref_34","first-page":"88","article-title":"The Effectiveness of Taboo Game to Improve Students\u2019 Vocabulary Mastery","volume":"4","author":"Agung","year":"2023","journal-title":"ELTALL Engl. Lang. Teaching, Appl. Linguist. Lit."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"267","DOI":"10.24093\/awej\/vol15no4.17","article-title":"Effectiveness of Taboo Word Game on Augmenting Business Vocabulary Competency Through Reflective Action Research","volume":"15","author":"Yaacob","year":"2024","journal-title":"Arab. World Engl. J. (AWEJ)"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.15379\/ijmst.v10i1.2829","article-title":"AI-driven technology and chatbots as tools for enhancing English language learning in the context of second language acquisition: A review study","volume":"10","author":"Abusahyon","year":"2023","journal-title":"Int. J. Membr. Sci. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107","DOI":"10.22492\/ije.12.2.05","article-title":"Using AI-powered speech recognition technology to improve English pronunciation and speaking skills","volume":"12","author":"Dennis","year":"2024","journal-title":"IAFOR J. Educ. Technol. Educ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"100230","DOI":"10.1016\/j.caeai.2024.100230","article-title":"Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice","volume":"6","author":"Du","year":"2024","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1080\/10494820.2022.2115077","article-title":"A systematic literature review of game-based learning in Artificial Intelligence education","volume":"32","author":"Zhan","year":"2024","journal-title":"Interact. Learn. Environ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"290","DOI":"10.5430\/wjel.v13n5p290","article-title":"Investigating ESL Learners\u2019 Perception and Problem towards Artificial Intelligence (AI)-Assisted English Language Learning and Teaching","volume":"13","author":"N","year":"2023","journal-title":"World J. Engl. Lang."},{"key":"ref_41","first-page":"32","article-title":"Using Gamification to Enhance Second Language Learning","volume":"27","author":"Flores","year":"2015","journal-title":"Digit. Educ. Rev."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Klimova, B., Pikhart, M., and Al-Obaydi, L.H. (2024). Exploring the potential of ChatGPT for foreign language education at the university level. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1269319"},{"key":"ref_43","unstructured":"Radford, A., Kim, J.W., Xu, T., Brockman, G., McLeavey, C., and Sutskever, I. (2023, January 23\u201329). Robust speech recognition via large-scale weak supervision. Proceedings of the International Conference on Machine Learning, Honolulu, HI, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1017\/S0267190502000120","article-title":"12. Discourse and Assessment","volume":"22","author":"Mcnamara","year":"2002","journal-title":"Annu. Rev. Appl. Linguist."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1044\/2016_JSLHR-L-16-0124","article-title":"Spoken Language Production in Young Adults: Examining Syntactic Complexity","volume":"60","author":"Nippold","year":"2017","journal-title":"J. Speech, Lang. Hear. Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"35","DOI":"10.37546\/JALTJJ34.1-2","article-title":"Comparing the Story Retelling Speaking Test with Other Speaking Tests","volume":"34","author":"Koizumi","year":"2012","journal-title":"JALT J."},{"key":"ref_47","first-page":"1","article-title":"Evaluating the Accuracy of ChatGPT in Assessing Writing and Speaking: A Verification Study Using ICNALE GRA","volume":"6","author":"Uchida","year":"2024","journal-title":"Learn. Corpus Stud. Asia World"},{"key":"ref_48","unstructured":"Huang, Q., Willems, T., and Wang, P.K. (2023). The application of GPT-4 in grading design university students\u2019 assignment and providing feedback: An exploratory study. arXiv."},{"key":"ref_49","unstructured":"Hirunyasiri, D., Thomas, D.R., Lin, J., Koedinger, K.R., and Aleven, V. (2023). Comparative Analysis of GPT-4 and Human Graders in Evaluating Praise Given to Students in Synthetic Dialogues. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Luger, E., and Sellen, A. (2016, January 7\u201312). \u201cLike having a really bad PA\u201d: The gulf between user expectation and experience of conversational agents. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858288"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Clark, L., and Radziwill, N.M. (2019, January 4\u20139). What makes a good conversation? Challenges in designing truly conversational agents. Proceedings of the 2019 IEEE International Conference on Artificial Intelligence Testing (AITest), Newark, CA, USA.","DOI":"10.1145\/3290605.3300705"},{"key":"ref_52","unstructured":"Clark, H.H. (1996). Using Language, Cambridge University Press."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Bowman, R., Nadal, C., Morrissey, K., Thieme, A., and Doherty, G. (2023, January 23\u201328). Using thematic analysis in healthcare HCI at CHI: A scoping review. Proceedings of the Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany.","DOI":"10.1145\/3544548.3581203"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"379","DOI":"10.3758\/BF03195514","article-title":"Beyond the five-user assumption: Benefits of increased sample sizes in usability testing","volume":"35","author":"Faulkner","year":"2003","journal-title":"Behav. Res. Methods Instruments Comput."},{"key":"ref_55","unstructured":"Nielsen, J. (2025, March 30). Why You only Need to Test with 5 Users. Nielsen Norman Group. Available online: https:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users\/."},{"key":"ref_56","first-page":"371","article-title":"Gender differences in communication: Implications for salespeople","volume":"23","author":"Burleson","year":"2003","journal-title":"J. Pers. Sell. Sales Manag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"379","DOI":"10.2307\/3588486","article-title":"What do ESL students say about their accents?","volume":"39","author":"Derwing","year":"2005","journal-title":"TESOL Q."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/6\/427\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:39:20Z","timestamp":1760031560000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/6\/427"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,23]]},"references-count":57,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["info16060427"],"URL":"https:\/\/doi.org\/10.3390\/info16060427","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,23]]}}}