{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T12:13:30Z","timestamp":1789992810731,"version":"4.0.1"},"reference-count":62,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T00:00:00Z","timestamp":1789776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Education Science Planning Project","award":["FRA250474"],"award-info":[{"award-number":["FRA250474"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>As generative artificial intelligence (GenAI) becomes increasingly integrated into second language (L2) learning, there is a growing need for reliable instruments to assess learners\u2019 cognitive evaluation of GenAI-mediated interactive learning experiences. This study developed and validated the GenAI L2 Interactive Learning Experience Scale (AI-L2-ILES) among 1130 Chinese university students. Drawing on an interactive experience perspective and adapting it to L2 learning, the study conceptualized learners\u2019 cognitive evaluation of GenAI interaction as comprising five dimensions: Effectiveness, Sociability, Novelty, Flow, and Seamlessness. Exploratory and confirmatory factor analyses supported this five-factor structure, with satisfactory evidence of reliability, validity, and measurement invariance across gender and academic disciplines. Network analysis further revealed that Flow was the most central dimension, Sociability showed the strongest association with Effectiveness, and Novelty occupied a relatively peripheral position. The network structure was stable across academic disciplines. Overall, the AI-L2-ILES provides a psychometrically sound measure of learners\u2019 cognitive evaluation of GenAI-mediated interactive L2 learning experiences and captures five distinct but interconnected dimensions of this emerging construct. The scale offers a useful tool for examining how L2 learners cognitively evaluate their interactions with GenAI.<\/jats:p>","DOI":"10.3390\/jintelligence14090226","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T11:05:53Z","timestamp":1789988753000},"page":"226","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Second Language Learners\u2019 Cognitive Evaluation of GenAI Interactive Learning Experience: Scale Development and Network Analysis"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3876-110X","authenticated-orcid":false,"given":"Hanwei","family":"Wu","sequence":"first","affiliation":[{"name":"Department of Foreign Languages, Basic Education College, National University of Defense Technology, Changsha 410072, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7493-4813","authenticated-orcid":false,"given":"Gurpinder Singh","family":"Lalli","sequence":"additional","affiliation":[{"name":"School of Education, University of Wolverhampton, Wolverhampton WS1 SBD, UK"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4672-8481","authenticated-orcid":false,"given":"Yongliang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Foreign Studies, North China University of Water Resources and Electric Power, Zhengzhou 450046, China"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"resources","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2689737","DOI":"10.1080\/2331186X.2026.2689737","article-title":"Exploring EFL students\u2019 perspectives on ChatGPT-assisted autonomous practices in enhancing self-directed learning at Palestinian universities","volume":"13","author":"Hamdan","year":"2026","journal-title":"Cogent Education"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"104588","DOI":"10.1016\/j.ijhm.2026.104588","article-title":"Operationalizing smart service experience: Guest engagement, value, memories, and behavioral intentions in hotels","volume":"134","author":"Ali","year":"2026","journal-title":"International Journal of Hospitality Management"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1080\/19368623.2025.2464029","article-title":"Critical determinants of intentions to revisit smart hotels: An examination of smart service interactional experience, emotions, and technophilia","volume":"34","author":"Ashfaq","year":"2025","journal-title":"Journal of Hospitality Marketing & Management"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Qui\u00f1onez, H. R., and Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6.","DOI":"10.3389\/fpubh.2018.00149"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1038\/s43586-021-00055-w","article-title":"Network analysis of multivariate data in psychological science","volume":"1","author":"Borsboom","year":"2021","journal-title":"Nature Reviews Methods Primers"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1207\/S15328007SEM0902_5","article-title":"Evaluating goodness-of-fit indexes for testing measurement invariance","volume":"9","author":"Cheung","year":"2002","journal-title":"Structural Equation Modeling"},{"key":"ref_7","first-page":"527","article-title":"Enhancing linguistic interaction with ChatGPT: An exploratory study of proficiency-matching and ecological validity in less commonly taught languages","volume":"42","author":"Poole","year":"2025","journal-title":"CALICO Journal"},{"key":"ref_8","unstructured":"Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience, Harper and Row."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Quarterly"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1207\/S15327965PLI1104_01","article-title":"The \u201cwhat\u201d and \u201cwhy\u201d of goal pursuits: Human needs and the self-determination of behavior","volume":"11","author":"Deci","year":"2000","journal-title":"Psychological Inquiry"},{"key":"ref_11","unstructured":"DeVellis, R. F. (2016). Scale development: Theory and applications (Applied social research methods), SAGE Publications."},{"key":"ref_12","first-page":"100285","article-title":"Exploring social and computer science students\u2019 perceptions of AI integration in (foreign) language instruction","volume":"7","author":"Dolenc","year":"2024","journal-title":"Computers and Education: Artificial Intelligence"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103189","DOI":"10.1016\/j.system.2023.103189","article-title":"Developing a short language classroom engagement scale (LCES) and linking it with needs satisfaction and achievement","volume":"120","author":"Eerdemutu","year":"2024","journal-title":"System"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"195","DOI":"10.3758\/s13428-017-0862-1","article-title":"Estimating psychological networks and their accuracy: A tutorial paper","volume":"50","author":"Epskamp","year":"2018","journal-title":"Behavior Research Methods"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1037\/met0000167","article-title":"A tutorial on regularized partial correlation networks","volume":"23","author":"Epskamp","year":"2018","journal-title":"Psychological Methods"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1037\/1082-989X.4.3.272","article-title":"Evaluating the use of exploratory factor analysis in psychological research","volume":"4","author":"Fabrigar","year":"1999","journal-title":"Psychological Methods"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1177\/002224378101800104","article-title":"Evaluating structural equation models with unobservable variables and measurement error","volume":"18","author":"Fornell","year":"1981","journal-title":"Journal of Marketing Research"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/19312458.2020.1718629","article-title":"Use omega rather than Cronbach\u2019s alpha for estimating reliability. But\u2026","volume":"14","author":"Hayes","year":"2020","journal-title":"Communication Methods and Measures"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1177\/1094428104263675","article-title":"Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis","volume":"7","author":"Hayton","year":"2004","journal-title":"Organizational Research Methods"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11747-014-0403-8","article-title":"A new criterion for assessing discriminant validity in variance-based structural equation modeling","volume":"43","author":"Henseler","year":"2015","journal-title":"Journal of the Academy of Marketing Science"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10705519909540118","article-title":"Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives","volume":"6","author":"Hu","year":"1999","journal-title":"Structural Equation Modeling"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1007\/s44202-026-00719-2","article-title":"A latent profile exploratory study on L2 dispositional flow among Chinese EFL undergraduates","volume":"6","author":"Jiang","year":"2026","journal-title":"Discover Psychology"},{"key":"ref_23","unstructured":"Kline, R. B. (2016). Principles and practice of structural equation modeling, The Guilford Press. [4th ed.]."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1080\/10494820.2025.2498537","article-title":"Generative AI (GenAI) in the language classroom: A systematic review","volume":"34","author":"Lee","year":"2026","journal-title":"Interactive Learning Environments"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103793","DOI":"10.1016\/j.system.2025.103793","article-title":"Development and validation of the PA-SDA scale: Measuring personal attributes in AI-integrated self-directed language learning","volume":"133","author":"Li","year":"2025","journal-title":"System"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e70423","DOI":"10.1111\/ejed.70423","article-title":"Music education with GenAI: Exploring the mediating roles of enjoyment between smart service interactional experience and behavioural intention","volume":"61","author":"Li","year":"2026","journal-title":"European Journal of Education"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"104143","DOI":"10.1016\/j.actpsy.2024.104143","article-title":"Positive emotions, self-regulatory capacity, and EFL performance in the Chinese senior high school context","volume":"243","author":"Li","year":"2024","journal-title":"Acta Psychologica"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1007\/s11528-025-01140-7","article-title":"Applying generative artificial intelligence to task-based language teaching and learning: A systematic review and meta-analysis","volume":"70","author":"Li","year":"2026","journal-title":"TechTrends"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1017\/S0958344025100359","article-title":"A scoping review of AI-mediated informal language learning: Mapping out the terrain and identifying future directions","volume":"38","author":"Liu","year":"2026","journal-title":"ReCALL"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e12846","DOI":"10.1111\/ejed.12846","article-title":"Untangling the relationship between AI-mediated informal digital learning of English (AI-IDLE), foreign language enjoyment and the ideal L2 self: Evidence from Chinese university EFL students","volume":"60","author":"Liu","year":"2025","journal-title":"European Journal of Education"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102425","DOI":"10.1016\/j.system.2020.102425","article-title":"Exploring \u201cFlow\u201d in young Chinese EFL learners\u2019 online English learning activities","volume":"96","author":"Liu","year":"2021","journal-title":"System"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1017\/S0261444818000125","article-title":"Interaction and instructed second language acquisition","volume":"51","author":"Loewen","year":"2018","journal-title":"Language Teaching"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103770","DOI":"10.1016\/j.system.2025.103770","article-title":"How social support contributes to self-efficacy and learning achievement: A validation study of secondary EFL learners","volume":"133","author":"Luo","year":"2025","journal-title":"System"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"311","DOI":"10.5993\/AJHB.23.4.9","article-title":"Establishing content validity: Using qualitative and quantitative steps","volume":"23","author":"McKenzie","year":"1999","journal-title":"American Journal of Health Behavior"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/JGIM.387836","article-title":"Drivers of intentions towards continued use of digital voice assistants: The moderating role of service experience","volume":"33","author":"Mpinganjira","year":"2025","journal-title":"Journal of Global Information Management"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nass, C., and Moon, Y. (2000). Machines and mindlessness: Social responses to computers, Blackwell Publishing.","DOI":"10.1111\/0022-4537.00153"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1177\/1362168816644940","article-title":"Anniversary article interactional feedback in second language teaching and learning: A synthesis and analysis of current research","volume":"20","author":"Nassaji","year":"2016","journal-title":"Language Teaching Research"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Niu, Z., Huang, L., He, H., Mei, S., Li, L., and Griffiths, M. D. (2024). The revised patient satisfaction questionnaire (PSQ-R): Validity, reliability, equivalence, and network analysis among hospitalized patients in the Chinese population. BMC Health Services Research, 24, (1).","DOI":"10.1186\/s12913-024-11788-1"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Osborne, J. W. (2008). Best practices in exploratory factor analysis. Best practices in quantitative methods, SAGE Publications, Inc.","DOI":"10.4135\/9781412995627"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100991","DOI":"10.1016\/j.iheduc.2024.100991","article-title":"Effects of GenAI-empowered interactive support on university EFL students\u2019 self-regulated strategy use and engagement in reading","volume":"65","author":"Pan","year":"2025","journal-title":"The Internet and Higher Education"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1177\/002224298504900403","article-title":"A conceptual model of service quality and its implication for future research","volume":"49","author":"Parasuraman","year":"1985","journal-title":"The Journal of Marketing"},{"key":"ref_42","unstructured":"Reeves, B., and Nass, C. I. (1996). The media equation: How people treat computers, television, and new media like real people and places. The media equation: How people treat computers, television, and new media like real people and places, Cambridge University Press."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1037\/a0029315","article-title":"When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions","volume":"17","author":"Rhemtulla","year":"2012","journal-title":"Psychological Methods"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1007\/s10791-026-10015-1","article-title":"A meta-analysis of generative AI effects on language proficiency and affective\u2013cognitive outcomes in language learning","volume":"29","author":"Saarela","year":"2026","journal-title":"Discover Computing"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"S86","DOI":"10.1002\/tesq.70010","article-title":"Exploring generative AI as a roleplay interlocutor in L2 task-based pragmatics learning: Comparing ChatGPT-learner and technology-mediated peer interactions","volume":"59","author":"Sim","year":"2025","journal-title":"TESOL Quarterly"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1017\/S095834402400020X","article-title":"Efficiency trumps aptitude: Individualizing computer-assisted second language vocabulary learning","volume":"37","author":"Suzuki","year":"2025","journal-title":"ReCALL"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1037\/met0000476","article-title":"Comparing network structures on three aspects: A permutation test","volume":"28","author":"Boschloo","year":"2023","journal-title":"Psychological Methods"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"755","DOI":"10.6018\/analesps.33.3.268401","article-title":"A journey around alpha and omega to estimate internal consistency reliability","volume":"33","author":"Viladrich","year":"2017","journal-title":"Anales de Psicolog\u00eda"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, C., Sun, L., Yan, J., and Zou, B. (2026). Disciplinary and educational level differences in AI-mediated informal digital learning of English (AI-IDLE): A qualitative epistemic network analysis. Journal of Computer Assisted Learning, 42.","DOI":"10.1002\/jcal.70244"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"103533","DOI":"10.1016\/j.system.2024.103533","article-title":"The impact of different conversational generative AI chatbots on EFL learners: An analysis of willingness to communicate, foreign language speaking anxiety, and self-perceived communicative competence","volume":"127","author":"Wang","year":"2024","journal-title":"System"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"4607","DOI":"10.1007\/s10639-024-12963-x","article-title":"Development and validation of the perceived interactivity of learner-AI interaction scale","volume":"30","author":"Wang","year":"2025","journal-title":"Education and Information Technologies"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wang, Y. (2026). Exploring student engagement with multimodal generative AI in task-based Chinese language learning. Computer Assisted Language Learning, 1\u201326.","DOI":"10.1080\/09588221.2026.2645428"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103791","DOI":"10.1016\/j.system.2025.103791","article-title":"EFL teachers\u2019 generative artificial intelligence (GenAI) literacy: A scale development and validation study","volume":"133","author":"Wang","year":"2025","journal-title":"System"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"e70189","DOI":"10.1002\/jcal.70189","article-title":"Investigating the interplay of Chinese English as foreign language learners\u2019 growth mindset, enjoyment, adaptability, and engagement in AI-mediated informal digital learning of English","volume":"42","author":"Wang","year":"2026","journal-title":"Journal of Computer Assisted Learning"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Wu, H., Lalli, G. S., and Xia, Y. (2026). Explaining second language learners\u2019 willingness to communicate with GenAI voice chatbots via SEM and fsQCA: The role of dark personality and motivational dispositions. The Asia-Pacific Education Researcher, 1\u201312.","DOI":"10.1007\/s40299-026-01127-9"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"102134","DOI":"10.1016\/j.lmot.2025.102134","article-title":"Disclosing Chinese college students\u2019 flow experience in GenAI-assisted informal digital learning of english: A self-determination theory perspective","volume":"90","author":"Wu","year":"2025","journal-title":"Learning and Motivation"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Wu, J., Wang, Y., He, Y., Yin, X., Chen, F., and Wan, B. (2026). Acceptance of AI-assisted English language learning tools in higher education: Psychological correlates across disciplinary and proficiency groups [Original Research]. Frontiers in Psychology.","DOI":"10.3389\/fpsyg.2026.1806457"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"141","DOI":"10.5539\/hes.v9n2p141","article-title":"Analyzing professional English learning needs and situations of science and language majors in a Chinese university","volume":"9","author":"Xie","year":"2019","journal-title":"Higher Education Studies"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"101227","DOI":"10.1016\/j.jslw.2025.101227","article-title":"The development and validation of a scale on student AI literacy in L2 writing: A domain-specific perspective","volume":"69","author":"Xu","year":"2025","journal-title":"Journal of Second Language Writing"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Xu, Y., and Wu, H. (2026). Chinese STEM college students\u2019 AI-mediated informal digital learning of English: A hybrid SEM-PNA approach to the hedonic-motivation system adoption model. Journal of Intelligence, 14, (7).","DOI":"10.3390\/jintelligence14070120"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Yao, Y., Rong, M., Chen, X., and Zhu, X. (2026). Measuring Chinese undergraduate students\u2019 engagement with GenAI feedback in L2 writing: A large-scale study. Innovation in Language Learning and Teaching, 1\u201318.","DOI":"10.1080\/17501229.2026.2683868"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1177\/10963480231226085","article-title":"Smart service interactional experience for family travelers: Scale development and validation","volume":"49","author":"Zhang","year":"2025","journal-title":"Journal of Hospitality & Tourism Research"}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/226\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T11:42:50Z","timestamp":1789990970000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/226"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,19]]},"references-count":62,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["jintelligence14090226"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14090226","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,19]]}}}