{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T05:35:44Z","timestamp":1780724144588,"version":"3.54.1"},"reference-count":109,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T00:00:00Z","timestamp":1730678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Assessments of interactional competence have traditionally been limited in large-scale language assessments. The listening portion suffers from construct underrepresentation, whereas the speaking portion suffers from limited task formats such as in-person interviews or role plays. Human-delivered tasks are challenging to administer at large scales, while automated assessments are typically very narrow in their assessment of the construct because they have carried over the limitations of traditional paper-based tasks to digital formats. However, computer-based assessments do allow for more interactive, automatically administered tasks, but come with increased complexity in task creation. Large language models present new opportunities for enhanced automated item generation (AIG) processes that can create complex content types and tasks at scale that support richer assessments.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This paper describes the use of such methods to generate content at scale for an interactive listening measure of interactional competence for the Duolingo English Test (DET), a large-scale, high-stakes test of English proficiency. The Interactive Listening task assesses test takers\u2019 ability to participate in a full conversation, resulting in a more authentic assessment of interactive listening ability than prior automated assessments by positing comprehension and interaction as purposes of listening.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results and discussion<\/jats:title><jats:p>The results of a pilot of 713 tasks with hundreds of responses per task, along with the results of human review, demonstrate the feasibility of a human-in-the-loop, generative AI-driven approach for automatic creation of complex educational assessments at scale.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2024.1474019","type":"journal-article","created":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T12:39:46Z","timestamp":1730723986000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["A generative AI-driven interactive listening assessment task"],"prefix":"10.3389","volume":"7","author":[{"given":"Andrew","family":"Runge","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yigal","family":"Attali","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geoffrey T.","family":"LaFlair","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yena","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacqueline","family":"Church","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,4]]},"reference":[{"key":"ref2","year":"2024"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1177\/02655322221126604","article-title":"The typology of second language listening constructs: a systematic review","volume":"40","author":"Aryadoust","year":"2023","journal-title":"Lang. Test."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"100204","DOI":"10.1016\/j.caeai.2024.100204","article-title":"Investigating the affordances of OpenAI\u2019s large language model in developing listening assessments","volume":"6","author":"Aryadoust","year":"2024","journal-title":"Comput. Educ."},{"key":"ref5","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/978-3-319-93843-1_2","article-title":"Automatic item generation unleashed: an evaluation of a large-scale deployment of item models","volume-title":"Artificial intelligence in education","author":"Attali","year":"2018"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1111\/j.1745-3984.2000.tb01077.x","article-title":"The point-biserial as a discrimination index for distractors in multiple-choice items: deficiencies in usage and an alternative","volume":"37","author":"Attali","year":"2000","journal-title":"J. Educ. Meas."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1177\/0013164409332231","article-title":"Immediate feedback and opportunity to revise answers to open-ended questions","volume":"70","author":"Attali","year":"2010","journal-title":"Educ. Psychol. Meas."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"903077","DOI":"10.3389\/frai.2022.903077","article-title":"The interactive reading task: transformer-based automatic item generation","volume":"5","author":"Attali","year":"2022","journal-title":"Front. Artif. Intell."},{"key":"ref9","doi-asserted-by":"crossref","DOI":"10.1002\/9780470712993","volume-title":"Computer-based testing and the internet: Issues and advances","author":"Bartram","year":"2005"},{"key":"ref10","first-page":"199","article-title":"Generative testing: from conception to implementation","volume-title":"Item generation for test development","author":"Bejar","year":"2002"},{"key":"ref11","first-page":"701","article-title":"Ensuring fairness of human-and AI-generated test items","volume-title":"Artificial intelligence in education. Posters and late breaking results, workshops and tutorials, industry and innovation tracks, practitioners, doctoral consortium and blue sky","author":"Belzak","year":"2023"},{"key":"ref001","doi-asserted-by":"publisher","first-page":"100161","DOI":"10.1016\/j.caeai.2023.100161","article-title":"Automated reading passage generation with OpenAI\u2019s large language model","volume":"5","author":"Bezirhan","year":"2023","journal-title":"Comput. Educ.: Artif. Intell."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1080\/15434303.2023.2288266","article-title":"The criticality of implementing principled design when using AI technologies in test development","volume":"20","author":"Bolender","year":"2023","journal-title":"Lang. Assess. Q."},{"key":"ref13","first-page":"1","article-title":"Assessing pragmatic competence","volume-title":"The TESOL encyclopedia of English language teaching","author":"Brown","year":"2018"},{"key":"ref14","first-page":"1877","article-title":"Language models are few-shot learners","volume-title":"Advances in neural information processing systems","author":"Brown","year":"2020"},{"key":"ref15","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511732959","volume-title":"Assessing Listening","author":"Buck","year":"2001"},{"key":"ref16","volume-title":"Designing and analyzing language tests: A hands-on introduction to language testing theory and practice","author":"Carr","year":"2011"},{"key":"ref17","first-page":"814","article-title":"PLACES: prompting language models for social conversation synthesis","volume-title":"Findings of the Association for Computational Linguistics: EACL 2023","author":"Chen","year":"2023"},{"key":"ref18","author":"Chen","year":"2022"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"6605","DOI":"10.18653\/v1\/2021.emnlp-main.530","article-title":"Simple conversational data augmentation for semi-supervised abstractive dialogue summarization","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Chen","year":"2021"},{"key":"ref20","author":"Chiu","year":"2021"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1177\/0146621616677520","article-title":"Critical values for Yen\u2019s Q3: identification of local dependence in the Rasch model using residual correlations","volume":"41","author":"Christensen","year":"2017","journal-title":"Appl. Psychol. Meas."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/ets2.12319","article-title":"The development and evaluation of interactional competence elicitor for oral language assessments","volume":"2021","author":"Chukharev-Hudilainen","year":"2021","journal-title":"ETS Res. Rep. Ser."},{"key":"ref23","doi-asserted-by":"publisher","first-page":"858273","DOI":"10.3389\/feduc.2023.858273","article-title":"Automatic item generation: foundations and machine learning-based approaches for assessments","volume":"8","author":"Circi","year":"2023","journal-title":"Front. Educ."},{"key":"ref24","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen","year":"1988"},{"key":"ref25","volume-title":"Common European framework of reference for languages: Learning, teaching, assessment \u2013 Companion volume","year":"2020"},{"key":"ref26","doi-asserted-by":"crossref","DOI":"10.3726\/b21295","volume-title":"Assessing interactional competence: Principles, test development and validation through an L2 Chinese IC test","author":"Dai","year":"2024"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1177\/0265532209104667","article-title":"The influence of interlocutor proficiency in a paired oral assessment","volume":"26","author":"Davis","year":"2009","journal-title":"Lang. Test."},{"key":"ref28","author":"Devlin","year":"2019"},{"key":"ref29","author":"Dinan","year":"2019"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1016\/j.pragma.2022.03.001","article-title":"Common ground, cooperation, and recipient design in human-computer interactions","volume":"193","author":"Dombi","year":"2022","journal-title":"J. Pragmat."},{"key":"ref31","volume-title":"Handbook of test development","author":"Downing","year":"2006"},{"key":"ref32","first-page":"747","article-title":"Automatic item generation and cognitive psychology","volume-title":"Handbook of statistics","author":"Embretson","year":"2006"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1016\/j.specom.2009.04.005","article-title":"An overview of spoken language technology for education","volume":"51","author":"Esk\u00e9nazi","year":"2009","journal-title":"Speech Comm."},{"key":"ref34","first-page":"79","article-title":"Performance of a trialogue-based prototype system for English language assessment for young learners","volume-title":"4st workshop on Child, computer and interaction, WOCCI 2014","author":"Evanini","year":"2014"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1080\/15434300801934702","article-title":"Peer-peer interaction in a speaking test: the case of the first certificate in English examination","volume":"5","author":"Galaczi","year":"2008","journal-title":"Lang. Assess. Q."},{"key":"ref36","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1080\/15434303.2018.1453816","article-title":"Interactional competence: Conceptualisations, operationalisations, and outstanding questions","volume":"15","author":"Galaczi","year":"2018","journal-title":"Lang. Assess. Q."},{"key":"ref37","doi-asserted-by":"crossref","DOI":"10.4324\/9780203803912","volume-title":"Automatic item generation: Theory and practice","author":"Gierl","year":"2012"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1080\/15434303.2023.2289173","article-title":"Exploring the potential of a spoken dialog system-delivered paired discussion task for assessing interactional competence","volume":"21","author":"Gokturk","year":"2024","journal-title":"Lang. Assess. Q."},{"key":"ref39","author":"Gopalakrishnan","year":"2019"},{"key":"ref40","first-page":"13","article-title":"Automatic item generation: a historical perspective","volume-title":"Automatic item generation: Theory and practice","author":"Haladyna","year":"2013"},{"key":"ref41","author":"Han","year":"2024"},{"key":"ref42","author":"Hartman","year":"2020"},{"key":"ref43","author":"Higashinaka","year":"2016"},{"key":"ref44","author":"Hou","year":"2019"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0261444822000477","article-title":"Speech acts and interaction in second language pragmatics: a position paper","author":"House","year":"2023","journal-title":"Lang. Teach."},{"key":"ref46","first-page":"487","volume-title":"Item generation for test development","author":"Irvine","year":"2002"},{"key":"ref47","author":"Iwashita","year":"1996"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref49","author":"Jiang","year":"2023"},{"key":"ref50","volume-title":"Evaluating and inducing personality in pre-trained language models. Proceedings of the 37th international conference on neural information processing systems","author":"Jiang","year":"2024"},{"key":"ref51","first-page":"27","article-title":"Re-analyzing the OPI: how much does it look like natural conversation?","volume-title":"Studies in bilingualism","author":"Johnson","year":"1998"},{"key":"ref52","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1080\/00393274.2017.1358662","article-title":"Speech acts and speech act sequences: greetings and farewells in the history of American English","volume":"89","author":"Jucker","year":"2017","journal-title":"Stud. Neophilol."},{"key":"ref53","doi-asserted-by":"crossref","DOI":"10.31274\/td-20240329-228","volume-title":"Development and validation of spoken dialog system-based oral communication tasks in an ESP context","author":"Karatay","year":"2022"},{"key":"ref54","first-page":"12930","article-title":"SODA: million-scale dialogue distillation with social commonsense contextualization","author":"Kim","year":"2023"},{"key":"ref55","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1177\/026553229901600203","article-title":"Simulating conversations in oral-proficiency assessment: a conversation analysis of role plays and non-scripted interviews in language exams","volume":"16","author":"Kormos","year":"1999","journal-title":"Lang. Test."},{"key":"ref56","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1111\/emip.12237","article-title":"A cost\u2013benefit analysis of automatic item generation","volume":"38","author":"Kosh","year":"2018","journal-title":"Educ. Measur."},{"key":"ref57","author":"Kumar","year":"2024"},{"key":"ref58","first-page":"29","article-title":"PERSONACHATGEN: generating personalized dialogues using GPT-3","volume-title":"Proceedings of the 1st workshop on customized chat grounding persona and knowledge","author":"Lee","year":"2022"},{"key":"ref59","doi-asserted-by":"crossref","first-page":"4715","DOI":"10.18653\/v1\/2020.acl-main.428","article-title":"Don\u2019t say that! Making inconsistent dialogue unlikely with unlikelihood training","volume-title":"Proceedings of the 58th annual meeting of the Association for Computational Linguistics","author":"Li","year":"2020"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1080\/15434303.2018.1472265","article-title":"Speech technologies and the assessment of second language speaking: approaches, challenges, and opportunities","volume":"15","author":"Litman","year":"2018","journal-title":"Lang. Assess. Q."},{"key":"ref61","first-page":"3469","article-title":"Towards emotional support dialog systems","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing","author":"Liu","year":"2021"},{"key":"ref62","doi-asserted-by":"publisher","first-page":"375","DOI":"10.3390\/fi15120375","article-title":"A structured narrative prompt for prompting narratives from large language models: sentiment assessment of chatgpt-generated narratives and real tweets","volume":"15","author":"Lynch","year":"2023","journal-title":"Future Internet"},{"key":"ref63","author":"Lyu","year":"2024"},{"key":"ref64","first-page":"1190","article-title":"Simulated chats for building dialog systems: learning to generate conversations from instructions","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2021, virtual event\/Punta Cana, Dominican Republic, 16\u201320 November, 2021","author":"Mohapatra","year":"2021"},{"key":"ref65","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1177\/0265532211398110","article-title":"Effects of test-taker characteristics and the number of participants in group oral tests","volume":"28","author":"Nakatsuhara","year":"2011","journal-title":"Lang. Test."},{"key":"ref66","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1093\/applin\/amaa067","article-title":"Human versus computer partner in the paired oral discussion test","volume":"42","author":"Ockey","year":"2021","journal-title":"Appl. Linguis."},{"key":"ref67","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1080\/15434303.2023.2237486","article-title":"Assessing interactional competence: ICE versus a human partner","volume":"20","author":"Ockey","year":"2023","journal-title":"Lang. Assess. Q."},{"key":"ref1","author":"OpenAI","year":"2024"},{"key":"ref68","author":"Papageorgiou","year":"2021"},{"key":"ref69","doi-asserted-by":"crossref","first-page":"92","DOI":"10.18653\/v1\/W19-5912","article-title":"Collaborative multi-agent dialogue model training via reinforcement learning","volume-title":"Proceedings of the 20th annual SIGdial meeting on discourse and dialogue","author":"Papangelis","year":"2019"},{"key":"ref70","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1177\/02655322221076024","article-title":"Developing a local academic English listening test using authentic unscripted audio-visual texts","volume":"39","author":"Park","year":"2022","journal-title":"Lang. Test."},{"key":"ref71","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1177\/0265532218772325","article-title":"Interactional competence: genie out of the bottle","volume":"35","author":"Plough","year":"2018","journal-title":"Lang. Test."},{"key":"ref72","author":"Radford","year":"2019"},{"key":"ref73","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/ets2.12105","article-title":"Bootstrapping development of a cloud-based spoken dialog system in the educational domain from scratch using crowdsourced data","volume":"2016","author":"Ramanarayanan","year":"2016","journal-title":"ETS Res. Rep. Ser."},{"key":"ref74","first-page":"704","article-title":"Increasing faithfulness in knowledge-grounded dialogue with controllable features","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL\/IJCNLP 2021","author":"Rashkin","year":"2021"},{"key":"ref75","doi-asserted-by":"crossref","first-page":"3982","DOI":"10.18653\/v1\/D19-1410","article-title":"Sentence-BERT: sentence Embeddings using Siamese BERT-networks","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Reimers","year":"2019"},{"key":"ref76","doi-asserted-by":"crossref","first-page":"23","DOI":"10.21832\/9781788923828-003","article-title":"Reconceptualising interactional competence for language testing","volume-title":"Assessing speaking in context","author":"Roever","year":"2021"},{"key":"ref77","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1177\/0265532218758128","article-title":"Speaking in turns and sequences: interactional competence as a target construct in testing speaking","volume":"35","author":"Roever","year":"2018","journal-title":"Lang. Test."},{"key":"ref78","doi-asserted-by":"crossref","first-page":"597","DOI":"10.4324\/9781003220756-46","article-title":"Quality management in test production and administration","volume-title":"The Routledge handbook of language testing","author":"Saville","year":"2021"},{"key":"ref79","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1111\/emip.12590","article-title":"Using OpenAI GPT to generate reading comprehension items","volume":"43","author":"Sayin","year":"2024","journal-title":"Educ. Measur."},{"key":"ref80","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1057\/9781137003522_8","article-title":"Oral proficiency interviews as varieties of interaction","volume-title":"Assessing second language pragmatics","author":"Seedhouse","year":"2013"},{"key":"ref81","first-page":"3784","article-title":"Retrieval augmentation reduces hallucination in conversation","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2021, virtual event \/ Punta Cana, Dominican Republic, 16\u201320 November, 2021","author":"Shuster","year":"2021"},{"key":"ref82","first-page":"329","article-title":"Innovative item formats in computer-based testing: in pursuit of improved construct representation","volume-title":"Handbook of test development","author":"Sireci","year":"2006"},{"key":"ref83","first-page":"8878","article-title":"Generating persona consistent dialogues by exploiting natural language inference","volume-title":"The thirty-fourth AAAI conference on artificial intelligence, AAAI 2020, the thirty-second innovative applications of artificial intelligence conference, IAAI 2020, the tenth AAAI symposium on educational advances in artificial intelligence, EAAI 2020","author":"Song","year":"2020"},{"key":"ref84","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1111\/modl.12385","article-title":"Comparing language use in oral proficiency interviews to target domains: conversational, academic, and professional discourse","volume":"101","author":"Staples","year":"2017","journal-title":"Mod. Lang. J."},{"key":"ref85","author":"Su","year":"2015"},{"key":"ref86","author":"Su\u00e1rez-\u00c1lvarez","year":"2023"},{"key":"ref87","first-page":"1741","article-title":"Towards fewer hallucinations in knowledge-grounded dialogue generation via augmentative and contrastive knowledge-dialogue","volume-title":"Proceedings of the 61st annual meeting of the Association for Computational Linguistics","author":"Sun","year":"2023"},{"key":"ref88","author":"Suvorov","year":"2023"},{"key":"ref89","author":"Timpe-Laughlin","year":"2017"},{"key":"ref90","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1080\/09588221.2020.1774904","article-title":"Using spoken dialogue technology for L2 speaking practice: what do teachers think?","volume":"35","author":"Timpe-Laughlin","year":"2020","journal-title":"Comput. Assist. Lang. Learn."},{"key":"ref91","author":"Touvron","year":"2023"},{"key":"ref92","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-85461-8","volume-title":"Elements of adaptive testing","author":"van der Linden","year":"2010"},{"key":"ref93","doi-asserted-by":"publisher","first-page":"489","DOI":"10.2307\/3586922","article-title":"Reeling, writhing, drawling, stretching, and fainting in coils: Oral proficiency interviews as conversation","volume":"23","author":"van Lier","year":"1989","journal-title":"TESOL Q."},{"key":"ref94","author":"Vaswani","year":"2017"},{"key":"ref95","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1007\/s11336-018-9608-y","article-title":"Automated item generation with recurrent neural networks","volume":"83","author":"von Davier","year":"2018","journal-title":"Psychometrika"},{"key":"ref96","first-page":"47","article-title":"Assessing Listening","volume-title":"The companion to language assessment","author":"Wagner","year":"2014"},{"key":"ref97","first-page":"80079","article-title":"Jailbroken: how does LLM safety training fail?","volume-title":"Advances in neural information processing systems","author":"Wei","year":"2023"},{"key":"ref98","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1037\/0033-2909.93.1.179","article-title":"Construct validity: construct representation versus nomothetic span","volume":"93","author":"Whitely","year":"1983","journal-title":"Psychol. Bull."},{"key":"ref99","doi-asserted-by":"crossref","first-page":"204","DOI":"10.18653\/v1\/2022.sigdial-1.21","article-title":"DG2: data augmentation through document grounded dialogue generation","volume-title":"Proceedings of the 23rd annual meeting of the special interest group on discourse and dialogue","author":"Wu","year":"2022"},{"key":"ref100","doi-asserted-by":"publisher","first-page":"1486","DOI":"10.1038\/s42256-023-00765-8","article-title":"Defending ChatGPT against jailbreak attack via self-reminders","volume":"5","author":"Xie","year":"2023","journal-title":"Nat Mach Intell"},{"key":"ref101","first-page":"13557","article-title":"Learning new skills after deployment: improving open-domain internet-driven dialogue with human feedback","volume-title":"Proceedings of the 61st annual meeting of the Association for Computational Linguistics","author":"Xu","year":"2023"},{"key":"ref102","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1177\/014662168400800201","article-title":"Effects of local item dependence on the fit and equating performance of the three-parameter logistic model","volume":"8","author":"Yen","year":"1984","journal-title":"Appl. Psychol. Meas."},{"key":"ref103","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1111\/j.1745-3984.1993.tb00423.x","article-title":"Scaling performance assessments: strategies for managing local item dependence","volume":"30","author":"Yen","year":"1993","journal-title":"J. Educ. Meas."},{"key":"ref104","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1177\/0265532219860077","article-title":"Managing proposal sequences in role-play assessment: validity evidence of interactional competence across levels","volume":"37","author":"Youn","year":"2020","journal-title":"Lang. Test."},{"key":"ref105","doi-asserted-by":"crossref","DOI":"10.1075\/sibil.14","volume-title":"Talking and testing: Discourse approaches to the assessment of Oral proficiency","author":"Young","year":"1998"},{"key":"ref106","first-page":"2204","article-title":"Personalizing dialogue agents: I have a dog, do you have pets too?","volume-title":"Proceedings of the 56th annual meeting of the Association for Computational Linguistics","author":"Zhang","year":"2018"},{"key":"ref107","doi-asserted-by":"crossref","first-page":"1552","DOI":"10.18653\/v1\/2023.findings-acl.99","article-title":"AugESC: dialogue augmentation with large language models for emotional support conversation","volume-title":"Findings of the Association for Computational Linguistics: ACL 2023, July 9\u201314, 2023","author":"Zheng","year":"2023"},{"key":"ref108","first-page":"55","article-title":"Automated distractor generation for fill-in-the-blank items using a prompt-based learning approach","volume":"65","author":"Zu","year":"2023","journal-title":"Psychol. Test. Assess. Model."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1474019\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T12:40:06Z","timestamp":1730724006000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1474019\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,4]]},"references-count":109,"alternative-id":["10.3389\/frai.2024.1474019"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1474019","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,4]]},"article-number":"1474019"}}