{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T04:56:33Z","timestamp":1781758593312,"version":"3.54.5"},"reference-count":86,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T00:00:00Z","timestamp":1728259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005246","name":"Institute of Education Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>In line with the positive effects of personalized learning, personalized assessments are expected to maximize learner motivation and engagement, allowing learners to show what they truly know and can do. Considering the advances in Generative Artificial Intelligence (GenAI), in this perspective article, we elaborate on the opportunities of integrating GenAI into personalized educational assessments to maximize learner engagement, performance, and access. We also draw attention to the challenges of integrating GenAI into personalized educational assessments regarding its potential risks to the assessment\u2019s core values of validity, reliability, and fairness. Finally, we discuss possible solutions and future directions.<\/jats:p>","DOI":"10.3389\/frai.2024.1460651","type":"journal-article","created":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T05:10:45Z","timestamp":1728277845000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["Opportunities and challenges of using generative AI to personalize educational assessment"],"prefix":"10.3389","volume":"7","author":[{"given":"Burcu","family":"Arslan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Blair","family":"Lehman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caitlin","family":"Tenison","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jesse R.","family":"Sparks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexis A.","family":"L\u00f3pez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Gu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Zapata-Rivera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,10,7]]},"reference":[{"key":"ref1","author":"Ali","year":"2020"},{"key":"ref2","volume-title":"Standards for educational and psychological testing","year":"2014"},{"key":"ref3","author":"Amirizaniani","year":"2024"},{"key":"ref4","author":"Arslan","year":"2024"},{"key":"ref5","author":"Barany","year":"2024"},{"key":"ref6","author":"Bender","year":"2021"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/0969594X.2010.513678","article-title":"Formative assessment: a critical review","volume":"18","author":"Bennett","year":"2011","journal-title":"Assess. Educ. Principles, Policy & Prac."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1080\/10627197.2023.2202312","article-title":"Toward a theory of socioculturally responsive assessment","volume":"28","author":"Bennett","year":"2023","journal-title":"Educ. Assess."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"1675","DOI":"10.1007\/s10648-021-09615-8","article-title":"A systematic review of research on personalized learning: personalized by whom, to what, how, and for what purpose (s)?","volume":"33","author":"Bernacki","year":"2021","journal-title":"Educ. Psychol. Rev."},{"key":"ref10","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1037\/edu0000250","article-title":"The role of situational interest in personalized learning","volume":"110","author":"Bernacki","year":"2018","journal-title":"J. Educ. Psychol."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s11092-008-9068-5","article-title":"Developing a theory of formative assessment","volume":"21","author":"Black","year":"2009","journal-title":"Educ. Assess. Eval. Account."},{"key":"ref12","first-page":"i","article-title":"Generative AI and prompt engineering: the art of whispering to let the genie out of the algorithmic world","volume":"18","author":"Bozkurt","year":"2023","journal-title":"Asian J. Distance Educ."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1007\/s40593-015-0090-8","article-title":"SMILI\u263a: a framework for interfaces to learning data in open learner models, learning analytics and related fields","volume":"26","author":"Bull","year":"2016","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"18900","DOI":"10.48550\/arXiv.2406.18900","article-title":"The rise of artificial intelligence in educational measurement: opportunities and ethical challenges","volume":"2406","author":"Bulut","year":"2024","journal-title":"arXiv preprint arXiv"},{"key":"ref15","author":"Burstein","year":"2023"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1111\/emip.12551","article-title":"Personalizing large-scale assessment in practice","volume":"42","author":"Buzick","year":"2023","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1177\/07356331241226592","article-title":"Facilitating student learning with a chatbot in an online math learning platform","volume":"62","author":"Cheng","year":"2024","journal-title":"J. Educ. Comput. Res."},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/aj46b","article-title":"Large language models amplify human biases in moral decision-making","author":"Cheung","year":"2024","journal-title":"Psyarxiv preprint"},{"key":"ref002","doi-asserted-by":"publisher","first-page":"arXiv","DOI":"10.48550\/arXiv.2402.11111","article-title":"Language models as science tutors","author":"Chevalier","year":"2024","journal-title":"arXiv preprint"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1016\/B978-044481862-1.50103-5","article-title":"Intelligent tutoring systems","volume-title":"Handbook of human-computer interaction, second, completely revised edition","author":"Corbett","year":"1997"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"98","DOI":"10.17705\/1jais.00867","article-title":"Human-in-the-loop AI reviewing: feasibility, opportunities, and risks","volume":"25","author":"Drori","year":"2024","journal-title":"J. Assoc. Inf. Syst."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/ets2.12067","article-title":"Measuring motivation in low-stakes assessments","volume":"2015","author":"Finn","year":"2015","journal-title":"ETS Res. Report Series"},{"key":"ref22","first-page":"506","article-title":"Interactive score reporting: an AutoTutor-based system for teachers","volume-title":"Proceedings of the international conference on artificial intelligence in education, LNCS","author":"Forsyth","year":"2017"},{"key":"ref23","author":"Forsyth","year":"2024"},{"key":"ref24","doi-asserted-by":"crossref","DOI":"10.1057\/9781137385765","volume-title":"Translanguaging: Language, Bilingualism and Education","author":"Garc\u00eda","year":"2014"},{"key":"ref25","doi-asserted-by":"crossref","first-page":"158","DOI":"10.4018\/979-8-3693-1351-0.ch008","article-title":"Challenges and limitations of generative AI in education","volume-title":"Transforming education with generative AI","author":"G\u00f6ko\u011flu","year":"2024"},{"key":"ref26","volume-title":"Funds of knowledge: Theorizing practices in households, communities, and classrooms","author":"Gonz\u00e1lez","year":"2005"},{"key":"ref27","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1037\/13275-018","article-title":"Intelligent tutoring systems","volume-title":"APA Educational Psychology handbook, Vol. 3. Application to learning and teaching","author":"Graesser","year":"2012"},{"key":"ref28","author":"Greshake","year":"2023"},{"key":"ref29","article-title":"Large language models: A comprehensive survey of its applications, challenges, limitations, and future prospects","volume-title":"TechRxiv","author":"Hadi","year":"2023"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1111\/emip.12602","article-title":"Transforming assessment: the impacts and implications of large language models and generative ai","volume":"43","author":"Hao","year":"2024","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref31","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1007\/s10676-024-09775-5","article-title":"ChatGPT is bullshit","volume":"26","author":"Hicks","year":"2024","journal-title":"Ethics Inf. Technol."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1207\/s15326985ep4102_4","article-title":"The four-phase model of interest development","volume":"41","author":"Hidi","year":"2006","journal-title":"Educ. Psychol."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"542","DOI":"10.1111\/ejed.12533","article-title":"State of the art and practice in AI in education","volume":"57","author":"Holmes","year":"2022","journal-title":"Eur. J. Educ."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"09395","DOI":"10.48550\/arXiv.2401.09395","article-title":"Stuck in the quicksand of numeracy, far from AGI summit: evaluating LLMs\u2019 mathematical competency through ontology-guided perturbations","volume":"2401","author":"Hong","year":"2024","journal-title":"arXiv preprint arXiv"},{"key":"ref35","author":"Hu","year":"2023"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1111\/jedm.12334","article-title":"Toward argument-based fairness with an application to AI-enhanced educational assessments","volume":"59","author":"Huggins-Manley","year":"2022","journal-title":"J. Educ. Meas."},{"key":"ref37","doi-asserted-by":"publisher","first-page":"105070a","DOI":"10.1016\/j.compedu.2024.105070","article-title":"Detecting ChatGPT-generated essays in a large-scale writing assessment: is there a bias against non-native English speakers?","volume":"217","author":"Jiang","year":"2024","journal-title":"Comput. Educ."},{"key":"ref38","author":"Johnson","year":"2024"},{"key":"ref39","author":"Jurenka","year":"2024"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"102274","DOI":"10.1016\/j.lindif.2023.102274","article-title":"ChatGPT for good? On opportunities and challenges of large language models for education","volume":"103","author":"Kasneci","year":"2023","journal-title":"Learn. Individ. Differ."},{"key":"ref41","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1038\/s42256-024-00820-y","article-title":"The benefits, risks and bounds of personalizing the alignment of large language models to individuals","volume":"6","author":"Kirk","year":"2024","journal-title":"Nature Machine Intell."},{"key":"ref42","author":"Kochmar","year":"2020"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.7275\/pare.2102","article-title":"A culturally enhanced framework of caring assessments for diverse learners","volume":"29","author":"Lehman","year":"2024","journal-title":"Pract. Assess. Res. Eval."},{"key":"ref44","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1080\/15348431.2020.1731693","article-title":"Examining how Spanish-speaking English language learners use their linguistic resources and language modes in a dual language mathematics assessment task","volume":"22","author":"L\u00f3pez","year":"2023","journal-title":"J. Latinos Educ."},{"key":"ref45","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1037\/a0037123","article-title":"Intelligent tutoring systems and learning outcomes: a meta-analysis","volume":"106","author":"Ma","year":"2014","journal-title":"J. Educ. Psychol."},{"key":"ref46","doi-asserted-by":"publisher","first-page":"02439","DOI":"10.48550\/arXiv.2308.02439","article-title":"A large language model-assisted education tool to provide feedback on open-ended responses","volume":"2308","author":"Matelsky","year":"2023","journal-title":"arXiv preprint arXiv"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"877","DOI":"10.3390\/analytics2040046","article-title":"Learning analytics in the era of large language models","volume":"2","author":"Mazzullo","year":"2023","journal-title":"Analytics"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"100199","DOI":"10.1016\/j.caeai.2023.100199","article-title":"Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students\u2019 text revision, motivation, and positive emotions","volume":"6","author":"Meyer","year":"2024","journal-title":"Comput. Educ.: Artificial Intelligence"},{"key":"ref49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/j.2333-8504.2003.tb01908.x","article-title":"A brief introduction to evidence-centered design","volume":"2003","author":"Mislevy","year":"2003","journal-title":"ETS Res. Report Series"},{"key":"ref50","year":""},{"key":"ref51","year":""},{"key":"ref52","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1007\/978-3-031-42682-7_19","article-title":"Evaluating ChatGPT\u2019s decimal skills and feedback generation in a digital learning game","volume-title":"Responsive and Sustainable Educational Futures. EC-TEL 2023","author":"Nguyen","year":"2023"},{"key":"ref53","author":"Olney","year":"2023"},{"key":"ref54","doi-asserted-by":"publisher","first-page":"00150","DOI":"10.48550\/arXiv.2307.00150","article-title":"Large language models (GPT) for automating feedback on programming assignments","volume":"2307","author":"Pankiewicz","year":"2023","journal-title":"arXiv preprint arXiv"},{"key":"ref55","doi-asserted-by":"publisher","first-page":"e0304013","DOI":"10.1371\/journal.pone.0304013","article-title":"ChatGPT-generated help produces learning gains equivalent to human tutor-authored help on mathematics skills","volume":"19","author":"Pardos","year":"2024","journal-title":"PLoS One"},{"key":"ref56","author":"Park","year":"2024"},{"key":"ref57","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1007\/978-3-030-20062-6_21","article-title":"Co-design as infrastructuring with attention to power: building collective capacity for equitable teaching and learning through design-based implementation research","volume-title":"Collaborative curriculum Design for Sustainable Innovation and Teacher Learning","author":"Penuel","year":"2019"},{"key":"ref001","doi-asserted-by":"publisher","first-page":"43","DOI":"10.4236\/jsea.2024.171003","article-title":"Guardian: A multi-tiered defense architecture for thwarting prompt injection attacks on llms","volume":"17","author":"Rai","year":"2024","journal-title":"J. Softw. Eng. Appl."},{"key":"ref58","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1080\/10627197.2022.2042682","article-title":"Disrupting white supremacy in assessment: toward a justice-oriented, antiracist validity framework","volume":"27","author":"Randall","year":"2022","journal-title":"Educ. Assess."},{"key":"ref59","doi-asserted-by":"publisher","first-page":"06599","DOI":"10.48550\/arXiv.2406.06599","article-title":"Anna Karenina strikes again: pre-trained LLM embeddings may favor high-performing learners","volume":"2406","author":"Schleifer","year":"2024","journal-title":"arXiv preprint arXiv"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1111\/jedm.12381","article-title":"Computation and accuracy evaluation of comparable scores on culturally responsive assessments","volume":"61","author":"Sinharay","year":"2024","journal-title":"J. Educ. Meas."},{"key":"ref61","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1111\/emip.12377","article-title":"Standardization and UNDERSTANDardization in educational assessment","volume":"39","author":"Sireci","year":"2020","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref62","doi-asserted-by":"publisher","first-page":"02427","DOI":"10.48550\/arXiv.2309.02427","article-title":"Cognitive architectures for language agents","volume":"2309","author":"Sumers","year":"2023","journal-title":"arXiv preprint arXiv"},{"key":"ref63","doi-asserted-by":"publisher","first-page":"10444","DOI":"10.48550\/arXiv.2401.10444","article-title":"Can a cognitive architecture fundamentally enhance LLMs? Or vice versa?","volume":"2401","author":"Sun","year":"2024","journal-title":"arXiv preprint arXiv"},{"key":"ref64","doi-asserted-by":"publisher","first-page":"100075","DOI":"10.1016\/j.caeai.2022.100075","article-title":"Assessment in the age of artificial intelligence","volume":"3","author":"Swiecki","year":"2022","journal-title":"Comput. Educ.: Artificial Intelligence"},{"key":"ref65","year":"2024"},{"key":"ref66","doi-asserted-by":"crossref","first-page":"90","DOI":"10.4324\/9781003278658-8","article-title":"Training Optimus prime, MD: a case study of automated item generation using artificial intelligence\u2013from fine-tuned GPT2 to GPT3 and beyond","volume-title":"Advancing natural language processing in educational assessment","author":"von Davier","year":"2023"},{"key":"ref67","first-page":"25","article-title":"Computational psychometrics: A framework for estimating learners\u2019 knowledge, skills and abilities from learning and assessments systems,","author":"von Davier","year":"2021","journal-title":"Computational psychometrics: New methodologies for a new generation of digital learning and assessment: With examples in R and Python"},{"key":"ref68","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1037\/a0031882","article-title":"Using adaptive learning technologies to personalize instruction to student interests: the impact of relevant contexts on performance and learning outcomes","volume":"105","author":"Walkington","year":"2013","journal-title":"J. Educ. Psychol."},{"key":"ref69","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1080\/00220973.2017.1380590","article-title":"Personalization of instruction: design dimensions and implications for cognition","volume":"86","author":"Walkington","year":"2018","journal-title":"J. Exp. Educ."},{"key":"ref70","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1007\/s40593-018-0168-1","article-title":"Personalizing algebra to students\u2019 individual interests in an intelligent tutoring system: how moderators of impact","volume":"29","author":"Walkington","year":"2019","journal-title":"J. Artif. Intell. Educ."},{"key":"ref71","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1111\/jcal.12502","article-title":"Applying learning analytics dashboards based on process-oriented feedback to improve students' learning effectiveness","volume":"37","author":"Wang","year":"2021","journal-title":"J. Comput. Assist. Learn."},{"key":"ref72","first-page":"153","article-title":"Towards human-like educational question generation with large language models","volume-title":"International conference on artificial intelligence in education","author":"Wang","year":"2022"},{"key":"ref73","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1080\/17439884.2020.1798995","article-title":"Historical threads, missing links, and future directions in AI in education","volume":"45","author":"Williamson","year":"2020","journal-title":"Learn. Media Technol."},{"key":"ref74","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1111\/emip.12165","article-title":"Rapid-guessing behavior: its identification, interpretation, and implications","volume":"36","author":"Wise","year":"2017","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref75","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1207\/s15324818ame1802_2","article-title":"Response time effort: a new measure of examinee motivation in computer-based tests","volume":"18","author":"Wise","year":"2005","journal-title":"Appl. Meas. Educ."},{"key":"ref76","author":"Xhakaj","year":"2017"},{"key":"ref77","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/19313152.2024.2339757","article-title":"Linguistically responsive formative assessment for emergent bilinguals: exploration of an elementary teacher\u2019s practice in a math classroom","author":"Yang","year":"2024","journal-title":"Int. Multilingual Res. J."},{"key":"ref78","doi-asserted-by":"publisher","first-page":"06794","DOI":"10.48550\/arXiv.2309.06794","article-title":"Cognitive mirage: a review of hallucinations in large language models","volume":"2309","author":"Ye","year":"2023","journal-title":"arXiv preprint arXiv"},{"key":"ref79","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1007\/978-3-642-31454-4_32","article-title":"Adaptive score reports","volume-title":"Proceedings of the user modeling, adaptation, and personalization conference","author":"Zapata-Rivera","year":"2012"},{"key":"ref80","author":"Zapata-Rivera","year":"2024"},{"key":"ref81","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1007\/3-540-47987-2_47","article-title":"Exploring various guidance mechanisms to support interaction with inspectable learner models","volume":"2363","author":"Zapata-Rivera","year":"2002","journal-title":"Proceed. Intell. Tutoring Syst. ITS"},{"key":"ref82","author":"Zapata-Rivera","year":"2020"},{"key":"ref83","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3639372","article-title":"Explainability for large language models: a survey","volume":"15","author":"Zhao","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref84","doi-asserted-by":"publisher","first-page":"02726","DOI":"10.48550\/arXiv.2403.02726","article-title":"Bias in generative AI","volume":"2403","author":"Zhou","year":"2024","journal-title":"arXiv preprint arXiv"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1460651\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T05:10:55Z","timestamp":1728277855000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1460651\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,7]]},"references-count":86,"alternative-id":["10.3389\/frai.2024.1460651"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1460651","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,7]]},"article-number":"1460651"}}