{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T15:01:50Z","timestamp":1782313310523,"version":"3.54.5"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute of Education Sciences, U.S. Department of Education","award":["R305T240035"],"award-info":[{"award-number":["R305T240035"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Large language models (LLMs) are increasingly being utilized to develop tools and services in various domains, including education. However, due to the nature of the training data, these models are susceptible to inherent social or cognitive biases, which can influence their outputs. Furthermore, their handling of critical topics, such as privacy and sensitive questions, is essential for responsible deployment. This study proposes a framework for the automatic detection of biases and violations of responsible use using a synthetic question-based dataset mimicking student\u2013chatbot interactions. We employ the LLM-as-a-judge method to evaluate multiple LLMs for biased responses. Our findings show that some models exhibit more bias than others, highlighting the need for careful consideration when selecting models for deployment in educational and other high-stakes applications. These results emphasize the importance of addressing bias in LLMs and implementing robust mechanisms to uphold responsible AI use in real-world services.<\/jats:p>","DOI":"10.3390\/computers14030100","type":"journal-article","created":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T04:55:44Z","timestamp":1741755344000},"page":"100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Multifaceted Assessment of Responsible Use and Bias in Language Models for Education"],"prefix":"10.3390","volume":"14","author":[{"given":"Ishrat","family":"Ahmed","sequence":"first","affiliation":[{"name":"Learning Engineering Institute, Arizona State University, Tempe, AZ 85281, USA"},{"name":"Enterprise Technology-AI Acceleration, Arizona State University, Tempe, AZ 85281, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenxing","family":"Liu","sequence":"additional","affiliation":[{"name":"Enterprise Technology-AI Acceleration, Arizona State University, Tempe, AZ 85281, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8327-4012","authenticated-orcid":false,"given":"Rod D.","family":"Roscoe","sequence":"additional","affiliation":[{"name":"Learning Engineering Institute, Arizona State University, Tempe, AZ 85281, USA"},{"name":"Human Systems Engineering, Arizona State University, Tempe, AZ 85281, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5621-6341","authenticated-orcid":false,"given":"Elizabeth","family":"Reilley","sequence":"additional","affiliation":[{"name":"Enterprise Technology-AI Acceleration, Arizona State University, Tempe, AZ 85281, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5869-1420","authenticated-orcid":false,"given":"Danielle S.","family":"McNamara","sequence":"additional","affiliation":[{"name":"Learning Engineering Institute, Arizona State University, Tempe, AZ 85281, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ilieva, G., Yankova, T., Klisarova-Belcheva, S., Dimitrov, A., Bratkov, M., and Angelov, D. (2023). Effects of generative chatbots in higher education. Information, 14.","DOI":"10.3390\/info14090492"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1186\/s41239-023-00426-1","article-title":"Role of AI chatbots in education: Systematic literature review","volume":"20","author":"Labadze","year":"2023","journal-title":"Int. J. Educ. Technol. High Educ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100033","DOI":"10.1016\/j.caeai.2021.100033","article-title":"Chatbots applications in education: A systematic review","volume":"2","author":"Okonkwo","year":"2021","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., and Drachsler, H. (2021). Are we there yet?\u2014A systematic literature review on chatbots in education. Front. Artif. Intell., 4.","DOI":"10.3389\/frai.2021.654924"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Odede, J., and Frommholz, I. (2024, January 10\u201314). JayBot\u2013Aiding University Students and Admission with an LLM-based Chatbot. Proceedings of the 2024 Conference on Human Information Interaction and Retrieval, Sheffield, UK.","DOI":"10.1145\/3627508.3638293"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"233285841774922","DOI":"10.1177\/2332858417749220","article-title":"How an artificially intelligent virtual assistant helps students navigate the road to college","volume":"3","author":"Page","year":"2017","journal-title":"Aera Open"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lieb, A., and Goel, T. (2024, January 11\u201316). Student Interaction with NewtBot: An LLM-as-tutor Chatbot for Secondary Physics Education. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613905.3647957"},{"key":"ref_8","first-page":"37","article-title":"Github copilot in the classroom: Learning to code with AI assistance","volume":"38","author":"Puryear","year":"2022","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_9","first-page":"193","article-title":"AI-based academic advising framework: A knowledge management perspective","volume":"13","author":"Bilquise","year":"2022","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_10","first-page":"74669","article-title":"CSM: A Chatbot Solution to Manage Student Questions About payments and Enrollment in University","volume":"12","year":"2024","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Owoseni, A., Kolade, O., and Egbetokun, A. (2024). Applications of Generative AI in Lesson Preparation and Content Development. Generative AI in Higher Education: Innovation Strategies for Teaching and Learning, Springer Nature.","DOI":"10.1007\/978-3-031-60179-8"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5334\/uproc.157","article-title":"Teaching with Generative AI: Moving forward with content creation","volume":"4","author":"Ullmann","year":"2024","journal-title":"Ubiquity Proc."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100151","DOI":"10.1016\/j.caeo.2023.100151","article-title":"Generative AI tools and assessment: Guidelines of the world\u2019s top-ranking universities","volume":"5","author":"Moorhouse","year":"2023","journal-title":"Comput. Educ. Open"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ruiz-Rojas, L.I., Acosta-Vargas, P., De-Moreta-Llovet, J., and Gonzalez-Rodriguez, M. (2023). Empowering education with generative artificial intelligence tools: Approach with an instructional design matrix. Sustainability, 15.","DOI":"10.3390\/su151511524"},{"key":"ref_15","unstructured":"OpenAI (2025, March 08). ChatGPT Models: GPT-3.5 and GPT-4. Available online: https:\/\/openai.com\/."},{"key":"ref_16","unstructured":"Anthropic (2025, March 08). Claude by Anthropic. Available online: https:\/\/www.anthropic.com\/."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kooli, C. (2023). Chatbots in education and research: A critical examination of ethical implications and solutions. Sustainability, 15.","DOI":"10.3390\/su15075614"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1080\/0960085X.2021.1927212","article-title":"Algorithmic bias: Review, synthesis, and future research directions","volume":"31","author":"Kordzadeh","year":"2022","journal-title":"Eur. J. Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1007\/s40593-021-00285-9","article-title":"Algorithmic bias in education","volume":"32","author":"Baker","year":"2022","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bird, K.A., Castleman, B.L., and Song, Y. (2024). Are algorithms biased in education? Exploring racial bias in predicting community college student success. J. Policy Anal. Manag.","DOI":"10.1002\/pam.22569"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Echterhoff, J., Liu, Y., Alessa, A., McAuley, J., and He, Z. (2024). Cognitive bias in high-stakes decision-making with llms. arXiv.","DOI":"10.18653\/v1\/2024.findings-emnlp.739"},{"key":"ref_22","unstructured":"Bommasani, R., Zhang, D., Lee, T., and Liang, P. (2023). Improving Transparency in AI Language Models: A Holistic Evaluation, HAI Policy & Society."},{"key":"ref_23","unstructured":"Jiao, J., Afroogh, S., Xu, Y., and Phillips, C. (2024). Navigating llm ethics: Advancements, challenges, and future directions. arXiv."},{"key":"ref_24","unstructured":"Liu, S., Shourie, V., and Ahmed, I. (2025, March 08). The Higher Education Language Model Multidimensional Multimodal Evaluation Framework. Available online: https:\/\/issuu.com\/asu_uto\/docs\/highered_language_model_evaluation_framework\/s\/56919235."},{"key":"ref_25","unstructured":"Arthur Team (2025, January 24). LLM-Guided Evaluation: Using LLMs to Evaluate LLMs. 29 September 2023. Available online: https:\/\/www.arthur.ai\/blog\/llm-guided-evaluation-using-llms-to-evaluate-llms."},{"key":"ref_26","unstructured":"Evidently AI (2025, January 24). LLM-as-a-Judge: A Complete Guide to Using LLMs for Evaluations. Available online: https:\/\/www.evidentlyai.com\/llm-guide\/llm-as-a-judge."},{"key":"ref_27","unstructured":"Shaikh, A., Dandekar, R.A., Panat, S., and Dandekar, R. (2024). CBEval: A framework for evaluating and interpreting cognitive biases in LLMs. arXiv."},{"key":"ref_28","unstructured":"Google (2025, March 08). Bison Model by Google Cloud AI. Available online: https:\/\/cloud.google.com\/ai-platform\/."},{"key":"ref_29","unstructured":"Cohere (2025, March 08). Command Light Model by Cohere. Available online: https:\/\/cohere.ai\/."},{"key":"ref_30","unstructured":"Verga, P., Hofstatter, S., Althammer, S., Su, Y., Piktus, A., Arkhangorodsky, A., Xu, M., White, N., and Lewis, P. (2024). Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models. arXiv."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/3\/100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:50:58Z","timestamp":1760028658000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/3\/100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,12]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["computers14030100"],"URL":"https:\/\/doi.org\/10.3390\/computers14030100","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,12]]}}}