{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T03:20:49Z","timestamp":1768447249542,"version":"3.49.0"},"reference-count":78,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T00:00:00Z","timestamp":1761091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Background and objectives: Evaluating Large Language Models (LLMs) presents two interrelated challenges: the general problem of assessing model performance across diverse tasks and the specific problem of using LLMs themselves as evaluators in pedagogical and educational contexts. Existing approaches often rely on single metrics or opaque preference-based methods, which fail to capture critical dimensions such as explanation quality, robustness, and argumentative diversity\u2014attributes essential in instructional settings. This paper introduces PEARL, a novel framework conceived, operationalized, and evaluated in the present work using LLM-based scorers, designed to provide interpretable, reproducible, and pedagogically meaningful assessments across multiple performance dimensions. Methods: PEARL integrates three specialized rubrics\u2014Technical, Argumentative, And Explanation-focused\u2014covering aspects such as factual accuracy, clarity, completeness, originality, dialecticality, and explanatory usefulness. The framework defines seven complementary metrics: Rubric Win Count (RWC), Global Win Rate (GWR), Rubric Mean Advantage (RMA), Consistency Spread (CS), Win Confidence Score (WCS), Explanation Quality Index (EQI), and Dialectical Presence Rate (DPR). We evaluated PEARL by evaluating eight open-weight instruction-tuned LLMs across 51 prompts, with outputs scored independently by GPT-4 and LLaMA 3:instruct. This constitutes LLM-based evaluation, and observed alignment with the GPT-4 proxy is mixed across metrics. Results: Preference-based metrics (RMA, RWC, and GWR) show evidence of group separation, reported with bootstrap confidence intervals and interpreted as exploratory due to small samples, while robustness-oriented (CS and WCS) and reasoning-diversity (DPR) metrics capture complementary aspects of performance not reflected in global win rate. RMA and RWC exhibit statistically significant, FDR-controlled correlations with the GPT-4 proxy, and correlation mapping highlights the complementary and partially orthogonal nature of PEARL\u2019s evaluation dimensions. Originality: PEARL is the first LLM evaluation framework to combine multi-rubric scoring, explanation-aware metrics, robustness analysis, and multi-LLM-evaluator analysis into a single, extensible system. Its multidimensional design supports both high-level benchmarking and targeted diagnostic assessment, offering a rigorous, transparent, and versatile methodology for researchers, developers, and educators working with LLMs in high-stakes and instructional contexts.<\/jats:p>","DOI":"10.3390\/info16110926","type":"journal-article","created":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T05:20:44Z","timestamp":1761196844000},"page":"926","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["PEARL: A Rubric-Driven Multi-Metric Framework for LLM Evaluation"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1849-3072","authenticated-orcid":false,"given":"Catalin","family":"Anghel","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Technology, \u201cDun\u0103rea de Jos\u201d University of Galati, \u0218tiin\u021bei St. 2, 800146 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2537-6713","authenticated-orcid":false,"given":"Andreea Alexandra","family":"Anghel","sequence":"additional","affiliation":[{"name":"Computer Science and Information Technology Program, Faculty of \u201cAutomation, Computer Science, Electrical and Electronic Engineering\u201d, \u201cDun\u0103rea de Jos\u201d University of Galati, 800008 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1155-5274","authenticated-orcid":false,"given":"Emilia","family":"Pecheanu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, \u201cDun\u0103rea de Jos\u201d University of Galati, \u0218tiin\u021bei St. 2, 800146 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9970-2556","authenticated-orcid":false,"given":"Marian Viorel","family":"Craciun","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, \u201cDun\u0103rea de Jos\u201d University of Galati, \u0218tiin\u021bei St. 2, 800146 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0935-4713","authenticated-orcid":false,"given":"Adina","family":"Cocu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, \u201cDun\u0103rea de Jos\u201d University of Galati, \u0218tiin\u021bei St. 2, 800146 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1461-4115","authenticated-orcid":false,"given":"Cristian","family":"Niculita","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, \u201cDun\u0103rea de Jos\u201d University of Galati, \u0218tiin\u021bei St. 2, 800146 Galati, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,22]]},"reference":[{"key":"ref_1","unstructured":"OpenAI GPT-4 Technical Report. Available online: https:\/\/cdn.openai.com\/papers\/gpt-4.pdf."},{"key":"ref_2","unstructured":"Meta The Llama 4 Herd: The Beginning of a New Era of Natively Multimodal AI Innovation. Available online: https:\/\/ai.meta.com\/blog\/llama-4-multimodal-intelligence."},{"key":"ref_3","unstructured":"Mistral.ai Announcing Mistral 7B: A High-Performance Open-Weight Language Model. Available online: https:\/\/mistral.ai\/news\/announcing-mistral-7b."},{"key":"ref_4","unstructured":"Mistral.ai Mixtral of Experts 8x22B. Available online: https:\/\/mistral.ai\/news\/mixtral-8x22b."},{"key":"ref_5","unstructured":"Anthropic Claude 3 Model Family. Available online: https:\/\/www.anthropic.com\/news\/claude-3-family."},{"key":"ref_6","unstructured":"Team, G., and Kavukcuoglu, K. Gemini 2.5: Our Most Intelligent AI Model. Available online: https:\/\/blog.google\/technology\/google-deepmind\/gemini-model-thinking-updates-march-2025."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Iacobescu, P., Marina, V., Anghel, C., and Anghele, A.-D. (2024). Evaluating Binary Classifiers for Cardiovascular Disease Prediction: Enhancing Early Diagnostic Capabilities. J. Cardiovasc. Dev. Dis., 11.","DOI":"10.3390\/jcdd11120396"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Susnea, I., Pecheanu, E., Cocu, A., Istrate, A., Anghel, C., and Iacobescu, P. (2025). Non-Intrusive Monitoring and Detection of Mobility Loss in Older Adults Using Binary Sensors. Sensors, 25.","DOI":"10.20944\/preprints202503.1358.v1"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Anghele, A.-D., Marina, V., Dragomir, L., Moscu, C.A., Anghele, M., and Anghel, C. (2024). Predicting Deep Venous Thrombosis Using Artificial Intelligence: A Clinical Data Approach. Bioengineering, 11.","DOI":"10.3390\/bioengineering11111067"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xu, F., Song, Y., Iyyer, M., and Choi, E. (2023, January 9\u201314). A Critical Evaluation of Evaluations for Long-form Question Answering. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.acl-long.181"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hashemi, H., Eisner, J., Rosset, C., Van Durme, B., and Kedzie, C. (2024, January 11\u201316). LLM-RUBRIC: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.745"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1038\/s44401-024-00011-2","article-title":"Current and future state of evaluation of large language models for clinical summarization tasks","volume":"2","author":"Brimhall","year":"2025","journal-title":"npj Health Syst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Joshi, B., He, K., Ramnath, S., Sabouri, S., Zhou, K., Chattopadhyay, S., Swayamdipta, S., and Ren, X. (2025). ELI-Why: Evaluating the Pedagogical Utility of Language Model Explanations. arXiv.","DOI":"10.18653\/v1\/2025.findings-acl.1306"},{"key":"ref_14","first-page":"20","article-title":"Explainability for Large Language Models: A Survey","volume":"56","author":"Zhao","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhou, J., Gandomi, A.H., Chen, F., and Holzinger, A. (2021). Evaluating the Quality of Machine Learning Explanations: A Survey on Methods and Metrics. Electronics, 10.","DOI":"10.3390\/electronics10050593"},{"key":"ref_16","unstructured":"Gupta, R. (2024, January 23\u201327). Evaluating LLMs: Beyond Simple Metrics. Proceedings of the INLG Workshop & ACL, Tokyo, Japan. Available online: https:\/\/medium.com\/@ritesh.gupta.ai\/evaluating-llms-beyond-simple-metrics-1e6babbed195."},{"key":"ref_17","unstructured":"Toloka.ai LLM Evaluation Framework: Principles, Practices, and Tools. Available online: https:\/\/toloka.ai\/blog\/llm-evaluation-framework-principles-practices-and-tools."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lopes, P., Silva, E., Braga, C., Oliveira, T., and Rosado, L. (2022). XAI Systems Evaluation: A Review of Human and Computer-Centred Methods. Appl. Sci., 12.","DOI":"10.3390\/app12199423"},{"key":"ref_19","first-page":"295","article-title":"From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI","volume":"55","author":"Meike","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_20","unstructured":"Stephen, C., Xander, D., Claudia, S., Thomas Krendl, G., and J\u00e9r\u00e9my, S. (2023). Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback. arXiv."},{"key":"ref_21","unstructured":"Kishore, P., Salim, R., Todd, W., and Wei-Jing, Z. (2002, January 6\u201312). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, PA, USA."},{"key":"ref_22","unstructured":"Chin-Yew, L. (2004). ROUGE: A Package for Automatic Evaluation of Summaries. Text Summarization Branches Out, Association for Computational Linguistics. Available online: https:\/\/aclanthology.org\/W04-1013."},{"key":"ref_23","unstructured":"Banerjee, S., and Lavie, A. (2005, January 29). METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and\/or Summarization, Ann Arbor, MI, USA. Available online: https:\/\/aclanthology.org\/W05-0909."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Blagec, K., Dorffner, G., Moradi, M., Ott, S., and Samwald, M. (2022, January 26). A global analysis of metrics used for measuring performance in natural language processing. Proceedings of the NLP Power! The First Workshop on Efficient Benchmarking in NLP, Dublin, Ireland. Available online: https:\/\/aclanthology.org\/2022.nlppower-1.6\/.","DOI":"10.18653\/v1\/2022.nlppower-1.6"},{"key":"ref_25","unstructured":"Shypula, A., Li, S., Zhang, B., Padmakumar, V., Yin, K., and Bastani, O. (2025). Evaluating the Diversity and Quality of LLM Generated Content. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zeng, X., Liu, Y., Meng, F., and Zhou, J. (2024, January 16). Towards Multiple References Era\u2014Addressing Data Leakage and Limited Reference Diversity in NLG Evaluation. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2024, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.findings-acl.710"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sulem, E., Abend, O., and Rappoport, A. (November, January 31). BLEU is Not Suitable for the Evaluation of Sentence Splitting in Text Simplification. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) 2018, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1081"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Freitag, M., Grangier, D., and Caswell, I. (2020, January 16\u201320). BLEU might be Guilty but References are not Innocent. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online (Virtual).","DOI":"10.18653\/v1\/2020.emnlp-main.5"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"L\u00e4ubli, S., Sennrich, R., and Volk, M. (November, January 31). Has Machine Translation Achieved Human Parity? A Case for Document-Level Evaluation. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1512"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wiseman, S., Shieber, S., and Rush, A. (2017, January 9\u201311). Challenges in Data-to-Document Generation. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1239"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1162\/coli_a_00322","article-title":"A Structured Review of the Validity of BLEU in Evaluating NLG","volume":"44","author":"Reiter","year":"2018","journal-title":"Comput. Linguist."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Aggarwal, D., Sil, P., Raman, B., and Bhattacharyya, P. (2025, January 22\u201326). \u201cI Understand Why I Got This Grade\u201d: Automatic Short Answer Grading (ASAG) with Feedback. Proceedings of the Artificial Intelligence in Education (AIED 2025), Palermo, Italy.","DOI":"10.1007\/978-3-031-98420-4_22"},{"key":"ref_33","unstructured":"Su, Y., and Xu, J. (2022). An Empirical Study on Contrastive Search and Contrastive Decoding for Open-ended Text Generation. arXiv."},{"key":"ref_34","unstructured":"Zheng, L., Chiang, W.L., Sheng, Y., and Zhang, H. Chatbot Arena Leaderboard Week 8: Introducing MT-Bench and Vicuna-33B. Available online: https:\/\/lmsys.org\/blog\/2023-06-22-leaderboard."},{"key":"ref_35","unstructured":"Wikipedia LMArena. Available online: https:\/\/en.wikipedia.org\/wiki\/LMArena."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liusie, A., Manakul, P., and Gales, M.J.F. (2024, January 16). LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (EACL), St. Julians, Malta.","DOI":"10.18653\/v1\/2024.eacl-long.8"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, Z., Wang, C., Ma, P., Wu, D., Wang, S., Gao, C., and Liu, Y. (2024, January 12\u201316). Split and Merge: Aligning Position Biases in LLM-based Evaluators. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), Miami, FL, USA.","DOI":"10.18653\/v1\/2024.emnlp-main.621"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Gao, M., Liu, Y., Hu, X., Wan, X., Bragg, J., and Cohan, A. (May, January 29). Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference. Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, NM, USA.","DOI":"10.18653\/v1\/2025.findings-naacl.260"},{"key":"ref_39","unstructured":"Hu, Z., Song, L., Zhang, J., Xiao, Z., Wang, T., Chen, Z., Yuan, N.J., Lian, J., Ding, K., and Xiong, H. (2024). Explaining Length Bias in LLM-based Preference Evaluations. arXiv."},{"key":"ref_40","unstructured":"Shi, L., Ma, C., Liang, W., Ma, W., and Vosoughi, S. (2024). Judging the Judges: A Systematic Investigation of Position Bias in Pairwise Comparative Assessments by LLMs. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI","volume":"58","author":"Bennetot","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Emirtekin, E. (2025). Large Language Model-Powered Automated Assessment: A Systematic Review. Appl. Sci., 15.","DOI":"10.3390\/app15105683"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kim, S., and Oh, D. (2025). Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. Appl. Sci., 15.","DOI":"10.3390\/app15062971"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Cisneros-Gonz\u00e1lez, J., Gordo-Herrera, N., Barcia-Santos, I., and S\u00e1nchez-Soriano, J. (2025). JorGPT: Instructor-Aided Grading of Programming Assignments with Large Language Models (LLMs). Future Internet, 17.","DOI":"10.3390\/fi17060265"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Fan, Z., Wang, W., W, X., and Zhang, D. (2024, January 12\u201316). SedarEval: Automated Evaluation using Self-Adaptive Rubrics. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.findings-emnlp.984"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kasai, J., Sakaguchi, K., Dunagan, L., Morrison, J., Le Bras, R., Choi, Y., and Smith, N.A. (2022, January 10\u201315). Transparent Human Evaluation for Image Captioning. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Seattle, WA, USA.","DOI":"10.18653\/v1\/2022.naacl-main.254"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1007\/s40593-024-00440-y","article-title":"Revealing Rubric Relations: Investigating the Interdependence of a Research Informed and a Machine Learning Based Rubric in Assessing Student Reasoning in Chemistry","volume":"35","author":"Martin","year":"2024","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sieker, J., Junker, S., Utescher, R., Attari, N., Wersing, H., Buschmeier, H., and Zarrie\u00df, S. (2024, January 12\u201316). The Illusion of Competence: Evaluating the Effect of Explanations on Users\u2019 Mental Models of Visual Question Answering Systems. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), Miami, FL, USA.","DOI":"10.18653\/v1\/2024.emnlp-main.1084"},{"key":"ref_49","unstructured":"Chaudhary, M., Gupta, H., Bhat, S., and Varma, V. (2024). Towards Understanding the Robustness of LLM-based Evaluations under Perturbations. arXiv."},{"key":"ref_50","first-page":"3686","article-title":"Towards Explainable Evaluation Metrics for Machine Translation","volume":"25","author":"Leiter","year":"2024","journal-title":"J. Mach. Learn. Res."},{"key":"ref_51","unstructured":"Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E.H., Le, Q.V., and Zhou, D. (December, January 28). Chain-of-thought prompting elicits reasoning in large language models. Proceedings of the 36th International Conference on Neural Information Processing Systems (NIPS\u201922), New Orleans, LA, USA."},{"key":"ref_52","unstructured":"Ziegler, D.M., Stiennon, N., Wu, J., Brown, T.B., Radford, A., Amodei, D., Christiano, P., and Irving, G. (2019). Fine Tuning Language Models from Human Preferences. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhu, K., Wang, J., Zhou, J., Wang, Z., Chen, H., Wang, Y., Yang, L., Ye, W., Gong, N.Z., and Zhang, Y. (2023). PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts. arXiv.","DOI":"10.1145\/3689217.3690621"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Li, Z., Peng, B., He, P., and Yan, X. (2024, January 12\u201316). Evaluating the Instruction Following Robustness of Large Language Models to Prompt Injection. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), Miami, FL, USA.","DOI":"10.18653\/v1\/2024.emnlp-main.33"},{"key":"ref_55","unstructured":"Turner, E., Soligo, A., Taylor, M., Rajamanoharan, S., and Nanda, N. (2025). Model Organisms for Emergent Misalignment. arXiv."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Moradi, M., and Samwald, M. (2021, January 7\u201311). Evaluating the Robustness of Neural Language Models to Input Perturbations. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021, Long Papers), Online and Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.117"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yang, J., Chen, D., Sun, Y., Li, R., Feng, Z., and Peng, W. (2024, January 11\u201316). Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability Oriented Approach. Proceedings of the Findings of the Association for Computational Linguistics (ACL 2024), Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.findings-acl.199"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Elangovan, A., Liu, L., Xu, L., Bodapati, S.B., and Roth, D. (2024, January 11\u201316). ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand. Available online: https:\/\/aclanthology.org\/2024.acl-long.63\/.","DOI":"10.18653\/v1\/2024.acl-long.63"},{"key":"ref_59","unstructured":"Ferdaus, M.M., Abdelguerfi, M., Ioup, E., Niles, K., Pathak, K., and Sloan, S. (2024). Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models. arXiv."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"e56764","DOI":"10.2196\/56764","article-title":"Large Language Models and User Trust: Consequence of Self-Referential Learning Loop and the Deskilling of Health Care Professionals","volume":"26","author":"Choudhury","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"e56306","DOI":"10.2196\/56306","article-title":"Finding Consensus on Trust in AI in Health Care: Recommendations From a Panel of International Experts","volume":"27","author":"Starke","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Zhen, H., Shi, Y., Huang, Y., Yang, J.J., and Liu, N. (2024). Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inference. Computers, 13.","DOI":"10.3390\/computers13090232"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/s10648-023-09823-4","article-title":"Effects of Rubrics on Academic Performance, Self-Regulated Learning, and self-Efficacy: A Meta-analytic Review","volume":"35","author":"Panadero","year":"2023","journal-title":"Educ. Psychol. Rev."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Anghel, C., Anghel, A.A., Pecheanu, E., Susnea, I., Cocu, A., and Istrate, A. (2025). Multi-Model Dialectical Evaluation of LLM Reasoning Chains: A Structured Framework with Dual Scoring Agents. Informatics, 12.","DOI":"10.3390\/informatics12030076"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Anghel, C., Anghel, A.A., Pecheanu, E., Cocu, A., and Istrate, A. (2025). Diagnosing Bias and Instability in LLM Evaluation: A Scalable Pairwise Meta-Evaluator. Information, 16.","DOI":"10.3390\/info16080652"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Melo, E., Silva, I., Costa, D.G., Viegas, C.M.D., and Barros, T.M. (2022). On the Use of eXplainable Artificial Intelligence to Evaluate School Dropout. Educ. Sci., 12.","DOI":"10.3390\/educsci12120845"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"D\u00edaz, G.M. (2025). Supporting Reflective AI Use in Education: A Fuzzy-Explainable Model for Identifying Cognitive Risk Profiles. Educ. Sci., 15.","DOI":"10.3390\/educsci15070923"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Pan, Y., and Nehm, R.H. (2025). Large Language Model and Traditional Machine Learning Scoring of Evolutionary Explanations: Benefits and Drawbacks. Educ. Sci., 15.","DOI":"10.3390\/educsci15060676"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Dipper, L., Marshall, J., Boyle, M., Hersh, D., Botting, N., and Cruice, M. (2021). Creating a Theoretical Framework to Underpin Discourse Assessment and Intervention in Aphasia. Brain Sci., 11.","DOI":"10.3390\/brainsci11020183"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Huang, J., Wu, X., Wen, J., Huang, C., Luo, M., Liu, L., and Zheng, Y. (2023). Evaluating Familiarity Ratings of Domain Concepts with Interpretable Machine Learning: A Comparative Study. Appl. Sci., 13.","DOI":"10.3390\/app132312818"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Prentzas, J., and Binopoulou, A. (2025). Explainable Artificial Intelligence Approaches in Primary Education: A Review. Electronics, 14.","DOI":"10.3390\/electronics14112279"},{"key":"ref_72","unstructured":"Fernandes, P., Treviso, M.V., Pruthi, D., Martins, A.F.T., and Neubig, G. (December, January 28). Learning to Scaffold: Optimizing Model Explanations for Teaching. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS) 2022, New Orleans, LA, USA. Available online: https:\/\/papers.neurips.cc\/paper_files\/paper\/2022\/file\/ea64883d500d31738cd39eb49a748fa4-Paper-Conference.pdf."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"2049","DOI":"10.3390\/make6030101","article-title":"A Novel Integration of Data-Driven Rule Generation and Computational Argumentation for Enhanced Explainable AI","volume":"6","author":"Rizzo","year":"2024","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Maine, F. (2025). Building the Foundations of Dialogic Pedagogy with Five- and Six-Year-Olds. Educ. Sci., 15.","DOI":"10.3390\/educsci15020251"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Leidinger, A., van Rooij, R., and Shutova, E. (2023). The language of prompting: What linguistic properties make a prompt successful?. arXiv.","DOI":"10.18653\/v1\/2023.findings-emnlp.618"},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Gozzi, M., and Di Maio, F. (2024). Comparative Analysis of Prompt Strategies for Large Language Models: Single-Task vs. Multitask Prompts. Electronics, 13.","DOI":"10.20944\/preprints202410.1334.v1"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Hackl, V., Krainz, A., and Bock, A. (2023). Is GPT-4 a Reliable Rater? Evaluating Consistency in GPT-4\u2019s Text Ratings. Front. Educ., 8.","DOI":"10.3389\/feduc.2023.1272229"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"010126","DOI":"10.1103\/PhysRevPhysEducRes.21.010126","article-title":"Grading Explanations of Problem-Solving Process and Generating Feedback Using Large Language Models at Human-Level Accuracy","volume":"21","author":"Chen","year":"2025","journal-title":"Phys. Rev. Phys. Educ. Res."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/11\/926\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T05:44:54Z","timestamp":1761198294000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/11\/926"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,22]]},"references-count":78,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["info16110926"],"URL":"https:\/\/doi.org\/10.3390\/info16110926","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,22]]}}}