{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T18:03:44Z","timestamp":1778695424051,"version":"3.51.4"},"reference-count":50,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This study proposes an indicator system for evaluating AI-assisted learning in higher education, combining evidence-based indicator development with expert-validated weighting. First, we review recent studies to extract candidate indicators and organize them into coherent dimensions. Next, a Delphi session with domain experts refines the second-order indicators and produces a measurable, non-redundant, implementation-ready index system. To capture interdependencies among indicators, we apply a hybrid Decision-Making Trial and Evaluation Laboratory\u2013Analytic Network Process (DEMATEL\u2013ANP, DANP) approach to derive global indicator weights. The framework is empirically illustrated through a course-level application to examine its decision usefulness, interpretability, and face validity based on expert evaluations and structured feedback from academic staff. The results indicate that pedagogical content quality, adaptivity (especially difficulty adjustment), formative feedback quality, and learner engagement act as key drivers in the evaluation network, while ethics-related indicators operate primarily as enabling constraints. The proposed framework provides a transparent and scalable tool for quality assurance in AI-assisted higher education, supporting instructional design, accreditation reporting, and continuous improvement.<\/jats:p>","DOI":"10.3390\/computers15020079","type":"journal-article","created":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T10:48:01Z","timestamp":1770115681000},"page":"79","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A DEMATEL\u2013ANP-Based Evaluation of AI-Assisted Learning in Higher Education"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7504-8576","authenticated-orcid":false,"given":"Galina","family":"Ilieva","sequence":"first","affiliation":[{"name":"Department of Management and Quantitative Methods in Economics, University of Plovdiv Paisii Hilendarski, 4000 Plovdiv, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5877-3098","authenticated-orcid":false,"given":"Tania","family":"Yankova","sequence":"additional","affiliation":[{"name":"Department of Management and Quantitative Methods in Economics, University of Plovdiv Paisii Hilendarski, 4000 Plovdiv, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8683-051X","authenticated-orcid":false,"given":"Margarita","family":"Ruseva","sequence":"additional","affiliation":[{"name":"Department of Management and Quantitative Methods in Economics, University of Plovdiv Paisii Hilendarski, 4000 Plovdiv, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1703-412X","authenticated-orcid":false,"given":"Stanislava","family":"Klisarova-Belcheva","sequence":"additional","affiliation":[{"name":"Department of Management and Quantitative Methods in Economics, University of Plovdiv Paisii Hilendarski, 4000 Plovdiv, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Alotaibi, N.S. (2024). The Impact of AI and LMS Integration on the Future of Higher Education: Opportunities, Challenges, and Strategies for Transformation. Sustainability, 16.","DOI":"10.3390\/su162310357"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s41239-023-00392-8","article-title":"Artificial Intelligence in Higher Education: The State of the Field","volume":"20","author":"Crompton","year":"2023","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Batista, J., Mesquita, A., and Carnaz, G. (2024). Generative AI and Higher Education: Trends, Challenges, and Future Directions from a Systematic Literature Review. Information, 15.","DOI":"10.20944\/preprints202409.1496.v1"},{"key":"ref_4","first-page":"1346","article-title":"Integrating AI Chatbot into Learning Management System: Enhancing Student Engagement and Learning Outcomes","volume":"5","author":"Saifullah","year":"2024","journal-title":"Dharmas Educ. J."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jdidou, Y., and Aammou, S. (2024, January 1\u20133). Transforming Education with AI: The Role of Recommendation Systems in Personalized Learning. Proceedings of the EDULEARN24: International Conference on Education and New Learning Technologies, Palma de Mallorca, Spain.","DOI":"10.21125\/edulearn.2024.1801"},{"key":"ref_6","first-page":"32","article-title":"How AI Makes Its Mark on Instructional Design","volume":"18","author":"Chng","year":"2023","journal-title":"Asian J. Distance Educ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Ortiz, M.\u00c1., Santana-Mancilla, P.C., and Anido-Rif\u00f3n, L.E. (2025). Machine Learning and Generative AI in Learning Analytics for Higher Education: A Systematic Review of Models, Trends, and Challenges. Appl. Sci., 15.","DOI":"10.3390\/app15158679"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1080\/02602938.2023.2183487","article-title":"Towards a Framework for Designing and Evaluating Online Assessments in Business Education","volume":"49","author":"Huber","year":"2024","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_9","unstructured":"UNESCO (2025, December 09). Guidance for Generative AI in Education and Research. Available online: https:\/\/www.unesco.org\/en\/articles\/guidance-generative-ai-education-and-research."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"186","DOI":"10.70088\/cfsps136","article-title":"Navigating International Challenges of Quality Assurance in Higher Education: A Synergy of Gen-AI and Human-Made Solutions","volume":"3","author":"Li","year":"2025","journal-title":"GBP Proc. Ser."},{"key":"ref_11","first-page":"33","article-title":"Effectiveness of AI-Powered Tutoring Systems in Enhancing Learning Outcomes","volume":"110","author":"Basri","year":"2024","journal-title":"Eurasian J. Educ. Res."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ju\u00e1rez Santiago, B., Olivares Ram\u00edrez, J.M., Rodr\u00edguez-Res\u00e9ndiz, J., Dector, A., Garc\u00eda Garc\u00eda, R., Gonz\u00e1lez-Dur\u00e1n, J.E.E., and Ferriol S\u00e1nchez, F. (2020). Learning Management System-Based Evaluation to Determine Academic Efficiency Performance. Sustainability, 12.","DOI":"10.3390\/su12104256"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e32220","DOI":"10.1016\/j.heliyon.2024.e32220","article-title":"Investigating Influencing Factors of Learning Satisfaction in AI ChatGPT for Research: University Students Perspective","volume":"10","author":"Almulla","year":"2024","journal-title":"Heliyon"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kakhkharova, M., and Tuychieva, S. (2024, January 18\u201319). AI-Enhanced Pedagogy in Higher Education: Redefining Teaching-Learning Paradigms. Proceedings of the 2024 International Conference on Knowledge Engineering and Communication Systems (ICKECS), Chikkaballapur, India.","DOI":"10.1109\/ICKECS61492.2024.10616893"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/ace.70012","article-title":"Ethical Frameworks of Artificial Intelligence for Faculty: Upholding Academic Integrity and Authenticity","volume":"188","author":"McGinty","year":"2025","journal-title":"New Dir. Adult Contin. Educ."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, Z., Dhruv, A., and Jain, V. (2024, January 5\u20137). Ethical Considerations in the Use of AI for Higher Education: A Comprehensive Guide. Proceedings of the 2024 IEEE 18th International Conference on Semantic Computing (ICSC), Laguna Hills, CA, USA.","DOI":"10.1109\/ICSC59802.2024.00041"},{"key":"ref_17","unstructured":"Gabus, A., and Fontela, E. (1972). World Problems, an Invitation to Further Thought Within the Framework of DEMATEL, Battelle Geneva Research Center."},{"key":"ref_18","unstructured":"Saaty, T.L. (1996). Decision Making with Dependence and Feedback: The Analytic Network Process, RWS Publications."},{"key":"ref_19","unstructured":"(2024). The ELEVATE-AI LLMs Framework: An Evaluation Framework for Use of Large Language Models in HEOR: An ISPOR Working Group Report. arXiv, Available online: https:\/\/arxiv.org\/pdf\/2501.12394v1."},{"key":"ref_20","unstructured":"Kirkpatrick, D.L. (1994). Evaluating Training Programs: The Four Levels, Berrett-Koehler Publishers."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1111\/j.1365-2729.2011.00440.x","article-title":"Quality in E-Learning: A Framework for Promoting and Assuring Quality in Virtual Institutions","volume":"28","author":"Masoumi","year":"2012","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"68","DOI":"10.14742\/ajet.7910","article-title":"Assuring the Quality of Online Learning in Higher Education","volume":"38","author":"Konstantinidou","year":"2022","journal-title":"Australas. J. Educ. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1007\/s13384-024-00772-7","article-title":"Agile Backward Design: A Framework for Planning Higher Education Curriculum","volume":"52","author":"Dazeley","year":"2025","journal-title":"Aust. Educ. Res."},{"key":"ref_24","unstructured":"Wiggins, G., and McTighe, J. (2005). Understanding by Design, ASCD. [Expanded 2nd ed.]. Available online: https:\/\/andymatuschak.org\/files\/papers\/Wiggins,%20McTighe%20-%202005%20-%20Understanding%20by%20design.pdf."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1177\/2042753020927201","article-title":"A Multimodal Assessment Framework for Higher Education","volume":"17","author":"Ross","year":"2020","journal-title":"e-Learn. Digit. Media"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.iheduc.2012.09.003","article-title":"A Framework for Institutional Adoption and Implementation of Blended Learning in Higher Education","volume":"18","author":"Graham","year":"2013","journal-title":"Internet High. Educ."},{"key":"ref_27","unstructured":"Council of Europe (2025, December 09). Artificial Intelligence and Education: Regulating the Use of AI Systems in Education. Available online: https:\/\/rm.coe.int\/prems-019925-gbr-2511-artificial-intelligence-and-education-a4-web-bat\/1680b6c970."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tyler, R.W. (2013). Basic Principles of Curriculum and Instruction, University of Chicago Press.","DOI":"10.7208\/chicago\/9780226086644.001.0001"},{"key":"ref_29","first-page":"11","article-title":"The Interservice Procedures for Instructional Systems Development","volume":"18","author":"Branson","year":"1978","journal-title":"Educ. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Phillips, J.J. (2012). Return on Investment in Training and Performance Improvement Programs, Routledge.","DOI":"10.4324\/9780080516257"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"100093","DOI":"10.1016\/j.caeo.2022.100093","article-title":"A Scoping Review of the Application of the SAMR Model in Research","volume":"3","author":"Blundell","year":"2022","journal-title":"Comput. Educ. Open"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107468","DOI":"10.1016\/j.chb.2022.107468","article-title":"Towards Intelligent-TPACK: An Empirical Study on Teachers\u2019 Professional Knowledge to Ethically Integrate AI-Based Tools into Education","volume":"138","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Al-Abdullatif, A.M. (2024). Modeling Teachers\u2019 Acceptance of Generative Artificial Intelligence Use in Higher Education: The Role of AI Literacy, Intelligent TPACK, and Perceived Trust. Educ. Sci., 14.","DOI":"10.3390\/educsci14111209"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"124167","DOI":"10.1016\/j.eswa.2024.124167","article-title":"Artificial Intelligence in Education: A Systematic Literature Review","volume":"252","author":"Wang","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, Q., Lv, C., Lu, L., and Tu, S. (2025). Evaluating the Quality of AI-Generated Digital Educational Resources for University Teaching and Learning. Systems, 13.","DOI":"10.3390\/systems13030174"},{"key":"ref_36","unstructured":"Myrick, J. (2025, January 10\u201312). Integrating AI into Course Quality Assurance Processes. Proceedings of the 8th International Academic Conference on Education, Teaching and Learning (IACETL), Helsinki, Finland. Available online: https:\/\/www.dpublication.com\/wp-content\/uploads\/2025\/06\/19-4196.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Logan-Fleming, D., Thakkar, M., Martinez Pacheco, S., Jones, H., and Parrish, D. (December, January 30). Assurance of Learning in the Age of AI: A Sector Scan and Future-Focused Call to Action. Proceedings of the ASCILITE 2025 Conference Proceedings, Adelaide, Australia.","DOI":"10.65106\/apubs.2025.2645"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"185","DOI":"10.31181\/dma31202569","article-title":"A comprehensive review of MCDM methods, applications, and emerging trends","volume":"3","author":"Kumar","year":"2025","journal-title":"Decis. Mak. Adv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yu, H., and Guo, Y. (2023). Generative Artificial Intelligence Empowers Educational Reform: Current Status, Issues, and Prospects. Front. Educ., 8.","DOI":"10.3389\/feduc.2023.1183162"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"17458","DOI":"10.1038\/s41598-025-97652-6","article-title":"AI Tutoring Outperforms In-Class Active Learning: An RCT Introducing a Novel Research-Based Design in an Authentic Educational Setting","volume":"15","author":"Kestin","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-L\u00f3pez, I.M., and Trujillo-Li\u00f1\u00e1n, L. (2025). Generative Artificial Intelligence in Education: Ethical Challenges, Regulatory Frameworks and Educational Quality in a Systematic Review of the Literature. Front. Educ., 10.","DOI":"10.3389\/feduc.2025.1565938"},{"key":"ref_42","unstructured":"Verhoeven, B., and Hor, T. (2025, December 25). A Framework for Human-Centric AI-First Teaching. AACSB Insights. Available online: https:\/\/www.aacsb.edu\/insights\/articles\/2025\/02\/a-framework-for-human-centric-ai-first-teaching."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Schleiss, J., Laupichler, M.C., Raupach, T., and Stober, S. (2023). AI Course Design Planning Framework: Developing Domain-Specific AI Education Courses. Educ. Sci., 13.","DOI":"10.3390\/educsci13090954"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4607","DOI":"10.1007\/s10639-024-12963-x","article-title":"Development and Validation of the Perceived Interactivity of Learner\u2013AI Interaction Scale","volume":"30","author":"Wang","year":"2025","journal-title":"Educ. Inf. Technol."},{"key":"ref_45","first-page":"101335","article-title":"A Systematic Review of AI-Powered Collaborative Learning in Higher Education: Trends and Outcomes from the Last Decade","volume":"11","author":"Kovari","year":"2025","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sajja, R., Sermet, Y., Cikmaz, M., Cwiertny, D., and Demir, I. (2024). Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education. Information, 15.","DOI":"10.3390\/info15100596"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1080\/15391523.2024.2304066","article-title":"Using AI-Empowered Assessments and Personalized Recommendations to Promote Online Collaborative Learning Performance","volume":"57","author":"Zheng","year":"2025","journal-title":"J. Res. Technol. Educ."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"11385","DOI":"10.1007\/s10639-023-12292-5","article-title":"An AI-Enabled Feedback\u2013Feedforward Approach to Promoting Online Collaborative Learning","volume":"29","author":"Zheng","year":"2024","journal-title":"Educ. Inf. Technol."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Karoglou, M., Ghergulescu, I., Stramarkou, M., Boukouvalas, C., and Krokida, M. (2025). Building an Adaptive AI-Powered Higher Education Class for the Future of Engineering: A Case Study from NTUA. Appl. Sci., 15.","DOI":"10.3390\/app15158524"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e32628","DOI":"10.1016\/j.heliyon.2024.e32628","article-title":"Integrating Deep Learning Techniques for Personalized Learning Pathways in Higher Education","volume":"10","author":"Naseer","year":"2024","journal-title":"Heliyon"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/15\/2\/79\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T05:11:54Z","timestamp":1770181914000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/15\/2\/79"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,1]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["computers15020079"],"URL":"https:\/\/doi.org\/10.3390\/computers15020079","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,1]]}}}