{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T02:02:01Z","timestamp":1776391321071,"version":"3.51.2"},"reference-count":92,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T00:00:00Z","timestamp":1773014400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T00:00:00Z","timestamp":1773014400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100023674","name":"Deanship of Scientific Research, King Khalid University","doi-asserted-by":"publisher","award":["RGP2\/412\/46"],"award-info":[{"award-number":["RGP2\/412\/46"]}],"id":[{"id":"10.13039\/501100023674","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Assisted Learning"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>In recent decades, emerging technologies\u2014particularly Artificial Intelligence (AI)\u2014have had a profound impact on the structure and decision\u2010making processes within educational systems. AI\u2010based tools now play a central role in data analysis, performance prediction, and personalised learning design.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>This study aimed to design and validate the Metacognitive Diagnostic Disruption in AI Decision\u2010Making Scale (MDD\u2010AI Scale) for educational administrators, focusing on metacognitive disruptions\u2014disturbances in self\u2010monitoring and self\u2010regulation processes caused by AI involvement in decision\u2010making.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using an exploratory mixed\u2010methods design, the study combined a literature review and interviews with 20 Jordanian educational administrators to develop 52 items from an initial 92. Data from 670 administrators were analysed for validity and reliability, with exploratory graph analysis (EGA) providing a network\u2010based perspective.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results and Conclusions<\/jats:title>\n                    <jats:p>\n                      Exploratory Factor Analysis (EFA) revealed a six\u2010factor structure\u2014Metacognitive Self\u2010Monitoring Disruption, Metacognitive Self\u2010Evaluation Disruption, Cognitive Flexibility Reduction, Cognitive Overreliance on AI, Conflict Detection Shutdown, and Disruption of Metacognitive Decision Planning\u2014explaining 67.6% of the variance. Confirmatory Factor Analysis (CFA) showed good fit (RMSEA\u2009=\u20090.072, CFI\u2009=\u20090.918), with AVE values &gt;\u20090.50 confirming convergent validity. Reliability was high across all indices (\n                      <jats:italic>\u03b1<\/jats:italic>\n                      \u2009=\u20090.904\u20130.951;\n                      <jats:italic>\u03c9<\/jats:italic>\n                      \u2009=\u20090.897\u20130.952; CR &gt;\u20090.89; ICC\u2009=\u20090.752\u20130.870). Measurement invariance across gender indicated structural equivalence. Exploratory Graph Analysis (EGA) and Random Forest Modeling (RFM) further supported robustness and predictive utility. Overall, the 42\u2010item MDD\u2010AI Scale is a valid, reliable, and innovative tool for assessing metacognitive disruptions in algorithmic decision\u2010making within educational management.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/jcal.70216","type":"journal-article","created":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T23:50:23Z","timestamp":1773100223000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Design and Validation of the Metacognitive Diagnostic Disruption in\n                    <scp>AI<\/scp>\n                    Decision\u2010Making Scale (\n                    <scp>MDD<\/scp>\n                    \u2010\n                    <scp>AI<\/scp>\n                    Scale) Among Educational Administrators in Jordan: Insights From the Network Analysis Perspective"],"prefix":"10.1002","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7253-412X","authenticated-orcid":false,"given":"Yusra jadallah abed","family":"Khasawneh","sequence":"first","affiliation":[{"name":"Faculty of Educational Sciences, Department of Educational Administration Ajloun National University  Ajloun Jordan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4967-3399","authenticated-orcid":false,"given":"Najwa Ahmed Saleem","family":"Khasawneh","sequence":"additional","affiliation":[{"name":"Faculty of Educational Sciences, Classroom Teacher Department, Specialization in Arabic Language Curricula and Teaching Methods Irbid National University  Irbid Jordan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1390-3765","authenticated-orcid":false,"given":"Mohamad Ahmad Saleem","family":"Khasawneh","sequence":"additional","affiliation":[{"name":"Special Education Department King Khalid University  Abha Saudi Arabia"}]}],"member":"311","published-online":{"date-parts":[[2026,3,9]]},"reference":[{"key":"e_1_2_18_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/08911762.2025.2463897"},{"key":"e_1_2_18_3_1","doi-asserted-by":"publisher","DOI":"10.1093\/jopart\/muac007"},{"key":"e_1_2_18_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/jopart\/muac007"},{"issue":"4","key":"e_1_2_18_5_1","first-page":"79","article-title":"The Effect of Human Resources Planning and Training and Development on Organizational Performance in the Government Sector in Jordan","volume":"4","author":"Al\u2010Qudah M. K. M.","year":"2014","journal-title":"International Journal of Academic Research in Business and Social Science"},{"issue":"28","key":"e_1_2_18_6_1","first-page":"15","article-title":"Metacognitive Skills Scale","volume":"28","author":"Alt\u0131nda\u011f M.","year":"2013","journal-title":"Hacettepe \u00dcniversitesi E\u011fitim Fak\u00fcltesi Dergisi"},{"key":"e_1_2_18_7_1","volume-title":"User Centered System Design: New Perspectives on Human\u2010Computer Interaction","author":"Anderson N. S.","year":"1988"},{"key":"e_1_2_18_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01663995"},{"key":"e_1_2_18_9_1","volume-title":"The Shallows: What the Internet Is Doing to Our Brains","author":"Barlow J.","year":"2010"},{"key":"e_1_2_18_10_1","unstructured":"Beach P. T. R.Anderson J. N.Jacovidis andK. L.Chadwick.2020.\u201cMaking the Abstract Explicit: The Role of Metacognition in Teaching and Learning.\u201dInflexion Policity Paper: Metacognition in Education 8\u201327."},{"key":"e_1_2_18_11_1","doi-asserted-by":"crossref","unstructured":"Binns R. M.Van Kleek M.Veale U.Lyngs J.Zhao andN.Shadbolt.2018.\u201c\u2018It's Reducing a Human Being to a Percentage\u2019 Perceptions of Justice in Algorithmic Decisions.\u201dProceedings of the 2018 Chi conference on human factors in computing systems.","DOI":"10.31235\/osf.io\/9wqxr"},{"key":"e_1_2_18_12_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2018.00149"},{"key":"e_1_2_18_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.3.624"},{"key":"e_1_2_18_14_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_18_15_1","unstructured":"Burns M.2023.\u201cTechnology in Education.\u201dPaper commissioned."},{"key":"e_1_2_18_16_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15328007SEM0902_5"},{"key":"e_1_2_18_17_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781529682663.n6"},{"key":"e_1_2_18_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13384\u2010024\u201000771\u20108"},{"key":"e_1_2_18_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjop.12046"},{"key":"e_1_2_18_20_1","doi-asserted-by":"publisher","DOI":"10.1027\/1016-9040.13.4.277"},{"key":"e_1_2_18_21_1","doi-asserted-by":"publisher","DOI":"10.4236\/ajibm.2023.131001"},{"key":"e_1_2_18_22_1","volume-title":"Exploratory Factor Analysis","author":"Fabrigar L. R.","year":"2012"},{"key":"e_1_2_18_23_1","unstructured":"Fernandes D. S.Villa S.Nicholls et\u00a0al.2024.\u201cPerformance and Metacognition Disconnect When Reasoning in Human\u2010AI Interaction.\u201darXiv preprint arXiv:2409.16708."},{"key":"e_1_2_18_24_1","volume-title":"Discovering Statistics Using IBM SPSS Statistics","author":"Field A.","year":"2024"},{"key":"e_1_2_18_25_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.34.10.906"},{"key":"e_1_2_18_26_1","doi-asserted-by":"publisher","DOI":"10.1177\/002224378101800104"},{"key":"e_1_2_18_27_1","first-page":"1","article-title":"Importance of Human Judgment in AI (Artificial Intelligence) Technology","volume":"9","author":"Foysal S.","year":"2023","journal-title":"Quest Journals Journal of Electronics and Communication Engineering Research"},{"key":"e_1_2_18_28_1","doi-asserted-by":"publisher","DOI":"10.2307\/3236261"},{"key":"e_1_2_18_29_1","unstructured":"Gadiraju U.2023.\u201cMaking the Right Decisions: AI Advice Decision Aids and the Promise of LLMs.\u201d"},{"key":"e_1_2_18_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/soc15010006"},{"key":"e_1_2_18_31_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000089"},{"key":"e_1_2_18_32_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0174035"},{"key":"e_1_2_18_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nedt.2003.10.001"},{"key":"e_1_2_18_34_1","doi-asserted-by":"crossref","unstructured":"Green B. andY.Chen.2019.\u201cThe Principles and Limits of Algorithm\u2010In\u2010The\u2010Loop Decision Making.\u201dProceedings of the ACM on human\u2010computer interaction 3(CSCW). 1\u201324.","DOI":"10.1145\/3359152"},{"key":"e_1_2_18_35_1","doi-asserted-by":"publisher","DOI":"10.3102\/003465430303953"},{"key":"e_1_2_18_36_1","volume-title":"Multivariate Data Analysis","author":"Hair J. F.","year":"2010"},{"key":"e_1_2_18_37_1","doi-asserted-by":"crossref","unstructured":"He G. L.Kuiper andU.Gadiraju.2023.\u201cKnowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems.\u201dProceedings of the 2023 CHI Conference on Human Factors in Computing Systems.","DOI":"10.1145\/3544548.3581025"},{"key":"e_1_2_18_38_1","volume-title":"Artificial Intelligence in Education Promises and Implications for Teaching and Learning","author":"Holmes W.","year":"2019"},{"key":"e_1_2_18_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/10705519909540118"},{"key":"e_1_2_18_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-020-09920-z"},{"key":"e_1_2_18_41_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2025.1550621"},{"key":"e_1_2_18_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02291575"},{"key":"e_1_2_18_43_1","volume-title":"Principles and Practice of Structural Equation Modeling","author":"Kline R. B.","year":"2023"},{"key":"e_1_2_18_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_2_18_45_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781315106304-7"},{"key":"e_1_2_18_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2023.100338"},{"key":"e_1_2_18_47_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1975.tb01393.x"},{"key":"e_1_2_18_48_1","volume-title":"Measurement in Nursing and Health Research","author":"Lenz E. R.","year":"2010"},{"key":"e_1_2_18_49_1","doi-asserted-by":"publisher","DOI":"10.70594\/brain\/16.S1\/21"},{"key":"e_1_2_18_50_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2024.1382693"},{"key":"e_1_2_18_51_1","unstructured":"Lim C.2025.\u201cDeBiasMe: De\u2010Biasing Human\u2010AI Interactions With Metacognitive AIED (AI in Education) Interventions.\u201darXiv preprint arXiv:2504.16770."},{"issue":"3","key":"e_1_2_18_52_1","first-page":"801","article-title":"Self\u2010Efficacy: The Exercise of Control","volume":"50","author":"Locke E. A.","year":"1997","journal-title":"Personnel Psychology"},{"key":"e_1_2_18_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2018.12.005"},{"key":"e_1_2_18_54_1","doi-asserted-by":"crossref","unstructured":"Long D. andB.Magerko.2020.\u201cWhat Is AI Literacy? Competencies and Design Considerations.\u201dProceedings of the 2020 CHI Conference on Human Factors in Computing Systems.","DOI":"10.1145\/3313831.3376727"},{"key":"e_1_2_18_55_1","doi-asserted-by":"publisher","DOI":"10.1093\/jcr\/ucz013"},{"key":"e_1_2_18_56_1","volume-title":"Intelligence Unleashed: An Argument for AI in Education","author":"Luckin R.","year":"2016"},{"key":"e_1_2_18_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2008.05.005"},{"key":"e_1_2_18_58_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocw105"},{"key":"e_1_2_18_59_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012\u2010017\u20100705\u20106"},{"key":"e_1_2_18_60_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012\u2010022\u201001222\u20107"},{"key":"e_1_2_18_61_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.4.1.84"},{"key":"e_1_2_18_62_1","doi-asserted-by":"crossref","unstructured":"Mango E. J.Koshal andC.Ouma.2019.\u201cMetacognitive Ability Effect on Leadership Development.\u201d","DOI":"10.33019\/ijbe.v3i3.232"},{"key":"e_1_2_18_63_1","doi-asserted-by":"crossref","unstructured":"Meske C. andE.\u00dcnal.2024.\u201cInvestigating the Impact of Control in AI\u2010Assisted Decision\u2010Making\u2010An Experimental Study.\u201dIn Proceedings of Mensch und Computer 2024. 419\u2013423.","DOI":"10.1145\/3670653.3677476"},{"key":"e_1_2_18_64_1","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1999.0734"},{"key":"e_1_2_18_65_1","first-page":"125","volume-title":"Psychology of Learning and Motivation","author":"Nelson T. O.","year":"1990"},{"key":"e_1_2_18_66_1","volume-title":"Psychometric Theory","author":"Nunnally J.","year":"1994"},{"key":"e_1_2_18_67_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_1"},{"key":"e_1_2_18_68_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720810376055"},{"key":"e_1_2_18_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423\u2010024\u201010439\u2010w"},{"key":"e_1_2_18_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apnr.2018.01.006"},{"key":"e_1_2_18_71_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781315814919"},{"key":"e_1_2_18_72_1","volume-title":"Nursing Research: Generating and Assessing Evidence for Nursing Practice","author":"Polit D. F.","year":"2008"},{"key":"e_1_2_18_73_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1138-y"},{"key":"e_1_2_18_74_1","doi-asserted-by":"crossref","unstructured":"Rastogi C. Y.Zhang D.Wei K. R.Varshney A.Dhurandhar andR.Tomsett.2022.\u201cDeciding Fast and Slow: The Role of Cognitive Biases in Ai\u2010Assisted Decision\u2010Making.\u201dProceedings of the ACM on Human\u2010Computer Interaction. 6(CSCW1) 1\u201322.","DOI":"10.1145\/3512930"},{"key":"e_1_2_18_75_1","doi-asserted-by":"publisher","DOI":"10.1080\/15700763.2024.2409307"},{"key":"e_1_2_18_76_1","unstructured":"Rismanchian S. andS.Doroudi.2024.\u201cReconciling Different Theories of Learning With an Agent\u2010Based Model of Procedural Learning.\u201darXiv Preprint arXiv:2408.13364."},{"key":"e_1_2_18_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-05542-8_15-2"},{"key":"e_1_2_18_78_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1994.1033"},{"key":"e_1_2_18_79_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02212307"},{"key":"e_1_2_18_80_1","volume-title":"Should Robots Replace Teachers?: AI and the Future of Education","author":"Selwyn N.","year":"2019"},{"key":"e_1_2_18_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102551"},{"key":"e_1_2_18_82_1","volume-title":"10th Annual Conference Cognitive Science Society Pod","author":"Spiro R. J.","year":"2019"},{"key":"e_1_2_18_83_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41239-025-00517-1"},{"key":"e_1_2_18_84_1","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmz026"},{"key":"e_1_2_18_85_1","volume-title":"Using Multivariate Statistics","author":"Tabachnick B. G.","year":"2013"},{"issue":"2","key":"e_1_2_18_86_1","first-page":"70","article-title":"The Development of the Metacognitive Thinking Skills Scale","volume":"3","author":"Tuncer M.","year":"2013","journal-title":"Development"},{"key":"e_1_2_18_87_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8721.2006.00443.x"},{"key":"e_1_2_18_88_1","doi-asserted-by":"publisher","DOI":"10.3138\/cjpe.26.010"},{"key":"e_1_2_18_89_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-7967(03)00147-5"},{"key":"e_1_2_18_90_1","doi-asserted-by":"publisher","DOI":"10.1080\/17439884.2020.1798995"},{"key":"e_1_2_18_91_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.2118"},{"key":"e_1_2_18_92_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41239-019-0171-0"},{"key":"e_1_2_18_93_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15430421tip4102_2"}],"container-title":["Journal of Computer Assisted Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jcal.70216","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/jcal.70216","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jcal.70216","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T01:36:13Z","timestamp":1776389773000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/jcal.70216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,9]]},"references-count":92,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["10.1002\/jcal.70216"],"URL":"https:\/\/doi.org\/10.1002\/jcal.70216","archive":["Portico"],"relation":{},"ISSN":["0266-4909","1365-2729"],"issn-type":[{"value":"0266-4909","type":"print"},{"value":"1365-2729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,9]]},"assertion":[{"value":"2025-05-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70216"}}