{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T06:18:14Z","timestamp":1787811494785,"version":"build-2784847793"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T00:00:00Z","timestamp":1787788800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100014991","name":"Shanghai Office of Philosophy and Social Science","doi-asserted-by":"publisher","award":["2023EYY002"],"award-info":[{"award-number":["2023EYY002"]}],"id":[{"id":"10.13039\/501100014991","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Diagnostic assessment, which aims to identify the strengths and weaknesses of learners' cognitive abilities for targeted remediation, has gained momentum in recent years. This study applied a cognitive diagnostic approach to validate the UDig Reading Test, designed to diagnose the reading skills of tertiary-level English as a foreign language (EFL) learners in China.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using a mixed-methods design, test-takers' think-aloud protocols, expert judgments, and cognitive diagnostic modeling were integrated to examine the accuracy of the predefined item-subskill associations. Large-scale performance data from 642 test-takers were analyzed to estimate their reading subskill mastery patterns.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Results showed that the predefined item-subskill associations were generally supported by empirical evidence. In particular, search reading was empirically confirmed as a targeted subskill in the expeditious reading section, despite its absence from the initial test specifications. Subskill prevalence analysis identified the subskill of understanding the structure and cohesion of a passage as the most challenging one, providing evidence that may inform targeted instructional support.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>This study responds to persistent calls for research into truly diagnostic assessments rather than retrofitting existing tests and demonstrates the value of the cognitive diagnostic approach in enhancing the diagnostic precision of reading assessment. It also outlines a research agenda for developing cognitive diagnostic assessment from inception so as to fully realize its diagnostic potential.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpsyg.2026.1894358","type":"journal-article","created":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T05:34:17Z","timestamp":1787808857000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Beyond retrofitting: validating a purpose-built reading diagnostic assessment through a cognitive diagnostic approach"],"prefix":"10.3389","volume":"17","author":[{"given":"Hang","family":"Sun","sequence":"first","affiliation":[{"name":"College of Foreign Languages, University of Shanghai for Science and Technology","place":["Shanghai, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shengkai","family":"Yin","sequence":"additional","affiliation":[{"name":"Faculty of Education, Monash University, Clayton","place":["VIC, Australia"]},{"name":"Institute of Education, Arts and Community, Federation University Australia, Berwick","place":["VIC, Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,27]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical identification model","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Autom. Control"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511732935","author":"Alderson","year":"2000","journal-title":"Assessing Reading"},{"key":"B3","volume-title":"Diagnosing Foreign Language Proficiency: The Interface between Learning and Assessment","author":"Alderson","year":"2005"},{"key":"B4","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1093\/applin\/amt046","article-title":"Towards a theory of diagnosis in second and foreign language assessment: insights from professional practice across diverse fields","volume":"36","author":"Alderson","year":"2014","journal-title":"Appl. Ling."},{"key":"B5","volume-title":"The Diagnosis of Reading in a Second or Foreign Language","author":"Alderson","year":"2015"},{"key":"B6","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1177\/026553229801500201","article-title":"Application of the rule-space procedure to language testing: examining attributes of a free response listening test","volume":"15","author":"Buck","year":"1998","journal-title":"Lang. Testing"},{"key":"B7","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1080\/15434303.2022.2140050","article-title":"Investigating second language (L2) reading subskill associations: a cognitive diagnosis approach","volume":"20","author":"Chen","year":"2023","journal-title":"Lang. Assess. Q."},{"key":"B8","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1080\/15434303.2016.1210610","article-title":"Retrofitting non-cognitive-diagnostic reading assessment under the generalized DINA model framework","volume":"13","author":"Chen","year":"2016","journal-title":"Lang. Assess. Q."},{"key":"B9","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1111\/j.1745-3984.2012.00185.x","article-title":"Relative and absolute fit evaluation in cognitive diagnosis modeling","volume":"50","author":"Chen","year":"2013","journal-title":"J. Educ. Meas."},{"key":"B10","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1177\/0265532207083743","article-title":"The key to success: English language testing in China","volume":"25","author":"Cheng","year":"2008","journal-title":"Lang. Testing"},{"key":"B11","volume-title":"College English Curriculum Requirements","year":"2020"},{"key":"B12","doi-asserted-by":"crossref","DOI":"10.1002\/j.2333-8504.2006.tb02012.x","volume-title":"Strategies in Responding to the new TOEFL Reading Tasks","author":"Cohen","year":"2006"},{"key":"B13","volume-title":"Designing and Conducting Mixed Methods Research, 3rd edn","author":"Creswell","year":"2017"},{"key":"B14","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/s11336-011-9207-7","article-title":"The generalized DINA model framework","volume":"76","author":"de la Torre","year":"2011","journal-title":"Psychometrika"},{"key":"B15","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1007\/s11336-015-9467-8","article-title":"A general method of empirical Q-matrix validation","volume":"81","author":"de la Torre","year":"2016","journal-title":"Psychometrika"},{"key":"B16","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1007\/s11336-008-9063-2","article-title":"Model evaluation and multiple strategies in cognitive diagnosis: an analysis of fraction subtraction data","volume":"73","author":"de la Torre","year":"2008","journal-title":"Psychometrika"},{"key":"B17","author":"Doe","year":"2013","journal-title":"Validating the Canadian academic English language assessment for diagnostic purposes from three perspectives: scoring, teaching, and learning (thesis)"},{"key":"B18","first-page":"A1","article-title":"An investigation into post-entry English language assessment in Australian universities","volume":"3","author":"Dunworth","year":"2009","journal-title":"J. Acad. Lang. Learn."},{"key":"B19","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1111\/j.1745-3984.2001.tb01131.x","article-title":"Improving construct validity with cognitive psychology principles","volume":"38","author":"Embretson","year":"2001","journal-title":"J. Educ. Meas."},{"key":"B20","volume-title":"TOEFL 2000 Reading Framework: A Working Paper. (TOEFL Monograph Series. No. 17)","author":"Enright","year":"2000"},{"key":"B21","article-title":"\u201cAn integrative review of cognitively diagnostic psychometric models [Paper presentation],\u201d","author":"Fu","year":"2007","journal-title":"Annual Meeting of the National Council on Measurement in Education, Chicago, IL, United States"},{"key":"B22","first-page":"727","article-title":"Comparison of CDM and its selection: a saturated model, a simple model or a mixed model?","volume":"41","author":"Gao","year":"2018","journal-title":"J. Psychol. Sci."},{"key":"B23","first-page":"25","article-title":"\u201cUsing diagnostic information to adapt traditional textbook-based instruction,\u201d","volume-title":"Towards Adaptive CALL: Natural Language Processing for Diagnostic Language Assessment","author":"Jamieson","year":"2008"},{"key":"B24","author":"Jang","year":"2005","journal-title":"A validity narrative: effects of reading skills diagnosis on teaching and learning in the context of NG TOEFL (thesis)"},{"key":"B25","first-page":"117","article-title":"\u201cA framework for cognitive diagnostic assessment,\u201d","author":"Jang","year":"2008","journal-title":"Towards Adaptive CALL: Natural Language Processing for Diagnostic Language Assessment"},{"key":"B26","volume-title":"An applied linguistics model of Chinese undergraduates' EAP reading and its operationalizations in the advanced English reading test","author":"Jin","year":"1998"},{"key":"B27","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1177\/01466210122032064","article-title":"Cognitive assessment models with few assumptions, and connections with nonparametric item response theory","volume":"25","author":"Junker","year":"2001","journal-title":"Appl. Psychol. Meas."},{"key":"B28","volume-title":"Examining Reading: Research and Practice in Assessing Second Language Reading","author":"Khalifa","year":"2009"},{"key":"B29","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1177\/0265532214558457","article-title":"Exploring ways to provide diagnostic feedback with an ESL placement test: cognitive diagnostic assessment of L2 reading ability","volume":"32","author":"Kim","year":"2015","journal-title":"Lang. Testing"},{"key":"B30","volume-title":"An argument-based validity inquiry into the Empirically-Derived Descriptor-Based Diagnostic (EDD) assessment in ESL academic writing","author":"Kim","year":"2010"},{"key":"B31","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1177\/0265532214565387","article-title":"Diagnosing diagnostic language assessment","volume":"32","author":"Lee","year":"2015","journal-title":"Lang. Testing"},{"key":"B32","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1080\/15434300902985108","article-title":"Cognitive diagnosis approaches to language assessment: an overview","volume":"6","author":"Lee","year":"2009","journal-title":"Lang. Assess. Q."},{"key":"B33","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511611186","volume-title":"Cognitive Diagnostic Assessment for Education: Theory and Applications","author":"Leighton","year":"2007"},{"key":"B34","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1177\/0265532215590848","article-title":"The selection of cognitive diagnostic models for a reading comprehension test","volume":"33","author":"Li","year":"2016","journal-title":"Lang. Testing"},{"key":"B35","author":"Ma","year":"","journal-title":"GDINA: The Generalized DINA Model Framework [R Package Version 2.7.3]"},{"key":"B36","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1111\/bmsp.12156","article-title":"An empirical Q-matrix validation method for the sequential generalized DINA model","volume":"73","author":"Ma","year":"","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.stueduc.2019.100817","article-title":"Retrofitting the IELTS reading section with a general cognitive diagnostic model in an Iranian EAP context","volume":"64","author":"Mirzaei","year":"2020","journal-title":"Stud. Educ. Eval."},{"key":"B38","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1177\/0013164418822700","article-title":"Reconsidering cutoff points in the general method of empirical Q-Matrix validation","volume":"79","author":"N\u00e1jera","year":"2019","journal-title":"Educ. Psychol. Meas."},{"key":"B39","volume-title":"Silent Reading - An Introduction to Its Study and Teaching","author":"Pugh","year":"1978"},{"key":"B40","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1080\/09695940701272856","article-title":"Is testing an efficient agent for pedagogical change? Examining the intended washback of the writing task in a high-stakes English test in China","volume":"14","author":"Qi","year":"2007","journal-title":"Assess. Educ."},{"key":"B41","doi-asserted-by":"publisher","first-page":"782","DOI":"10.1177\/0734282915623053","article-title":"Application of a cognitive diagnostic model to a high-stakes reading comprehension test","volume":"34","author":"Ravand","year":"2016","journal-title":"J. Psychoeduc. Assess."},{"key":"B42","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1080\/08957347.2024.2424550","article-title":"Exploring interrelationships among L2 writing subskills: insights from cognitive diagnostic models","volume":"37","author":"Ravand","year":"2024","journal-title":"Appl. Meas. Educ."},{"key":"B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0261444813000190","article-title":"Issues in post-entry language assessment in English-medium universities","volume":"48","author":"Read","year":"2013","journal-title":"Lang. Teaching"},{"key":"B44","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1177\/0013164407301545","article-title":"The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model","volume":"68","author":"Rupp","year":"2008","journal-title":"Educ. Psychol. Meas."},{"key":"B45","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Ann. Stat."},{"key":"B46","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1111\/j.1540-4781.1992.tb05402.x","article-title":"Beyond proficiency testing: a diagnostic feedback assessment model for assessing foreign language learning","volume":"72","author":"Shohamy","year":"1992","journal-title":"Mod. Lang. J."},{"key":"B47","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1177\/0013164406292025","article-title":"Assessing fit of cognitive diagnostic models: a case study","volume":"67","author":"Sinharay","year":"2007","journal-title":"Educ. Psychol. Meas."},{"key":"B48","first-page":"29","article-title":"\u201cThe gentle art of diagnostic testing revisited,\u201d","volume-title":"Language Assessment for Feedback: Testing and Other Strategies","author":"Spolsky","year":"1992"},{"key":"B49","volume-title":"An argument-based approach to validating a diagnostic test: the case of UDig reading test (thesis)","author":"Sun","year":"2020"},{"key":"B50","first-page":"159","article-title":"\u201cHow Hong Kong students cope with assessment,\u201d","volume-title":"The Chinese Learner: Cultural, Psychological and Contextual Influences","author":"Tang","year":"1996"},{"key":"B51","doi-asserted-by":"publisher","first-page":"9","DOI":"10.4324\/9781351136501-3","article-title":"\u201cValidity aspects of score reporting,\u201d","author":"Tannenbaum","year":"2019","journal-title":"Score Reporting Research and Applications"},{"key":"B52","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1111\/j.1745-3984.1983.tb00212.x","article-title":"Rule space: an approach for dealing with misconceptions based on item response theory","volume":"20","author":"Tatsuoka","year":"1983","journal-title":"J. Educ. Meas."},{"key":"B53","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1037\/1082-989X.11.3.287","article-title":"Measurement of psychological disorders using cognitive diagnosis models","volume":"11","author":"Templin","year":"2006","journal-title":"Psychol. Methods"},{"key":"B54","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1177\/0265532220941470","article-title":"Examining the L2 reading comprehension ability of adult ELLs: developing a diagnostic test within the cognitive diagnostic assessment framework","volume":"38","author":"Toprak","year":"2021","journal-title":"Lang. Testing"},{"key":"B55","doi-asserted-by":"publisher","first-page":"243","DOI":"10.3724\/SP.J.1041.2013.00243","article-title":"Comparison and selection of five noncompensatory cognitive diagnosis models based on attribute hierarchy structure","volume":"45","author":"Tu","year":"2013","journal-title":"Acta Psychol. Sin."},{"key":"B56","first-page":"60","article-title":"Diagnostic assessment of Hong Kong tertiary students' English language proficiency: the development and validation of DELTA","volume":"14","author":"Urmston","year":"2013","journal-title":"Hong Kong J. Appl. Ling."},{"key":"B57","volume-title":"Reading in a Second Language: Process, Product, and Practice","author":"Urquhart","year":"1998"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1002\/j.2333-8504.2005.tb01993.x","article-title":"A general diagnostic model applied to language testing data","author":"von Davier","year":"2005","journal-title":"ETS Res. Rep. Ser."},{"key":"B59","first-page":"157","article-title":"The cognitive processes underlying the academic reading construct as measured by IELTS","volume":"9","author":"Weir","year":"2009","journal-title":"Br. Council\/IDP Australia IELTS Res. Rep."},{"key":"B60","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1177\/0265532216646141","article-title":"Probing the relative importance of different attributes in L2 reading and listening comprehension items: an application of cognitive diagnostic models","volume":"34","author":"Yi","year":"2016","journal-title":"Lang. Testing"},{"key":"B61","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1080\/15434303.2010.516043","article-title":"Scratching where they itch: evaluation of feedback on a diagnostic English grammar test for Taiwanese university students","volume":"9","author":"Yin","year":"2012","journal-title":"Lang. Assess. Q."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1894358\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T05:34:23Z","timestamp":1787808863000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1894358\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,27]]},"references-count":61,"alternative-id":["10.3389\/fpsyg.2026.1894358"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1894358","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,27]]},"article-number":"1894358"}}