{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T12:38:08Z","timestamp":1765888688812,"version":"3.41.2"},"reference-count":34,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T00:00:00Z","timestamp":1629763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>The implementation of cognitive diagnostic computerized adaptive testing often depends on a high-quality item bank. How to online estimate the item parameters and calibrate the <jats:bold>Q<\/jats:bold>-matrix required by items becomes an important problem in the construction of the high-quality item bank for personalized adaptive learning. The related previous research mainly focused on the calibration method with the random design in which the new items were randomly assigned to examinees. Although the way of randomly assigning new items can ensure the randomness of data sampling, some examinees cannot provide enough information about item parameter estimation or Q-matrix calibration for the new items. In order to increase design efficiency, we investigated three adaptive designs under different practical situations: (a) because the non-parametric classification method needs calibrated item attribute vectors, but not item parameters, the first study focused on an optimal design for the calibration of the Q-matrix of the new items based on Shannon entropy; (b) if the Q-matrix of the new items was specified by subject experts, an optimal design was designed for the estimation of item parameters based on Fisher information; and (c) if the Q-matrix and item parameters are unknown for the new items, we developed a hybrid optimal design for simultaneously estimating them. The simulation results showed that, the adaptive designs are better than the random design with a limited number of examinees in terms of the correct recovery rate of attribute vectors and the precision of item parameters.<\/jats:p>","DOI":"10.3389\/fpsyg.2021.710497","type":"journal-article","created":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T09:08:42Z","timestamp":1629796122000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["An Adaptive Design for Item Parameter Online Estimation and Q-Matrix Online Calibration in CD-CAT"],"prefix":"10.3389","volume":"12","author":[{"given":"Wenyi","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yukun","family":"Tu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lihong","family":"Song","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juanjuan","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Teng","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2021,8,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1177\/0146621618813113","article-title":"Nonparametric CAT for CD in educational settings with small samples","volume":"43","author":"Chang","year":"2018","journal-title":"Appl. Psychol. Meas."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1184","DOI":"10.3724\/SP.J.1041.2016.01184","article-title":"Two new online calibration methods for computerized adaptive testing","volume":"48","author":"Chen","year":"2016","journal-title":"Acta Psychol. Sin."},{"key":"B3","doi-asserted-by":"publisher","first-page":"836","DOI":"10.3724\/SP.J.1041.2011.00836","article-title":"Item replenishing in cognitive diagnostic computerized adaptive testing","volume":"43","author":"Chen","year":"2011","journal-title":"Acta Psychol. Sin."},{"key":"B4","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1007\/s11336-012-9255-7","article-title":"Online calibration methods for the DINA model with independent attributes in CD-CAT","volume":"77","author":"Chen","year":"2012","journal-title":"Psychometrika"},{"key":"B5","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1177\/0146621613513065","article-title":"Online item calibration for Q-matrix in CD-CAT","volume":"39","author":"Chen","year":"2015","journal-title":"Appl. Psychol. Meas."},{"key":"B6","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1007\/s11336-009-9123-2","article-title":"When cognitive diagnosis meets computerized adaptive testing: CD-CAT","volume":"74","author":"Cheng","year":"2009","journal-title":"Psychometrika"},{"key":"B7","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1007\/s00357-013-9132-9","article-title":"A nonparametric approach to cognitive diagnosis by proximity to ideal response patterns","volume":"30","author":"Chiu","year":"2013","journal-title":"J. Classif."},{"key":"B8","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1007\/s11336-017-9595-4","article-title":"Cognitive diagnosis for small educational programs: the general nonparametric classification method","volume":"83","author":"Chiu","year":"2018","journal-title":"Psychometrika"},{"key":"B9","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1007\/s11336-011-9207-7","article-title":"The generalized DINA model framework","volume":"76","author":"de la Torre","year":"2011","journal-title":"Psychometrika"},{"key":"B10","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1007\/s00357-019-09357-x","article-title":"Cognitive diagnostic computerized adaptive testing for polytomously scored items.","volume":"37","author":"Gao","year":"2020","journal-title":"J. Classif."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.3389\/fpsyg.2019.01122","article-title":"Termination rules for variable-length CD-CAT from the information theory perspective","volume":"10","author":"Guo","year":"2019","journal-title":"Front. Psychol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1007\/s11336-008-9089-5","article-title":"Defining a family of cognitive diagnosis models using log-linear models with latent variables","volume":"74","author":"Henson","year":"2009","journal-title":"Psychometrika"},{"key":"B13","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1111\/bmsp.12160","article-title":"Utilizing response times in cognitive diagnostic computerized adaptive testing under the higher order deterministic input, noisy 'and' gate model","volume":"73","author":"Huang","year":"2019","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"B14","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1177\/01466210122032064","article-title":"Cognitive assessment models with few assumptions, and connections with nonparametric item response theory","volume":"25","author":"Junker","year":"2001","journal-title":"Appl. Psychol. Meas."},{"key":"B15","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1177\/0146621614554650","article-title":"New item selection methods for cognitive diagnosis computerized adaptive testing","volume":"39","author":"Kaplan","year":"2015","journal-title":"Appl. Psychol. Meas."},{"key":"B16","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1111\/j.1745-3984.2004.tb01163.x","article-title":"The attribute hierarchy method for cognitive assessment: a variation on Tatsuoka's rule-space approach","volume":"41","author":"Leighton","year":"2004","journal-title":"J. Educ. Meas."},{"key":"B17","doi-asserted-by":"publisher","first-page":"441","DOI":"10.16357\/j.cnki.issn1000-5862.2020.05.01","article-title":"The cognitive diagnostic model which can deal with compensation and noncompensation effects: CDINA","volume":"44","author":"Luo","year":"2020","journal-title":"J. Jiangxi Normal Univers."},{"key":"B18","doi-asserted-by":"publisher","first-page":"99","DOI":"10.3102\/10769986002002099","article-title":"The use of probabilistic models in the assessment of mastery","volume":"2","author":"Macready","year":"1977","journal-title":"J. Educ. Stat."},{"key":"B19","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-69218-0","volume-title":"Computerized Adaptive and Multistage Testing With R: Using Packages catR and mstR","author":"Magis","year":"2017"},{"key":"B20","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/BF02294535","article-title":"Estimating multiple classification latent class models","volume":"64","author":"Maris","year":"1999","journal-title":"Psychometrika"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.21236\/ADA160277","article-title":"Covariate measurement error in logistic regression","volume":"13","author":"Stefanski","year":"1985","journal-title":"Ann. Stat."},{"key":"B22","doi-asserted-by":"publisher","first-page":"575141","DOI":"10.3389\/fpsyg.2020.575141","article-title":"The impact of item calibration error on variable-length cognitive diagnostic computerized adaptive testing","volume":"11","author":"Sun","year":"2020","journal-title":"Front. Psychol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1037\/1082-989X.11.3.287","article-title":"Measurement of psychological disorders using cognitive diagnosis models","volume":"11","author":"Templin","year":"2006","journal-title":"Psychol. Methods"},{"key":"B24","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1348\/000711007X193957","article-title":"A general diagnostic model applied to language testing data","volume":"61","author":"von Davier","year":"2008","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"B25","doi-asserted-by":"publisher","first-page":"i","DOI":"10.1002\/j.2333-8504.2005.tb01993.x","article-title":"A general diagnostic model applied to language testing data","volume":"2005","author":"von Davier","year":"2005","journal-title":"ETS Res. Rep. Ser."},{"key":"B26","first-page":"65","article-title":"Item response theory, item calibration, and proficiency estimation,","volume-title":"Computerized Adaptive Testing: A Primer","author":"Wainer","year":"1990"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1177\/0013164413498256","article-title":"Mutual information item selection method in cognitive diagnostic computerized adaptive testing with short test length","volume":"73","author":"Wang","year":"2013","journal-title":"Educ. Psychol. Meas."},{"key":"B28","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1111\/j.1745-3984.2011.00145.x","article-title":"Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing","volume":"48","author":"Wang","year":"2011","journal-title":"J. Educ. Meas."},{"key":"B29","doi-asserted-by":"publisher","first-page":"111","DOI":"10.16357\/j.cnki.issn1000-5862.2021.02.01","article-title":"The application of cognitive diagnostic computerized adaptive testing on diagnosis and assessment of psychological disorder","volume":"45","author":"Wang","year":"2021","journal-title":"J. Jiangxi Normal Univers."},{"key":"B30","doi-asserted-by":"publisher","first-page":"964","DOI":"10.3724\/SP.J.1041.2011.00964","article-title":"Attribute calibration of original que stions in computerized adaptive diagnostic test","volume":"43","author":"Wang","year":"2011","journal-title":"Acta Psychol. Sin."},{"key":"B31","doi-asserted-by":"publisher","first-page":"224","DOI":"10.3389\/fpsyg.2020.00224","article-title":"Attribute discrimination index-based method to balance attribute coverage for short-length cognitive diagnostic computerized adaptive testing","volume":"11","author":"Wang","year":"2020","journal-title":"Front. Psychol."},{"key":"B32","article-title":"A simulation study to compare CAT strategies for cognitive diagnosis,","volume-title":"Annual Meeting of the American Educational Research Association","author":"Xu","year":"2003"},{"key":"B33","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1177\/0146621619893783","article-title":"Stratified item selection methods in cognitive diagnosis computerized adaptive testing","volume":"44","author":"Yang","year":"2020","journal-title":"Appl. Psychol. Meas."},{"key":"B34","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1177\/0146621618798665","article-title":"Computerized adaptive testing for cognitively based multiple-choice data","volume":"43","author":"Yigit","year":"2019","journal-title":"Appl. Psychol. Meas."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.710497\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,24]],"date-time":"2021-08-24T09:08:49Z","timestamp":1629796129000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.710497\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,24]]},"references-count":34,"alternative-id":["10.3389\/fpsyg.2021.710497"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2021.710497","relation":{},"ISSN":["1664-1078"],"issn-type":[{"type":"electronic","value":"1664-1078"}],"subject":[],"published":{"date-parts":[[2021,8,24]]},"article-number":"710497"}}