{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T21:39:25Z","timestamp":1772314765769,"version":"3.50.1"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"14","license":[{"start":{"date-parts":[[2025,5,5]],"date-time":"2025-05-05T00:00:00Z","timestamp":1746403200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,5]],"date-time":"2025-05-05T00:00:00Z","timestamp":1746403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003500","name":"Universit\u00e0 degli Studi di Padova","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003500","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Competence-based test development (CbTD) is a novel method for constructing tests that are as informative as possible about the competence state (the set of skills an individual masters) underlying the item responses. If desired, the tests can also be minimal, meaning that no item can be eliminated without reducing their informativeness. To demonstrate the usefulness and usability of CbTD in practice, this work illustrates real-life applications to the construction of a test from scratch, and the improvement and shortening of existing tests. In particular, a test for the assessment of students\u2019 mathematical formulation is constructed from scratch and validated using empirical data collected from middle and high school students. A booklet of the TIMSS 2003 eighth grade mathematics test is improved by adding a minimal set of items appropriately selected from another booklet of the same test, and the resulting booklet is compared with the original one. Finally, a shortened form of a well-known fraction subtraction test is developed and compared to other forms of the same length. The findings suggest that CbTD can help to improve the development of tests by identifying specific items needed to assess particular competence states. It can also support assessment practice in at least two respects: by enabling an unambiguous and precise identification of individuals\u2019 competence states, which helps plan personalized interventions, and by allowing for assessments that are shorter but just as accurate as longer ones.<\/jats:p>","DOI":"10.1007\/s10639-025-13581-x","type":"journal-article","created":{"date-parts":[[2025,5,5]],"date-time":"2025-05-05T05:01:24Z","timestamp":1746421284000},"page":"20735-20766","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Real-life applications of competence-based test development to the construction, improvement, and shortening of tests"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2982-7178","authenticated-orcid":false,"given":"Pasquale","family":"Anselmi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00fcrgen","family":"Heller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca","family":"Stefanutti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Egidio","family":"Robusto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giulia","family":"Barillari","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,5]]},"reference":[{"key":"13581_CR1","doi-asserted-by":"publisher","first-page":"15","DOI":"10.4324\/9781410602077-9","volume-title":"Knowledge spaces: Theories, empirical research, and applications","author":"D Albert","year":"1999","unstructured":"Albert, D., & Held, T. (1999). Component-based knowledge spaces in problem solving and inductive reasoning. In D. Albert & J. Lukas (Eds.), Knowledge spaces: Theories, empirical research, and applications (pp. 15\u201340). Mahwah: Lawrence Erlbaum Associates."},{"key":"13581_CR2","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/978-1-4612-4308-3_9","volume-title":"Contributions to mathematical psychology, psychometrics and methodology","author":"D Albert","year":"1994","unstructured":"Albert, D., Schrepp, M., & Held, T. (1994). Construction of knowledge spaces for problem solving in chess. In G. Fischer & D. Laming (Eds.), Contributions to mathematical psychology, psychometrics and methodology (pp. 123\u2013135). New York: Springer-Verlag."},{"key":"13581_CR3","doi-asserted-by":"publisher","unstructured":"American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th edition, text revision ed.). Washington, DC: American Psychiatric Pub. https:\/\/doi.org\/10.1002\/9780470479216.corpsy0271","DOI":"10.1002\/9780470479216.corpsy0271"},{"key":"13581_CR4","doi-asserted-by":"publisher","unstructured":"American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: American Psychiatric Pub. https:\/\/doi.org\/10.1176\/appi.books.9780890425596","DOI":"10.1176\/appi.books.9780890425596"},{"key":"13581_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2021.102621","volume":"106","author":"P Anselmi","year":"2022","unstructured":"Anselmi, P., Heller, J., Stefanutti, L., & Robusto, E. (2022). Constructing, improving, and shortening tests for skill assessment. Journal of Mathematical Psychology, 106, Article 102621. https:\/\/doi.org\/10.1016\/j.jmp.2021.102621","journal-title":"Journal of Mathematical Psychology"},{"issue":"3","key":"13581_CR6","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1111\/bmsp.12335","volume":"77","author":"P Anselmi","year":"2024","unstructured":"Anselmi, P., Heller, J., Stefanutti, L., & Robusto, E. (2024). Constructing tests for skill assessment with competence-based test development. British Journal of Mathematical and Statistical Psychology, 77(3), 429\u2013458. https:\/\/doi.org\/10.1111\/bmsp.12335","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"issue":"4","key":"13581_CR7","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1007\/S11336-012-9286-0","volume":"77","author":"P Anselmi","year":"2012","unstructured":"Anselmi, P., Robusto, E., & Stefanutti, L. (2012). Uncovering the best skill multimap by constraining the error probabilities of the gain-loss model. Psychometrika, 77(4), 763\u2013781. https:\/\/doi.org\/10.1007\/S11336-012-9286-0","journal-title":"Psychometrika"},{"key":"13581_CR8","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.endm.2013.05.140","volume":"42","author":"P Anselmi","year":"2013","unstructured":"Anselmi, P., Robusto, E., & Stefanutti, L. (2013). A procedure for identifying the best skill multimap in the gain-loss model. Electronic Notes in Discrete Mathematics, 42, 9\u201316. https:\/\/doi.org\/10.1016\/j.endm.2013.05.140","journal-title":"Electronic Notes in Discrete Mathematics"},{"issue":"2","key":"13581_CR9","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/s11336-016-9498-9","volume":"81","author":"P Anselmi","year":"2016","unstructured":"Anselmi, P., Robusto, E., Stefanutti, L., & de Chiusole, D. (2016). An upgrading procedure for adaptive assessment of knowledge. Psychometrika, 81(2), 461\u2013482. https:\/\/doi.org\/10.1007\/s11336-016-9498-9","journal-title":"Psychometrika"},{"issue":"3","key":"13581_CR10","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1111\/bmsp.12095","volume":"70","author":"P Anselmi","year":"2017","unstructured":"Anselmi, P., Stefanutti, L., de Chiusole, D., & Robusto, E. (2017). The assessment of knowledge and learning in competence spaces: The gain-loss model for dependent skills. British Journal of Mathematical and Statistical Psychology, 70(3), 457\u2013479. https:\/\/doi.org\/10.1111\/bmsp.12095","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"issue":"10","key":"13581_CR11","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1111\/jir.13143","volume":"68","author":"A Bacherini","year":"2024","unstructured":"Bacherini, A., Anselmi, P., Havercamp, S., & Balboni, G. (2024). Psychometric properties of the Beliefs About Adults with ID Scale in American physicians: Application of classical test and Rasch measurement theories. Journal of Intellectual Disability Research, 68(10), 1129\u20131145. https:\/\/doi.org\/10.1111\/jir.13143","journal-title":"Journal of Intellectual Disability Research"},{"key":"13581_CR12","unstructured":"Barillari, G., & Anselmi, P. (2023). Mathematical formulation test. Retrieved from https:\/\/osf.io\/xf2uh\/?view_only=f71dfcc22b0740658bdfee5e41ec985f"},{"issue":"2","key":"13581_CR13","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1207\/s15327833mtl0602_6","volume":"6","author":"M T Battista","year":"2004","unstructured":"Battista, M. T. (2004). Applying cognition-based assessment to elementary school students\u2019 development of understanding of area and volume measurement. Mathematical Thinking and Learning, 6(2), 185\u2013204. https:\/\/doi.org\/10.1207\/s15327833mtl0602_6","journal-title":"Mathematical Thinking and Learning"},{"key":"13581_CR14","doi-asserted-by":"publisher","first-page":"149","DOI":"10.3389\/fpubh.2018.00149","volume":"6","author":"G O Boateng","year":"2018","unstructured":"Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Qui\u00f1onez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Frontiers in Public Health, 6, 149. https:\/\/doi.org\/10.3389\/fpubh.2018.00149","journal-title":"Frontiers in Public Health"},{"issue":"20","key":"13581_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40359-020-0386-9","volume":"8","author":"F Chiesi","year":"2020","unstructured":"Chiesi, F., Lau, C., & Saklofske, D. H. (2020). A revised short version of the compassionate love scale for humanity (CLS-H-SF): Evidence from item response theory analyses and validity testing. BMC Psychology, 8(20), 1\u20139. https:\/\/doi.org\/10.1186\/s40359-020-0386-9","journal-title":"BMC Psychology"},{"key":"13581_CR16","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1207\/s15327833mtl0602_1","volume":"6","author":"D H Clements","year":"2004","unstructured":"Clements, D. H., & Sarama, J. (2004). Learning trajectories in mathematics education. Mathematical Thinking and Learning, 6, 81\u201389.","journal-title":"Mathematical Thinking and Learning"},{"key":"13581_CR17","doi-asserted-by":"publisher","unstructured":"Colledani, D., Anselmi, P., & Robusto, E. (2018a). Using item response theory for the development of a new short form of the Eysenck Personality Questionnaire-Revised. Frontiers in Psychology, 9, Article 1834. https:\/\/doi.org\/10.3389\/fpsyg.2018.01834","DOI":"10.3389\/fpsyg.2018.01834"},{"key":"13581_CR18","doi-asserted-by":"publisher","unstructured":"Colledani, D., Robusto, E., & Anselmi, P. (2018b). Development of a new abbreviated form of the Junior Eysenck Personality Questionnaire-Revised. Personality and Individual Differences, 120, 159\u2013165. https:\/\/doi.org\/10.1016\/j.paid.2017.08.037","DOI":"10.1016\/j.paid.2017.08.037"},{"key":"13581_CR19","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/j.paid.2019.05.044","volume":"149","author":"D Colledani","year":"2019","unstructured":"Colledani, D., Anselmi, P., & Robusto, E. (2019a). Development of a new abbreviated form of the Eysenck Personality Questionnaire-Revised with multidimensional item response theory. Personality and Individual Differences, 149, 108\u2013117. https:\/\/doi.org\/10.1016\/j.paid.2019.05.044","journal-title":"Personality and Individual Differences"},{"key":"13581_CR20","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.paid.2019.01.032","volume":"142","author":"D Colledani","year":"2019","unstructured":"Colledani, D., Anselmi, P., & Robusto, E. (2019b). Using multidimensional item response theory to develop an abbreviated form of the Italian version of Eysenck\u2019s IVE questionnaire. Personality and Individual Differences, 142, 45\u201352. https:\/\/doi.org\/10.1016\/j.paid.2019.01.032","journal-title":"Personality and Individual Differences"},{"key":"13581_CR21","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/BF02295640","volume":"69","author":"J de la Torre","year":"2004","unstructured":"de la Torre, J., & Douglas, J. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333\u2013353. https:\/\/doi.org\/10.1007\/BF02295640","journal-title":"Psychometrika"},{"key":"13581_CR22","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1177\/0146621610377081","volume":"35","author":"L DeCarlo","year":"2011","unstructured":"DeCarlo, L. (2011). On the analysis of fraction subtraction data: The DINA model, classification, latent class sizes, and the Q-matrix. Applied Psychological Measurement, 35, 8\u201326. https:\/\/doi.org\/10.1177\/0146621610377081","journal-title":"Applied Psychological Measurement"},{"issue":"6","key":"13581_CR23","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1177\/0146621612449069","volume":"36","author":"L DeCarlo","year":"2012","unstructured":"DeCarlo, L. (2012). Recognizing uncertainty in the Q-matrix via a Bayesian extension of the DINA model. Applied Psychological Measurement, 36(6), 447\u2013468. https:\/\/doi.org\/10.1177\/0146621612449069","journal-title":"Applied Psychological Measurement"},{"key":"13581_CR24","doi-asserted-by":"publisher","unstructured":"de Chiusole, D., Spinoso, M., Anselmi, P., Bacherini, A., Balboni, G., Mazzoni, N., ... Pierluigi, I. (2024). PsycAssist: A web-based artificial intelligence system designed for adaptive neuropsychological assessment and training. Brain Sciences, 14(2), Article 122. https:\/\/doi.org\/10.3390\/brainsci14020122","DOI":"10.3390\/brainsci14020122"},{"key":"13581_CR25","doi-asserted-by":"publisher","unstructured":"de Chiusole, D., Stefanutti, L., Anselmi, P., & Robusto, E. (2018). Testing the actual equivalence of automatically generated items. Behavior Research Methods, 50, 39\u201356. https:\/\/doi.org\/10.3758\/s13428-017-1004-5","DOI":"10.3758\/s13428-017-1004-5"},{"key":"13581_CR26","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1007\/s40593-020-00223-1","volume":"30","author":"D de Chiusole","year":"2020","unstructured":"de Chiusole, D., Stefanutti, L., Anselmi, P., & Robusto, E. (2020). Stat-Knowlab. Assessment and learning of statistics with competence-based knowledge space theory. International Journal of Artificial Intelligence in Education, 30, 668\u2013700. https:\/\/doi.org\/10.1007\/s40593-020-00223-1","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"13581_CR27","doi-asserted-by":"crossref","unstructured":"DiBello, L.-V., Roussos, L.-A., & Stout, W. (2007). Review of cognitively diagnostic assessment and a summary of psychometric models. In C. Rao & S. Sinharay (Eds.), Handbook of Statistics, vol. 26 (pp. 970\u20131030). Amsterdam: North-Holland Publications.","DOI":"10.1016\/S0169-7161(06)26031-0"},{"key":"13581_CR28","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/978-1-4612-4308-3_8","volume-title":"Contributions to mathematical psychology, psychometrics and methodology","author":"J-P Doignon","year":"1994","unstructured":"Doignon, J.-P. (1994). Knowledge spaces and skill assignments. In G.-H. Fisher & D. Laming (Eds.), Contributions to mathematical psychology, psychometrics and methodology (pp. 111\u2013121). Berlin, Heidelberg, and New York: Springer-Verlag."},{"issue":"1","key":"13581_CR29","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1111\/j.2044-8317.1995.tb01047.x","volume":"48","author":"I D\u00fcntsch","year":"1995","unstructured":"D\u00fcntsch, I., & Gediga, G. (1995). Skills and knowledge structures. British Journal of Mathematical and Statistical Psychology, 48(1), 9\u201327. https:\/\/doi.org\/10.1111\/j.2044-8317.1995.tb01047.x","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"key":"13581_CR30","volume-title":"Item response theory for psychologists","author":"S E Embretson","year":"2020","unstructured":"Embretson, S. E., & Reise, S. P. (2020). Item response theory for psychologists. Lawrence Erlbaum Associates."},{"key":"13581_CR31","doi-asserted-by":"crossref","unstructured":"Falmagne, J.-C., Cosyn, E., Doignon, J.-P., & Thi\u00e9ry, N. (2006). The assessment of knowledge, in theory and in practice. In B. Ganter & L. Kwuida (Eds.), Formal Concept Analysis, 4th International Conference, ICFCA 2006, Dresden, Germany, february 13\u201317, 2006, Lecture Notes in Artificial Intelligence (pp. 61\u201379). Berlin, Heidelberg, and New York: Springer-Verlag.","DOI":"10.1007\/11671404_4"},{"issue":"1","key":"13581_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.2044-8317.1988.tb00884.x","volume":"41","author":"J-C Falmagne","year":"1988","unstructured":"Falmagne, J.-C., & Doignon, J.-P. (1988a). A class of stochastic procedures for the assessment of knowledge. British Journal of Mathematical and Statistical Psychology, 41(1), 1\u201323. https:\/\/doi.org\/10.1111\/j.2044-8317.1988.tb00884.x","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"key":"13581_CR33","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/0022-2496(88)90011-9","volume":"32","author":"J-C Falmagne","year":"1988","unstructured":"Falmagne, J.-C., & Doignon, J.-P. (1988b). A Markovian procedure for assessing the state of a system. Journal of Mathematical Psychology, 32, 232\u2013258. https:\/\/doi.org\/10.1016\/0022-2496(88)90011-9","journal-title":"Journal of Mathematical Psychology"},{"issue":"2","key":"13581_CR34","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1037\/0033-295X.97.2.201","volume":"97","author":"J-C Falmagne","year":"1990","unstructured":"Falmagne, J.-C., Koppen, M., Villano, M., Doignon, J.-P., & Johanessen, L. (1990). Introduction to knowledge spaces: how to build, test and search them. Psychological Review, 97(2), 204\u2013224. https:\/\/doi.org\/10.1037\/0033-295X.97.2.201","journal-title":"Psychological Review"},{"key":"13581_CR35","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1348\/000711002760554516","volume":"55","author":"G Gediga","year":"2002","unstructured":"Gediga, G., & D\u00fcntsch, I. (2002). Skill set analysis in knowledge structures. British Journal of Mathematical and Statistical Psychology, 55, 361\u2013384. https:\/\/doi.org\/10.1348\/000711002760554516","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"issue":"1","key":"13581_CR36","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1111\/jomf.12157","volume":"77","author":"R A Gordon","year":"2015","unstructured":"Gordon, R. A. (2015). Measuring constructs in family science: How can item response theory improve precision and validity? Journal of Marriage and Family, 77(1), 147\u2013176. https:\/\/doi.org\/10.1111\/jomf.12157","journal-title":"Journal of Marriage and Family"},{"key":"13581_CR37","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1016\/B978-012691360-6\/50020-3","volume-title":"Handbook of applied multivariate statistics and mathematical modeling","author":"R-K Hambleton","year":"2000","unstructured":"Hambleton, R.-K., Robin, F., & Xing, D. (2000). Item response models for the analysis of educational and psychological test data. In H. E. A. Tinsley & S. D. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 553\u2013585). San Diego: Academic Press."},{"key":"13581_CR38","volume-title":"Fundamentals of item response theory","author":"R K Hambleton","year":"1991","unstructured":"Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage Press."},{"key":"13581_CR39","doi-asserted-by":"publisher","unstructured":"Heller, J. (2021). Generalizing quasi-ordinal knowledge spaces to polytomous items. Journal of Mathematical Psychology, 101, Article 102515. https:\/\/doi.org\/10.1016\/j.jmp.2021.102515","DOI":"10.1016\/j.jmp.2021.102515"},{"issue":"3","key":"13581_CR40","doi-asserted-by":"publisher","first-page":"522","DOI":"10.1111\/bmsp.12266","volume":"75","author":"J Heller","year":"2022","unstructured":"Heller, J. (2022). Complete Q-matrices in conjunctive models on general attribute structures. British Journal of Mathematical and Statistical Psychology, 75(3), 522\u2013549. https:\/\/doi.org\/10.1111\/bmsp.12266","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"key":"13581_CR41","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.jmp.2017.05.004","volume":"79","author":"J Heller","year":"2017","unstructured":"Heller, J., Anselmi, P., Stefanutti, L., & Robusto, E. (2017). A necessary and sufficient condition for unique skill assessment. Journal of Mathematical Psychology, 79, 23\u201328. https:\/\/doi.org\/10.1016\/j.jmp.2017.05.004","journal-title":"Journal of Mathematical Psychology"},{"key":"13581_CR42","doi-asserted-by":"crossref","unstructured":"Heller, J. & Stefanutti, L. (2024). Polytomous knowledge structures. In J. Heller & L. Stefanutti (Eds.), Knowledge structures: Recent developments in theory and application (pp. 231\u2013267). World Scientific.","DOI":"10.1142\/9789811280481_0010"},{"issue":"4","key":"13581_CR43","doi-asserted-by":"publisher","first-page":"995","DOI":"10.1007\/s11336-015-9457-x","volume":"80","author":"J Heller","year":"2015","unstructured":"Heller, J., Stefanutti, L., Anselmi, P., & Robusto, E. (2015). On the link between cognitive diagnostic models and knowledge space theory. Psychometrika, 80(4), 995\u20131019. https:\/\/doi.org\/10.1007\/s11336-015-9457-x","journal-title":"Psychometrika"},{"issue":"1","key":"13581_CR44","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1007\/s11336-015-9494-5","volume":"81","author":"J Heller","year":"2016","unstructured":"Heller, J., Stefanutti, L., Anselmi, P., & Robusto, E. (2016). Erratum to: On the link between cognitive diagnostic models and knowledge space theory. Psychometrika, 81(1), 250\u2013251. https:\/\/doi.org\/10.1007\/s11336-015-9494-5","journal-title":"Psychometrika"},{"key":"13581_CR45","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1007\/978-3-642-35329-1_11","volume-title":"Knowledge spaces: Applications in education","author":"J Heller","year":"2013","unstructured":"Heller, J., \u00dcnl\u00fc, A., & Albert, D. (2013). Skills, competencies and knowledge structures. In J.-C. Falmagne, D. Albert, C. Doble, D. Eppstein, & X. Hu (Eds.), Knowledge spaces: Applications in education (pp. 229\u2013242). Berlin, Heidelberg, and New York: Springer-Verlag."},{"issue":"4","key":"13581_CR46","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1177\/0146621604272623","volume":"29","author":"R Henson","year":"2005","unstructured":"Henson, R., & Douglas, J. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29(4), 262\u2013277. https:\/\/doi.org\/10.1177\/0146621604272623","journal-title":"Applied Psychological Measurement"},{"key":"13581_CR47","doi-asserted-by":"publisher","unstructured":"Jeckeln, G., Hu, Y., Cavazos, J. G., Yates, A. N., Hahn, C. A., Tang, L., ... O\u2019Toole, A. J. (2023). Face identification proficiency test designed using item response theory. Advance online publication. https:\/\/doi.org\/10.3758\/s13428-023-02092-7","DOI":"10.3758\/s13428-023-02092-7"},{"issue":"9","key":"13581_CR48","doi-asserted-by":"publisher","first-page":"2481","DOI":"10.12973\/eurasia.2016.1299a","volume":"12","author":"A Jupri","year":"2016","unstructured":"Jupri, A., & Drijvers, P. (2016). Student difficulties in mathematizing word problems in algebra. Eurasia Journal of Mathematics, Science and Technology Education, 12(9), 2481\u20132502. https:\/\/doi.org\/10.12973\/eurasia.2016.1299a","journal-title":"Eurasia Journal of Mathematics, Science and Technology Education"},{"issue":"1","key":"13581_CR49","first-page":"22","volume":"11","author":"S Ketabi","year":"2021","unstructured":"Ketabi, S., Alavi, S. M., & Ravand, H. (2021). Diagnostic test construction: Insights from cognitive diagnostic modeling. International Journal of Language Testing, 11(1), 22\u201335.","journal-title":"International Journal of Language Testing"},{"key":"13581_CR50","first-page":"53","volume":"205","author":"K Korossy","year":"1997","unstructured":"Korossy, K. (1997). Extending the theory of knowledge spaces: A competence-performance approach. Zeitschrift f\u00fcr Psychologie, 205, 53\u201382.","journal-title":"Zeitschrift f\u00fcr Psychologie"},{"key":"13581_CR51","first-page":"103","volume-title":"Knowledge spaces: Theories, empirical research, and applications","author":"K Korossy","year":"1999","unstructured":"Korossy, K. (1999). Modeling knowledge as competence and performance. In D. Albert & J. Lukas (Eds.), Knowledge spaces: Theories, empirical research, and applications (pp. 103\u2013132). Mahwah, NJ: Lawrence Erlbaum Associates."},{"key":"13581_CR52","doi-asserted-by":"crossref","unstructured":"Lalor, J. P., Wu, H., & Yu, H. (2016). Building an evaluation scale using item response theory. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Texas.","DOI":"10.18653\/v1\/D16-1062"},{"issue":"2","key":"13581_CR53","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1177\/0013164416645636","volume":"77","author":"R Liu","year":"2017","unstructured":"Liu, R., Huggins-Manley, A. C., & Bradshaw, L. (2017). The impact of Q-matrix designs on diagnostic classification accuracy in the presence of attribute hierarchies. Educational and Psychological Measurement, 77(2), 220\u2013240. https:\/\/doi.org\/10.1177\/0013164416645636","journal-title":"Educational and Psychological Measurement"},{"key":"13581_CR54","volume-title":"Applications of item response theory to practical testing problems","author":"F-M Lord","year":"1980","unstructured":"Lord, F.-M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates."},{"issue":"3","key":"13581_CR55","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1177\/0013164414539162","volume":"75","author":"M-J Madison","year":"2015","unstructured":"Madison, M.-J., & Bradshaw, L.-P. (2015). The effects of Q-matrix design on classification accuracy in the log-linear cognitive diagnosis model. Educational and Psychological Measurement, 75(3), 491\u2013511. https:\/\/doi.org\/10.1177\/0013164414539162","journal-title":"Educational and Psychological Measurement"},{"issue":"4","key":"13581_CR56","first-page":"379","volume":"33","author":"R-J Mislevy","year":"1996","unstructured":"Mislevy, R.-J. (1996). Test theory reconceived. Journal of Educational Masurement, 33(4), 379\u2013416.","journal-title":"Journal of Educational Masurement"},{"key":"13581_CR57","unstructured":"Morleo, F., Vitanza, A., & Anselmi, P. (2025). Design of a test for assessing teamwork and collaborative skills with Competence-based Knowledge Space Theory. Manuscript submitted for publication."},{"issue":"5","key":"13581_CR58","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1093\/eurjcn\/zvac020","volume":"21","author":"T H Nguyen","year":"2022","unstructured":"Nguyen, T. H., Lee, C. S., & Kim, M. T. (2022). Using item response theory to develop and refine patient-reported outcome measures. European Journal of Cardiovascular Nursing, 21(5), 509\u2013515. https:\/\/doi.org\/10.1093\/eurjcn\/zvac020","journal-title":"European Journal of Cardiovascular Nursing"},{"key":"13581_CR59","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1007\/s11205-014-0773-9","volume":"124","author":"B P O\u2019Connor","year":"2015","unstructured":"O\u2019Connor, B. P., Crawford, M. R., & Holder, M. D. (2015). An item response theory analysis of the subjective happiness scale. Social Indicators Research, 124, 249\u2013258. https:\/\/doi.org\/10.1007\/s11205-014-0773-9","journal-title":"Social Indicators Research"},{"issue":"1","key":"13581_CR60","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.jval.2014.10.005","volume":"18","author":"J Petrillo","year":"2015","unstructured":"Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value in Health, 18(1), 25\u201334. https:\/\/doi.org\/10.1016\/j.jval.2014.10.005","journal-title":"Value in Health"},{"key":"13581_CR61","doi-asserted-by":"publisher","unstructured":"Quinn, H., Thissen, D., Liu, Y., Magnus, B., Lai, J.-S., Amtmann, D., ... DeWalt, D. A. (2014). Using item response theory to enrich and expand the PROMIS\u00ae pediatric self report banks. Health and Quality of Life Outcomes, 12, 1\u201310. https:\/\/doi.org\/10.1186\/s12955-014-0160-x","DOI":"10.1186\/s12955-014-0160-x"},{"key":"13581_CR62","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/j.stueduc.2017.10.007","volume":"55","author":"F Ranjbaran","year":"2017","unstructured":"Ranjbaran, F., & Alavi, S. M. (2017). Developing a reading comprehension test for cognitive diagnostic assessment: A RUM analysis. Studies in Educational Evaluation, 55, 167\u2013179. https:\/\/doi.org\/10.1016\/j.stueduc.2017.10.007","journal-title":"Studies in Educational Evaluation"},{"issue":"1","key":"13581_CR63","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1080\/15305058.2019.1588278","volume":"20","author":"H Ravand","year":"2020","unstructured":"Ravand, H., & Baghaei, P. (2020). Diagnostic classification models: Recent developments, practical issues, and prospects. International Journal of Testing, 20(1), 24\u201356. https:\/\/doi.org\/10.1080\/15305058.2019.1588278","journal-title":"International Journal of Testing"},{"key":"13581_CR64","unstructured":"Robitzsch, A., Kiefer, T., George, A. C., & \u00dcnl\u00fc, A. (2022). CDM: Cognitive diagnosis modeling [Computer software manual]. Retrieved from http:\/\/CRAN.R-project.org\/package=CDM (R package version 8.2-6)"},{"issue":"3","key":"13581_CR65","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1111\/j.1745-3984.2010.00119.x","volume":"47","author":"E Robusto","year":"2010","unstructured":"Robusto, E., Stefanutti, L., & Anselmi, P. (2010). The Gain-Loss Model: A probabilistic skill multimap model for assessing learning processes. Journal of Educational Measurement, 47(3), 373\u2013394. https:\/\/doi.org\/10.1111\/j.1745-3984.2010.00119.x","journal-title":"Journal of Educational Measurement"},{"issue":"4","key":"13581_CR66","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1111\/j.1745-3984.2007.00040.x","volume":"44","author":"L A Roussos","year":"2007","unstructured":"Roussos, L. A., Templin, J. L., & Henson, R. A. (2007). Skill diagnosis using IRT-based latent class models. Journal of Educational Measurement, 44(4), 293\u2013311. https:\/\/doi.org\/10.1111\/j.1745-3984.2007.00040.x","journal-title":"Journal of Educational Measurement"},{"key":"13581_CR67","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1177\/0013164407301545","volume":"68","author":"A A Rupp","year":"2008","unstructured":"Rupp, A. A., & Templin, J. (2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68, 78\u201396. https:\/\/doi.org\/10.1177\/0013164407301545","journal-title":"Educational and Psychological Measurement"},{"key":"13581_CR68","volume-title":"Diagnostic measurement: Theory, methods, and applications","author":"A A Rupp","year":"2010","unstructured":"Rupp, A. A., Templin, J., & Henson, R. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York: Guilford Press."},{"issue":"3","key":"13581_CR69","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1006\/jmps.1997.1169","volume":"41","author":"M Schrepp","year":"1997","unstructured":"Schrepp, M. (1997). A generalization of knowledge space theory to problems with more than two answer alternatives. Journal of Mathematical Psychology, 41(3), 237\u2013243. https:\/\/doi.org\/10.1006\/jmps.1997.1169","journal-title":"Journal of Mathematical Psychology"},{"key":"13581_CR70","first-page":"133","volume-title":"Knowledge spaces: Theories, empirical research, and applications","author":"M Schrepp","year":"1999","unstructured":"Schrepp, M. (1999). An empirical test of a process model for letter series completion problems. In D. Albert & J. Lukas (Eds.), Knowledge spaces: Theories, empirical research, and applications (pp. 133\u2013153). Mahwah: Lawrence Erlbaum Associates."},{"key":"13581_CR71","doi-asserted-by":"publisher","unstructured":"Stefanutti, L., Anselmi, P., de Chiusole, D., & Spoto, A. (2020a). On the polytomous generalization of knowledge space theory. Journal of Mathematical Psychology, 94, Article 102306. https:\/\/doi.org\/10.1016\/j.jmp.2019.102306","DOI":"10.1016\/j.jmp.2019.102306"},{"issue":"3","key":"13581_CR72","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1007\/s11336-020-09722-5","volume":"85","author":"L Stefanutti","year":"2020","unstructured":"Stefanutti, L., de Chiusole, D., Anselmi, P., & Spoto, A. (2020b). Extending the basic local independence model to polytomous data. Psychometrika, 85(3), 684\u2013715. https:\/\/doi.org\/10.1007\/s11336-020-09722-5","journal-title":"Psychometrika"},{"key":"13581_CR73","doi-asserted-by":"publisher","first-page":"1197","DOI":"10.3758\/s13428-012-0187-z","volume":"44","author":"L Stefanutti","year":"2012","unstructured":"Stefanutti, L., Heller, J., Anselmi, P., & Robusto, E. (2012). Assessing the local identifiability of probabilistic knowledge structures. Behavior Research Methods, 44, 1197\u20131211. https:\/\/doi.org\/10.3758\/s13428-012-0187-z","journal-title":"Behavior Research Methods"},{"key":"13581_CR74","doi-asserted-by":"publisher","unstructured":"Stefanutti, L., Spoto, A., Anselmi, P., & de Chiusole, D. (2023). Towards a competence-based polytomous knowledge structure theory. Journal of Mathematical Psychology, 115, Article 102781. https:\/\/doi.org\/10.1016\/j.jmp.2023.102781","DOI":"10.1016\/j.jmp.2023.102781"},{"key":"13581_CR75","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41687-019-0130-5","volume":"3","author":"A M Stover","year":"2019","unstructured":"Stover, A. M., McLeod, L. D., Langer, M. M., Chen, W.-H., & Reeve, B. B. (2019). State of the psychometric methods: Patient-reported outcome measure development and refinement using item response theory. Journal of Patient-Reported Outcomes, 3, 1\u201316. https:\/\/doi.org\/10.1186\/s41687-019-0130-5","journal-title":"Journal of Patient-Reported Outcomes"},{"key":"13581_CR76","unstructured":"Su, Y.-L., Choi, K.-M., Lee, W.-C., Choi, T., & McAninch, M. (2013). Hierarchical cognitive diagnostic analysis for TIMSS 2003 mathematics (Research Report No.\u00a035). Iowa: Center for Advanced Studies in Measurement and Assessment."},{"key":"13581_CR77","doi-asserted-by":"publisher","unstructured":"Tass\u00e9, M. J., Schalock, R. L., Thissen, D., Balboni, G., Bersani, H., Jr., Borthwick-Duffy, S. A., ... Navas, P. (2016). Development and standardization of the diagnostic adaptive behavior scale: Application of item response theory to the assessment of adaptive behavior. American Journal on Intellectual and Developmental Disabilities, 121(2), 79\u201394. https:\/\/doi.org\/10.1352\/1944-7558-121.2.79","DOI":"10.1352\/1944-7558-121.2.79"},{"key":"13581_CR78","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1111\/1467-9876.00272","volume":"51","author":"C Tatsuoka","year":"2002","unstructured":"Tatsuoka, C. (2002). Data analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society Series C (Applied Statistics), 51, 337\u2013350. https:\/\/doi.org\/10.1111\/1467-9876.00272","journal-title":"Journal of the Royal Statistical Society Series C (Applied Statistics)"},{"key":"13581_CR79","first-page":"453","volume-title":"Monitoring skills and knowledge acquisition","author":"K Tatsuoka","year":"1990","unstructured":"Tatsuoka, K. (1990). Toward an integration of item-response theory and cognitive error diagnosis. In N. Frederiksen, R. Glaser, A. Lesgold, & M. Safto (Eds.), Monitoring skills and knowledge acquisition (pp. 453\u2013488). Hillsdale: Lawrence Erlbaum Associates."},{"issue":"3","key":"13581_CR80","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1037\/1082-989X.11.3.287","volume":"11","author":"J Templin","year":"2006","unstructured":"Templin, J., & Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11(3), 287\u2013305. https:\/\/doi.org\/10.1037\/1082-989X.11.3.287","journal-title":"Psychological Methods"},{"key":"13581_CR81","doi-asserted-by":"publisher","unstructured":"Xia, J., Tang, Z., Wu, P., Wang, J., & Yu, J. (2019). Use of item response theory to develop a shortened version of the EORTC QLQ-BR23 scales. Scientific Reports, 9(1), Article 1764. https:\/\/doi.org\/10.1038\/s41598-018-37965-x","DOI":"10.1038\/s41598-018-37965-x"},{"key":"13581_CR82","first-page":"123","volume-title":"Applications of item response theory","author":"W M Yen","year":"1983","unstructured":"Yen, W. M. (1983). Use of the three-parameter logistic model in the development of a standardized achievement test. In R. K. Hamhleton (Ed.), Applications of item response theory (pp. 123\u2013141). Vancouver, BC: Educational Research Institute of British Columbia."},{"key":"13581_CR83","doi-asserted-by":"publisher","unstructured":"Zanon, C., Hutz, C. S., Yoo, H. H., & Hambleton, R. K. (2016). An application of item response theory to psychological test development. Psicologia: Reflex\u00e3o e Cr\u00edtica, 29, Article 18. https:\/\/doi.org\/10.1186\/s41155-016-0040-x","DOI":"10.1186\/s41155-016-0040-x"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-025-13581-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10639-025-13581-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-025-13581-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T06:49:54Z","timestamp":1758264594000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10639-025-13581-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,5]]},"references-count":83,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["13581"],"URL":"https:\/\/doi.org\/10.1007\/s10639-025-13581-x","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"value":"1360-2357","type":"print"},{"value":"1573-7608","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,5]]},"assertion":[{"value":"5 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}