{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T19:30:41Z","timestamp":1772652641634,"version":"3.50.1"},"reference-count":158,"publisher":"Elsevier BV","issue":"3","license":[{"start":{"date-parts":[[2024,12,10]],"date-time":"2024-12-10T00:00:00Z","timestamp":1733788800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,12,10]],"date-time":"2024-12-10T00:00:00Z","timestamp":1733788800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["446349713"],"award-info":[{"award-number":["446349713"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007215","name":"Verband der Chemischen Industrie","doi-asserted-by":"publisher","award":["Verband der Chemischen Industrie"],"award-info":[{"award-number":["Verband der Chemischen Industrie"]}],"id":[{"id":"10.13039\/100007215","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Justus-Liebig-Universit\u00e4t Gie\u00dfen"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Artif Intell Educ"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Valid rubrics facilitate assessing the level of complexity in students\u2019 open-ended responses. To design a valid rubric, it is essential to thoroughly define the types of responses that represent evidence of varying complexity levels. Formulating such evidence statements can be approached deductively by adopting predefined criteria from the research literature or inductively by detecting topics, for example, based on data-driven machine learning (ML) techniques. Investigating the interdependence of such research-informed and ML-based rubrics is key to validating ML-based approaches and enhancing their applicability in formative assessments. This study quantitatively compares a research-informed and an ML-based rubric designed to capture the complexity of students\u2019 reasoning on the relative rate of contrasted reactions in undergraduate organic chemistry. Specifically, we leveraged an ML-based clustering technique to inductively develop a holistic fifteen-category rubric to evaluate students\u2019 open-ended reasoning. Subsequently, we performed a quantitative analysis to examine whether the ML-based rubric and its research-informed counterpart are significantly associated. Our findings indicate that research-informed and ML-based rubrics assess students\u2019 reasoning comparably. Thus, both rubric types are valid for categorizing students\u2019 reasoning, underscoring the applicability of integrating ML techniques into rubric development. Nevertheless, aligning ML-based rubrics with the respective assessment objectives remains crucial. A well-aligned, evidence-based rubric may ultimately ease the analysis of student reasoning.<\/jats:p>","DOI":"10.1007\/s40593-024-00440-y","type":"journal-article","created":{"date-parts":[[2024,12,10]],"date-time":"2024-12-10T09:47:53Z","timestamp":1733824073000},"page":"1465-1503","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Revealing Rubric Relations: Investigating the Interdependence of a Research-Informed and a Machine Learning-Based Rubric in Assessing Student Reasoning in Chemistry"],"prefix":"10.1016","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8648-4250","authenticated-orcid":false,"given":"Paul P.","family":"Martin","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2054-6882","authenticated-orcid":false,"given":"David","family":"Kranz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0444-8609","authenticated-orcid":false,"given":"Nicole","family":"Graulich","sequence":"additional","affiliation":[]}],"member":"78","published-online":{"date-parts":[[2024,12,10]]},"reference":[{"key":"440_CR1","unstructured":"Agresti, A. (2013). Categorical data analysis.\u00a0Wiley."},{"key":"440_CR2","unstructured":"Agresti, A. (2018). An introduction to categorical data analysis.\u00a0Wiley."},{"issue":"2","key":"440_CR3","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1080\/00461520.2013.775712","volume":"48","author":"L Alfieri","year":"2013","unstructured":"Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A Meta-Analytic Review. Educational Psychologist, 48(2), 87\u2013113. https:\/\/doi.org\/10.1080\/00461520.2013.775712","journal-title":"Educational Psychologist"},{"issue":"4","key":"440_CR4","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1111\/emip.12314","volume":"39","author":"D Anderson","year":"2020","unstructured":"Anderson, D., Rowley, B., Stegenga, S., Irvin, P. S., & Rosenberg, J. M. (2020). Evaluating content-related validity evidence using a text-based machine learning procedure. Educational Measurement: Issues and Practice, 39(4), 53\u201364. https:\/\/doi.org\/10.1111\/emip.12314","journal-title":"Educational Measurement: Issues and Practice"},{"key":"440_CR5","volume-title":"Statistical methods in medical research","author":"P Armitage","year":"2008","unstructured":"Armitage, P., Berry, G., & Matthews, J. N. S. (2008). Statistical methods in medical research. Wiley."},{"key":"440_CR6","volume-title":"gridExtra: miscellaneous functions for grid graphics","author":"B Auguie","year":"2017","unstructured":"Auguie, B. (2017). gridExtra: Miscellaneous functions for grid graphics. [Computer Program]."},{"issue":"3\/4","key":"440_CR7","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1007\/s11186-014-9216-5","volume":"43","author":"CA Bail","year":"2014","unstructured":"Bail, C. A. (2014). The cultural environment: Measuring culture with big data. Theory and Society, 43(3\/4), 465\u2013482. https:\/\/doi.org\/10.1007\/s11186-014-9216-5","journal-title":"Theory and Society"},{"issue":"1","key":"440_CR8","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1080\/00220973.1995.9943797","volume":"64","author":"TM Beasley","year":"1995","unstructured":"Beasley, T. M., & Schumacker, R. E. (1995). Multiple regression approach to analyzing contingency tables: Post hoc and planned comparison procedures. The Journal of Experimental Education, 64(1), 79\u201393. https:\/\/doi.org\/10.1080\/00220973.1995.9943797","journal-title":"The Journal of Experimental Education"},{"issue":"10","key":"440_CR9","doi-asserted-by":"publisher","first-page":"1713","DOI":"10.1021\/acs.jchemed.6b00298","volume":"93","author":"N Becker","year":"2016","unstructured":"Becker, N., Noyes, K., & Cooper, M. (2016). Characterizing students\u2019 mechanistic reasoning about London dispersion forces. Journal of Chemical Education, 93(10), 1713\u20131724. https:\/\/doi.org\/10.1021\/acs.jchemed.6b00298","journal-title":"Journal of Chemical Education"},{"key":"440_CR10","volume-title":"An introduction to artificial intelligence. Can computers think?","author":"R Bellmann","year":"1978","unstructured":"Bellmann, R. (1978). An introduction to artificial intelligence. Can computers think? Boyd and Fraser."},{"issue":"9","key":"440_CR11","doi-asserted-by":"publisher","first-page":"1402","DOI":"10.1021\/ed082p1402","volume":"82","author":"G Bhattacharyya","year":"2005","unstructured":"Bhattacharyya, G., & Bodner, G. M. (2005). \u201cIt gets me to the product\u201d: How students propose organic mechanisms. Journal of Chemical Education, 82(9), 1402\u20131407. https:\/\/doi.org\/10.1021\/ed082p1402","journal-title":"Journal of Chemical Education"},{"key":"440_CR12","doi-asserted-by":"publisher","DOI":"10.1057\/9781137007285","volume-title":"Reinventing evidence in social inquiry: Decoding facts and variables","author":"R Biernacki","year":"2012","unstructured":"Biernacki, R. (2012). Reinventing evidence in social inquiry: Decoding facts and variables. Palgrave Macmillan."},{"key":"440_CR13","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006","unstructured":"Bishop, C. M. (2006). Pattern recognition and machine learning. Springer."},{"issue":"6","key":"440_CR14","doi-asserted-by":"publisher","first-page":"1068","DOI":"10.1021\/acs.jchemed.8b00719","volume":"96","author":"NE Bod\u00e9","year":"2019","unstructured":"Bod\u00e9, N. E., Deng, J. M., & Flynn, A. B. (2019). Getting past the rules and to the WHY: Causal mechanistic arguments when judging the plausibility of organic reaction mechanisms. Journal of Chemical Education, 96(6), 1068\u20131082. https:\/\/doi.org\/10.1021\/acs.jchemed.8b00719","journal-title":"Journal of Chemical Education"},{"issue":"22","key":"440_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2018.00022","volume":"3","author":"SM Brookhart","year":"2018","unstructured":"Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, 3(22), 1\u201312. https:\/\/doi.org\/10.3389\/feduc.2018.00022","journal-title":"Frontiers in Education"},{"issue":"3","key":"440_CR16","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1080\/00131911.2014.929565","volume":"67","author":"SM Brookhart","year":"2015","unstructured":"Brookhart, S. M., & Chen, F. (2015). The quality and effectiveness of descriptive rubrics. Educational Review, 67(3), 343\u2013368. https:\/\/doi.org\/10.1080\/00131911.2014.929565","journal-title":"Educational Review"},{"key":"440_CR17","doi-asserted-by":"publisher","DOI":"10.1017\/9781108380690","volume-title":"Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control","author":"SL Brunton","year":"2019","unstructured":"Brunton, S. L., & Kutz, J. N. (2019). Data-Driven Science and Engineering: Machine learning, Dynamical systems, and control. Cambridge University Press."},{"issue":"1","key":"440_CR18","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1039\/C2RP20145C","volume":"14","author":"TJ Bussey","year":"2013","unstructured":"Bussey, T. J., Orgill, M., & Crippen, K. J. (2013). Variation theory: A theory of learning and a useful theoretical framework for chemical education research. Chemistry Education Research and Practice, 14(1), 9\u201322. https:\/\/doi.org\/10.1039\/C2RP20145C","journal-title":"Chemistry Education Research and Practice"},{"issue":"1","key":"440_CR19","doi-asserted-by":"publisher","first-page":"205395172210801","DOI":"10.1177\/20539517221080146","volume":"9","author":"HB Carlsen","year":"2022","unstructured":"Carlsen, H. B., & Ralund, S. (2022). Computational grounded theory revisited: From computer-led to computer-assisted text analysis. Big Data & Society, 9(1),\u00a020539517221080146. https:\/\/doi.org\/10.1177\/20539517221080146","journal-title":"Big Data & Society"},{"issue":"2","key":"440_CR20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.12973\/ijpce\/211359","volume":"11","author":"I Caspari","year":"2019","unstructured":"Caspari, I., & Graulich, N. (2019). Scaffolding the structure of organic chemistry students\u2019 multivariate comparative mechanistic reasoning. International Journal of Physics and Chemistry Education, 11(2), 31\u201343. https:\/\/doi.org\/10.12973\/ijpce\/211359","journal-title":"International Journal of Physics and Chemistry Education"},{"issue":"4","key":"440_CR21","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1039\/C8RP00131F","volume":"19","author":"I Caspari","year":"2018","unstructured":"Caspari, I., Kranz, D., & Graulich, N. (2018). Resolving the complexity of organic chemistry students\u2019 reasoning through the lens of a mechanistic framework. Chemistry Education Research and Practice, 19(4), 1117\u20131141. https:\/\/doi.org\/10.1039\/C8RP00131F","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR22","doi-asserted-by":"crossref","unstructured":"Chang, W. (2017). Webshot: Take screenshots of web pages. [Computer program].","DOI":"10.32614\/CRAN.package.webshot"},{"key":"440_CR23","volume-title":"Constructing grounded theory","author":"K Charmaz","year":"2014","unstructured":"Charmaz, K. (2014). Constructing grounded theory. Sage."},{"issue":"2","key":"440_CR24","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/s11251-016-9374-0","volume":"44","author":"DB Chin","year":"2016","unstructured":"Chin, D. B., Chi, M., & Schwartz, D. L. (2016). A comparison of two methods of active learning in physics: Inventing a general solution versus compare and contrast. Instructional Science, 44(2), 177\u2013195. https:\/\/doi.org\/10.1007\/s11251-016-9374-0","journal-title":"Instructional Science"},{"key":"440_CR25","volume-title":"Statistical power analysis for the behavioral sciences","author":"J Cohen","year":"1988","unstructured":"Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Psychology Press Taylor & Francis."},{"issue":"10","key":"440_CR26","doi-asserted-by":"publisher","first-page":"1703","DOI":"10.1021\/acs.jchemed.6b00417","volume":"93","author":"MM Cooper","year":"2016","unstructured":"Cooper, M. M., Kouyoumdjian, H., & Underwood, S. M. (2016). Investigating students\u2019 reasoning about acid\u2013base reactions. Journal of Chemical Education, 93(10), 1703\u20131712. https:\/\/doi.org\/10.1021\/acs.jchemed.6b00417","journal-title":"Journal of Chemical Education"},{"issue":"2","key":"440_CR27","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1021\/acs.jchemed.8b00784","volume":"96","author":"OM Crandell","year":"2019","unstructured":"Crandell, O. M., Kouyoumdjian, H., Underwood, S. M., & Cooper, M. M. (2019). Reasoning about reactions in organic chemistry: Starting it in general chemistry. Journal of Chemical Education, 96(2), 213\u2013226. https:\/\/doi.org\/10.1021\/acs.jchemed.8b00784","journal-title":"Journal of Chemical Education"},{"issue":"2","key":"440_CR28","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1021\/acs.jchemed.3c00710","volume":"101","author":"CJ Crowder","year":"2024","unstructured":"Crowder, C. J., Yik, B. J., Frost, S. J., Cruz-Ram\u00edrez de Arellano, D., & Raker, J. R. (2024). Impact of prompt cueing on level of explanation sophistication for organic reaction mechanisms. Journal of Chemical Education, 101(2), 398\u2013410. https:\/\/doi.org\/10.1021\/acs.jchemed.3c00710","journal-title":"Journal of Chemical Education"},{"issue":"104094","key":"440_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.compedu.2020.104094","volume":"162","author":"G Deeva","year":"2021","unstructured":"Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021). A review of automated feedback systems for learners: Classification framework, challenges and opportunities. Computers & Education, 162(104094), 1\u201343. https:\/\/doi.org\/10.1016\/j.compedu.2020.104094","journal-title":"Computers & Education"},{"issue":"3","key":"440_CR30","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.1021\/acs.jchemed.1c01080","volume":"99","author":"KS DeGlopper","year":"2022","unstructured":"DeGlopper, K. S., Schwarz, C. E., Ellias, N. J., & Stowe, R. L. (2022). Impact of assessment emphasis on organic chemistry students\u2019 explanations for an alkene addition reaction. Journal of Chemical Education, 99(3), 1368\u20131382. https:\/\/doi.org\/10.1021\/acs.jchemed.1c01080","journal-title":"Journal of Chemical Education"},{"issue":"3","key":"440_CR31","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1039\/D0RP00320D","volume":"22","author":"JM Deng","year":"2021","unstructured":"Deng, J. M., & Flynn, A. B. (2021). Reasoning, granularity, and comparisons in students\u2019 arguments on two organic chemistry items. Chemistry Education Research and Practice, 22(3), 749\u2013771. https:\/\/doi.org\/10.1039\/D0RP00320D","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR32","volume-title":"Guidelines for safeguarding good research practice, code of conduct","author":"Deutsche Forschungsgemeinschaft","year":"2022","unstructured":"Deutsche Forschungsgemeinschaft. (2022). Guidelines for safeguarding good research practice, code of conduct. DFG."},{"key":"440_CR33","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint, arXiv:1810.04805, 1\u201316. https:\/\/doi.org\/10.48550\/arXiv.1810.04805","DOI":"10.48550\/arXiv.1810.04805"},{"issue":"6","key":"440_CR34","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1007\/s10956-015-9569-1","volume":"24","author":"DF Donnelly","year":"2015","unstructured":"Donnelly, D. F., Vitale, J. M., & Linn, M. C. (2015). Automated guidance for thermodynamics essays: Critiquing versus revisiting. Journal of Science Education and Technology, 24(6), 861\u2013874. https:\/\/doi.org\/10.1007\/s10956-015-9569-1","journal-title":"Journal of Science Education and Technology"},{"issue":"8","key":"440_CR35","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.1021\/acs.jchemed.2c00313","volume":"99","author":"AJ Dood","year":"2022","unstructured":"Dood, A. J., & Watts, F. M. (2022). Mechanistic reasoning in organic chemistry: A scoping review of how students describe and explain mechanisms in the chemistry education research literature. Journal of Chemical Education, 99(8), 2864\u20132876. https:\/\/doi.org\/10.1021\/acs.jchemed.2c00313","journal-title":"Journal of Chemical Education"},{"issue":"8","key":"440_CR36","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1021\/acs.jchemed.8b00177","volume":"95","author":"AJ Dood","year":"2018","unstructured":"Dood, A. J., Fields, K. B., & Raker, J. R. (2018). Using lexical analysis to predict Lewis acid\u2013base model use in response to an acid\u2013base proton-transfer reaction. Journal of Chemical Education, 95(8), 1267\u20131275. https:\/\/doi.org\/10.1021\/acs.jchemed.8b00177","journal-title":"Journal of Chemical Education"},{"issue":"1","key":"440_CR37","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1039\/C9RP00148D","volume":"21","author":"AJ Dood","year":"2020","unstructured":"Dood, A. J., Dood, J. C., Cruz-Ram\u00edrez de Arellano, D., Fields, K. B., & Raker, J. R. (2020). Analyzing explanations of substitution reactions using lexical analysis and logistic regression techniques. Chemistry Education Research and Practice, 21(1), 267\u2013286. https:\/\/doi.org\/10.1039\/C9RP00148D","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR38","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1145\/3506860.3506892","volume-title":"LAK22: 12th international learning analytics and knowledge conference","author":"AJ Dood","year":"2022","unstructured":"Dood, A. J., Winograd, B. A., Finkenstaedt-Quinn, S. A., Gere, A. R., & Shultz, G. V. (2022). PeerBERT: Automated characterization of peer review comments across courses. In LAK22: 12th international learning analytics and knowledge conference (pp. 492\u2013499). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3506860.3506892"},{"issue":"3","key":"440_CR39","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1021\/acs.jchemed.3c00757","volume":"101","author":"AJ Dood","year":"2024","unstructured":"Dood, A. J., Watts, F. M., Connor, M. C., & Shultz, G. V. (2024). Automated text analysis of organic chemistry students\u2019 written hypotheses. Journal of Chemical Education, 101(3), 807\u2013818. https:\/\/doi.org\/10.1021\/acs.jchemed.3c00757","journal-title":"Journal of Chemical Education"},{"key":"440_CR40","doi-asserted-by":"crossref","unstructured":"Ebbert, D. (2019). Chisq.posthoc.test: A post hoc analysis for Pearson\u2019s chi-squared test for count data. [Computer program].","DOI":"10.32614\/CRAN.package.chisq.posthoc.test"},{"key":"440_CR41","first-page":"04052016","volume":"OJ L 119","author":"European Union","year":"2016","unstructured":"European Union (2016). Regulation 2016\/679 (General Data Protection Regulation). Official Journal of the European Union, OJ L 119, 04052016. cor. OJ L 127, 23.5.2018.","journal-title":"Official Journal of the European Union"},{"key":"440_CR42","volume-title":"Discovering statistics using R","author":"A Field","year":"2012","unstructured":"Field, A., Miles, J., & Field, Z. (2012). Discovering statistics using R. Sage."},{"issue":"5","key":"440_CR43","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.1021\/acs.jchemed.2c00737","volume":"100","author":"CGC Franovic","year":"2023","unstructured":"Franovic, C. G. C., Noyes, K., Stoltzfus, J. R., Schwarz, C. V., Long, T. M., & Cooper, M. M. (2023). Undergraduate chemistry and biology students\u2019 use of causal mechanistic reasoning to explain and predict preferential protein-ligand binding activity. Journal of Chemical Education, 100(5), 1716\u20131727. https:\/\/doi.org\/10.1021\/acs.jchemed.2c00737","journal-title":"Journal of Chemical Education"},{"issue":"2","key":"440_CR44","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1039\/D2RP00327A","volume":"24","author":"SJH Frost","year":"2023","unstructured":"Frost, S. J. H., Yik, B. J., Dood, A. J., Cruz-Ram\u00edrez de Arellano, D., Fields, K. B., & Raker, J. R. (2023). Evaluating electrophile and nucleophile understanding: A large-scale study of learners\u2019 explanations of reaction mechanisms. Chemistry Education Research and Practice, 24(2), 706\u2013722. https:\/\/doi.org\/10.1039\/D2RP00327A","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR45","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.edurev.2015.04.001","volume":"15","author":"LF Gerard","year":"2015","unstructured":"Gerard, L. F., Matuk, C., McElhaney, K., & Linn, M. C. (2015). Automated, adaptive guidance for K-12 education. Educational Research Review, 15, 41\u201358. https:\/\/doi.org\/10.1016\/j.edurev.2015.04.001","journal-title":"Educational Research Review"},{"key":"440_CR46","unstructured":"Glaser, B., & Strauss, A. (1999). Discovery of grounded theory: Strategies for qualitative research.\u00a0Routledge."},{"issue":"3","key":"440_CR47","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1111\/jcal.12767","volume":"39","author":"S Gombert","year":"2023","unstructured":"Gombert, S., Di Mitri, D., Karademir, O., Kubsch, M., Kolbe, H., Tautz, S., Grimm, A., Bohm, I., Neumann, K., & Drachsler, H. (2023). Coding energy knowledge in constructed responses with explainable NLP models. Journal of Computer Assisted Learning, 39(3), 767\u2013786. https:\/\/doi.org\/10.1111\/jcal.12767","journal-title":"Journal of Computer Assisted Learning"},{"issue":"1","key":"440_CR48","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1111\/j.1749-6632.2003.tb06093.x","volume":"988","author":"WM Goodwin","year":"2003","unstructured":"Goodwin, W. M. (2003). Explanation in organic chemistry. Annals of the New York Academy of Sciences, 988(1), 141\u2013153. https:\/\/doi.org\/10.1111\/j.1749-6632.2003.tb06093.x","journal-title":"Annals of the New York Academy of Sciences"},{"issue":"2","key":"440_CR49","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/s10698-007-9033-2","volume":"10","author":"WM Goodwin","year":"2008","unstructured":"Goodwin, W. M. (2008). Structural formulas and explanation in organic chemistry. Foundations of Chemistry, 10(2), 117\u2013127. https:\/\/doi.org\/10.1007\/s10698-007-9033-2","journal-title":"Foundations of Chemistry"},{"issue":"1","key":"440_CR50","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1039\/C4RP00165F","volume":"16","author":"N Graulich","year":"2015","unstructured":"Graulich, N. (2015). The tip of the iceberg in organic chemistry classes: How do students deal with the invisible? Chemistry Education Research and Practice, 16(1), 9\u201321. https:\/\/doi.org\/10.1039\/C4RP00165F","journal-title":"Chemistry Education Research and Practice"},{"issue":"1","key":"440_CR51","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1515\/cti-2020-0001","volume":"3","author":"N Graulich","year":"2021","unstructured":"Graulich, N., & Caspari, I. (2021). Designing a scaffold for mechanistic reasoning in organic chemistry. Chemistry Teacher International, 3(1), 19\u201330. https:\/\/doi.org\/10.1515\/cti-2020-0001","journal-title":"Chemistry Teacher International"},{"issue":"3","key":"440_CR52","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1021\/acs.jchemed.7b00672","volume":"95","author":"N Graulich","year":"2018","unstructured":"Graulich, N., & Schween, M. (2018). Concept-oriented task design: Making purposeful case comparisons in organic chemistry. Journal of Chemical Education, 95(3), 376\u2013383. https:\/\/doi.org\/10.1021\/acs.jchemed.7b00672","journal-title":"Journal of Chemical Education"},{"issue":"4","key":"440_CR53","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1039\/C9RP00054B","volume":"20","author":"N Graulich","year":"2019","unstructured":"Graulich, N., Hedtrich, S., & Harzenetter, R. (2019). Explicit versus implicit similarity\u2014exploring relational conceptual understanding in organic chemistry. Chemistry Education Research and Practice, 20(4), 924\u2013936. https:\/\/doi.org\/10.1039\/C9RP00054B","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR54","unstructured":"Grootendorst, M. (2020). Topic modeling with BERT. Retrieved 20 April 2023 from https:\/\/towardsdatascience.com\/topicmodeling-with-bert-779f7db187e6"},{"key":"440_CR55","doi-asserted-by":"publisher","unstructured":"Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., Kern, R., Picus, M., Hoyer, S., van Kerkwijk, M. H., Brett, M., Haldane, A., del R\u00edo, J. F., Wiebe, M., Peterson, P.,\u00a0\u2026 Oliphant, T. E.\u00a0(2020). Array programming with NumPy. Nature, 585(7825), 357\u2013362. https:\/\/doi.org\/10.1038\/s41586-020-2649-2","DOI":"10.1038\/s41586-020-2649-2"},{"issue":"3","key":"440_CR56","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1080\/0969594X.2012.742422","volume":"20","author":"C Harsch","year":"2013","unstructured":"Harsch, C., & Martin, G. (2013). Comparing holistic and analytic scoring methods: Issues of validity and reliability. Assessment in Education: Principles Policy & Practice, 20(3), 281\u2013307. https:\/\/doi.org\/10.1080\/0969594X.2012.742422","journal-title":"Assessment in Education: Principles Policy & Practice"},{"key":"440_CR57","unstructured":"Haudek, K. C., Moscarella, R. A., Urban-Lurain, M., Merrill, J. E., Sweeder, R. D., & Richmond, G. (2009). Using lexical analysis software to understand student knowledge transfer between chemistry and biology.\u00a0Paper presented at the National Association of Research in Science Teaching, Annual Conference, Garden Grove, CA."},{"issue":"3","key":"440_CR58","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1187\/cbe.11-08-0084","volume":"11","author":"KC Haudek","year":"2012","unstructured":"Haudek, K. C., Prevost, L. B., Moscarella, R. A., Merrill, J. E., & Urban-Lurain, M. (2012). What are they thinking? Automated analysis of student writing about acid\u2013base chemistry in introductory biology. CBE - Life Sciences Education, 11(3), 283\u2013293. https:\/\/doi.org\/10.1187\/cbe.11-08-0084","journal-title":"CBE - Life Sciences Education"},{"key":"440_CR59","unstructured":"Haudek, K. C., Moscarella, R. A., Weston, M., Merrill, J. E., & Urban-Lurain, M. (2015). Construction of rubrics to evaluate content in students\u2019 scientific explanation using computerized text analysis.\u00a0Paper presented at the National Association of Research in Science Teaching, Annual Conference, Chicago, IL."},{"key":"440_CR60","unstructured":"Haudek, K. C., Wilson, C. D., Stuhlsatz, M. A. M., Donovan, B., Bracey, Z. B., Gardner, A., Osborne, J. F., & Cheuk, T. (2019). Using automated analysis to assess middle school students\u2019 competence with scientific argumentation.\u00a0Paper presented at the National Conference on Measurement in Education (NCME), Annual Conference, Toronto, ON."},{"key":"440_CR61","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1170.001.0001","volume-title":"Artificial intelligence: The very idea","author":"J Haugeland","year":"1989","unstructured":"Haugeland, J. (1989). Artificial intelligence: The very idea. MIT Press."},{"key":"440_CR62","unstructured":"Honnibal, M., Montani, I., Van Landeghem, S., & Boyd, A. (2020). spaCy: Industrial-strength natural language processing in Python. [Computer program]."},{"key":"440_CR63","unstructured":"Howell, D. C. (2006). Statistical methods for psychology. PWS-Kent Publishing Co."},{"issue":"3","key":"440_CR64","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","volume":"9","author":"JD Hunter","year":"2007","unstructured":"Hunter, J. D. (2007). Matplotlib: A 2D graphics environment. Computing in Science & Engineering, 9(3), 90\u201395. https:\/\/ieeexplore.ieee.org\/document\/4160265","journal-title":"Computing in Science & Engineering"},{"issue":"7","key":"440_CR65","doi-asserted-by":"publisher","first-page":"1","DOI":"10.7275\/9h7f-mp76","volume":"24","author":"LN Jescovitch","year":"2019","unstructured":"Jescovitch, L. N., Scott, E. E., Cerchiara, J. A., Doherty, J. H., Wenderoth, M. P., Merrill, J. E., Urban-Lurain, M., & Haudek, K. C. (2019). Deconstruction of holistic rubrics into analytic bins for large-scale assessments of students\u2019 reasoning of complex science concepts. Practical Assessment Research & Evaluation, 24(7), 1\u201313. https:\/\/doi.org\/10.7275\/9h7f-mp76","journal-title":"Practical Assessment Research & Evaluation"},{"key":"440_CR66","unstructured":"Jescovitch, L. N., Doherty, J. H., Scott, E. E., Cerchiara, J. A., Wenderoth, M. P., Urban-Lurain, M., Merrill, J. E., & Haudek, K. C. (2019). Challenges in developing computerized scoring models for principle-based reasoning in a physiology context.\u00a0Paper presented at the National Association of Research in Science Teaching, Annual Conference, Baltimore, MD."},{"issue":"2","key":"440_CR67","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1007\/s10956-020-09858-0","volume":"30","author":"LN Jescovitch","year":"2021","unstructured":"Jescovitch, L. N., Scott, E. E., Cerchiara, J. A., Merrill, J. E., Urban-Lurain, M., Doherty, J. H., & Haudek, K. C. (2021). Comparison of machine learning performance using analytic and holistic coding approaches across constructed response assessments aligned to a science learning progression. Journal of Science Education and Technology, 30(2), 150\u2013167. https:\/\/doi.org\/10.1007\/s10956-020-09858-0","journal-title":"Journal of Science Education and Technology"},{"issue":"2","key":"440_CR68","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1016\/j.edurev.2007.05.002","volume":"2","author":"A Jonsson","year":"2007","unstructured":"Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130\u2013144. https:\/\/doi.org\/10.1016\/j.edurev.2007.05.002","journal-title":"Educational Research Review"},{"issue":"968289","key":"440_CR69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2022.968289","volume":"7","author":"L Kaldaras","year":"2022","unstructured":"Kaldaras, L., & Haudek, K. C. (2022). Validation of automated scoring for learning progression-aligned Next Generation Science Standards performance assessments. Frontiers in Education, 7(968289), 1\u201322. https:\/\/doi.org\/10.3389\/feduc.2022.968289","journal-title":"Frontiers in Education"},{"issue":"983055","key":"440_CR70","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2022.983055","volume":"7","author":"L Kaldaras","year":"2022","unstructured":"Kaldaras, L., Yoshida, N. R., & Haudek, K. C. (2022). Rubric development for AI-enabled scoring of three-dimensional constructed-response assessment aligned to NGSS learning progression. Frontiers in Education, 7(983055), 1\u201315. https:\/\/doi.org\/10.3389\/feduc.2022.983055","journal-title":"Frontiers in Education"},{"key":"440_CR71","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316801","volume-title":"Finding groups in data: An introduction to cluster analysis","author":"L Kaufman","year":"1990","unstructured":"Kaufman, L., & Rousseeuw, P. J. (1990). Finding groups in data: An introduction to cluster analysis. Wiley."},{"issue":"4","key":"440_CR72","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1039\/C0RP90003F","volume":"11","author":"A Kraft","year":"2010","unstructured":"Kraft, A., Strickland, A. M., & Bhattacharyya, G. (2010). Reasonable reasoning: Multi-variate problem-solving in organic chemistry. Chemistry Education Research and Practice, 11(4), 281\u2013292. https:\/\/doi.org\/10.1039\/C0RP90003F","journal-title":"Chemistry Education Research and Practice"},{"issue":"2","key":"440_CR73","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1039\/D2RP00132B","volume":"24","author":"D Kranz","year":"2023","unstructured":"Kranz, D., Schween, M., & Graulich, N. (2023). Patterns of reasoning\u2014exploring the interplay of students\u2019 work with a scaffold and their conceptual knowledge in organic chemistry. Chemistry Education Research and Practice, 24(2), 453\u2013477. https:\/\/doi.org\/10.1039\/D2RP00132B","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR74","unstructured":"Kranz, D., Martin, P. P., Schween, M., & Graulich, N. (under review). Should we scaffold it? Analysing students\u2019 learning gains to evaluate the effect of task format and scaffolding. Chemistry Education Research and Practice."},{"issue":"2","key":"440_CR75","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1080\/10508406.2018.1510404","volume":"28","author":"C Krist","year":"2019","unstructured":"Krist, C., Schwarz, C. V., & Reiser, B. J. (2019). Identifying essential epistemic heuristics for guiding mechanistic reasoning in science learning. Journal of the Learning Sciences, 28(2), 160\u2013205. https:\/\/doi.org\/10.1080\/10508406.2018.1510404","journal-title":"Journal of the Learning Sciences"},{"issue":"981910","key":"440_CR76","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2022.981910","volume":"7","author":"M Kubsch","year":"2022","unstructured":"Kubsch, M., Czinczel, B., Lossjew, J., Wyrwich, T., Bednorz, D., Bernholt, S., Fiedler, D., Strau\u00df, S., Cress, U., Drachsler, H., Neumann, K., & Rummel, N. (2022). Toward learning progression analytics\u2014developing learning environments for the automated analysis of learning using evidence centered design. Frontiers in Education, 7(981910), 1\u201315. https:\/\/doi.org\/10.3389\/feduc.2022.981910","journal-title":"Frontiers in Education"},{"issue":"2","key":"440_CR77","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1002\/tea.21803","volume":"60","author":"M Kubsch","year":"2023","unstructured":"Kubsch, M., Krist, C., & Rosenberg, J. M. (2023). Distributing epistemic functions and tasks\u2014A framework for augmenting human analytic power with machine learning in science education research. Journal of Research in Science Teaching, 60(2), 423\u2013447. https:\/\/doi.org\/10.1002\/tea.21803","journal-title":"Journal of Research in Science Teaching"},{"issue":"5","key":"440_CR78","doi-asserted-by":"publisher","first-page":"1245","DOI":"10.1111\/1467-8624.00605","volume":"74","author":"D Kuhn","year":"2003","unstructured":"Kuhn, D., & Udell, W. (2003). The development of argument skills. Child Development, 74(5), 1245\u20131260. https:\/\/doi.org\/10.1111\/1467-8624.00605","journal-title":"Child Development"},{"issue":"1","key":"440_CR79","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159\u2013174. https:\/\/doi.org\/10.2307\/2529310","journal-title":"Biometrics"},{"issue":"6","key":"440_CR80","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1002\/tea.21867","volume":"60","author":"T Li","year":"2023","unstructured":"Li, T., Reigh, E., He, P., & Adah Miller, E. (2023). Can we and should we use artificial intelligence for formative assessment in science? Journal of Research in Science Teaching, 60(6), 1385\u20131389. https:\/\/doi.org\/10.1002\/tea.21867","journal-title":"Journal of Research in Science Teaching"},{"issue":"107547","key":"440_CR81","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.chb.2022.107547","volume":"139","author":"L Lim","year":"2023","unstructured":"Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Ga\u0161evi\u0107, D. (2023). Effects of real-time analytics-based personalized scaffolds on students\u2019 self-regulated learning. Computers in Human Behavior, 139(107547), 1\u201318. https:\/\/doi.org\/10.1016\/j.chb.2022.107547","journal-title":"Computers in Human Behavior"},{"issue":"2","key":"440_CR82","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1111\/emip.12028","volume":"33","author":"OL Liu","year":"2014","unstructured":"Liu, O. L., Brew, C., Blackmore, J., Gerard, L., Madhok, J., & Linn, M. C. (2014). Automated scoring of constructed-response science items: Prospects and obstacles. Educational Measurement: Issues and Practice, 33(2), 19\u201328. https:\/\/doi.org\/10.1111\/emip.12028","journal-title":"Educational Measurement: Issues and Practice"},{"issue":"1","key":"440_CR83","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1108\/20468251211179678","volume":"1","author":"ML Lo","year":"2012","unstructured":"Lo, M. L., & Marton, F. (2012). Towards a science of the art of teaching. International Journal for Lesson and Learning Studies, 1(1), 7\u201322. https:\/\/doi.org\/10.1108\/20468251211179678","journal-title":"International Journal for Lesson and Learning Studies"},{"issue":"1","key":"440_CR84","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1086\/392759","volume":"67","author":"P Machamer","year":"2000","unstructured":"Machamer, P., Darden, L., & Craver, C. F. (2000). Thinking about mechanisms. Philosophy of Science, 67(1), 1\u201325. https:\/\/doi.org\/10.1086\/392759","journal-title":"Philosophy of Science"},{"key":"440_CR85","unstructured":"MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In L. Lecam, & J. Neyman (Eds.), Proceedings of the fifth Berkeley symposium on mathematical statistics and probability (pp. 281\u2013297). University of California."},{"issue":"2","key":"440_CR86","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/s10956-020-09895-9","volume":"30","author":"S Maestrales","year":"2021","unstructured":"Maestrales, S., Zhai, X., Touitou, I., Baker, Q., Schneider, B., & Krajcik, J. (2021). Using machine learning to score multidimensional assessments of chemistry and physics. Journal of Science Education and Technology, 30(2), 239\u2013254. https:\/\/doi.org\/10.1007\/s10956-020-09895-9","journal-title":"Journal of Science Education and Technology"},{"issue":"2","key":"440_CR87","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1039\/D2RP00287F","volume":"24","author":"PP Martin","year":"2023","unstructured":"Martin, P. P., & Graulich, N. (2023). When a machine detects student reasoning: A review of machine learning-based formative assessment of mechanistic reasoning. Chemistry Education Research and Practice, 24(2), 407\u2013427. https:\/\/doi.org\/10.1039\/D2RP00287F","journal-title":"Chemistry Education Research and Practice"},{"issue":"2","key":"440_CR88","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s10956-023-10087-4","volume":"33","author":"PP Martin","year":"2024","unstructured":"Martin, P. P., & Graulich, N. (2024a). Beyond language barriers: Allowing multiple languages in postsecondary chemistry classes through multilingual machine learning. Journal of Science Education and Technology, 33(2), 333\u2013348. https:\/\/doi.org\/10.1007\/s10956-023-10087-4","journal-title":"Journal of Science Education and Technology"},{"issue":"3","key":"440_CR89","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1002\/nadc.20244141003","volume":"72","author":"PP Martin","year":"2024","unstructured":"Martin, P. P., & Graulich, N. (2024b). Lehre in der Organischen Chemie individualisieren [Individualized teaching in organic chemistry]. Nachrichten aus der Chemie, 72(3), 8\u201311. https:\/\/doi.org\/10.1002\/nadc.20244141003","journal-title":"Nachrichten aus der Chemie"},{"key":"440_CR90","doi-asserted-by":"publisher","unstructured":"Martin, P. P., & Graulich, N. (2024c). Navigating the data frontier in science assessment: Advancing data augmentation strategies for machine learning applications with generative artificial intelligence. Computers and Education: Artificial Intelligence, 7(100265). https:\/\/doi.org\/10.1016\/j.caeai.2024.100265","DOI":"10.1016\/j.caeai.2024.100265"},{"issue":"8","key":"440_CR91","doi-asserted-by":"publisher","first-page":"1757","DOI":"10.1002\/tea.21903","volume":"61","author":"PP Martin","year":"2024","unstructured":"Martin, P. P., Kranz, D., Wulff, P., & Graulich, N. (2024). Exploring new depths: Applying machine learning for the analysis of student argumentation in chemistry. Journal of Research in Science Teaching, 61(8), 1757\u20131792. https:\/\/doi.org\/10.1002\/tea.21903","journal-title":"Journal of Research in Science Teaching"},{"issue":"2","key":"440_CR92","doi-asserted-by":"publisher","first-page":"143","DOI":"10.11613\/bm.2013.018","volume":"23","author":"ML McHugh","year":"2013","unstructured":"McHugh, M. L. (2013). The chi-square test of independence. Biochemia Medica, 23(2), 143\u2013149. https:\/\/doi.org\/10.11613\/bm.2013.018","journal-title":"Biochemia Medica"},{"issue":"11","key":"440_CR93","doi-asserted-by":"publisher","first-page":"205","DOI":"10.21105\/joss.00205","volume":"2","author":"L McInnes","year":"2017","unstructured":"McInnes, L., Healy, J., & Astels, S. (2017). HDBSCAN: Hierarchical density-based clustering. Journal of Open Source Software, 2(11), 205\u2013206. https:\/\/doi.org\/10.21105\/joss.00205","journal-title":"Journal of Open Source Software"},{"issue":"29","key":"440_CR94","doi-asserted-by":"publisher","first-page":"861","DOI":"10.21105\/joss.00861","volume":"3","author":"L McInnes","year":"2018","unstructured":"McInnes, L., Healy, J., Saul, N., & Gro\u00dfberger, L. (2018). UMAP: Uniform manifold approximation and projection. The Journal of Open Source Software, 3(29), 861\u2013862. https:\/\/doi.org\/10.21105\/joss.00861","journal-title":"The Journal of Open Source Software"},{"key":"440_CR95","doi-asserted-by":"publisher","unstructured":"McInnes, L., Healy, J., & Melville, J. (2018). UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv preprint, arXiv:1802.03426, 1\u201363. https:\/\/doi.org\/10.48550\/arXiv.1802.03426","DOI":"10.48550\/arXiv.1802.03426"},{"key":"440_CR96","doi-asserted-by":"publisher","unstructured":"McKinney, W. (2010). Data structures for statistical computing in Python. In Proceedings of the 9th Python in Science Conference (pp. 51\u201356). SciPy 2010. https:\/\/doi.org\/10.25080\/Majora-92bf1922-00a","DOI":"10.25080\/Majora-92bf1922-00a"},{"issue":"3","key":"440_CR97","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1111\/jedm.12117","volume":"53","author":"RJ Mislevy","year":"2016","unstructured":"Mislevy, R. J. (2016). How developments in psychology and technology challenge validity argumentation. Journal of Educational Measurement, 53(3), 265\u2013292. https:\/\/doi.org\/10.1111\/jedm.12117","journal-title":"Journal of Educational Measurement"},{"issue":"4","key":"440_CR98","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1111\/j.1745-3992.2006.00075.x","volume":"25","author":"RJ Mislevy","year":"2007","unstructured":"Mislevy, R. J., & Haertel, G. D. (2007). Implications of evidence-centered design for educational testing. Educational Measurement:Issues and Practice, 25(4), 6\u201320. https:\/\/doi.org\/10.1111\/j.1745-3992.2006.00075.x","journal-title":"Educational Measurement:Issues and Practice"},{"key":"440_CR99","doi-asserted-by":"publisher","unstructured":"Mislevy, R. J., Almond, R. G., & Lukas, J. F. (2003). A brief introduction to evidence-centered design. ETS Research Report Series, (1), i\u201329. https:\/\/doi.org\/10.1002\/j.2333-8504.2003.tb01908.x","DOI":"10.1002\/j.2333-8504.2003.tb01908.x"},{"issue":"1","key":"440_CR100","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1207\/S15366359MEA0101_02","volume":"1","author":"RJ Mislevy","year":"2003","unstructured":"Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). Focus article: On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1(1), 3\u201362. https:\/\/doi.org\/10.1207\/S15366359MEA0101_02","journal-title":"Measurement: Interdisciplinary Research and Perspectives"},{"key":"440_CR101","volume-title":"Machine Learning","author":"TM Mitchell","year":"1997","unstructured":"Mitchell, T. M. (1997). Machine learning. McGraw Hill."},{"key":"440_CR102","volume-title":"Foundation of machine learning","author":"M Mohri","year":"2012","unstructured":"Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2012). Foundation of machine learning. The MIT Press."},{"issue":"1","key":"440_CR103","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0049124117729703","volume":"49","author":"LK Nelson","year":"2020","unstructured":"Nelson, L. K. (2020). Computational grounded theory: A methodological framework. Sociological Methods & Research, 49(1), 3\u201342. https:\/\/doi.org\/10.1177\/0049124117729703","journal-title":"Sociological Methods & Research"},{"issue":"11","key":"440_CR104","doi-asserted-by":"publisher","first-page":"3923","DOI":"10.1021\/acs.jchemed.0c00445","volume":"97","author":"K Noyes","year":"2020","unstructured":"Noyes, K., McKay, R. L., Neumann, M., Haudek, K. C., & Cooper, M. M. (2020). Developing computer resources to automate analysis of students\u2019 explanations of London dispersion forces. Journal of Chemical Education, 97(11), 3923\u20133936. https:\/\/doi.org\/10.1021\/acs.jchemed.0c00445","journal-title":"Journal of Chemical Education"},{"issue":"2","key":"440_CR105","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1021\/acs.jchemed.1c00959","volume":"99","author":"K Noyes","year":"2022","unstructured":"Noyes, K., Carlson, C. G., Stoltzfus, J. R., Schwarz, C. V., Long, T. M., & Cooper, M. M. (2022). A deep look into designing a task and coding scheme through the lens of causal mechanistic reasoning. Journal of Chemical Education, 99(2), 874\u2013885. https:\/\/doi.org\/10.1021\/acs.jchemed.1c00959","journal-title":"Journal of Chemical Education"},{"issue":"100329","key":"440_CR106","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.edurev.2020.100329","volume":"30","author":"E Panadero","year":"2020","unstructured":"Panadero, E., & Jonsson, A. (2020). A critical review of the arguments against the use of rubrics. Educational Research Review, 30(100329), 1\u201319. https:\/\/doi.org\/10.1016\/j.edurev.2020.100329","journal-title":"Educational Research Review"},{"issue":"1","key":"440_CR107","doi-asserted-by":"publisher","first-page":"91","DOI":"10.2307\/2346669","volume":"30","author":"W Patefield","year":"1981","unstructured":"Patefield, W. (1981). Algorithm AS 159: An efficient method of generating random R\u00d7C tables with given row and column totals. Journal of the Royal Statistical Society, 30(1), 91\u201397. https:\/\/doi.org\/10.2307\/2346669","journal-title":"Journal of the Royal Statistical Society"},{"issue":"1","key":"440_CR108","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.5555\/1953048.2078195","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., VanderPlas, J. T., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, \u00c9. (2011). Scikit-learn: Machine learning in Python. The Journal of Machine Learning Research, 12(1), 2825\u20132830. https:\/\/doi.org\/10.5555\/1953048.2078195","journal-title":"The Journal of Machine Learning Research"},{"issue":"1","key":"440_CR109","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00461520.2016.1145550","volume":"51","author":"J Pellegrino","year":"2016","unstructured":"Pellegrino, J., DiBello, L., & Goldman, S. (2016). A framework for conceptualizing and evaluating the validity of instructionally relevant assessments. Educational Psychologist, 51(1), 1\u201323. https:\/\/doi.org\/10.1080\/00461520.2016.1145550","journal-title":"Educational Psychologist"},{"issue":"4","key":"440_CR110","doi-asserted-by":"publisher","first-page":"1153","DOI":"10.1039\/D3RP00068K","volume":"24","author":"B P\u00f6lloth","year":"2023","unstructured":"P\u00f6lloth, B., Diekemper, D., & Schwarzer, S. (2023). What resources do high school students activate to link energetic and structural changes in chemical reactions?\u2014A qualitative study. Chemistry Education Research and Practice, 24(4), 1153\u20131173. https:\/\/doi.org\/10.1039\/D3RP00068K","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR111","doi-asserted-by":"publisher","unstructured":"Prevost, L. B., Haudek, K. C., Merrill, J. E., & Urban-Lurain, M. (2012). Examining student constructed explanations of thermodynamics using lexical analysis. In 42nd Frontiers in Education Conference Proceedings (pp. 1\u20136). IEEE. https:\/\/doi.org\/10.1109\/FIE.2012.6462451","DOI":"10.1109\/FIE.2012.6462451"},{"key":"440_CR112","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2023","unstructured":"R Core Team. (2023). R: A language and environment for statistical computing. [Computer Program]."},{"key":"440_CR113","first-page":"1","volume-title":"Language models are unsupervised multitask learners","author":"A Radford","year":"2019","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 1\u201324. https:\/\/d4mucfpksywv.cloudfront.net\/better-language-models\/language-models.pdf"},{"key":"440_CR114","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1039\/9781839167782-00304","volume-title":"Student reasoning in organic chemistry: Research advances and evidence-based instructional practices","author":"JR Raker","year":"2022","unstructured":"Raker, J. R., Yik, B. J., & Dood, A. J. (2022). Development of a generalizable framework for machine learning-based evaluation of written explanations of reaction mechanisms from the post-secondary organic chemistry curriculum. In N. Graulich & G. V. Shultz (Eds.), Student reasoning in organic chemistry: Research advances and evidence-based instructional practices (pp. 304\u2013319). The Royal Society of Chemistry. https:\/\/doi.org\/10.1039\/9781839167782-00304"},{"issue":"2","key":"440_CR115","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1007\/s10956-020-09862-4","volume":"30","author":"JM Rosenberg","year":"2021","unstructured":"Rosenberg, J. M., & Krist, C. (2021). Combining machine learning and qualitative methods to elaborate students\u2019 ideas about the generality of their model-based explanations. Journal of Science Education and Technology, 30(2), 255\u2013267. https:\/\/doi.org\/10.1007\/s10956-020-09862-4","journal-title":"Journal of Science Education and Technology"},{"key":"440_CR116","volume-title":"RStudio: Integrated development environment for R","author":"RStudio Team","year":"2023","unstructured":"RStudio Team. (2023). RStudio: Integrated development environment for R. [Computer Program]."},{"issue":"1","key":"440_CR117","doi-asserted-by":"publisher","first-page":"49","DOI":"10.5281\/zenodo.3554643","volume":"4","author":"AA Rupp","year":"2012","unstructured":"Rupp, A. A., Levy, R., Dicerbo, K. E., Sweet, S. J., Crawford, A. V., Cali\u00e7o, T., Benson, M., Fay, D., Kunze, K. L., Mislevy, R. J., & Behrens, J. T. (2012). Putting ECD into practice: The interplay of theory and data in evidence models within a digital learning environment. Journal of Educational Data Mining, 4(1), 49\u2013110. https:\/\/doi.org\/10.5281\/zenodo.3554643","journal-title":"Journal of Educational Data Mining"},{"issue":"3","key":"440_CR118","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1002\/sce.20264","volume":"92","author":"RS Russ","year":"2008","unstructured":"Russ, R. S., Scherr, R. E., Hammer, D., & Mikeska, J. (2008). Recognizing mechanistic reasoning in student scientific inquiry: A framework for discourse analysis developed from philosophy of science. Science Education, 92(3), 499\u2013525. https:\/\/doi.org\/10.1002\/sce.20264","journal-title":"Science Education"},{"issue":"101620","key":"440_CR119","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.learninstruc.2022.101620","volume":"83","author":"M Sailer","year":"2023","unstructured":"Sailer, M., Bauer, E., Hofmann, R., Kiesewetter, J., Glas, J., Gurevych, I., & Fischer, F. (2023). Adaptive feedback from artificial neural networks facilitates pre-service teachers\u2019 diagnostic reasoning in simulation-based learning. Learning and Instruction, 83(101620), 1\u201310. https:\/\/doi.org\/10.1016\/j.learninstruc.2022.101620","journal-title":"Learning and Instruction"},{"key":"440_CR120","volume-title":"The coding manual for qualitative researchers","author":"J Saldana","year":"2015","unstructured":"Saldana, J. (2015). The coding manual for qualitative researchers. Sage."},{"issue":"3","key":"440_CR121","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1147\/rd.33.0210","volume":"3","author":"AL Samuel","year":"1959","unstructured":"Samuel, A. L. (1959). Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 211\u2013229. https:\/\/doi.org\/10.1147\/rd.33.0210","journal-title":"IBM Journal of Research and Development"},{"issue":"1","key":"440_CR122","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1039\/C3RP00111C","volume":"15","author":"H Sevian","year":"2014","unstructured":"Sevian, H., & Talanquer, V. (2014). Rethinking chemistry: A learning progression on chemical thinking. Chemistry Education Research and Practice, 15(1), 10\u201323. https:\/\/doi.org\/10.1039\/C3RP00111C","journal-title":"Chemistry Education Research and Practice"},{"issue":"4","key":"440_CR123","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1080\/10508406.2013.836654","volume":"22","author":"B Sherin","year":"2013","unstructured":"Sherin, B. (2013). A computational study of commonsense science: An exploration in the automated analysis of clinical interview data. Journal of the Learning Sciences, 22(4), 600\u2013638. https:\/\/doi.org\/10.1080\/10508406.2013.836654","journal-title":"Journal of the Learning Sciences"},{"issue":"12","key":"440_CR124","doi-asserted-by":"publisher","first-page":"1852","DOI":"10.1021\/acs.jchemed.7b00335","volume":"94","author":"RL Stowe","year":"2017","unstructured":"Stowe, R. L., & Cooper, M. M. (2017). Practicing what we preach: Assessing critical thinking in organic chemistry. Journal of Chemical Education, 94(12), 1852\u20131859. https:\/\/doi.org\/10.1021\/acs.jchemed.7b00335","journal-title":"Journal of Chemical Education"},{"issue":"8","key":"440_CR125","doi-asserted-by":"publisher","first-page":"2490","DOI":"10.1021\/acs.jchemed.1c00532","volume":"98","author":"RL Stowe","year":"2021","unstructured":"Stowe, R. L., Scharlott, L. J., Ralph, V. R., Becker, N. M., & Cooper, M. M. (2021). You are what you assess: The case for emphasizing chemistry on chemistry assessments. Journal of Chemical Education, 98(8), 2490\u20132495. https:\/\/doi.org\/10.1021\/acs.jchemed.1c00532","journal-title":"Journal of Chemical Education"},{"key":"440_CR126","volume-title":"Embeddings in natural language processing: Theory and advances in vector representations of meaning","author":"M Taher Pilehvar","year":"2020","unstructured":"Taher Pilehvar, M., & Camacho-Collados, J. (2020). Embeddings in natural language processing: Theory and advances in vector representations of meaning. Morgan & Claypool."},{"issue":"8","key":"440_CR127","doi-asserted-by":"publisher","first-page":"1091","DOI":"10.1021\/ed4008765","volume":"91","author":"V Talanquer","year":"2014","unstructured":"Talanquer, V. (2014). Chemistry education: Ten heuristics to tame. Journal of Chemical Education, 91(8), 1091\u20131097. https:\/\/doi.org\/10.1021\/ed4008765","journal-title":"Journal of Chemical Education"},{"issue":"4","key":"440_CR128","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1007\/s40593-017-0145-0","volume":"27","author":"C Tansomboon","year":"2017","unstructured":"Tansomboon, C., Gerard, L. F., Vitale, J. M., & Linn, M. C. (2017). Designing automated guidance to promote productive revision of science explanations. International Journal of Artificial Intelligence in Education, 27(4), 729\u2013757. https:\/\/doi.org\/10.1007\/s40593-017-0145-0","journal-title":"International Journal of Artificial Intelligence in Education"},{"issue":"89","key":"440_CR129","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2019.00089","volume":"4","author":"C Tomas","year":"2019","unstructured":"Tomas, C., Whitt, E., Lavelle-Hill, R., & Severn, K. (2019). Modeling holistic marks with analytic rubrics. Frontiers in Education, 4(89), 1\u201319. https:\/\/doi.org\/10.3389\/feduc.2019.00089","journal-title":"Frontiers in Education"},{"key":"440_CR130","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511840005","volume-title":"The uses of argument","author":"SE Toulmin","year":"2003","unstructured":"Toulmin, S. E. (2003). The uses of argument (Rev. ed.). Cambridge University Press.","edition":"Rev. Ed."},{"issue":"2","key":"440_CR131","doi-asserted-by":"publisher","first-page":"020123","DOI":"10.1103\/PhysRevPhysEducRes.19.020123","volume":"19","author":"P Tschisgale","year":"2023","unstructured":"Tschisgale, P., Wulff, P., & Kubsch, M. (2023). Integrating artificial intelligence-based methods into qualitative research in physics education research: A case for computational grounded theory. Physical Review Physics Education Research, 19(2), 020123. https:\/\/doi.org\/10.1103\/PhysRevPhysEducRes.19.020123","journal-title":"Physical Review Physics Education Research"},{"key":"440_CR132","doi-asserted-by":"publisher","unstructured":"Urban-Lurain, M., Prevost, L. B., Haudek, K. C., Henry, E. N., Berry, M., & Merrill, J. E. (2013). Using computerized lexical analysis of student writing to support Just-in-Time Teaching in large enrollment STEM courses. In\u00a043rd Frontiers in Education Conference Proceedings (pp. 1709\u20131715). IEEE. https:\/\/doi.org\/10.1109\/FIE.2013.6685130","DOI":"10.1109\/FIE.2013.6685130"},{"key":"440_CR133","unstructured":"Van Rossum, G., & Drake, F. L. (2009). Python 3 reference manual. CreateSpace."},{"key":"440_CR134","doi-asserted-by":"publisher","first-page":"5998","DOI":"10.48550\/arXiv.1706.03762","volume-title":"Advances in neural information processing systems","author":"A Vaswani","year":"2017","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141, & Polosukhin, I. (2017). Attention is all you need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in neural information processing systems (Vol. 30, pp. 5998\u20136008). Curran Associates, Inc. https:\/\/doi.org\/10.48550\/arXiv.1706.03762"},{"issue":"9","key":"440_CR135","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1080\/09500693.2016.1198969","volume":"38","author":"JM Vitale","year":"2016","unstructured":"Vitale, J. M., McBride, E., & Linn, M. C. (2016). Distinguishing complex ideas about climate change: Knowledge integration vs. specific guidance. International Journal of Science Education, 38(9), 1548\u20131569. https:\/\/doi.org\/10.1080\/09500693.2016.1198969","journal-title":"International Journal of Science Education"},{"issue":"2","key":"440_CR136","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1007\/s10956-020-09859-z","volume":"30","author":"C Wang","year":"2021","unstructured":"Wang, C., Liu, X., Wang, L., Sun, Y., & Zhang, H. (2021). Automated scoring of Chinese grades 7\u20139 students\u2019 competence in interpreting and arguing from evidence. Journal of Science Education and Technology, 30(2), 269\u2013282. https:\/\/doi.org\/10.1007\/s10956-020-09859-z","journal-title":"Journal of Science Education and Technology"},{"key":"440_CR137","unstructured":"Warnes, G. R., Bolker, B., Lumley, T., & Johnson, R. C. (2023). gmodels: Various R programming tools for model fitting. [Computer program]."},{"key":"440_CR138","unstructured":"Waskom, M., Gelbart, M., Botvinnik, O., Ostblom, J., Hobson, P., Lukauskas, S., Gemperline, D. C., Augspurger, T., Halchenko, Y., & Warmenhoven, J. (2020). seaborn. [Computer program]."},{"issue":"2","key":"440_CR139","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1039\/D0RP00298D","volume":"22","author":"FM Watts","year":"2021","unstructured":"Watts, F. M., Zaimi, I., Kranz, D., Graulich, N., & Shultz, G. V. (2021). Investigating students\u2019 reasoning over time for case comparisons of acyl transfer reaction mechanisms. Chemistry Education Research and Practice, 22(2), 364\u2013381. https:\/\/doi.org\/10.1039\/D0RP00298D","journal-title":"Chemistry Education Research and Practice"},{"key":"440_CR140","volume-title":"Student reasoning in organic chemistry: Research advances and evidence-base","author":"FM Watts","year":"2022","unstructured":"Watts, F. M., Dood, A. J., & Shultz, G. V. (2022). Developing machine learning models for automated analysis of organic chemistry students\u2019 written descriptions of organic reaction mechanisms. In N. Graulich & G. V. Shultz (Eds.), Student reasoning in organic chemistry: Research advances and evidence-base."},{"issue":"2","key":"440_CR141","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1039\/C5RP00208G","volume":"17","author":"ML Weinrich","year":"2016","unstructured":"Weinrich, M. L., & Talanquer, V. (2016). Mapping students\u2019 modes of reasoning when thinking about chemical reactions used to make a desired product. Chemistry Education Research and Practice, 17(2), 394\u2013406. https:\/\/doi.org\/10.1039\/C5RP00208G","journal-title":"Chemistry Education Research and Practice"},{"issue":"12","key":"440_CR142","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v021.i12","volume":"21","author":"H Wickham","year":"2007","unstructured":"Wickham, H. (2007). Reshaping data with the reshape package. Journal of Statistical Software, 21(12), 1\u201320. https:\/\/doi.org\/10.18637\/jss.v021.i12","journal-title":"Journal of Statistical Software"},{"key":"440_CR143","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/978-3-319-24277-4_9","volume-title":"ggplot2: Elegant graphics for data analysis","author":"H Wickham","year":"2016","unstructured":"Wickham, H. (2016). Data analysis. In H. Wickham (Ed.), ggplot2: Elegant graphics for data analysis (pp. 189\u2013201). Springer International Publishing. https:\/\/doi.org\/10.1007\/978-3-319-24277-4_9"},{"issue":"43","key":"440_CR144","doi-asserted-by":"publisher","first-page":"1","DOI":"10.21105\/joss.01686","volume":"4","author":"H Wickham","year":"2019","unstructured":"Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D. A., Fran\u00e7ois, R., Grolemund, G., Hayes, A., Henry, L., & Hester, J. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4(43), 1\u20136. https:\/\/doi.org\/10.21105\/joss.01686","journal-title":"Journal of Open Source Software"},{"key":"440_CR145","unstructured":"Wickham, H., Fran\u00e7ois, R., Henry, L., & M\u00fcller, K. (2022). dplyr: A grammar of data manipulation. [Computer program]."},{"issue":"1","key":"440_CR146","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1002\/tea.21864","volume":"61","author":"CD Wilson","year":"2023","unstructured":"Wilson, C. D., Haudek, K. C., Osborne, J. F., Bracey, B., Cheuk, Z. E., Donovan, T., Stuhlsatz, B. M., Santiago, M. A. M., M. M., & Zhai, X. (2023). Using automated analysis to assess middle school students\u2019 competence with scientific argumentation. Journal of Research in Science Teaching, 61(1), 38\u201369. https:\/\/doi.org\/10.1002\/tea.21864","journal-title":"Journal of Research in Science Teaching"},{"key":"440_CR147","doi-asserted-by":"publisher","first-page":"11","DOI":"10.22318\/cscl2021.11","volume-title":"Proceedings of the 14th International Conference on Computer-Supported Collaborative Learning: CSCL 2021","author":"BA Winograd","year":"2021","unstructured":"Winograd, B. A., Dood, A. J., Finkenstaedt-Quinn, S. A., Gere, A. R., & Shultz, G. V. (2021). Automating characterization of peer review comments in chemistry courses. In C. E. Hmelo-Silver, B. De Wever, & J. Oshima (Eds.), Proceedings of the 14th International Conference on Computer-Supported Collaborative Learning: CSCL 2021 (pp. 11\u201318). International Society of the Learning Sciences. https:\/\/doi.org\/10.22318\/cscl2021.11"},{"key":"440_CR148","doi-asserted-by":"publisher","unstructured":"Winograd, B. A., Dood, A. J., Moon, A., Moeller, R., Shultz, G. V., & Gere, A. R. (2021). Detecting high orders of cognitive complexity in students\u2019 reasoning in argumentative writing about ocean acidification. In\u00a011th International Learning Analytics and Knowledge Conference\u00a0(pp. 586\u2013591). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3448139.3448202","DOI":"10.1145\/3448139.3448202"},{"issue":"4","key":"440_CR149","doi-asserted-by":"publisher","first-page":"490","DOI":"10.1007\/s10956-022-09969-w","volume":"31","author":"P Wulff","year":"2022","unstructured":"Wulff, P., Buschh\u00fcter, D., Westphal, A., Mientus, L., Nowak, A., & Borowski, A. (2022). Bridging the gap between qualitative and quantitative assessment in science education research with machine learning\u2014A case for pretrained language models-based clustering. Journal of Science Education and Technology, 31(4), 490\u2013513. https:\/\/doi.org\/10.1007\/s10956-022-09969-w","journal-title":"Journal of Science Education and Technology"},{"issue":"3","key":"440_CR150","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1007\/s40593-022-00290-6","volume":"33","author":"P Wulff","year":"2023","unstructured":"Wulff, P., Mientus, L., Nowak, A., & Borowski, A. (2023). Utilizing a pretrained language model (BERT) to classify preservice physics teachers\u2019 written reflections. International Journal of Artificial Intelligence in Education, 33(3), 439\u2013466. https:\/\/doi.org\/10.1007\/s40593-022-00290-6","journal-title":"International Journal of Artificial Intelligence in Education"},{"issue":"1061461","key":"440_CR151","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/feduc.2022.1061461","volume":"7","author":"P Wulff","year":"2023","unstructured":"Wulff, P., Westphal, A., Mientus, L., Nowak, A., & Borowski, A. (2023). Enhancing writing analytics in science education research with machine learning and natural language processing\u2014formative assessment of science and non-science preservice teachers\u2019 written reflections. Frontiers in Education, 7(1061461), 1\u201318. https:\/\/doi.org\/10.3389\/feduc.2022.1061461","journal-title":"Frontiers in Education"},{"issue":"4","key":"440_CR152","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1039\/D1RP00111F","volume":"22","author":"BJ Yik","year":"2021","unstructured":"Yik, B. J., Dood, A. J., Cruz-Ram\u00edrez de Arellano, D., Fields, K. B., & Raker, J. R. (2021). Development of a machine learning-based tool to evaluate correct Lewis acid\u2013base model use in written responses to open-ended formative assessment items. Chemistry Education Research and Practice, 22(4), 866\u2013885. https:\/\/doi.org\/10.1039\/D1RP00111F","journal-title":"Chemistry Education Research and Practice"},{"issue":"8","key":"440_CR153","doi-asserted-by":"publisher","first-page":"3107","DOI":"10.1021\/acs.jchemed.3c00400","volume":"100","author":"BJ Yik","year":"2023","unstructured":"Yik, B. J., Schreurs, D. G., & Raker, J. R. (2023). Implementation of an R shiny app for instructors: An automated text analysis formative assessment tool for evaluating Lewis acid-base model use. Journal of Chemical Education, 100(8), 3107\u20133113. https:\/\/doi.org\/10.1021\/acs.jchemed.3c00400","journal-title":"Journal of Chemical Education"},{"issue":"1","key":"440_CR154","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1039\/D2RP00184E","volume":"24","author":"BJ Yik","year":"2023","unstructured":"Yik, B. J., Dood, A. J., Frost, S. J. H., Cruz-Ram\u00edrez de Arellano, D., Fields, K. B., & Raker, J. R. (2023). Generalized rubric for level of explanation sophistication for nucleophiles in organic chemistry reaction mechanisms. Chemistry Education Research and Practice, 24(1), 263\u2013282. https:\/\/doi.org\/10.1039\/D2RP00184E","journal-title":"Chemistry Education Research and Practice"},{"issue":"2","key":"440_CR155","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1177\/001316441559002","volume":"76","author":"F Zehner","year":"2016","unstructured":"Zehner, F., S\u00e4lzer, C., & Goldhammer, F. (2016). Automatic Coding of Short text responses via clustering in Educational Assessment. Educational and Psychological Measurement, 76(2), 280\u2013303. https:\/\/doi.org\/10.1177\/001316441559002","journal-title":"Educational and Psychological Measurement"},{"issue":"9","key":"440_CR156","doi-asserted-by":"publisher","first-page":"1430","DOI":"10.1002\/tea.21658","volume":"57","author":"X Zhai","year":"2020","unstructured":"Zhai, X., Haudek, K. C., Shi, L., Nehm, R. H., & Urban-Lurain, M. (2020). From substitution to redefinition: A framework of machine learning-based science assessment. Journal of Research in Science Teaching, 57(9), 1430\u20131459. https:\/\/doi.org\/10.1002\/tea.21658","journal-title":"Journal of Research in Science Teaching"},{"issue":"1","key":"440_CR157","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1080\/03057267.2020.1735757","volume":"56","author":"X Zhai","year":"2020","unstructured":"Zhai, X., Yin, Y., Pellegrino, J. W., Haudek, K. C., & Shi, L. (2020). Applying machine learning in science assessment: A systematic review. Studies in Science Education, 56(1), 111\u2013151. https:\/\/doi.org\/10.1080\/03057267.2020.1735757","journal-title":"Studies in Science Education"},{"key":"440_CR158","volume-title":"kableExtra: Construct complex table with kable and pipe syntax","author":"H Zhu","year":"2022","unstructured":"Zhu, H., Travison, T., Tsai, T., Beasley, W., Xie, Y., Yu, G., Laurent, S., Shepherd, R., & Sidi, Y. (2022). kableExtra: Construct complex table with kable and pipe syntax. [Computer Program]."}],"container-title":["International Journal of Artificial Intelligence in Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00440-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40593-024-00440-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00440-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T18:12:36Z","timestamp":1772647956000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40593-024-00440-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,10]]},"references-count":158,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["440"],"URL":"https:\/\/doi.org\/10.1007\/s40593-024-00440-y","relation":{},"ISSN":["1560-4292","1560-4306"],"issn-type":[{"value":"1560-4292","type":"print"},{"value":"1560-4306","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,10]]},"assertion":[{"value":"6 November 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 December 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All data collection procedures are based on the ethical guidelines of the German Research Foundation.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"The authors have no conflicts of interest to declare.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}},{"value":"Informed consent was obtained from all participants.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}}]}}