{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T01:08:33Z","timestamp":1775092113089,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,21]],"date-time":"2024-09-21T00:00:00Z","timestamp":1726876800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003009","name":"Science and Technology Development Fund (FDCT)","doi-asserted-by":"publisher","award":["0029\/2023\/RIA1"],"award-info":[{"award-number":["0029\/2023\/RIA1"]}],"id":[{"id":"10.13039\/501100003009","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003009","name":"Science and Technology Development Fund (FDCT)","doi-asserted-by":"publisher","award":["22&ZD009"],"award-info":[{"award-number":["22&ZD009"]}],"id":[{"id":"10.13039\/501100003009","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003009","name":"Science and Technology Development Fund (FDCT)","doi-asserted-by":"publisher","award":["22CDJ030"],"award-info":[{"award-number":["22CDJ030"]}],"id":[{"id":"10.13039\/501100003009","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003009","name":"Science and Technology Development Fund (FDCT)","doi-asserted-by":"publisher","award":["201807000122"],"award-info":[{"award-number":["201807000122"]}],"id":[{"id":"10.13039\/501100003009","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012456","name":"National Social Science Foundation of China","doi-asserted-by":"publisher","award":["0029\/2023\/RIA1"],"award-info":[{"award-number":["0029\/2023\/RIA1"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012456","name":"National Social Science Foundation of China","doi-asserted-by":"publisher","award":["22&ZD009"],"award-info":[{"award-number":["22&ZD009"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012456","name":"National Social Science Foundation of China","doi-asserted-by":"publisher","award":["22CDJ030"],"award-info":[{"award-number":["22CDJ030"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012456","name":"National Social Science Foundation of China","doi-asserted-by":"publisher","award":["201807000122"],"award-info":[{"award-number":["201807000122"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["0029\/2023\/RIA1"],"award-info":[{"award-number":["0029\/2023\/RIA1"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["22&ZD009"],"award-info":[{"award-number":["22&ZD009"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["22CDJ030"],"award-info":[{"award-number":["22CDJ030"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["201807000122"],"award-info":[{"award-number":["201807000122"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Constructed response items that require the student to give more detailed and elaborate responses are widely applied in large-scale assessments. However, the hand-craft scoring with a rubric for massive responses is labor-intensive and impractical due to rater subjectivity and answer variability. The automatic response coding method, such as the automatic scoring of short answers, has become a critical component of the learning and assessment system. In this paper, we propose an interactive coding system called ASSIST to efficiently score student responses with expert knowledge and then generate an automatic score classifier. First, the ungraded responses are clustered to generate specific codes, representative responses, and indicator words. The constraint set based on feedback from experts is taken as training data in metric learning to compensate for machine bias. Meanwhile, the classifier from responses to code is trained according to the clustering results. Second, the experts review each coded cluster with the representative responses and indicator words to score a rating. The coded cluster and score pairs will be validated to ensure inter-rater reliability. Finally, the classifier is available for scoring a new response with out-of-distribution detection, which is based on the similarity between response representation and class proxy, i.e., the weight of class in the last linear layer of the classifier. The originality of the system developed stems from the interactive response clustering procedure, which involves expert feedback and an adaptive automatic classifier that can identify new response classes. The proposed system is evaluated on our real-world assessment dataset. The results of the experiments demonstrate the effectiveness of the proposed system in saving human effort and improving scoring performance. The average improvements in clustering quality and scoring accuracy are 14.48% and 18.94%, respectively. Additionally, we reported the inter-rater reliability, out-of-distribution rate, and cluster statistics, before and after interaction.<\/jats:p>","DOI":"10.3390\/systems12090380","type":"journal-article","created":{"date-parts":[[2024,9,24]],"date-time":"2024-09-24T08:54:17Z","timestamp":1727168057000},"page":"380","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Learning to Score: A Coding System for Constructed Response Items via Interactive Clustering"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-4531-923X","authenticated-orcid":false,"given":"Lingjing","family":"Luo","sequence":"first","affiliation":[{"name":"School of Marxism, University of Electronic Science and Technology of China, Chengdu 611731, China"},{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6R 2V4, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7309-8588","authenticated-orcid":false,"given":"Hang","family":"Yang","sequence":"additional","affiliation":[{"name":"Macau Institute of Systems Engineering, Macau University of Science and Technology, Macau, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1547-5503","authenticated-orcid":false,"given":"Zhiwu","family":"Li","sequence":"additional","affiliation":[{"name":"Macau Institute of Systems Engineering, Macau University of Science and Technology, Macau, China"},{"name":"School of Electro-Mechanical Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9335-9930","authenticated-orcid":false,"given":"Witold","family":"Pedrycz","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6R 2V4, Canada"},{"name":"Systems Research Institute, Polish Academy of Sciences, 01-447 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,21]]},"reference":[{"key":"ref_1","first-page":"i-46","article-title":"On the meanings of constructed response","volume":"1991","author":"Bennett","year":"1991","journal-title":"ETS Res. Rep. Ser."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100206","DOI":"10.1016\/j.caeai.2024.100206","article-title":"Automatic assessment of text-based responses in post-secondary education: A systematic review","volume":"6","author":"Gao","year":"2024","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101258","DOI":"10.1016\/j.stueduc.2023.101258","article-title":"Automatic evaluation of open-ended questions for online learning. A systematic mapping","volume":"77","author":"Guarino","year":"2023","journal-title":"Stud. Educ. Eval."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1109\/TLT.2023.3254544","article-title":"Dynamic cognitive diagnosis: An educational priors-enhanced deep knowledge tracing perspective","volume":"16","author":"Wang","year":"2023","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1109\/TLT.2023.3320877","article-title":"A data-driven approach for the identification of features for automated feedback on academic essays","volume":"16","author":"Abbas","year":"2023","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TLT.2022.3175537","article-title":"Automatic short-answer grading via Bert-based deep neural networks","volume":"15","author":"Zhu","year":"2022","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1177\/0013164415590022","article-title":"Automatic coding of short text responses via clustering in educational assessment","volume":"76","author":"Zehner","year":"2015","journal-title":"Educ. Psychol. Meas."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Marvaniya, S., Saha, S., Dhamecha, T.I., Foltz, P., Sindhgatta, R., and Sengupta, B. (2018, January 22\u201326). Creating scoring rubric from representative student answers for improved short answer grading. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, New York, NY, USA.","DOI":"10.1145\/3269206.3271755"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3340960","article-title":"Interactive clustering: A comprehensive review","volume":"53","author":"Bae","year":"2020","journal-title":"ACM Comput. Surv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.compedu.2010.07.013","article-title":"The automatic assessment of free text answers using a modified BLEU algorithm","volume":"56","author":"Noorbehbahani","year":"2011","journal-title":"Comput. Educ."},{"key":"ref_11","unstructured":"Ren, J., Liu, P.J., Fertig, E., Snoek, J., Poplin, R., Depristo, M., Dillon, J., and Lakshminarayanan, B. (2019, January 8\u201314). Likelihood ratios for out-of-distribution detection. Proceedings of the Advances in Neural Information Processing Systems 32: NeurIPS 2019, Vancouver, BC, Canada."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0049124117729703","article-title":"Computational grounded theory: A methodological framework","volume":"49","author":"Nelson","year":"2020","journal-title":"Sociol. Methods Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s40593-014-0026-8","article-title":"The eras and trends of automatic short answer grading","volume":"25","author":"Burrows","year":"2014","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_14","unstructured":"Sukkarieh, J.Z., and Blackmore, J. (2009, January 19\u201321). c-rater: Automatic content scoring for short constructed responses. Proceedings of the Twenty-Second International FLAIRS Conference, Sanibel Island, FL, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sultan, M.A., Salazar, C., and Sumner, T. (2016, January 12\u201317). Fast and easy short answer grading with high accuracy. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1123"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1080\/10494820.2020.1855207","article-title":"Automatic short answer grading by encoding student responses via a graph convolutional network","volume":"31","author":"Tan","year":"2023","journal-title":"Interact. Learn. Environ."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Schneider, J., Schenk, B., Niklaus, C., and Vlachos, M. (2024, January 2\u20134). Towards llm-based auto-grading for short textual answers. Proceedings of the 16th International Conference on Computer Supported Education, Angers, France.","DOI":"10.5220\/0012552200003693"},{"key":"ref_18","unstructured":"Chang, L.H., and Ginter, F. (2024, January 20\u201327). Automatic short answer grading for Finnish with ChatGPT. Proceedings of the 39th AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/TLT.2023.3299359","article-title":"Automatic evaluation of instructional videos based on video features and student watching experience","volume":"17","author":"Min","year":"2024","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zesch, T., Heilman, M., and Cahill, A. (2015, January 4). Reducing annotation efforts in supervised short answer scoring. Proceedings of the 10th Workshop on Innovative Use of NLP for Building Educational Applications, Denver, CO, USA.","DOI":"10.3115\/v1\/W15-0615"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1111\/jcal.12717","article-title":"Semi-automatic coding of open-ended text responses in large-scale assessments","volume":"39","author":"Andersen","year":"2022","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s13042-010-0001-0","article-title":"Understanding bag-of-words model: A statistical framework","volume":"1","author":"Zhang","year":"2010","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_23","unstructured":"Ramos, J. (2003, January 3\u20138). Using TF-IDF to determine word relevance in document queries. Proceedings of the First Instructional Conference on Machine Learning, Piscataway, NJ, USA."},{"key":"ref_24","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Conneau, A., Kiela, D., Schwenk, H., Barrault, L., and Bordes, A. (2017). Supervised learning of universal sentence representations from natural language inference data. arXiv.","DOI":"10.18653\/v1\/D17-1070"},{"key":"ref_26","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"McInnes, L., Healy, J., and Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv.","DOI":"10.21105\/joss.00861"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, D., Zhou, Z.H., and Chen, S. (2007, January 26\u201328). Semi-supervised dimensionality reduction. Proceedings of the 2007 SIAM International Conference on Data Mining, Minneapolis, MN, USA.","DOI":"10.1137\/1.9781611972771.73"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1016\/j.patrec.2011.07.011","article-title":"A new algorithm for initial cluster centers in k-means algorithm","volume":"32","author":"Erisoglu","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"15169","DOI":"10.1007\/s11042-018-6894-4","article-title":"Latent Dirichlet allocation (LDA) and topic modeling: Models, applications, a survey","volume":"78","author":"Jelodar","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3068335","article-title":"DBSCAN revisited, revisited: Why and how you should (still) use DBSCAN","volume":"42","author":"Schubert","year":"2017","journal-title":"ACM Trans. Database Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1002\/widm.53","article-title":"Algorithms for hierarchical clustering: An overview","volume":"2","author":"Murtagh","year":"2011","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Malzer, C., and Baum, M. (2020, January 14\u201316). A hybrid approach to hierarchical density-based cluster selection. Proceedings of the 2020 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Karlsruhe, Germany.","DOI":"10.1109\/MFI49285.2020.9235263"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5414","DOI":"10.1109\/TCYB.2022.3163350","article-title":"Computing and clustering in the environment of order-2 information granules","volume":"53","author":"Pedrycz","year":"2023","journal-title":"IEEE Trans. Cybern."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/TFUZZ.2012.2236842","article-title":"Proximity-based clustering: A search for structural consistency in data with semantic blocks of features","volume":"21","author":"Pedrycz","year":"2013","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1675","DOI":"10.1016\/S0167-8655(02)00130-7","article-title":"Collaborative fuzzy clustering","volume":"23","author":"Pedrycz","year":"2002","journal-title":"Pattern Recognit. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ju, W., Yi, S., Wang, Y., Long, Q., Luo, J., Xiao, Z., and Zhang, M. (2024, January 3\u20139). A survey of data-efficient graph learning. Proceedings of the 33rd International Joint Conference on Artificial Intelligence, Jeju, Republic of Korea.","DOI":"10.24963\/ijcai.2024\/896"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ju, W., Gu, Y., Chen, B., Sun, G., Qin, Y., Liu, X., Luo, X., and Zhang, M. (2023, January 7\u201314). GLCC: A general framework for graph-level clustering. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i4.25559"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1109\/TNNLS.2022.3177775","article-title":"CLEAR: Cluster-enhanced contrast for self-supervised graph representation learning","volume":"35","author":"Luo","year":"2024","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yi, S., Ju, W., Qin, Y., Luo, X., Liu, L., Zhou, Y., and Zhang, M. (2023). Redundancy-free self-supervised relational learning for graph clustering. IEEE Trans. Neural Netw. Learn. Syst., 1\u201315.","DOI":"10.1109\/TNNLS.2023.3314451"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Reimers, N., and Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv.","DOI":"10.18653\/v1\/D19-1410"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., Hinneburg, A., and Keim, D.A. (2001, January 4\u20136). On the surprising behavior of distance metrics in high dimensional space. Proceedings of the 8th International Conference on Database Theory: ICDT 2001, London, UK.","DOI":"10.1007\/3-540-44503-X_27"},{"key":"ref_43","unstructured":"Damrich, S., and Hamprecht, F.A. (2021, January 6\u201314). On UMAP\u2019s true loss function. Proceedings of the 35th Conference on Neural Information Processing Systems: NeurIPS 2021, Virtual Conference."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"205","DOI":"10.21105\/joss.00205","article-title":"Hdbscan: Hierarchical density based clustering","volume":"2","author":"McInnes","year":"2017","journal-title":"J. Open Source Softw."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"3669","DOI":"10.1109\/TKDE.2020.3028943","article-title":"Deep feature-based text clustering and its explanation","volume":"34","author":"Guan","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhang, Z., and Xiang, X. (2023, January 17\u201324). Decoupling maxlogit for out-of-distribution detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00330"},{"key":"ref_47","unstructured":"Sun, Y., Ming, Y., Zhu, X., and Li, Y. (2022, January 17\u201323). Out-of-distribution detection with deep nearest neighbors. Proceedings of the 39th International Conference on Machine Learning, PMLR 162, Baltimore, MD, USA."},{"key":"ref_48","unstructured":"Jiao, Z., Sun, S., and Sun, K. (2018). Chinese lexical analysis with deep Bi-GRU-CRF network. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_50","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J. Comput. Appl. Math."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv.","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., and Xu, B. (2016, January 7\u201312). Attention-based bidirectional long short-term memory networks for relation classification. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-2034"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wang, T., Inoue, N., Ouchi, H., Mizumoto, T., and Inui, K. (2019, January 3). Inject rubrics into short answer grading system. Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP: DeepLo 2019, Hong Kong, China.","DOI":"10.18653\/v1\/D19-6119"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Qi, H., Wang, Y., Dai, J., Li, J., and Di, X. (2019, January 8\u201310). Attention-based hybrid model for automatic short answer scoring. Proceedings of the 11th International Conference on Simulation Tools and Techniques: SIMUtools 2019, Chengdu, China.","DOI":"10.1007\/978-3-030-32216-8_37"},{"key":"ref_56","unstructured":"Condor, A., Litster, M., and Pardos, Z. (2021, January 29). Automatic short answer grading with SBERT on out-of-sample questions. Proceedings of the 14th Iteration of the Conference, Educational Data Mining, Virtual Conference."},{"key":"ref_57","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/9\/380\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:01:28Z","timestamp":1760112088000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/9\/380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,21]]},"references-count":57,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["systems12090380"],"URL":"https:\/\/doi.org\/10.3390\/systems12090380","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,21]]}}}