{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T22:32:58Z","timestamp":1785364378670,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T00:00:00Z","timestamp":1740960000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,3,3]]},"DOI":"10.1145\/3706468.3706507","type":"proceedings-article","created":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:04:11Z","timestamp":1740146651000},"page":"293-305","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":68,"title":["Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1108-8283","authenticated-orcid":false,"given":"Changrong","family":"Xiao","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4320-7948","authenticated-orcid":false,"given":"Wenxing","family":"Ma","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3086-9027","authenticated-orcid":false,"given":"Qingping","family":"Song","sequence":"additional","affiliation":[{"name":"Hong Kong Baptist University, Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9453-8404","authenticated-orcid":false,"given":"Sean Xin","family":"Xu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1474-3169","authenticated-orcid":false,"given":"Kunpeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1063-4360","authenticated-orcid":false,"given":"Yufang","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing Xicheng Educational Research Institute, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2187-9216","authenticated-orcid":false,"given":"Qi","family":"Fu","sequence":"additional","affiliation":[{"name":"Beijing Xicheng Educational Research Institute, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,3,3]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","unstructured":"Samuel\u00a0C Bellini-Leite. 2023. Dual Process Theory for Large Language Models: An overview of using Psychology to address hallucination and reliability issues. Adaptive Behavior (2023). 10.1177\/10597123231206604","DOI":"10.1177\/10597123231206604"},{"key":"e_1_3_3_2_4_2","unstructured":"Martin Benfeghoul Umais Zahid Qinghai Guo and Zafeirios Fountas. 2024. When in Doubt Think Slow: Iterative Reasoning with Latent Imagination. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2402.15283 (2024)."},{"key":"e_1_3_3_2_5_2","first-page":"2285","volume-title":"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)","author":"Boquio Eujene Nikka\u00a0V.","year":"2024","unstructured":"Eujene Nikka\u00a0V. Boquio and Prospero\u00a0C. Naval, Jr.2024. Beyond Canonical Fine-tuning: Leveraging Hybrid Multi-Layer Pooled Representations of BERT for Automated Essay Scoring. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, and Nianwen Xue (Eds.). ELRA and ICCL, Torino, Italia, 2285\u20132295. https:\/\/aclanthology.org\/2024.lrec-main.204"},{"key":"e_1_3_3_2_6_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1810.04805 (2018)."},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1115"},{"key":"e_1_3_3_2_8_2","unstructured":"Eva Eigner and Thorsten H\u00e4ndler. 2024. Determinants of LLM-assisted Decision-Making. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2402.17385 (2024)."},{"key":"e_1_3_3_2_9_2","unstructured":"Fabricio Goes Zisen Zhou Piotr Sawicki Marek Grzes and Daniel\u00a0G Brown. 2022. Crowd score: A method for the evaluation of jokes using large language model AI voters as judges. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2212.11214 (2022)."},{"key":"e_1_3_3_2_10_2","unstructured":"Jieun Han Haneul Yoo Junho Myung Minsun Kim Hyunseung Lim Yoonsu Kim Tak\u00a0Yeon Lee Hwajung Hong Juho Kim So-Yeon Ahn et\u00a0al. 2023. FABRIC: Automated Scoring and Feedback Generation for Essays. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2310.05191 (2023)."},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Kenneth Holstein and Vincent Aleven. 2022. Designing for human\u2013AI complementarity in K-12 education. AI Magazine 43 2 (2022) 239\u2013248.","DOI":"10.1002\/aaai.12058"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.123"},{"key":"e_1_3_3_2_13_2","volume-title":"Thinking, Fast and Slow","author":"Kahneman D.","year":"2011","unstructured":"D. Kahneman. 2011. Thinking, Fast and Slow. Farrar, Straus and Giroux. https:\/\/books.google.com.tr\/books?id=AV9x8XakdV0C"},{"key":"e_1_3_3_2_14_2","unstructured":"Mahammed Kamruzzaman and Gene\u00a0Louis Kim. 2024. Prompting Techniques for Reducing Social Bias in LLMs through System 1 and System 2 Cognitive Processes. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2404.17218 (2024)."},{"key":"e_1_3_3_2_15_2","volume-title":"International Conference on Learning Representations","author":"Khandelwal Urvashi","year":"2020","unstructured":"Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through Memorization: Nearest Neighbor Language Models. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=HklBjCEKvH"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.findings-emnlp.38"},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.291"},{"key":"e_1_3_3_2_18_2","unstructured":"Bill\u00a0Yuchen Lin Yicheng Fu Karina Yang Faeze Brahman Shiyu Huang Chandra Bhagavatula Prithviraj Ammanabrolu Yejin Choi and Xiang Ren. 2024. Swiftsage: A generative agent with fast and slow thinking for complex interactive tasks. Advances in Neural Information Processing Systems 36 (2024)."},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i09.7062"},{"key":"e_1_3_3_2_20_2","volume-title":"Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018)","author":"Mathias Sandeep","year":"2018","unstructured":"Sandeep Mathias and Pushpak Bhattacharyya. 2018. ASAP++: Enriching the ASAP automated essay grading dataset with essay attribute scores. In Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018)."},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-3705"},{"key":"e_1_3_3_2_22_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1301.3781 (2013)."},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Eleni Miltsakaki and Karen Kukich. 2004. Evaluation of text coherence for electronic essay scoring systems. Natural Language Engineering 10 1 (2004) 25\u201355.","DOI":"10.1017\/S1351324903003206"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"crossref","unstructured":"Atsushi Mizumoto and Masaki Eguchi. 2023. Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics 2 2 (2023) 100050.","DOI":"10.1016\/j.rmal.2023.100050"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.bea-1.32"},{"key":"e_1_3_3_2_26_2","unstructured":"Long Ouyang Jeffrey Wu Xu Jiang Diogo Almeida Carroll Wainwright Pamela Mishkin Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray et\u00a0al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022) 27730\u201327744."},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Ori Ram Yoav Levine Itay Dalmedigos Dor Muhlgay Amnon Shashua Kevin Leyton-Brown and Yoav Shoham. 2023. In-context retrieval-augmented language models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2302.00083 (2023).","DOI":"10.1162\/tacl_a_00605"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Dadi Ramesh and Suresh\u00a0Kumar Sanampudi. 2022. An automated essay scoring systems: a systematic literature review. Artificial Intelligence Review 55 3 (2022) 2495\u20132527.","DOI":"10.1007\/s10462-021-10068-2"},{"key":"e_1_3_3_2_30_2","unstructured":"Robert Ridley Liang He Xinyu Dai Shujian Huang and Jiajun Chen. 2020. Prompt agnostic essay scorer: a domain generalization approach to cross-prompt automated essay scoring. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2008.01441 (2020)."},{"key":"e_1_3_3_2_31_2","unstructured":"Pedro\u00a0Uria Rodriguez Amir Jafari and Christopher\u00a0M Ormerod. 2019. Language models and automated essay scoring. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1909.09482 (2019)."},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TALE48000.2019.9226022"},{"key":"e_1_3_3_2_33_2","unstructured":"Sheng Shen Le Hou Yanqi Zhou Nan Du Shayne Longpre Jason Wei Hyung\u00a0Won Chung Barret Zoph William Fedus Xinyun Chen et\u00a0al. 2023. Mixture-of-experts meets instruction tuning: A winning combination for large language models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.14705 (2023)."},{"key":"e_1_3_3_2_34_2","unstructured":"Weijia Shi Sewon Min Michihiro Yasunaga Minjoon Seo Rich James Mike Lewis Luke Zettlemoyer and Wen-tau Yih. 2023. Replug: Retrieval-augmented black-box language models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2301.12652 (2023)."},{"key":"e_1_3_3_2_35_2","unstructured":"Maja Stahl Leon Biermann Andreas Nehring and Henning Wachsmuth. 2024. Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2404.15845 (2024)."},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1123"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1193"},{"key":"e_1_3_3_2_38_2","unstructured":"Xiaoyu Tian Liangyu Chen Na Liu Yaxuan Liu Wei Zou Kaijiang Chen and Ming Cui. 2023. DUMA: a Dual-Mind Conversational Agent with Fast and Slow Thinking. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2310.18075 (2023)."},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-22341-0_45"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.249"},{"key":"e_1_3_3_2_41_2","unstructured":"Ziqi Wang Le Hou Tianjian Lu Yuexin Wu Yunxuan Li Hongkun Yu and Heng Ji. 2023. Enable Language Models to Implicitly Learn Self-Improvement From Data. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2310.00898 (2023)."},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Peter\u00a0C Wason and J\u00a0St\u00a0BT Evans. 1974. Dual processes in reasoning? Cognition 3 2 (1974) 141\u2013154.","DOI":"10.1016\/0010-0277(74)90017-1"},{"key":"e_1_3_3_2_43_2","unstructured":"Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Fei Xia Ed Chi Quoc\u00a0V Le Denny Zhou et\u00a0al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022) 24824\u201324837."},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.bea-1.49"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.141"},{"key":"e_1_3_3_2_46_2","unstructured":"Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu Yonghao Zhuang Zi Lin Zhuohan Li Dacheng Li Eric Xing et\u00a0al. 2023. Judging LLM-as-a-judge with MT-Bench and Chatbot Arena. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2306.05685 (2023)."},{"key":"e_1_3_3_2_47_2","volume-title":"The Eleventh International Conference on Learning Representations","author":"Zhou Denny","year":"2023","unstructured":"Denny Zhou, Nathanael Sch\u00e4rli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc\u00a0V Le, and Ed\u00a0H. Chi. 2023. Least-to-Most Prompting Enables Complex Reasoning in Large Language Models. In The Eleventh International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=WZH7099tgfM"}],"event":{"name":"LAK '25: The 15th International Learning Analytics and Knowledge Conference","location":"Dublin Ireland","acronym":"LAK 2025"},"container-title":["Proceedings of the 15th International Learning Analytics and Knowledge Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706468.3706507","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706468.3706507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:56:50Z","timestamp":1750298210000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706468.3706507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,3]]},"references-count":46,"alternative-id":["10.1145\/3706468.3706507","10.1145\/3706468"],"URL":"https:\/\/doi.org\/10.1145\/3706468.3706507","relation":{},"subject":[],"published":{"date-parts":[[2025,3,3]]},"assertion":[{"value":"2025-03-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}