{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:46:26Z","timestamp":1776120386895,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":55,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,3,18]]},"DOI":"10.1145\/3636555.3636911","type":"proceedings-article","created":{"date-parts":[[2024,3,5]],"date-time":"2024-03-05T18:11:20Z","timestamp":1709662280000},"page":"529-539","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Using Think-Aloud Data to Understand Relations between Self-Regulation Cycle Characteristics and Student Performance in Intelligent Tutoring Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3437-8979","authenticated-orcid":false,"given":"Conrad","family":"Borchers","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7334-4256","authenticated-orcid":false,"given":"Jiayi","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3051-3232","authenticated-orcid":false,"given":"Ryan S.","family":"Baker","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1581-6657","authenticated-orcid":false,"given":"Vincent","family":"Aleven","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,3,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45108-0_33"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1435344.1435346"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-015-0088-2"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2022.813632"},{"key":"e_1_3_2_1_5_1","volume-title":"Does adaptive scaffolding facilitate students","author":"Azevedo Roger","year":"2004","unstructured":"Roger Azevedo, Jennifer\u00a0G Cromley, and Diane Seibert. 2004. Does adaptive scaffolding facilitate students\u2019 ability to regulate their learning with hypermedia?Contemporary educational psychology 29, 3 (2004), 344\u2013370."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.03.025"},{"key":"e_1_3_2_1_7_1","volume-title":"Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?Educational Technology Research and Development 56","author":"Azevedo Roger","year":"2008","unstructured":"Roger Azevedo, Daniel\u00a0C Moos, Jeffrey\u00a0A Greene, Fielding\u00a0I Winters, and Jennifer\u00a0G Cromley. 2008. Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?Educational Technology Research and Development 56 (2008), 45\u201372."},{"key":"e_1_3_2_1_8_1","volume-title":"Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational psychologist 45, 4","author":"Azevedo Roger","year":"2010","unstructured":"Roger Azevedo, Daniel\u00a0C Moos, Amy\u00a0M Johnson, and Amber\u00a0D Chauncey. 2010. Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational psychologist 45, 4 (2010), 210\u2013223."},{"key":"e_1_3_2_1_9_1","volume-title":"Process mining techniques for analysing patterns and strategies in students","author":"Bannert Maria","year":"2014","unstructured":"Maria Bannert, Peter Reimann, and Christoph Sonnenberg. 2014. Process mining techniques for analysing patterns and strategies in students\u2019 self-regulated learning. Metacognition and learning 9 (2014), 161\u2013185."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.58459\/rptel.2010.5123-152"},{"key":"e_1_3_2_1_12_1","volume-title":"Linear and generalized linear mixed models. Ecological statistics: contemporary theory and application","author":"Bolker M","year":"2015","unstructured":"Benjamin\u00a0M Bolker. 2015. Linear and generalized linear mixed models. Ecological statistics: contemporary theory and application (2015), 309\u2013333."},{"key":"e_1_3_2_1_13_1","volume-title":"Comparing Paper and AI Tutoring. In European Conference on Technology Enhanced Learning. Springer, 44\u201359","author":"Borchers Conrad","year":"2023","unstructured":"Conrad Borchers, Paulo\u00a0F Carvalho, Meng Xia, Pinyang Liu, Kenneth\u00a0R Koedinger, and Vincent Aleven. 2023. What Makes Problem-Solving Practice Effective? Comparing Paper and AI Tutoring. In European Conference on Technology Enhanced Learning. Springer, 44\u201359."},{"key":"e_1_3_2_1_14_1","volume-title":"Instructional Factors Analysis: A Cognitive Model For Multiple Instructional Interventions. In EDM 2011 4 th International Conference on Educational Data Mining.","author":"Chi Min","unstructured":"Min Chi, Kenneth Koedinger, Geoff Gordon, and Pamela Jordan. 61. Instructional Factors Analysis: A Cognitive Model For Multiple Instructional Interventions. In EDM 2011 4 th International Conference on Educational Data Mining."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301400"},{"key":"e_1_3_2_1_16_1","volume-title":"Model-dependent variance inflation factor cutoff values. Quality engineering 14, 3","author":"Craney A","year":"2002","unstructured":"Trevor\u00a0A Craney and James\u00a0G Surles. 2002. Model-dependent variance inflation factor cutoff values. Quality engineering 14, 3 (2002), 391\u2013403."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13369-020-05117-x"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1039\/B812409B"},{"key":"e_1_3_2_1_19_1","volume-title":"Towards a fuller picture: Triangulation and integration of the measurement of self-regulated learning based on trace and think aloud data. Journal of Computer Assisted Learning","author":"Fan Yizhou","year":"2023","unstructured":"Yizhou Fan, Mladen Rakovic, Joep van Der\u00a0Graaf, Lyn Lim, Shaveen Singh, Johanna Moore, Inge Molenaar, Maria Bannert, and Dragan Ga\u0161evi\u0107. 2023. Towards a fuller picture: Triangulation and integration of the measurement of self-regulated learning based on trace and think aloud data. Journal of Computer Assisted Learning (2023)."},{"key":"e_1_3_2_1_20_1","volume-title":"Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods.Psychological bulletin 137, 2","author":"Fox C","year":"2011","unstructured":"Mark\u00a0C Fox, K\u00a0Anders Ericsson, and Ryan Best. 2011. Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods.Psychological bulletin 137, 2 (2011), 316."},{"key":"e_1_3_2_1_21_1","volume-title":"Enhancing Engagement Modeling in Game-Based Learning Environments with Student-Agent Discourse Analysis. In International Conference on Artificial Intelligence in Education. Springer, 681\u2013687","author":"Goslen Alex","year":"2023","unstructured":"Alex Goslen, Nathan Henderson, Jonathan Rowe, Jiayi Zhang, Stephen Hutt, Jaclyn Ocumpaugh, Eric Wiebe, Kristy\u00a0Elizabeth Boyer, Bradford Mott, and James Lester. 2023. Enhancing Engagement Modeling in Game-Based Learning Environments with Student-Agent Discourse Analysis. In International Conference on Artificial Intelligence in Education. Springer, 681\u2013687."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2022.100881"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-020-09519-0"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448139.3448155"},{"key":"e_1_3_2_1_25_1","volume-title":"Investigating SMART Models of Self-Regulation and Their Impact on Learning","author":"Hutt Stephen","year":"2021","unstructured":"Stephen Hutt, Jaclyn Ocumpaugh, Juliana Ma, Alexandra\u00a0L Andres, Nigel Bosch, Luc Paquette, Gautam Biswas, and Ryan\u00a0S Baker. 2021. Investigating SMART Models of Self-Regulation and Their Impact on Learning.International Educational Data Mining Society (2021)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Emily\u00a0C King Max Benson Sandra Raysor Thomas\u00a0A Holme Jonathan Sewall Kenneth\u00a0R Koedinger Vincent Aleven and David\u00a0J Yaron. 2022. The Open-Response Chemistry Cognitive Assistance Tutor System: Development and Implementation.","DOI":"10.1021\/acs.jchemed.1c00947"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1201\/b10274-6"},{"key":"e_1_3_2_1_28_1","first-page":"1","article-title":"Temporal structures and sequential patterns of self-regulated learning behaviors in problem solving with an intelligent tutoring system","volume":"25","author":"Li Shan","year":"2022","unstructured":"Shan Li, Juan Zheng, and Susanne\u00a0P Lajoie. 2022. Temporal structures and sequential patterns of self-regulated learning behaviors in problem solving with an intelligent tutoring system. Educational Technology & Society 25, 4 (2022), 1\u201314.","journal-title":"Educational Technology & Society"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.749749"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107547"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39583-8_9"},{"key":"e_1_3_2_1_32_1","volume-title":"Polite web-based intelligent tutors: Can they improve learning in classrooms?Computers & Education 56, 3","author":"McLaren M","year":"2011","unstructured":"Bruce\u00a0M McLaren, Krista\u00a0E DeLeeuw, and Richard\u00a0E Mayer. 2011. Polite web-based intelligent tutors: Can they improve learning in classrooms?Computers & Education 56, 3 (2011), 574\u2013584."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/11774303_32"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107540"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12761"},{"key":"e_1_3_2_1_36_1","volume-title":"A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology 8","author":"Panadero Ernesto","year":"2017","unstructured":"Ernesto Panadero. 2017. A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology 8 (2017), 422."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460320"},{"key":"e_1_3_2_1_38_1","volume-title":"Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed?Educational psychologist 40, 1","author":"Puntambekar Sadhana","year":"2005","unstructured":"Sadhana Puntambekar and Roland Hubscher. 2005. Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed?Educational psychologist 40, 1 (2005), 1\u201312."},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 40th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0202)","author":"Radford Alec","year":"2023","unstructured":"Alec Radford, Jong\u00a0Wook Kim, Tao Xu, Greg Brockman, Christine Mcleavey, and Ilya Sutskever. 2023. Robust Speech Recognition via Large-Scale Weak Supervision. In Proceedings of the 40th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0202), Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 28492\u201328518. https:\/\/proceedings.mlr.press\/v202\/radford23a.html"},{"key":"e_1_3_2_1_40_1","volume-title":"Improving students","author":"Roll Ido","year":"2011","unstructured":"Ido Roll, Vincent Aleven, Bruce\u00a0M McLaren, and Kenneth\u00a0R Koedinger. 2011. Improving students\u2019 help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and instruction 21, 2 (2011), 267\u2013280."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508406.2014.883977"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-019-09188-6"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39112-5_22"},{"key":"e_1_3_2_1_44_1","volume-title":"Temporally-focused analytics of self-regulated learning: A systematic review of literature. Computers and education: Artificial intelligence 3","author":"Saint John","year":"2022","unstructured":"John Saint, Yizhou Fan, Dragan Ga\u0161evi\u0107, and Abelardo Pardo. 2022. Temporally-focused analytics of self-regulated learning: A systematic review of literature. Computers and education: Artificial intelligence 3 (2022), 100060."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2015.21.3"},{"key":"e_1_3_2_1_46_1","volume-title":"Proceedings of the 15th International Conference on Educational Data Mining. 98","author":"Swamy Vinitra","year":"2022","unstructured":"Vinitra Swamy, Bahar Radmehr, Natasa Krco, Mirko Marras, and Tanja K\u00e4ser. 2022. Evaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs. In Proceedings of the 15th International Conference on Educational Data Mining. 98."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/10986065.2013.770717"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijer.2005.08.012"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2010.517150"},{"key":"e_1_3_2_1_50_1","volume-title":"Handbook of learning analytics","author":"Winne H","year":"2017","unstructured":"Philip\u00a0H Winne. 2017. Handbook of learning analytics. Society for learning analytics research (2017), 241\u2013249."},{"key":"e_1_3_2_1_51_1","volume-title":"Metacognition in Educational Theory and Practice, Douglas\u00a0J","author":"Winne H.","unstructured":"Philip\u00a0H. Winne and Allyson\u00a0F. Hadwin. 1998. Studying as Self-Regulated Learning. In Metacognition in Educational Theory and Practice, Douglas\u00a0J. Hacker, John Dunlosky, and Arthur\u00a0C. Graesser (Eds.). Erlbaum, Hillsdale, NJ, 277\u2013304."},{"key":"e_1_3_2_1_52_1","volume-title":"Stephen Hutt, Ryan\u00a0S Baker, Jaclyn Ocumpaugh, Caitlin Mills, Jamiella Brooks, Sheela Sethuraman, and Tyron Young.","author":"Zhang Jiayi","year":"2022","unstructured":"Jiayi Zhang, Juliana Ma Alexandra\u00a0L Andres, Stephen Hutt, Ryan\u00a0S Baker, Jaclyn Ocumpaugh, Caitlin Mills, Jamiella Brooks, Sheela Sethuraman, and Tyron Young. 2022. Detecting SMART Model Cognitive Operations in Mathematical Problem-Solving Process.International Educational Data Mining Society (2022)."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3506860.3506887"},{"key":"e_1_3_2_1_54_1","volume-title":"Self-regulated learning and academic achievement: An overview. Educational psychologist 25, 1","author":"Zimmerman J","year":"1990","unstructured":"Barry\u00a0J Zimmerman. 1990. Self-regulated learning and academic achievement: An overview. Educational psychologist 25, 1 (1990), 3\u201317."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012109890-2\/50031-7"}],"event":{"name":"LAK '24: The 14th Learning Analytics and Knowledge Conference","location":"Kyoto Japan","acronym":"LAK '24"},"container-title":["Proceedings of the 14th Learning Analytics and Knowledge Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3636555.3636911","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3636555.3636911","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T01:22:29Z","timestamp":1758072149000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3636555.3636911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,18]]},"references-count":55,"alternative-id":["10.1145\/3636555.3636911","10.1145\/3636555"],"URL":"https:\/\/doi.org\/10.1145\/3636555.3636911","relation":{},"subject":[],"published":{"date-parts":[[2024,3,18]]},"assertion":[{"value":"2024-03-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}