{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T16:44:00Z","timestamp":1779122640608,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T00:00:00Z","timestamp":1623110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","award":["1553071"],"award-info":[{"award-number":["1553071"]}],"id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,8]]},"DOI":"10.1145\/3430895.3460127","type":"proceedings-article","created":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T01:27:20Z","timestamp":1623029240000},"page":"69-76","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Automating the Assessment of Problem-solving Practices Using Log Data and Data Mining Techniques"],"prefix":"10.1145","author":[{"given":"Karen D.","family":"Wang","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shima","family":"Salehi","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max","family":"Arseneault","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krishnan","family":"Nair","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carl","family":"Wieman","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,8]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Combining unsupervised and supervised classification to build user models for exploratory learning environments. JEDM| Journal of Educational Data Mining 1, 1","author":"Amershi Saleema","year":"2009","unstructured":"Saleema Amershi and Cristina Conati . 2009. Combining unsupervised and supervised classification to build user models for exploratory learning environments. JEDM| Journal of Educational Data Mining 1, 1 ( 2009 ), 18--71. Saleema Amershi and Cristina Conati. 2009. Combining unsupervised and supervised classification to build user models for exploratory learning environments. JEDM| Journal of Educational Data Mining 1, 1 (2009), 18--71."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.05.021"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12128"},{"key":"e_1_3_2_2_4_1","volume-title":"Learning analytics","author":"Baker Ryan Shaun","unstructured":"Ryan Shaun Baker and Paul Salvador Inventado . 2014. Educational data mining and learning analytics . In Learning analytics . Springer , 61--75. Ryan Shaun Baker and Paul Salvador Inventado. 2014. Educational data mining and learning analytics. In Learning analytics. Springer, 61--75."},{"key":"e_1_3_2_2_5_1","volume-title":"Educational assessment: What to watch in a rapidly changing world. Educational measurement: issues and practice 37, 4","author":"Bennett Randy E","year":"2018","unstructured":"Randy E Bennett . 2018. Educational assessment: What to watch in a rapidly changing world. Educational measurement: issues and practice 37, 4 ( 2018 ), 7--15. Randy E Bennett. 2018. Educational assessment: What to watch in a rapidly changing world. Educational measurement: issues and practice 37, 4 (2018), 7--15."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/15391523.2010.10782553"},{"key":"e_1_3_2_2_7_1","volume-title":"Retrieved","author":"ABET Engineering Accreditation Commission","year":"2020","unstructured":"ABET Engineering Accreditation Commission . 2020 . Criteria for Accrediting Engineering Programs 2020--2021. (Sept. 2020) . Retrieved September 30, 2020 from https: \/\/www.abet.org\/accreditation\/accreditation-criteria\/ ABET Engineering Accreditation Commission. 2020. Criteria for Accrediting Engineering Programs 2020--2021. (Sept. 2020). Retrieved September 30, 2020 from https: \/\/www.abet.org\/accreditation\/accreditation-criteria\/"},{"key":"e_1_3_2_2_8_1","volume-title":"AI in Education needs interpretable machine learning: Lessons from Open Learner Modelling. arXiv preprint arXiv:1807.00154","author":"Conati Cristina","year":"2018","unstructured":"Cristina Conati , Kaska Porayska-Pomsta , and Manolis Mavrikis . 2018. AI in Education needs interpretable machine learning: Lessons from Open Learner Modelling. arXiv preprint arXiv:1807.00154 ( 2018 ). Cristina Conati, Kaska Porayska-Pomsta, and Manolis Mavrikis. 2018. AI in Education needs interpretable machine learning: Lessons from Open Learner Modelling. arXiv preprint arXiv:1807.00154 (2018)."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508406.2013.837391"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2015.10.018"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3027422"},{"key":"e_1_3_2_2_12_1","first-page":"190","article-title":"A contextualized, differential sequence mining method to derive students' learning behavior patterns","volume":"5","author":"Kinnebrew John S","year":"2013","unstructured":"John S Kinnebrew , Kirk M Loretz , and Gautam Biswas . 2013 . A contextualized, differential sequence mining method to derive students' learning behavior patterns . Journal of Educational Data Mining 5 , 1 (2013), 190 -- 219 . John S Kinnebrew, Kirk M Loretz, and Gautam Biswas. 2013. A contextualized, differential sequence mining method to derive students' learning behavior patterns. Journal of Educational Data Mining 5, 1 (2013), 190--219.","journal-title":"Journal of Educational Data Mining"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.4937964"},{"key":"e_1_3_2_2_14_1","volume-title":"Dancing with robots: Human skills for computerized work","author":"Levy Frank","year":"2013","unstructured":"Frank Levy and Richard J Murnane . 2013. Dancing with robots: Human skills for computerized work . Washington, DC : Third Way NEXT ( 2013 ), 5--35. Frank Levy and Richard J Murnane. 2013. Dancing with robots: Human skills for computerized work. Washington, DC: Third Way NEXT (2013), 5--35."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1787\/9789264190511-en"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-61425-0_24"},{"key":"e_1_3_2_2_17_1","volume-title":"PhET: Interactive simulations for teaching and learning physics. The physics teacher 44, 1","author":"Perkins Katherine","year":"2006","unstructured":"Katherine Perkins , Wendy Adams , Michael Dubson , Noah Finkelstein , Sam Reid , Carl Wieman , and Ron LeMaster . 2006. PhET: Interactive simulations for teaching and learning physics. The physics teacher 44, 1 ( 2006 ), 18--23. Katherine Perkins, Wendy Adams, Michael Dubson, Noah Finkelstein, Sam Reid, Carl Wieman, and Ron LeMaster. 2006. PhET: Interactive simulations for teaching and learning physics. The physics teacher 44, 1 (2006), 18--23."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969296"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/02635143.2019.1600490"},{"key":"e_1_3_2_2_20_1","volume-title":"Technology and testing. science 323, 5910","author":"Quellmalz Edys S","year":"2009","unstructured":"Edys S Quellmalz and James W Pellegrino . 2009. Technology and testing. science 323, 5910 ( 2009 ), 75--79. Edys S Quellmalz and James W Pellegrino. 2009. Technology and testing. science 323, 5910 (2009), 75--79."},{"key":"e_1_3_2_2_21_1","volume-title":"Improving problem-solving through reflection","author":"Salehi Shima","unstructured":"Shima Salehi . 2018. Improving problem-solving through reflection . Stanford University . Shima Salehi. 2018. Improving problem-solving through reflection. Stanford University."},{"key":"e_1_3_2_2_22_1","volume-title":"Retrieved","author":"Lead States NGSS","year":"2013","unstructured":"NGSS Lead States . 2013 . Next Generation Science Standards: For States, By States. (July 2013) . Retrieved July 30, 2019 from http:\/\/www.nextgenscience.org\/ NGSS Lead States. 2013. Next Generation Science Standards: For States, By States. (July 2013). Retrieved July 30, 2019 from http:\/\/www.nextgenscience.org\/"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.21657"},{"key":"e_1_3_2_2_24_1","first-page":"5","article-title":"The future of data-enriched assessment","volume":"9","author":"Thille Candace","year":"2014","unstructured":"Candace Thille , Emily Schneider , Ren\u00e9 F Kizilcec , Christopher Piech , Sherif A Halawa , and Daniel K Greene . 2014 . The future of data-enriched assessment . Research & Practice in Assessment 9 (2014), 5 -- 16 . Candace Thille, Emily Schneider, Ren\u00e9 F Kizilcec, Christopher Piech, Sherif A Halawa, and Daniel K Greene. 2014. The future of data-enriched assessment. Research & Practice in Assessment 9 (2014), 5--16.","journal-title":"Research & Practice in Assessment"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12033"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2168-9830.2000.tb00551.x"},{"key":"e_1_3_2_2_27_1","volume-title":"Modelling mathematics problem solving item responses using a multidimensional IRT model. Mathematics education research journal 18, 2","author":"Wu Margaret","year":"2006","unstructured":"Margaret Wu and Raymond Adams . 2006. Modelling mathematics problem solving item responses using a multidimensional IRT model. Mathematics education research journal 18, 2 ( 2006 ), 93--113. Margaret Wu and Raymond Adams. 2006. Modelling mathematics problem solving item responses using a multidimensional IRT model. Mathematics education research journal 18, 2 (2006), 93--113."},{"key":"e_1_3_2_2_28_1","volume-title":"A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements. Journal of Science Education and Technology","author":"Zhai Xiaoming","year":"2020","unstructured":"Xiaoming Zhai , Lehong Shi , and Ross H Nehm . 2020a. A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements. Journal of Science Education and Technology ( 2020 ), 1--19. Xiaoming Zhai, Lehong Shi, and Ross H Nehm. 2020a. A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements. Journal of Science Education and Technology (2020), 1--19."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/03057267.2020.1735757"}],"event":{"name":"L@S '21: Eighth (2021) ACM Conference on Learning @ Scale","location":"Virtual Event Germany","acronym":"L@S '21"},"container-title":["Proceedings of the Eighth ACM Conference on Learning @ Scale"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430895.3460127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3430895.3460127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:41Z","timestamp":1750195481000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430895.3460127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,8]]},"references-count":29,"alternative-id":["10.1145\/3430895.3460127","10.1145\/3430895"],"URL":"https:\/\/doi.org\/10.1145\/3430895.3460127","relation":{},"subject":[],"published":{"date-parts":[[2021,6,8]]},"assertion":[{"value":"2021-06-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}