{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T18:34:19Z","timestamp":1771612459948,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T00:00:00Z","timestamp":1618185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NWO","award":["NWO464.18.104"],"award-info":[{"award-number":["NWO464.18.104"]}]},{"name":"ESRC","award":["ES\/S015701\/1"],"award-info":[{"award-number":["ES\/S015701\/1"]}]},{"name":"DFG","award":["BA20144"],"award-info":[{"award-number":["BA20144"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,12]]},"DOI":"10.1145\/3448139.3448181","type":"proceedings-article","created":{"date-parts":[[2021,4,5]],"date-time":"2021-04-05T22:29:58Z","timestamp":1617661798000},"page":"438-448","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":34,"title":["Do Instrumentation Tools Capture Self-Regulated Learning?"],"prefix":"10.1145","author":[{"given":"Joep","family":"van der Graaf","sequence":"first","affiliation":[{"name":"Radboud University, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lyn","family":"Lim","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yizhou","family":"Fan","sequence":"additional","affiliation":[{"name":"The University of Edinburgh, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Kilgour","sequence":"additional","affiliation":[{"name":"The University of Edinburgh, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johanna","family":"Moore","sequence":"additional","affiliation":[{"name":"The University of Edinburgh, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Bannert","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dragan","family":"Gasevic","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inge","family":"Molenaar","sequence":"additional","affiliation":[{"name":"Radboud University, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,4,12]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cedpsych.2003.09.002"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.03.025"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-007-9067-0"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2010.515934"},{"key":"e_1_3_2_1_5_1","volume-title":"Mudrick","author":"Azevedo Roger","year":"2018","unstructured":"Roger Azevedo , Michelle Taub , and Nicholas V . Mudrick . 2018 . Understanding and Reasoning About Real-Time Cognitive, Affective , and Metacognitive Processes to Foster Self-Regulation With Advanced Learning Technologies. In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group , New York, NY. Roger Azevedo, Michelle Taub, and Nicholas V. Mudrick. 2018. Understanding and Reasoning About Real-Time Cognitive, Affective, and Metacognitive Processes to Foster Self-Regulation With Advanced Learning Technologies. In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group, New York, NY."},{"key":"e_1_3_2_1_6_1","volume-title":"Beschreibung und Vermittlung wirksamer metakognitiver Lernstrategien und Regulationsaktivit\u00e4ten","author":"Bannert Maria","unstructured":"Maria Bannert . 2007. Metakognition beim Lernen mit Hypermedia. Erfassung , Beschreibung und Vermittlung wirksamer metakognitiver Lernstrategien und Regulationsaktivit\u00e4ten . Waxmann , M\u00fcnster, Germany . Maria Bannert. 2007. Metakognition beim Lernen mit Hypermedia. Erfassung, Beschreibung und Vermittlung wirksamer metakognitiver Lernstrategien und Regulationsaktivit\u00e4ten. Waxmann, M\u00fcnster, Germany."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-013-9107-6"},{"key":"e_1_3_2_1_8_1","volume-title":"Loosely Sequenced, and Contingent Features of Self-Regulated Learning: Trace Data and Their Analysis. In Handbook of Self-Regulation of Learning and Performance","author":"Bernacki Matthew L.","unstructured":"Matthew L. Bernacki . 2018. Examining the Cyclical , Loosely Sequenced, and Contingent Features of Self-Regulated Learning: Trace Data and Their Analysis. In Handbook of Self-Regulation of Learning and Performance ( Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group , New York, NY. Matthew L. Bernacki. 2018. Examining the Cyclical, Loosely Sequenced, and Contingent Features of Self-Regulated Learning: Trace Data and Their Analysis. In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group, New York, NY."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cedpsych.2011.12.001"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-007-9004-y"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2004.09.007"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0032243"},{"key":"e_1_3_2_1_13_1","volume-title":"Motivation and Affect in Self-Regulated Learning: Does Metacognition Play a Role? In Handbook of Self-Regulation of Learning and Performance","author":"Efklides Anastasia","unstructured":"Anastasia Efklides , Bennett L. Schwartz , and Victoria Brown . 2018. Motivation and Affect in Self-Regulated Learning: Does Metacognition Play a Role? In Handbook of Self-Regulation of Learning and Performance ( Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group , New York, NY. Anastasia Efklides, Bennett L. Schwartz, and Victoria Brown. 2018. Motivation and Affect in Self-Regulated Learning: Does Metacognition Play a Role? In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group, New York, NY."},{"key":"e_1_3_2_1_14_1","volume-title":"Retrieved","author":"Publications","year":"2020","unstructured":"Publications Office of the European European Union. 2019. Key competences for lifelong learning . Retrieved October 22, 2020 from http:\/\/op.europa.eu\/nl\/publication-detail\/-\/publication\/297a33c8-a1f3-11e9-9d01-01aa75ed71a1 Publications Office of the European European Union. 2019. Key competences for lifelong learning. Retrieved October 22, 2020 from http:\/\/op.europa.eu\/nl\/publication-detail\/-\/publication\/297a33c8-a1f3-11e9-9d01-01aa75ed71a1"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cedpsych.2008.05.006"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-014-0506-7"},{"key":"e_1_3_2_1_17_1","first-page":"1","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"Richard Landis J.","year":"1977","unstructured":"J. Richard Landis and Gary G. Koch . 1977 . The Measurement of Observer Agreement for Categorical Data . Biometrics 33 , 1 (March 1977), 159. DOI:https:\/\/doi.org\/10.2307\/2529310 10.2307\/2529310 J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics 33, 1 (March 1977), 159. DOI:https:\/\/doi.org\/10.2307\/2529310","journal-title":"Biometrics"},{"key":"e_1_3_2_1_18_1","unstructured":"Micheal A. Lawrence. 2016. ez: Easy Analysis and Visualization of Factorial Experiments.  Micheal A. Lawrence. 2016. ez: Easy Analysis and Visualization of Factorial Experiments."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14742\/ajet.3058"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01463939"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-010-9154-1"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2010.06.022"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-013-9105-8"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496416689710"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.2190\/H3W1-8321-1260-1443"},{"key":"e_1_3_2_1_26_1","volume-title":"A Review of Self-regulated Learning: Six Models and Four Directions for Research. Front. Psychol. 8, (April","author":"Panadero Ernesto","year":"2017","unstructured":"Ernesto Panadero . 2017. A Review of Self-regulated Learning: Six Models and Four Directions for Research. Front. Psychol. 8, (April 2017 ), 422. DOI:https:\/\/doi.org\/10.3389\/fpsyg.2017.00422 10.3389\/fpsyg.2017.00422 Ernesto Panadero. 2017. A Review of Self-regulated Learning: Six Models and Four Directions for Research. Front. Psychol. 8, (April 2017), 422. DOI:https:\/\/doi.org\/10.3389\/fpsyg.2017.00422"},{"key":"e_1_3_2_1_27_1","first-page":"49","article-title":"Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence","volume":"17","author":"Papamitsiou Zacharoula","year":"2014","unstructured":"Zacharoula Papamitsiou and Anastasios A. Economides . 2014 . Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence . Journal of Educational Technology & Society 17 , 4 (2014), 49 \u2013 64 . Zacharoula Papamitsiou and Anastasios A. Economides. 2014. Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence. Journal of Educational Technology & Society 17, 4 (2014), 49\u201364.","journal-title":"Journal of Educational Technology & Society"},{"key":"e_1_3_2_1_28_1","volume-title":"R: A language and environment for statistical computing","author":"Team R Core","year":"2020","unstructured":"R Core Team . 2020 . R: A language and environment for statistical computing . R Foundation for Statistical Computing, Vienna, Austria . Retrieved from http:\/\/www.R-project.org\/ R Core Team. 2020. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http:\/\/www.R-project.org\/"},{"key":"e_1_3_2_1_29_1","unstructured":"William Revelle. 2020. psych: Procedures for Psychological Psychometric and Personality Research.  William Revelle. 2020. psych: Procedures for Psychological Psychometric and Personality Research."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2015.21.2"},{"key":"#cr-split#-e_1_3_2_1_31_1.1","doi-asserted-by":"crossref","unstructured":"J. Saint A. Whitelock-Wainwright D. Gasevic and A. Pardo. 2020. Trace-SRL: A Framework for Analysis of Micro-Level Processes of Self-Regulated Learning from Trace Data. IEEE Transactions on Learning Technologies (2020) 1-1. DOI:https:\/\/doi.org\/10.1109\/TLT.2020.3027496 10.1109\/TLT.2020.3027496","DOI":"10.1109\/TLT.2020.3027496"},{"key":"#cr-split#-e_1_3_2_1_31_1.2","doi-asserted-by":"crossref","unstructured":"J. Saint A. Whitelock-Wainwright D. Gasevic and A. Pardo. 2020. Trace-SRL: A Framework for Analysis of Micro-Level Processes of Self-Regulated Learning from Trace Data. IEEE Transactions on Learning Technologies (2020) 1-1. DOI:https:\/\/doi.org\/10.1109\/TLT.2020.3027496","DOI":"10.1109\/TLT.2020.3027496"},{"key":"e_1_3_2_1_32_1","volume-title":"Schunk and Jeffrey Alan Greene (Eds.)","author":"Dale","year":"2018","unstructured":"Dale H. Schunk and Jeffrey Alan Greene (Eds.) . 2018 . Handbook of Self-Regulation of Learning and Performance (Second edition ed.). Routledge, Taylor & Francis Group , New York, NY. Dale H. Schunk and Jeffrey Alan Greene (Eds.). 2018. Handbook of Self-Regulation of Learning and Performance (Second edition ed.). Routledge, Taylor & Francis Group, New York, NY."},{"key":"e_1_3_2_1_33_1","volume-title":"Schunk and Jeffrey Alan Greene","author":"Dale","year":"2018","unstructured":"Dale H. Schunk and Jeffrey Alan Greene . 2018 . Historical, Contemporary , and Future Perspectives on Self-Regulated Learning and Performance. In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group , New York, NY. Dale H. Schunk and Jeffrey Alan Greene. 2018. Historical, Contemporary, and Future Perspectives on Self-Regulated Learning and Performance. In Handbook of Self-Regulation of Learning and Performance (Second edition), Dale H. Schunk and Jeffrey Alan Greene (eds.). Routledge, Taylor & Francis Group, New York, NY."},{"key":"e_1_3_2_1_34_1","volume-title":"Trace-Based Microanalytic Measurement of Self-Regulated Learning Processes. JLA (April","author":"Siadaty Melody","year":"2016","unstructured":"Melody Siadaty , Dragan Ga\u0161evi\u0107 , and Marek Hatala . 2016. Trace-Based Microanalytic Measurement of Self-Regulated Learning Processes. JLA (April 2016 ), 183\u2013214. DOI:https:\/\/doi.org\/10.18608\/jla.2016.31.11 10.18608\/jla.2016.31.11 Melody Siadaty, Dragan Ga\u0161evi\u0107, and Marek Hatala. 2016. Trace-Based Microanalytic Measurement of Self-Regulated Learning Processes. JLA (April 2016), 183\u2013214. DOI:https:\/\/doi.org\/10.18608\/jla.2016.31.11"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-018-0165-4"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2014.07.018"},{"key":"e_1_3_2_1_37_1","unstructured":"The Language Archive. 2020. ELAN. Max Planck Institute for Psycholinguistics Nijmegen the Netherlands. Retrieved from https:\/\/archive.mpi.nl\/tla\/elan  The Language Archive. 2020. ELAN. Max Planck Institute for Psycholinguistics Nijmegen the Netherlands. Retrieved from https:\/\/archive.mpi.nl\/tla\/elan"},{"key":"e_1_3_2_1_38_1","volume-title":"International Handbook of Metacognition and Learning Technologies","author":"Veenman Marcel V.J.","unstructured":"Marcel V.J. Veenman . 2013. Assessing Metacognitive Skills in Computerized Learning Environments . In International Handbook of Metacognition and Learning Technologies , Roger Azevedo and Vincent Aleven (eds.). Springer New York , New York, NY . Marcel V.J. Veenman. 2013. Assessing Metacognitive Skills in Computerized Learning Environments. In International Handbook of Metacognition and Learning Technologies, Roger Azevedo and Vincent Aleven (eds.). Springer New York, New York, NY."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1041-6080(96)90022-9"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.89.3.397"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326985ep4101_3"},{"key":"e_1_3_2_1_42_1","volume-title":"Handbook of Learning Analytics (First)","author":"Winne Philip H.","unstructured":"Philip H. Winne . 2017. Learning Analytics for Self-Regulated Learning . In Handbook of Learning Analytics (First) , Charles Lang, George Siemens, Alyssa Wise and Dragan Gasevic (eds.). Society for Learning Analytics Research (SoLAR) , 241\u2013249. DOI:https:\/\/doi.org\/10.18608\/hla17.021 10.18608\/hla17.021 Philip H. Winne. 2017. Learning Analytics for Self-Regulated Learning. In Handbook of Learning Analytics (First), Charles Lang, George Siemens, Alyssa Wise and Dragan Gasevic (eds.). Society for Learning Analytics Research (SoLAR), 241\u2013249. DOI:https:\/\/doi.org\/10.18608\/hla17.021"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjep.12173"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012109890-2\/50045-7"},{"key":"e_1_3_2_1_45_1","volume-title":"Construct and consequential validity for learning analytics based on trace data. Computers in Human Behavior 112, (November","author":"Winne Philip H.","year":"2020","unstructured":"Philip H. Winne . 2020. Construct and consequential validity for learning analytics based on trace data. Computers in Human Behavior 112, (November 2020 ), 106457. DOI:https:\/\/doi.org\/10.1016\/j.chb.2020.106457 10.1016\/j.chb.2020.106457 Philip H. Winne. 2020. Construct and consequential validity for learning analytics based on trace data. Computers in Human Behavior 112, (November 2020), 106457. DOI:https:\/\/doi.org\/10.1016\/j.chb.2020.106457"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2019.62.7"}],"event":{"name":"LAK21: 11th International Learning Analytics and Knowledge Conference","location":"Irvine CA USA","acronym":"LAK21"},"container-title":["LAK21: 11th International Learning Analytics and Knowledge Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448139.3448181","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448139.3448181","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:25:00Z","timestamp":1750195500000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448139.3448181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,12]]},"references-count":47,"alternative-id":["10.1145\/3448139.3448181","10.1145\/3448139"],"URL":"https:\/\/doi.org\/10.1145\/3448139.3448181","relation":{},"subject":[],"published":{"date-parts":[[2021,4,12]]},"assertion":[{"value":"2021-04-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}