{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T15:33:55Z","timestamp":1768318435673,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":68,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,3,4]],"date-time":"2019-03-04T00:00:00Z","timestamp":1551657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,3,4]]},"DOI":"10.1145\/3303772.3303775","type":"proceedings-article","created":{"date-parts":[[2019,2,25]],"date-time":"2019-02-25T13:32:31Z","timestamp":1551101551000},"page":"501-510","source":"Crossref","is-referenced-by-count":42,"title":["Counting Clicks is Not Enough"],"prefix":"10.1145","author":[{"given":"Ed","family":"Fincham","sequence":"first","affiliation":[{"name":"School of Informatics, University of Edinburgh, Edinburgh, United Kingdom"}]},{"given":"Alexander","family":"Whitelock-Wainwright","sequence":"additional","affiliation":[{"name":"School of Psychology, University of Liverpool, Liverpool, United Kingdom"}]},{"given":"Vitomir","family":"Kovanovi\u0107","sequence":"additional","affiliation":[{"name":"Teaching Innovation Unit and School of Education, University of South Australia, Adelaide, Australia"}]},{"given":"Sre\u0107ko","family":"Joksimovi\u0107","sequence":"additional","affiliation":[{"name":"Teaching Innovation Unit and School of Education, University of South Australia, Adelaide, Australia"}]},{"given":"Jan-Paul","family":"van Staalduinen","sequence":"additional","affiliation":[{"name":"Education and Student Affairs, Delft University of Technology, Delft, Netherlands"}]},{"given":"Dragan","family":"Ga\u0161evi\u0107","sequence":"additional","affiliation":[{"name":"Monash University, Clayton, Australia"}]}],"member":"320","published-online":{"date-parts":[[2019,3,4]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Information Systems (ICIS 2013)","author":"Adamopoulos Panagiotis","year":"2013"},{"key":"e_1_3_2_1_2_1","volume-title":"Academic Engagement: An Overview of Its Definitions, Dimensions, and Major Conceptualisations. 9 (11","author":"Alrashidi Oqab","year":"2016"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"James J. Appleton Sandra L. Christenson and Michael J. Furlong. 2008. Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools 45 5 (1 5 2008) 369--386. James J. Appleton Sandra L. Christenson and Michael J. Furlong. 2008. Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools 45 5 (1 5 2008) 369--386.","DOI":"10.1002\/pits.20303"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsp.2006.04.002"},{"key":"e_1_3_2_1_5_1","unstructured":"American Educational Research Association American Psychological Association National Council on Measurement in Education Joint Committee on Standards for Educational and Psychological Testing. 2014. Standards for Educational and Psychological Testing. American Educational Research Association American Psychological Association National Council on Measurement in Education Joint Committee on Standards for Educational and Psychological Testing. 2014. Standards for Educational and Psychological Testing."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2015.1004069"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"A. Alexander Beaujean. 2014. Latent variable modeling using R: A step-by-step guide. Routledge. A. Alexander Beaujean. 2014. Latent variable modeling using R: A step-by-step guide. Routledge.","DOI":"10.4324\/9781315869780"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Natasha K. Bowen and Shenyang Guo. 2011. Structural Equation Modeling. Oxford University Press. Natasha K. Bowen and Shenyang Guo. 2011. Structural Equation Modeling. Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195367621.001.0001"},{"key":"e_1_3_2_1_9_1","unstructured":"Timothy A. Brown. 2015. Methodology in the social sciences. Confirmatory factor analysis for applied research (2nd ed.). New York NY US: Guilford Press. Timothy A. Brown. 2015. Methodology in the social sciences. Confirmatory factor analysis for applied research (2nd ed.). New York NY US: Guilford Press."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Robert C. MacCallum Michael W. Browne and Hazuki M. Sugawara. 1996. Power Analysis and Determination of Sample Size for Covariance Structure Modeling. 1 (06 1996) 130--149. Robert C. MacCallum Michael W. Browne and Hazuki M. Sugawara. 1996. Power Analysis and Determination of Sample Size for Covariance Structure Modeling. 1 (06 1996) 130--149.","DOI":"10.1037\/1082-989X.1.2.130"},{"key":"e_1_3_2_1_11_1","unstructured":"Sandra L. Christenson Amy L. Reschly James J. Appleton Sarah Berman Deanna M. Spanjers and P. Varro. 2008. Best practices in fostering student engagement. National Association of School Psychologists 1099--1120. Sandra L. Christenson Amy L. Reschly James J. Appleton Sarah Berman Deanna M. Spanjers and P. Varro. 2008. Best practices in fostering student engagement. National Association of School Psychologists 1099--1120."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1080\/02796015.2002.12086162","article-title":"Commentary: The centrality of the learning context for students' academic enabler skills","volume":"31","author":"Christenson Sandra L.","year":"2002","journal-title":"School Psychology Review"},{"key":"e_1_3_2_1_13_1","unstructured":"Thomas D Cook and Donald T Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Houghton Mifflin. Thomas D Cook and Donald T Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Houghton Mifflin."},{"key":"e_1_3_2_1_14_1","unstructured":"Anna B. Costello and Jason W. Osborne. 2005. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. 10 (01 2005) 1--9. Anna B. Costello and Jason W. Osborne. 2005. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. 10 (01 2005) 1--9."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X14523038"},{"key":"e_1_3_2_1_16_1","unstructured":"Nia Dowell Oleksandra Skrypnyk Sre\u0107ko Joksimovi\u0107 Arthur C. Graesser Shane Dawson Dragan Ga\u0161evi\u0107 Pieter de Vries Thieme Hennis and Vitomir Kovanovi\u0107. 2015. Modeling Learners' Social Centrality and Performance through Language and Discourse. (2015). https:\/\/eric.ed.gov\/?id=ED560532 presented at the Proceedings of the 8th International Conference on Educational Data Mining. Nia Dowell Oleksandra Skrypnyk Sre\u0107ko Joksimovi\u0107 Arthur C. Graesser Shane Dawson Dragan Ga\u0161evi\u0107 Pieter de Vries Thieme Hennis and Vitomir Kovanovi\u0107. 2015. Modeling Learners' Social Centrality and Performance through Language and Discourse. (2015). https:\/\/eric.ed.gov\/?id=ED560532 presented at the Proceedings of the 8th International Conference on Educational Data Mining."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Leandre Fabrigar Duane Wegener Robert C. MacCallum and Erin J. Strahan. 1999. Evaluating the use of Exploratory Factor Analysis in psychological research. 4 (01 1999) 272--299. Leandre Fabrigar Duane Wegener Robert C. MacCallum and Erin J. Strahan. 1999. Evaluating the use of Exploratory Factor Analysis in psychological research. 4 (01 1999) 272--299.","DOI":"10.1037\/1082-989X.4.3.272"},{"key":"e_1_3_2_1_18_1","unstructured":"Andy Field Jeremy Miles and Zoe Field. 2012. Discovering Statistics Using R. SAGE Publications. Andy Field Jeremy Miles and Zoe Field. 2012. Discovering Statistics Using R. SAGE Publications."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543059002117"},{"key":"e_1_3_2_1_20_1","unstructured":"Charles W. Fisher and David C. Berliner. 1985. Perspectives on instructional time. New York: Longman. Charles W. Fisher and David C. Berliner. 1985. Perspectives on instructional time. New York: Longman."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543074001059"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11528-014-0822-x"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2017.42.10"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Peter Goodyear. 2002. Psychological Foundations for Networked Learning. Springer London London 49--75. Peter Goodyear. 2002. Psychological Foundations for Networked Learning. Springer London London 49--75.","DOI":"10.1007\/978-1-4471-0181-9_4"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X11413260"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Christian G\u00fctl Vanessa Rizzardini Rocael Hern\u00e1ndezand Chang and Miguel Morales. 2014. Attrition in MOOC: Lessons Learned from Drop-Out Students. In Learning Technology for Education in Cloud. MOOC and Big Data Lorna Uden Jane Sinclair Yu-Hui Tao and Dario Liberona (Eds.). Springer International Publishing Cham 37--48. Christian G\u00fctl Vanessa Rizzardini Rocael Hern\u00e1ndezand Chang and Miguel Morales. 2014. Attrition in MOOC: Lessons Learned from Drop-Out Students. In Learning Technology for Education in Cloud. MOOC and Big Data Lorna Uden Jane Sinclair Yu-Hui Tao and Dario Liberona (Eds.). Springer International Publishing Cham 37--48.","DOI":"10.1007\/978-3-319-10671-7_4"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428104263675"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610739208253916"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/10705519909540118"},{"key":"e_1_3_2_1_30_1","unstructured":"IBM Tone Analyzer. n.d.. https:\/\/www.ibm.com\/watson\/developercloud\/tone-analyzer.html. IBM Tone Analyzer. n.d.. https:\/\/www.ibm.com\/watson\/developercloud\/tone-analyzer.html."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723576.2723604"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654317740335"},{"key":"e_1_3_2_1_33_1","volume-title":"Proceedings of the 6th International Conference on Networked Learning. 616--623","author":"Jones Chris","year":"2008"},{"key":"e_1_3_2_1_34_1","unstructured":"Karl J\u00f6reskog and Arthur S. Goldberger. 1975. Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable. 70 (1975) 631--639. Karl J\u00f6reskog and Arthur S. Goldberger. 1975. Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable. 70 (1975) 631--639."},{"key":"e_1_3_2_1_35_1","unstructured":"Karl G J\u00f6reskog. 1999 June 22. How Large Can a Standardized Coefficient be? http:\/\/www.ssicentral.com\/lisrel\/techdocs\/HowLargeCanaStandardizedCoefficientbe.pdf Karl G J\u00f6reskog. 1999 June 22. How Large Can a Standardized Coefficient be? http:\/\/www.ssicentral.com\/lisrel\/techdocs\/HowLargeCanaStandardizedCoefficientbe.pdf"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12000"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"David Kaplan. 2009. Structural Equation Modeling (2nd ed.): Foundations and Extensions. SAGE Publications. David Kaplan. 2009. Structural Equation Modeling (2nd ed.): Foundations and Extensions. SAGE Publications.","DOI":"10.4135\/9781452226576"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164411427395"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460330"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2015.23.6"},{"key":"e_1_3_2_1_41_1","volume-title":"Lecture Notes in Computer Science","volume":"9307","author":"Li Nan","year":"2015"},{"key":"e_1_3_2_1_42_1","volume-title":"ASCILITE - Australian Society for Computers in Learning in Tertiary Education Annual Conference","author":"Lodge Jason","year":"2012"},{"key":"e_1_3_2_1_43_1","first-page":"635","article-title":"Objective Tests as Instruments of Psychological Theory","volume":"3","author":"Loevinger Jane","year":"1957","journal-title":"Psychological Reports"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15328007sem1103_2"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Danielle S. McNamara Arthur C. Graesser Philip M. McCarthy and Zhiqiang Cai. 2014. Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge University Press. Danielle S. McNamara Arthur C. Graesser Philip M. McCarthy and Zhiqiang Cai. 2014. Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge University Press.","DOI":"10.1017\/CBO9780511894664"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Samuel Messick. 1995. Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice (1995) 5--8. Samuel Messick. 1995. Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice (1995) 5--8.","DOI":"10.1111\/j.1745-3992.1995.tb00881.x"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Samuel Messick. 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American psychologist 50 9 (1995) 741. Samuel Messick. 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American psychologist 50 9 (1995) 741.","DOI":"10.1037\/0003-066X.50.9.741"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2567857"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Arti Ramesh Dan Goldwasser Bert Huang Hal Daume III and Lise Getoor. 2014. Learning Latent Engagement Patterns of Students in Online Courses. (2014). https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI14\/paper\/view\/8571 Arti Ramesh Dan Goldwasser Bert Huang Hal Daume III and Lise Getoor. 2014. Learning Latent Engagement Patterns of Students in Online Courses. (2014). https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI14\/paper\/view\/8571","DOI":"10.1609\/aaai.v28i1.8920"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/01466216970212006"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Justin Reich. 2015. Rebooting MOOC Research. Science 347 6217 (2015) 34--35. Justin Reich. 2015. Rebooting MOOC Research. Science 347 6217 (2015) 34--35.","DOI":"10.1126\/science.1261627"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"crossref","unstructured":"Amy L. Reschly and Sandra L. Christenson. 2012. Jingle Jangle and Conceptual Haziness: Evolution and Future Directions of the Engagement Construct. Springer US Boston MA 3--19. Amy L. Reschly and Sandra L. Christenson. 2012. Jingle Jangle and Conceptual Haziness: Evolution and Future Directions of the Engagement Construct. Springer US Boston MA 3--19.","DOI":"10.1007\/978-1-4614-2018-7_1"},{"key":"e_1_3_2_1_53_1","unstructured":"William Revelle. 2018. psych: Procedures for Psychological Psychometric and Personality Research. Northwestern University Evanston Illinois. https:\/\/CRAN.R-project.org\/package=psych R package version 1.8.4. William Revelle. 2018. psych: Procedures for Psychological Psychometric and Personality Research. Northwestern University Evanston Illinois. https:\/\/CRAN.R-project.org\/package=psych R package version 1.8.4."},{"key":"e_1_3_2_1_54_1","volume-title":"The SAGE Handbook of E-Learning Research","author":"Rogers Tim","edition":"2"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i02"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2567574.2567627"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0305-0483(96)00051-5"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543040003371"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2728669"},{"key":"e_1_3_2_1_60_1","unstructured":"Conrad Tucker Barton K. Pursel and Aanna Divinsky. 2014. Mining studentgenerated textual data in MOOCS and quantifying their effects on student performance and learning outcomes. (2014). https:\/\/peer.asee.org\/22840 Paper presented at ASEE Annual Conference Indianapolis Indiana. Conrad Tucker Barton K. Pursel and Aanna Divinsky. 2014. Mining studentgenerated textual data in MOOCS and quantifying their effects on student performance and learning outcomes. (2014). https:\/\/peer.asee.org\/22840 Paper presented at ASEE Annual Conference Indianapolis Indiana."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socnet.2015.05.001"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/01587919.2016.1184400"},{"key":"e_1_3_2_1_63_1","volume-title":"Proceedings of the 8th International Conference on Educational Data Mining. 226--233","author":"Wang Xu","year":"2015"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2611750"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0361-476X(02)00006-1"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Alyssa Friend Wise and David Shaffer. 2015. Why theory matters more than ever in the age of big data. 2 (01 2015) 5--13. Alyssa Friend Wise and David Shaffer. 2015. Why theory matters more than ever in the age of big data. 2 (01 2015) 5--13.","DOI":"10.18608\/jla.2015.22.2"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2728687"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2012.03.004"}],"event":{"name":"LAK19: The 9th International Learning Analytics & Knowledge Conference","location":"Tempe AZ USA","acronym":"LAK19","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SoLAR The Society for Learning Analytics Research","SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 9th International Conference on Learning Analytics & Knowledge"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3303772.3303775","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/dl.acm.org\/ft_gateway.cfm?id=3303775&ftid=2041052&dwn=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:39Z","timestamp":1750204419000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3303772.3303775"}},"subtitle":["Validating a Theorized Model of Engagement in Learning Analytics"],"short-title":[],"issued":{"date-parts":[[2019,3,4]]},"references-count":68,"alternative-id":["10.1145\/3303772.3303775","10.1145\/3303772"],"URL":"https:\/\/doi.org\/10.1145\/3303772.3303775","relation":{},"subject":[],"published":{"date-parts":[[2019,3,4]]}}}