{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T21:12:35Z","timestamp":1781989955075,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,3,7]],"date-time":"2018-03-07T00:00:00Z","timestamp":1520380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Australian Government","award":["ID14-3821"],"award-info":[{"award-number":["ID14-3821"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,3,7]]},"DOI":"10.1145\/3170358.3170413","type":"proceedings-article","created":{"date-parts":[[2018,3,19]],"date-time":"2018-03-19T14:05:51Z","timestamp":1521468351000},"page":"451-460","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Embracing imperfection in learning analytics"],"prefix":"10.1145","author":[{"given":"Kirsty","family":"Kitto","sequence":"first","affiliation":[{"name":"University of Technology Sydney, Sydney, NSW"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"Buckingham Shum","sequence":"additional","affiliation":[{"name":"University of Technology Sydney, Sydney, NSW"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Gibson","sequence":"additional","affiliation":[{"name":"University of Technology Sydney, Sydney, NSW"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,3,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498766"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883939"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-016-0105-0"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883944"},{"key":"e_1_3_2_1_5_1","volume-title":"Educational Data Mining","author":"Beck Joseph","year":"2013","unstructured":"Joseph Beck and Xiaolu Xiong . 2013. Limits to accuracy: how well can we do at student modeling? . In Educational Data Mining 2013 . Joseph Beck and Xiaolu Xiong. 2013. Limits to accuracy: how well can we do at student modeling?. In Educational Data Mining 2013."},{"key":"e_1_3_2_1_6_1","volume-title":"Algorithmic Accountability for Learning Analytics. (2016). Seminar","author":"Shum Simon Buckingham","year":"2016","unstructured":"Simon Buckingham Shum . 2016. Algorithmic Accountability for Learning Analytics. (2016). Seminar , University College London , April 2016 . Retrieved from http:\/\/bit.ly\/aala2016. Simon Buckingham Shum. 2016. Algorithmic Accountability for Learning Analytics. (2016). Seminar, University College London, April 2016. Retrieved from http:\/\/bit.ly\/aala2016."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2016.32.2"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2017.41.5"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04417-5_17"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390446"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330601.2330636"},{"key":"e_1_3_2_1_12_1","volume-title":"Learning to learn: International perspectives from theory and practice","author":"Crick Ruth Deakin","unstructured":"Ruth Deakin Crick , Cristina Stringher , and Kai Ren . 2014. Learning to learn: International perspectives from theory and practice . Routledge . Ruth Deakin Crick, Cristina Stringher, and Kai Ren. 2014. Learning to learn: International perspectives from theory and practice. Routledge."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3027442"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883885"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2011.10.001"},{"key":"e_1_3_2_1_16_1","volume-title":"Recommender systems handbook","author":"Drachsler Hendrik","unstructured":"Hendrik Drachsler , Katrien Verbert , Olga C Santos , and Nikos Manouselis . 2015. Panorama of recommender systems to support learning . In Recommender systems handbook . Springer , 421--451. Hendrik Drachsler, Katrien Verbert, Olga C Santos, and Nikos Manouselis. 2015. Panorama of recommender systems to support learning. In Recommender systems handbook. Springer, 421--451."},{"key":"e_1_3_2_1_17_1","volume-title":"Vistas in Information Handling","author":"Engelbart Douglas C.","unstructured":"Douglas C. Engelbart . 1963. Conceptual Framework for the Augmentation of Man's Intellect . In Vistas in Information Handling . Spartan Books , 1--29. Douglas C. Engelbart. 1963. Conceptual Framework for the Augmentation of Man's Intellect. In Vistas in Information Handling. Spartan Books, 1--29."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11528-014-0822-x"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1511\/2014.111.460"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3027436"},{"key":"e_1_3_2_1_21_1","volume-title":"An introduction to statistical learning with applications in R","author":"James Gareth","unstructured":"Gareth James , Daniela Witten , Trevor Hastie , and Robert Tibshirani . 2013. An introduction to statistical learning with applications in R . Vol. 112 . Springer . Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An introduction to statistical learning with applications in R. Vol. 112. Springer."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170358.3170421"},{"key":"e_1_3_2_1_23_1","volume-title":"Opening the Black Box of Adaptivity. Educause Review","author":"Johnson Dale","year":"2017","unstructured":"Dale Johnson . 2017. Opening the Black Box of Adaptivity. Educause Review ( 2017 ). Available at http:\/\/er.educause.edu\/blogs\/2017\/6\/opening-the-black-box-of-adaptivity. Dale Johnson. 2017. Opening the Black Box of Adaptivity. Educause Review (2017). Available at http:\/\/er.educause.edu\/blogs\/2017\/6\/opening-the-black-box-of-adaptivity."},{"key":"e_1_3_2_1_24_1","volume-title":"fast and slow","author":"Kahneman Daniel","unstructured":"Daniel Kahneman . 2011. Thinking , fast and slow . Macmillan . Daniel Kahneman. 2011. Thinking, fast and slow. Macmillan."},{"key":"e_1_3_2_1_25_1","first-page":"745","article-title":"A systematic review of interactive information retrieval evaluation studies, 1967--2006","volume":"64","author":"Kelly Diane","year":"2013","unstructured":"Diane Kelly and Cassidy R. Sugimoto . 2013 . A systematic review of interactive information retrieval evaluation studies, 1967--2006 . Journal of the Association for Information Science and Technology 64 , 4 (2013), 745 -- 770 . Diane Kelly and Cassidy R. Sugimoto. 2013. A systematic review of interactive information retrieval evaluation studies, 1967--2006. Journal of the Association for Information Science and Technology 64, 4 (2013), 745--770.","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"e_1_3_2_1_26_1","first-page":"42","article-title":"RiPLE: Recommendation in Peer-Learning Environments Based on Knowledge Gaps and Interests","volume":"9","author":"Khosravi Hassan","year":"2017","unstructured":"Hassan Khosravi , Kendra Cooper , and Kirsty Kitto . 2017 . RiPLE: Recommendation in Peer-Learning Environments Based on Knowledge Gaps and Interests . Educational Data Mining 9 , 1 (2017), 42 -- 67 . Hassan Khosravi, Kendra Cooper, and Kirsty Kitto. 2017. RiPLE: Recommendation in Peer-Learning Environments Based on Knowledge Gaps and Interests. Educational Data Mining 9, 1 (2017), 42--67.","journal-title":"Educational Data Mining"},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings ASCILITE","author":"Kitto Kirsty","year":"2016","unstructured":"Kirsty Kitto , Mandy Lupton , Kate Davis , and Zak Waters . 2016 . Incorporating student-facing learning analytics into pedagogical practice. In Show Me The Learning . Proceedings ASCILITE 2016. 338--347. Kirsty Kitto, Mandy Lupton, Kate Davis, and Zak Waters. 2016. Incorporating student-facing learning analytics into pedagogical practice. In Show Me The Learning. Proceedings ASCILITE 2016. 338--347."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14742\/ajet.3607"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883950"},{"key":"e_1_3_2_1_30_1","first-page":"25","article-title":"Closing the loop: Automated data-driven cognitive model discoveries lead to improved instruction and learning gains","volume":"9","author":"Liu Ran","year":"2017","unstructured":"Ran Liu and Kenneth R Koedinger . 2017 . Closing the loop: Automated data-driven cognitive model discoveries lead to improved instruction and learning gains . JEDM-Journal of Educational Data Mining 9 , 1 (2017), 25 -- 41 . Ran Liu and Kenneth R Koedinger. 2017. Closing the loop: Automated data-driven cognitive model discoveries lead to improved instruction and learning gains. JEDM-Journal of Educational Data Mining 9, 1 (2017), 25--41.","journal-title":"JEDM-Journal of Educational Data Mining"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556969"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764213479367"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5334\/2008-14"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Wenting Ma Olusola O. Adesope John C. Nesbit and Qing Liu. 2014. Intelligent tutoring systems and learning outcomes: A meta-analysis. (2014) 901--918 pages.  Wenting Ma Olusola O. Adesope John C. Nesbit and Qing Liu. 2014. Intelligent tutoring systems and learning outcomes: A meta-analysis. (2014) 901--918 pages.","DOI":"10.1037\/a0037123"},{"key":"e_1_3_2_1_35_1","unstructured":"Cathy O'Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Crown.   Cathy O'Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Crown."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3402\/rlt.v24.30088"},{"key":"e_1_3_2_1_37_1","volume-title":"Using Learning Analytics to Scale the Provision of Personalised Feedback. British Journal of Educational Technology","author":"Pardo Abelardo","year":"2017","unstructured":"Abelardo Pardo , Jelena Jovanovi\u0107 , Shane Dawson , Dragan Gasevic , and Negin Mirriahi . 2017. Using Learning Analytics to Scale the Provision of Personalised Feedback. British Journal of Educational Technology ( 2017 ). Abelardo Pardo, Jelena Jovanovi\u0107, Shane Dawson, Dragan Gasevic, and Negin Mirriahi. 2017. Using Learning Analytics to Scale the Provision of Personalised Feedback. British Journal of Educational Technology (2017)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883870"},{"key":"e_1_3_2_1_39_1","volume-title":"Educational Data Mining","author":"Pardos Zachary","year":"2013","unstructured":"Zachary Pardos , Yoav Bergner , Daniel Seaton , and David Pritchard . 2013. Adapting bayesian knowledge tracing to a massive open online course in edx . In Educational Data Mining 2013 . Zachary Pardos, Yoav Bergner, Daniel Seaton, and David Pritchard. 2013. Adapting bayesian knowledge tracing to a massive open online course in edx. In Educational Data Mining 2013."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883949"},{"key":"e_1_3_2_1_41_1","article-title":"Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at the Open University UK","volume":"2016","author":"Rienties Bart","year":"2016","unstructured":"Bart Rienties , Avinash Boroowa , Simon Cross , Chris Kubiak , Kevin Mayles , and Sam Murphy . 2016 . Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at the Open University UK . Journal of Interactive Media in Education 2016 , 1 (2016). Bart Rienties, Avinash Boroowa, Simon Cross, Chris Kubiak, Kevin Mayles, and Sam Murphy. 2016. Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at the Open University UK. Journal of Interactive Media in Education 2016, 1 (2016).","journal-title":"Journal of Interactive Media in Education"},{"key":"e_1_3_2_1_42_1","volume-title":"Partners in cognition: Extending human intelligence with intelligent technologies. Educational researcher 20, 3","author":"Salomon Gavriel","year":"1991","unstructured":"Gavriel Salomon , David N Perkins , and Tamar Globerson . 1991. Partners in cognition: Extending human intelligence with intelligent technologies. Educational researcher 20, 3 ( 1991 ), 2--9. Gavriel Salomon, David N Perkins, and Tamar Globerson. 1991. Partners in cognition: Extending human intelligence with intelligent technologies. Educational researcher 20, 3 (1991), 2--9."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835542"},{"key":"e_1_3_2_1_44_1","volume-title":"Educational Data Mining","author":"Pedro Michael Sao","year":"2013","unstructured":"Michael Sao Pedro , Ryan Baker , and Janice Gobert . 2013. Incorporating scaffolding and tutor context into bayesian knowledge tracing to predict inquiry skill acquisition . In Educational Data Mining 2013 . Michael Sao Pedro, Ryan Baker, and Janice Gobert. 2013. Incorporating scaffolding and tutor context into bayesian knowledge tracing to predict inquiry skill acquisition. In Educational Data Mining 2013."},{"key":"e_1_3_2_1_45_1","first-page":"117","article-title":"Quality indicators for learning analytics","volume":"17","author":"Scheffel Maren","year":"2014","unstructured":"Maren Scheffel , Hendrik Drachsler , Slavi Stoyanov , and Marcus Specht . 2014 . Quality indicators for learning analytics . Journal of Educational Technology & Society 17 , 4 (2014), 117 . Maren Scheffel, Hendrik Drachsler, Slavi Stoyanov, and Marcus Specht. 2014. Quality indicators for learning analytics. Journal of Educational Technology & Society 17, 4 (2014), 117.","journal-title":"Journal of Educational Technology & Society"},{"key":"e_1_3_2_1_46_1","volume-title":"Active Learning (Synthesis Lectures on Artificial Intelligence and Machine Learning)","author":"Settles Burr","year":"2012","unstructured":"Burr Settles . 2012. Active Learning (Synthesis Lectures on Artificial Intelligence and Machine Learning) . Long Island, NY : Morgan & Clay Pool ( 2012 ). Burr Settles. 2012. Active Learning (Synthesis Lectures on Artificial Intelligence and Machine Learning). Long Island, NY: Morgan & Clay Pool (2012)."},{"key":"e_1_3_2_1_47_1","volume-title":"Proceedings of the 25th International Conference on Computers in Education.","author":"Shibani Aileen","unstructured":"Aileen Shibani , Simon Knight , Simon Buckingham Shum , and P. Ryan . 2017. Design and Implementation of a Pedagogic Intervention Using Writing Analytics . In Proceedings of the 25th International Conference on Computers in Education. Aileen Shibani, Simon Knight, Simon Buckingham Shum, and P. Ryan. 2017. Design and Implementation of a Pedagogic Intervention Using Writing Analytics. In Proceedings of the 25th International Conference on Computers in Education."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764213498851"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/0362-3319(91)90040-B"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148176"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2011.611369"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764213479363"},{"key":"e_1_3_2_1_53_1","volume-title":"Learning for life in the 21st century: Sociocultural perspectives on the future of education","author":"Wells Gordon","unstructured":"Gordon Wells and Guy Claxton . 2008. Learning for life in the 21st century: Sociocultural perspectives on the future of education . John Wiley & Sons . Gordon Wells and Guy Claxton. 2008. Learning for life in the 21st century: Sociocultural perspectives on the future of education. John Wiley & Sons."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2010.517150"}],"event":{"name":"LAK '18: International Conference on Learning Analytics and Knowledge","location":"Sydney New South Wales Australia","acronym":"LAK '18"},"container-title":["Proceedings of the 8th International Conference on Learning Analytics and Knowledge"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3170358.3170413","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3170358.3170413","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:43:56Z","timestamp":1750207436000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3170358.3170413"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,7]]},"references-count":54,"alternative-id":["10.1145\/3170358.3170413","10.1145\/3170358"],"URL":"https:\/\/doi.org\/10.1145\/3170358.3170413","relation":{},"subject":[],"published":{"date-parts":[[2018,3,7]]},"assertion":[{"value":"2018-03-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}