{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T02:28:55Z","timestamp":1772159335191,"version":"3.50.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,8,29]],"date-time":"2017-08-29T00:00:00Z","timestamp":1503964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1321045"],"award-info":[{"award-number":["IIS-1321045"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>\n            In recent years, learning process data have become increasingly easy to collect through computer-based learning environments. This has led to increased interest in the field of\n            <jats:italic>learning analytics<\/jats:italic>\n            , which is concerned with leveraging learning process data in order to better understand, and ultimately to improve, teaching and learning. In computing education, the logical place to collect learning process data is through integrated development environments (IDEs), where computing students typically spend large amounts of time working on programming assignments. While the primary purpose of IDEs is to support computer programming, they might also be used as a mechanism for delivering learning interventions designed to enhance student learning. The possibility of using IDEs both to collect learning process data, and to strategically intervene in the learning process, suggests an exciting design space for computing education research: that of\n            <jats:italic>IDE-based learning analytics<\/jats:italic>\n            . In order to facilitate the systematic exploration of this design space, we present an IDE-based data analytics process model with four primary activities: (1)\n            <jats:italic>Collect data,<\/jats:italic>\n            (2)\n            <jats:italic>Analyze data,<\/jats:italic>\n            (3)\n            <jats:italic>Design intervention,<\/jats:italic>\n            and (4)\n            <jats:italic>Deliver intervention<\/jats:italic>\n            . For each activity, we identify key design dimensions and review relevant computing education literature. To provide guidance on designing\n            <jats:italic>effective<\/jats:italic>\n            interventions, we describe four relevant learning theories, and consider their implications for design. Based on our review, we present a call-to-action for future research into IDE-based learning analytics.\n          <\/jats:p>","DOI":"10.1145\/3105759","type":"journal-article","created":{"date-parts":[[2017,8,28]],"date-time":"2017-08-28T12:45:15Z","timestamp":1503924315000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["IDE-Based Learning Analytics for Computing Education"],"prefix":"10.1145","volume":"17","author":[{"given":"C. D.","family":"Hundhausen","sequence":"first","affiliation":[{"name":"Washington State University, Pullman, WA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D. M.","family":"Olivares","sequence":"additional","affiliation":[{"name":"Washington State University, Pullman, WA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A. S.","family":"Carter","sequence":"additional","affiliation":[{"name":"Humboldt State University, Arcata, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,8,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787717"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0159178"},{"key":"e_1_2_1_3_1","volume-title":"Cognitive Science 13","author":"Anderson J. R.","year":"1989"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/6592.6593"},{"key":"e_1_2_1_5_1","first-page":"26","article-title":"An investigation of factors related to self efficacy for java programming among engineering students","volume":"8","author":"Askar P.","year":"2009","journal-title":"Turkish Journal of Educational Technology"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"R. S. J. Baker and G. Siemens. 2014. Educational data mining and learning analytics. The Cambridge Handbook of the Learning Sciences. Cambridge University Press. 253--274.  R. S. J. Baker and G. Siemens. 2014. Educational data mining and learning analytics. The Cambridge Handbook of the Learning Sciences. Cambridge University Press. 253--274.","DOI":"10.1017\/CBO9781139519526.016"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8624.00273"},{"key":"e_1_2_1_8_1","unstructured":"A. Bandura. 1997. Self-efficacy: the Exercise of Control. Worth Publishers.  A. Bandura. 1997. Self-efficacy: the Exercise of Control. Worth Publishers."},{"key":"e_1_2_1_9_1","unstructured":"A. Bandura. 1986. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice Hall.  A. Bandura. 1986. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice Hall."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"A. Barr M. Beard and R. C. Atkinson. 1976. The computer as a tutorial laboratory: The Stanford BIP Project. International Journal of Man-Machine Studies 8 (1976) 567--596.  A. Barr M. Beard and R. C. Atkinson. 1976. The computer as a tutorial laboratory: The Stanford BIP Project. International Journal of Man-Machine Studies 8 (1976) 567--596.","DOI":"10.1016\/S0020-7373(76)80021-1"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028014.1028066"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897000.2897007"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/567067.567069"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Workshop on AI-supported Education for Computer Science at the 16th International Conference on Artificial Intelligence in Education (AIEDws\u201913)","author":"Bosch N.","year":"2013"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X018001032"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538924"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445287"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632344"},{"key":"e_1_2_1_19_1","unstructured":"S. K. Card T. P. Moran and A. Newell. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates.   S. K. Card T. P. Moran and A. Newell. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the Thirteenth Australasian Computing Education Conference -","volume":"114","author":"Cardell-Oliver R.","year":"2011"},{"key":"e_1_2_1_21_1","unstructured":"A. C. Carter. 2013. OSBIDE. http:\/\/osbide.codeplex.com. Accessed date 26 July 2016.  A. C. Carter. 2013. OSBIDE. http:\/\/osbide.codeplex.com. Accessed date 26 July 2016."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787710"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2831373.2831399"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960322"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"A. Collins J. S. Brown and S. E. Newman. 1989. Cognitive apprenticeship: Teaching the craft of reading writing and mathematics. Knowing Learning and Instruction: Essays in honor of Robert Glaser. L.B. Resnick ed. Lawrence Erlbaum Associates. 453--494.  A. Collins J. S. Brown and S. E. Newman. 1989. Cognitive apprenticeship: Teaching the craft of reading writing and mathematics. Knowing Learning and Instruction: Essays in honor of Robert Glaser. L.B. Resnick ed. Lawrence Erlbaum Associates. 453--494.","DOI":"10.4324\/9781315044408-14"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"A. T. Corbett and J. R. Anderson. 1992. The LISP intelligent tutoring system: Research in skill acquisition. In Computer Assisted Instruction and Intelligent Tutoring Systems: Establishing Communication and Collaboration. Erlbaum. 73--110.  A. T. Corbett and J. R. Anderson. 1992. The LISP intelligent tutoring system: Research in skill acquisition. In Computer Assisted Instruction and Intelligent Tutoring Systems: Establishing Communication and Collaboration. Erlbaum. 73--110.","DOI":"10.4324\/9781315044361-4"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.83.1.17"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591708.2591748"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the International Conference on Educational Data Mining. 91--100","author":"Dominguez A. K."},{"key":"e_1_2_1_30_1","unstructured":"Eclipse.org. 2016. Usage Data Collector User Guide. https:\/\/eclipse.org\/org\/usagedata\/userguide.php. Accessed date 26 July 2016.  Eclipse.org. 2016. Usage Data Collector User Guide. https:\/\/eclipse.org\/org\/usagedata\/userguide.php. Accessed date 26 July 2016."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1384271.1384371"},{"key":"e_1_2_1_32_1","volume-title":"Protocol Analysis: Verbal Reports as Data","author":"Ericsson K. A.","year":"1984"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.44.2.419"},{"key":"e_1_2_1_34_1","first-page":"1","article-title":"Cognitive apprenticeship, technology, and the contextualization of learning environments","volume":"4","author":"Ghefaili A.","year":"2003","journal-title":"Journal of Educational Computing, Design 8 Online Learning"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"M. Guzdial. 1994. Software-realized scaffolding to facilitate programming for science learning. Interactive learning Environments 4 1 (1994) 1--44.  M. Guzdial. 1994. Software-realized scaffolding to facilitate programming for science learning. Interactive learning Environments 4 1 (1994) 1--44.","DOI":"10.1080\/1049482940040101"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1076\/ilee.6.1.143.3609"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538921"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753478"},{"key":"e_1_2_1_39_1","unstructured":"B. Herold. 2014. \u201cLandmark\u201d student-data-privacy law enacted in California. Education Week.  B. Herold. 2014. \u201cLandmark\u201d student-data-privacy law enacted in California. Education Week."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.2002.0237"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734432"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2656450.2656476"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858798"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151588.1151600"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30950-2_40"},{"key":"e_1_2_1_46_1","unstructured":"J. Johnson. 2010. Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Rules. Morgan Kaufmann Publishers Inc.   J. Johnson. 2010. Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Rules. Morgan Kaufmann Publishers Inc."},{"key":"e_1_2_1_47_1","unstructured":"P. Johnson. 2010. Hackystat - A framework for collection analysis visualization interpretation annotation and dissemination of software development process and product data. https:\/\/code.google.com\/p\/hackystat\/. Accessed date 11 August 2016.  P. Johnson. 2010. Hackystat - A framework for collection analysis visualization interpretation annotation and dissemination of software development process and product data. https:\/\/code.google.com\/p\/hackystat\/. Accessed date 11 August 2016."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.83.3.693"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786864"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.4.249.17496"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511815355"},{"key":"e_1_2_1_52_1","unstructured":"J. A. Luke. 2015. Continuously Collecting Software Development Event Data As Students Program. M.S. Thesis Virginia Tech.  J. A. Luke. 2015. Continuously Collecting Software Development Event Data As Students Program. M.S. Thesis Virginia Tech."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0037123"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/2819009.2819206"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884803"},{"key":"e_1_2_1_56_1","unstructured":"Netbeans.org. 2016. Netbeans Usage Data Tracking. http:\/\/netbeans.org\/about\/usage-tracking.html. Accessed date 26 July 2016.  Netbeans.org. 2016. Netbeans Usage Data Tracking. http:\/\/netbeans.org\/about\/usage-tracking.html. Accessed date 26 July 2016."},{"key":"e_1_2_1_57_1","unstructured":"D. A. Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition. Basic Books.  D. A. Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition. Basic Books."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1597849.1384284"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_1"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493394.2493401"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2007.06.009"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724668"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 1st Workshop on AI-supported Education for Computer Science.","author":"Rivers K."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1595496.1562929"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1584322.1584332"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037276.2037278"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0092976"},{"key":"e_1_2_1_68_1","volume-title":"Encyclopedia of Software Engineering","author":"Scacchi W."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240866.1241057"},{"key":"e_1_2_1_70_1","first-page":"123","article-title":"Exploratory experiments in programmer behavior","volume":"5","author":"Shneiderman B.","year":"1976","journal-title":"International Journal of Man-Machine Studies"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1066129.1066140"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140131"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462476.2465594"},{"key":"e_1_2_1_74_1","unstructured":"Stack Overflow. 2012. Stack Overflow. http:\/\/stackoverflow.com\/. Accessed date 21 November 2016.  Stack Overflow. 2012. Stack Overflow. http:\/\/stackoverflow.com\/. Accessed date 21 November 2016."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.3233\/JAI-130029"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022193728205"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-013-0751-2"},{"key":"e_1_2_1_78_1","volume-title":"ELEED: E-Learning and Education 8, 1","author":"Verbert K.","year":"2012"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462476.2462501"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2013.99"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3105759","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3105759","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3105759","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:38Z","timestamp":1750217438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3105759"}},"subtitle":["A Process Model, Critical Review, and Research Agenda"],"short-title":[],"issued":{"date-parts":[[2017,8,29]]},"references-count":80,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3105759"],"URL":"https:\/\/doi.org\/10.1145\/3105759","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,29]]},"assertion":[{"value":"2016-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}