{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T10:36:06Z","timestamp":1777113366737,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,27]]},"DOI":"10.1145\/3785022.3785040","type":"proceedings-article","created":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T09:39:01Z","timestamp":1777109941000},"page":"150-159","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Revisiting the Hint Button: Consistent Negative Associations Between Unproductive Hint Use and Learning Outcomes in Intelligent Tutoring Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5165-640X","authenticated-orcid":false,"given":"Marshall","family":"An","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6921-2878","authenticated-orcid":false,"given":"Mahboobeh","family":"Mehrvarz","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2291-1468","authenticated-orcid":false,"given":"John","family":"Stamper","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1196-5284","authenticated-orcid":false,"given":"Bruce M.","family":"McLaren","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2026,4,26]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Vincent Aleven Bruce\u00a0M Mclaren Jonathan Sewall and Kenneth\u00a0R Koedinger. 2009. A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education 19 2 (2009) 105\u2013154.","DOI":"10.3233\/IRG-2009-19(2)02"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Vincent Aleven Bruce\u00a0M McLaren Jonathan Sewall Martin Van\u00a0Velsen Octav Popescu Sandra Demi Michael Ringenberg and Kenneth\u00a0R Koedinger. 2016. Example-tracing tutors: Intelligent tutor development for non-programmers. International Journal of Artificial Intelligence in Education 26 1 (2016) 224\u2013269.","DOI":"10.1007\/s40593-015-0088-2"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Vincent Aleven Ido Roll Bruce\u00a0M McLaren and Kenneth\u00a0R Koedinger. 2016. Help helps but only so much: Research on help seeking with intelligent tutoring systems. International Journal of Artificial Intelligence in Education 26 1 (2016) 205\u2013223.","DOI":"10.1007\/s40593-015-0089-1"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"crossref","unstructured":"John\u00a0R Anderson Albert\u00a0T Corbett Kenneth\u00a0R Koedinger and Ray Pelletier. 1995. Cognitive tutors: Lessons learned. The journal of the learning sciences 4 2 (1995) 167\u2013207.","DOI":"10.1207\/s15327809jls0402_2"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30139-4_44"},{"key":"e_1_3_3_1_7_2","first-page":"195","volume-title":"AIED","author":"Arroyo Ivon","year":"2007","unstructured":"Ivon Arroyo, Kimberly Ferguson, Jeffrey Johns, Toby Dragon, Hasmik Meheranian, Don Fisher, Andrew Barto, Sridhar Mahadevan, and Beverly\u00a0Park Woolf. 2007. Repairing disengagement with non-invasive interventions. In AIED, Vol.\u00a02007. 195\u2013202."},{"key":"e_1_3_3_1_8_2","unstructured":"Ryan Baker Jason Walonoski Neil Heffernan Ido Roll Albert Corbett and Kenneth Koedinger. 2008. Why students engage in \u201cgaming the system\u201d behavior in interactive learning environments. Journal of Interactive Learning Research 19 2 (2008) 185\u2013224."},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30139-4_50"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/11527886_28"},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985741"},{"key":"e_1_3_3_1_12_2","first-page":"57","volume-title":"AIED","author":"Baker Ryan\u00a0Shaun","year":"2005","unstructured":"Ryan\u00a0Shaun Baker, Ido Roll, Albert\u00a0T Corbett, and Kenneth\u00a0R Koedinger. 2005. Do performance goals lead students to game the system?. In AIED. 57\u201364."},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"crossref","unstructured":"Ryan SJ\u00a0d Baker Albert\u00a0T Corbett Ido Roll and Kenneth\u00a0R Koedinger. 2008. Developing a generalizable detector of when students game the system. User Modeling and User-Adapted Interaction 18 3 (2008) 287\u2013314.","DOI":"10.1007\/s11257-007-9045-6"},{"key":"e_1_3_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13470-8_25"},{"key":"e_1_3_3_1_15_2","volume-title":"Artificial Intelligence in Education","author":"Cocea Mihaela","year":"2009","unstructured":"Mihaela Cocea. 2009. The impact of off-task and gaming behaviors on learning: immediate or aggregate. In Artificial Intelligence in Education."},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203771587"},{"key":"e_1_3_3_1_17_2","first-page":"109","volume-title":"Design Recommendations for Intelligent Tutoring Systems: Volume 2-Instructional Management","author":"Goldberg Benjamin","year":"2014","unstructured":"Benjamin Goldberg and Randall Spain. 2014. Creating the Intelligent Novice: Supporting Self-Regulated Learning and Metacognition in Educational. In Design Recommendations for Intelligent Tutoring Systems: Volume 2-Instructional Management. Vol.\u00a02. US Army Research Laboratory, 109."},{"key":"e_1_3_3_1_18_2","first-page":"194","volume-title":"Proceedings of the 10th International Conference on Intelligent Tutoring Systems (ITS2010) Part","volume":"1","author":"Gong Yue","year":"2010","unstructured":"Yue Gong, J Beck, Neil\u00a0T Heffernan, and Elijah Forbes-Summers. 2010. The impact of gaming (?) on learning at the fine-grained level. In Proceedings of the 10th International Conference on Intelligent Tutoring Systems (ITS2010) Part, Vol.\u00a01. 194\u2013203."},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Rex Hartson. 2003. Cognitive physical sensory and functional affordances in interaction design. Behaviour & information technology 22 5 (2003) 315\u2013338.","DOI":"10.1080\/01449290310001592587"},{"key":"e_1_3_3_1_20_2","volume-title":"The psychology of reading and language comprehension.","author":"Just Marcel\u00a0Adam","year":"1987","unstructured":"Marcel\u00a0Adam Just and Patricia\u00a0Ann Carpenter. 1987. The psychology of reading and language comprehension.Allyn & Bacon."},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Kenneth\u00a0R Koedinger and Vincent Aleven. 2007. Exploring the assistance dilemma in experiments with cognitive tutors. Educational psychology review 19 3 (2007) 239\u2013264.","DOI":"10.1007\/s10648-007-9049-0"},{"key":"e_1_3_3_1_22_2","unstructured":"Kenneth\u00a0R Koedinger Ryan\u00a0SJd Baker Kyle Cunningham Alida Skogsholm Brett Leber and John Stamper. 2010. A data repository for the EDM community: The PSLC DataShop. Handbook of educational data mining 43 (2010) 43\u201356."},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Kenneth\u00a0R Koedinger Albert\u00a0T Corbett and Charles Perfetti. 2012. The Knowledge-Learning-Instruction framework: Bridging the science-practice chasm to enhance robust student learning. Cognitive science 36 5 (2012) 757\u2013798.","DOI":"10.1111\/j.1551-6709.2012.01245.x"},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724681"},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"crossref","unstructured":"James\u00a0A Kulik and John\u00a0D Fletcher. 2016. Effectiveness of intelligent tutoring systems: a meta-analytic review. Review of educational research 86 1 (2016) 42\u201378.","DOI":"10.3102\/0034654315581420"},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07221-0_47"},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Mehak Maniktala Christa Cody Tiffany Barnes and Min Chi. 2020. Avoiding help avoidance: Using interface design changes to promote unsolicited hint usage in an intelligent tutor. International Journal of Artificial Intelligence in Education 30 4 (2020) 637\u2013667.","DOI":"10.1007\/s40593-020-00213-3"},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Bruce\u00a0M McLaren J\u00a0Elizabeth Richey Huy Nguyen and Xinying Hou. 2022. How instructional context can impact learning with educational technology: Lessons from a study with a digital learning game. Computers & education 178 (2022) 104366.","DOI":"10.1016\/j.compedu.2021.104366"},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.22318\/icls2025.723915"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"crossref","unstructured":"Donald\u00a0A Norman. 1999. Affordance conventions and design. interactions 6 3 (1999) 38\u201343.","DOI":"10.1145\/301153.301168"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566248"},{"key":"e_1_3_3_1_32_2","volume-title":"CogSci","author":"Paquette Luc","year":"2014","unstructured":"Luc Paquette, Adriana\u00a0MJB de Carvalho, and Ryan\u00a0Shaun Baker. 2014. Towards Understanding Expert Coding of Student Disengagement in Online Learning. In CogSci."},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Michael Pressley Eileen Wood Vera\u00a0E Woloshyn Vicki Martin Alison King and Deborah Menke. 1992. Encouraging mindful use of prior knowledge: Attempting to construct explanatory answers facilitates learning. Educational psychologist 27 1 (1992) 91\u2013109.","DOI":"10.1207\/s15326985ep2701_7"},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13388-6_39"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-64302-6_15"},{"key":"e_1_3_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Ido Roll Vincent Aleven Bruce\u00a0M McLaren and Kenneth\u00a0R Koedinger. 2011. Improving students\u2019 help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and instruction 21 2 (2011) 267\u2013280.","DOI":"10.1016\/j.learninstruc.2010.07.004"},{"key":"e_1_3_3_1_37_2","unstructured":"Benjamin Shih Kenneth\u00a0R Koedinger and Richard Scheines. 2008. A Response Time Model For Bottom-Out Hints as Worked Examples. EDM 2008 (2008) 117\u2013126."},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Faiza Tahir Antonija Mitrovic and Valerie Sotardi. 2022. Investigating the causal relationships between badges and learning outcomes in SQL-Tutor. Research and Practice in Technology Enhanced Learning 17 1 (2022) 7.","DOI":"10.1186\/s41039-022-00180-4"},{"key":"e_1_3_3_1_39_2","doi-asserted-by":"crossref","unstructured":"Kurt VanLehn. 2011. The relative effectiveness of human tutoring intelligent tutoring systems and other tutoring systems. Educational psychologist 46 4 (2011) 197\u2013221.","DOI":"10.1080\/00461520.2011.611369"},{"key":"e_1_3_3_1_40_2","volume-title":"Mind in society: The development of higher psychological processes","author":"Vygotsky Lev\u00a0S","year":"1978","unstructured":"Lev\u00a0S Vygotsky. 1978. Mind in society: The development of higher psychological processes. Vol.\u00a086. Harvard university press."},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/11774303_80"}],"event":{"name":"LAK 2026: LAK26: 16th International Learning Analytics and Knowledge Conference","location":"Bergen Norway","acronym":"LAK 2026"},"container-title":["Proceedings of the LAK26: 16th International Learning Analytics and Knowledge Conference"],"original-title":[],"deposited":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T09:46:47Z","timestamp":1777110407000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3785022.3785040"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,26]]},"references-count":40,"alternative-id":["10.1145\/3785022.3785040","10.1145\/3785022"],"URL":"https:\/\/doi.org\/10.1145\/3785022.3785040","relation":{},"subject":[],"published":{"date-parts":[[2026,4,26]]},"assertion":[{"value":"2026-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}