{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:42:33Z","timestamp":1776112953215,"version":"3.50.1"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"CHI PLAY","license":[{"start":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T00:00:00Z","timestamp":1633392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,5]]},"abstract":"<jats:p>Designers of instructional software use gamification to help motivate and engage learners. Typically focusing on gamifying a single task, designers aim to provide a straightforward path through learning. In contrast, video games frequently provide optional secondary tasks using collectibles. Collectibles-like coins-are secondary, non-essential goals that encourage players to selectively take on additional challenges and engage more with a game. While research supports the idea that by increasing engagement learning can be improved, exactly how collectibles-an extremely common element in games-might be employed in gamified learning and how it might affect the play experience is underexplored. We present the results of a study comparing a gamified photo-editing training game that uses collectibles to one without collectibles. Our results show that learners choose to engage more when collectibles are present, and that this has a positive effect on software skills applied to a representative out-of-game challenge. Our findings provide a nuanced view of the tradeoffs in motivation and experience when collectibles are used.<\/jats:p>","DOI":"10.1145\/3474691","type":"journal-article","created":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T22:59:48Z","timestamp":1633561188000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Pathfinder"],"prefix":"10.1145","volume":"5","author":[{"given":"Tim","family":"Nagl\u00e9","sequence":"first","affiliation":[{"name":"Eindhoven University of Technology, Eindhoven, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott","family":"Bateman","sequence":"additional","affiliation":[{"name":"University of New Brunswick, Fredericton, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max V.","family":"Birk","sequence":"additional","affiliation":[{"name":"Eindhoven University of Technology, Eindhoven, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"key":"e_1_2_3_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159365.2159370"},{"key":"e_1_2_3_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979131"},{"key":"e_1_2_3_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207687"},{"key":"e_1_2_3_4_1","doi-asserted-by":"publisher","unstructured":"Craig G Anderson Kathryn Campbell and Constance Steinkuehler. 2019. Building Persistence Through Failure The Role of Challenge in Video Games. https:\/\/doi.org\/10.1145\/3337722.3337741","DOI":"10.1145\/3337722.3337741"},{"key":"e_1_2_3_5_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781410615862--66"},{"key":"e_1_2_3_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858062"},{"key":"e_1_2_3_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174234"},{"key":"e_1_2_3_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2793107.2793111"},{"key":"e_1_2_3_9_1","doi-asserted-by":"publisher","DOI":"10.7334\/psicothema2016.383"},{"key":"e_1_2_3_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858227"},{"key":"e_1_2_3_11_1","volume-title":"Development of the Video Game Demand Scale","author":"Bowman Nicholas David","unstructured":"Nicholas David Bowman, Joseph Wasserman, and Jaime Banks. 2018. Development of the Video Game Demand Scale. Routledge."},{"key":"e_1_2_3_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2691352.2691353"},{"key":"e_1_2_3_13_1","volume-title":"Medium. Retrieved","author":"Bycer Josh","year":"2019","unstructured":"Josh Bycer. 2019. The Crafting of Collectibles in Videogames. Medium. Retrieved September 12, 2020 from https:\/\/medium.com\/@GWBycer\/the-crafting-of-collectibles-in-videogames-1ca37f39ccff"},{"key":"e_1_2_3_14_1","doi-asserted-by":"publisher","unstructured":"Andy Cockburn Carl Gutwin Joey Scarr and Sylvain Malacria. 2014. Supporting novice to expert transitions in user interfaces. ACM Computing Surveys 47. https:\/\/doi.org\/10.1145\/2659796","DOI":"10.1145\/2659796"},{"key":"e_1_2_3_15_1","doi-asserted-by":"publisher","unstructured":"Seth Cooper Firas Khatib Adrien Treuille Janos Barbero Jeehyung Lee Michael Beenen Andrew Leaver-Fay David Baker Zoran Popovi? and Foldit Players. 2010. Predicting protein structures with a multiplayer online game. Nature 466 7307: 756--760. https:\/\/doi.org\/10.1038\/nature09304","DOI":"10.1038\/nature09304"},{"key":"e_1_2_3_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.1991.9653137"},{"key":"e_1_2_3_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_2_3_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208358"},{"key":"e_1_2_3_19_1","volume-title":"Retrieved","author":"Donthu N","year":"2020","unstructured":"N Donthu, A Gustafsson - Journal of business research, and undefined 2020. Effects of COVID-19 on business and research. ncbi.nlm.nih.gov. Retrieved September 16, 2020 from https:\/\/www.ncbi.nlm.nih.gov\/pmc\/PMC7280091"},{"key":"e_1_2_3_20_1","volume-title":"Retrieved","year":"2017","unstructured":"Dorknado. 2017. Collectables In Video Games: How And When To Use Them. dorknado.com. Retrieved September 12, 2020 from http:\/\/dorknado.com\/collectables-video-games-use\/"},{"key":"e_1_2_3_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047245"},{"key":"e_1_2_3_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878114553569"},{"key":"e_1_2_3_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878102238607"},{"key":"e_1_2_3_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025997"},{"key":"e_1_2_3_25_1","first-page":"9","article-title":"Game Studies - Unlocking the Gameworld: The Rewards of Space and Time in Videogames","volume":"11","author":"Gazzard Alison","year":"2012","unstructured":"Alison Gazzard. 2012. Game Studies - Unlocking the Gameworld: The Rewards of Space and Time in Videogames. Game Studies 11, 1: 9--13. Retrieved September 12, 2020 from http:\/\/gamestudies.org\/1101\/articles\/gazzard_alison","journal-title":"Game Studies"},{"key":"e_1_2_3_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2513383.2513436"},{"key":"e_1_2_3_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.11.022"},{"key":"e_1_2_3_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518803"},{"key":"e_1_2_3_29_1","doi-asserted-by":"publisher","unstructured":"Philip J Guo Juho Kim and Rob Rubin. 2014. How Video Production Affects Student Engagement: An Empirical Study of MOOC Videos. dl.acm.orgPaperpile: 41--50. https:\/\/doi.org\/10.1145\/2556325.2566239","DOI":"10.1145\/2556325.2566239"},{"key":"e_1_2_3_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.03.036"},{"key":"e_1_2_3_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2485760.2485764"},{"key":"e_1_2_3_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166--4115(08)62386--9"},{"key":"e_1_2_3_33_1","doi-asserted-by":"publisher","unstructured":"Colby Johanson. 2019. Bride of Frankensystem. https:\/\/doi.org\/http:\/\/doi.org\/10.5281\/zenodo.3544693","DOI":"10.5281\/zenodo.3544693"},{"key":"e_1_2_3_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1952222.1952281"},{"key":"e_1_2_3_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025580"},{"key":"e_1_2_3_36_1","doi-asserted-by":"publisher","DOI":"10.5430\/jms.v5n4p110"},{"key":"e_1_2_3_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2006.10.001"},{"key":"e_1_2_3_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2141512.2141598"},{"key":"e_1_2_3_39_1","volume-title":"HComp'15 Proceedings of the AAAI Conference on Human Computation: 102--109","author":"Krause Markus","year":"2015","unstructured":"Markus Krause and Ren\u00e9 Kizilcec. 2015. To Play or not to Play : Interactions between Response Quality and Task Complexity in Games and Paid Crowdsourcing. HComp'15 Proceedings of the AAAI Conference on Human Computation: 102--109."},{"key":"e_1_2_3_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466235"},{"key":"e_1_2_3_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.008"},{"key":"e_1_2_3_42_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781315820972--28"},{"key":"e_1_2_3_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380131"},{"key":"e_1_2_3_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.57.9.705"},{"key":"e_1_2_3_45_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2015.00040"},{"key":"e_1_2_3_46_1","unstructured":"Scott Mackenzie. 2013. HCI Reseach: An Empirical Research Perspective."},{"key":"e_1_2_3_47_1","volume-title":"Volunteering Versus Work for Pay: Incentives and Tradeoffs in Crowdsourcing. First AAAI Conference on Human Computation and Crowdsourcing: 94--102","author":"Mao Andrew","unstructured":"Andrew Mao, Ece Kamar, Yiling Chen, Eric Horvitz, Megan E. Schwamb, Chris J. Lintott, and Arfon M. Smith. 2013. Volunteering Versus Work for Pay: Incentives and Tradeoffs in Crowdsourcing. First AAAI Conference on Human Computation and Crowdsourcing: 94--102. Retrieved from http:\/\/www.aaai.org\/ocs\/index.php\/HCOMP\/HCOMP13\/paper\/view\/7497"},{"key":"e_1_2_3_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365--2729.2004.00096.x"},{"key":"e_1_2_3_49_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0124--6"},{"key":"e_1_2_3_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2013.04.003"},{"key":"e_1_2_3_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/02701367.1989.10607413"},{"key":"e_1_2_3_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2583008.2583017"},{"key":"e_1_2_3_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.048"},{"key":"e_1_2_3_54_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654308326083"},{"key":"e_1_2_3_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481341"},{"key":"e_1_2_3_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2008.02.016"},{"key":"e_1_2_3_57_1","doi-asserted-by":"publisher","DOI":"10.1080\/15213269.2012.673850"},{"key":"e_1_2_3_58_1","volume-title":"Retrieved","author":"Phillips Tom","year":"2017","unstructured":"Tom Phillips. 2017. The reward for collecting all 900 Zelda: Breath of the Wild Korok seeds is a bit poo. eurogamer.net. Retrieved September 12, 2020 from https:\/\/www.eurogamer.net\/articles\/2017-03--15-theres-a-ridiculous-reward-if-you-collect-zeldas-900-korok-seeds"},{"key":"e_1_2_3_59_1","doi-asserted-by":"publisher","DOI":"10.1089\/cpb.2009.0083"},{"key":"e_1_2_3_60_1","doi-asserted-by":"publisher","DOI":"10.1089\/cyber.2011.0437"},{"key":"e_1_2_3_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2018.08.018"},{"key":"e_1_2_3_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.68"},{"key":"e_1_2_3_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11031-006--9051--8"},{"key":"e_1_2_3_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3235765.3235796"},{"key":"e_1_2_3_65_1","volume-title":"CEUR Workshop Proceedings 2282","author":"Sarkar Anurag","year":"2018","unstructured":"Anurag Sarkar, Varun Sriram, Riddhi Padte, Jeffrey Cao, and Seth Cooper. 2018. Desire path-inspired procedural placement of coins in a platformer game. CEUR Workshop Proceedings 2282."},{"key":"e_1_2_3_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.05.005"},{"key":"e_1_2_3_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858412"},{"key":"e_1_2_3_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2014.09.006"},{"key":"e_1_2_3_69_1","doi-asserted-by":"publisher","DOI":"10.1177\/1071181312561455"},{"key":"e_1_2_3_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357152"},{"key":"e_1_2_3_71_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40561-019-0106--1"},{"key":"e_1_2_3_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2019.00035"},{"key":"e_1_2_3_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116627"},{"key":"e_1_2_3_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2967934.2968088"},{"key":"e_1_2_3_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159365.2159381"},{"key":"e_1_2_3_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025497"},{"key":"e_1_2_3_77_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1015"},{"key":"e_1_2_3_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025967"},{"key":"e_1_2_3_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300549"},{"key":"e_1_2_3_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/GAS.2013.6632588"},{"key":"e_1_2_3_81_1","doi-asserted-by":"publisher","unstructured":"Bluma Zeigarnik. 1938. On finished and unfinished tasks. In A source book of Gestalt psychology. 300--314. https:\/\/doi.org\/10.1037\/11496-025","DOI":"10.1037\/11496-025"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474691","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474691","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:42Z","timestamp":1750191522000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474691"}},"subtitle":["The Behavioural and Motivational Effects of Collectibles in Gamified Software Training"],"short-title":[],"issued":{"date-parts":[[2021,10,5]]},"references-count":81,"journal-issue":{"issue":"CHI PLAY","published-print":{"date-parts":[[2021,10,5]]}},"alternative-id":["10.1145\/3474691"],"URL":"https:\/\/doi.org\/10.1145\/3474691","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,5]]},"assertion":[{"value":"2021-10-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}