{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T20:27:52Z","timestamp":1759177672354,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":51,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,9,15]],"date-time":"2020-09-15T00:00:00Z","timestamp":1600128000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,9,15]]},"DOI":"10.1145\/3402942.3402965","type":"proceedings-article","created":{"date-parts":[[2020,9,17]],"date-time":"2020-09-17T16:38:02Z","timestamp":1600360682000},"page":"1-7","source":"Crossref","is-referenced-by-count":2,"title":["Do Game Bots Dream of Electric Rewards?"],"prefix":"10.1145","author":[{"given":"Penny","family":"Sweetser","sequence":"first","affiliation":[{"name":"Australian National University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Aitchison","sequence":"additional","affiliation":[{"name":"Australian National University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,9,17]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Marcin Andrychowicz Filip Wolski Alex Ray Jonas Schneider Rachel Fong Peter Welinder Bob McGrew Josh Tobin OpenAI\u00a0Pieter Abbeel and Wojciech Zaremba. 2017. Hindsight experience replay. In Advances in Neural Information Processing Systems. 5048\u20135058.  Marcin Andrychowicz Filip Wolski Alex Ray Jonas Schneider Rachel Fong Peter Welinder Bob McGrew Josh Tobin OpenAI\u00a0Pieter Abbeel and Wojciech Zaremba. 2017. Hindsight experience replay. In Advances in Neural Information Processing Systems. 5048\u20135058."},{"key":"e_1_3_2_1_2_1","unstructured":"Yusuf Aytar Tobias Pfaff David Budden Thomas Paine Ziyu Wang and Nando de Freitas. 2018. Playing hard exploration games by watching youtube. In Advances in Neural Information Processing Systems. 2930\u20132941.  Yusuf Aytar Tobias Pfaff David Budden Thomas Paine Ziyu Wang and Nando de Freitas. 2018. Playing hard exploration games by watching youtube. In Advances in Neural Information Processing Systems. 2930\u20132941."},{"volume-title":"Palgrave Macmillan US","author":"Bogost Ian","key":"e_1_3_2_1_3_1"},{"volume-title":"International Conference on Learning Representations.","year":"2019","author":"Burda Yuri","key":"e_1_3_2_1_4_1"},{"volume-title":"International Conference on Learning Representations.","year":"2019","author":"Burda Yuri","key":"e_1_3_2_1_5_1"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018702"},{"volume-title":"Trans.)","author":"Caillois Roger","key":"e_1_3_2_1_7_1"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.017"},{"volume-title":"Beyond Boredom and Anxiety","author":"Csikszentmihalyi Mihaly","key":"e_1_3_2_1_9_1"},{"volume-title":"Flow: The Psychology of Optimal Experience","year":"1991","author":"Csikszentmihalyi Mihaly","key":"e_1_3_2_1_10_1"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Edward\u00a0L Deci. 1971. Effects of externally mediated rewards on intrinsic motivation.Journal of personality and Social Psychology 18 1(1971) 105. https:\/\/doi.org\/10.1037\/h0030644  Edward\u00a0L Deci. 1971. Effects of externally mediated rewards on intrinsic motivation.Journal of personality and Social Psychology 18 1(1971) 105. https:\/\/doi.org\/10.1037\/h0030644","DOI":"10.1037\/h0030644"},{"volume-title":"A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation.Psychological bulletin 125, 6","year":"1999","author":"Deci L","key":"e_1_3_2_1_12_1"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/0092-6566(85)90023-6"},{"volume-title":"The lens of intrinsic skill atoms: A method for gameful design. Human\u2013Computer Interaction 30, 3-4","year":"2015","author":"Deterding Sebastian","key":"e_1_3_2_1_14_1"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41649-6_2"},{"volume-title":"Proceedings of the 2011 DiGRA International Conference: Think Design Play (DIGRA \u201811)","year":"2011","author":"Hamari Juho","key":"e_1_3_2_1_17_1"},{"volume-title":"Human-level performance in 3D multiplayer games with population-based reinforcement learning. Science 364, 6443","year":"2019","author":"Jaderberg Max","key":"e_1_3_2_1_18_1"},{"volume-title":"International Conference on Learning Representations.","year":"2016","author":"Jaderberg Max","key":"e_1_3_2_1_19_1"},{"volume-title":"Advances in Artificial Life, Mathieu\u00a0S. Capcarr\u00e8re, Alex\u00a0A. Freitas, Peter\u00a0J. Bentley, Colin\u00a0G. Johnson","author":"Klyubin S.","key":"e_1_3_2_1_20_1"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2583008.2583032"},{"volume-title":"A\u2019s, praise, and other bribes (25th anniv. ed.). Houghton Mifflin Harcourt","author":"Kohn Alfie","key":"e_1_3_2_1_22_1"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.008"},{"volume-title":"Retrieved","year":"2001","author":"Maroney Kevin","key":"e_1_3_2_1_24_1"},{"volume-title":"Human-level control through deep reinforcement learning. Nature 518, 7540","year":"2015","author":"Mnih Volodymyr","key":"e_1_3_2_1_25_1"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.11.062"},{"volume-title":"The Concept of Flow","author":"Nakamura Jeanne","key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-017-9088-8_16"},{"key":"e_1_3_2_1_28_1","unstructured":"Scott Nicholson. 2012. A User-Centered Theoretical Framework for Meaningful Gamification. In Games+Learning+Society (GLS) Conference 8.0. 223\u2013229.  Scott Nicholson. 2012. A User-Centered Theoretical Framework for Meaningful Gamification. In Games+Learning+Society (GLS) Conference 8.0. 223\u2013229."},{"volume-title":"A RECIPE for Meaningful Gamification","author":"Nicholson Scott","key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-10208-5_1"},{"volume-title":"Retrieved","year":"2016","author":"AI.","key":"e_1_3_2_1_30_1"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.70"},{"volume-title":"Retrieved","year":"2010","author":"Robertson Margaret","key":"e_1_3_2_1_32_1"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1020"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11031-006-9051-8"},{"volume-title":"International Conference on Learning Representations.","year":"2019","author":"Savinov Nikolay","key":"e_1_3_2_1_35_1"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"David Silver Aja Huang Chris\u00a0J. Maddison Arthur Guez Laurent Sifre George van\u00a0den Driessche Julian Schrittwieser Ioannis Antonoglou Veda Panneershelvam Marc Lanctot Sander Dieleman Dominik Grewe John Nham Nal Kalchbrenner Ilya Sutskever Timothy Lillicrap Madeleine Leach Koray Kavukcuoglu Thore Graepel and Demis Hassabis. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529 7587 (2016) 484\u2013489. https:\/\/doi.org\/10.1038\/nature16961  David Silver Aja Huang Chris\u00a0J. Maddison Arthur Guez Laurent Sifre George van\u00a0den Driessche Julian Schrittwieser Ioannis Antonoglou Veda Panneershelvam Marc Lanctot Sander Dieleman Dominik Grewe John Nham Nal Kalchbrenner Ilya Sutskever Timothy Lillicrap Madeleine Leach Koray Kavukcuoglu Thore Graepel and Demis Hassabis. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529 7587 (2016) 484\u2013489. https:\/\/doi.org\/10.1038\/nature16961","DOI":"10.1038\/nature16961"},{"volume-title":"A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science 362, 6419","year":"2018","author":"Silver David","key":"e_1_3_2_1_37_1"},{"key":"e_1_3_2_1_38_1","first-page":"L","article-title":"Intrinsically Motivated Reinforcement Learning","volume":"17","author":"Singh P.","year":"2005","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0054118"},{"volume-title":"Retrieved","year":"2019","key":"e_1_3_2_1_40_1"},{"volume-title":"Reinforcement learning: An introduction","author":"Sutton S.","key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-3618-5"},{"volume-title":"Article 1 (April","year":"2017","author":"Sweetser Penelope","key":"e_1_3_2_1_42_1"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077246.1077253"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1038\/058390b0"},{"volume-title":"Human-Computer Interaction. Perspectives on Design","author":"Tondello F.","key":"e_1_3_2_1_45_1"},{"volume-title":"Psychology as the behaviorist views it. Psychological review 20, 2","year":"1913","author":"Watson B.","key":"e_1_3_2_1_46_1"},{"volume-title":"Motivation reconsidered: The concept of competence. Psychological review 66, 5","year":"1959","author":"White W.","key":"e_1_3_2_1_47_1"},{"volume-title":"Retrieved","year":"2019","key":"e_1_3_2_1_48_1"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2018.12.002"},{"volume-title":"Foundations of Digital Games 2013 (FDG","year":"2013","author":"Zagal P.","key":"e_1_3_2_1_50_1"},{"key":"e_1_3_2_1_52_1","unstructured":"Gabe Zichermann and Christopher Cunningham. 2011. Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. O\u2019Reilly Sebastopol.  Gabe Zichermann and Christopher Cunningham. 2011. Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. O\u2019Reilly Sebastopol."}],"event":{"name":"FDG '20: International Conference on the Foundations of Digital Games","acronym":"FDG '20","location":"Bugibba Malta"},"container-title":["International Conference on the Foundations of Digital Games"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3402942.3402965","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3402942.3402965","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:35Z","timestamp":1750200095000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3402942.3402965"}},"subtitle":["The universality of intrinsic motivation"],"short-title":[],"issued":{"date-parts":[[2020,9,15]]},"references-count":51,"alternative-id":["10.1145\/3402942.3402965","10.1145\/3402942"],"URL":"https:\/\/doi.org\/10.1145\/3402942.3402965","relation":{},"subject":[],"published":{"date-parts":[[2020,9,15]]}}}