{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T14:37:16Z","timestamp":1777646236206,"version":"3.51.4"},"reference-count":43,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2024,3,31]],"date-time":"2024-03-31T00:00:00Z","timestamp":1711843200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,3,31]],"date-time":"2024-03-31T00:00:00Z","timestamp":1711843200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["Discovery grant RGPIN-2016-06051"],"award-info":[{"award-number":["Discovery grant RGPIN-2016-06051"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Games and Culture"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>Rewards are prevalent game design elements in gamified environments. Rewards are helpful tools to keep players engaged and encouraged to perform tasks. However, implementing a reward system from scratch in every gamified environment, such as citizen science games or educational applications, can be time-consuming. This article presents FORGE, a Framework for Organizing Rewards in Gamified Environments. FORGE is a free and open-source framework built to be easy to install, easy to integrate, flexible and customizable. It was designed to be used in a variety of different environments and scenarios, such as games, training software and interactive websites. The FORGE framework comes with two sample applications, a simple game concept and an educational web application, to demonstrate its capabilities and serve as an entry point for new adopters.<\/jats:p>","DOI":"10.1177\/15554120241241555","type":"journal-article","created":{"date-parts":[[2024,4,1]],"date-time":"2024-04-01T02:52:50Z","timestamp":1711939970000},"page":"94-113","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["FORGE: A Framework for Organizing Rewards in Gamified Environments"],"prefix":"10.1177","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0587-0692","authenticated-orcid":false,"given":"Rogerio","family":"de Leon Pereira","sequence":"first","affiliation":[{"name":"University of Manitoba"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2514-0264","authenticated-orcid":false,"given":"Olivier","family":"Tremblay-Savard","sequence":"additional","affiliation":[{"name":"University of Manitoba"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,3,31]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1108\/IJILT-02-2017-0009"},{"issue":"3","key":"e_1_3_3_3_1","first-page":"89","article-title":"Adaptive gamification framework to promote computational thinking in 8\u201313 year olds","volume":"17","author":"Altaie M. A.","year":"2021","unstructured":"Altaie M. A., Jawawi D. N. A. (2021). Adaptive gamification framework to promote computational thinking in 8\u201313 year olds. Journal of e-Learning and Knowledge Society, 17(3), 89\u2013100. https:\/\/doi.org\/10.20368\/1971-8829\/1135552","journal-title":"Journal of e-Learning and Knowledge Society"},{"key":"e_1_3_3_4_1","unstructured":"Antin J. Churchill E. F. (2011). Badges in social media: A social psychological perspective. In Chi 2011 gamification workshop proceedings (Vol. 7)."},{"key":"e_1_3_3_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-1328-8_17"},{"key":"e_1_3_3_6_1","volume-title":"Beyond boredom and anxiety","author":"Csikszentmihalyi M.","year":"2000","unstructured":"Csikszentmihalyi M. (2000). Beyond boredom and anxiety. Jossey-Bass."},{"key":"e_1_3_3_7_1","doi-asserted-by":"crossref","unstructured":"Dai P. Rzeszotarski J. M. Paritosh P. Chi E. H. (2015). And now for something completely different: Improving crowdsourcing workflows with micro-diversions. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing (pp. 628\u2013638).","DOI":"10.1145\/2675133.2675260"},{"key":"e_1_3_3_8_1","doi-asserted-by":"crossref","unstructured":"de Leon Pereira R. Tan A. Bunt A. Tremblay-Savard O. (2021). Increasing player engagement retention and performance through the inclusion of educational content in a citizen science. In International conference on the foundations of digital games.","DOI":"10.1145\/3472538.3472554"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/0960085X.2020.1797546"},{"key":"e_1_3_3_11_1","volume-title":"Mindset: The new psychology of success","author":"Dweck C. S.","year":"2006","unstructured":"Dweck C. S. (2006). Mindset: The new psychology of success. Random house."},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781315783048"},{"issue":"22","key":"e_1_3_3_13_1","article-title":"iCub-HRI: A software framework for complex human\u2013robot interaction scenarios on the icub humanoid robot","volume":"5","author":"Fischer T.","year":"2018","unstructured":"Fischer T., Puigbo J.-Y., Camilleri D., Nguyen P. D., Moulin-Frier C., Lall\u00e9e S., Prescott T. J., Demiris Y., Verschure P. F. (2018). iCub-HRI: A software framework for complex human\u2013robot interaction scenarios on the icub humanoid robot. Frontiers in Robotics and AI, 5(22). https:\/\/doi.org\/10.3389\/frobt.2018.00022","journal-title":"Frontiers in Robotics and AI"},{"key":"e_1_3_3_14_1","doi-asserted-by":"crossref","unstructured":"Gaston J. Cooper S. (2017). To three or not to three: Improving human computation game onboarding with a three-star system. In Proceedings of the 2017 chi conference on human factors in computing systems (p. 5034\u20135039). New York NY USA: Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3025453.3025997","DOI":"10.1145\/3025453.3025997"},{"key":"e_1_3_3_15_1","doi-asserted-by":"crossref","unstructured":"Goh D. H.-L. Pe-Than E. P. P. Lee C. S. (2015). An investigation of reward systems in human computation games. In International conference on human-computer interaction (pp. 596\u2013607).","DOI":"10.1007\/978-3-319-20916-6_55"},{"key":"e_1_3_3_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2013.01.004"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.03.036"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781405165518.wbeos1321"},{"key":"e_1_3_3_19_1","doi-asserted-by":"crossref","unstructured":"Hamari J. Eranti V. (2011). Framework for designing and evaluating game achievements. In Digra conference (Vol. 10 p. 9966).","DOI":"10.26503\/dl.v2011i1.545"},{"key":"e_1_3_3_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.07.045"},{"key":"e_1_3_3_21_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0031362"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47283-6"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.008"},{"key":"e_1_3_3_24_1","doi-asserted-by":"crossref","unstructured":"Law E. Yin M. Goh J. Chen K. Terry M. A. Gajos K. Z. (2016). Curiosity killed the cat but makes crowdwork better. In Proceedings of the 2016 chi conference on human factors in computing systems (pp. 4098\u20134110).","DOI":"10.1145\/2858036.2858144"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555412014559978"},{"key":"e_1_3_3_26_1","doi-asserted-by":"crossref","unstructured":"Matin A. Maduro M. de Leon Pereira R. Tremblay-Savard O. (2020). Effect of timer top score and leaderboard on performance and motivation in a human computing game. In International conference on the foundations of digital games (pp. 1\u201310).","DOI":"10.1145\/3402942.3403000"},{"key":"e_1_3_3_27_1","doi-asserted-by":"crossref","unstructured":"Mekler E. D. Bruhlmann F. Opwis K. Tuch A. N. (2013). Do points levels and leaderboards harm intrinsic motivation? An empirical analysis of common gamification elements. In Proceedings of the first international conference on gameful design research and applications (pp. 66\u201373).","DOI":"10.1145\/2583008.2583017"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12528-017-9150-4"},{"key":"e_1_3_3_29_1","doi-asserted-by":"crossref","unstructured":"Morschheuser B. Hamari J. Koivisto J. (2016). Gamification in crowdsourcing: A review. In 2016 49th hawaii international conference on system sciences (hicss) (p. 43754384). https:\/\/doi.org\/10.1109\/HICSS.2016.543","DOI":"10.1109\/HICSS.2016.543"},{"key":"e_1_3_3_30_1","first-page":"206","article-title":"Flow theory and research","volume":"195","author":"Nakamura J.","year":"2009","unstructured":"Nakamura J., Csikszentmihalyi M. (2009). Flow theory and research. Handbook of Positive Psychology, 195, 206.","journal-title":"Handbook of Positive Psychology"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.12116"},{"key":"e_1_3_3_32_1","volume-title":"Total engagement: Using games and virtual worlds to change the way people work and businesses compete","author":"Reeves B.","year":"2009","unstructured":"Reeves B., Read L. (2009). Total engagement: Using games and virtual worlds to change the way people work and businesses compete. Harvard Business School Publishing."},{"issue":"19","key":"e_1_3_3_33_1","first-page":"28","article-title":"Psychological perspectives on motivation through gamification","author":"Sailer M.","year":"2014","unstructured":"Sailer M., Hense J., Mandl J., Klevers M. (2014). Psychological perspectives on motivation through gamification. Interaction Design and Architecture Journal, (19), 28\u201337.","journal-title":"Interaction Design and Architecture Journal"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1201\/b22101"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-9094-9_24"},{"key":"e_1_3_3_36_1","unstructured":"Singh A. Drogaris C. Nazarova E. Blanchette M. Waldispuhl J. Matin A. I. Tremblay-Savard O. (2017). A human-computation platform for multi-scale genome analysis. Association for the Advancement of Artificial Intelligence (www. aaai. org). https:\/\/www.humancomputation.com\/2017\/papers\/100human-computationplatform.pdf"},{"key":"e_1_3_3_37_1","doi-asserted-by":"crossref","unstructured":"Siu K. Riedl M. O. (2016). Reward systems in human computation games. In Proceedings of the 2016 annual symposium on computer-human interaction in play (pp. 266\u2013275).","DOI":"10.1145\/2967934.2968083"},{"key":"e_1_3_3_38_1","doi-asserted-by":"crossref","unstructured":"Sripada S. K. Reddy Y. R. Khandelwal S. (2016). Architecting an extensible framework for gamifying software engineering concepts. In Proceedings of the 9th India software engineering conference (pp. 119\u2013130).","DOI":"10.1145\/2856636.2856649"},{"key":"e_1_3_3_39_1","doi-asserted-by":"crossref","unstructured":"Tremblay-Savard O. Butyaev A. Waldispuhl J. (2016). Collaborative solving in a human computing game using a market skills and challenges. In Proceedings of the 2016 annual symposium on computer-human interaction in play (pp. 130\u2013141).","DOI":"10.1145\/2967934.2968104"},{"key":"e_1_3_3_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iot.2021.100383"},{"key":"e_1_3_3_41_1","doi-asserted-by":"crossref","unstructured":"Wang H. Sun C.-T. (2011). Game reward systems: Gaming experiences and social meanings. In Digra conference (Vol. 114).","DOI":"10.26503\/dl.v2011i1.594"},{"key":"e_1_3_3_42_1","volume-title":"The gamification toolkit: dynamics, mechanics, and components for the win","author":"Werbach K.","year":"2015","unstructured":"Werbach K., Hunter D. (2015). The gamification toolkit: dynamics, mechanics, and components for the win. University of Pennsylvania Press."},{"key":"e_1_3_3_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2021.06.070"},{"key":"e_1_3_3_44_1","volume-title":"Gamification by design: Implementing game mechanics in web and mobile apps","author":"Zichermann G.","year":"2011","unstructured":"Zichermann G., Cunningham C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. O\u2019Reilly Media, Inc."}],"container-title":["Games and Culture"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15554120241241555","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15554120241241555","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15554120241241555","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T06:34:42Z","timestamp":1777444482000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/15554120241241555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,31]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1177\/15554120241241555"],"URL":"https:\/\/doi.org\/10.1177\/15554120241241555","relation":{},"ISSN":["1555-4120","1555-4139"],"issn-type":[{"value":"1555-4120","type":"print"},{"value":"1555-4139","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,31]]}}}