{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T14:44:06Z","timestamp":1770993846441,"version":"3.50.1"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T00:00:00Z","timestamp":1727395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Academy of Finland Flagship Programme","award":["337653"],"award-info":[{"award-number":["337653"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2024,9,30]]},"abstract":"<jats:p>Despite recent high interest among researchers and practitioners in learning programming, even the most dedicated learners can struggle to find motivation for studying and practicing programming. Therefore, in recent years, several strategies (e.g., educational games, flipped classrooms, and visual programming languages) have been employed to increase students\u2019 engagement in programming studies. However, despite these efforts, no approach has proven efficient enough to sufficiently motivate these learners, and the community continues to search for novel strategies to enhance programming learners\u2019 motivation. Building upon this, our study explores the use of unplugged gamification (i.e., gamification implemented without digital technology) combined with challenge-based learning during a programming workshop. Using Grounded Theory methods and data collected from focus groups, we analyzed and interpreted the perceptions of 24 programming learners regarding the gamified workshop. Learners reported experiencing collaboration while learning, with some indicating increased effort to obtain rewards, while others seemed to forget about the rewards altogether. Our findings provide valuable insights for computing teachers and researchers into how unplugged gamification combined with challenge-based learning is perceived by programming learners.<\/jats:p>","DOI":"10.1145\/3686165","type":"journal-article","created":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T10:02:37Z","timestamp":1722592957000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Exploring the Use of Unplugged Gamification on Programming Learners\u2019 Experience"],"prefix":"10.1145","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-6437-1312","authenticated-orcid":false,"given":"Gabriela","family":"de Carvalho Barros Bezerra","sequence":"first","affiliation":[{"name":"Institute of Mathematics and Computer Science, University of S\u00e3o Paulo, S\u00e3o Carlos, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3928-6520","authenticated-orcid":false,"given":"Wilk","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Gamification Group, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3498-0049","authenticated-orcid":false,"given":"Ana Cl\u00e1udia","family":"Guimar\u00e3es Santos","sequence":"additional","affiliation":[{"name":"Gamification Group, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6573-588X","authenticated-orcid":false,"given":"Juho","family":"Hamari","sequence":"additional","affiliation":[{"name":"Gamification Group, Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,9,27]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3383456"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3410404.3414232"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39583-8_17"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.19"},{"key":"e_1_3_2_6_2","unstructured":"Dav\u00ed\u00f0 Arnarsson and \u00cdvar H\u00fani J\u00f3hannesson. 2015. Improving Unit Testing Practices With the Use of Gamification. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:55426475"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3507696"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2020.100322"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/2382564.2382567"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1272848.1272879"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.28945\/4767"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","unstructured":"Fabio Binder Mark Nichols Sheila Reinehr and Andreia Malucelli. 2017. Challenge based learning applied to mobile software development teaching. 57\u201364. DOI: 10.1109\/CSEET.2017.19","DOI":"10.1109\/CSEET.2017.19"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/1744161.1744176"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781849209175"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3011286.3011301"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3440759"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781848607941"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1177\/002224377701400311"},{"issue":"1","key":"e_1_3_2_19_2","first-page":"509","article-title":"Grounded theory: Objectivist and constructivist methods","volume":"2","author":"Charmaz Kathy","year":"2000","unstructured":"Kathy Charmaz. 2000. Grounded theory: Objectivist and constructivist methods. Handbook of Qualitative Research 2, 1 (2000), 509\u2013535.","journal-title":"Handbook of Qualitative Research"},{"key":"e_1_3_2_20_2","first-page":"291","article-title":"Grounded theory and credibility","volume":"3","author":"Charmaz Kathy","year":"2011","unstructured":"Kathy Charmaz and Antony Bryant. 2011. Grounded theory and credibility. Qualitative Research 3 (2011), 291\u2013309.","journal-title":"Qualitative Research"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.30935\/cedtech\/8247"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3469131"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3362789.3362893"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2021.1920816"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.11.021"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.13335"},{"key":"e_1_3_2_27_2","first-page":"1","volume-title":"Proceedings of the IEEE Frontiers in Education Conference (FIE \u201923)","author":"Nascimento Isabelle Melo Do","year":"2023","unstructured":"Isabelle Melo Do Nascimento, Wilk Oliveira, Pasqueline Dantas, Luiz Oliveira da Silva Junior, Juho Hamari, and Jos\u00e9 Rocha do Amaral Neto. 2023. An experience report on teachers\u2019 training for unplugged gamified teaching in Brazil. In Proceedings of the IEEE Frontiers in Education Conference (FIE \u201923). IEEE, 1\u20135."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/FIE58773.2023.10343435"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/10494820.2023.2248220"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3607537"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3569587"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3583779"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/AST.2017.20"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1080\/13562517.2020.1863354"},{"key":"e_1_3_2_35_2","volume-title":"Discovery of grounded theory: Strategies for qualitative research","author":"Glaser Barney","year":"1967","unstructured":"Barney Glaser and Anselm Strauss. 1967. Discovery of grounded theory: Strategies for qualitative research. Routledge."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-99-0942-1_67"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22093567"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3311350.3347167"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","unstructured":"Juho Hamari. 2019. Gamification. The Blackwell Encyclopedia of Sociology 1\u20133. DOI: 10.1002\/9781405165518.wbeos1321","DOI":"10.1002\/9781405165518.wbeos1321"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.26503\/todigra.v1i2.13"},{"key":"e_1_3_2_41_2","article-title":"Developing theory with the grounded-theory approach and thematic analysis","volume":"29","author":"Heydarian Nazanin Mina","year":"2016","unstructured":"Nazanin Mina Heydarian. 2016. Developing theory with the grounded-theory approach and thematic analysis. APS Observer 29 (2016).","journal-title":"APS Observer"},{"key":"e_1_3_2_42_2","volume-title":"Challenge Based Learning: The Report From the Implementation Project","author":"Johnson Larry","year":"2011","unstructured":"Larry Johnson and Samantha Brown. 2011. Challenge Based Learning: The Report From the Implementation Project. Technical Report. The New Media Consortium."},{"key":"e_1_3_2_43_2","volume-title":"Challenge-Based Learning: An Approach for Our Time","author":"Johnson Laurence F.","year":"2009","unstructured":"Laurence F. Johnson, Rachel S. Smith, J. Troy Smythe, and Rachel K. Varon. 2009. Challenge-Based Learning: An Approach for Our Time. Technical Report. The New Media Consortium."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.5539\/ijbm.v9n11p224"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.311.7000.299"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102495"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2018.10.013"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.103872"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77277-2_18"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1111\/apps.12108"},{"key":"e_1_3_2_51_2","author":"Adams S.","year":"2011","unstructured":"S. Adams and L. Johnson. 2011. Challenge Based Learning: The Report from the Implementation Project. Technical Report. 39 pages.","journal-title":"Challenge Based Learning: The Report from the Implementation Project"},{"key":"e_1_3_2_52_2","first-page":"144","article-title":"The effect of challenge-based gamification on learning: An experiment in the context of statistics education","author":"Legaki Nikoletta-Zampeta","year":"2020","unstructured":"Nikoletta-Zampeta Legaki, Nannan Xi, Juho Hamari, Kostas Karpouzis, and Vassilios Assimakopoulos. 2020. The effect of challenge-based gamification on learning: An experiment in the context of statistics education. International Journal of Human-Computer Studies 144 (2020), 102496.","journal-title":"International Journal of Human-Computer Studies"},{"key":"e_1_3_2_53_2","article-title":"A technique for the measurement of attitudes","author":"Likert Rensis","year":"1932","unstructured":"Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of Psychology (1932).","journal-title":"Archives of Psychology"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-68201-9_70"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-022-11350-8"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49094-6_46"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/LACLO49268.2019.00013"},{"key":"e_1_3_2_58_2","first-page":"65","author":"Marczewski Andrzej","year":"2015","unstructured":"Andrzej Marczewski. 2015. User Types HEXAD. 65\u201380.","journal-title":"User Types HEXAD"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2018.2864133"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12008-021-00755-3"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1177\/160940690600500103"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.soc.22.1.129"},{"key":"e_1_3_2_63_2","first-page":"5134","volume-title":"Proceedings of the 57th Hawaii International Conference on System Sciences","author":"Muthupoltotage Udayangi Perera","year":"2024","unstructured":"Udayangi Perera Muthupoltotage. 2024. Unveiling resilience: Exploring key components of resilience among undergraduate computer science students in introductory programming courses. In Proceedings of the 57th Hawaii International Conference on System Sciences. 5134\u20135143."},{"key":"e_1_3_2_64_2","volume-title":"Challenge Based Learning White Paper","author":"Nichols Mark","year":"2008","unstructured":"Mark Nichols and Karen Cator. 2008. Challenge Based Learning White Paper. Apple, Inc., Cupertino, CA."},{"key":"e_1_3_2_65_2","volume-title":"Challenge Based Learning Guide","author":"Nichols Mark","year":"2016","unstructured":"Mark Nichols, Karen Cator, and Marco Torres. 2016. Challenge Based Learning Guide. Digital Promise, Redwood City, CA."},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1111\/2041-210X.12860"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-32-9812-5"},{"key":"e_1_3_2_68_2","first-page":"1318","volume-title":"Proceedings of the 57th Hawaii International Conference on System Sciences","author":"Oliveira Wilk","year":"2024","unstructured":"Wilk Oliveira and Juho Hamari. 2024. Global trends in flow theory research within gameful environments: A scoping review, bibliometric analysis and agenda for future studies. In Proceedings of the 57th Hawaii International Conference on System Sciences, 1318\u20131327."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-022-11122-4"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2020.152"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.22456\/1679-1916.105971"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3410404.3414267"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3513140"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3230011"},{"key":"e_1_3_2_75_2","article-title":"Building metaknowledge in AI literacy\u2013The effect of gamified vs","author":"Pinski Marc","year":"2024","unstructured":"Marc Pinski, Miguel-Jos\u00e9 Haas, and Alexander Benlian. 2024. Building metaknowledge in AI literacy\u2013The effect of gamified vs. Text-based learning on AI literacy metaknowledge. (2024).","journal-title":"Text-based learning on AI literacy metaknowledge"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2018.10.005"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485732"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432419"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2022.3162409"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432402"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","unstructured":"Alan Santos Afonso Sales Paulo Fernandes and Mark Nichols. 2015. Combining challenge-based learning and scrum framework for mobile application development. DOI: 10.1145\/2729094.2742602","DOI":"10.1145\/2729094.2742602"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-45544-y"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-021-09300-z"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611068"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2729094.2742602"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445984"},{"key":"e_1_3_2_87_2","first-page":"245","volume-title":"Proceedings of the International Conference on Information and Communication Technology and Applications","author":"Sidekerskien\u0117 Tatjana","year":"2020","unstructured":"Tatjana Sidekerskien\u0117, Robertas Dama\u0161evi\u010dius, and Rytis Maskeli\u016bnas. 2020. Validation of student psychological player types for game-based learning in university math lectures. In Proceedings of the International Conference on Information and Communication Technology and Applications. Springer, 245\u2013258."},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/2483710.2483713"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884833"},{"key":"e_1_3_2_90_2","first-page":"273","volume-title":"Handbook of Qualitative Research","author":"Strauss Anselm","year":"1994","unstructured":"Anselm Strauss and Juliet Corbin. 1994. Grounded theory methodology: An overview. In Handbook of Qualitative Research. N. K. Denzin and Y. S. Lincoln (Eds.), Sage Publications, Inc., 273\u2013285."},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.30935\/cedtech\/7942"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-78270-2_63"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40561-019-0106-1"},{"issue":"3","key":"e_1_3_2_94_2","first-page":"47","article-title":"How to gamify learning systems? An experience report using the design sprint method and a taxonomy for gamification elements in education","volume":"22","author":"Toda Armando M.","year":"2019","unstructured":"Armando M. Toda, Paula T. Palomino, Wilk Oliveira, Luiz Rodrigues, Ana C. T. Klock, Isabela Gasparini, Alexandra I. Cristea, and Seiji Isotani. 2019. How to gamify learning systems? An experience report using the design sprint method and a taxonomy for gamification elements in education. Journal of Educational Technology & Society 22, 3 (2019), 47\u201360.","journal-title":"Journal of Educational Technology & Society"},{"key":"e_1_3_2_95_2","first-page":"143","volume-title":"Proceedings of the Researcher Links Workshop: Higher Education for All","author":"Toda Armando M.","year":"2017","unstructured":"Armando M. Toda, Pedro H. D. Valle, and Seiji Isotani. 2017. The dark side of gamification: An overview of negative effects of gamification in education. In Proceedings of the Researcher Links Workshop: Higher Education for All. Springer, 143\u2013156."},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.10.002"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/2967934.2968082"},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.216"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12528-021-09271-5"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.21125\/iceri.2019.0312"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686165","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686165","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:51Z","timestamp":1750295871000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686165"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,27]]},"references-count":99,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,9,30]]}},"alternative-id":["10.1145\/3686165"],"URL":"https:\/\/doi.org\/10.1145\/3686165","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,27]]},"assertion":[{"value":"2024-02-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-19","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}