{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T05:18:50Z","timestamp":1788326330289,"version":"build-2803163510"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T00:00:00Z","timestamp":1788220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/100031478","name":"NextGenerationEU","doi-asserted-by":"publisher","award":["PE00000013"],"award-info":[{"award-number":["PE00000013"]}],"id":[{"id":"10.13039\/100031478","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Recomm. Syst."],"published-print":{"date-parts":[[2027,1,31]]},"abstract":"<jats:p>In recent years, environmental sustainability has emerged as a critical issue for society, prompting governments, local authorities, and private organizations to promote initiatives that encourage more sustainable lifestyles. One such initiative is the AWorld application, which leverages gamification to educate, raise awareness, and inspire positive behavioral changes. The app engages users through personalized challenges, or missions, that require interaction with its features and reward participants with in-game points. In this article, we present a hierarchical Multi-Armed Bandit (MAB) framework, MABTree, designed to replace AWorld\u2019s current random mission assignment with a targeted and adaptive approach guided by a custom reward function. Using real-world interaction data from AWorld, we evaluated MABTree in an offline setting across multiple policies and configurations. Results show that MABTree improves cumulative reward, user coverage, and mission diversity compared to classical MAB baselines, with particularly strong gains in balancing exploration of new features and exploitation of known user preferences. While these findings indicate the potential of MABTree to enhance personalization and engagement in sustainability-focused applications, further online testing is needed to validate its real-world impact on long-term user behavior change.<\/jats:p>","DOI":"10.1145\/3788864","type":"journal-article","created":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T21:14:59Z","timestamp":1769030099000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Multi-Armed Bandit Framework for Personalized Sustainability Goal Assignment"],"prefix":"10.1145","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-3211-9632","authenticated-orcid":false,"given":"Riccardo","family":"Belliato","sequence":"first","affiliation":[{"name":"Motivational Digital Systems, FBK","place":["Trento, Italy"]},{"name":"Department of Mathematics, Computer Science and Physics, University of Udine","place":["Trento, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1154-1382","authenticated-orcid":false,"given":"Antonio","family":"Bucchiarone","sequence":"additional","affiliation":[{"name":"SWEN Research Group, University of L'Aquila","place":["L'Aquila, Italy"]},{"name":"MoDiS Research Unit, FBK","place":["L'Aquila, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7254-1963","authenticated-orcid":false,"given":"Giuseppe","family":"Valetto","sequence":"additional","affiliation":[{"name":"AWorld S.r.l.","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7931-3650","authenticated-orcid":false,"given":"Giuseppe","family":"Minardi","sequence":"additional","affiliation":[{"name":"Indipendent Researcher","place":["Turin, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8699-7777","authenticated-orcid":false,"given":"Annapaola","family":"Marconi","sequence":"additional","affiliation":[{"name":"Motivational Digital Systems, FBK","place":["Trento, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9191-3280","authenticated-orcid":false,"given":"Kevin","family":"Roitero","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Computer Science and Physics, University of Udine","place":["Udine, Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,9,1]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1137\/S0097539701398375"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2022.103657"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-16014-1_6"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-57840-3_31"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CEC48606.2020.9185782"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2017.12.009"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1002\/ca.24074"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.18662\/brain\/14.2\/452"},{"key":"e_1_3_2_10_2","volume-title":"Flow: The Psychology of Optimal Experience","author":"Csikszentmihalyi Mihaly","year":"1990","unstructured":"Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience. Harper & Row."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.2196\/18035"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2008.06.005"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.3389\/feduc.2018.00099"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICISC62624.2024.00071"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-024-12477-6"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-022-00849-w"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103266"},{"key":"e_1_3_2_19_2","first-page":"8833","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Hong Joey","year":"2022","unstructured":"Joey Hong, Branislav Kveton, Sumeet Katariya, Manzil Zaheer, and Mohammad Ghavamzadeh. 2022. Deep hierarchy in bandits. In Proceedings of the International Conference on Machine Learning. PMLR, 8833\u20138851."},{"key":"e_1_3_2_20_2","article-title":"Non-stochastic bandit slate problems","volume":"23","author":"Kale Satyen","year":"2010","unstructured":"Satyen Kale, Lev Reyzin, and Robert E. Schapire. 2010. Non-stochastic bandit slate problems. Advances in Neural Information Processing Systems 23 (2010).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2926720"},{"key":"e_1_3_2_22_2","unstructured":"Jaya Kawale and Elliot Chow. 2018. A MultiArmed Bandit Framework For Recommendations at Netflix. https:\/\/www.slideshare.net\/JayaKawale\/a-multiarmed-bandit-framework-for-recommendations-at-netflix"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130859.3131321"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-019-09255-2"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-019-09255-2"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102495"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2018.10.013"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.3390\/su12020712"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106963"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-92833-8_15"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935878"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.57.9.705"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.3390\/app142210220"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2015.03.008"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1108\/JOSM-12-2021-0487"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","unstructured":"Lennart E. Nacke and Sebastian Deterding. 2017. The maturing of gamification research. Computers in Human Behavior 71 (2017) 450\u2013454.","DOI":"10.1016\/j.chb.2016.11.062"},{"key":"e_1_3_2_38_2","unstructured":"United Nations. 2015. Transforming Our World: The 2030 Agenda for Sustainable Development. Retrieved January 7 2025 from https:\/\/sdgs.un.org\/2030agenda. Adopted by all United Nations Member States this agenda provides a blueprint for peace and prosperity emphasizing 17 Sustainable Development Goals (SDGs) to address global challenges including poverty inequality climate change and environmental degradation."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-022-11122-4"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.3390\/nu15081950"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273587"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.4278\/0890-1171-12.1.38"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00083"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.11.007"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.68"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3359274"},{"key":"e_1_3_2_47_2","first-page":"9422","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Sen Rajat","year":"2021","unstructured":"Rajat Sen, Alexander Rakhlin, Lexing Ying, Rahul Kidambi, Dean Foster, Daniel N. Hill, and Inderjit S. Dhillon. 2021. Top-k extreme contextual bandits with arm hierarchy. In Proceedings of the International Conference on Machine Learning. PMLR, 9422\u20139433."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/MTS.2012.2225457"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.116669"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3099023.3099114"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3099023.3099114"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2967934.2968082"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.2307\/3001913"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611975321.74"},{"key":"e_1_3_2_55_2","unstructured":"Yisong Yue Sue Ann Hong and Carlos Guestrin. 2012. Hierarchical exploration for accelerating contextual bandits. arXiv:1206.6454. Retrieved from https:\/\/arxiv.org\/abs\/1206.6454"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.2196\/19968"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.2196\/19968"}],"container-title":["ACM Transactions on Recommender Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3788864","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T16:54:05Z","timestamp":1788281645000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3788864"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,1]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2027,1,31]]}},"alternative-id":["10.1145\/3788864"],"URL":"https:\/\/doi.org\/10.1145\/3788864","relation":{},"ISSN":["2770-6699"],"issn-type":[{"value":"2770-6699","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,1]]},"assertion":[{"value":"2025-01-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}