{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:06:38Z","timestamp":1750309598995,"version":"3.41.0"},"reference-count":19,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T00:00:00Z","timestamp":1742256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMETRICS Perform. Eval. Rev."],"published-print":{"date-parts":[[2025,3,18]]},"abstract":"<jats:p>Email marketing has become an essential tool for businesses to reach out to potential customers [16]. However, the use of mass marketing raises ethical and environmental issues. In fact, this practice tarnishes domain reputation with potential spamming and overwhelms recipients with irrelevant content. Not only does this decrease user engagement, but it also results in a negative user experience. Moreover, it contributes to significant carbon emissions [5], especially with emails containing heavy attachments. To address these challenges, we propose a novel approach that frames the problem as a Contextual Restless Bandit Recommender System aiming to target relevant user segments while adapting to dynamic environments. The objective is to offer a more effective and sustainable solution, minimizing unnecessary email transmissions and ensuring that recipients receive content tailored to their profile.<\/jats:p>","DOI":"10.1145\/3725536.3725547","type":"journal-article","created":{"date-parts":[[2025,3,18]],"date-time":"2025-03-18T22:19:36Z","timestamp":1742336376000},"page":"21-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Whittle Index-Based Q-Learning for Contextual Restless Bandits: A Case Study in Email Marketing"],"prefix":"10.1145","volume":"52","author":[{"given":"Ibtihal","family":"El Mimouni","sequence":"first","affiliation":[{"name":"INRIA NEO, Smartprofile, Universit\u00c9 C\u00f4te d'Azur Sophia Antipolis, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,3,18]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"CNIL https:\/\/www.cnil.fr\/en."},{"key":"e_1_2_1_2_1","unstructured":"GDPR https:\/\/gdpr-info.eu\/."},{"key":"e_1_2_1_3_1","unstructured":"Smartprofile https:\/\/smartp.com\/."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2022.110186"},{"key":"e_1_2_1_5_1","volume-title":"How bad are bananas?: the carbon footprint of everything","author":"Berners-Lee M.","year":"2020","unstructured":"M. Berners-Lee, How bad are bananas?: the carbon footprint of everything. Profile Books, 2020."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1017\/9781108571401"},{"key":"e_1_2_1_7_1","first-page":"11492","volume-title":"PMLR","author":"Zhou D.","year":"2020","unstructured":"D. Zhou, L. Li, and Q. Gu, \"Neural contextual bandits with UCB-based exploration,\" in International Conference on Machine Learning, PMLR, 2020, pp. 11492--11502."},{"key":"e_1_2_1_8_1","first-page":"1001","volume-title":"IEEE","author":"Avrachenkov K.","year":"2019","unstructured":"K. Avrachenkov and V. S. Borkar, \"A learning algorithm for the Whittle index policy for scheduling web crawlers,\" in 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), IEEE, 2019, pp. 1001--1006."},{"key":"e_1_2_1_9_1","first-page":"7820","volume-title":"IEEE","author":"Meshram R.","year":"2015","unstructured":"R. Meshram, D. Manjunath, and A. Gopalan, \"A restless bandit with no observable states for recommendation systems and communication link scheduling,\" in 2015 54th IEEE Conference on Decision and Control (CDC), IEEE, 2015, pp. 7820--7825."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1214\/14-STS504"},{"key":"e_1_2_1_11_1","unstructured":"L. Zhou \"A survey on contextual multi-armed bandits \" arXiv preprint arXiv:1508.03326 2015."},{"key":"e_1_2_1_12_1","first-page":"661","volume-title":"A contextual-bandit approach to personalized news article recommendation,\" in Proceedings of the 19th International Conference on World Wide Web","author":"Li L.","year":"2010","unstructured":"L. Li, W. Chu, J. Langford, and R. E. Schapire, \"A contextual-bandit approach to personalized news article recommendation,\" in Proceedings of the 19th International Conference on World Wide Web, 2010, pp. 661--670."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2068950"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1070.0505"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2004.01.036"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jt.5740078"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/245108.245121"},{"key":"e_1_2_1_18_1","first-page":"318","volume-title":"IEEE","author":"Papadimitriou C. H.","year":"1994","unstructured":"C. H. Papadimitriou and J. N. Tsitsiklis, \"The complexity of optimal queueing network control,\" in Proceedings of IEEE 9th Annual Conference on Structure in Complexity Theory, IEEE, 1994, pp. 318--322."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.2307\/3214163"}],"container-title":["ACM SIGMETRICS Performance Evaluation Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725536.3725547","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3725536.3725547","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:57:04Z","timestamp":1750298224000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725536.3725547"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,18]]},"references-count":19,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,3,18]]}},"alternative-id":["10.1145\/3725536.3725547"],"URL":"https:\/\/doi.org\/10.1145\/3725536.3725547","relation":{},"ISSN":["0163-5999"],"issn-type":[{"type":"print","value":"0163-5999"}],"subject":[],"published":{"date-parts":[[2025,3,18]]},"assertion":[{"value":"2025-03-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}