{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T16:11:14Z","timestamp":1781539874187,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":45,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ONR YIP"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,13]]},"DOI":"10.1145\/3460231.3478849","type":"proceedings-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T21:45:02Z","timestamp":1631569502000},"page":"661-667","source":"Crossref","is-referenced-by-count":16,"title":["Estimating and Penalizing Preference Shift in Recommender Systems"],"prefix":"10.1145","author":[{"given":"Micah","family":"Carroll","sequence":"first","affiliation":[{"name":"UC Berkeley, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dylan","family":"Hadfield-Menell","sequence":"additional","affiliation":[{"name":"UC Berkeley, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stuart","family":"Russell","sequence":"additional","affiliation":[{"name":"UC Berkeley, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anca","family":"Dragan","sequence":"additional","affiliation":[{"name":"UC Berkeley, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Aspiration: The Agency of Becoming","unstructured":"2018. Aspiration: The Agency of Becoming . Oxford University Press , Oxford, New York. 2018. Aspiration: The Agency of Becoming. Oxford University Press, Oxford, New York."},{"key":"e_1_3_2_2_2_1","volume-title":"Reinforcement learning based recommender systems: A survey. arXiv:2101.06286 [cs] (Jan","author":"Afsar Mehdi","year":"2021","unstructured":"M.\u00a0 Mehdi Afsar , Trafford Crump , and Behrouz Far . 2021. Reinforcement learning based recommender systems: A survey. arXiv:2101.06286 [cs] (Jan . 2021 ). http:\/\/arxiv.org\/abs\/2101.06286 arXiv:2101.06286. M.\u00a0Mehdi Afsar, Trafford Crump, and Behrouz Far. 2021. Reinforcement learning based recommender systems: A survey. arXiv:2101.06286 [cs] (Jan. 2021). http:\/\/arxiv.org\/abs\/2101.06286 arXiv:2101.06286."},{"key":"e_1_3_2_2_3_1","first-page":"2","article-title":"Online Social Network Site Addiction","volume":"2","author":"Andreassen Cecilie\u00a0Schou","year":"2015","unstructured":"Cecilie\u00a0Schou Andreassen . 2015 . Online Social Network Site Addiction : A Comprehensive Review. Current Addiction Reports 2 , 2 (June 2015), 175\u2013184. https:\/\/doi.org\/10.1007\/s40429-015-0056-9 Cecilie\u00a0Schou Andreassen. 2015. Online Social Network Site Addiction: A Comprehensive Review. Current Addiction Reports 2, 2 (June 2015), 175\u2013184. https:\/\/doi.org\/10.1007\/s40429-015-0056-9","journal-title":"A Comprehensive Review. Current Addiction Reports"},{"key":"e_1_3_2_2_4_1","volume-title":"Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation. arXiv:1911.03845 [cs, stat] (Jan","author":"Bai Xueying","year":"2020","unstructured":"Xueying Bai , Jian Guan , and Hongning Wang . 2020. Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation. arXiv:1911.03845 [cs, stat] (Jan . 2020 ). http:\/\/arxiv.org\/abs\/1911.03845 arXiv:1911.03845. Xueying Bai, Jian Guan, and Hongning Wang. 2020. Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation. arXiv:1911.03845 [cs, stat] (Jan. 2020). http:\/\/arxiv.org\/abs\/1911.03845 arXiv:1911.03845."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.20190390"},{"key":"e_1_3_2_2_6_1","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, Atlanta GA USA, 150\u2013159","author":"Bountouridis Dimitrios","year":"2019","unstructured":"Dimitrios Bountouridis , Jaron Harambam , Mykola Makhortykh , M\u00f3nica Marrero , Nava Tintarev , and Claudia Hauff . 2019 . SIREN: A Simulation Framework for Understanding the Effects of Recommender Systems in Online News Environments . In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, Atlanta GA USA, 150\u2013159 . https:\/\/doi.org\/10.1145\/3287560.3287583 Dimitrios Bountouridis, Jaron Harambam, Mykola Makhortykh, M\u00f3nica Marrero, Nava Tintarev, and Claudia Hauff. 2019. SIREN: A Simulation Framework for Understanding the Effects of Recommender Systems in Online News Environments. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, Atlanta GA USA, 150\u2013159. https:\/\/doi.org\/10.1145\/3287560.3287583"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240370"},{"key":"e_1_3_2_2_8_1","volume-title":"Generative Adversarial User Model for Reinforcement Learning Based Recommendation System. arXiv:1812.10613 [cs, stat] (Dec","author":"Chen Xinshi","year":"2019","unstructured":"Xinshi Chen , Shuang Li , Hui Li , Shaohua Jiang , Yuan Qi , and Le Song . 2019. Generative Adversarial User Model for Reinforcement Learning Based Recommendation System. arXiv:1812.10613 [cs, stat] (Dec . 2019 ). http:\/\/arxiv.org\/abs\/1812.10613 arXiv:1812.10613. Xinshi Chen, Shuang Li, Hui Li, Shaohua Jiang, Yuan Qi, and Le Song. 2019. Generative Adversarial User Model for Reinforcement Learning Based Recommendation System. arXiv:1812.10613 [cs, stat] (Dec. 2019). http:\/\/arxiv.org\/abs\/1812.10613 arXiv:1812.10613."},{"key":"e_1_3_2_2_9_1","volume-title":"arXiv:1606.07792 [cs, stat] (June","author":"Cheng Heng-Tze","year":"2016","unstructured":"Heng-Tze Cheng , Levent Koc , Jeremiah Harmsen , Tal Shaked , Tushar Chandra , Hrishi Aradhye , Glen Anderson , Greg Corrado , Wei Chai , Mustafa Ispir , Rohan Anil , Zakaria Haque , Lichan Hong , Vihan Jain , Xiaobing Liu , and Hemal Shah . 2016. Wide & Deep Learning for Recommender Systems . arXiv:1606.07792 [cs, stat] (June 2016 ). http:\/\/arxiv.org\/abs\/1606.07792 arXiv:1606.07792. Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, Rohan Anil, Zakaria Haque, Lichan Hong, Vihan Jain, Xiaobing Liu, and Hemal Shah. 2016. Wide & Deep Learning for Recommender Systems. arXiv:1606.07792 [cs, stat] (June 2016). http:\/\/arxiv.org\/abs\/1606.07792 arXiv:1606.07792."},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI \u201903)","author":"Cosley Dan","year":"2003","unstructured":"Dan Cosley , Shyong\u00a0 K. Lam , Istvan Albert , Joseph\u00a0 A. Konstan , and John Riedl . 2003 . Is seeing believing? how recommender system interfaces affect users\u2019 opinions . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI \u201903) . Association for Computing Machinery, New York, NY, USA, 585\u2013592. https:\/\/doi.org\/10.1145\/642611.642713 Dan Cosley, Shyong\u00a0K. Lam, Istvan Albert, Joseph\u00a0A. Konstan, and John Riedl. 2003. Is seeing believing? how recommender system interfaces affect users\u2019 opinions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI \u201903). Association for Computing Machinery, New York, NY, USA, 585\u2013592. https:\/\/doi.org\/10.1145\/642611.642713"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959190"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/1088868309352251"},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of the 10th ACM Conference on Recommender Systems. ACM, Boston Massachusetts USA, 221\u2013224","author":"D.","unstructured":"Michael\u00a0 D. Ekstrand and Martijn\u00a0C. Willemsen. 2016. Behaviorism is Not Enough: Better Recommendations through Listening to Users . In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, Boston Massachusetts USA, 221\u2013224 . https:\/\/doi.org\/10.1145\/2959100.2959179 Michael\u00a0D. Ekstrand and Martijn\u00a0C. Willemsen. 2016. Behaviorism is Not Enough: Better Recommendations through Listening to Users. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, Boston Massachusetts USA, 221\u2013224. https:\/\/doi.org\/10.1145\/2959100.2959179"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.2753\/JEC1086-4415110204"},{"key":"e_1_3_2_2_15_1","volume-title":"Excessive use of online video streaming services: Impact of recommender system use, psychological factors, and motives. Computers in Human Behavior 80 (March","author":"Hasan Md\u00a0Rajibul","year":"2018","unstructured":"Md\u00a0Rajibul Hasan , Ashish\u00a0Kumar Jha , and Yi Liu . 2018. Excessive use of online video streaming services: Impact of recommender system use, psychological factors, and motives. Computers in Human Behavior 80 (March 2018 ), 220\u2013228. https:\/\/doi.org\/10.1016\/j.chb.2017.11.020 Md\u00a0Rajibul Hasan, Ashish\u00a0Kumar Jha, and Yi Liu. 2018. Excessive use of online video streaming services: Impact of recommender system use, psychological factors, and motives. Computers in Human Behavior 80 (March 2018), 220\u2013228. https:\/\/doi.org\/10.1016\/j.chb.2017.11.020"},{"key":"e_1_3_2_2_16_1","volume-title":"The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify. arXiv:2003.08203 [cs] (March","author":"Holtz David","year":"2020","unstructured":"David Holtz , Benjamin Carterette , Praveen Chandar , Zahra Nazari , Henriette Cramer , and Sinan Aral . 2020. The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify. arXiv:2003.08203 [cs] (March 2020 ). http:\/\/arxiv.org\/abs\/2003.08203 arXiv:2003.08203. David Holtz, Benjamin Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, and Sinan Aral. 2020. The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify. arXiv:2003.08203 [cs] (March 2020). http:\/\/arxiv.org\/abs\/2003.08203 arXiv:2003.08203."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9876.00136"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1207\/153276603768344807"},{"key":"e_1_3_2_2_19_1","volume-title":"Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology. arXiv:1905.12767 [cs, stat] (May","author":"Ie Eugene","year":"2019","unstructured":"Eugene Ie , Vihan Jain , Jing Wang , Sanmit Narvekar , Ritesh Agarwal , Rui Wu , Heng-Tze Cheng , Morgane Lustman , Vince Gatto , Paul Covington , Jim McFadden , Tushar Chandra , and Craig Boutilier . 2019. Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology. arXiv:1905.12767 [cs, stat] (May 2019 ). http:\/\/arxiv.org\/abs\/1905.12767 arXiv:1905.12767. Eugene Ie, Vihan Jain, Jing Wang, Sanmit Narvekar, Ritesh Agarwal, Rui Wu, Heng-Tze Cheng, Morgane Lustman, Vince Gatto, Paul Covington, Jim McFadden, Tushar Chandra, and Craig Boutilier. 2019. Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology. arXiv:1905.12767 [cs, stat] (May 2019). http:\/\/arxiv.org\/abs\/1905.12767 arXiv:1905.12767."},{"key":"e_1_3_2_2_20_1","volume-title":"Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society (Jan. 2019","author":"Jiang Ray","year":"2019","unstructured":"Ray Jiang , Silvia Chiappa , Tor Lattimore , Andr\u00e1s Gy\u00f6rgy , and Pushmeet Kohli . 2019 . Degenerate Feedback Loops in Recommender Systems . Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society (Jan. 2019 ), 383\u2013390. https:\/\/doi.org\/10.1145\/3306618.3314288 arXiv:1902.10730. Ray Jiang, Silvia Chiappa, Tor Lattimore, Andr\u00e1s Gy\u00f6rgy, and Pushmeet Kohli. 2019. Degenerate Feedback Loops in Recommender Systems. Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society (Jan. 2019), 383\u2013390. https:\/\/doi.org\/10.1145\/3306618.3314288 arXiv:1902.10730."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Prerna Juneja and Tanushree Mitra. 2021. Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation. (2021) 27.  Prerna Juneja and Tanushree Mitra. 2021. Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation. (2021) 27.","DOI":"10.1145\/3411764.3445250"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1320040111"},{"key":"e_1_3_2_2_23_1","volume-title":"Hidden Incentives for Auto-Induced Distributional Shift. arXiv:2009.09153 [cs, stat] (Sept","author":"Krueger David","year":"2020","unstructured":"David Krueger , Tegan Maharaj , and Jan Leike . 2020. Hidden Incentives for Auto-Induced Distributional Shift. arXiv:2009.09153 [cs, stat] (Sept . 2020 ). http:\/\/arxiv.org\/abs\/2009.09153 arXiv:2009.09153. David Krueger, Tegan Maharaj, and Jan Leike. 2020. Hidden Incentives for Auto-Induced Distributional Shift. arXiv:2009.09153 [cs, stat] (Sept. 2020). http:\/\/arxiv.org\/abs\/2009.09153 arXiv:2009.09153."},{"key":"e_1_3_2_2_24_1","first-page":"7","article-title":"Modeling and broadening temporal user interest in personalized news recommendation","volume":"41","author":"Li Lei","year":"2014","unstructured":"Lei Li , Li Zheng , Fan Yang , and Tao Li . 2014 . Modeling and broadening temporal user interest in personalized news recommendation . Expert Systems with Applications 41 , 7 (June 2014), 3168\u20133177. https:\/\/doi.org\/10.1016\/j.eswa.2013.11.020 Lei Li, Li Zheng, Fan Yang, and Tao Li. 2014. Modeling and broadening temporal user interest in personalized news recommendation. Expert Systems with Applications 41, 7 (June 2014), 3168\u20133177. https:\/\/doi.org\/10.1016\/j.eswa.2013.11.020","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_2_2_25_1","volume-title":"RLlib: Abstractions for Distributed Reinforcement Learning. arXiv:1712.09381 [cs] (June","author":"Liang Eric","year":"2018","unstructured":"Eric Liang , Richard Liaw , Philipp Moritz , Robert Nishihara , Roy Fox , Ken Goldberg , Joseph\u00a0 E. Gonzalez , Michael\u00a0 I. Jordan , and Ion Stoica . 2018. RLlib: Abstractions for Distributed Reinforcement Learning. arXiv:1712.09381 [cs] (June 2018 ). http:\/\/arxiv.org\/abs\/1712.09381 arXiv:1712.09381. Eric Liang, Richard Liaw, Philipp Moritz, Robert Nishihara, Roy Fox, Ken Goldberg, Joseph\u00a0E. Gonzalez, Michael\u00a0I. Jordan, and Ion Stoica. 2018. RLlib: Abstractions for Distributed Reinforcement Learning. arXiv:1712.09381 [cs] (June 2018). http:\/\/arxiv.org\/abs\/1712.09381 arXiv:1712.09381."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Jordan Louviere David Hensher and Joffre Swait. 2000. Stated choice methods: analysis and application. Vol.\u00a017. https:\/\/doi.org\/10.1017\/CBO9780511753831.008  Jordan Louviere David Hensher and Joffre Swait. 2000. Stated choice methods: analysis and application. Vol.\u00a017. https:\/\/doi.org\/10.1017\/CBO9780511753831.008","DOI":"10.1017\/CBO9780511753831"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.63.6.890"},{"key":"e_1_3_2_2_28_1","volume-title":"Feedback Loop and Bias Amplification in Recommender Systems. arXiv:2007.13019 [cs] (July","author":"Mansoury Masoud","year":"2020","unstructured":"Masoud Mansoury , Himan Abdollahpouri , Mykola Pechenizkiy , Bamshad Mobasher , and Robin Burke . 2020. Feedback Loop and Bias Amplification in Recommender Systems. arXiv:2007.13019 [cs] (July 2020 ). http:\/\/arxiv.org\/abs\/2007.13019 arXiv:2007.13019. Masoud Mansoury, Himan Abdollahpouri, Mykola Pechenizkiy, Bamshad Mobasher, and Robin Burke. 2020. Feedback Loop and Bias Amplification in Recommender Systems. arXiv:2007.13019 [cs] (July 2020). http:\/\/arxiv.org\/abs\/2007.13019 arXiv:2007.13019."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1710966114"},{"key":"e_1_3_2_2_30_1","volume-title":"Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, and Vijay Rao.","author":"Mudigere Dheevatsa","year":"2021","unstructured":"Dheevatsa Mudigere , Yuchen Hao , Jianyu Huang , Andrew Tulloch , Srinivas Sridharan , Xing Liu , Mustafa Ozdal , Jade Nie , Jongsoo Park , Liang Luo , Jie\u00a0Amy Yang , Leon Gao , Dmytro Ivchenko , Aarti Basant , Yuxi Hu , Jiyan Yang , Ehsan\u00a0 K. Ardestani , Xiaodong Wang , Rakesh Komuravelli , Ching-Hsiang Chu , Serhat Yilmaz , Huayu Li , Jiyuan Qian , Zhuobo Feng , Yinbin Ma , Junjie Yang , Ellie Wen , Hong Li , Lin Yang , Chonglin Sun , Whitney Zhao , Dimitry Melts , Krishna Dhulipala , K.\u00a0 R. Kishore , Tyler Graf , Assaf Eisenman , Kiran\u00a0Kumar Matam , Adi Gangidi , Guoqiang\u00a0Jerry Chen , Manoj Krishnan , Avinash Nayak , Krishnakumar Nair , Bharath Muthiah , Mahmoud khorashadi , Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, and Vijay Rao. 2021 . High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models . arXiv:2104.05158 [cs] (April 2021). http:\/\/arxiv.org\/abs\/2104.05158 arXiv:2104.05158. Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie\u00a0Amy Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan\u00a0K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Dimitry Melts, Krishna Dhulipala, K.\u00a0R. Kishore, Tyler Graf, Assaf Eisenman, Kiran\u00a0Kumar Matam, Adi Gangidi, Guoqiang\u00a0Jerry Chen, Manoj Krishnan, Avinash Nayak, Krishnakumar Nair, Bharath Muthiah, Mahmoud khorashadi, Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, and Vijay Rao. 2021. High-performance, Distributed Training of Large-scale Deep Learning Recommendation Models. arXiv:2104.05158 [cs] (April 2021). http:\/\/arxiv.org\/abs\/2104.05158 arXiv:2104.05158."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2568012"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098108"},{"key":"e_1_3_2_2_33_1","volume-title":"Transformative experience","author":"Paul A.","unstructured":"L.\u00a0 A. Paul . 2014. Transformative experience ( 1 st ed ed.). Oxford University Press , Oxford . OCLC: ocn872342141. L.\u00a0A. Paul. 2014. Transformative experience(1st ed ed.). Oxford University Press, Oxford. OCLC: ocn872342141.","edition":"1"},{"key":"e_1_3_2_2_34_1","unstructured":"L\u00a0R Rabiner. [n.d.]. An Introduction to Hidden Markov Models. ([n.\u00a0d.]) 13.  L\u00a0R Rabiner. [n.d.]. An Introduction to Hidden Markov Models. ([n.\u00a0d.]) 13."},{"key":"e_1_3_2_2_35_1","volume-title":"Auditing Radicalization Pathways on YouTube. arXiv:1908.08313 [cs] (Dec","author":"Ribeiro Manoel\u00a0Horta","year":"2019","unstructured":"Manoel\u00a0Horta Ribeiro , Raphael Ottoni , Robert West , Virg\u00edlio A.\u00a0F. Almeida , and Wagner Meira . 2019. Auditing Radicalization Pathways on YouTube. arXiv:1908.08313 [cs] (Dec . 2019 ). http:\/\/arxiv.org\/abs\/1908.08313 arXiv:1908.08313. Manoel\u00a0Horta Ribeiro, Raphael Ottoni, Robert West, Virg\u00edlio A.\u00a0F. Almeida, and Wagner Meira. 2019. Auditing Radicalization Pathways on YouTube. arXiv:1908.08313 [cs] (Dec. 2019). http:\/\/arxiv.org\/abs\/1908.08313 arXiv:1908.08313."},{"key":"e_1_3_2_2_36_1","unstructured":"Stuart Russell and Peter Norvig. 2002. Artificial intelligence: a modern approach. (2002).  Stuart Russell and Peter Norvig. 2002. Artificial intelligence: a modern approach. (2002)."},{"key":"e_1_3_2_2_37_1","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347(2017).  John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347(2017)."},{"key":"e_1_3_2_2_38_1","volume-title":"Designing Recommender Systems to Depolarize. arXiv:2107.04953 [cs] (July","author":"Stray Jonathan","year":"2021","unstructured":"Jonathan Stray . 2021. Designing Recommender Systems to Depolarize. arXiv:2107.04953 [cs] (July 2021 ). http:\/\/arxiv.org\/abs\/2107.04953 arXiv:2107.04953. Jonathan Stray. 2021. Designing Recommender Systems to Depolarize. arXiv:2107.04953 [cs] (July 2021). http:\/\/arxiv.org\/abs\/2107.04953 arXiv:2107.04953."},{"key":"e_1_3_2_2_39_1","volume-title":"BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. arXiv:1904.06690 [cs] (Aug","author":"Sun Fei","year":"2019","unstructured":"Fei Sun , Jun Liu , Jian Wu , Changhua Pei , Xiao Lin , Wenwu Ou , and Peng Jiang . 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. arXiv:1904.06690 [cs] (Aug . 2019 ). http:\/\/arxiv.org\/abs\/1904.06690 arXiv:1904.06690. Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. arXiv:1904.06690 [cs] (Aug. 2019). http:\/\/arxiv.org\/abs\/1904.06690 arXiv:1904.06690."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018689"},{"key":"e_1_3_2_2_41_1","volume-title":"Measuring Recommender System Effects with Simulated Users. arXiv:2101.04526 [cs] (Jan","author":"Yao Sirui","year":"2021","unstructured":"Sirui Yao , Yoni Halpern , Nithum Thain , Xuezhi Wang , Kang Lee , Flavien Prost , Ed\u00a0 H. Chi , Jilin Chen , and Alex Beutel . 2021. Measuring Recommender System Effects with Simulated Users. arXiv:2101.04526 [cs] (Jan . 2021 ). http:\/\/arxiv.org\/abs\/2101.04526 arXiv:2101.04526. Sirui Yao, Yoni Halpern, Nithum Thain, Xuezhi Wang, Kang Lee, Flavien Prost, Ed\u00a0H. Chi, Jilin Chen, and Alex Beutel. 2021. Measuring Recommender System Effects with Simulated Users. arXiv:2101.04526 [cs] (Jan. 2021). http:\/\/arxiv.org\/abs\/2101.04526 arXiv:2101.04526."},{"key":"e_1_3_2_2_42_1","first-page":"1","article-title":"Deep Learning based Recommender System","volume":"52","author":"Zhang Shuai","year":"2019","unstructured":"Shuai Zhang , Lina Yao , Aixin Sun , and Yi Tay . 2019 . Deep Learning based Recommender System : A Survey and New Perspectives. Comput. Surveys 52 , 1 (Feb. 2019), 1\u201338. https:\/\/doi.org\/10.1145\/3285029 arXiv:1707.07435. Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep Learning based Recommender System: A Survey and New Perspectives. Comput. Surveys 52, 1 (Feb. 2019), 1\u201338. https:\/\/doi.org\/10.1145\/3285029 arXiv:1707.07435.","journal-title":"A Survey and New Perspectives. Comput. Surveys"},{"key":"e_1_3_2_2_43_1","volume-title":"Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks. arXiv:1404.5772 [cs] (July","author":"Zhang Yuyu","year":"2014","unstructured":"Yuyu Zhang , Hanjun Dai , Chang Xu , Jun Feng , Taifeng Wang , Jiang Bian , Bin Wang , and Tie-Yan Liu . 2014. Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks. arXiv:1404.5772 [cs] (July 2014 ). http:\/\/arxiv.org\/abs\/1404.5772 arXiv:1404.5772. Yuyu Zhang, Hanjun Dai, Chang Xu, Jun Feng, Taifeng Wang, Jiang Bian, Bin Wang, and Tie-Yan Liu. 2014. Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks. arXiv:1404.5772 [cs] (July 2014). http:\/\/arxiv.org\/abs\/1404.5772 arXiv:1404.5772."},{"key":"e_1_3_2_2_44_1","volume-title":"Toward Simulating Environments in Reinforcement Learning Based Recommendations. arXiv:1906.11462 [cs] (Sept","author":"Zhao Xiangyu","year":"2019","unstructured":"Xiangyu Zhao , Long Xia , Lixin Zou , Dawei Yin , and Jiliang Tang . 2019. Toward Simulating Environments in Reinforcement Learning Based Recommendations. arXiv:1906.11462 [cs] (Sept . 2019 ). http:\/\/arxiv.org\/abs\/1906.11462 arXiv:1906.11462. Xiangyu Zhao, Long Xia, Lixin Zou, Dawei Yin, and Jiliang Tang. 2019. Toward Simulating Environments in Reinforcement Learning Based Recommendations. arXiv:1906.11462 [cs] (Sept. 2019). http:\/\/arxiv.org\/abs\/1906.11462 arXiv:1906.11462."},{"key":"e_1_3_2_2_45_1","volume-title":"Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems. arXiv:1902.05570 [cs] (July","author":"Zou Lixin","year":"2019","unstructured":"Lixin Zou , Long Xia , Zhuoye Ding , Jiaxing Song , Weidong Liu , and Dawei Yin . 2019. Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems. arXiv:1902.05570 [cs] (July 2019 ). http:\/\/arxiv.org\/abs\/1902.05570 arXiv:1902.05570. Lixin Zou, Long Xia, Zhuoye Ding, Jiaxing Song, Weidong Liu, and Dawei Yin. 2019. Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems. arXiv:1902.05570 [cs] (July 2019). http:\/\/arxiv.org\/abs\/1902.05570 arXiv:1902.05570."}],"event":{"name":"RecSys '21: Fifteenth ACM Conference on Recommender Systems","location":"Amsterdam Netherlands","acronym":"RecSys '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Fifteenth ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3478849","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460231.3478849","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:30Z","timestamp":1750193310000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3478849"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,13]]},"references-count":45,"alternative-id":["10.1145\/3460231.3478849","10.1145\/3460231"],"URL":"https:\/\/doi.org\/10.1145\/3460231.3478849","relation":{},"subject":[],"published":{"date-parts":[[2021,9,13]]}}}