{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T15:36:26Z","timestamp":1766158586692,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,9,22]],"date-time":"2020-09-22T00:00:00Z","timestamp":1600732800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,9,22]]},"DOI":"10.1145\/3383313.3412233","type":"proceedings-article","created":{"date-parts":[[2020,9,19]],"date-time":"2020-09-19T02:28:22Z","timestamp":1600482502000},"page":"210-219","source":"Crossref","is-referenced-by-count":23,"title":["Learning to Collaborate in Multi-Module Recommendation via Multi-Agent Reinforcement Learning without Communication"],"prefix":"10.1145","author":[{"given":"Xu","family":"HE","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"An","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering Nanyang Technological University, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanghua","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haikai","family":"Chen","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rundong","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinrun","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Runsheng","family":"Yu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhirong","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,9,22]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4068(74)90037-8"},{"key":"e_1_3_2_1_2_1","unstructured":"Sungwoon Choi Heonseok Ha Uiwon Hwang Chanju Kim Jung-Woo Ha and Sungroh Yoon. 2018. Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:1801.05532(2018).  Sungwoon Choi Heonseok Ha Uiwon Hwang Chanju Kim Jung-Woo Ha and Sungroh Yoon. 2018. Reinforcement learning based recommender system using biclustering technique. arXiv preprint arXiv:1801.05532(2018)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186165"},{"key":"e_1_3_2_1_4_1","unstructured":"Jakob Foerster Gregory Farquhar Triantafyllos Afouras Nantas Nardelli and Shimon Whiteson. 2017. Counterfactual Multi-Agent Policy Gradients. arXiv preprint cs.AI\/1705.08926(2017).  Jakob Foerster Gregory Farquhar Triantafyllos Afouras Nantas Nardelli and Shimon Whiteson. 2017. Counterfactual Multi-Agent Policy Gradients. arXiv preprint cs.AI\/1705.08926(2017)."},{"volume-title":"Correlated Q-learning. In Proceedings of the International Conference on Machine Learning. 242","year":"2003","author":"Greenwald Amy","key":"e_1_3_2_1_5_1"},{"key":"e_1_3_2_1_6_1","unstructured":"Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. arXiv preprint arXiv:1801.01290(2018).  Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. arXiv preprint arXiv:1801.01290(2018)."},{"key":"e_1_3_2_1_7_1","unstructured":"Yujing Hu Qing Da Anxiang Zeng Yang Yu and Yinghui Xu. 2018. Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization Analysis and Application. arXiv preprint arXiv:1803.00710(2018).  Yujing Hu Qing Da Anxiang Zeng Yang Yu and Yinghui Xu. 2018. Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization Analysis and Application. arXiv preprint arXiv:1803.00710(2018)."},{"key":"e_1_3_2_1_8_1","unstructured":"Eugene Ie Vihan Jain Jing Wang Sanmit Navrekar Ritesh Agarwal Rui Wu Heng-Tze Cheng Morgane Lustman Vince Gatto Paul Covington 2019. Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767(2019).  Eugene Ie Vihan Jain Jing Wang Sanmit Navrekar Ritesh Agarwal Rui Wu Heng-Tze Cheng Morgane Lustman Vince Gatto Paul Covington 2019. Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767(2019)."},{"key":"e_1_3_2_1_9_1","unstructured":"Shariq Iqbal and Fei Sha. 2018. Actor-attention-critic for multi-agent reinforcement learning. arXiv preprint arXiv:1810.02912(2018).  Shariq Iqbal and Fei Sha. 2018. Actor-attention-critic for multi-agent reinforcement learning. arXiv preprint arXiv:1810.02912(2018)."},{"key":"e_1_3_2_1_10_1","unstructured":"Martin Jankowiak and Fritz Obermeyer. 2018. Pathwise derivatives beyond the reparameterization trick. arXiv preprint arXiv:1806.01851(2018).  Martin Jankowiak and Fritz Obermeyer. 2018. Pathwise derivatives beyond the reparameterization trick. arXiv preprint arXiv:1806.01851(2018)."},{"key":"e_1_3_2_1_11_1","unstructured":"Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013).  Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013)."},{"key":"e_1_3_2_1_12_1","unstructured":"Timothy\u00a0P Lillicrap Jonathan\u00a0J Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971(2015).  Timothy\u00a0P Lillicrap Jonathan\u00a0J Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971(2015)."},{"volume-title":"Machine Learning","author":"Littman L","key":"e_1_3_2_1_13_1"},{"volume-title":"Learning to rank for information retrieval. Foundations and trends in information retrieval 3, 3","year":"2009","author":"Liu Tie-Yan","key":"e_1_3_2_1_14_1"},{"key":"e_1_3_2_1_15_1","unstructured":"Yong Liu Yinan Zhang Qiong Wu Chunyan Miao Lizhen Cui Binqiang Zhao Yin Zhao and Lu Guan. 2019. Diversity-promoting deep reinforcement learning for interactive recommendation. arXiv preprint arXiv:1903.07826(2019).  Yong Liu Yinan Zhang Qiong Wu Chunyan Miao Lizhen Cui Binqiang Zhao Yin Zhao and Lu Guan. 2019. Diversity-promoting deep reinforcement learning for interactive recommendation. arXiv preprint arXiv:1903.07826(2019)."},{"key":"e_1_3_2_1_16_1","unstructured":"Ryan Lowe Yi Wu Aviv Tamar Jean Harb OpenAI\u00a0Pieter Abbeel and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. In Advances in Neural Information Processing Systems. 6379\u20136390.  Ryan Lowe Yi Wu Aviv Tamar Jean Harb OpenAI\u00a0Pieter Abbeel and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. In Advances in Neural Information Processing Systems. 6379\u20136390."},{"key":"e_1_3_2_1_17_1","first-page":"100","article-title":"Introduction to information retrieval","volume":"16","author":"Manning Christopher","year":"2010","journal-title":"Natural Language Engineering"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3209992"},{"key":"e_1_3_2_1_19_1","unstructured":"Changhua Pei Xinru Yang Qing Cui Xiao Lin Fei Sun Peng Jiang Wenwu Ou and Yongfeng Zhang. 2019. Value-aware Recommendation based on Reinforced Profit Maximization in E-commerce Systems. arXiv preprint arXiv:1902.00851(2019).  Changhua Pei Xinru Yang Qing Cui Xiao Lin Fei Sun Peng Jiang Wenwu Ou and Yongfeng Zhang. 2019. Value-aware Recommendation based on Reinforced Profit Maximization in E-commerce Systems. arXiv preprint arXiv:1902.00851(2019)."},{"key":"e_1_3_2_1_20_1","unstructured":"Tabish Rashid Mikayel Samvelyan Christian\u00a0Schroeder De\u00a0Witt Gregory Farquhar Jakob Foerster and Shimon Whiteson. 2018. QMIX: monotonic value function factorisation for deep multi-agent reinforcement learning. arXiv preprint arXiv:1803.11485(2018).  Tabish Rashid Mikayel Samvelyan Christian\u00a0Schroeder De\u00a0Witt Gregory Farquhar Jakob Foerster and Shimon Whiteson. 2018. QMIX: monotonic value function factorisation for deep multi-agent reinforcement learning. arXiv preprint arXiv:1803.11485(2018)."},{"key":"e_1_3_2_1_21_1","unstructured":"Peter Sunehag Richard Evans Gabriel Dulac-Arnold Yori Zwols Daniel Visentin and Ben Coppin. 2015. Deep reinforcement learning with attention for slate markov decision processes with high-dimensional states and actions. arXiv preprint arXiv:1512.01124(2015).  Peter Sunehag Richard Evans Gabriel Dulac-Arnold Yori Zwols Daniel Visentin and Ben Coppin. 2015. Deep reinforcement learning with attention for slate markov decision processes with high-dimensional states and actions. arXiv preprint arXiv:1512.01124(2015)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313455"},{"volume-title":"Proceedings of the International Conference on Machine Learning","year":"2020","author":"Wang Rundong","key":"e_1_3_2_1_23_1"},{"volume-title":"Conference on Learning Theory. 25\u201354","year":"2013","author":"Wang Yining","key":"e_1_3_2_1_24_1"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Mengchen Zhao Zhao Li Bo An Haifeng Lu Yifan Yang and Chen Chu. 2018. Impression Allocation for Combating Fraud in E-commerce Via Deep Reinforcement Learning with Action Norm Penalty.Proceedings of the International Joint Conferences on Artificial Intelligence Organization 3940\u20133946.  Mengchen Zhao Zhao Li Bo An Haifeng Lu Yifan Yang and Chen Chu. 2018. Impression Allocation for Combating Fraud in E-commerce Via Deep Reinforcement Learning with Action Norm Penalty.Proceedings of the International Joint Conferences on Artificial Intelligence Organization 3940\u20133946.","DOI":"10.24963\/ijcai.2018\/548"},{"volume-title":"Long Xia, Jiliang Tang, and Dawei Yin with Martin Vesely as coordinator. ACM SIGWEB NewsletterSpring","year":"2019","author":"Zhao Xiangyu","key":"e_1_3_2_1_26_1"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Xiangyu Zhao Long Xia Liang Zhang Zhuoye Ding Dawei Yin and Jiliang Tang. 2018. Deep Reinforcement Learning for Page-wise Recommendations. arXiv preprint arXiv:1805.02343(2018).  Xiangyu Zhao Long Xia Liang Zhang Zhuoye Ding Dawei Yin and Jiliang Tang. 2018. Deep Reinforcement Learning for Page-wise Recommendations. arXiv preprint arXiv:1805.02343(2018).","DOI":"10.1145\/3240323.3240374"},{"key":"e_1_3_2_1_28_1","unstructured":"Xiangyu Zhao Long Xia Yihong Zhao Dawei Yin and Jiliang Tang. 2019. Model-Based Reinforcement Learning for Whole-Chain Recommendations. arXiv preprint arXiv:1902.03987(2019).  Xiangyu Zhao Long Xia Yihong Zhao Dawei Yin and Jiliang Tang. 2019. Model-Based Reinforcement Learning for Whole-Chain Recommendations. arXiv preprint arXiv:1902.03987(2019)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185994"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Lixin Zou Long Xia Zhuoye Ding Jiaxing Song Weidong Liu and Dawei Yin. 2019. Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems. arXiv preprint arXiv:1902.05570(2019).  Lixin Zou Long Xia Zhuoye Ding Jiaxing Song Weidong Liu and Dawei Yin. 2019. Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems. arXiv preprint arXiv:1902.05570(2019).","DOI":"10.1145\/3292500.3330668"}],"event":{"name":"RecSys '20: Fourteenth ACM Conference on Recommender Systems","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGecom Special Interest Group on Economics and Computation"],"location":"Virtual Event Brazil","acronym":"RecSys '20"},"container-title":["Fourteenth ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383313.3412233","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3383313.3412233","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:21Z","timestamp":1750199601000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383313.3412233"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,22]]},"references-count":30,"alternative-id":["10.1145\/3383313.3412233","10.1145\/3383313"],"URL":"https:\/\/doi.org\/10.1145\/3383313.3412233","relation":{},"subject":[],"published":{"date-parts":[[2020,9,22]]}}}