{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T02:47:51Z","timestamp":1783738071533,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3449864","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:00:27Z","timestamp":1622746827000},"page":"436-448","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Variation Control and Evaluation for Generative Slate Recommendations"],"prefix":"10.1145","author":[{"given":"Shuchang","family":"Liu","sequence":"first","affiliation":[{"name":"Rutgers University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Sun","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingqiang","family":"Ge","sequence":"additional","affiliation":[{"name":"Rutgers University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changhua","family":"Pei","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongfeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Rutgers University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Qingyao Ai Keping Bi Jiafeng Guo and W\u00a0Bruce Croft. 2018. Learning a deep listwise context model for ranking refinement. In SIGIR. ACM 135\u2013144.  Qingyao Ai Keping Bi Jiafeng Guo and W\u00a0Bruce Croft. 2018. Learning a deep listwise context model for ranking refinement. In SIGIR. ACM 135\u2013144."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344218"},{"key":"e_1_3_2_1_3_1","volume-title":"Xiyang Luo, Alan Mackey, and Ofer Meshi.","author":"Bello Irwan","year":"2018","unstructured":"Irwan Bello , Sayali Kulkarni , Sagar Jain , Craig Boutilier , Ed Chi, Elad Eban , Xiyang Luo, Alan Mackey, and Ofer Meshi. 2018 . Seq2slate: Re-ranking and slate optimization with rnns. arXiv preprint arXiv:1810.02019(2018). Irwan Bello, Sayali Kulkarni, Sagar Jain, Craig Boutilier, Ed Chi, Elad Eban, Xiyang Luo, Alan Mackey, and Ofer Meshi. 2018. Seq2slate: Re-ranking and slate optimization with rnns. arXiv preprint arXiv:1810.02019(2018)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240360"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Samuel\u00a0R Bowman Luke Vilnis Oriol Vinyals Andrew\u00a0M Dai Rafal Jozefowicz and Samy Bengio. 2015. Generating sentences from a continuous space. arXiv preprint arXiv:1511.06349(2015).  Samuel\u00a0R Bowman Luke Vilnis Oriol Vinyals Andrew\u00a0M Dai Rafal Jozefowicz and Samy Bengio. 2015. Generating sentences from a continuous space. arXiv preprint arXiv:1511.06349(2015).","DOI":"10.18653\/v1\/K16-1002"},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the Twelfth Irish Conference on Artificial Intelligence and Cognitive Science","author":"Bradley Keith","year":"2001","unstructured":"Keith Bradley and Barry Smyth . 2001 . Improving recommendation diversity . In Proceedings of the Twelfth Irish Conference on Artificial Intelligence and Cognitive Science , Maynooth, Ireland. Citeseer, 85\u201394. Keith Bradley and Barry Smyth. 2001. Improving recommendation diversity. In Proceedings of the Twelfth Irish Conference on Artificial Intelligence and Cognitive Science, Maynooth, Ireland. Citeseer, 85\u201394."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291025"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291025"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449973"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Charles\u00a0LA Clarke Maheedhar Kolla Gordon\u00a0V Cormack Olga Vechtomova Azin Ashkan Stefan B\u00fcttcher and Ian MacKinnon. 2008. Novelty and diversity in information retrieval evaluation. In SIGIR. 659\u2013666.  Charles\u00a0LA Clarke Maheedhar Kolla Gordon\u00a0V Cormack Olga Vechtomova Azin Ashkan Stefan B\u00fcttcher and Ian MacKinnon. 2008. Novelty and diversity in information retrieval evaluation. In SIGIR. 659\u2013666.","DOI":"10.1145\/1390334.1390446"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10593-2_40"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109877"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959178"},{"key":"e_1_3_2_1_16_1","unstructured":"Yingqiang Ge Shuchang Liu Ruoyuan Gao Yikun Xian Yunqi Li Xiangyu Zhao Changhua Pei Fei Sun Junfeng Ge Wenwu Ou 2021. Towards Long-term Fairness in Recommendation. arXiv preprint arXiv:2101.03584(2021).  Yingqiang Ge Shuchang Liu Ruoyuan Gao Yikun Xian Yunqi Li Xiangyu Zhao Changhua Pei Fei Sun Junfeng Ge Wenwu Ou 2021. Towards Long-term Fairness in Recommendation. arXiv preprint arXiv:2101.03584(2021)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401056"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330832"},{"key":"e_1_3_2_1_19_1","unstructured":"Nathaniel Good J.\u00a0Ben Schafer Joseph\u00a0A. Konstan Al Borchers Badrul Sarwar Jon Herlocker and John Riedl. 1999. Combining Collaborative Filtering with Personal Agents for Better Recommendations. In Proceedings of the Sixteenth National Conference on Artificial Intelligence and the Eleventh Innovative Applications of Artificial Intelligence Conference Innovative Applications of Artificial Intelligence (Orlando Florida USA). American Association for Artificial Intelligence Menlo Park CA USA 439\u2013446.  Nathaniel Good J.\u00a0Ben Schafer Joseph\u00a0A. Konstan Al Borchers Badrul Sarwar Jon Herlocker and John Riedl. 1999. Combining Collaborative Filtering with Personal Agents for Better Recommendations. In Proceedings of the Sixteenth National Conference on Artificial Intelligence and the Eleventh Innovative Applications of Artificial Intelligence Conference Innovative Applications of Artificial Intelligence (Orlando Florida USA). American Association for Artificial Intelligence Menlo Park CA USA 439\u2013446."},{"key":"e_1_3_2_1_20_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672\u20132680.  Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672\u20132680."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_3_2_1_22_1","volume-title":"Session-based Recommendations with Recurrent Neural Networks. In 4th International Conference on Learning Representations.","author":"Hidasi Bal\u00e1zs","year":"2016","unstructured":"Bal\u00e1zs Hidasi , Alexandros Karatzoglou , Linas Baltrunas , and Domonkos Tikk . 2016 . Session-based Recommendations with Recurrent Neural Networks. In 4th International Conference on Learning Representations. Bal\u00e1zs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2016. Session-based Recommendations with Recurrent Neural Networks. In 4th International Conference on Learning Representations."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of 5th International Conference on Learning Representations.","author":"Higgins Irina","year":"2017","unstructured":"Irina Higgins , Lo\u00efc Matthey , Arka Pal , Christopher Burgess , Xavier Glorot , Matthew Botvinick , Shakir Mohamed , and Alexander Lerchner . 2017 . beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework . In Proceedings of 5th International Conference on Learning Representations. Irina Higgins, Lo\u00efc Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner. 2017. beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework. In Proceedings of 5th International Conference on Learning Representations."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1986.10478354"},{"key":"e_1_3_2_1_25_1","unstructured":"Eugene Ie Chih-wei Hsu Martin Mladenov Vihan Jain Sanmit Narvekar Jing Wang Rui Wu and Craig Boutilier. 2019. RecSim: A Configurable Simulation Platform for Recommender Systems. arXiv preprint arXiv:1909.04847(2019).  Eugene Ie Chih-wei Hsu Martin Mladenov Vihan Jain Sanmit Narvekar Jing Wang Rui Wu and Craig Boutilier. 2019. RecSim: A Configurable Simulation Platform for Recommender Systems. arXiv preprint arXiv:1909.04847(2019)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/360"},{"key":"e_1_3_2_1_27_1","unstructured":"Eugene Ie Vihan Jain Jing Wang Sanmit Navrekar Ritesh Agarwal Rui Wu Heng-Tze Cheng Morgane Lustman Vince Gatto Paul Covington 2019. Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767(2019).  Eugene Ie Vihan Jain Jing Wang Sanmit Navrekar Ritesh Agarwal Rui Wu Heng-Tze Cheng Morgane Lustman Vince Gatto Paul Covington 2019. Reinforcement learning for slate-based recommender systems: A tractable decomposition and practical methodology. arXiv preprint arXiv:1905.12767(2019)."},{"key":"e_1_3_2_1_28_1","unstructured":"Ray Jiang Sven Gowal Yuqiu Qian Timothy Mann and Danilo\u00a0J. Rezende. 2019. Beyond Greedy Ranking: Slate Optimization via List-CVAE. In ICLR.  Ray Jiang Sven Gowal Yuqiu Qian Timothy Mann and Danilo\u00a0J. Rezende. 2019. Beyond Greedy Ranking: Slate Optimization via List-CVAE. In ICLR."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Thorsten Joachims Laura\u00a0A Granka Bing Pan Helene Hembrooke and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Sigir Vol.\u00a05. 154\u2013161.  Thorsten Joachims Laura\u00a0A Granka Bing Pan Helene Hembrooke and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Sigir Vol.\u00a05. 154\u2013161.","DOI":"10.1145\/1076034.1076063"},{"key":"e_1_3_2_1_30_1","unstructured":"Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013).  Diederik\u00a0P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Yehuda Koren Robert Bell and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer8(2009) 30\u201337.  Yehuda Koren Robert Bell and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer8(2009) 30\u201337.","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186150"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Tie-Yan Liu 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3(2009) 225\u2013331.  Tie-Yan Liu 2009. Learning to rank for information retrieval. Foundations and Trends\u00ae in Information Retrieval 3 3(2009) 225\u2013331.","DOI":"10.1561\/1500000016"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403229"},{"key":"e_1_3_2_1_35_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg\u00a0S Corrado and Jeff Dean. [n.d.]. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems 26.  Tomas Mikolov Ilya Sutskever Kai Chen Greg\u00a0S Corrado and Jeff Dean. [n.d.]. Distributed Representations of Words and Phrases and their Compositionality. In Advances in Neural Information Processing Systems 26."},{"key":"e_1_3_2_1_36_1","unstructured":"Tao Qin Tie-Yan Liu Xu-Dong Zhang De-Sheng Wang and Hang Li. 2009. Global ranking using continuous conditional random fields. In Advances in neural information processing systems. 1281\u20131288.  Tao Qin Tie-Yan Liu Xu-Dong Zhang De-Sheng Wang and Hang Li. 2009. Global ranking using continuous conditional random fields. In Advances in neural information processing systems. 1281\u20131288."},{"key":"e_1_3_2_1_37_1","volume-title":"BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618(2012).","author":"Rendle Steffen","year":"2012","unstructured":"Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , and Lars Schmidt-Thieme . 2012 . BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618(2012). Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618(2012)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742726"},{"key":"e_1_3_2_1_39_1","article-title":"An MDP-based recommender system","author":"Shani Guy","year":"2005","unstructured":"Guy Shani , David Heckerman , and Ronen\u00a0 I Brafman . 2005 . An MDP-based recommender system . Journal of Machine Learning Research 6 , Sep (2005). Guy Shani, David Heckerman, and Ronen\u00a0I Brafman. 2005. An MDP-based recommender system. Journal of Machine Learning Research 6, Sep (2005).","journal-title":"Journal of Machine Learning Research 6"},{"key":"e_1_3_2_1_40_1","unstructured":"Shaoyun Shi Hanxiong Chen Weizhi Ma Jiaxin Mao Min Zhang and Yongfeng Zhang. 2020. Neural Logic Reasoning. In CIKM. 1365\u20131374.  Shaoyun Shi Hanxiong Chen Weizhi Ma Jiaxin Mao Min Zhang and Yongfeng Zhang. 2020. Neural Logic Reasoning. In CIKM. 1365\u20131374."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Fei Sun Jun Liu Jian Wu Changhua Pei Xiao Lin Wenwu Ou and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. arXiv preprint arXiv:1904.06690(2019).  Fei Sun Jun Liu Jian Wu Changhua Pei Xiao Lin Wenwu Ou and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. arXiv preprint arXiv:1904.06690(2019).","DOI":"10.1145\/3357384.3357895"},{"key":"e_1_3_2_1_42_1","unstructured":"Adith Swaminathan Akshay Krishnamurthy Alekh Agarwal Miro Dudik John Langford Damien Jose and Imed Zitouni. 2017. Off-policy evaluation for slate recommendation. In Advances in NIPS. 3632\u20133642.  Adith Swaminathan Akshay Krishnamurthy Alekh Agarwal Miro Dudik John Langford Damien Jose and Imed Zitouni. 2017. Off-policy evaluation for slate recommendation. In Advances in NIPS. 3632\u20133642."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297231.1297250"},{"key":"e_1_3_2_1_44_1","unstructured":"Paolo Viappiani and Craig Boutilier. 2010. Optimal bayesian recommendation sets and myopically optimal choice query sets. In Advances in neural information processing systems. 2352\u20132360.  Paolo Viappiani and Craig Boutilier. 2010. Optimal bayesian recommendation sets and myopically optimal choice query sets. In Advances in neural information processing systems. 2352\u20132360."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080786"},{"key":"e_1_3_2_1_46_1","unstructured":"Jianxiong Wei Anxiang Zeng Yueqiu Wu Peng Guo Qingsong Hua and Qingpeng Cai. 2020. Generator and Critic: A Deep Reinforcement Learning Approach for Slate Re-ranking in E-commerce. arXiv preprint arXiv:2005.12206(2020).  Jianxiong Wei Anxiang Zeng Yueqiu Wu Peng Guo Qingsong Hua and Qingpeng Cai. 2020. Generator and Critic: A Deep Reinforcement Learning Approach for Slate Re-ranking in E-commerce. arXiv preprint arXiv:2005.12206(2020)."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412038"},{"key":"e_1_3_2_1_48_1","unstructured":"Yisong Yue Rajan Patel and Hein Roehrig. 2010. Beyond position bias: Examining result attractiveness as a source of presentation bias in clickthrough data. In WWW. 1011\u20131018.  Yisong Yue Rajan Patel and Hein Roehrig. 2010. Beyond position bias: Examining result attractiveness as a source of presentation bias in clickthrough data. In WWW. 1011\u20131018."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1000488107"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1060745.1060754"}],"event":{"name":"WWW '21: The Web Conference 2021","location":"Ljubljana Slovenia","acronym":"WWW '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449864","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3449864","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:31Z","timestamp":1750195471000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449864"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":50,"alternative-id":["10.1145\/3442381.3449864","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3449864","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}