{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T00:34:05Z","timestamp":1773362045163,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3449913","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:03:16Z","timestamp":1622746996000},"page":"1809-1820","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["An Adversarial Imitation Click Model for Information Retrieval"],"prefix":"10.1145","author":[{"given":"Xinyi","family":"Dai","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianghao","family":"Lin","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weinan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuai","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiwen","family":"Liu","sequence":"additional","affiliation":[{"name":"Huawei Noah's Ark Lab, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruiming","family":"Tang","sequence":"additional","affiliation":[{"name":"Huawei Noah's Ark Lab, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiuqiang","family":"He","sequence":"additional","affiliation":[{"name":"Huawei Noah's Ark Lab, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianye","family":"Hao","sequence":"additional","affiliation":[{"name":"Huawei Noah's Ark Lab, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Wang","sequence":"additional","affiliation":[{"name":"University College London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Yu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015430"},{"key":"e_1_3_2_1_2_1","unstructured":"Xueying Bai Jian Guan and Hongning Wang. 2019. A Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation. In Advances in Neural Information Processing Systems. 10735\u201310746. Xueying Bai Jian Guan and Hongning Wang. 2019. A Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation. In Advances in Neural Information Processing Systems. 10735\u201310746."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Michael Bain and Claude Sammut. 1995. A Framework for Behavioural Cloning.. In Machine Intelligence 15. 103\u2013129. Michael Bain and Claude Sammut. 1995. A Framework for Behavioural Cloning.. In Machine Intelligence 15. 103\u2013129.","DOI":"10.1093\/oso\/9780198538677.003.0006"},{"key":"e_1_3_2_1_4_1","unstructured":"Samy Bengio Oriol Vinyals Navdeep Jaitly and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Advances in Neural Information Processing Systems. 1171\u20131179. Samy Bengio Oriol Vinyals Navdeep Jaitly and Noam Shazeer. 2015. Scheduled sampling for sequence prediction with recurrent neural networks. In Advances in Neural Information Processing Systems. 1171\u20131179."},{"key":"e_1_3_2_1_5_1","unstructured":"Christopher\u00a0M Bishop. 2006. Pattern recognition and machine learning. springer. Christopher\u00a0M Bishop. 2006. Pattern recognition and machine learning. springer."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883033"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210004"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526711"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3358158"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371819"},{"key":"e_1_3_2_1_11_1","volume-title":"International Conference on Machine Learning. PMLR, 1052\u20131061","author":"Chen Xinshi","year":"2019","unstructured":"Xinshi Chen , Shuang Li , Hui Li , Shaohua Jiang , Yuan Qi , and Le Song . 2019 . Generative adversarial user model for reinforcement learning based recommendation system . In International Conference on Machine Learning. PMLR, 1052\u20131061 . Xinshi Chen, Shuang Li, Hui Li, Shaohua Jiang, Yuan Qi, and Le Song. 2019. Generative adversarial user model for reinforcement learning based recommendation system. In International Conference on Machine Learning. PMLR, 1052\u20131061."},{"key":"e_1_3_2_1_12_1","unstructured":"Kyunghyun Cho Bart Van\u00a0Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259(2014). Kyunghyun Cho Bart Van\u00a0Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259(2014)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Aleksandr Chuklin Ilya Markov and Maarten\u00a0de Rijke. 2015. Click models for web search. Synthesis lectures on information concepts retrieval and services 7 3(2015) 1\u2013115. Aleksandr Chuklin Ilya Markov and Maarten\u00a0de Rijke. 2015. Click models for web search. Synthesis lectures on information concepts retrieval and services 7 3(2015) 1\u2013115.","DOI":"10.2200\/S00654ED1V01Y201507ICR043"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341545"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390392"},{"key":"e_1_3_2_1_16_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672\u20132680. Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672\u20132680."},{"key":"e_1_3_2_1_17_1","unstructured":"Alex Graves Greg Wayne and Ivo Danihelka. 2014. Neural turing machines. arXiv preprint arXiv:1410.5401(2014). Alex Graves Greg Wayne and Ivo Danihelka. 2014. Neural turing machines. arXiv preprint arXiv:1410.5401(2014)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526712"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498818"},{"key":"e_1_3_2_1_20_1","unstructured":"Jonathan Ho and Stefano Ermon. 2016. Generative adversarial imitation learning. In Advances in neural information processing systems. 4565\u20134573. Jonathan Ho and Stefano Ermon. 2016. Generative adversarial imitation learning. In Advances in neural information processing systems. 4565\u20134573."},{"key":"e_1_3_2_1_21_1","volume-title":"Long short-term memory. Neural computation 9, 8","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation 9, 8 ( 1997 ), 1735\u20131780. Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735\u20131780."},{"key":"e_1_3_2_1_22_1","volume-title":"IR Evaluation Methods for Retrieving Highly Relevant Documents. SIGIR Forum","author":"J\u00e4rvelin Kalervo","year":"2017","unstructured":"Kalervo J\u00e4rvelin and Jaana Kek\u00e4l\u00e4inen . 2017. IR Evaluation Methods for Retrieving Highly Relevant Documents. SIGIR Forum ( 2017 ), 243\u2013250. Kalervo J\u00e4rvelin and Jaana Kek\u00e4l\u00e4inen. 2017. IR Evaluation Methods for Retrieving Highly Relevant Documents. SIGIR Forum (2017), 243\u2013250."},{"key":"e_1_3_2_1_23_1","volume-title":"ACM SIGIR Forum, Vol.\u00a051.","author":"Joachims Thorsten","unstructured":"Thorsten Joachims , Laura Granka , Bing Pan , Helene Hembrooke , and Geri Gay . 2017. Accurately interpreting clickthrough data as implicit feedback . In ACM SIGIR Forum, Vol.\u00a051. Acm New York, NY, USA , 4\u201311. Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2017. Accurately interpreting clickthrough data as implicit feedback. In ACM SIGIR Forum, Vol.\u00a051. Acm New York, NY, USA, 4\u201311."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914803"},{"key":"e_1_3_2_1_25_1","volume":"200","author":"Ng Y","unstructured":"Andrew\u00a0 Y Ng , Stuart\u00a0 J Russell , 200 0. Algorithms for inverse reinforcement learning.. In ICML, Vol.\u00a01. 2. Andrew\u00a0Y Ng, Stuart\u00a0J Russell, 2000. Algorithms for inverse reinforcement learning.. In ICML, Vol.\u00a01. 2.","journal-title":"J Russell"},{"key":"e_1_3_2_1_26_1","unstructured":"Takayuki Osa Joni Pajarinen Gerhard Neumann J\u00a0Andrew Bagnell Pieter Abbeel and Jan Peters. 2018. An algorithmic perspective on imitation learning. arXiv preprint arXiv:1811.06711(2018). Takayuki Osa Joni Pajarinen Gerhard Neumann J\u00a0Andrew Bagnell Pieter Abbeel and Jan Peters. 2018. An algorithmic perspective on imitation learning. arXiv preprint arXiv:1811.06711(2018)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242643"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the fourteenth international conference on artificial intelligence and statistics. 627\u2013635","author":"Ross St\u00e9phane","year":"2011","unstructured":"St\u00e9phane Ross , Geoffrey Gordon , and Drew Bagnell . 2011 . A reduction of imitation learning and structured prediction to no-regret online learning . In Proceedings of the fourteenth international conference on artificial intelligence and statistics. 627\u2013635 . St\u00e9phane Ross, Geoffrey Gordon, and Drew Bagnell. 2011. A reduction of imitation learning and structured prediction to no-regret online learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics. 627\u2013635."},{"key":"e_1_3_2_1_29_1","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347(2017). John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347(2017)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33014902"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835835"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3209993"},{"key":"e_1_3_2_1_33_1","unstructured":"Tian Xu Ziniu Li and Yang Yu. 2019. On Value Discrepancy of Imitation Learning. arXiv preprint arXiv:1911.07027(2019). Tian Xu Ziniu Li and Yang Yu. 2019. On Value Discrepancy of Imitation Learning. arXiv preprint arXiv:1911.07027(2019)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298649"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772793"},{"key":"e_1_3_2_1_36_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning. 5902\u20135911","author":"Zhao Junbo","year":"2018","unstructured":"Junbo Zhao , Yoon Kim , Kelly Zhang , Alexander Rush , and Yann LeCun . 2018 . Adversarially Regularized Autoencoders . In Proceedings of the 35th International Conference on Machine Learning. 5902\u20135911 . Junbo Zhao, Yoon Kim, Kelly Zhang, Alexander Rush, and Yann LeCun. 2018. Adversarially Regularized Autoencoders. In Proceedings of the 35th International Conference on Machine Learning. 5902\u20135911."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3346997"},{"key":"e_1_3_2_1_38_1","unstructured":"Brian\u00a0D Ziebart J\u00a0Andrew Bagnell and Anind\u00a0K Dey. 2010. Modeling interaction via the principle of maximum causal entropy. (2010). Brian\u00a0D Ziebart J\u00a0Andrew Bagnell and Anind\u00a0K Dey. 2010. Modeling interaction via the principle of maximum causal entropy. (2010)."},{"key":"e_1_3_2_1_39_1","volume-title":"AAAI, Vol.\u00a08.","author":"Ziebart D","unstructured":"Brian\u00a0 D Ziebart , Andrew\u00a0 L Maas , J\u00a0Andrew Bagnell , and Anind\u00a0 K Dey . 2008. Maximum entropy inverse reinforcement learning .. In AAAI, Vol.\u00a08. Chicago, IL, USA , 1433\u20131438. Brian\u00a0D Ziebart, Andrew\u00a0L Maas, J\u00a0Andrew Bagnell, and Anind\u00a0K Dey. 2008. Maximum entropy inverse reinforcement learning.. In AAAI, Vol.\u00a08. Chicago, IL, USA, 1433\u20131438."}],"event":{"name":"WWW '21: The Web Conference 2021","location":"Ljubljana Slovenia","acronym":"WWW '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449913","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3449913","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:31Z","timestamp":1750195471000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3449913"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":39,"alternative-id":["10.1145\/3442381.3449913","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3449913","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}