{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T07:59:30Z","timestamp":1786089570915,"version":"3.56.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,11,3]],"date-time":"2019-11-03T00:00:00Z","timestamp":1572739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,11,3]]},"DOI":"10.1145\/3357384.3358058","type":"proceedings-article","created":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T14:11:35Z","timestamp":1572876695000},"page":"329-338","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":64,"title":["Improving Ad Click Prediction by Considering Non-displayed Events"],"prefix":"10.1145","author":[{"given":"Bowen","family":"Yuan","sequence":"first","affiliation":[{"name":"National Taiwan University, Taiepei, Taiwan Roc"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jui-Yang","family":"Hsia","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taipei, Taiwan Roc"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng-Yuan","family":"Yang","sequence":"additional","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huawei Noah's ark lab, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chih-Yao","family":"Chang","sequence":"additional","affiliation":[{"name":"Huawei Noah's ark lab, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenhua","family":"Dong","sequence":"additional","affiliation":[{"name":"Huawei Noah's ark lab, Shenzhen, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chih-Jen","family":"Lin","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taipei, Taiwan Roc"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Immanuel Bayer Xiangnan He Bhargav Kanagal and Steffen Rendle. 2017. A generic coordinate descent framework for learning from implicit feedback. In WWW .  Immanuel Bayer Xiangnan He Bhargav Kanagal and Steffen Rendle. 2017. A generic coordinate descent framework for learning from implicit feedback. In WWW .","DOI":"10.1145\/3038912.3052694"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Stephen Bonner and Flavian Vasile. 2018. Causal Embeddings for Recommendation. In RecSys .  Stephen Bonner and Flavian Vasile. 2018. Causal Embeddings for Recommendation. In RecSys .","DOI":"10.1145\/3240323.3240360"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2532128"},{"key":"e_1_3_2_1_4_1","unstructured":"Miroslav Dud'ik John Langford and Lihong Li. 2011. Doubly robust policy evaluation and learning. In ICML .  Miroslav Dud'ik John Langford and Lihong Li. 2011. Doubly robust policy evaluation and learning. In ICML ."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Ali Mamdouh Elkahky Yang Song and Xiaodong He. 2015. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In WWW .  Ali Mamdouh Elkahky Yang Song and Xiaodong He. 2015. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In WWW .","DOI":"10.1145\/2736277.2741667"},{"key":"e_1_3_2_1_6_1","unstructured":"Huifeng Guo Ruiming Tang Yunming Ye Zhenguo Li and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. In IJCAI .  Huifeng Guo Ruiming Tang Yunming Ye Zhenguo Li and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. In IJCAI ."},{"key":"e_1_3_2_1_7_1","unstructured":"Xinran He Junfeng Pan Ou Jin Tianbing Xu Bo Liu Tao Xu Yanxin Shi Antoine Atallah Ralf Herbrich Stuart Bowers and Joaquin Qui n onero Candela. 2014. Practical Lessons from Predicting Clicks on Ads at Facebook. In ADKDD .  Xinran He Junfeng Pan Ou Jin Tianbing Xu Bo Liu Tao Xu Yanxin Shi Antoine Atallah Ralf Herbrich Stuart Bowers and Joaquin Qui n onero Candela. 2014. Practical Lessons from Predicting Clicks on Ads at Facebook. In ADKDD ."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.2307\/1912352"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483446"},{"key":"e_1_3_2_1_10_1","unstructured":"Cho-Jui Hsieh Nagarajan Natarajan and Inderjit Dhillon. 2015. PU Learning for Matrix Completion. In ICML .  Cho-Jui Hsieh Nagarajan Natarajan and Inderjit Dhillon. 2015. PU Learning for Matrix Completion. In ICML ."},{"key":"e_1_3_2_1_11_1","unstructured":"Yifan Hu Yehuda Koren and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In ICDM .  Yifan Hu Yehuda Koren and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In ICDM ."},{"key":"e_1_3_2_1_12_1","volume-title":"Ensemble of Collaborative Filtering and Feature Engineered Model for Click Through Rate Prediction. In KDD Cup 2012 Workshop .","author":"Jahrer Machael","year":"2012"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Yuchin Juan Damien Lefortier and Olivier Chapelle. 2017. Field-aware factorization machines in a real-world online advertising system. In WWW .  Yuchin Juan Damien Lefortier and Olivier Chapelle. 2017. Field-aware factorization machines in a real-world online advertising system. In WWW .","DOI":"10.1145\/3041021.3054185"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Yuchin Juan Yong Zhuang Wei-Sheng Chin and Chih-Jen Lin. 2016. Field-aware Factorization Machines for CTR Prediction. In RecSys .  Yuchin Juan Yong Zhuang Wei-Sheng Chin and Chih-Jen Lin. 2016. Field-aware Factorization Machines for CTR Prediction. In RecSys .","DOI":"10.1145\/2959100.2959134"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Himabindu Lakkaraju Jon Kleinberg Jure Leskovec Jens Ludwig and Sendhil Mullainathan. 2017. The selective labels problem: Evaluating algorithmic predictions in the presence of unobservables. In KDD .  Himabindu Lakkaraju Jon Kleinberg Jure Leskovec Jens Ludwig and Sendhil Mullainathan. 2017. The selective labels problem: Evaluating algorithmic predictions in the presence of unobservables. In KDD .","DOI":"10.1145\/3097983.3098066"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Carolin Lawrence Artem Sokolov and Stefan Riezler. 2017. Counterfactual Learning from Bandit Feedback under Deterministic Logging: A Case Study in Statistical Machine Translation. In EMNLP .  Carolin Lawrence Artem Sokolov and Stefan Riezler. 2017. Counterfactual Learning from Bandit Feedback under Deterministic Logging: A Case Study in Statistical Machine Translation. In EMNLP .","DOI":"10.18653\/v1\/D17-1272"},{"key":"e_1_3_2_1_17_1","volume-title":"NIPS Workshop on Inference and Learning of Hypothetical and Counterfactual Interventions in Complex Systems .","author":"Lefortier Damien","year":"2016"},{"key":"e_1_3_2_1_18_1","volume-title":"Rubin","author":"Little Roderick J. A.","year":"2002"},{"key":"e_1_3_2_1_19_1","unstructured":"David C. Liu Stephanie Rogers Raymond Shiau Dmitry Kislyuk Kevin C. Ma Zhigang Zhong Jenny Liu and Yushi Jing. 2017. Related Pins at Pinterest: The Evolution of a Real-World Recommender System. In WWW .  David C. Liu Stephanie Rogers Raymond Shiau Dmitry Kislyuk Kevin C. Ma Zhigang Zhong Jenny Liu and Yushi Jing. 2017. Related Pins at Pinterest: The Evolution of a Real-World Recommender System. In WWW ."},{"key":"e_1_3_2_1_20_1","volume-title":"Zemel","author":"Marlin Benjamin M.","year":"2009"},{"key":"e_1_3_2_1_21_1","volume-title":"Tom Boulos, and Jeremy Kubica.","author":"McMahan H. Brendan","year":"2013"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Yusuke Narita Shota Yasui and Kohei Yata. 2019. Efficient Counterfactual Learning from Bandit Feedback. In AAAI .  Yusuke Narita Shota Yasui and Kohei Yata. 2019. Efficient Counterfactual Learning from Bandit Feedback. In AAAI .","DOI":"10.2139\/ssrn.3300346"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3233770"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Steffen Rendle. 2010. Factorization machines. In ICDM .  Steffen Rendle. 2010. Factorization machines. In ICDM .","DOI":"10.1109\/ICDM.2010.127"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Matthew Richardson Ewa Dominowska and Robert Ragno. 2007. Predicting clicks: estimating the click-through rate for new ADs. In WWW .  Matthew Richardson Ewa Dominowska and Robert Ragno. 2007. Predicting clicks: estimating the click-through rate for new ADs. In WWW .","DOI":"10.1145\/1242572.1242643"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Nir Rosenfeld Yishay Mansour and Elad Yom-Tov. 2017. Predicting counterfactuals from large historical data and small randomized trials. In WWW .  Nir Rosenfeld Yishay Mansour and Elad Yom-Tov. 2017. Predicting counterfactuals from large historical data and small randomized trials. In WWW .","DOI":"10.1145\/3041021.3054190"},{"key":"e_1_3_2_1_27_1","unstructured":"Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations As Treatments: Debiasing Learning and Evaluation. In ICML .  Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak and Thorsten Joachims. 2016. Recommendations As Treatments: Debiasing Learning and Evaluation. In ICML ."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886805"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Longqi Yang Yin Cui Yuan Xuan Chenyang Wang Serge Belongie and Deborah Estrin. 2018. Unbiased offline recommender evaluation for missing-not-at-random implicit feedback. In RecSys .  Longqi Yang Yin Cui Yuan Xuan Chenyang Wang Serge Belongie and Deborah Estrin. 2018. Unbiased offline recommender evaluation for missing-not-at-random implicit feedback. In RecSys .","DOI":"10.1145\/3240323.3240355"},{"key":"e_1_3_2_1_30_1","unstructured":"Hsiang-Fu Yu Mikhail Bilenko and Chih-Jen Lin. 2017a. Selection of Negative Samples for One-class Matrix Factorization. In SDM .  Hsiang-Fu Yu Mikhail Bilenko and Chih-Jen Lin. 2017a. Selection of Negative Samples for One-class Matrix Factorization. In SDM ."},{"key":"e_1_3_2_1_31_1","unstructured":"Hsiang-Fu Yu Hsin-Yuan Huang Inderjit S. Dihillon and Chih-Jen Lin. 2017b. A Unified Algorithm for One-class Structured Matrix Factorization with Side Information. In AAAI .  Hsiang-Fu Yu Hsin-Yuan Huang Inderjit S. Dihillon and Chih-Jen Lin. 2017b. A Unified Algorithm for One-class Structured Matrix Factorization with Side Information. In AAAI ."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Weinan Zhang Tianxiong Zhou Jun Wang and Jian Xu. 2016. Bid-aware gradient descent for unbiased learning with censored data in display advertising. In KDD .  Weinan Zhang Tianxiong Zhou Jun Wang and Jian Xu. 2016. Bid-aware gradient descent for unbiased learning with censored data in display advertising. In KDD .","DOI":"10.1145\/2939672.2939713"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Guorui Zhou Xiaoqiang Zhu Chenru Song Ying Fan Han Zhu Xiao Ma Yanghui Yan Junqi Jin Han Li and Kun Gai. 2018. Deep interest network for click-through rate prediction. In KDD .  Guorui Zhou Xiaoqiang Zhu Chenru Song Ying Fan Han Zhu Xiao Ma Yanghui Yan Junqi Jin Han Li and Kun Gai. 2018. Deep interest network for click-through rate prediction. In KDD .","DOI":"10.1145\/3219819.3219823"}],"event":{"name":"CIKM '19: The 28th ACM International Conference on Information and Knowledge Management","location":"Beijing China","acronym":"CIKM '19","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 28th ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357384.3358058","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3357384.3358058","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:18Z","timestamp":1750203858000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357384.3358058"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,3]]},"references-count":33,"alternative-id":["10.1145\/3357384.3358058","10.1145\/3357384"],"URL":"https:\/\/doi.org\/10.1145\/3357384.3358058","relation":{},"subject":[],"published":{"date-parts":[[2019,11,3]]},"assertion":[{"value":"2019-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}