{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T02:43:45Z","timestamp":1783737825941,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,6]]},"DOI":"10.1145\/3580305.3599771","type":"proceedings-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T18:13:58Z","timestamp":1691172838000},"page":"5174-5183","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["An Empirical Study of Selection Bias in Pinterest Ads Retrieval"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4241-9905","authenticated-orcid":false,"given":"Yuan","family":"Wang","sequence":"first","affiliation":[{"name":"Santa Clara University, Santa Clara, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0109-7903","authenticated-orcid":false,"given":"Peifeng","family":"Yin","sequence":"additional","affiliation":[{"name":"Pinterest, San Francisco, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5639-7540","authenticated-orcid":false,"given":"Zhiqiang","family":"Tao","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7437-0159","authenticated-orcid":false,"given":"Hari","family":"Venkatesan","sequence":"additional","affiliation":[{"name":"Pinterest, San Francisco, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5550-462X","authenticated-orcid":false,"given":"Jin","family":"Lai","sequence":"additional","affiliation":[{"name":"Pinterest, San Francisco, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6572-4315","authenticated-orcid":false,"given":"Yi","family":"Fang","sequence":"additional","affiliation":[{"name":"Santa Clara University, Santa Clara, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8965-5194","authenticated-orcid":false,"given":"PJ","family":"Xiao","sequence":"additional","affiliation":[{"name":"Pinterest, San Francisco, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-011-0287-y"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462919"},{"key":"e_1_3_2_2_4_1","volume-title":"Cross Domain Regularization for Neural Ranking Models Using Adversarial Learning. In The 41st International ACM SIGIR Conference on Research Development in Information Retrieval","author":"Cohen Daniel","unstructured":"Daniel Cohen , Bhaskar Mitra , Katja Hofmann , and W. Bruce Croft . 2018 . Cross Domain Regularization for Neural Ranking Models Using Adversarial Learning. In The 41st International ACM SIGIR Conference on Research Development in Information Retrieval ( Ann Arbor, MI, USA) (SIGIR '18). Association for Computing Machinery, New York, NY, USA, 1025--1028. Daniel Cohen, Bhaskar Mitra, Katja Hofmann, and W. Bruce Croft. 2018. Cross Domain Regularization for Neural Ranking Models Using Adversarial Learning. In The 41st International ACM SIGIR Conference on Research Development in Information Retrieval (Ann Arbor, MI, USA) (SIGIR '18). Association for Computing Machinery, New York, NY, USA, 1025--1028."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959190"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1049"},{"key":"e_1_3_2_2_7_1","volume-title":"Weinberger (Eds.)","volume":"27","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q . Weinberger (Eds.) , Vol. 27 . Curran Associates, Inc. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger (Eds.), Vol. 27. Curran Associates, Inc."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-021-01453-z"},{"key":"e_1_3_2_2_9_1","volume-title":"On Selection Bias with Imbalanced Classes","author":"Jacobusse Gert","unstructured":"Gert Jacobusse and Cor Veenman . 2016. On Selection Bias with Imbalanced Classes . In Discovery Science, Toon Calders, Michelangelo Ceci, and Donato Malerba (Eds.). Springer International Publishing , Cham , 325--340. Gert Jacobusse and Cor Veenman. 2016. On Selection Bias with Imbalanced Classes. In Discovery Science, Toon Calders, Michelangelo Ceci, and Donato Malerba (Eds.). Springer International Publishing, Cham, 325--340."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3294771.3294864"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098011"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488200"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_2_2_15_1","volume-title":"Calibrating Probability with Undersampling for Unbalanced Classification. In 2015 IEEE Symposium Series on Computational Intelligence (Cape Town, South Africa). IEEE","author":"Pozzolo Andrea Dal","year":"2015","unstructured":"Andrea Dal Pozzolo , Olivier Caelen , Reid A. Johnson , and Gianluca Bontempi . 2015 . Calibrating Probability with Undersampling for Unbalanced Classification. In 2015 IEEE Symposium Series on Computational Intelligence (Cape Town, South Africa). IEEE , New York, NY, USA, 159--166. Andrea Dal Pozzolo, Olivier Caelen, Reid A. Johnson, and Gianluca Bontempi. 2015. Calibrating Probability with Undersampling for Unbalanced Classification. In 2015 IEEE Symposium Series on Computational Intelligence (Cape Town, South Africa). IEEE, New York, NY, USA, 159--166."},{"key":"e_1_3_2_2_16_1","volume-title":"RankFlow: Joint Optimization of Multi-Stage Cascade Ranking Systems as Flows (SIGIR '22)","author":"Qin Jiarui","unstructured":"Jiarui Qin , Jiachen Zhu , Bo Chen , Zhirong Liu , Weiwen Liu , Ruiming Tang , Rui Zhang , Yong Yu , and Weinan Zhang . 2022. RankFlow: Joint Optimization of Multi-Stage Cascade Ranking Systems as Flows (SIGIR '22) . Association for Computing Machinery , New York, NY, USA , 814--824. Jiarui Qin, Jiachen Zhu, Bo Chen, Zhirong Liu, Weiwen Liu, Ruiming Tang, Rui Zhang, Yong Yu, and Weinan Zhang. 2022. RankFlow: Joint Optimization of Multi-Stage Cascade Ranking Systems as Flows (SIGIR '22). Association for Computing Machinery, New York, NY, USA, 814--824."},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning -","volume":"70","author":"Saito Kuniaki","year":"2017","unstructured":"Kuniaki Saito , Yoshitaka Ushiku , and Tatsuya Harada . 2017 . Asymmetric Tri-Training for Unsupervised Domain Adaptation . In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia) (ICML'17). JMLR.org, 2988--2997. Kuniaki Saito, Yoshitaka Ushiku, and Tatsuya Harada. 2017. Asymmetric Tri-Training for Unsupervised Domain Adaptation. In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia) (ICML'17). JMLR.org, 2988--2997."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911537"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441799"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462855"},{"key":"e_1_3_2_2_21_1","volume-title":"Cold: Towards the next generation of pre-ranking system. arXiv preprint arXiv:2007.16122","author":"Wang Zhe","year":"2020","unstructured":"Zhe Wang , Liqin Zhao , Biye Jiang , Guorui Zhou , Xiaoqiang Zhu , and Kun Gai . 2020 . Cold: Towards the next generation of pre-ranking system. arXiv preprint arXiv:2007.16122 (2020). Zhe Wang, Liqin Zhao, Biye Jiang, Guorui Zhou, Xiaoqiang Zhu, and Kun Gai. 2020. Cold: Towards the next generation of pre-ranking system. arXiv preprint arXiv:2007.16122 (2020)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3400066"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.519"},{"key":"e_1_3_2_2_24_1","volume-title":"EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Search. CoRR abs\/1812.01190","author":"Wu Wenjin","year":"2018","unstructured":"Wenjin Wu , Guojun Liu , Hui Ye , Chenshuang Zhang , Tianshu Wu , Daorui Xiao , Wei Lin , and Xiaoyu Zhu . 2018 . EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Search. CoRR abs\/1812.01190 (2018). arXiv:1812.01190 http:\/\/arxiv.org\/abs\/1812.01190 Wenjin Wu, Guojun Liu, Hui Ye, Chenshuang Zhang, Tianshu Wu, Daorui Xiao, Wei Lin, and Xiaoyu Zhu. 2018. EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Search. CoRR abs\/1812.01190 (2018). arXiv:1812.01190 http:\/\/arxiv.org\/abs\/1812.01190"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080809"},{"key":"e_1_3_2_2_26_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"333","author":"Zemel Rich","year":"2013","unstructured":"Rich Zemel , Yu Wu , Kevin Swersky , Toni Pitassi , and Cynthia Dwork . 2013 . Learning Fair Representations . In Proceedings of the 30th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 28), Sanjoy Dasgupta and David McAllester (Eds.). PMLR, Atlanta, Georgia, USA, 325-- 333 . Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning Fair Representations. In Proceedings of the 30th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 28), Sanjoy Dasgupta and David McAllester (Eds.). PMLR, Atlanta, Georgia, USA, 325--333."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278779"}],"event":{"name":"KDD '23: The 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Long Beach CA USA","acronym":"KDD '23","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599771","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599771","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:22Z","timestamp":1750182562000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599771"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":27,"alternative-id":["10.1145\/3580305.3599771","10.1145\/3580305"],"URL":"https:\/\/doi.org\/10.1145\/3580305.3599771","relation":{},"subject":[],"published":{"date-parts":[[2023,8,4]]},"assertion":[{"value":"2023-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}