{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T15:34:08Z","timestamp":1772724848611,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,9,10]],"date-time":"2019-09-10T00:00:00Z","timestamp":1568073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,9,10]]},"DOI":"10.1145\/3298689.3347002","type":"proceedings-article","created":{"date-parts":[[2019,9,11]],"date-time":"2019-09-11T13:21:31Z","timestamp":1568208091000},"page":"187-195","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Addressing delayed feedback for continuous training with neural networks in CTR prediction"],"prefix":"10.1145","author":[{"given":"Sofia Ira","family":"Ktena","sequence":"first","affiliation":[{"name":"Twitter, London, UK"}]},{"given":"Alykhan","family":"Tejani","sequence":"additional","affiliation":[{"name":"Twitter, London, UK"}]},{"given":"Lucas","family":"Theis","sequence":"additional","affiliation":[{"name":"Twitter, London, UK"}]},{"given":"Pranay Kumar","family":"Myana","sequence":"additional","affiliation":[{"name":"Twitter, London, UK"}]},{"given":"Deepak","family":"Dilipkumar","sequence":"additional","affiliation":[{"name":"Twitter"}]},{"given":"Ferenc","family":"Husz\u00e1r","sequence":"additional","affiliation":[{"name":"Twitter, London, UK"}]},{"given":"Steven","family":"Yoo","sequence":"additional","affiliation":[{"name":"Twitter"}]},{"given":"Wenzhe","family":"Shi","sequence":"additional","affiliation":[{"name":"Twitter, London, UK"}]}],"member":"320","published-online":{"date-parts":[[2019,9,10]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Peter C Austin and Elizabeth A Stuart. 2015. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Statistics in medicine 34 28 (2015) 3661--3679.  Peter C Austin and Elizabeth A Stuart. 2015. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Statistics in medicine 34 28 (2015) 3661--3679.","DOI":"10.1002\/sim.6607"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2567766"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623634"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290999"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_3_2_1_6_1","series-title":"Series B (methodological)","volume-title":"Maximum likelihood from incomplete data via the EM algorithm. Journal of the royal statistical society","author":"Dempster Arthur P","year":"1977","unstructured":"Arthur P Dempster , Nan M Laird , and Donald B Rubin . 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the royal statistical society . Series B (methodological) ( 1977 ), 1--38. Arthur P Dempster, Nan M Laird, and Donald B Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the royal statistical society. Series B (methodological) (1977), 1--38."},{"key":"e_1_3_2_1_7_1","volume-title":"International Conference on Machine Learning. 1386--1394","author":"Plessis Marthinus Du","year":"2015","unstructured":"Marthinus Du Plessis , Gang Niu , and Masashi Sugiyama . 2015 . Convex formulation for learning from positive and unlabeled data . In International Conference on Machine Learning. 1386--1394 . Marthinus Du Plessis, Gang Niu, and Masashi Sugiyama. 2015. Convex formulation for learning from positive and unlabeled data. In International Conference on Machine Learning. 1386--1394."},{"key":"e_1_3_2_1_8_1","unstructured":"Marthinus C du Plessis Gang Niu and Masashi Sugiyama. 2014. Analysis of learning from positive and unlabeled data. In Advances in neural information processing systems. 703--711.   Marthinus C du Plessis Gang Niu and Masashi Sugiyama. 2014. Analysis of learning from positive and unlabeled data. In Advances in neural information processing systems . 703--711."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401920"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2006.16"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the thirteenth international conference on artificial intelligence and statistics. 249--256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio . 2010 . Understanding the difficulty of training deep feedforward neural networks . In Proceedings of the thirteenth international conference on artificial intelligence and statistics. 249--256 . Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics. 249--256."},{"key":"e_1_3_2_1_12_1","unstructured":"Elad Hazan Alexander Rakhlin and Peter L Bartlett. 2008. Adaptive online gradient descent. In Advances in Neural Information Processing Systems. 65--72.   Elad Hazan Alexander Rakhlin and Peter L Bartlett. 2008. Adaptive online gradient descent. In Advances in Neural Information Processing Systems . 65--72."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2648584.2648589"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959134"},{"key":"e_1_3_2_1_15_1","volume-title":"The statistical analysis of failure time data","author":"Kalbfleisch John D","unstructured":"John D Kalbfleisch and Ross L Prentice . 2011. The statistical analysis of failure time data . Vol. 360 . John Wiley & Sons . John D Kalbfleisch and Ross L Prentice. 2011. The statistical analysis of failure time data. Vol. 360. John Wiley & Sons."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2003.809799"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_2_1_18_1","unstructured":"Ryuichi Kiryo Gang Niu Marthinus C du Plessis and Masashi Sugiyama. 2017. Positive-unlabeled learning with non-negative risk estimator. In Advances in neural information processing systems. 1675--1685.   Ryuichi Kiryo Gang Niu Marthinus C du Plessis and Masashi Sugiyama. 2017. Positive-unlabeled learning with non-negative risk estimator. In Advances in neural information processing systems . 1675--1685."},{"key":"e_1_3_2_1_19_1","first-page":"448","article-title":"Learning with positive and unlabeled examples using weighted logistic regression","volume":"3","author":"Lee Wee Sun","year":"2003","unstructured":"Wee Sun Lee and Bing Liu . 2003 . Learning with positive and unlabeled examples using weighted logistic regression . In ICML , Vol. 3. 448 -- 455 . Wee Sun Lee and Bing Liu. 2003. Learning with positive and unlabeled examples using weighted logistic regression. In ICML, Vol. 3. 448--455.","journal-title":"ICML"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788582"},{"key":"e_1_3_2_1_21_1","volume-title":"Pbodl: Parallel bayesian online deep learning for click-through rate prediction in tencent advertising system. arXiv preprint arXiv:1707.00802","author":"Liu Xun","year":"2017","unstructured":"Xun Liu , Wei Xue , Lei Xiao , and Bo Zhang . 2017 . Pbodl: Parallel bayesian online deep learning for click-through rate prediction in tencent advertising system. arXiv preprint arXiv:1707.00802 (2017). Xun Liu, Wei Xue, Lei Xiao, and Bo Zhang. 2017. Pbodl: Parallel bayesian online deep learning for click-through rate prediction in tencent advertising system. arXiv preprint arXiv:1707.00802 (2017)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2013.06.010"},{"key":"e_1_3_2_1_23_1","volume-title":"Twenty-Second International Joint Conference on Artificial Intelligence.","author":"Nguyen Minh Nhut","year":"2011","unstructured":"Minh Nhut Nguyen , Xiao-Li Li , and See-Kiong Ng . 2011 . Positive unlabeled learning for time series classification . In Twenty-Second International Joint Conference on Artificial Intelligence. Minh Nhut Nguyen, Xiao-Li Li, and See-Kiong Ng. 2011. Positive unlabeled learning for time series classification. In Twenty-Second International Joint Conference on Artificial Intelligence."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304889.3305030"},{"key":"e_1_3_2_1_25_1","unstructured":"Clayton Scott and Gilles Blanchard. 2009. Novelty detection: Unlabeled data definitely help. In Artificial Intelligence and Statistics. 464--471.  Clayton Scott and Gilles Blanchard. 2009. Novelty detection: Unlabeled data definitely help. In Artificial Intelligence and Statistics . 464--471."},{"key":"e_1_3_2_1_26_1","volume-title":"Stochastic Bandit Models for Delayed Conversions. In Conference on Uncertainty in Artificial Intelligence.","author":"Vernade Claire","year":"2017","unstructured":"Claire Vernade , Olivier Capp\u00e9 , and Vianney Perchet . 2017 . Stochastic Bandit Models for Delayed Conversions. In Conference on Uncertainty in Artificial Intelligence. Claire Vernade, Olivier Capp\u00e9, and Vianney Perchet. 2017. Stochastic Bandit Models for Delayed Conversions. In Conference on Uncertainty in Artificial Intelligence."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-008-9056-7"},{"key":"e_1_3_2_1_28_1","volume-title":"A Nonparametric Delayed Feedback Model for Conversion Rate Prediction. arXiv preprint arXiv:1802.00255","author":"Yoshikawa Yuya","year":"2018","unstructured":"Yuya Yoshikawa and Yusaku Imai . 2018. A Nonparametric Delayed Feedback Model for Conversion Rate Prediction. arXiv preprint arXiv:1802.00255 ( 2018 ). Yuya Yoshikawa and Yusaku Imai. 2018. A Nonparametric Delayed Feedback Model for Conversion Rate Prediction. arXiv preprint arXiv:1802.00255 (2018)."}],"event":{"name":"RecSys '19: Thirteenth ACM Conference on Recommender Systems","location":"Copenhagen Denmark","acronym":"RecSys '19"},"container-title":["Proceedings of the 13th ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3298689.3347002","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3298689.3347002","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:55Z","timestamp":1750201975000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3298689.3347002"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,10]]},"references-count":28,"alternative-id":["10.1145\/3298689.3347002","10.1145\/3298689"],"URL":"https:\/\/doi.org\/10.1145\/3298689.3347002","relation":{},"subject":[],"published":{"date-parts":[[2019,9,10]]},"assertion":[{"value":"2019-09-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}