{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:21:23Z","timestamp":1783700483459,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":51,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,6,17]],"date-time":"2019-06-17T00:00:00Z","timestamp":1560729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,6,17]]},"DOI":"10.1145\/3328526.3329558","type":"proceedings-article","created":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T12:45:07Z","timestamp":1561121107000},"page":"199-213","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Observational Data for Heterogeneous Treatment Effects with Application to Recommender Systems"],"prefix":"10.1145","author":[{"given":"Akos","family":"Lada","sequence":"first","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Peysakhovich","sequence":"additional","affiliation":[{"name":"Facebook, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Aparicio","sequence":"additional","affiliation":[{"name":"MIT, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Bailey","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,6,17]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3386\/w19742"},{"key":"e_1_3_2_1_2_1","volume-title":"Mostly harmless econometrics: An empiricist's companion","author":"Angrist Joshua D","unstructured":"Joshua D Angrist and J\u00f6rn-Steffen Pischke . 2008. Mostly harmless econometrics: An empiricist's companion . Princeton university press . Joshua D Angrist and J\u00f6rn-Steffen Pischke. 2008. Mostly harmless econometrics: An empiricist's companion .Princeton university press."},{"key":"e_1_3_2_1_3_1","volume-title":"Choice overload in online platforms. Working Paper","author":"Aparicio Diego","year":"2018","unstructured":"Diego Aparicio and Drazen Prelec . 2018. Choice overload in online platforms. Working Paper ( 2018 ). Diego Aparicio and Drazen Prelec. 2018. Choice overload in online platforms. Working Paper (2018)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1510489113"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.31.2.3"},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 23rd ACM conference on the World Wide Web. ACM.","author":"Bakshy E.","unstructured":"E. Bakshy , D. Eckles , and M. S. Bernstein . 2014. Designing and Deploying Online Field Experiments . In Proceedings of the 23rd ACM conference on the World Wide Web. ACM. E. Bakshy, D. Eckles, and M. S. Bernstein. 2014. Designing and Deploying Online Field Experiments. In Proceedings of the 23rd ACM conference on the World Wide Web. ACM."},{"key":"e_1_3_2_1_7_1","unstructured":"Abhijit Banerjee and Esther Duflo. 2012. Poor economics: A radical rethinking of the way to fight global poverty .PublicAffairs.  Abhijit Banerjee and Esther Duflo. 2012. Poor economics: A radical rethinking of the way to fight global poverty .PublicAffairs."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of KDD cup and workshop","volume":"2007","author":"Bennett James","year":"2007","unstructured":"James Bennett and Stan Lanning . 2007 . The netflix prize . In Proceedings of KDD cup and workshop , Vol. 2007 . 35. James Bennett and Stan Lanning. 2007. The netflix prize. In Proceedings of KDD cup and workshop, Vol. 2007. 35."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3982\/ECTA12423"},{"key":"e_1_3_2_1_10_1","volume-title":"Learning to learn","author":"Caruana Rich","unstructured":"Rich Caruana . 1998. Multitask learning . In Learning to learn . Springer , 95--133. Rich Caruana. 1998. Multitask learning. In Learning to learn . Springer, 95--133."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1214\/15-EJS1027"},{"key":"e_1_3_2_1_12_1","volume-title":"et almbox","author":"Chernozhukov Victor","year":"2016","unstructured":"Victor Chernozhukov , Denis Chetverikov , Mert Demirer , Esther Duflo , Christian Hansen , et almbox . 2016 . Double machine learning for treatment and causal parameters. arXiv preprint arXiv:1608.00060 (2016). Victor Chernozhukov, Denis Chetverikov, Mert Demirer, Esther Duflo, Christian Hansen, et almbox. 2016. Double machine learning for treatment and causal parameters. arXiv preprint arXiv:1608.00060 (2016)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOAS285"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390177"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/rest.90.3.389"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242610"},{"key":"e_1_3_2_1_17_1","volume-title":"Returns to capital in microenterprises: evidence from a field experiment. The quarterly journal of Economics","author":"Mel Suresh De","year":"2008","unstructured":"Suresh De Mel , David McKenzie , and Christopher Woodruff . 2008. Returns to capital in microenterprises: evidence from a field experiment. The quarterly journal of Economics , Vol. 123 , 4 ( 2008 ), 1329--1372. Suresh De Mel, David McKenzie, and Christopher Woodruff. 2008. Returns to capital in microenterprises: evidence from a field experiment. The quarterly journal of Economics, Vol. 123, 4 (2008), 1329--1372."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1257\/jel.48.2.424"},{"key":"e_1_3_2_1_19_1","volume-title":"Using randomization in development economics research: A toolkit. Handbook of development economics","author":"Duflo Esther","year":"2007","unstructured":"Esther Duflo , Rachel Glennerster , and Michael Kremer . 2007. Using randomization in development economics research: A toolkit. Handbook of development economics , Vol. 4 ( 2007 ), 3895--3962. Esther Duflo, Rachel Glennerster, and Michael Kremer. 2007. Using randomization in development economics research: A toolkit. Handbook of development economics, Vol. 4 (2007), 3895--3962."},{"key":"e_1_3_2_1_20_1","volume-title":"Bias and high-dimensional adjustment in observational studies of peer effects. Working Paper","author":"Eckles Dean","year":"2017","unstructured":"Dean Eckles and Eytan Bakshy . 2017. Bias and high-dimensional adjustment in observational studies of peer effects. Working Paper ( 2017 ). Dean Eckles and Eytan Bakshy. 2017. Bias and high-dimensional adjustment in observational studies of peer effects. Working Paper (2017)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940716.2940761"},{"key":"e_1_3_2_1_22_1","volume-title":"Jeremy MG Taylor, and Stephen J Ruberg","author":"Foster Jared C","year":"2011","unstructured":"Jared C Foster , Jeremy MG Taylor, and Stephen J Ruberg . 2011 . Subgroup identification from randomized clinical trial data. Statistics in medicine, Vol. 30 , 24 (2011), 2867--2880. Jared C Foster, Jeremy MG Taylor, and Stephen J Ruberg. 2011. Subgroup identification from randomized clinical trial data. Statistics in medicine, Vol. 30, 24 (2011), 2867--2880."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1255484"},{"key":"e_1_3_2_1_24_1","volume-title":"Testing for qualitative interactions between treatment effects and patient subsets. Biometrics","author":"Gail M","year":"1985","unstructured":"M Gail and R Simon . 1985. Testing for qualitative interactions between treatment effects and patient subsets. Biometrics ( 1985 ), 361--372. M Gail and R Simon. 1985. Testing for qualitative interactions between treatment effects and patient subsets. Biometrics (1985), 361--372."},{"key":"e_1_3_2_1_25_1","volume-title":"A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Science","author":"Gordon Brett R","year":"2019","unstructured":"Brett R Gordon , Florian Zettelmeyer , Neha Bhargava , and Dan Chapsky . 2019. A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Science ( 2019 ). Brett R Gordon, Florian Zettelmeyer, Neha Bhargava, and Dan Chapsky. 2019. A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Science (2019)."},{"key":"e_1_3_2_1_26_1","volume-title":"Modeling heterogeneous treatment effects in survey experiments with Bayesian additive regression trees. Public Opinion Quarterly","author":"Green Donald P","year":"2012","unstructured":"Donald P Green and Holger L Kern . 2012. Modeling heterogeneous treatment effects in survey experiments with Bayesian additive regression trees. Public Opinion Quarterly ( 2012 ), nfs036. Donald P Green and Holger L Kern. 2012. Modeling heterogeneous treatment effects in survey experiments with Bayesian additive regression trees. Public Opinion Quarterly (2012), nfs036."},{"key":"e_1_3_2_1_27_1","volume-title":"Estimating heterogeneous treatment effects and the effects of heterogeneous treatments with ensemble methods. Unpublished manuscript","author":"Grimmer Justin","year":"2014","unstructured":"Justin Grimmer , Solomon Messing , and Sean J Westwood . 2014. Estimating heterogeneous treatment effects and the effects of heterogeneous treatments with ensemble methods. Unpublished manuscript , Stanford University , Stanford, CA ( 2014 ). Justin Grimmer, Solomon Messing, and Sean J Westwood. 2014. Estimating heterogeneous treatment effects and the effects of heterogeneous treatments with ensemble methods. Unpublished manuscript, Stanford University, Stanford, CA (2014)."},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning-Volume 70","author":"Hartford Jason","year":"2017","unstructured":"Jason Hartford , Greg Lewis , Kevin Leyton-Brown , and Matt Taddy . 2017 . Deep IV: A flexible approach for counterfactual prediction . In Proceedings of the 34th International Conference on Machine Learning-Volume 70 . JMLR. org, 1414--1423. Jason Hartford, Greg Lewis, Kevin Leyton-Brown, and Matt Taddy. 2017. Deep IV: A flexible approach for counterfactual prediction. In Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 1414--1423."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2648584.2648589"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0262.2005.00594.x"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOAS593"},{"key":"e_1_3_2_1_32_1","volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"Imbens Guido W","unstructured":"Guido W Imbens and Donald B Rubin . 2015. Causal inference in statistics, social, and biomedical sciences . Cambridge University Press . Guido W Imbens and Donald B Rubin. 2015. Causal inference in statistics, social, and biomedical sciences .Cambridge University Press."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1257\/jel.47.1.5"},{"key":"e_1_3_2_1_34_1","volume-title":"Why most published research findings are false. PLoS medicine","author":"Ioannidis John PA","year":"2005","unstructured":"John PA Ioannidis . 2005. Why most published research findings are false. PLoS medicine , Vol. 2 , 8 ( 2005 ), e124. John PA Ioannidis. 2005. Why most published research findings are false. PLoS medicine, Vol. 2, 8 (2005), e124."},{"key":"e_1_3_2_1_35_1","volume-title":"Prediction policy problems. The American economic review","author":"Kleinberg Jon","year":"2015","unstructured":"Jon Kleinberg , Jens Ludwig , Sendhil Mullainathan , and Ziad Obermeyer . 2015. Prediction policy problems. The American economic review , Vol. 105 , 5 ( 2015 ), 491--495. Jon Kleinberg, Jens Ludwig, Sendhil Mullainathan, and Ziad Obermeyer. 2015. Prediction policy problems. The American economic review, Vol. 105, 5 (2015), 491--495."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281295"},{"key":"e_1_3_2_1_37_1","volume-title":"Transfer Learning for Estimating Causal Effects using Neural Networks. Working paper","author":"Kunzel Soren R","year":"2018","unstructured":"Soren R Kunzel , Bradly C Stadie , Nikita Vemuri , Varsha Ramakrishnan , Jasjeet S Sekhon , and Pieter Abbeel . 2018. Transfer Learning for Estimating Causal Effects using Neural Networks. Working paper ( 2018 ). Soren R Kunzel, Bradly C Stadie, Nikita Vemuri, Varsha Ramakrishnan, Jasjeet S Sekhon, and Pieter Abbeel. 2018. Transfer Learning for Estimating Causal Effects using Neural Networks. Working paper (2018)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjv023"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963431"},{"key":"e_1_3_2_1_40_1","volume-title":"Design sensitivity: Statistical power for experimental research","author":"Lipsey Mark W","unstructured":"Mark W Lipsey . 1990. Design sensitivity: Statistical power for experimental research . Vol. 19 . Sage . Mark W Lipsey. 1990. Design sensitivity: Statistical power for experimental research. Vol. 19. Sage."},{"key":"e_1_3_2_1_41_1","first-page":"273","article-title":"Two Cheers for Corporate Experimentation: The A\/B Illusion and the Virtues of Data-Driven Innovation","volume":"13","author":"Meyer Michelle N","year":"2015","unstructured":"Michelle N Meyer . 2015 . Two Cheers for Corporate Experimentation: The A\/B Illusion and the Virtues of Data-Driven Innovation . J. on Telecomm. & High Tech. L. , Vol. 13 (2015), 273 . Michelle N Meyer. 2015. Two Cheers for Corporate Experimentation: The A\/B Illusion and the Virtues of Data-Driven Innovation. J. on Telecomm. & High Tech. L., Vol. 13 (2015), 273.","journal-title":"J. on Telecomm. & High Tech. L."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.29.3.61"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186151"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2016.08.017"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/245108.245121"},{"key":"e_1_3_2_1_46_1","volume-title":"Bounding and Minimizing Counterfactual Error. Working Paper","author":"Shalit Uri","year":"2016","unstructured":"Uri Shalit , Fredrik Johansson , and David Sontag . 2016. Bounding and Minimizing Counterfactual Error. Working Paper ( 2016 ). Uri Shalit, Fredrik Johansson, and David Sontag. 2016. Bounding and Minimizing Counterfactual Error. Working Paper (2016)."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1577074"},{"key":"e_1_3_2_1_48_1","volume-title":"A nonparametric Bayesian analysis of heterogeneous treatment effects in digital experimentation. arXiv preprint arXiv:1412.8563","author":"Taddy Matt","year":"2014","unstructured":"Matt Taddy , Matt Gardner , Liyun Chen , and David Draper . 2014. A nonparametric Bayesian analysis of heterogeneous treatment effects in digital experimentation. arXiv preprint arXiv:1412.8563 ( 2014 ). Matt Taddy, Matt Gardner, Liyun Chen, and David Draper. 2014. A nonparametric Bayesian analysis of heterogeneous treatment effects in digital experimentation. arXiv preprint arXiv:1412.8563 (2014)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.28.2.3"},{"key":"e_1_3_2_1_50_1","volume-title":"Estimation and Inference of Heterogeneous Treatment Effects using Random Forests. Working Paper","author":"Wager Stefan","year":"2015","unstructured":"Stefan Wager and Susan Athey . 2015. Estimation and Inference of Heterogeneous Treatment Effects using Random Forests. Working Paper ( 2015 ). Stefan Wager and Susan Athey. 2015. Estimation and Inference of Heterogeneous Treatment Effects using Random Forests. Working Paper (2015)."},{"key":"e_1_3_2_1_51_1","first-page":"4","article-title":"Semi-supervised learning literature survey","volume":"2","author":"Zhu Xiaojin","year":"2006","unstructured":"Xiaojin Zhu . 2006 . Semi-supervised learning literature survey . Computer Science, University of Wisconsin-Madison , Vol. 2 , 3 (2006), 4 . Xiaojin Zhu. 2006. Semi-supervised learning literature survey. Computer Science, University of Wisconsin-Madison, Vol. 2, 3 (2006), 4.","journal-title":"Computer Science, University of Wisconsin-Madison"}],"event":{"name":"EC '19: ACM Conference on Economics and Computation","location":"Phoenix AZ USA","acronym":"EC '19","sponsor":["SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Proceedings of the 2019 ACM Conference on Economics and Computation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328526.3329558","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3328526.3329558","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:40Z","timestamp":1750204420000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328526.3329558"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,17]]},"references-count":51,"alternative-id":["10.1145\/3328526.3329558","10.1145\/3328526"],"URL":"https:\/\/doi.org\/10.1145\/3328526.3329558","relation":{},"subject":[],"published":{"date-parts":[[2019,6,17]]},"assertion":[{"value":"2019-06-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}