{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T03:34:30Z","timestamp":1775792070503,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,7]],"date-time":"2023-07-07T00:00:00Z","timestamp":1688688000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,9]]},"DOI":"10.1145\/3580507.3597702","type":"proceedings-article","created":{"date-parts":[[2023,7,7]],"date-time":"2023-07-07T14:19:22Z","timestamp":1688739562000},"page":"992-1016","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Causal Estimation of User Learning in Personalized Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9453-4799","authenticated-orcid":false,"given":"Evan","family":"Munro","sequence":"first","affiliation":[{"name":"Graduate School of Business, Stanford University, Stanford, United States of America"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8152-6818","authenticated-orcid":false,"given":"David","family":"Jones","sequence":"additional","affiliation":[{"name":"Google, Seattle, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8101-8939","authenticated-orcid":false,"given":"Jennifer","family":"Brennan","sequence":"additional","affiliation":[{"name":"Google Research, Seattle, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7306-9825","authenticated-orcid":false,"given":"Roland","family":"Nelet","sequence":"additional","affiliation":[{"name":"Google Research, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6705-5629","authenticated-orcid":false,"given":"Vahab","family":"Mirrokni","sequence":"additional","affiliation":[{"name":"Google Research, New York, United States of America"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3729-9547","authenticated-orcid":false,"given":"Jean","family":"Pouget-Abadie","sequence":"additional","affiliation":[{"name":"Google Research, New York, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,7,7]]},"reference":[{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2835776.2835829"},{"key":"e_1_3_2_1_3_1","volume-title":"Multiple randomization designs. arXiv preprint arXiv:2112.13495","author":"Bajari Patrick","year":"2021","unstructured":"Patrick Bajari , Brian Burdick , Guido W Imbens , Lorenzo Masoero , James McQueen , Thomas Richardson , and Ido M Rosen . 2021. Multiple randomization designs. arXiv preprint arXiv:2112.13495 ( 2021 ). Patrick Bajari, Brian Burdick, Guido W Imbens, Lorenzo Masoero, James McQueen, Thomas Richardson, and Ido M Rosen. 2021. Multiple randomization designs. arXiv preprint arXiv:2112.13495 (2021)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.3982\/QE1744"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2018.1527225"},{"key":"e_1_3_2_1_6_1","volume-title":"Design and analysis of switchback experiments. Management Science","author":"Bojinov Iavor","year":"2022","unstructured":"Iavor Bojinov , David Simchi-Levi , and Jinglong Zhao . 2022. Design and analysis of switchback experiments. Management Science ( 2022 ). Iavor Bojinov, David Simchi-Levi, and Jinglong Zhao. 2022. Design and analysis of switchback experiments. Management Science (2022)."},{"key":"e_1_3_2_1_7_1","first-page":"1","article-title":"Design and Analysis of Experiments in Networks: Reducing Bias from Interference","volume":"5","author":"Eckles Dean","year":"2017","unstructured":"Dean Eckles , Brian Karrer , Johan Ugander , 2017 . Design and Analysis of Experiments in Networks: Reducing Bias from Interference . Journal of Causal Inference 5 , 1 (2017), 1 -- 23 . Dean Eckles, Brian Karrer, Johan Ugander, et al. 2017. Design and Analysis of Experiments in Networks: Reducing Bias from Interference. Journal of Causal Inference 5, 1 (2017), 1--23.","journal-title":"Journal of Causal Inference"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1287\/mksc.2021.1311"},{"key":"e_1_3_2_1_9_1","volume-title":"Design and analysis of bipartite experiments under a linear exposure-response model. arXiv preprint arXiv:2103.06392","author":"Harshaw Christopher","year":"2021","unstructured":"Christopher Harshaw , Fredrik S\u00e4vje , David Eisenstat , Vahab Mirrokni , and Jean Pouget-Abadie . 2021. Design and analysis of bipartite experiments under a linear exposure-response model. arXiv preprint arXiv:2103.06392 ( 2021 ). Christopher Harshaw, Fredrik S\u00e4vje, David Eisenstat, Vahab Mirrokni, and Jean Pouget-Abadie. 2021. Design and analysis of bipartite experiments under a linear exposure-response model. arXiv preprint arXiv:2103.06392 (2021)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788583"},{"key":"e_1_3_2_1_11_1","volume-title":"Switchback Experiments under Geometric Mixing. arXiv preprint arXiv:2209.00197","author":"Hu Yuchen","year":"2022","unstructured":"Yuchen Hu and Stefan Wager . 2022. Switchback Experiments under Geometric Mixing. arXiv preprint arXiv:2209.00197 ( 2022 ). Yuchen Hu and Stefan Wager. 2022. Switchback Experiments under Geometric Mixing. arXiv preprint arXiv:2209.00197 (2022)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214508000000292"},{"key":"e_1_3_2_1_13_1","volume-title":"inference and sensitivity analysis for causal mediation effects. Statistical science 25, 1","author":"Imai Kosuke","year":"2010","unstructured":"Kosuke Imai , Luke Keele , and Teppei Yamamoto . 2010. Identification , inference and sensitivity analysis for causal mediation effects. Statistical science 25, 1 ( 2010 ), 51--71. Kosuke Imai, Luke Keele, and Teppei Yamamoto. 2010. Identification, inference and sensitivity analysis for causal mediation effects. Statistical science 25, 1 (2010), 51--71."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2012.01032.x"},{"key":"e_1_3_2_1_15_1","volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"Imbens Guido W","unstructured":"Guido W Imbens and Donald B Rubin . 2015. Causal inference in statistics, social, and biomedical sciences . Cambridge University Press . Guido W Imbens and Donald B Rubin. 2015. Causal inference in statistics, social, and biomedical sciences. Cambridge University Press."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2021.4247"},{"key":"e_1_3_2_1_17_1","volume-title":"Recommender systems handbook","author":"Knijnenburg P","unstructured":"Bart P Knijnenburg and Martijn C Willemsen . 2015. Evaluating recommender systems with user experiments . In Recommender systems handbook . Springer , 309--352. BartP Knijnenburg and Martijn C Willemsen. 2015. Evaluating recommender systems with user experiments. In Recommender systems handbook. Springer, 309--352."},{"key":"e_1_3_2_1_18_1","volume-title":"Trustworthy online controlled experiments: A practical guide to a\/b testing","author":"Kohavi Ron","unstructured":"Ron Kohavi , Diane Tang , and Ya Xu. 2020. Trustworthy online controlled experiments: A practical guide to a\/b testing . Cambridge University Press . Ron Kohavi, Diane Tang, and Ya Xu. 2020. Trustworthy online controlled experiments: A practical guide to a\/b testing. Cambridge University Press."},{"key":"e_1_3_2_1_19_1","volume-title":"Statistical Challenges in Online Controlled Experiments: A Review of A\/B Testing Methodology. arXiv preprint arXiv:2212.11366","author":"Larsen Nicholas","year":"2022","unstructured":"Nicholas Larsen , Jonathan Stallrich , Srijan Sengupta , Alex Deng , Ron Kohavi , and Nathaniel Stevens . 2022. Statistical Challenges in Online Controlled Experiments: A Review of A\/B Testing Methodology. arXiv preprint arXiv:2212.11366 ( 2022 ). Nicholas Larsen, Jonathan Stallrich, Srijan Sengupta, Alex Deng, Ron Kohavi, and Nathaniel Stevens. 2022. Statistical Challenges in Online Controlled Experiments: A Review of A\/B Testing Methodology. arXiv preprint arXiv:2212.11366 (2022)."},{"key":"e_1_3_2_1_20_1","first-page":"3064","article-title":"Rate-optimal cluster-randomized designs for spatial interference","volume":"50","author":"Leung Michael P","year":"2022","unstructured":"Michael P Leung . 2022 . Rate-optimal cluster-randomized designs for spatial interference . The Annals of Statistics 50 , 5 (2022), 3064 -- 3087 . Michael P Leung. 2022. Rate-optimal cluster-randomized designs for spatial interference. The Annals of Statistics 50, 5 (2022), 3064--3087.","journal-title":"The Annals of Statistics"},{"key":"e_1_3_2_1_21_1","volume-title":"How targeted ads and dynamic pricing can perpetuate bias. Harvard Business Review","author":"Miller Alex P","year":"2019","unstructured":"Alex P Miller and Kartik Hosanagar . 2019. How targeted ads and dynamic pricing can perpetuate bias. Harvard Business Review ( 2019 ). Alex P Miller and Kartik Hosanagar. 2019. How targeted ads and dynamic pricing can perpetuate bias. Harvard Business Review (2019)."},{"key":"e_1_3_2_1_22_1","volume-title":"Treatment effects in market equilibrium. arXiv preprint arXiv:2109.11647","author":"Munro Evan","year":"2021","unstructured":"Evan Munro , Stefan Wager , and Kuang Xu. 2021. Treatment effects in market equilibrium. arXiv preprint arXiv:2109.11647 ( 2021 ). Evan Munro, Stefan Wager, and Kuang Xu. 2021. Treatment effects in market equilibrium. arXiv preprint arXiv:2109.11647 (2021)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.53"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Judea Pearl. 2022. Direct and indirect effects. In Probabilistic and Causal Inference: The Works of Judea Pearl. 373--392. Judea Pearl. 2022. Direct and indirect effects. In Probabilistic and Causal Inference: The Works of Judea Pearl. 373--392.","DOI":"10.1145\/3501714.3501736"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.2022.2124309"},{"key":"e_1_3_2_1_26_1","first-page":"673","article-title":"Average treatment effects in the presence of unknown interference","volume":"49","author":"S\u00e4vje Fredrik","year":"2021","unstructured":"Fredrik S\u00e4vje , Peter Aronow , and Michael Hudgens . 2021 . Average treatment effects in the presence of unknown interference . Annals of statistics 49 , 2 (2021), 673 . Fredrik S\u00e4vje, Peter Aronow, and Michael Hudgens. 2021. Average treatment effects in the presence of unknown interference. Annals of statistics 49, 2 (2021), 673.","journal-title":"Annals of statistics"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/25.3-4.285"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1111\/j.1467-9469.2010.00722.x","article-title":"Controlled direct and mediated effects: definition, identification and bounds","volume":"38","author":"VanderWeele Tyler J","year":"2011","unstructured":"Tyler J VanderWeele . 2011 . Controlled direct and mediated effects: definition, identification and bounds . Scandinavian Journal of Statistics 38 , 3 (2011), 551 -- 563 . Tyler J VanderWeele. 2011. Controlled direct and mediated effects: definition, identification and bounds. Scandinavian Journal of Statistics 38, 3 (2011), 551--563.","journal-title":"Scandinavian Journal of Statistics"},{"key":"e_1_3_2_1_29_1","volume-title":"Mediation analysis: a practitioner's guide. Annual review of public health 37","author":"VanderWeele Tyler J","year":"2016","unstructured":"Tyler J VanderWeele . 2016. Mediation analysis: a practitioner's guide. Annual review of public health 37 ( 2016 ), 17--32. Tyler J VanderWeele. 2016. Mediation analysis: a practitioner's guide. Annual review of public health 37 (2016), 17--32."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1111\/rssb.12194","article-title":"Mediation analysis with time varying exposures and mediators","volume":"79","author":"VanderWeele Tyler J","year":"2017","unstructured":"Tyler J VanderWeele and Eric J Tchetgen Tchetgen . 2017 . Mediation analysis with time varying exposures and mediators . Journal of the Royal Statistical Society: Series B (Statistical Methodology) 79 , 3 (2017), 917 -- 938 . Tyler J VanderWeele and Eric J Tchetgen Tchetgen. 2017. Mediation analysis with time varying exposures and mediators. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 79, 3 (2017), 917--938.","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"e_1_3_2_1_31_1","volume-title":"Experimental design under network interference. arXiv preprint arXiv:2003.08421","author":"Viviano Davide","year":"2020","unstructured":"Davide Viviano . 2020. Experimental design under network interference. arXiv preprint arXiv:2003.08421 ( 2020 ). Davide Viviano. 2020. Experimental design under network interference. arXiv preprint arXiv:2003.08421 (2020)."}],"event":{"name":"EC '23: 24th ACM Conference on Economics and Computation","location":"London United Kingdom","acronym":"EC '23","sponsor":["SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Proceedings of the 24th ACM Conference on Economics and Computation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580507.3597702","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580507.3597702","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:56Z","timestamp":1750182536000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580507.3597702"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,7]]},"references-count":30,"alternative-id":["10.1145\/3580507.3597702","10.1145\/3580507"],"URL":"https:\/\/doi.org\/10.1145\/3580507.3597702","relation":{},"subject":[],"published":{"date-parts":[[2023,7,7]]},"assertion":[{"value":"2023-07-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}