{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T06:01:12Z","timestamp":1777615272431,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467129","type":"proceedings-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T06:12:08Z","timestamp":1628748728000},"page":"2743-2752","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["On Post-selection Inference in A\/B Testing"],"prefix":"10.1145","author":[{"given":"Alex","family":"Deng","sequence":"first","affiliation":[{"name":"Airbnb, San Francisco, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yicheng","family":"Li","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiannan","family":"Lu","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vivek","family":"Ramamurthy","sequence":"additional","affiliation":[{"name":"Microsoft Corporation, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Jos\u00e9 L Montiel Olea, and E Glen Weyl","author":"Azevedo Eduardo M","year":"2019","unstructured":"Eduardo M Azevedo , Alex Deng , Jos\u00e9 L Montiel Olea, and E Glen Weyl . 2019 . Empirical Bayes estimation of treatment effects with many A\/B tests: An overview., 43--47 pages. Eduardo M Azevedo, Alex Deng, Jos\u00e9 L Montiel Olea, and E Glen Weyl. 2019. Empirical Bayes estimation of treatment effects with many A\/B tests: An overview., 43--47 pages."},{"key":"e_1_3_2_2_2_1","volume-title":"Proceedings of the 2018 ACM Conference on Economics and Computation","author":"Azevedo Eduardo M.","year":"1916","unstructured":"Eduardo M. Azevedo , Alex Deng , Jose Luis Montiel Olea , Justin Rao , and E. Glen Weyl . 2018. The A\/B Testing Problem . In Proceedings of the 2018 ACM Conference on Economics and Computation ( Ithaca, NY, USA) (EC '18). ACM, New York, NY, USA, 461--462. https:\/\/doi.org\/10.1145\/32 1916 6.3219204 10.1145\/3219166.3219204 Eduardo M. Azevedo, Alex Deng, Jose Luis Montiel Olea, Justin Rao, and E. Glen Weyl. 2018. The A\/B Testing Problem. In Proceedings of the 2018 ACM Conference on Economics and Computation (Ithaca, NY, USA) (EC '18). ACM, New York, NY, USA, 461--462. https:\/\/doi.org\/10.1145\/3219166.3219204"},{"key":"e_1_3_2_2_3_1","volume-title":"Bayesian Reasoning and Machine Learning","author":"Barber David","unstructured":"David Barber . 2012. Bayesian Reasoning and Machine Learning . Cambridge University Press . David Barber. 2012. Bayesian Reasoning and Machine Learning .Cambridge University Press."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/bimj.200900299"},{"key":"e_1_3_2_2_5_1","series-title":"Series B (Methodological)","volume-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society","author":"Benjamini Yoav","year":"1995","unstructured":"Yoav Benjamini and Yosef Hochberg . 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society . Series B (Methodological) ( 1995 ), 289--300. Yoav Benjamini and Yosef Hochberg. 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological) (1995), 289--300."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159652.3159699"},{"key":"e_1_3_2_2_7_1","volume-title":"Statistical Inference","author":"Casella George","unstructured":"George Casella and Roger L Berger . 2002. Statistical Inference . Duxbury Press : Pacific Grove, CA . George Casella and Roger L Berger. 2002. Statistical Inference .Duxbury Press: Pacific Grove, CA."},{"key":"e_1_3_2_2_8_1","volume-title":"Improving Treatment Effect Estimators Through Experiment Splitting. In The World Wide Web Conference. ACM, 285--295","author":"Coey Dominic","year":"2019","unstructured":"Dominic Coey and Tom Cunningham . 2019 . Improving Treatment Effect Estimators Through Experiment Splitting. In The World Wide Web Conference. ACM, 285--295 . Dominic Coey and Tom Cunningham. 2019. Improving Treatment Effect Estimators Through Experiment Splitting. In The World Wide Web Conference. ACM, 285--295."},{"key":"e_1_3_2_2_9_1","volume-title":"Asymptotic Theory of Statistics and Probability","author":"DasGupta Anirban","unstructured":"Anirban DasGupta . 2008. Asymptotic Theory of Statistics and Probability . Springer . Anirban DasGupta. 2008. Asymptotic Theory of Statistics and Probability .Springer."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2743062"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219919"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2016.33"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018677"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939700"},{"key":"e_1_3_2_2_16_1","volume-title":"Dong Woo Kim, and Jiannan Lu","author":"Deng Alex","year":"2016","unstructured":"Alex Deng , Pengchuan Zhang , Shouyuan Chen , Dong Woo Kim, and Jiannan Lu . 2016 b. Concise Summarization of Heterogeneous Treatment Effect Using Total Variation Regularized Regression . arxiv: 1610.03917 [stat.AP] Alex Deng, Pengchuan Zhang, Shouyuan Chen, Dong Woo Kim, and Jiannan Lu. 2016b. Concise Summarization of Heterogeneous Treatment Effect Using Total Variation Regularized Regression. arxiv: 1610.03917 [stat.AP]"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330771"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1995.10476626"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214504000000692"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511761362"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1198\/jasa.2011.tm11181"},{"key":"e_1_3_2_2_22_1","volume-title":"Two modeling strategies for empirical Bayes estimation. Statistical science: a review journal of the Institute of Mathematical Statistics","author":"Efron Bradley","year":"2014","unstructured":"Bradley Efron . 2014. Two modeling strategies for empirical Bayes estimation. Statistical science: a review journal of the Institute of Mathematical Statistics , Vol. 29 , 2 ( 2014 ), 285. Bradley Efron. 2014. Two modeling strategies for empirical Bayes estimation. Statistical science: a review journal of the Institute of Mathematical Statistics, Vol. 29, 2 (2014), 285."},{"key":"e_1_3_2_2_23_1","first-page":"117","article-title":"Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach","volume":"68","author":"Efron Bradley","year":"1973","unstructured":"Bradley Efron and Carl Morris . 1973 . Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach . J. Amer. Statist. Assoc. , Vol. 68 , 341 (1973), 117 -- 130 . Bradley Efron and Carl Morris. 1973. Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach. J. Amer. Statist. Assoc., Vol. 68, 341 (1973), 117--130.","journal-title":"J. Amer. Statist. Assoc."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330722"},{"key":"e_1_3_2_2_25_1","volume-title":"Nonparametric empirical bayes estimation on heterogeneous data. arXiv preprint arXiv:2002.12586","author":"Fu Luella J","year":"2020","unstructured":"Luella J Fu , Wenguang Sun , and Gareth M James . 2020. Nonparametric empirical bayes estimation on heterogeneous data. arXiv preprint arXiv:2002.12586 ( 2020 ). Luella J Fu, Wenguang Sun, and Gareth M James. 2020. Nonparametric empirical bayes estimation on heterogeneous data. arXiv preprint arXiv:2002.12586 (2020)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210049"},{"key":"e_1_3_2_2_27_1","volume-title":"A Decision Theoretic Approach to A\/B Testing. arXiv preprint arXiv:1710.03410","author":"Goldberg David","year":"2017","unstructured":"David Goldberg and James E Johndrow . 2017. A Decision Theoretic Approach to A\/B Testing. arXiv preprint arXiv:1710.03410 ( 2017 ). David Goldberg and James E Johndrow. 2017. A Decision Theoretic Approach to A\/B Testing. arXiv preprint arXiv:1710.03410 (2017)."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331651.3331655"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3291025"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488217"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-008-0114-1"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219905"},{"key":"e_1_3_2_2_33_1","volume-title":"Theory of Point Estimation","author":"Lehmann Erich L","unstructured":"Erich L Lehmann and George Casella . 2006. Theory of Point Estimation . Springer Science & Business Media . Erich L Lehmann and George Casella. 2006. Theory of Point Estimation .Springer Science & Business Media."},{"key":"e_1_3_2_2_34_1","volume-title":"Testing Statistical Hypotheses","author":"Lehmann Erich L","unstructured":"Erich L Lehmann and Joseph P Romano . 2006. Testing Statistical Hypotheses . Springer Science & Business Media . Erich L Lehmann and Joseph P Romano. 2006. Testing Statistical Hypotheses .Springer Science & Business Media."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spl.2016.06.007"},{"key":"e_1_3_2_2_36_1","volume-title":"Machine learning: a probabilistic perspective","author":"Murphy Kevin P","unstructured":"Kevin P Murphy . 2012. Machine learning: a probabilistic perspective . MIT press . Kevin P Murphy. 2012. Machine learning: a probabilistic perspective .MIT press."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1992.tb01452.x"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/cjs.11320"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1198\/000313001300339950"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1198\/000313008X331530"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1214\/13-EJS868"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/6.1.1"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835810"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313648"},{"key":"e_1_3_2_2_45_1","volume-title":"Asymptotic Statistics","author":"Van der Vaart Aad W","unstructured":"Aad W Van der Vaart . 2000. Asymptotic Statistics . Cambridge University Press . Aad W Van der Vaart. 2000. Asymptotic Statistics .Cambridge University Press."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939733"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2012.728154"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788602"}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event Singapore","acronym":"KDD '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467129","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467129","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:27Z","timestamp":1750191507000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":48,"alternative-id":["10.1145\/3447548.3467129","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467129","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}