{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:48:57Z","timestamp":1772909337404,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467091","type":"proceedings-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T06:12:05Z","timestamp":1628748725000},"page":"3106-3116","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Network Experimentation at Scale"],"prefix":"10.1145","author":[{"given":"Brian","family":"Karrer","sequence":"first","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Liang","family":"Shi","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Monica","family":"Bhole","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Matt","family":"Goldman","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Tyrone","family":"Palmer","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Charlie","family":"Gelman","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Mikael","family":"Konutgan","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]},{"given":"Feng","family":"Sun","sequence":"additional","affiliation":[{"name":"Facebook, Menlo Park, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Aronow and Cyrus Samii","author":"Peter","year":"2017","unstructured":"Peter M. Aronow and Cyrus Samii . 2017 . Estimating average causal effects under general interference, with application to a social network experiment. Ann. Appl. Stat ., Vol. 11 , 4 (12 2017), 1912--1947. Peter M. Aronow and Cyrus Samii. 2017. Estimating average causal effects under general interference, with application to a social network experiment. Ann. Appl. Stat., Vol. 11, 4 (12 2017), 1912--1947."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2016.1241178"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_3_2_2_4_1","volume-title":"Chen and Qi-Man Shao","author":"Louis H.","year":"2004","unstructured":"Louis H. Y. Chen and Qi-Man Shao . 2004 . Normal approximation under local dependence. Ann. Probab ., Vol. 32 , 3 (07 2004), 1985--2028. Louis H. Y. Chen and Qi-Man Shao. 2004. Normal approximation under local dependence. Ann. Probab., Vol. 32, 3 (07 2004), 1985--2028."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1515\/jci-2018-0026"},{"key":"e_1_3_2_2_6_1","volume-title":"Planning of Experiments","author":"Cox David Roxbee","unstructured":"David Roxbee Cox . 1958. Planning of Experiments . Wiley . David Roxbee Cox. 1958. Planning of Experiments. Wiley."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219919"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433413"},{"key":"e_1_3_2_2_9_1","volume-title":"Ilias Gerostathopoulos, Matthew Wardrop, Tobias Mao, and Colin McFarland.","author":"Diamantopoulos Nikos","year":"2019","unstructured":"Nikos Diamantopoulos , Jeffrey Wong , David Issa Mattos , Ilias Gerostathopoulos, Matthew Wardrop, Tobias Mao, and Colin McFarland. 2019 . Engineering for a Science-Centric Experimentation Platform . arxiv: 1910.03878 [cs.SE] Nikos Diamantopoulos, Jeffrey Wong, David Issa Mattos, Ilias Gerostathopoulos, Matthew Wardrop, Tobias Mao, and Colin McFarland. 2019. Engineering for a Science-Centric Experimentation Platform. arxiv: 1910.03878 [cs.SE]"},{"key":"e_1_3_2_2_10_1","volume-title":"Design and Analysis of Experiments in Networks: Reducing Bias from Interference. Journal of Causal Inference (04","author":"Eckles Dean","year":"2014","unstructured":"Dean Eckles , Brian Karrer , and Johan Ugander . 2014. Design and Analysis of Experiments in Networks: Reducing Bias from Interference. Journal of Causal Inference (04 2014 ). Dean Eckles, Brian Karrer, and Johan Ugander. 2014. Design and Analysis of Experiments in Networks: Reducing Bias from Interference. Journal of Causal Inference (04 2014)."},{"key":"e_1_3_2_2_11_1","unstructured":"Facebook. 2020. Commuting Zones. https:\/\/dataforgood.fb.com\/tools\/commutingzones\/.  Facebook. 2020. Commuting Zones. https:\/\/dataforgood.fb.com\/tools\/commutingzones\/."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741081"},{"key":"e_1_3_2_2_13_1","volume-title":"Cluster randomised trials","author":"Hayes Richard J","unstructured":"Richard J Hayes and Lawrence H Moulton . 2017. Cluster randomised trials . CRC press . Richard J Hayes and Lawrence H Moulton. 2017. Cluster randomised trials .CRC press."},{"key":"e_1_3_2_2_14_1","volume-title":"Reducing Interference Bias in Online Marketplace Pricing Experiments. arxiv","author":"Holtz David","year":"2004","unstructured":"David Holtz , Ruben Lobel , Inessa Liskovich , and Sinan Aral . 2020. Reducing Interference Bias in Online Marketplace Pricing Experiments. arxiv : 2004 .12489 [stat.ME] David Holtz, Ruben Lobel, Inessa Liskovich, and Sinan Aral. 2020. Reducing Interference Bias in Online Marketplace Pricing Experiments. arxiv: 2004.12489 [stat.ME]"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214508000000292"},{"key":"e_1_3_2_2_16_1","volume-title":"Social hash partitioner: a scalable distributed hypergraph partitioner. arXiv preprint arXiv:1707.06665","author":"Kabiljo Igor","year":"2017","unstructured":"Igor Kabiljo , Brian Karrer , Mayank Pundir , Sergey Pupyrev , Alon Shalita , Alessandro Presta , and Yaroslav Akhremtsev . 2017. Social hash partitioner: a scalable distributed hypergraph partitioner. arXiv preprint arXiv:1707.06665 ( 2017 ). Igor Kabiljo, Brian Karrer, Mayank Pundir, Sergey Pupyrev, Alon Shalita, Alessandro Presta, and Yaroslav Akhremtsev. 2017. Social hash partitioner: a scalable distributed hypergraph partitioner. arXiv preprint arXiv:1707.06665 (2017)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOAS583"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1515\/spp-2013-0002"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/asz047"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330778"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0037350"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","first-page":"591","DOI":"10.2307\/2287653","article-title":"Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment","volume":"75","author":"Rubin Donald B.","year":"1980","unstructured":"Donald B. Rubin . 1980 . Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment . J. Amer. Statist. Assoc. , Vol. 75 , 371 (1980), 591 -- 593 . Donald B. Rubin. 1980. Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment. J. Amer. Statist. Assoc., Vol. 75, 371 (1980), 591--593.","journal-title":"J. Amer. Statist. Assoc."},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Halifax, NS, Canada) (KDD","author":"Saveski Martin","year":"2017","unstructured":"Martin Saveski , Jean Pouget-Abadie , Guillaume Saint-Jacques , Weitao Duan , Souvik Ghosh , Ya Xu , and Edoardo M. Airoldi . 2017. Detecting Network Effects: Randomizing Over Randomized Experiments . In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Halifax, NS, Canada) (KDD 2017 ). Association for Computing Machinery, New York, NY, USA, 1027--1035. Martin Saveski, Jean Pouget-Abadie, Guillaume Saint-Jacques, Weitao Duan, Souvik Ghosh, Ya Xu, and Edoardo M. Airoldi. 2017. Detecting Network Effects: Randomizing Over Randomized Experiments. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Halifax, NS, Canada) (KDD 2017). Association for Computing Machinery, New York, NY, USA, 1027--1035."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487695"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939733"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788602"}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event Singapore","acronym":"KDD '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467091","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:04Z","timestamp":1750195684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":27,"alternative-id":["10.1145\/3447548.3467091","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467091","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}