{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T20:52:53Z","timestamp":1789678373888,"version":"4.0.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T00:00:00Z","timestamp":1768176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Completely randomized experiments, originally developed by Fisher and Neyman in the 1930s, are still widely used in practice, even in online experimentation. However, such designs are of limited value for answering standard questions in marketplaces, where multiple populations of agents interact strategically, leading to complex patterns of spillover effects. In this article, we derive the finite-sample properties of tractable estimators for \u2018Simple Multiple Randomization Designs\u2019, a new class of experimental designs which account for complex spillover effects in randomized experiments. Our derivations are obtained under a natural and general form of cross-unit interference, which we call \u2018local interference\u2019. We discuss the estimation of main effects, direct effects, and spillovers, and present associated central limit theorems.<\/jats:p>","DOI":"10.1093\/jrsssb\/qkaf073","type":"journal-article","created":{"date-parts":[[2025,11,9]],"date-time":"2025-11-09T12:50:44Z","timestamp":1762692644000},"page":"958-977","source":"Crossref","is-referenced-by-count":2,"title":["Multiple randomization designs: estimation and inference with interference"],"prefix":"10.1093","volume":"88","author":[{"given":"Lorenzo","family":"Masoero","sequence":"first","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suhas","family":"Vijaykumar","sequence":"additional","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3721-2704","authenticated-orcid":false,"given":"Thomas S","family":"Richardson","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Washington , Seattle, WA 98195 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"McQueen","sequence":"additional","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ido","family":"Rosen","sequence":"additional","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Burdick","sequence":"additional","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pat","family":"Bajari","sequence":"additional","affiliation":[{"name":"Amazon , 440 Terry Ave N, Seattle, WA 98109 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4846-7326","authenticated-orcid":false,"given":"Guido","family":"Imbens","sequence":"additional","affiliation":[{"name":"Graduate School of Business and Department of Economics, Stanford University , Stanford, CA 94305 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,1,12]]},"reference":[{"issue":"1","key":"2026071507142909600_qkaf073-B1","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0049124112437535","article-title":"A general method for detecting interference between units in randomized experiments","volume":"41","author":"Aronow","year":"2012","journal-title":"Sociological Methods & Research"},{"issue":"4","key":"2026071507142909600_qkaf073-B2","doi-asserted-by":"publisher","first-page":"1912","DOI":"10.1214\/16-AOAS1005","article-title":"Estimating average causal effects under general interference, with application to a social network experiment","volume":"11","author":"Aronow","year":"2017","journal-title":"The Annals of Applied Statistics"},{"issue":"521","key":"2026071507142909600_qkaf073-B3","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1080\/01621459.2016.1241178","article-title":"Exact p-values for network interference","volume":"113","author":"Athey","year":"2018","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2026071507142909600_qkaf073-B4","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.jeconom.2020.10.012","article-title":"Design-based analysis in difference-in-differences settings with staggered adoption","volume":"226","author":"Athey","year":"2022","journal-title":"Journal of Econometrics"},{"issue":"3","key":"2026071507142909600_qkaf073-B5","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1214\/23-STS883","article-title":"Experimental design in marketplaces","volume":"38","author":"Bajari","year":"2023","journal-title":"Statistical Science"},{"issue":"2","key":"2026071507142909600_qkaf073-B6","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1093\/biomet\/asy072","article-title":"Randomization tests of causal effects under interference","volume":"106","author":"Basse","year":"2019","journal-title":"Biometrika"},{"key":"2026071507142909600_qkaf073-B7","author":"Blake","year":"2014"},{"key":"2026071507142909600_qkaf073-B8","author":"Bojinov","year":"2020"},{"key":"2026071507142909600_qkaf073-B9","doi-asserted-by":"publisher","first-page":"7094","DOI":"10.1145\/3580507.3597738","article-title":"Reducing marketplace interference bias via shadow prices","volume":"71","author":"Bright","year":"2024","journal-title":"Management Science"},{"issue":"1","key":"2026071507142909600_qkaf073-B10","doi-asserted-by":"publisher","first-page":"69","DOI":"10.2307\/2530496","article-title":"The crossover experiment for clinical trials","volume":"36","author":"Brown","year":"1980","journal-title":"Biometrics"},{"issue":"2","key":"2026071507142909600_qkaf073-B11","doi-asserted-by":"publisher","first-page":"104","DOI":"10.2307\/2983686","article-title":"Long-term agricultural experiments","volume":"6","author":"Cochran","year":"1939","journal-title":"Supplement to the Journal of the Royal Statistical Society"},{"key":"2026071507142909600_qkaf073-B12","doi-asserted-by":"crossref","DOI":"10.1201\/9781420035834","volume-title":"The theory of the design of experiments","author":"Cox","year":"2000"},{"key":"2026071507142909600_qkaf073-B13","volume-title":"Statistical methods for research workers. Number 5","author":"Fisher","year":"1928"},{"key":"2026071507142909600_qkaf073-B14","volume-title":"The design of experiments","author":"Fisher","year":"1937"},{"issue":"1","key":"2026071507142909600_qkaf073-B15","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1145\/3331651.3331655","article-title":"Top challenges from the first practical online controlled experiments summit","volume":"21","author":"Gupta","year":"2019","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"2026071507142909600_qkaf073-B16","doi-asserted-by":"publisher","author":"Harshaw","year":"2022","DOI":"10.1145\/3490486.3538269"},{"issue":"feb06 1","key":"2026071507142909600_qkaf073-B17","doi-asserted-by":"publisher","first-page":"h391","DOI":"10.1136\/bmj.h391","article-title":"The stepped wedge cluster randomised trial: Rationale, design, analysis, and reporting","volume":"350","author":"Hemming","year":"2015","journal-title":"BMJ"},{"issue":"475","key":"2026071507142909600_qkaf073-B18","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1198\/016214506000000447","article-title":"Evaluating kindergarten retention policy: A case study of causal inference for multilevel observational data","volume":"101","author":"Hong","year":"2006","journal-title":"Journal of the American Statistical Association"},{"issue":"3","key":"2026071507142909600_qkaf073-B19","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3102\/1076998607307355","article-title":"Causal inference for time-varying instructional treatments","volume":"33","author":"Hong","year":"2008","journal-title":"Journal of Educational and Behavioral Statistics"},{"issue":"482","key":"2026071507142909600_qkaf073-B20","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1198\/016214508000000292","article-title":"Toward causal inference with interference","volume":"103","author":"Hudgens","year":"2008","journal-title":"Journal of the American Statistical Association"},{"key":"2026071507142909600_qkaf073-B21","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"Imbens","year":"2015"},{"key":"2026071507142909600_qkaf073-B22","doi-asserted-by":"crossref","first-page":"7069","DOI":"10.1287\/mnsc.2021.4247","article-title":"Experimental design in two-sided platforms: An analysis of bias","volume":"68","author":"Johari","year":"2022","journal-title":"Management Science"},{"key":"2026071507142909600_qkaf073-B23","author":"Li","year":"2021"},{"issue":"520","key":"2026071507142909600_qkaf073-B24","doi-asserted-by":"publisher","first-page":"1759","DOI":"10.1080\/01621459.2017.1295865","article-title":"General forms of finite population central limit theorems with applications to causal inference","volume":"112","author":"Li","year":"2017","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2026071507142909600_qkaf073-B25","doi-asserted-by":"publisher","first-page":"S1","DOI":"10.1111\/j.1368-423X.2012.00368.x","article-title":"Identification of treatment response with social interactions","volume":"16","author":"Manski","year":"2013","journal-title":"The Econometrics Journal"},{"key":"2026071507142909600_qkaf073-B26","author":"Masoero","year":"2023"},{"key":"2026071507142909600_qkaf073-B27","author":"Masoero","year":"2024"},{"issue":"6","key":"2026071507142909600_qkaf073-B28","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.2307\/2938316","article-title":"Rationalizability, learning, and equilibrium in games with strategic complementarities","volume":"58","author":"Milgrom","year":"1990","journal-title":"Econometrica: Journal of the Econometric Society"},{"issue":"10","key":"2026071507142909600_qkaf073-B29","doi-asserted-by":"crossref","first-page":"3273","DOI":"10.1257\/aer.20230039","article-title":"Treatment effects in market equilibrium","volume":"115","author":"Munro","year":"2021","journal-title":"American Economic Review"},{"issue":"4","key":"2026071507142909600_qkaf073-B30","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1214\/ss\/1177012031","article-title":"On the application of probability theory to agricultural experiments. Essay on principles. Section 9","volume":"5","author":"Neyman","year":"1923\/1990","journal-title":"Statistical Science"},{"key":"2026071507142909600_qkaf073-B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/ss\/1177012031","article-title":"Sur les applications de la th\u00e9orie des probabilit\u00e9s aux experiences agricoles: Essai des principes","volume":"10","author":"Neyman","year":"1923","journal-title":"Roczniki Nauk Rolniczych"},{"issue":"4","key":"2026071507142909600_qkaf073-B32","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1214\/14-STS501","article-title":"Causal diagrams for interference","volume":"29","author":"Ogburn","year":"2014","journal-title":"Statistical Science"},{"issue":"477","key":"2026071507142909600_qkaf073-B33","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1198\/016214506000001112","article-title":"Interference between units in randomized experiments","volume":"102","author":"Rosenbaum","year":"2007","journal-title":"Journal of the American Statistical Association"},{"issue":"5","key":"2026071507142909600_qkaf073-B34","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1037\/h0037350","article-title":"Estimating causal effects of treatments in randomized and nonrandomized studies","volume":"66","author":"Rubin","year":"1974","journal-title":"Journal of Educational Psychology"},{"issue":"2","key":"2026071507142909600_qkaf073-B35","doi-asserted-by":"publisher","first-page":"ujae023","DOI":"10.1093\/biomtc\/ujae023","article-title":"Behavioral carry-over effect and power consideration in crossover trials","volume":"80","author":"Shi","year":"2024","journal-title":"Biometrics"},{"key":"2026071507142909600_qkaf073-B36","article-title":"Berry\u2013Esseen bounds for design-based causal inference with possibly diverging treatment levels and varying group sizes","author":"Shi","year":"2022","journal-title":"Annals of Statistics"},{"key":"2026071507142909600_qkaf073-B37","author":"Sudijono","year":"2025"},{"key":"2026071507142909600_qkaf073-B38","author":"Ugander","year":"2013"},{"issue":"4","key":"2026071507142909600_qkaf073-B39","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1214\/14-STS479","article-title":"Interference and sensitivity analysis","volume":"29","author":"VanderWeele","year":"2014","journal-title":"Statistical Science: A Review Journal of the Institute of Mathematical Statistics"},{"issue":"1","key":"2026071507142909600_qkaf073-B40","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1111\/j.1467-9531.2009.01221.x","article-title":"Exploiting spatial dependence to improve measurement of neighborhood social processes","volume":"39","author":"Verbitsky-Savitz","year":"2009","journal-title":"Sociological Methodology"},{"key":"2026071507142909600_qkaf073-B41","doi-asserted-by":"publisher","author":"Viviano","year":"2023","DOI":"10.48550\/arXiv.2310.14983"},{"key":"2026071507142909600_qkaf073-B42","doi-asserted-by":"publisher","first-page":"6694","DOI":"10.1287\/mnsc.2020.3844","article-title":"Experimenting in equilibrium","volume":"67","author":"Wager","year":"2021","journal-title":"Management Science"},{"issue":"1\u20132","key":"2026071507142909600_qkaf073-B43","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1093\/biomet\/29.1-2.21","article-title":"On the z-test in randomized blocks and Latin squares","volume":"29","author":"Welch","year":"1937","journal-title":"Biometrika"},{"key":"2026071507142909600_qkaf073-B44","doi-asserted-by":"publisher","first-page":"5317","DOI":"10.1287\/mnsc.2023.4928","article-title":"Optimal experimental design for staggered rollouts","volume":"70","author":"Xiong","year":"2023","journal-title":"Management Science"},{"issue":"2","key":"2026071507142909600_qkaf073-B45","doi-asserted-by":"publisher","first-page":"1170","DOI":"10.1214\/21-AOS2144","article-title":"Reconciling design-based and model-based causal inferences for split-plot experiments","volume":"50","author":"Zhao","year":"2022","journal-title":"Annals of Statistics"},{"issue":"5","key":"2026071507142909600_qkaf073-B46","doi-asserted-by":"publisher","first-page":"1876","DOI":"10.1214\/17-AOS1605","article-title":"Randomization-based causal inference from split-plot designs","volume":"46","author":"Zhao","year":"2018","journal-title":"Annals of Statistics"},{"issue":"5","key":"2026071507142909600_qkaf073-B47","doi-asserted-by":"publisher","first-page":"2210","DOI":"10.1214\/aos\/1069362395","article-title":"Error bound in a central limit theorem of double-indexed permutation statistics","volume":"25","author":"Zhao","year":"1997","journal-title":"Annals of Statistics"},{"key":"2026071507142909600_qkaf073-B48","doi-asserted-by":"publisher","author":"Zhu","year":"2024","DOI":"10.48550\/arXiv.2401.15811"},{"issue":"1","key":"2026071507142909600_qkaf073-B49","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1214\/19-STS749","article-title":"Bipartite causal inference with interference","volume":"36","author":"Zigler","year":"2021","journal-title":"Statistical Science: A Review Journal of the Institute of Mathematical Statistics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/88\/3\/958\/66357464\/qkaf073.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/88\/3\/958\/66357464\/qkaf073.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T11:14:35Z","timestamp":1784114075000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/88\/3\/958\/8422435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,12]]},"references-count":49,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,1,12]]},"published-print":{"date-parts":[[2026,7,15]]}},"URL":"https:\/\/doi.org\/10.1093\/jrsssb\/qkaf073","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,7]]},"published":{"date-parts":[[2026,1,12]]}}}