{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T19:19:54Z","timestamp":1787167194607,"version":"build-2736575974"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,5,3]],"date-time":"2023-05-03T00:00:00Z","timestamp":1683072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,12]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>Power analyses are an important aspect of experimental design, because they help determine how experiments are implemented in practice. It is common to specify a desired level of power and compute the sample size necessary to obtain that power. Such calculations are well known for completely randomized experiments, but there can be many benefits to using other experimental designs. For example, it has recently been established that rerandomization, where subjects are randomized until covariate balance is obtained, increases the precision of causal effect estimators. This work establishes the power of rerandomized treatment-control experiments, thereby allowing for sample size calculators. We find the surprising result that, while power is often greater under rerandomization than complete randomization, the opposite can occur for very small treatment effects. The reason is that inference under rerandomization can be relatively more conservative, in the sense that it can have a lower Type-I error at the same nominal significance level, and this additional conservativeness adversely affects power. This surprising result is due to treatment effect heterogeneity, a quantity often ignored in power analyses. We find that heterogeneity increases power for large effect sizes, but decreases power for small effect sizes.<\/jats:p>","DOI":"10.1093\/biomet\/asad027","type":"journal-article","created":{"date-parts":[[2023,5,3]],"date-time":"2023-05-03T18:00:37Z","timestamp":1683136837000},"page":"355-363","source":"Crossref","is-referenced-by-count":11,"title":["Power and sample size calculations for rerandomization"],"prefix":"10.1093","volume":"111","author":[{"given":"Zach","family":"Branson","sequence":"first","affiliation":[{"name":"Department of Statistics and Data Science, Carnegie Mellon University , 5000 Forbes Avenue , Pittsburgh, Pennsylvania 15213, U.S.A"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7375-7758","authenticated-orcid":false,"given":"Xinran","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Illinois at Urbana-Champaign , 605 E. Springfield Avenue , Champaign, Illinois 61820, U.S.A"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2704-2353","authenticated-orcid":false,"given":"Peng","family":"Ding","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of California , 425 Evans Hall , Berkeley, California 94720, U.S.A . pengdingpku@berkeley.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,5,3]]},"reference":[{"key":"2024050300004951300_asad027-B1","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1257\/aer.20201856","article-title":"Optimality of matched-pair designs in randomized controlled trials","volume":"112","author":"Bai","year":"2022","journal-title":"Am. Econ. Rev"},{"key":"2024050300004951300_asad027-B2","doi-asserted-by":"crossref","first-page":"1958","DOI":"10.1214\/16-AOAS959","article-title":"Improving covariate balance in 2K factorial designs via rerandomization with an application to a New York City Department of Education high school study","volume":"10","author":"Branson","year":"2016","journal-title":"Ann. Appl. Statist"},{"key":"2024050300004951300_asad027-B3","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.jspi.2020.07.002","article-title":"Ridge rerandomization: an experimental design strategy in the presence of covariate collinearity","volume":"211","author":"Branson","year":"2021","journal-title":"J. Statist. Plan. Infer"},{"key":"2024050300004951300_asad027-B4","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1257\/app.1.4.200","article-title":"In pursuit of balance: randomization in practice in development field experiments","volume":"1","author":"Bruhn","year":"2009","journal-title":"Am. Econ. J. Appl. Econ"},{"key":"2024050300004951300_asad027-B5","doi-asserted-by":"crossref","DOI":"10.1201\/9781315183084","volume-title":"Sample Size Calculations in Clinical Research","author":"Chow","year":"2017"},{"key":"2024050300004951300_asad027-B6","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol. Bull"},{"key":"2024050300004951300_asad027-B7","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1080\/01621459.2017.1407322","article-title":"Decomposing treatment effect variation","volume":"114","author":"Ding","year":"2019","journal-title":"J. Am. Statist. Assoc"},{"key":"2024050300004951300_asad027-B8","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/0197-2456(90)90005-M","article-title":"Power and sample size calculations: a review and computer program","volume":"11","author":"Dupont","year":"1990","journal-title":"Controlled clinical trials"},{"key":"2024050300004951300_asad027-B9","volume-title":"Design of Experiments","author":"Fisher","year":"1935"},{"key":"2024050300004951300_asad027-B10","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1093\/biostatistics\/5.2.263","article-title":"Optimal multivariate matching before randomization","volume":"5","author":"Greevy","year":"2004","journal-title":"Biostatistics"},{"key":"2024050300004951300_asad027-B11","doi-asserted-by":"crossref","first-page":"4857","DOI":"10.1002\/sim.3337","article-title":"Variance identification and efficiency analysis in randomized experiments under the matched-pair design","volume":"27","author":"Imai","year":"2008","journal-title":"Statist. Med"},{"key":"2024050300004951300_asad027-B12","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal Inference in Statistics, Social, and Biomedical Sciences","author":"Imbens","year":"2015"},{"key":"2024050300004951300_asad027-B13","doi-asserted-by":"publisher","DOI":"10.1111\/biom.13782.","article-title":"Statistical inference and power analysis for direct and spillover effects in two-stage randomized experiments","author":"Jiang","year":"2022","journal-title":"Biometrics"},{"key":"2024050300004951300_asad027-B14","doi-asserted-by":"crossref","DOI":"10.3352\/jeehp.2021.18.17","article-title":"Sample size determination and power analysis using the G* Power software","volume":"18","author":"Kang","year":"2021","journal-title":"Journal of educational evaluation for health professions"},{"key":"2024050300004951300_asad027-B15","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/0197-2456(81)90001-5","article-title":"Introduction to sample size determination and power analysis for clinical trials","volume":"2","author":"Lachin","year":"1981","journal-title":"Contr. Clin. Trials"},{"key":"2024050300004951300_asad027-B16","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1007\/BF03011261","article-title":"Study design in clinical research: sample size estimation and power analysis","volume":"43","author":"Lerman","year":"1996","journal-title":"Can. J. Anaesth."},{"key":"2024050300004951300_asad027-B17","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1080\/01621459.2017.1295865","article-title":"General forms of finite population central limit theorems with applications to causal inference","volume":"112","author":"Li","year":"2017","journal-title":"J. Am. Statist. Assoc"},{"key":"2024050300004951300_asad027-B18","doi-asserted-by":"crossref","first-page":"9157","DOI":"10.1073\/pnas.1808191115","article-title":"Asymptotic theory of rerandomization in treatment\u2013control experiments","volume":"115","author":"Li","year":"2018","journal-title":"Proc. Nat. Acad. Sci"},{"key":"2024050300004951300_asad027-B19","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1214\/18-AOS1790","article-title":"Rerandomization in 2K factorial experiments","volume":"48","author":"Li","year":"2020","journal-title":"Ann. Statist"},{"key":"2024050300004951300_asad027-B20","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1093\/biomet\/asac045","article-title":"Design-based theory for cluster rerandomization","volume":"110","author":"Lu","year":"2023","journal-title":"Biometrika"},{"key":"2024050300004951300_asad027-B21","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1146\/annurev.psych.59.103006.093735","article-title":"Sample size planning for statistical power and accuracy in parameter estimation","volume":"59","author":"Maxwell","year":"2008","journal-title":"Ann. Rev. Psychol"},{"key":"2024050300004951300_asad027-B22","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1467-9868.2012.01048.x","article-title":"Adjusting treatment effect estimates by post-stratification in randomized experiments","volume":"75","author":"Miratrix","year":"2013","journal-title":"J. R. Statist. Soc. B"},{"key":"2024050300004951300_asad027-B23","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1214\/12-AOS1008","article-title":"Rerandomization to improve covariate balance in experiments","volume":"40","author":"Morgan","year":"2012","journal-title":"Ann. Statist."},{"key":"2024050300004951300_asad027-B24","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1080\/01621459.2015.1079528","article-title":"Rerandomization to balance tiers of covariates","volume":"110","author":"Morgan","year":"2015","journal-title":"J. Am. Statist. Assoc"},{"key":"2024050300004951300_asad027-B25","first-page":"465","article-title":"On the application of probability theory to agricultural experiments","volume":"5","author":"Neyman","year":"1923","journal-title":"Essay on principles. Section 9. Statist. Sci"},{"key":"2024050300004951300_asad027-B26","doi-asserted-by":"crossref","first-page":"271","DOI":"10.3102\/1076998620946272","article-title":"Insights on variance estimation for blocked and matched pairs designs","volume":"46","author":"Pashley","year":"2021","journal-title":"J. Educ. Behav. Statist"},{"key":"2024050300004951300_asad027-B27","doi-asserted-by":"crossref","first-page":"69","DOI":"10.3102\/10769986211027240","article-title":"Block what you can, except when you shouldn\u2019t","volume":"47","author":"Pashley","year":"2022","journal-title":"J. Educ. Behav. Statist"},{"key":"2024050300004951300_asad027-B28","author":"R Development Core Team","year":"2024"},{"key":"2024050300004951300_asad027-B29","doi-asserted-by":"crossref","first-page":"238","DOI":"10.3102\/1076998609332748","article-title":"Statistical power for regression discontinuity designs in education evaluations","volume":"34","author":"Schochet","year":"2009","journal-title":"J. Educ. Behav. Statist"},{"key":"2024050300004951300_asad027-B30","doi-asserted-by":"crossref","first-page":"367","DOI":"10.3102\/10769986211070625","article-title":"Statistical power for estimating treatment effects using difference-in-differences and comparative interrupted time series estimators with variation in treatment timing","volume":"47","author":"Schochet","year":"2022","journal-title":"J. Educ. Behav. Statist"},{"key":"2024050300004951300_asad027-B31","doi-asserted-by":"crossref","first-page":"310","DOI":"10.2307\/3213483","article-title":"Dispersive ordering of distributions","volume":"19","author":"Shaked","year":"1982","journal-title":"J. Appl. Prob"},{"key":"2024050300004951300_asad027-B32","author":"Tabord-Meehan","year":"2022"},{"key":"2024050300004951300_asad027-B33","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2021.1990767.","article-title":"Rerandomization in stratified randomized experiments","author":"Wang","year":"2021","journal-title":"J. Am. Statist. Assoc"},{"key":"2024050300004951300_asad027-B34","doi-asserted-by":"crossref","first-page":"3439","DOI":"10.1214\/22-AOS2235","article-title":"Rerandomization with diminishing covariate imbalance and diverging number of covariates","volume":"50","author":"Wang","year":"2022","journal-title":"Ann. Statist."},{"key":"2024050300004951300_asad027-B35","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1093\/epirev\/24.1.39","article-title":"Sample size calculations for randomized controlled trials","volume":"24","author":"Wittes","year":"2002","journal-title":"Epidemiol. Rev"},{"key":"2024050300004951300_asad027-B36","doi-asserted-by":"publisher","DOI":"10.1002\/cjs.11765.","article-title":"PCA rerandomization","author":"Zhang","year":"2023","journal-title":"Can. J. Statist."},{"key":"2024050300004951300_asad027-B37","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1093\/biomet\/asy031","article-title":"Sequential rerandomization","volume":"105","author":"Zhou","year":"2018","journal-title":"Biometrika"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asad027\/50833315\/asad027.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/111\/1\/355\/56665596\/asad027.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/111\/1\/355\/56665596\/asad027.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,2]],"date-time":"2024-05-02T20:01:21Z","timestamp":1714680081000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/111\/1\/355\/7151068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,3]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,5,3]]},"published-print":{"date-parts":[[2024,2,12]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asad027","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2023,5,3]]}}}