{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T00:42:34Z","timestamp":1791592954029,"version":"4.3.4"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":536,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1945136"],"award-info":[{"award-number":["1945136"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Cluster-randomized experiments are widely used due to their logistical convenience and policy relevance. To analyse them properly, we must address the fact that the treatment is assigned at the cluster level instead of the individual level. Standard analytic strategies are regressions based on individual data, cluster averages and cluster totals, which differ when the cluster sizes vary. These methods are often motivated by models with strong and unverifiable assumptions, and the choice among them can be subjective. Without any outcome modelling assumption, we evaluate these regression estimators and the associated robust standard errors from the design-based perspective where only the treatment assignment itself is random and controlled by the experimenter. We demonstrate that regression based on cluster averages targets a weighted average treatment effect, regression based on individual data is suboptimal in terms of efficiency and regression based on cluster totals is consistent and more efficient with a large number of clusters. We highlight the critical role of covariates in improving estimation efficiency and illustrate the efficiency gain via both simulation studies and data analysis. The asymptotic analysis also reveals the efficiency-robustness trade-off by comparing the properties of various estimators using data at different levels with and without covariate adjustment. Moreover, we show that the robust standard errors are convenient approximations to the true asymptotic standard errors under the design-based perspective. Our theory holds even when the outcome models are misspecified, so it is model-assisted rather than model-based. We also extend the theory to a wider class of weighted average treatment effects.<\/jats:p>","DOI":"10.1111\/rssb.12468","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T13:58:40Z","timestamp":1630936720000},"page":"994-1015","source":"Crossref","is-referenced-by-count":49,"title":["Model-Assisted Analyses of Cluster-Randomized Experiments"],"prefix":"10.1093","volume":"83","author":[{"given":"Fangzhou","family":"Su","sequence":"first","affiliation":[{"name":"Department of Statistics , , Berkeley, California , USA"},{"name":"University of California , , Berkeley, California , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Ding","sequence":"additional","affiliation":[{"name":"Department of Statistics , , Berkeley, California , USA"},{"name":"University of California , , Berkeley, California , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,9,6]]},"reference":[{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.3386\/w24003","volume-title":"When should you adjust standard errors for clustering","author":"Abadie","year":"2017"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvcm4j72","volume-title":"Mostly harmless econometrics: An empiricist's companion","author":"Angrist","year":"2008"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/bs.hefe.2016.10.003","volume-title":"Handbook of economic field experiments","author":"Athey","year":"2017"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1080\/01621459.2012.682524","article-title":"Clustering, spatial correlations, and randomization inference","volume":"107","author":"Barrios","year":"2012","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1080\/01621459.2017.1323641","article-title":"Analyzing two-stage experiments in the presence of interference","volume":"113","author":"Basse","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"7383","DOI":"10.1073\/pnas.1510506113","article-title":"Lasso adjustments of treatment effect estimates in randomized experiments","volume":"113","author":"Bloniarz","year":"2016","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"317","DOI":"10.3368\/jhr.50.2.317","article-title":"A practitioner's guide to cluster-robust inference","volume":"50","author":"Cameron","year":"2015","journal-title":"Journal of Human Resources"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1093\/oxfordjournals.aje.a112592","article-title":"Randomization by group: A formal analysis","volume":"108","author":"Cornfield","year":"1978","journal-title":"American Journal of Epidemiology"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1111\/rssb.12085","article-title":"Causal inference from 2K factorial designs by using potential outcomes","volume":"77","author":"Dasgupta","year":"2015","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"2151","DOI":"10.1214\/18-AOAS1147","article-title":"Rank tests in unmatched clustered randomized trials applied to a study of teacher training","volume":"12","author":"Ding","year":"2018","journal-title":"Annals of Applied Statistics"},{"key":"2023022501100761500_","volume-title":"Design and analysis of cluster randomization trials in health research","author":"Donner","year":"2000"},{"key":"2023022501100761500_","volume-title":"Emerging trends in the social and behavioral sciences","author":"Feller","year":"2015"},{"key":"2023022501100761500_","volume-title":"The design of experiments","author":"Fisher","year":"1935"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1111\/rssb.12290","article-title":"On mitigating the analytical limitations of finely stratified experiments","volume":"80","author":"Fogarty","year":"2018","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1093\/biomet\/asy034","article-title":"Regression assisted inference for the average treatment effect in paired experiments","volume":"105","author":"Fogarty","year":"2018","journal-title":"Biometrika"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1093\/biostatistics\/3.2.147","article-title":"Clustered encouragement designs with individual noncompliance: Bayesian inference with randomization, and application to advance directive forms","volume":"3","author":"Frangakis","year":"2002","journal-title":"Biostatistics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1214\/07-AOAS143","article-title":"On regression adjustments in experiments with several treatments","volume":"2","author":"Freedman","year":"2008","journal-title":"The Annals of Applied Statistics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.aam.2006.12.003","article-title":"On regression adjustments to experimental data","volume":"40","author":"Freedman","year":"2008","journal-title":"Advances in Applied Mathematics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.1002\/9780470523551","volume-title":"Sampling statistics","author":"Fuller","year":"2009"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1002\/(SICI)1097-0258(19960615)15:11<1069::AID-SIM220>3.0.CO;2-Q","article-title":"On design considerations and randomization-based inference for community intervention trials","volume":"15","author":"Gail","year":"1996","journal-title":"Statistics in Medicine"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1002\/sim.4780130514","article-title":"Regression analysis with clustered data","volume":"13","author":"Graubard","year":"1994","journal-title":"Statistics in Medicine"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1093\/pan\/mpm025","article-title":"Analysis of cluster-randomized experiments: A comparison of alternative estimation approaches","volume":"16","author":"Green","year":"2008","journal-title":"Political Analysis"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1126\/science.aaa0491","article-title":"Encouraging sanitation investment in the developing world: A cluster-randomized trial","volume":"348","author":"Guiteras","year":"2015","journal-title":"Science"},{"key":"2023022501100761500_","first-page":"221","volume-title":"Proceedings of the fifth Berkeley symposium on mathematical statistics and probability","author":"Huber","year":"1967"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1214\/08-STS274","article-title":"The essential role of pair matching in cluster-randomized experiments, with application to the Mexican universal health insurance evaluation","volume":"24","author":"Imai","year":"2009","journal-title":"Statistical Science"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference for statistics, social, and biomedical sciences: An introduction","author":"Imbens","year":"2015"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1037\/1082-989X.13.1.1","article-title":"Cluster randomized trials with treatment noncompliance","volume":"13","author":"Jo","year":"2008","journal-title":"Psychological Methods"},{"key":"2023022501100761500_","article-title":"Estimation methods for cluster randomized trials with noncompliance: A study of a biometric smartcard payment system in India","volume-title":"arXiv preprint","author":"Kang","year":"2018"},{"key":"2023022501100761500_","article-title":"Spillover effects in cluster randomized trials with noncompliance","volume-title":"arXiv preprint","author":"Kang","year":"2018"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.1093\/biomet\/asaa103","article-title":"Regression adjustment in completely randomized experiments with a diverging number of covariates","author":"Lei","year":"2021","journal-title":"Biometrika"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1080\/01621459.2017.1295865","article-title":"General forms of finite population central limit theorems with applications to causal inference","volume":"112","author":"Li","year":"2017","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal data analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1214\/12-AOAS583","article-title":"Agnostic notes on regression adjustments to experimental data: Reexamining Freedman's critique","volume":"7","author":"Lin","year":"2013","journal-title":"Annals of Applied Statistics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1093\/biomet\/asaa038","article-title":"Regression-adjusted average treatment effect estimates in stratified randomized experiments","volume":"107","author":"Liu","year":"2020","journal-title":"Biometrika"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.1201\/9780429296284","volume-title":"Sampling: Design and analysis","author":"Lohr","year":"2019"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"2654","DOI":"10.1016\/j.spl.2008.03.008","article-title":"Bias of the regression estimator for experiments using clustered random assignment","volume":"78","author":"Middleton","year":"2008","journal-title":"Statistics and Probability Letters"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1515\/spp-2013-0002","article-title":"Unbiased estimation of the average treatment effect in clusterrandomized experiments","volume":"6","author":"Middleton","year":"2015","journal-title":"Statistics, Politics and Policy"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1467-9868.2012.01048.x","article-title":"Adjusting treatment effect estimates by post-stratification in randomized experiments","volume":"75","author":"Miratrix","year":"2013","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1080\/01621459.2017.1294076","article-title":"Using standard tools from finite population sampling to improve causal inference for complex experiments","volume":"113","author":"Mukerjee","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","first-page":"465","article-title":"On the application of probability theory to agricultural experiments. Essay on principles (with discussion). Section 9 (translated). Reprinted ed","volume":"5","author":"Neyman","year":"1923","journal-title":"Statistical Science"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1037\/1082-989X.2.2.173","article-title":"Statistical analysis and optimal design for cluster randomized trials","volume":"2","author":"Raudenbush","year":"1997","journal-title":"Psychological Methods"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1146\/annurev-statistics-031219-041205","article-title":"Randomized experiments in education, with implications for multilevel causal inference","volume":"7","author":"Raudenbush","year":"2020","journal-title":"Annual Review of Statistics and its Application"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"219","DOI":"10.3102\/1076998611432176","article-title":"Estimators for clustered education RCTs using the Neyman model for causal inference","volume":"38","author":"Schochet","year":"2013","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"32","DOI":"10.3102\/1076998619855350","article-title":"Analyzing grouped administrative data for RCTs using design-based methods","volume":"45","author":"Schochet","year":"2020","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"2023022501100761500_","article-title":"Design-based ratio estimators and central limit theorems for clustered, blocked RCTs","author":"Schochet","year":"2021","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1198\/016214507000000897","article-title":"Randomization inference in a group\u2013randomized trial of treatments for depression: Covariate adjustment, noncompliance, and quantile effects","volume":"103","author":"Small","year":"2008","journal-title":"Journal of the American Statistical Association"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"907","DOI":"10.2105\/AJPH.2017.303706","article-title":"Review of recent methodological developments in group-randomized trials: Part 1\u2014design","volume":"107","author":"Turner","year":"2017","journal-title":"American Journal of Public Health"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.2105\/AJPH.2017.303707","article-title":"Review of recent methodological developments in group-randomized trials: Part 2\u2014analysis","volume":"107","author":"Turner","year":"2017","journal-title":"American Journal of Public Health"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"817","DOI":"10.2307\/1912934","article-title":"A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity","volume":"48","author":"White","year":"1980","journal-title":"Econometrica"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1111\/j.1541-0420.2011.01622.x","article-title":"A powerful and robust test statistic for randomization inference in group-randomized trials with matched pairs of groups","volume":"68","author":"Zhang","year":"2012","journal-title":"Biometrics"},{"key":"2023022501100761500_","doi-asserted-by":"crossref","DOI":"10.1016\/j.jeconom.2021.04.007","article-title":"Covariate-adjusted Fisher randomization tests for the average treatment effect","author":"Zhao","year":"2021","journal-title":"Journal of Econometrics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12468","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12468","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/5\/994\/49321564\/jrsssb_83_5_994.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/5\/994\/49321564\/jrsssb_83_5_994.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T11:13:02Z","timestamp":1699441982000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/83\/5\/994\/7056098"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,6]]},"references-count":51,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,9,6]]},"published-print":{"date-parts":[[2021,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12468","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,11]]},"published":{"date-parts":[[2021,9,6]]}}}