{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T21:19:53Z","timestamp":1778793593688,"version":"3.51.4"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T00:00:00Z","timestamp":1764115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,2,13]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>Randomization tests rely on simple data transformations and possess an appealing robustness property. In addition to being finite-sample valid if the data distribution is invariant under the transformation, these tests can be asymptotically valid under a suitable studentization of the test statistic, even if the invariance does not hold. However, practical implementation often encounters noisy data, resulting in approximate randomization tests that may not be as robust. In this paper, one key theoretical contribution is a nonasymptotic bound on the discrepancy between the size of an approximate randomization test and the size of the idealized randomization test using noiseless data. This allows us to derive novel conditions for the validity of approximate randomization tests under data invariances, while being able to use existing results based on studentization if the invariance does not hold. We illustrate our theory through several examples, including significance tests in linear regression. These examples clarify key aspects of how randomization tests behave in small samples and address limitations of prior theoretical results.<\/jats:p>","DOI":"10.1093\/biomet\/asaf085","type":"journal-article","created":{"date-parts":[[2025,11,25]],"date-time":"2025-11-25T12:51:36Z","timestamp":1764075096000},"source":"Crossref","is-referenced-by-count":0,"title":["Asymptotic validity and finite-sample properties of approximate randomization tests"],"prefix":"10.1093","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0061-9984","authenticated-orcid":false,"given":"Panos","family":"Toulis","sequence":"first","affiliation":[{"name":"Booth School of Business, University of Chicago , 5807 South Woodlawn Avenue. Chicago , Illinois 60637, panos.toulis@chicagobooth.edu","place":["U.S.A."]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,11,26]]},"reference":[{"key":"2026051120021162100_asaf085-B1","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1093\/biomet\/asy072","article-title":"Randomization tests of causal effects under interference","volume":"106","author":"Basse","year":"2019","journal-title":"Biometrika"},{"key":"2026051120021162100_asaf085-B2","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.1214\/aos\/1176345637","article-title":"Some asymptotic theory for the bootstrap","volume":"9","author":"Bickel","year":"1981","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B3","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.3982\/ECTA13081","article-title":"Randomization tests under an approximate symmetry assumption","volume":"85","author":"Canay","year":"2017","journal-title":"Econometrica"},{"key":"2026051120021162100_asaf085-B4","doi-asserted-by":"crossref","first-page":"1849","DOI":"10.1080\/01621459.2021.1920957","article-title":"An exact and robust conformal inference method for counterfactual and synthetic controls","volume":"116","author":"Chernozhukov","year":"2021","journal-title":"J. Am. Statist. Assoc"},{"key":"2026051120021162100_asaf085-B5","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1214\/13-AOS1090","article-title":"Exact and asymptotically robust permutation tests","volume":"41","author":"Chung","year":"2013","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B6","doi-asserted-by":"crossref","DOI":"10.1201\/b14832","volume-title":"Theoretical Statistics","author":"Cox","year":"1979"},{"key":"2026051120021162100_asaf085-B7","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.jeconom.2008.08.003","article-title":"The wild bootstrap, tamed at last","volume":"146","author":"Davidson","year":"2008","journal-title":"J. Economet"},{"key":"2026051120021162100_asaf085-B8","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1080\/01621459.2016.1202117","article-title":"Robust permutation tests for correlation and regression coefficients","volume":"112","author":"DiCiccio","year":"2017","journal-title":"J. Am. Statist. Assoc"},{"key":"2026051120021162100_asaf085-B9","author":"Dobriban","year":"2021"},{"key":"2026051120021162100_asaf085-B10","doi-asserted-by":"crossref","DOI":"10.1214\/cbms\/1462061029","volume-title":"Group Invariance Applications in Statistics","author":"Eaton","year":"1989"},{"key":"2026051120021162100_asaf085-B11","doi-asserted-by":"crossref","DOI":"10.1201\/9781420011814","volume-title":"Randomization Tests","author":"Edgington","year":"2007"},{"key":"2026051120021162100_asaf085-B12","volume-title":"Appl. Math","author":"Embrechts","year":"2013"},{"key":"2026051120021162100_asaf085-B13","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1214\/088342304000000396","article-title":"Permutation methods: a basis for exact inference","volume":"19","author":"Ernst","year":"2004","journal-title":"Statist. Sci."},{"key":"2026051120021162100_asaf085-B14","volume-title":"The Design of Experiments","author":"Fisher","year":"1935"},{"key":"2026051120021162100_asaf085-B15","doi-asserted-by":"crossref","first-page":"2196","DOI":"10.1111\/biom.13741","article-title":"Testing weak nulls in matched observational studies","volume":"79","author":"Fogarty","year":"2023","journal-title":"Biometrics"},{"key":"2026051120021162100_asaf085-B16","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1214\/aos\/1176345638","article-title":"Bootstrapping regression models","volume":"9","author":"Freedman","year":"1981","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B17","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1080\/07350015.1983.10509354","article-title":"A nonstochastic interpretation of reported significance levels","volume":"1","author":"Freedman","year":"1983","journal-title":"J. Bus. Econ. Statist"},{"key":"2026051120021162100_asaf085-B18","first-page":"185","volume-title":"A Festschrift for Eric L. Lehmannn","author":"Freedman","year":"1983"},{"key":"2026051120021162100_asaf085-B19","volume-title":"Field Experiments: Design, Analysis, and Interpretation","author":"Gerber","year":"2012"},{"key":"2026051120021162100_asaf085-B20","volume-title":"Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses","author":"Good","year":"2013"},{"key":"2026051120021162100_asaf085-B21","author":"Guo","year":"2023"},{"key":"2026051120021162100_asaf085-B22","volume-title":"Design and Analysis of Experiments: Introduction to Experimental Design","author":"Hinkelmann","year":"2007"},{"key":"2026051120021162100_asaf085-B23","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1214\/aoms\/1177729436","article-title":"The large-sample power of tests based on permutations of observations","volume":"23","author":"Hoeffding","year":"1952","journal-title":"Ann. Math. Statist."},{"key":"2026051120021162100_asaf085-B24","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1214\/aos\/1176342503","article-title":"Robust regression: asymptotics, conjectures and Monte Carlo","volume":"1","author":"Huber","year":"1973","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B25","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal Inference in Statistics, Social, and Biomedical Sciences","author":"Imbens","year":"2015"},{"key":"2026051120021162100_asaf085-B26","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/S0167-7152(97)00043-6","article-title":"Studentized permutation tests for non-i.i.d. hypotheses and the generalized Behrens--Fisher problem","volume":"36","author":"Janssen","year":"1997","journal-title":"Statist. Prob. Lett"},{"key":"2026051120021162100_asaf085-B27","first-page":"320","article-title":"Nonparametric symmetry tests for statistical functionals","volume":"8","author":"Janssen","year":"1999","journal-title":"Math. Meth. Statist"},{"key":"2026051120021162100_asaf085-B28","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1093\/biomet\/asad050","article-title":"More efficient exact group invariance testing: using a representative subgroup","volume":"111","author":"Koning","year":"2024","journal-title":"Biometrika"},{"key":"2026051120021162100_asaf085-B29","volume-title":"Testing Statistical Hypotheses","author":"Lehmann","year":"2005"},{"key":"2026051120021162100_asaf085-B30","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1093\/biomet\/asaa079","article-title":"An assumption-free exact test for fixed-design linear models with exchangeable errors","volume":"108","author":"Lei","year":"2021","journal-title":"Biometrika"},{"key":"2026051120021162100_asaf085-B31","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1093\/biomet\/asaa103","article-title":"Regression adjustment in completely randomized experiments with a diverging number of covariates","volume":"108","author":"Lei","year":"2021","journal-title":"Biometrika"},{"key":"2026051120021162100_asaf085-B32","doi-asserted-by":"crossref","first-page":"1696","DOI":"10.1214\/aos\/1176351062","article-title":"Bootstrap procedures under some non-i.i.d. models","volume":"16","author":"Liu","year":"1988","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B33","author":"Lopes","year":"2014"},{"key":"2026051120021162100_asaf085-B34","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1214\/aos\/1176349025","article-title":"Bootstrap and wild bootstrap for high dimensional linear models","volume":"21","author":"Mammen","year":"1993","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B35","doi-asserted-by":"crossref","first-page":"119","DOI":"10.2307\/2984124","article-title":"Significance tests which may be applied to samples from any populations","volume":"4","author":"Pitman","year":"1937","journal-title":"Suppl. J. R. Statist. Soc"},{"key":"2026051120021162100_asaf085-B36","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1111\/rssb.12478","article-title":"A graph-theoretic approach to randomization tests of causal effects under general interference","volume":"84","author":"Puelz","year":"2022","journal-title":"J. R. Statist. Soc. B"},{"key":"2026051120021162100_asaf085-B37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1214\/aos\/1176347007","article-title":"Bootstrap and randomization tests of some nonparametric hypotheses","volume":"17","author":"Romano","year":"1989","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-1-4757-3692-2","volume-title":"Observational Studies","author":"Rosenbaum","year":"2002"},{"key":"2026051120021162100_asaf085-B39","first-page":"591","article-title":"Randomization analysis of experimental data: the Fisher randomization test comment","volume":"75","author":"Rubin","year":"1980","journal-title":"J. Am. Statist. Assoc"},{"key":"2026051120021162100_asaf085-B40","author":"Toulis","year":"2024"},{"key":"2026051120021162100_asaf085-B41","doi-asserted-by":"crossref","DOI":"10.1007\/b13794","volume-title":"Introduction to Nonparametric Estimation","author":"Tsybakov","year":"2009"},{"key":"2026051120021162100_asaf085-B42","author":"Wang","year":"2021"},{"key":"2026051120021162100_asaf085-B43","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1214\/24-AOS2479","article-title":"Residual permutation test for regression coefficient testing","volume":"53","author":"Wen","year":"2025","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B44","volume-title":"Econometric Analysis of Cross Section and Panel Data","author":"Wooldridge","year":"2010"},{"key":"2026051120021162100_asaf085-B45","first-page":"1261","article-title":"Jackknife, bootstrap and other resampling methods in regression analysis","volume":"14","author":"Wu","year":"1986","journal-title":"Ann. Statist."},{"key":"2026051120021162100_asaf085-B46","doi-asserted-by":"crossref","first-page":"1898","DOI":"10.1080\/01621459.2020.1750415","article-title":"Randomization tests for weak null hypotheses in randomized experiments","volume":"116","author":"Wu","year":"2021","journal-title":"J. Am. Statist. Assoc"},{"key":"2026051120021162100_asaf085-B47","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.jeconom.2021.04.007","article-title":"Covariate-adjusted Fisher randomization tests for the average treatment effect","volume":"225","author":"Zhao","year":"2021","journal-title":"J. Economet"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asaf085\/65551953\/asaf085.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/113\/2\/asaf085\/65551953\/asaf085.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/113\/2\/asaf085\/65551953\/asaf085.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T00:02:22Z","timestamp":1778544142000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/doi\/10.1093\/biomet\/asaf085\/8343535"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,26]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,2,13]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asaf085","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026]]},"published":{"date-parts":[[2025,11,26]]},"article-number":"asaf085"}}