{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T09:40:58Z","timestamp":1791538858306,"version":"4.3.4"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":1222,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>We propose a general new method, the conditional permutation test, for testing the conditional independence of variables X and Y given a potentially high dimensional random vector Z that may contain confounding factors. The test permutes entries of X non-uniformly, to respect the existing dependence between X and Z and thus to account for the presence of these confounders. Like the conditional randomization test of Cand\u00e8s and co-workers in 2018, our test relies on the availability of an approximation to the distribution of X|Z\u2014whereas their test uses this estimate to draw new X-values, for our test we use this approximation to design an appropriate non-uniform distribution on permutations of the X-values already seen in the true data. We provide an efficient Markov chain Monte Carlo sampler for the implementation of our method and establish bounds on the type I error in terms of the error in the approximation of the conditional distribution of X|Z, finding that, for the worst-case test statistic, the inflation in type I error of the conditional permutation test is no larger than that of the conditional randomization test. We validate these theoretical results with experiments on simulated data and on the Capital Bikeshare data set.<\/jats:p>","DOI":"10.1111\/rssb.12340","type":"journal-article","created":{"date-parts":[[2019,10,21]],"date-time":"2019-10-21T05:37:26Z","timestamp":1571636246000},"page":"175-197","source":"Crossref","is-referenced-by-count":84,"title":["The Conditional Permutation Test for Independence While Controlling for Confounders"],"prefix":"10.1093","volume":"82","author":[{"given":"Thomas B.","family":"Berrett","sequence":"first","affiliation":[{"name":"University of Cambridge \u00a0 UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Chicago \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rina Foygel","family":"Barber","sequence":"additional","affiliation":[{"name":"University of Chicago \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard J.","family":"Samworth","sequence":"additional","affiliation":[{"name":"University of Cambridge \u00a0 UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,10,21]]},"reference":[{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1080\/01621459.2016.1241178","article-title":"Exact p-values for network interference","volume":"113","author":"Athey","year":"2018","journal-title":"J. Am. Statist. Ass."},{"issue":"no. 1","key":"2023022408362603200_","doi-asserted-by":"crossref","DOI":"10.1002\/sta4.225","article-title":"On the construction of knockoffs in case\u2013control studies","volume":"8","author":"Barber","year":"2019","journal-title":"Stat."},{"key":"2023022408362603200_","volume-title":"Robust inference with knockoffs. Ann. Statist.","author":"Barber","year":"2019"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1093\/restud\/rdt044","article-title":"Inference on treatment effects after selection among high-dimensional controls","volume":"81","author":"Belloni","year":"2014","journal-title":"Rev. Econ. Stud."},{"key":"2023022408362603200_","volume-title":"Testing conditional independence for continuous random variables","author":"Bergsma","year":"2004"},{"key":"2023022408362603200_","volume-title":"Nonparametric independence testing via mutual information. Biometrika","author":"Berrett","year":"2019"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1111\/rssb.12265","article-title":"Panning for gold: \u2018model-X\u2019 knockoffs for high dimensional controlled variable selection","volume":"80","author":"Cand\u00e8s","year":"2018","journal-title":"J. R. Statist. Soc. B"},{"key":"2023022408362603200_","volume-title":"Elements of Information Theory","author":"Cover","year":"2012"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1979.tb01052.x","article-title":"Conditional independence in statistical theory (with discussion)","volume":"41","author":"Dawid","year":"1979","journal-title":"J. R. Statist. Soc. B"},{"key":"2023022408362603200_","first-page":"132","article-title":"A permutation-based kernel conditional independence test","volume":"30","author":"Doran","year":"2014","journal-title":"Uncertnty Artif. Intell."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1214\/088342304000000396","article-title":"Permutation methods: a basis for exact inference","volume":"19","author":"Ernst","year":"2004","journal-title":"Statist. Sci."},{"key":"2023022408362603200_","first-page":"489","article-title":"Kernel measures of conditional dependence","volume":"20","author":"Fukumizu","year":"2008","journal-title":"Adv. Neurl Inform. Process. Syst."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/11564089_7","volume-title":"Proc. 16th Int. Conf. Algorithmic Learning Theory","author":"Gretton","year":"2005"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1515\/jci-2015-0018","article-title":"A conditional randomization test to account for covariate imbalance in randomized experiments","volume":"4","author":"Hennessy","year":"2016","journal-title":"J. Causl Inf."},{"key":"2023022408362603200_","volume-title":"Measures of dependence between random vectors and tests of independence: literature review","author":"Josse","year":"2013"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1016\/j.jmva.2008.10.013","article-title":"Tests of independence among continuous random vectors based on Cram\u00e9r\u2013von Mises functionals of the empirical copula process","volume":"100","author":"Kojadinovic","year":"2009","journal-title":"J. Multiv. Anal."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1111\/rssb.12235","article-title":"Kernel-based tests for joint independence","volume":"80","author":"Pfister","year":"2018","journal-title":"J. R. Statist. Soc. B"},{"key":"2023022408362603200_","volume-title":"Permutation tests of non-exchangeable null models","author":"Roach","year":"2018"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1080\/01621459.1984.10478082","article-title":"Conditional permutation tests and the propensity score in observational studies","volume":"79","author":"Rosenbaum","year":"1984","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408362603200_","first-page":"938","article-title":"Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information","author":"Runge","year":"2018","journal-title":"Proc. 21st Int. Conf. Artificial Intelligence and Statistics"},{"key":"2023022408362603200_","first-page":"2955","article-title":"Model-powered conditional independence test","volume":"31","author":"Sen","year":"2017","journal-title":"Adv. Neurl Inform. Process Syst."},{"key":"2023022408362603200_","volume-title":"The hardness of conditional independence testing and the generalised covariance measure. Ann. Statist.","author":"Shah","year":"2019"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"4011","DOI":"10.1214\/09-AOS704","article-title":"Testing conditional independence via Rosenblatt transforms","volume":"37","author":"Song","year":"2009","journal-title":"Ann. Statist."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/ss\/1177012580","article-title":"Francis Galton\u2019s account of the invention of correlation","volume":"4","author":"Stigler","year":"1989","journal-title":"Statist. Sci."},{"issue":"no. 1","key":"2023022408362603200_","article-title":"Approximate kernel-based conditional independence tests for fast non-parametric causal discovery","volume":"7","author":"Strobl","year":"2019","journal-title":"J. Causl Inf."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1016\/j.jeconom.2006.11.006","article-title":"A consistent characteristic function-based test for conditional independence","volume":"141","author":"Su","year":"2007","journal-title":"J. Econmetr."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1017\/S0266466608080341","article-title":"A nonparametric Hellinger metric test for conditional independence","volume":"24","author":"Su","year":"2008","journal-title":"Econmetr. Theory"},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.jeconom.2014.04.006","article-title":"Testing conditional independence via empirical likelihood","volume":"182","author":"Su","year":"2014","journal-title":"J. Econmetr."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"2382","DOI":"10.1214\/14-AOS1255","article-title":"Partial distance correlation with methods for dissimilarities","volume":"42","author":"Sz\u00e9kely","year":"2014","journal-title":"Ann. Statist."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"2769","DOI":"10.1214\/009053607000000505","article-title":"Measuring and testing dependence by correlation of distances","volume":"35","author":"Sz\u00e9kely","year":"2007","journal-title":"Ann. Statist."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1111\/j.1467-9469.2011.00744.x","article-title":"Estimation of a conditional copula and association measures","volume":"38","author":"Veraverbeke","year":"2011","journal-title":"Scand. J. Statist."},{"key":"2023022408362603200_","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1093\/biomet\/asy021","article-title":"Symmetric rank covariances: a generalised framework for nonparametric measures of dependence","volume":"105","author":"Weihs","year":"2018","journal-title":"Biometrika"},{"key":"2023022408362603200_","first-page":"804","article-title":"Kernel-based conditional independence test and application in causal discovery","volume":"27","author":"Zhang","year":"2011","journal-title":"Uncertnty Artif. Intell."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12340","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/1\/175\/49320569\/jrsssb_82_1_175.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/1\/175\/49320569\/jrsssb_82_1_175.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T05:06:20Z","timestamp":1721883980000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/82\/1\/175\/7056014"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,21]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,10,21]]},"published-print":{"date-parts":[[2020,2,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12340","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,2]]},"published":{"date-parts":[[2019,10,21]]}}}