{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T20:49:32Z","timestamp":1790196572148,"version":"4.1.0"},"reference-count":89,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2024,9,18]],"date-time":"2024-09-18T00:00:00Z","timestamp":1726617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"publisher","award":["EP\/N031938\/1"],"award-info":[{"award-number":["EP\/N031938\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"publisher","award":["EP\/R013381\/1"],"award-info":[{"award-number":["EP\/R013381\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,2,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Many testing problems are readily amenable to randomized tests, such as those employing data splitting. However, despite their usefulness in principle, randomized tests have obvious drawbacks. Firstly, two analyses of the same dataset may lead to different results. Secondly, the test typically loses power because it does not fully utilize the entire sample. As a remedy to these drawbacks, we study how to combine the test statistics or p-values resulting from multiple random realizations, such as through random data splits. We develop rank-transformed subsampling as a general method for delivering large-sample inference about the combined statistic or p-value under mild assumptions. We apply our methodology to a wide range of problems, including testing unimodality in high-dimensional data, testing goodness-of-fit of parametric quantile regression models, testing no direct effect in a sequentially randomized trial and calibrating cross-fit double machine learning confidence intervals. In contrast to existing p-value aggregation schemes that can be highly conservative, our method enjoys Type I error control that asymptotically approaches the nominal level. Moreover, compared to using the ordinary subsampling, we show that our rank transform can remove the first-order bias in approximating the null under alternatives and greatly improve power.<\/jats:p>","DOI":"10.1093\/jrsssb\/qkae091","type":"journal-article","created":{"date-parts":[[2024,9,18]],"date-time":"2024-09-18T02:39:19Z","timestamp":1726627159000},"page":"256-286","source":"Crossref","is-referenced-by-count":10,"title":["Rank-transformed subsampling: inference for multiple data splitting and exchangeable <i>p<\/i>-values"],"prefix":"10.1093","volume":"87","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2081-7398","authenticated-orcid":false,"given":"F Richard","family":"Guo","sequence":"first","affiliation":[{"name":"Department of Statistics, University of Michigan, Ann Arbor , Michigan ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9073-3782","authenticated-orcid":false,"given":"Rajen D","family":"Shah","sequence":"additional","affiliation":[{"name":"Statistical Laboratory, University of Cambridge , Cambridge ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,9,18]]},"reference":[{"key":"2025021015260655900_qkae091-B1","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.patcog.2018.10.026","article-title":"To cluster, or not to cluster: An analysis of clusterability methods","volume":"88","author":"Adolfsson","year":"2019","journal-title":"Pattern Recognition"},{"issue":"12","key":"2025021015260655900_qkae091-B2","doi-asserted-by":"publisher","first-page":"4462","DOI":"10.1016\/j.csda.2012.02.020","article-title":"Investigating the multimodality of multivariate data with principal curves","volume":"56","author":"Ahmed","year":"2012","journal-title":"Computational Statistics & Data Analysis"},{"issue":"7604","key":"2025021015260655900_qkae091-B3","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","article-title":"1,500 scientists lift the lid on reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"issue":"5","key":"2025021015260655900_qkae091-B4","doi-asserted-by":"publisher","first-page":"2514","DOI":"10.1214\/22-AOS2187","article-title":"Testing goodness-of-fit and conditional independence with approximate co-sufficient sampling","volume":"50","author":"Barber","year":"2022","journal-title":"The Annals of Statistics"},{"key":"2025021015260655900_qkae091-B90","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2201.13451"},{"issue":"4","key":"2025021015260655900_qkae091-B5","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1093\/biomet\/asx053","article-title":"Doubly robust nonparametric inference on the average treatment effect","volume":"104","author":"Benkeser","year":"2017","journal-title":"Biometrika"},{"issue":"3","key":"2025021015260655900_qkae091-B6","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1093\/biomet\/74.3.457","article-title":"Prepivoting to reduce level error of confidence sets","volume":"74","author":"Beran","year":"1987","journal-title":"Biometrika"},{"issue":"403","key":"2025021015260655900_qkae091-B7","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1080\/01621459.1988.10478649","article-title":"Prepivoting test statistics: A bootstrap view of asymptotic refinements","volume":"83","author":"Beran","year":"1988","journal-title":"Journal of the American Statistical Association"},{"issue":"17\u201318","key":"2025021015260655900_qkae091-B8","doi-asserted-by":"publisher","first-page":"1358","DOI":"10.1016\/j.spl.2010.04.018","article-title":"Subsampling p-values","volume":"80","author":"Berg","year":"2010","journal-title":"Statistics & Probability Letters"},{"issue":"1","key":"2025021015260655900_qkae091-B9","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1111\/rssb.12340","article-title":"The conditional permutation test for independence while controlling for confounders","volume":"82","author":"Berrett","year":"2020","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2025021015260655900_qkae091-B10","first-page":"967","article-title":"On the choice of m in the m out of n bootstrap and confidence bounds for extrema","volume":"18","author":"Bickel","year":"2008","journal-title":"Statistica Sinica"},{"issue":"1","key":"2025021015260655900_qkae091-B11","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Machine Learning"},{"issue":"4","key":"2025021015260655900_qkae091-B12","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1214\/aos\/1031689014","article-title":"Analyzing bagging","volume":"30","author":"B\u00fchlmann","year":"2002","journal-title":"The Annals of Statistics"},{"issue":"34","key":"2025021015260655900_qkae091-B13","doi-asserted-by":"publisher","first-page":"e2205518119","DOI":"10.1073\/pnas.2205518119","article-title":"Model-free prediction test with application to genomics data","volume":"119","author":"Cai","year":"2022","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"3","key":"2025021015260655900_qkae091-B14","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1111\/1467-9868\u2018.00141","article-title":"Calibrating the excess mass and dip tests of modality","volume":"60","author":"Cheng","year":"1998","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"2025021015260655900_qkae091-B15","doi-asserted-by":"publisher","first-page":"C1","DOI":"10.1111\/ectj.12097","article-title":"Double\/debiased machine learning for treatment and structural parameters","volume":"21","author":"Chernozhukov","year":"2018","journal-title":"The Econometrics Journal"},{"key":"2025021015260655900_qkae091-B16","doi-asserted-by":"publisher","first-page":"109748","DOI":"10.1016\/j.spl.2022.109748","article-title":"Averaging p-values under exchangeability","volume":"194","author":"Choi","year":"2022","journal-title":"Statistics & Probability Letters"},{"key":"2025021015260655900_qkae091-B17","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.csda.2015.02.016","article-title":"A lack-of-fit test for quantile regression models with high-dimensional covariates","volume":"88","author":"Conde-Amboage","year":"2015","journal-title":"Computational Statistics & Data Analysis"},{"issue":"2","key":"2025021015260655900_qkae091-B18","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1093\/biomet\/62.2.441","article-title":"A note on data-splitting for the evaluation of significance levels","volume":"62","author":"Cox","year":"1975","journal-title":"Biometrika"},{"key":"2025021015260655900_qkae091-B19","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3185742","article-title":"Significance tests of feature relevance for a black-box learner","author":"Dai","year":"2022","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"2025021015260655900_qkae091-B20","volume-title":"Unimodality, convexity, and applications","author":"Dharmadhikari","year":"1988"},{"issue":"2","key":"2025021015260655900_qkae091-B21","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1093\/biostatistics\/kxz042","article-title":"Machine learning in the estimation of causal effects: Targeted minimum loss-based estimation and double\/debiased machine learning","volume":"21","author":"D\u00edaz","year":"2020","journal-title":"Biostatistics"},{"key":"2025021015260655900_qkae091-B22","volume-title":"Hypothesis testing using multiple data splitting","author":"DiCiccio","year":"2018"},{"key":"2025021015260655900_qkae091-B23","doi-asserted-by":"publisher","first-page":"108865","DOI":"10.1016\/j.spl.2020.108865","article-title":"Exact tests via multiple data splitting","volume":"166","author":"DiCiccio","year":"2020","journal-title":"Statistics & Probability Letters"},{"issue":"3","key":"2025021015260655900_qkae091-B24","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1111\/rssb.12321","article-title":"Lack-of-fit tests for quantile regression models","volume":"81","author":"Dong","year":"2019","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"11","key":"2025021015260655900_qkae091-B25","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1109\/TC.1976.1674577","article-title":"On the choice of smoothing parameters for Parzen estimators of probability density functions","volume":"C-25","author":"Duin","year":"1976","journal-title":"IEEE Transactions on Computers"},{"key":"2025021015260655900_qkae091-B26","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.2024.2347338"},{"key":"2025021015260655900_qkae091-B27","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1016\/j.jeconom.2013.07.006","article-title":"Specification analysis of linear quantile models","volume":"178","author":"Escanciano","year":"2014","journal-title":"Journal of Econometrics"},{"issue":"1","key":"2025021015260655900_qkae091-B28","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.jeconom.2010.06.003","article-title":"Specification tests of parametric dynamic conditional quantiles","volume":"159","author":"Escanciano","year":"2010","journal-title":"Journal of Econometrics"},{"issue":"5","key":"2025021015260655900_qkae091-B29","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Annals of Statistics"},{"issue":"369","key":"2025021015260655900_qkae091-B30","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1080\/01621459.1980.10477419","article-title":"Density estimation and bump-hunting by the penalized likelihood method exemplified by scattering and meteorite data","volume":"75","author":"Good","year":"1980","journal-title":"Journal of the American Statistical Association"},{"key":"2025021015260655900_qkae091-B31","author":"Guidoum","year":"2015"},{"key":"2025021015260655900_qkae091-B32","author":"Habbema","year":"1974"},{"issue":"1","key":"2025021015260655900_qkae091-B33","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1214\/aos\/1176346577","article-title":"The dip test of unimodality","volume":"13","author":"Hartigan","year":"1985","journal-title":"The Annals of Statistics"},{"issue":"464","key":"2025021015260655900_qkae091-B34","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1198\/016214503000000963","article-title":"A lack-of-fit test for quantile regression","volume":"98","author":"He","year":"2003","journal-title":"Journal of the American Statistical Association"},{"issue":"4","key":"2025021015260655900_qkae091-B35","doi-asserted-by":"publisher","first-page":"1215","DOI":"10.1111\/biom.v77.4","article-title":"Nonparametric cluster significance testing with reference to a unimodal null distribution","volume":"77","author":"Helgeson","year":"2021","journal-title":"Biometrics"},{"key":"2025021015260655900_qkae091-B36","volume-title":"Causal inference: What if","author":"Hern\u00e1n","year":"2020"},{"issue":"459","key":"2025021015260655900_qkae091-B37","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1198\/016214502388618627","article-title":"An adaptive, rate-optimal test of linearity for median regression models","volume":"97","author":"Horowitz","year":"2002","journal-title":"Journal of the American Statistical Association"},{"key":"2025021015260655900_qkae091-B38","author":"Huang","year":"2015"},{"issue":"4","key":"2025021015260655900_qkae091-B39","doi-asserted-by":"publisher","first-page":"975","DOI":"10.1080\/10618600.2014.948179","article-title":"Statistical significance of clustering using soft thresholding","volume":"24","author":"Huang","year":"2015","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"2025021015260655900_qkae091-B40","author":"Huang","year":"2022"},{"issue":"7793","key":"2025021015260655900_qkae091-B41","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1038\/s41586-020-1969-6","article-title":"Pan-cancer analysis of whole genomes","volume":"578","author":"ICGC\/TCGA Pan-Cancer Analysis of Whole Genomes Consortium","year":"2020","journal-title":"Nature"},{"issue":"8","key":"2025021015260655900_qkae091-B42","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis","year":"2005","journal-title":"PLoS Medicine"},{"issue":"3","key":"2025021015260655900_qkae091-B43","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1111\/rssb.12371","article-title":"Goodness-of-fit testing in high dimensional generalized linear models","volume":"82","author":"Jankov\u00e1","year":"2020","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2025021015260655900_qkae091-B91","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2205.10198"},{"key":"2025021015260655900_qkae091-B44","volume-title":"Probabilistic symmetries and invariance principles","author":"Kallenberg","year":"2005"},{"key":"2025021015260655900_qkae091-B92","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2203.06469"},{"issue":"2","key":"2025021015260655900_qkae091-B45","first-page":"1","article-title":"On unimodal distributions","volume":"2","author":"Khintchine","year":"1938","journal-title":"Izvestiya Nauchno-Issledovatel\u2019skogo Instituta Matematiki i Mekhaniki"},{"issue":"1","key":"2025021015260655900_qkae091-B46","doi-asserted-by":"publisher","first-page":"683","DOI":"10.3150\/23-BEJ1613","article-title":"Dimension-agnostic inference using cross U-statistics","volume":"30","author":"Kim","year":"2024","journal-title":"Bernoulli"},{"key":"2025021015260655900_qkae091-B47","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511754098","volume-title":"Quantile regression","author":"Koenker","year":"2005"},{"key":"2025021015260655900_qkae091-B48","author":"Koenker","year":"2022"},{"key":"2025021015260655900_qkae091-B49","volume-title":"Testing statistical hypotheses","author":"Lehmann","year":"2005","edition":"3rd ed."},{"issue":"523","key":"2025021015260655900_qkae091-B50","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1080\/01621459.2017.1307116","article-title":"Distribution-free predictive inference for regression","volume":"113","author":"Lei","year":"2018","journal-title":"Journal of the American Statistical Association"},{"issue":"71","key":"2025021015260655900_qkae091-B51","first-page":"1","article-title":"Multiple-splitting projection test for high-dimensional mean vectors","volume":"23","author":"Liu","year":"2022","journal-title":"Journal of Machine Learning Research"},{"issue":"483","key":"2025021015260655900_qkae091-B52","doi-asserted-by":"publisher","first-page":"1281","DOI":"10.1198\/016214508000000454","article-title":"Statistical significance of clustering for high-dimension, low\u2013sample size data","volume":"103","author":"Liu","year":"2008","journal-title":"Journal of the American Statistical Association"},{"issue":"529","key":"2025021015260655900_qkae091-B53","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1080\/01621459.2018.1554485","article-title":"Cauchy combination test: A powerful test with analytic p-value calculation under arbitrary dependency structures","volume":"115","author":"Liu","year":"2020","journal-title":"Journal of the American Statistical Association"},{"key":"2025021015260655900_qkae091-B94","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2211.02039"},{"key":"2025021015260655900_qkae091-B54","author":"Maechler","year":"2021"},{"issue":"497","key":"2025021015260655900_qkae091-B55","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1080\/01621459.2011.646935","article-title":"Bootstrapping for significance of compact clusters in multidimensional datasets","volume":"107","author":"Maitra","year":"2012","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2025021015260655900_qkae091-B56","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1111\/insr.2012.80.issue-1","article-title":"Subsampling inference with K populations and a non-standard Behrens\u2013Fisher problem","volume":"80","author":"McMurry","year":"2012","journal-title":"International Statistical Review"},{"issue":"4","key":"2025021015260655900_qkae091-B57","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","article-title":"Stability selection","volume":"72","author":"Meinshausen","year":"2010","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"488","key":"2025021015260655900_qkae091-B58","doi-asserted-by":"publisher","first-page":"1671","DOI":"10.1198\/jasa.2009.tm08647","article-title":"P-values for high-dimensional regression","volume":"104","author":"Meinshausen","year":"2009","journal-title":"Journal of the American Statistical Association"},{"issue":"3","key":"2025021015260655900_qkae091-B59","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1214\/aos\/1176325622","article-title":"Posterior predictive p-values","volume":"22","author":"Meng","year":"1994","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2025021015260655900_qkae091-B60","first-page":"329","article-title":"Dividing a sample into two parts a statistical dilemma","volume":"35","author":"Moran","year":"1973","journal-title":"Sankhy\u0101: The Indian Journal of Statistics, Series A"},{"issue":"2","key":"2025021015260655900_qkae091-B61","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1093\/ije\/dyw323","article-title":"An introduction to g methods","volume":"46","author":"Naimi","year":"2017","journal-title":"International Journal of Epidemiology"},{"key":"2025021015260655900_qkae091-B95","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1801.09138"},{"issue":"6251","key":"2025021015260655900_qkae091-B62","doi-asserted-by":"publisher","first-page":"aac4716","DOI":"10.1126\/science.aac4716","article-title":"Estimating the reproducibility of psychological science","volume":"349","author":"Open Science Collaboration","year":"2015","journal-title":"Science"},{"issue":"4","key":"2025021015260655900_qkae091-B63","doi-asserted-by":"publisher","first-page":"2031","DOI":"10.1214\/aos\/1176325770","article-title":"Large sample confidence regions based on subsamples under minimal assumptions","volume":"22","author":"Politis","year":"1994","journal-title":"The Annals of Statistics"},{"key":"2025021015260655900_qkae091-B64","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-1554-7","volume-title":"Subsampling","author":"Politis","year":"1999"},{"issue":"1","key":"2025021015260655900_qkae091-B65","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1214\/22-AOS2253","article-title":"Nested Markov properties for acyclic directed mixed graphs","volume":"51","author":"Richardson","year":"2023","journal-title":"The Annals of Statistics"},{"issue":"9-12","key":"2025021015260655900_qkae091-B66","doi-asserted-by":"publisher","first-page":"1393","DOI":"10.1016\/0270-0255(86)90088-6","article-title":"A new approach to causal inference in mortality studies with a sustained exposure period\u2014application to control of the healthy worker survivor effect","volume":"7","author":"Robins","year":"1986","journal-title":"Mathematical Modelling"},{"key":"2025021015260655900_qkae091-B67","doi-asserted-by":"publisher","author":"Robins","year":"1999","DOI":"10.7551\/mitpress\/2006.003.0017"},{"key":"2025021015260655900_qkae091-B68","author":"Romano","year":"2019"},{"issue":"1","key":"2025021015260655900_qkae091-B69","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1093\/biomet\/asaa054","article-title":"Characterization of parameters with a mixed bias property","volume":"108","author":"Rotnitzky","year":"2021","journal-title":"Biometrika"},{"issue":"3","key":"2025021015260655900_qkae091-B70","doi-asserted-by":"publisher","first-page":"623","DOI":"10.2307\/1426677","article-title":"Random variables with maximum sums","volume":"14","author":"R\u00fcschendorf","year":"1982","journal-title":"Advances in Applied Probability"},{"key":"2025021015260655900_qkae091-B71"},{"issue":"1","key":"2025021015260655900_qkae091-B72","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1111\/rssb.12234","article-title":"Goodness-of-fit tests for high dimensional linear models","volume":"80","author":"Shah","year":"2018","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"2025021015260655900_qkae091-B73","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1111\/j.1467-9868.2011.01034.x","article-title":"Variable selection with error control: Another look at stability selection","volume":"75","author":"Shah","year":"2013","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"2","key":"2025021015260655900_qkae091-B74","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1016\/S0378-3758(00)00115-4","article-title":"Improving predictive inference under covariate shift by weighting the log-likelihood function","volume":"90","author":"Shimodaira","year":"2000","journal-title":"Journal of Statistical Planning and Inference"},{"key":"2025021015260655900_qkae091-B75","doi-asserted-by":"publisher","first-page":"109395","DOI":"10.1016\/j.spl.2022.109395","article-title":"Multi split conformal prediction","volume":"184","author":"Solari","year":"2022","journal-title":"Statistics & Probability Letters"},{"issue":"1","key":"2025021015260655900_qkae091-B76","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1080\/10618600.2021.1923520","article-title":"The holdout randomization test for feature selection in black box models","volume":"31","author":"Tansey","year":"2022","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"3","key":"2025021015260655900_qkae091-B77","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1093\/jrsssb\/qkad018","article-title":"Statistical testing under distributional shifts","volume":"85","author":"Thams","year":"2023","journal-title":"Journal of the Royal Statistical Society Series B: Statistical Methodology"},{"key":"2025021015260655900_qkae091-B78","doi-asserted-by":"publisher","DOI":"10.1111\/sjos.12614"},{"key":"2025021015260655900_qkae091-B79","volume-title":"Asymptotic statistics","author":"van der Vaart","year":"2000"},{"key":"2025021015260655900_qkae091-B80","author":"Vassilvitskii","year":"2006"},{"issue":"4","key":"2025021015260655900_qkae091-B81","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1093\/biomet\/asaa027","article-title":"Combining p-values via averaging","volume":"107","author":"Vovk","year":"2020","journal-title":"Biometrika"},{"issue":"3","key":"2025021015260655900_qkae091-B82","doi-asserted-by":"publisher","first-page":"1736","DOI":"10.1214\/20-AOS2020","article-title":"E-values: Calibration, combination and applications","volume":"49","author":"Vovk","year":"2021","journal-title":"The Annals of Statistics"},{"issue":"543","key":"2025021015260655900_qkae091-B83","doi-asserted-by":"publisher","first-page":"1645","DOI":"10.1080\/01621459.2021.2003200","article-title":"A general framework for inference on algorithm-agnostic variable importance","volume":"118","author":"Williamson","year":"2023","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2025021015260655900_qkae091-B84","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v077.i01","article-title":"ranger: A fast implementation of random forests for high dimensional data in C++ and R","volume":"77","author":"Wright","year":"2017","journal-title":"Journal of Statistical Software"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/87\/1\/256\/59160848\/qkae091.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/87\/1\/256\/59160848\/qkae091.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T15:26:21Z","timestamp":1739201181000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/87\/1\/256\/7759731"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,18]]},"references-count":89,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,9,18]]},"published-print":{"date-parts":[[2025,2,10]]}},"URL":"https:\/\/doi.org\/10.1093\/jrsssb\/qkae091","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,2]]},"published":{"date-parts":[[2024,9,18]]}}}