{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T17:39:51Z","timestamp":1787161191323,"version":"build-2736575974"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T00:00:00Z","timestamp":1700006400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12171477"],"award-info":[{"award-number":["12171477"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12225113"],"award-info":[{"award-number":["12225113"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12271331"],"award-info":[{"award-number":["12271331"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72192832"],"award-info":[{"award-number":["72192832"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["Z190002"],"award-info":[{"award-number":["Z190002"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Program for Innovative Research Team of Shanghai University of Finance and Economics"},{"name":"Public Computing Cloud"},{"DOI":"10.13039\/501100004260","name":"Renmin University of China","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004260","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>Testing independence between high-dimensional random vectors is fundamentally different from testing independence between univariate random variables. Taking the projection correlation as an example, it suffers from at least three problems. First, it has a high computational complexity of O{n3(p+q)}, where n, p and q are the sample size and dimensions of the random vectors; this limits its usefulness substantially when n is extremely large. Second, the asymptotic null distribution of the projection correlation test is rarely tractable; therefore, random permutations are often suggested as a means of approximating the asymptotic null distribution, which further increases the complexity of implementing independence tests. Third, the power performance of the projection correlation test deteriorates in high dimensions. To address these issues, the projection correlation is improved by using a modified weight function, which reduces the complexity to O{n2(p+q)}. We estimate the improved projection correlation with U-statistic theory. Importantly, its asymptotic null distribution is standard normal, thanks to the high dimesnionality of the random vectors. This expedites the implementation of independence tests substantially. To enhance the power performance in high dimensions, we propose incorporating a cross-validation procedure with feature screening into the projection correlation test. The implementation efficacy and power enhancement are confirmed through extensive numerical studies.<\/jats:p>","DOI":"10.1093\/biomet\/asad070","type":"journal-article","created":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T00:56:57Z","timestamp":1699923417000},"page":"1013-1027","source":"Crossref","is-referenced-by-count":16,"title":["Projective independence tests in high dimensions: the curses and the cures"],"prefix":"10.1093","volume":"111","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8926-9791","authenticated-orcid":false,"given":"Yaowu","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information Management and Engineering, Shanghai University of Finance and Economics , 318 Wuchuan Road , Shanghai 200433, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liping","family":"Zhu","sequence":"additional","affiliation":[{"name":"Institute of Statistics and Big Data, Renmin University of China , 59 Zhongguancun Street , Beijing 100872, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,11,15]]},"reference":[{"key":"2024090418515226500_asad070-B1","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1090\/S0002-9947-1950-0051437-7","article-title":"Theory of reproducing kernels","volume":"68","author":"Aronszajn","year":"1950","journal-title":"Trans. Am. Math. Soc"},{"key":"2024090418515226500_asad070-B2","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1093\/biomet\/asz024","article-title":"Nonparametric independence testing via mutual information","volume":"106","author":"Berrett","year":"2019","journal-title":"Biometrika"},{"key":"2024090418515226500_asad070-B3","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1214\/aoms\/1177705055","article-title":"Distribution free tests of independence based on the sample distribution function","volume":"32","author":"Blum","year":"1961","journal-title":"Ann. Math. Statist."},{"key":"2024090418515226500_asad070-B4","doi-asserted-by":"crossref","first-page":"5455","DOI":"10.1214\/21-EJS1889","article-title":"A new framework for distance and kernel-based metrics in high dimensions","volume":"15","author":"Chakraborty","year":"2021","journal-title":"Electron. J. Statist."},{"key":"2024090418515226500_asad070-B5","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1214\/09-AOS716","article-title":"A two-sample test for high-dimensional data with applications to gene-set testing","volume":"38","author":"Chen","year":"2010","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B6","volume-title":"Elements of Information Theory","author":"Cover","year":"2012"},{"key":"2024090418515226500_asad070-B7","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1080\/01621459.2021.1923508","article-title":"Multivariate rank-based distribution-free nonparametric testing using measure transportation","volume":"118","author":"Deb","year":"2023","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B8","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/j.1467-9868.2011.01005.x","article-title":"Variance estimation using refitted cross-validation in ultrahigh dimensional regression","volume":"74","author":"Fan","year":"2012","journal-title":"J. R. Statist. Soc. B"},{"key":"2024090418515226500_asad070-B9","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2024090418515226500_asad070-B10","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1214\/20-AOS2024","article-title":"Asymptotic distributions of high-dimensional distance correlation inference","volume":"49","author":"Gao","year":"2021","journal-title":"Ann. Statist"},{"key":"2024090418515226500_asad070-B11","first-page":"585","volume-title":"Proc. 21st Ann. Conf. Neural Information Processing Systems (NIPS 2007).","author":"Gretton","year":"2008"},{"key":"2024090418515226500_asad070-B12","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1214\/aoms\/1177704004","article-title":"Probability integrals of multivariate normal and multivariate t1","volume":"34","author":"Gupta","year":"1963","journal-title":"Ann. Math. Statist."},{"key":"2024090418515226500_asad070-B13","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1214\/aoms\/1177730150","article-title":"A non-parametric test of independence","volume":"19","author":"Hoeffding","year":"1948","journal-title":"Ann. Math. Statist."},{"key":"2024090418515226500_asad070-B14","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1080\/00401706.2015.1054435","article-title":"Fast computing for distance covariance","volume":"58","author":"Huo","year":"2016","journal-title":"Technometrics"},{"key":"2024090418515226500_asad070-B15","doi-asserted-by":"crossref","first-page":"3417","DOI":"10.1214\/19-AOS1936","article-title":"Robust multivariate nonparametric tests via projection averaging","volume":"48","author":"Kim","year":"2020","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B16","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1080\/01621459.2012.695654","article-title":"Feature screening via distance correlation learning","volume":"107","author":"Li","year":"2012","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B17","first-page":"6020","author":"Li","year":"2020"},{"key":"2024090418515226500_asad070-B18","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1080\/01621459.2018.1554485","article-title":"Cauchy combination test: A powerful test with analytic p-value calculation under arbitrary dependency structures","volume":"115","author":"Liu","year":"2020","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B19","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1198\/jasa.2009.tm08647","article-title":"p-Values for high-dimensional regression","volume":"104","author":"Meinshausen","year":"2009","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B20","first-page":"289","article-title":"IX. On the problem of the most efficient tests of statistical hypotheses","volume":"231","author":"Neyman","year":"1933","journal-title":"Phil. Trans. R. Soc. A"},{"key":"2024090418515226500_asad070-B21","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v29i1.9692","article-title":"On the decreasing power of kernel and distance based nonparametric hypothesis tests in high dimensions","author":"Ramdas","year":"2015","journal-title":"In Proc. 29th AAAI Conf. Artificial Intelligence (AAAI\u201915). Washington, DC: AAAI Press, pp. 3571\u20137"},{"key":"2024090418515226500_asad070-B22","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.1214\/13-AOS1140","article-title":"Equivalence of distance-based and RKHS-based statistics in hypothesis testing","volume":"41","author":"Sejdinovic","year":"2013","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B23","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1080\/01621459.2014.887012","article-title":"Martingale difference correlation and its use in high-dimensional variable screening","volume":"109","author":"Shao","year":"2014","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B24","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1080\/01621459.2020.1782223","article-title":"Distribution-free consistent independence tests via center-outward ranks and signs","volume":"117","author":"Shi","year":"2022","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B25","doi-asserted-by":"crossref","first-page":"2769","DOI":"10.1214\/009053607000000505","article-title":"Measuring and testing dependence by correlation of distances","volume":"35","author":"Sz\u00e9kely","year":"2007","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B26","first-page":"405","article-title":"A central limit theorem for non stationary mixing processes","volume":"30","author":"Voln\u1ef3","year":"1989","journal-title":"Commentationes Mathematicae Universitatis Carolinae"},{"key":"2024090418515226500_asad070-B27","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1093\/biomet\/asaa027","article-title":"Combining p-values via averaging","volume":"107","author":"Vovk","year":"2020","journal-title":"Biometrika"},{"key":"2024090418515226500_asad070-B28","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1073\/pnas.1814092116","article-title":"The harmonic mean p-value for combining dependent tests","volume":"116","author":"Wilson","year":"2019","journal-title":"Proc. Nat. Acad. Sci"},{"key":"2024090418515226500_asad070-B29","first-page":"417","article-title":"Power analysis of projection-pursuit independence tests","volume":"32","author":"Xu","year":"2022","journal-title":"Statist. Sinica"},{"key":"2024090418515226500_asad070-B30","doi-asserted-by":"crossref","first-page":"9956","DOI":"10.1073\/pnas.1715593115","article-title":"Jackknife approach to the estimation of mutual information","volume":"115","author":"Zeng","year":"2018","journal-title":"Proc. Nat. Acad. Sci"},{"key":"2024090418515226500_asad070-B31","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1080\/01621459.2019.1604366","article-title":"A simple two-sample test in high dimensions based on L2-norm","volume":"115","author":"Zhang","year":"2020","journal-title":"J. Am. Statist. Assoc"},{"key":"2024090418515226500_asad070-B32","first-page":"1971","article-title":"A lack-of-fit test with screening in sufficient dimension reduction","volume":"30","author":"Zhang","year":"2020","journal-title":"Statist. Sinica"},{"key":"2024090418515226500_asad070-B33","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1214\/17-AOS1548","article-title":"Conditional mean and quantile dependence testing in high dimension","volume":"46","author":"Zhang","year":"2018","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B34","doi-asserted-by":"crossref","first-page":"3366","DOI":"10.1214\/19-AOS1934","article-title":"Distance-based and RKHS-based dependence metrics in high dimension","volume":"48","author":"Zhu","year":"2020","journal-title":"Ann. Statist."},{"key":"2024090418515226500_asad070-B35","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1093\/biomet\/asx043","article-title":"Projection correlation between two random vectors","volume":"104","author":"Zhu","year":"2017","journal-title":"Biometrika"},{"key":"2024090418515226500_asad070-B36","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1198\/jasa.2011.tm10563","article-title":"Model-free feature screening for ultrahigh-dimensional data","volume":"106","author":"Zhu","year":"2011","journal-title":"J. Am. Statist. Assoc"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asad070\/56414962\/asad070.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/111\/3\/1013\/59021290\/asad070.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/111\/3\/1013\/59021290\/asad070.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T07:28:06Z","timestamp":1725521286000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/111\/3\/1013\/7421912"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,15]]},"references-count":36,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,11,15]]},"published-print":{"date-parts":[[2024,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asad070","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,9,1]]},"published":{"date-parts":[[2023,11,15]]}}}