{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T17:26:40Z","timestamp":1789838800396,"version":"4.0.1"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Modern high-dimensional methods often adopt the \u2018bet on sparsity\u2019 principle, while in supervised multivariate learning statisticians may face \u2018dense\u2019 problems with a large number of nonzero coefficients. This paper proposes a novel clustered reduced-rank learning (CRL) framework that imposes two joint matrix regularizations to automatically group the features in constructing predictive factors. CRL is more interpretable than low-rank modelling and relaxes the stringent sparsity assumption in variable selection. In this paper, new information-theoretical limits are presented to reveal the intrinsic cost of seeking for clusters, as well as the blessing from dimensionality in multivariate learning. Moreover, an efficient optimization algorithm is developed, which performs subspace learning and clustering with guaranteed convergence. The obtained fixed-point estimators, although not necessarily globally optimal, enjoy the desired statistical accuracy beyond the standard likelihood setup under some regularity conditions. Moreover, a new kind of information criterion, as well as its scale-free form, is proposed for cluster and rank selection, and has a rigorous theoretical support without assuming an infinite sample size. Extensive simulations and real-data experiments demonstrate the statistical accuracy and interpretability of the proposed method.<\/jats:p>","DOI":"10.1111\/rssb.12492","type":"journal-article","created":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T01:15:29Z","timestamp":1646270129000},"page":"912-932","source":"Crossref","is-referenced-by-count":3,"title":["Supervised Multivariate Learning with Simultaneous Feature Auto-Grouping and Dimension Reduction"],"prefix":"10.1093","volume":"84","author":[{"given":"Yiyuan","family":"She","sequence":"first","affiliation":[{"name":"Department of Statistics, Florida State University , Tallahassee , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiahui","family":"Shen","sequence":"additional","affiliation":[{"name":"Department of Statistics, Florida State University , Tallahassee , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Center for Information Science, Peking University , Beijing , China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,3,2]]},"reference":[{"key":"2023022408354654200_","volume-title":"Categorical data analysis","author":"Agresti","year":"2012"},{"key":"2023022408354654200_","volume-title":"Fast and provably good seedings for K-means","author":"Bachem","year":"2016"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1214\/08-AOS620","article-title":"Simultaneous analysis of Lasso and Dantzig selector","volume":"37","author":"Bickel","year":"2009","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/0041-5553(67)90040-7","article-title":"The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming","volume":"7","author":"Bregman","year":"1967","journal-title":"USSR Computational Mathematics and Mathematical Physics"},{"key":"2023022408354654200_","volume-title":"Classification and regression trees","author":"Breiman","year":"1984"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"1282","DOI":"10.1214\/11-AOS876","article-title":"Optimal selection of reduced rank estimators of high-dimensional matrices","volume":"39","author":"Bunea","year":"2011","journal-title":"The Annals of Statistics"},{"issue":"4","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"2342","DOI":"10.1109\/TIT.2011.2111771","article-title":"Tight oracle bounds for low-rank matrix recovery from a minimal number of random measurements","volume":"57","author":"Cand\u00e8s","year":"2011","journal-title":"IEEE Transactions on Information Theory"},{"issue":"6","key":"2023022408354654200_","first-page":"2313","article-title":"The Dantzig selector: satistical estimation when p is much larger than n","volume":"35","author":"Cand\u00e8s","year":"2007","journal-title":"The Annals of Statistics"},{"issue":"4","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1080\/10618600.2014.948181","article-title":"Splitting methods for convex clustering","volume":"24","author":"Chi","year":"2015","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"1","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/j.1467-9868.2009.00723.x","article-title":"Sparse partial least squares regression for simultaneous dimension reduction and variable selection","volume":"72","author":"Chun","year":"2010","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"3","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1093\/biomet\/81.3.425","article-title":"Ideal spatial adaptation by wavelet shrinkage","volume":"81","author":"Donoho","year":"1994","journal-title":"Biometrika"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/21-EJP606","article-title":"Concentration inequalities for polynomials in \u03b1-sub-exponential random variables","volume":"26","author":"G\u00f6tze","year":"2021","journal-title":"Electronic Journal of Probability"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning","author":"Hastie","year":"2009"},{"issue":"2","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/0047-259X(75)90042-1","article-title":"Reduced-rank regression for the multivariate linear model","volume":"5","author":"Izenman","year":"1975","journal-title":"Journal of Multivariate Analysis"},{"issue":"486","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1198\/jasa.2009.0121","article-title":"On consistency and sparsity for principal components analysis in high dimensions","volume":"104","author":"Johnstone","year":"2009","journal-title":"Journal of the American Statistical Association"},{"issue":"5","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"2302","DOI":"10.1214\/11-AOS894","article-title":"Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion","volume":"39","author":"Koltchinskii","year":"2011","journal-title":"The Annals of Statistics"},{"issue":"1","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1038\/msb.2010.104","article-title":"Defining the budding yeast chromatin-associated interactome","volume":"6","author":"Lambert","year":"2010","journal-title":"Molecular Systems Biology"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"2164","DOI":"10.1214\/11-AOS896","article-title":"Oracle inequalities and optimal inference under group sparsity","volume":"39","author":"Lounici","year":"2011","journal-title":"The Annals of Statistics"},{"issue":"22","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"8364","DOI":"10.1128\/MCB.20.22.8364-8372.2000","article-title":"Sok2 regulates yeast pseudohyphal differentiation via a transcription factor cascade that regulates cell-cell adhesion","volume":"20","author":"Pan","year":"2000","journal-title":"Molecular and Cellular Biology"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","DOI":"10.1017\/9780511982170","volume-title":"Codes, cryptology and curves with computer algebra","author":"Pellikaan","year":"2017"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1214\/10-EJS578","article-title":"Sparse regression with exact clustering","volume":"4","author":"She","year":"2010","journal-title":"Electronic Journal of Statistics"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1111\/rssb.12295","article-title":"On cross-validation for sparse reduced rank regression","volume":"81","author":"She","year":"2019","journal-title":"Journal of the Royal Statistical Society: Series B"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1109\/TNSE.2019.2893383","article-title":"Indirect Gaussian graph learning beyond Gaussianity","volume":"7","author":"She","year":"2020","journal-title":"IEEE Transactions on Network Science and Engineering"},{"issue":"6","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1214\/21-AOS2090","article-title":"Analysis of generalized Bregman surrogate algorithms for nonsmooth nonconvex statistical learning","volume":"49","author":"She","year":"2021","journal-title":"The Annals of Statistics"},{"issue":"1","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1467-9868.2005.00490.x","article-title":"Sparsity and smoothness via the fused LASSO","volume":"67","author":"Tibshirani","year":"2005","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-2545-2","volume-title":"Weak convergence and empirical processes: with applications to statistics","author":"van der Vaart","year":"1996"},{"issue":"1","key":"2023022408354654200_","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","article-title":"Model selection and estimation in regression with grouped variables","volume":"68","author":"Yuan","year":"2006","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022408354654200_","doi-asserted-by":"crossref","DOI":"10.1109\/WKDD.2009.210","volume-title":"K-means clustering algorithm with improved initial center","author":"Zhang","year":"2009"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12492","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12492","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/84\/3\/912\/49322459\/jrsssb_84_3_912.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/84\/3\/912\/49322459\/jrsssb_84_3_912.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T09:32:21Z","timestamp":1700299941000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/84\/3\/912\/7056153"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,2]]},"references-count":28,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3,2]]},"published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12492","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7]]},"published":{"date-parts":[[2022,3,2]]}}}