{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T07:20:11Z","timestamp":1791616811846,"version":"4.3.4"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":3413,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-0955316"],"award-info":[{"award-number":["DMS-0955316"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1150318"],"award-info":[{"award-number":["DMS-1150318"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-0806030"],"award-info":[{"award-number":["DMS-0806030"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-0906784"],"award-info":[{"award-number":["DMS-0906784"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"University of Southern California's James H. Zumberge Faculty Research and Innovation Fund"},{"DOI":"10.13039\/100006034","name":"University of Southern California","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006034","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>High dimensional sparse modelling via regularization provides a powerful tool for analysing large-scale data sets and obtaining meaningful interpretable models. The use of non-convex penalty functions shows advantage in selecting important features in high dimensions, but the global optimality of such methods still demands more understanding. We consider sparse regression with a hard thresholding penalty, which we show to give rise to thresholded regression. This approach is motivated by its close connection with L0-regularization, which can be unrealistic to implement in practice but of appealing sampling properties, and its computational advantage. Under some mild regularity conditions allowing possibly exponentially growing dimensionality, we establish the oracle inequalities of the resulting regularized estimator, as the global minimizer, under various prediction and variable selection losses, as well as the oracle risk inequalities of the hard thresholded estimator followed by further L2-regularization. The risk properties exhibit interesting shrinkage effects under both estimation and prediction losses. We identify the optimal choice of the ridge parameter, which is shown to have simultaneous advantages to both the L2-loss and the prediction loss. These new results and phenomena are evidenced by simulation and real data examples.<\/jats:p>","DOI":"10.1111\/rssb.12037","type":"journal-article","created":{"date-parts":[[2013,11,7]],"date-time":"2013-11-07T05:18:43Z","timestamp":1383801523000},"page":"627-649","source":"Crossref","is-referenced-by-count":51,"title":["High Dimensional Thresholded Regression and Shrinkage Effect"],"prefix":"10.1093","volume":"76","author":[{"given":"Zemin","family":"Zheng","sequence":"first","affiliation":[{"name":"University of Southern California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingying","family":"Fan","sequence":"additional","affiliation":[{"name":"University of Southern California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinchi","family":"Lv","sequence":"additional","affiliation":[{"name":"University of Southern California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2013,11,7]]},"reference":[{"key":"2023031400061877100_","first-page":"313","article-title":"Smoothing noisy data with tapered coiflets series","volume":"23","author":"Antoniadis","year":"1996","journal-title":"Scand. J. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1198\/016214501753208942","article-title":"Regularization of wavelet approximations (with discussion)","volume":"96","author":"Antoniadis","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s004400050210","article-title":"Risk bounds for model selection via penalization","volume":"113","author":"Barron","year":"1999","journal-title":"Probab. Theor. Reltd Flds"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1214\/08-AOS620","article-title":"Simultaneous analysis of Lasso and Dantzig selector","volume":"37","author":"Bickel","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1214\/07-EJS008","article-title":"Sparsity oracle inequalities for the Lasso","volume":"1","author":"Bunea","year":"2007","journal-title":"Electron. J. Statist."},{"key":"2023031400061877100_","first-page":"2313","article-title":"The Dantzig selector: statistical estimation when p is much larger than n (with discussion)","volume":"35","author":"Cand\u00e8s","year":"2007","journal-title":"Ann. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"2197","DOI":"10.1073\/pnas.0437847100","article-title":"Optimally sparse representation in general (nonorthogonal) dictionaries via l1 minimization","volume":"100","author":"Donoho","year":"2003","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1214\/009053604000000067","article-title":"Least angle regression (with discussion)","volume":"32","author":"Efron","year":"2004","journal-title":"Ann. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"5467","DOI":"10.1109\/TIT.2011.2158486","article-title":"Nonconcave penalized likelihood with NP-dimensionality","volume":"57","author":"Fan","year":"2011","journal-title":"IEEE Trans. Inform. Theor."},{"key":"2023031400061877100_","first-page":"109","volume-title":"Technometrics","author":"Frank","year":"1993"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1214\/07-AOAS131","article-title":"Pathwise coordinate optimization","volume":"1","author":"Friedman","year":"2007","journal-title":"Ann. Appl. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1214\/11-EJS624","article-title":"The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso)","volume":"5","author":"van de Geer","year":"2011","journal-title":"Electron. J. Statist."},{"key":"2023031400061877100_","first-page":"361","volume-title":"In Proc. 4th Berkeley Symp. Mathematical Statistics and Probability","author":"James","year":"1961"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1080\/01621459.2012.746068","article-title":"High-dimensional sparse additive hazards regression","volume":"108","author":"Lin","year":"2013","journal-title":"J. Am. Statist. Ass."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"3498","DOI":"10.1214\/09-AOS683","article-title":"A unified approach to model selection and sparse recovery using regularized least squares","volume":"37","author":"Lv","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031400061877100_","first-page":"197","volume-title":"In Proc. 3rd Berkeley Symp. Mathematical Statistics and Probability","author":"Stein","year":"1956"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1214\/07-AOAS147","article-title":"Coordinate descent algorithms for Lasso penalized regression","volume":"2","author":"Wu","year":"2008","journal-title":"Ann. Appl. Statist."},{"key":"2023031400061877100_","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"Ann. Statist."},{"key":"2023031400061877100_","first-page":"1509","article-title":"One-step sparse estimates in nonconcave penalized likelihood models (with discussion)","volume":"36","author":"Zou","year":"2008","journal-title":"Ann. Statist."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12037","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/76\/3\/627\/49507858\/jrsssb_76_3_627.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/76\/3\/627\/49507858\/jrsssb_76_3_627.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,19]],"date-time":"2024-05-19T07:49:46Z","timestamp":1716104986000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/76\/3\/627\/7076025"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,11,7]]},"references-count":21,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2013,11,7]]},"published-print":{"date-parts":[[2014,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12037","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2014,6]]},"published":{"date-parts":[[2013,11,7]]}}}