{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T05:02:54Z","timestamp":1773637374040,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC_UU_00002\/2"],"award-info":[{"award-number":["MC_UU_00002\/2"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC_UU_00002\/10"],"award-info":[{"award-number":["MC_UU_00002\/10"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2020,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well developed, the relative efficacy of different approaches in finite-sample settings, as encountered in practice, remains incompletely understood. There is therefore a need for empirical investigations in this area that can offer practical insight and guidance to users. In this paper, we present a large-scale comparison of penalized regression methods. We distinguish between three related goals: prediction, variable selection and variable ranking. Our results span more than 2300 data-generating scenarios, including both synthetic and semisynthetic data (real covariates and simulated responses), allowing us to systematically consider the influence of various factors (sample size, dimensionality, sparsity, signal strength and multicollinearity). We consider several widely used approaches (Lasso, Adaptive Lasso, Elastic Net, Ridge Regression, SCAD, the Dantzig Selector and Stability Selection). We find considerable variation in performance between methods. Our results support a \u201cno panacea\u201d view, with no unambiguous winner across all scenarios or goals, even in this restricted setting where all data align well with the assumptions underlying the methods. The study allows us to make some recommendations as to which approaches may be most (or least) suitable given the goal and some data characteristics. Our empirical results complement existing theory and provide a resource to compare methods across a range of scenarios and metrics.<\/jats:p>","DOI":"10.1007\/s11222-019-09914-9","type":"journal-article","created":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T09:07:27Z","timestamp":1576746447000},"page":"697-719","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking"],"prefix":"10.1007","volume":"30","author":[{"given":"Fan","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sach","family":"Mukherjee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvia","family":"Richardson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5909-692X","authenticated-orcid":false,"given":"Steven M.","family":"Hill","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,12,19]]},"reference":[{"key":"9914_CR1","doi-asserted-by":"publisher","first-page":"1705","DOI":"10.1214\/08-AOS620","volume":"37","author":"PJ Bickel","year":"2009","unstructured":"Bickel, P.J., Ritov, Y., Tsybakov, A.B.: Simultaneous analysis of Lasso and Dantzig selector. Ann. Stat. 37, 1705\u20131732 (2009)","journal-title":"Ann. Stat."},{"key":"9914_CR2","doi-asserted-by":"publisher","first-page":"1610","DOI":"10.1080\/01621459.2012.716344","volume":"107","author":"HD Bondell","year":"2012","unstructured":"Bondell, H.D., Reich, B.J.: Consistent high-dimensional Bayesian variable selection via penalized credible regions. J. Am. Stat. Assoc. 107, 1610\u20131624 (2012)","journal-title":"J. Am. Stat. Assoc."},{"key":"9914_CR3","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1214\/10-AOAS388","volume":"5","author":"P Breheny","year":"2011","unstructured":"Breheny, P., Huang, J.: Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection. Ann. Appl. Stat. 5, 232\u2013253 (2011)","journal-title":"Ann. Appl. Stat."},{"key":"9914_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20192-9","volume-title":"Statistics for High-Dimensional Data: Methods, Theory and Applications","author":"P B\u00fchlmann","year":"2011","unstructured":"B\u00fchlmann, P., van de Geer, S.: Statistics for High-Dimensional Data: Methods, Theory and Applications, 1st edn. Springer, Berlin (2011)","edition":"1"},{"key":"9914_CR5","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1007\/s00180-013-0436-3","volume":"29","author":"P B\u00fchlmann","year":"2014","unstructured":"B\u00fchlmann, P., Mandozzi, J.: High-dimensional variable screening and bias in subsequent inference, with an empirical comparison. Comput. Stat. 29, 407\u2013430 (2014)","journal-title":"Comput. Stat."},{"key":"9914_CR6","doi-asserted-by":"publisher","first-page":"2313","DOI":"10.1214\/009053606000001523","volume":"35","author":"E Candes","year":"2007","unstructured":"Candes, E., Tao, T.: The Dantzig selector: statistical estimation when $$p$$ is much larger than $$n$$. Ann. Stat. 35, 2313\u20132351 (2007)","journal-title":"Ann. Stat."},{"key":"9914_CR7","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1214\/12-BA716","volume":"7","author":"G Celeux","year":"2012","unstructured":"Celeux, G., Anbari, M.E., Marin, J.M., Robert, C.P.: Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation. Bayesian Anal. 7, 477\u2013502 (2012)","journal-title":"Bayesian Anal."},{"key":"9914_CR8","doi-asserted-by":"publisher","first-page":"2358","DOI":"10.1214\/009053607000000433","volume":"35","author":"B Efron","year":"2007","unstructured":"Efron, B., Hastie, T., Tibshirani, R.: Discussion: The Dantzig selector: statistical estimation when $$p$$ is much larger than $$n$$. Ann. Stat. 35, 2358\u20132364 (2007)","journal-title":"Ann. Stat."},{"key":"9914_CR9","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.1198\/016214501753382273","volume":"96","author":"J Fan","year":"2001","unstructured":"Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 96, 1348\u20131360 (2001)","journal-title":"J. Am. Stat. Assoc."},{"key":"9914_CR10","first-page":"101","volume":"20","author":"J Fan","year":"2010","unstructured":"Fan, J., Lv, J.: A selective overview of variable selection in high dimensional feature space. Stat. Sin. 20, 101\u2013148 (2010)","journal-title":"Stat. Sin."},{"key":"9914_CR11","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1214\/009053604000000256","volume":"32","author":"J Fan","year":"2004","unstructured":"Fan, J., Peng, H., et al.: Nonconcave penalized likelihood with a diverging number of parameters. Ann. Stat. 32, 928\u2013961 (2004)","journal-title":"Ann. Stat."},{"key":"9914_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v033.i01","volume":"33","author":"JH Friedman","year":"2010","unstructured":"Friedman, J.H., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33, 1\u201322 (2010)","journal-title":"J. Stat. Softw."},{"key":"9914_CR13","unstructured":"Hastie, T., Tibshirani, R., Tibshirani, R.J.: Extended Comparisons of Best Subset Selection, Forward Stepwise Selection, and the Lasso (2017). arXiv preprint arXiv:1707.08692"},{"key":"9914_CR14","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1080\/00401706.1970.10488634","volume":"12","author":"AE Hoerl","year":"1970","unstructured":"Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55\u201367 (1970)","journal-title":"Technometrics"},{"key":"9914_CR15","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1111\/j.1467-9868.2008.00668.x","volume":"71","author":"GM James","year":"2009","unstructured":"James, G.M., Radchenko, P., Lv, J.: DASSO: connections between the Dantzig selector and Lasso. J. R. Stat. Soc. Ser. B 71, 127\u2013142 (2009)","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"9914_CR16","first-page":"553","volume":"16","author":"X Li","year":"2015","unstructured":"Li, X., Zhao, T., Yuan, X., Liu, H.: The flare package for high dimensional linear regression and precision matrix estimation in R. J. Mach. Learn. Res. 16, 553\u2013557 (2015)","journal-title":"J. Mach. Learn. Res."},{"key":"9914_CR17","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1080\/10618600.2015.1020159","volume":"25","author":"C Lim","year":"2016","unstructured":"Lim, C., Yu, B.: Estimation stability with cross-validation (ESCV). J. Comput. Graph. Stat. 25, 464\u2013492 (2016)","journal-title":"J. Comput. Graph. Stat."},{"key":"9914_CR18","doi-asserted-by":"publisher","first-page":"1436","DOI":"10.1214\/009053606000000281","volume":"34","author":"N Meinshausen","year":"2006","unstructured":"Meinshausen, N., B\u00fchlmann, P.: High-dimensional graphs and variable selection with the lasso. Ann. Stat. 34, 1436\u20131462 (2006)","journal-title":"Ann. Stat."},{"key":"9914_CR19","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","volume":"72","author":"N Meinshausen","year":"2010","unstructured":"Meinshausen, N., B\u00fchlmann, P.: Stability selection. J. R. Stat. Soc. Ser. B 72, 417\u2013473 (2010)","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"9914_CR20","doi-asserted-by":"publisher","first-page":"2373","DOI":"10.1214\/009053607000000460","volume":"35","author":"N Meinshausen","year":"2007","unstructured":"Meinshausen, N., Rocha, G., Yu, B.: Discussion: a tale of three cousins: Lasso, L2 Boosting and Dantzig. Ann. Stat. 35, 2373\u20132384 (2007)","journal-title":"Ann. Stat."},{"key":"9914_CR21","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.2019.1624294","author":"K Perrakis","year":"2019","unstructured":"Perrakis, K., Mukherjee, S.: The Alzheimer\u2019s Disease Neuroimaging Initiative: Scalable Bayesian regression in high dimensions with multiple data sources. J. Comput. Graph. Stat. Adv. (2019). https:\/\/doi.org\/10.1080\/10618600.2019.1624294","journal-title":"J. Comput. Graph. Stat. Adv."},{"key":"9914_CR22","unstructured":"R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2018)"},{"key":"9914_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v062.i05","volume":"62","author":"M Sill","year":"2014","unstructured":"Sill, M., Hielscher, T., Becker, N., Zucknick, M.: c060: extended inference with lasso and elastic-net regularized cox and generalized linear models. J. Stat. Softw. 62, 1\u201322 (2014)","journal-title":"J. Stat. Softw."},{"key":"9914_CR24","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1038\/nature10166","volume":"474","author":"The Cancer Genome Atlas Research Network","year":"2011","unstructured":"The Cancer Genome Atlas Research Network: Integrated genomic analyses of ovarian carcinoma. Nature 474, 609\u2013615 (2011)","journal-title":"Nature"},{"key":"9914_CR25","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani, R.: Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. 58, 267\u2013288 (1996)","journal-title":"J. R. Stat. Soc."},{"key":"9914_CR26","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/j.1467-9868.2005.00490.x","volume":"67","author":"R Tibshirani","year":"2005","unstructured":"Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., Knight, K.: Sparsity and smoothness via the fused lasso. J. R. Stat. Soc. Ser. B 67, 91\u2013108 (2005)","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"9914_CR27","doi-asserted-by":"publisher","first-page":"3280","DOI":"10.1158\/1078-0432.CCR-14-0445","volume":"20","author":"SL Tucker","year":"2014","unstructured":"Tucker, S.L., Gharpure, K., Herbrich, S.M., Unruh, A.K., Nick, A.M., Crane, E.K., Coleman, R.L., Guenthoer, J., Dalton, H.J., Wu, S.Y., Rupaimoole, R., Lopez-Berestein, G., Ozpolat, B., Ivan, C., Hu, W., Baggerly, K.A., Sood, A.K.: Molecular biomarkers of residual disease after surgical debulking of high-grade serous ovarian cancer. Clin. Cancer Res. 20, 3280\u20133288 (2014)","journal-title":"Clin. Cancer Res."},{"key":"9914_CR28","doi-asserted-by":"publisher","first-page":"2183","DOI":"10.1109\/TIT.2009.2016018","volume":"55","author":"MJ Wainwright","year":"2009","unstructured":"Wainwright, M.J.: Sharp thresholds for high-dimensional and noisy sparsity recovery using L1-constrained quadratic programming (Lasso). IEEE Trans. Inf. Theory 55, 2183\u20132202 (2009)","journal-title":"IEEE Trans. Inf. Theory"},{"key":"9914_CR29","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","volume":"68","author":"M Yuan","year":"2006","unstructured":"Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B 68, 49\u201367 (2006)","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"9914_CR30","doi-asserted-by":"publisher","first-page":"1567","DOI":"10.1214\/07-AOS520","volume":"36","author":"CH Zhang","year":"2008","unstructured":"Zhang, C.H., Huang, J.: The sparsity and bias of the Lasso selection in high-dimensional linear regression. Ann. Stat. 36, 1567\u20131594 (2008)","journal-title":"Ann. Stat."},{"key":"9914_CR31","first-page":"2541","volume":"7","author":"P Zhao","year":"2006","unstructured":"Zhao, P., Yu, B.: On model selection consistency of lasso. J. Mach. Learn. Res. 7, 2541\u20132563 (2006)","journal-title":"J. Mach. Learn. Res."},{"key":"9914_CR32","doi-asserted-by":"publisher","first-page":"3133","DOI":"10.1198\/016214506000000735","volume":"101","author":"H Zou","year":"2006","unstructured":"Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101, 3133\u20133164 (2006)","journal-title":"J. Am. Stat. Assoc."},{"key":"9914_CR33","first-page":"468","volume":"72","author":"H Zou","year":"2010","unstructured":"Zou, H.: Discussion of \u201cStability selection\u201d by Nicolai Meinshausen and Peter Buhlmann. J. R. Stat. Soc. Ser. B 72, 468 (2010)","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"9914_CR34","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"H Zou","year":"2005","unstructured":"Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B 67, 301\u2013320 (2005)","journal-title":"J. R. Stat. Soc. Ser. B"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-019-09914-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11222-019-09914-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-019-09914-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,28]],"date-time":"2024-07-28T22:11:51Z","timestamp":1722204711000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11222-019-09914-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,19]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,5]]}},"alternative-id":["9914"],"URL":"https:\/\/doi.org\/10.1007\/s11222-019-09914-9","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,19]]},"assertion":[{"value":"27 July 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}