{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T19:17:06Z","timestamp":1793128626650,"version":"4.5.0"},"reference-count":35,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T00:00:00Z","timestamp":1680048000000},"content-version":"vor","delay-in-days":5150,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-9971405"],"award-info":[{"award-number":["DMS-9971405"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["N01-HV-28183"],"award-info":[{"award-number":["N01-HV-28183"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>We propose covariance-regularized regression, a family of methods for prediction in high dimensional settings that uses a shrunken estimate of the inverse covariance matrix of the features to achieve superior prediction. An estimate of the inverse covariance matrix is obtained by maximizing the log-likelihood of the data, under a multivariate normal model, subject to a penalty; it is then used to estimate coefficients for the regression of the response onto the features. We show that ridge regression, the lasso and the elastic net are special cases of covariance-regularized regression, and we demonstrate that certain previously unexplored forms of covariance-regularized regression can outperform existing methods in a range of situations. The covariance-regularized regression framework is extended to generalized linear models and linear discriminant analysis, and is used to analyse gene expression data sets with multiple class and survival outcomes.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2009.00699.x","type":"journal-article","created":{"date-parts":[[2009,2,20]],"date-time":"2009-02-20T09:39:47Z","timestamp":1235122787000},"page":"615-636","source":"Crossref","is-referenced-by-count":172,"title":["Covariance-Regularized Regression and Classification for high Dimensional Problems"],"prefix":"10.1093","volume":"71","author":[{"given":"Daniela M.","family":"Witten","sequence":"first","affiliation":[{"name":"Stanford University , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Tibshirani","sequence":"additional","affiliation":[{"name":"Stanford University , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2009,2,20]]},"reference":[{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1371\/journal.pbio.0020108","article-title":"Semi-supervised methods to predict patient survival from gene expression data","volume":"2","author":"Bair","year":"2004","journal-title":"PLOS Biol."},{"key":"2023033000105762400_","first-page":"485","article-title":"Model selection through sparse maximum likelihood estimation for multivariate gaussian or binary data","volume":"9","author":"Banerjee","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","DOI":"10.1214\/08-AOS600","article-title":"Covariance regularization by thresholding","author":"Bickel","year":"2008","journal-title":"Ann. Statist."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1214\/aos\/1176349756","article-title":"Estimation of a covariance matrix under Stein\u2019s loss","volume":"13","author":"Dey","year":"1985","journal-title":"Ann. Statist."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1080\/00401706.1993.10485033","article-title":"A statistical view of some chemometrics regression tools (with discussion)","volume":"35","author":"Frank","year":"1993","journal-title":"Technometrics"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1080\/01621459.1989.10478752","article-title":"Regularized discriminant analysis","volume":"84","author":"Friedman","year":"1989","journal-title":"J. Am. Statist. Ass."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1093\/biostatistics\/kxm045","article-title":"Sparse inverse covariance estimation with the graphical lasso","volume":"9","author":"Friedman","year":"2007","journal-title":"Biostatistics"},{"key":"2023033000105762400_","volume-title":"Regularization paths for generalized linear models via coordinate descent","author":"Friedman","year":"2008"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1111\/j.2517-6161.1984.tb01288.x","article-title":"Iteratively reweighted least squares for maximum likelihood estimation, and some robust and resistant alternatives","volume":"46","author":"Green","year":"1984","journal-title":"J. R. Statist. Soc. B"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1093\/biostatistics\/kxj035","article-title":"Regularized linear discriminant analysis and its application in microarrays","volume":"8","author":"Guo","year":"2007","journal-title":"Biostatistics"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1214\/aos\/1176344845","article-title":"Estimation of the inverse covariance matrix: random mixtures of the inverse Wishart matrix and the identity","volume":"7","author":"Haff","year":"1979","journal-title":"Ann. Statist."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neur. Computn"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1080\/00401706.1970.10488634","article-title":"Ridge regression: biased estimation for nonorthogonal problems","volume":"12","author":"Hoerl","year":"1970","journal-title":"Technometrics"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1056\/NEJMoa055351","article-title":"A biological definition of Burkitt\u2019s lymphoma from transcriptional and genomic profiling","volume":"354","author":"Hummel","year":"2006","journal-title":"New Engl. J. Med."},{"key":"2023033000105762400_","first-page":"361","volume-title":"Proc. 4th Berkeley Symp. Mathematics and Statistical Probability","author":"James","year":"1961"},{"key":"2023033000105762400_","volume-title":"The Statistical Analysis of Failure Time Data","author":"Kalbfleisch","year":"1980"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1214\/088342307000000032","article-title":"The use of unlabeled data in predictive modeling","volume":"22","author":"Liang","year":"2007","journal-title":"Statist. Sci."},{"key":"2023033000105762400_","volume-title":"Multivariate Analysis","author":"Mardia","year":"1979"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","DOI":"10.1002\/0471725293","volume-title":"Discriminant Analysis and Statistical Pattern Recognition","author":"McLachlan","year":"1992"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1214\/009053606000000281","article-title":"High dimensional graphs and variable selection with the lasso","volume":"34","author":"Meinshausen","year":"2006","journal-title":"Ann. Statist."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1851","DOI":"10.1182\/blood-2004-07-2947","article-title":"Molecular profiling of diffuse large B-cell lymphoma identifies robust subtypes including one characterized by host inflammatory response","volume":"105","author":"Monti","year":"2005","journal-title":"Blood"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1080\/01621459.1978.10480106","article-title":"Normal discrimination with unclassified observations","volume":"73","author":"O\u2019Neill","year":"1978","journal-title":"J. Am. Statist. Ass."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1111\/j.1467-9868.2007.00607.x","article-title":"L1-regularization path algorithm for generalized linear models","volume":"69","author":"Park","year":"2007","journal-title":"J. R. Statist. Soc. B"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"15149","DOI":"10.1073\/pnas.211566398","article-title":"Multiclass cancer diagnosis using tumor gene expression signature","volume":"98","author":"Ramaswamy","year":"2001","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1056\/NEJMoa012914","article-title":"The use of molecular profiling to predict survival after chemotherapy for diffuse large B-cell lymphoma","volume":"346","author":"Rosenwald","year":"2002","journal-title":"New Engl. J. Med."},{"key":"2023033000105762400_","first-page":"494","article-title":"Sparse permutation invariant covariance estimation","volume":"2","author":"Rothman","year":"2008","journal-title":"Electr. J. Statist."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1038\/nm0102-68","article-title":"Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning","volume":"8","author":"Shipp","year":"2002","journal-title":"Nat. Med."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"6567","DOI":"10.1073\/pnas.082099299","article-title":"Diagnosis of multiple cancer types by shrunken centroids of gene expression","volume":"99","author":"Tibshirani","year":"2002","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1214\/ss\/1056397488","article-title":"Class prediction by nearest shrunken centroids, with applications to DNA microarrays","volume":"18","author":"Tibshirani","year":"2003","journal-title":"Statist. Sci."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"5116","DOI":"10.1073\/pnas.091062498","article-title":"Significance analysis of microarrays applied to the ionizing radiation response","volume":"98","author":"Tusher","year":"2001","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023033000105762400_","first-page":"2541","article-title":"On model selection consistency of lasso","volume":"7","author":"Zhao","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1093\/biostatistics\/kxg046","article-title":"Classification of gene microarrays by penalized logistic regression","volume":"5","author":"Zhu","year":"2004","journal-title":"Biostatistics"},{"key":"2023033000105762400_","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Statist. Soc. B"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2009.00699.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/3\/615\/49686350\/jrsssb_71_3_615.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/3\/615\/49686350\/jrsssb_71_3_615.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T20:47:11Z","timestamp":1738961231000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/71\/3\/615\/7092917"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2,20]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2009,2,20]]},"published-print":{"date-parts":[[2009,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2009.00699.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2009,6]]},"published":{"date-parts":[[2009,2,20]]}}}