{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T21:51:40Z","timestamp":1791323500535,"version":"4.3.1"},"reference-count":27,"publisher":"Institute of Mathematical Statistics","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2026,8,1]]},"abstract":"<jats:p>We introduce a generic estimator for the false discovery rate of any model selection procedure, in common statistical modeling settings including the Gaussian linear model, Gaussian graphical model, and model-X setting. We prove that our method has a conservative (nonnegative) bias in finite samples under standard statistical assumptions, and provide a bootstrap method for assessing its standard error. For methods like the Lasso, forward-stepwise regression, and the graphical Lasso, our estimator serves as a valuable companion to cross-validation, illuminating the tradeoff between prediction error and variable selection accuracy as a function of the model complexity parameter.<\/jats:p>","DOI":"10.1214\/26-aos2625","type":"journal-article","created":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T08:13:11Z","timestamp":1787040791000},"page":"1793-1818","source":"Crossref","is-referenced-by-count":0,"title":["Estimating the false discovery rate of variable selection"],"prefix":"10.1214","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1844-5799","authenticated-orcid":false,"given":"Yixiang","family":"Luo","sequence":"first","affiliation":[{"name":"Department of Mathematics, University of California, Berkeley"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William","family":"Fithian","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of California, Berkeley"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lihua","family":"Lei","sequence":"additional","affiliation":[{"name":"Graduate School of Business, Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"6","doi-asserted-by":"publisher","unstructured":"<small>Cand\u00e8s, E.<\/small>, <small>Fan, Y.<\/small>, <small>Janson, L.<\/small> and <small>Lv, J.<\/small> (2018). Panning for gold: \u2018model-X\u2019 knockoffs for high dimensional controlled variable selection. <i>J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> <b>80<\/b> 551\u2013577.","DOI":"10.1111\/rssb.12265"},{"key":"16","doi-asserted-by":"publisher","unstructured":"<small>LEI, J.<\/small> (2019). Fast exact conformalization of the lasso using piecewise linear homotopy. <i>Biometrika<\/i> <b>106<\/b> 749\u2013764.","DOI":"10.1093\/biomet\/asz046"},{"key":"21","unstructured":"<small>RHEE, S.-Y.<\/small>, <small>FESSEL, W. J.<\/small>, <small>ZOLOPA, A. R.<\/small>, <small>HURLEY, L.<\/small>, <small>LIU, T.<\/small>, <small>TAYLOR, J.<\/small>, <small>NGUYEN, D. P.<\/small>, <small>SLOME, S.<\/small>, <small>KLEIN, D.<\/small> et al. (2005). HIV-1 protease and reverse-transcriptase mutations: Correlations with antiretroviral therapy in subtype B isolates and implications for drug-resistance surveillance. <i>J. Infect. Dis.<\/i> <b>192<\/b> 456\u2013465."},{"key":"22","doi-asserted-by":"crossref","unstructured":"<small>Rhee, S.-Y.<\/small>, <small>Taylor, J.<\/small>, <small>Wadhera, G.<\/small>, <small>Ben-Hur, A.<\/small>, <small>Brutlag, D. L.<\/small> and <small>Shafer, R. W.<\/small> (2006). Genotypic predictors of human immunodeficiency virus type 1 drug resistance. <i>Proc. Natl. Acad. Sci. USA<\/i> <b>103<\/b> 17355\u201317360.","DOI":"10.1073\/pnas.0607274103"},{"key":"1","doi-asserted-by":"publisher","unstructured":"<small>BARBER, R. F.<\/small> and <small>CAND\u00c8S, E. J.<\/small> (2015). Controlling the false discovery rate via knockoffs. <i>Ann. Statist.<\/i> <b>43<\/b> 2055\u20132085.","DOI":"10.1214\/15-AOS1337"},{"key":"14","doi-asserted-by":"publisher","unstructured":"<small>HUANG, D.<\/small> and <small>JANSON, L.<\/small> (2020). Relaxing the assumptions of knockoffs by conditioning. <i>Ann. Statist.<\/i> <b>48<\/b> 3021\u20133042.","DOI":"10.1214\/19-AOS1920"},{"key":"4","doi-asserted-by":"publisher","unstructured":"<small>BENJAMINI, Y.<\/small> and <small>YEKUTIELI, D.<\/small> (2001). The control of the false discovery rate in multiple testing under dependency. <i>Ann. Statist.<\/i> <b>29<\/b> 1165\u20131188.","DOI":"10.1214\/aos\/1013699998"},{"key":"23","doi-asserted-by":"crossref","unstructured":"<small>SACHS, K.<\/small>, <small>PEREZ, O.<\/small>, <small>PE\u2019ER, D.<\/small>, <small>LAUFFENBURGER, D. A.<\/small> and <small>NOLAN, G. P.<\/small> (2005). Causal protein-signaling networks derived from multiparameter single-cell data. <i>Science<\/i> <b>308<\/b> 523\u2013529.","DOI":"10.1126\/science.1105809"},{"key":"5","doi-asserted-by":"publisher","unstructured":"<small>BLACKWELL, D.<\/small> (1947). Conditional expectation and unbiased sequential estimation. <i>Ann. Math. Stat.<\/i> <b>18<\/b> 105\u2013110.","DOI":"10.1214\/aoms\/1177730497"},{"key":"11","doi-asserted-by":"crossref","unstructured":"<small>Friedman, J.<\/small>, <small>Hastie, T.<\/small> and <small>Tibshirani, R.<\/small> (2008). Sparse inverse covariance estimation with the graphical lasso. <i>Biostatistics<\/i> <b>9<\/b> 432\u2013441.","DOI":"10.1093\/biostatistics\/kxm045"},{"key":"24","doi-asserted-by":"publisher","unstructured":"<small>Storey, J. D.<\/small> (2002). A direct approach to false discovery rates. <i>J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> <b>64<\/b> 479\u2013498.","DOI":"10.1111\/1467-9868.00346"},{"key":"27","doi-asserted-by":"publisher","unstructured":"<small>Zou, H.<\/small> and <small>Hastie, T.<\/small> (2005). Regularization and variable selection via the elastic net. <i>J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> <b>67<\/b> 301\u2013320.","DOI":"10.1111\/j.1467-9868.2005.00503.x"},{"key":"19","doi-asserted-by":"publisher","unstructured":"<small>Meinshausen, N.<\/small> and <small>B\u00fchlmann, P.<\/small> (2006). High-dimensional graphs and variable selection with the lasso. <i>Ann. Statist.<\/i> <b>34<\/b> 1436\u20131462.","DOI":"10.1214\/009053606000000281"},{"key":"12","doi-asserted-by":"publisher","unstructured":"<small>Goeman, J. J.<\/small> and <small>Solari, A.<\/small> (2011). Multiple testing for exploratory research. <i>Statist. Sci.<\/i> <b>26<\/b> 584\u2013597.","DOI":"10.1214\/11-STS356"},{"key":"26","doi-asserted-by":"publisher","unstructured":"<small>Yuan, M.<\/small> and <small>Lin, Y.<\/small> (2007). Model selection and estimation in the Gaussian graphical model. <i>Biometrika<\/i> <b>94<\/b> 19\u201335.","DOI":"10.1093\/biomet\/asm018"},{"key":"9","doi-asserted-by":"publisher","unstructured":"<small>Efron, B.<\/small>, <small>Hastie, T.<\/small>, <small>Johnstone, I.<\/small> and <small>Tibshirani, R.<\/small> (2004). Least angle regression. <i>Ann. Statist.<\/i> <b>32<\/b> 407\u2013499. With discussion, and a rejoinder by the authors.","DOI":"10.1214\/009053604000000067"},{"key":"10","doi-asserted-by":"crossref","unstructured":"<small>FITHIAN, W.<\/small> and <small>LEI, L.<\/small> (2022). Conditional calibration for false discovery rate control under dependence. <i>Ann. Statist.<\/i> <b>50<\/b> 3091\u20133118.","DOI":"10.1214\/21-AOS2137"},{"key":"3","doi-asserted-by":"crossref","unstructured":"<small>BENJAMINI, Y.<\/small> and <small>HOCHBERG, Y.<\/small> (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. <i>J. Roy. Statist. Soc. Ser. B, Methodol.<\/i> <b>57<\/b> 289\u2013300.","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"25","doi-asserted-by":"crossref","unstructured":"<small>TIBSHIRANI, R.<\/small> (1996). Regression shrinkage and selection via the lasso. <i>J. Roy. Statist. Soc. Ser. B, Methodol.<\/i> <b>58<\/b> 267\u2013288.","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"13","doi-asserted-by":"publisher","unstructured":"<small>HOCKING, R. R.<\/small> (1976). The analysis and selection of variables in linear regression. <i>Biometrics<\/i> <b>32<\/b> 1\u201349.","DOI":"10.2307\/2529336"},{"key":"8","doi-asserted-by":"crossref","unstructured":"<small>DUNNETT, C. W.<\/small> (1955). A multiple comparison procedure for comparing several treatments with a control. <i>J. Amer. Statist. Assoc.<\/i> <b>50<\/b> 1096\u20131121.","DOI":"10.1080\/01621459.1955.10501294"},{"key":"15","doi-asserted-by":"publisher","unstructured":"<small>LEHMANN, E. L.<\/small> and <small>SCHEFF\u00c9, H.<\/small> (1950). Completeness, similar regions, and unbiased estimation. I. <i>Sankhy\u0101<\/i> <b>10<\/b> 305\u2013340.","DOI":"10.1007\/978-1-4614-1412-4_23"},{"key":"2","doi-asserted-by":"crossref","unstructured":"<small>BAUMANN, K.<\/small> (2003). Cross-validation as the objective function for variable-selection techniques. <i>TrAC, Trends Anal. Chem.<\/i> <b>22<\/b> 395\u2013406.","DOI":"10.1016\/S0165-9936(03)00607-1"},{"key":"7","doi-asserted-by":"publisher","unstructured":"<small>DRTON, M.<\/small> and <small>PERLMAN, M. D.<\/small> (2007). Multiple testing and error control in Gaussian graphical model selection. <i>Statist. Sci.<\/i> <b>22<\/b> 430\u2013449.","DOI":"10.1214\/088342307000000113"},{"key":"17","unstructured":"<small>LI, X.<\/small> and <small>FITHIAN, W.<\/small> (2021). Whiteout: when do fixed-X knockoffs fail? arXiv preprint. Available at arXiv:<a href=\"https:\/\/arxiv.org\/abs\/2107.06388\">2107.06388<\/a>."},{"key":"18","doi-asserted-by":"crossref","unstructured":"<small>LUO, Y.<\/small>, <small>FITHIAN, W.<\/small> and <small>LEI, L.<\/small> (2026). Supplement to \u201cEstimating the false discovery rate of variable selection.\u201d <a href=\"https:\/\/doi.org\/10.1214\/26-AOS2625SUPPA\">https:\/\/doi.org\/10.1214\/26-AOS2625SUPPA<\/a>, <a href=\"https:\/\/doi.org\/10.1214\/26-AOS2625SUPPB\">https:\/\/doi.org\/10.1214\/26-AOS2625SUPPB<\/a>, <a href=\"https:\/\/doi.org\/10.1214\/26-AOS2625SUPPC\">https:\/\/doi.org\/10.1214\/26-AOS2625SUPPC<\/a>","DOI":"10.1214\/26-AOS2625SUPPC"},{"key":"20","unstructured":"<small>RADHAKRISHNA RAO, C.<\/small> (1945). Information and the accuracy attainable in the estimation of statistical parameters. <i>Bull. Calcutta Math. Soc.<\/i> <b>37<\/b> 81\u201391."}],"container-title":["The Annals of Statistics"],"original-title":[],"deposited":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T21:12:10Z","timestamp":1791321130000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-54\/issue-4\/Estimating-the-false-discovery-rate-of-variable-selection\/10.1214\/26-AOS2625.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,1]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,8,1]]}},"URL":"https:\/\/doi.org\/10.1214\/26-aos2625","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,1]]}}}