{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T16:10:03Z","timestamp":1737043803559,"version":"3.33.0"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2007,5,22]],"date-time":"2007-05-22T00:00:00Z","timestamp":1179792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2007,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>We consider a Bayesian model selection strategy based on predicting the signs of the coefficients in a regression model, i.e. we consider identification of coefficients in a full or encompassing model for which we can confidently predict whether they are positive or negative. This is useful when our main purpose in doing model selection is interpretation, since the sign of a coefficient is often of primary importance for this task. In the case of a linear model with standard non-informative prior, we connect our sign coefficient prediction approach to the classical Zheng\u2013Loh procedure for model selection. One advantage of our approach is that only specification of a prior on the full model is required, unlike standard Bayesian variable selection approaches which require specification of prior distributions on parameters in all submodels, and specification of a prior on the model itself. We consider applying our method with proper hierarchical shrinkage priors, which makes the procedure more useful in \u2018large p, small n\u2019 regression problems with more predictors than observations and in problems involving multicollinearity. In these problems we may wish to do prediction by using shrinkage methods in the full model, but interpreting which variables are important is also of interest. We compare selection by using our coefficient sign prediction approach with the recently proposed elastic net procedure of Zou and Hastie and observe that our method shares some of the features of the elastic net such as a group selection property. The method can be extended to more complex model selection problems such as selection on variance components in random-effects models. For selection on variance components where the parameter of interest is non-negative and hence prediction of the sign of the parameter not the appropriate way to proceed, we consider instead prediction of the sign of the score component for the parameter at zero, obtaining a method that is related to classical score tests on variance components.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2007.00597.x","type":"journal-article","created":{"date-parts":[[2007,5,23]],"date-time":"2007-05-23T18:25:51Z","timestamp":1179944751000},"page":"447-461","source":"Crossref","is-referenced-by-count":2,"title":["Coefficient Sign Prediction Methods for Model Selection"],"prefix":"10.1093","volume":"69","author":[{"given":"David J.","family":"Nott","sequence":"first","affiliation":[{"name":"National University of Singapore , Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony Y. C.","family":"Kuk","sequence":"additional","affiliation":[{"name":"National University of Singapore , Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2007,5,22]]},"reference":[{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1093\/biomet\/86.3.635","article-title":"The choice of variables in multivariate regression: a non-conjugate Bayesian decision theory approach","volume":"86","author":"Brown","year":"1999","journal-title":"Biometrika"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1111\/1467-9868.00348","article-title":"Bayes model averaging with selection of regressors","volume":"64","author":"Brown","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1111\/j.2517-6161.1985.tb01384.x","article-title":"On asymptotic normality of limiting density functions with Bayesian implications","volume":"47","author":"Chen","year":"1985","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1111\/j.0006-341X.2003.00089.x","article-title":"Random effects selection in linear mixed models","volume":"59","author":"Chen","year":"2003","journal-title":"Biometrics"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1101\/sqb.2003.68.109","article-title":"Genetic variation in the control of transcription","volume":"68","author":"Cotsapas","year":"2003","journal-title":"Cold Spring Harb. Symp. Quant. Biol."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1023\/A:1026504402220","article-title":"A case study of stochastic optimization in health policy: problem formulation and preliminary results","volume":"18","author":"Draper","year":"2000","journal-title":"J. Glob. Optimizn"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0378-3758(02)00286-0","article-title":"Variable selection in qualitative models via an entropic explanatory power","volume":"111","author":"Dupuis","year":"2003","journal-title":"J. Statist. Planng Inf."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0304-4076(00)00076-2","article-title":"Benchmark priors for Bayesian model averaging","volume":"100","author":"Fern\u00e1ndez","year":"2001","journal-title":"J. Econometr."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/biomet\/85.1.1","article-title":"Model choice: a minimum posterior predictive loss approach","volume":"85","author":"Gelfand","year":"1998","journal-title":"Biometrika"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1093\/biomet\/87.4.731","article-title":"Calibration and empirical Bayes variable selection","volume":"87","author":"George","year":"2000","journal-title":"Biometrika"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1080\/01621459.1993.10476353","article-title":"Variable selection via Gibbs sampling","volume":"88","author":"George","year":"1993","journal-title":"J. Am. Statist. Ass."},{"first-page":"265","year":"2005","author":"Haario","key":"2023040705374058000_"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1111\/j.2517-6161.1979.tb01071.x","article-title":"On asymptotic posterior normality for stochastic processes","volume":"41","author":"Heyde","year":"1979","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1023\/A:1011916902934","article-title":"Nonparametric regression using linear combinations of basis functions","volume":"11","author":"Kohn","year":"2001","journal-title":"Statist. Comput."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1111\/j.2517-6161.1995.tb02028.x","article-title":"Predictive model selection","volume":"57","author":"Laud","year":"1995","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1093\/biomet\/84.2.309","article-title":"Variance component testing in generalized linear models with random effects","volume":"84","author":"Lin","year":"1997","journal-title":"Biometrika"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/j.2517-6161.1968.tb01505.x","article-title":"The choice of variables in multiple regression (with discussion)","volume":"30","author":"Lindley","year":"1968","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","first-page":"75","article-title":"Discussion on \u2018Assessment and propagation of model uncertainty\u2019 (by D. Draper)","volume":"57","author":"Lindley","year":"1995","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","first-page":"31","article-title":"Replicated microarray data","volume":"12","author":"L\u00f6nnstedt","year":"2001","journal-title":"Statist. Sin."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1111\/1467-9469.00225","article-title":"A Bayesian approach to selecting covariates for prediction","volume":"28","author":"Marriott","year":"2001","journal-title":"Scand. J. Statist."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1111\/j.0006-341X.2002.00701.x","article-title":"DNA microarray experiments: biological and technological aspects","volume":"58","author":"Nguyen","year":"2002","journal-title":"Biometrics"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1080\/01621459.1997.10473615","article-title":"Bayesian model averaging for linear regression models","volume":"92","author":"Raftery","year":"1997","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/0304-4076(95)01763-1","article-title":"Nonparametric regression using Bayesian variable selection","volume":"75","author":"Smith","year":"1996","journal-title":"J. Econometr."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2202\/1544-6115.1027","article-title":"Linear models and empirical Bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Statist. Appl. Genet. Molec. Biol."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1007\/0-387-29362-0_23","volume-title":"Bioinformatics and Computational Biology Solutions using R and Bioconductor","author":"Smyth","year":"2005"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1111\/1467-9868.00353","article-title":"Bayesian measures of model complexity and fit (with discussion)","volume":"64","author":"Spiegelhalter","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705374058000_","first-page":"1","article-title":"From ANOVA to variance components: discussion of Gelman (2005), \u2018Analysis of variance\u2014why it is more important than ever\u2019","volume":"33","author":"Zaslavsky","year":"2005","journal-title":"Ann. Statist."},{"key":"2023040705374058000_","first-page":"233","volume-title":"Bayesian Inference and Decision Techniques\u2014Essays in Honor of Bruno de Finetti","author":"Zellner","year":"1986"},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/01621459.1995.10476497","article-title":"Consistent variable selection in linear models","volume":"90","author":"Zheng","year":"1995","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705374058000_","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Statist. Soc. B"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2007.00597.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/69\/3\/447\/49795338\/jrsssb_69_3_447.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/69\/3\/447\/49795338\/jrsssb_69_3_447.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T15:32:43Z","timestamp":1737041563000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/69\/3\/447\/7109345"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,5,22]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2007,5,22]]},"published-print":{"date-parts":[[2007,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2007.00597.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"type":"print","value":"1369-7412"},{"type":"electronic","value":"1467-9868"}],"subject":[],"published-other":{"date-parts":[[2007,6]]},"published":{"date-parts":[[2007,5,22]]}}}