{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T22:34:55Z","timestamp":1780439695240,"version":"3.54.1"},"reference-count":29,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The two-stage feature screening method for linear models applies dimension reduction at first stage to screen out nuisance features and dramatically reduce the dimension to a moderate size; at the second stage, penalized methods such as LASSO and SCAD could be applied for feature selection. A majority of subsequent works on the sure independent screening methods have focused mainly on the linear model. This motivates us to extend the independence screening method to generalized linear models, and particularly with binary response by using the point-biserial correlation. We develop a two-stage feature screening method called point-biserial sure independence screening (PB-SIS) for high-dimensional generalized linear models, aiming for high selection accuracy and low computational cost. We demonstrate that PB-SIS is a feature screening method with high efficiency. The PB-SIS method possesses the sure independence property under certain regularity conditions. A set of simulation studies are conducted and confirm the sure independence property and the accuracy and efficiency of PB-SIS. Finally we apply PB-SIS to one real data example to show its effectiveness.<\/jats:p>","DOI":"10.3390\/e25060851","type":"journal-article","created":{"date-parts":[[2023,5,27]],"date-time":"2023-05-27T16:18:43Z","timestamp":1685204323000},"page":"851","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models"],"prefix":"10.3390","volume":"25","author":[{"given":"Jinzhu","family":"Jiang","sequence":"first","affiliation":[{"name":"Department of Mathematics and Statistics, Bowling Green State University, Bowling Green, OH 43403, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junfeng","family":"Shang","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, Bowling Green State University, Bowling Green, OH 43403, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1080\/01621459.2019.1573734","article-title":"Category-adaptive variable screening for ultra-High dimensional heterogeneous categorical data","volume":"115","author":"Xie","year":"2020","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1080\/01621459.2019.1632078","article-title":"Model-free forward screening via cumulative divergence","volume":"115","author":"Zhou","year":"2020","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_3","first-page":"1","article-title":"Distributed feature screening via componentwise debiasing","volume":"21","author":"Li","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1080\/01621459.2020.1783274","article-title":"Model-free feature screening and FDR control with knockoff features","volume":"117","author":"Liu","year":"2022","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression Shrinkage and selection via lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable Selection via non-concave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_7","first-page":"2313","article-title":"The Dantzig selector: Statistical estimation when p is much larger than n","volume":"35","author":"Candes","year":"2007","journal-title":"Ann. Stat."},{"key":"ref_8","first-page":"2013","article-title":"Ultrahigh dimensional feature selection: Beyond the linear model","volume":"10","author":"Fan","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"High dimensional classification using feature annealed independence rules","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Stat. Soc."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"McCullagh, P., and Nelder, J. (1989). Generalized Linear Models, Chapman & Hall. [2nd ed.].","DOI":"10.1007\/978-1-4899-3242-6"},{"key":"ref_11","first-page":"3567","article-title":"Sure Independence screening in generalized linear models with NP-dimensionality","volume":"39","author":"Fan","year":"2010","journal-title":"Ann. Stat."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1093\/biomet\/ass062","article-title":"The Kolmogorov filter for variable screening in high-dimensional binary classification","volume":"100","author":"Mai","year":"2013","journal-title":"Biometrika"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1214\/aoms\/1177728730","article-title":"Correlation Between A Discrete And A Continuous Variable: Point\u2014Biserial Correlation","volume":"25","author":"Tate","year":"1954","journal-title":"Ann. Math. Stat."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization Paths for Generalized Linear Models via Coordinate Descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Stat. Softw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1093\/biomet\/81.3.425","article-title":"Ideal spatial adaptation by wavelet shrinkage","volume":"81","author":"Donoho","year":"1994","journal-title":"Biometrika"},{"key":"ref_16","first-page":"302","article-title":"Pathwise coordinate optimization","volume":"2","author":"Friedman","year":"2007","journal-title":"Ann. Appl. Stat."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"Ann. Stat."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1214\/009053605000000200","article-title":"Variable selection using MM algorithms","volume":"33","author":"Hunter","year":"2005","journal-title":"Ann. Stat."},{"key":"ref_19","first-page":"1509","article-title":"One-step sparse estimates in nonconcave penalized likelihood models","volume":"36","author":"Zou","year":"2008","journal-title":"Ann. Stat."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1007\/s11222-013-9407-3","article-title":"Majorization minimization by coordinate descent for concave penalized generalized linear models","volume":"24","author":"Jiang","year":"2014","journal-title":"Stat. Comput."},{"key":"ref_21","unstructured":"Akaike, H. (, 1973). Information theory and an extension of the maximum likelihood principle. Proceedings of the International Symposium on Information Theory, Budapest, Hungary."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Ann. Stat."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1093\/biomet\/asn034","article-title":"Extended Bayesian information criterion for model selection with large model space","volume":"94","author":"Chen","year":"2008","journal-title":"Biometrika"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1165\/rcmb.2012-0230OC","article-title":"Peripheral blood mononuclear cell gene expression in chronic obstructive pulmonary disease","volume":"49","author":"Bahr","year":"2013","journal-title":"Am. J. Respir. Cell Mol. Biol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1142\/S0219720005001004","article-title":"Minimum redundancy feature selection from microarray gene expression data","volume":"3","author":"Ding","year":"2005","journal-title":"J. Bioinform. Comput. Biol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Radovic, M., Ghalwash, M., Filipovic, N., and Obradovic, Z. (2017). Minimum redundancy maximum relevance feature selection approach for temporal gene expression data. BMC Bioinform., 18.","DOI":"10.1186\/s12859-016-1423-9"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"6371","DOI":"10.1016\/j.eswa.2014.04.019","article-title":"MIFS-ND: A mutual information-based feature selection method","volume":"41","author":"Hoque","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1080\/01621459.2014.920256","article-title":"Model-free feature screening for ultrahigh dimensional discriminant analysis","volume":"110","author":"Cui","year":"2015","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.spl.2017.02.011","article-title":"Model free feature screening with dependent variable in ultrahigh dimensional binary classification","volume":"125","author":"Lai","year":"2017","journal-title":"Stat. Probab. Lett."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/6\/851\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:42:42Z","timestamp":1760125362000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/6\/851"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["e25060851"],"URL":"https:\/\/doi.org\/10.3390\/e25060851","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,26]]}}}