{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T04:37:43Z","timestamp":1784695063649,"version":"3.55.0"},"reference-count":31,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,5]],"date-time":"2020-11-05T00:00:00Z","timestamp":1604534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2018-04486"],"award-info":[{"award-number":["RGPIN-2018-04486"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Distance weighted discrimination (DWD) is an appealing classification method that is capable of overcoming data piling problems in high-dimensional settings. Especially when various sparsity structures are assumed in these settings, variable selection in multicategory classification poses great challenges. In this paper, we propose a multicategory generalized DWD (MgDWD) method that maintains intrinsic variable group structures during selection using a sparse group lasso penalty. Theoretically, we derive minimizer uniqueness for the penalized MgDWD loss function and consistency properties for the proposed classifier. We further develop an efficient algorithm based on the proximal operator to solve the optimization problem. The performance of MgDWD is evaluated using finite sample simulations and miRNA data from an HIV study.<\/jats:p>","DOI":"10.3390\/e22111257","type":"journal-article","created":{"date-parts":[[2020,11,5]],"date-time":"2020-11-05T19:38:41Z","timestamp":1604605121000},"page":"1257","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Sparse Multicategory Generalized Distance Weighted Discrimination in Ultra-High Dimensions"],"prefix":"10.3390","volume":"22","author":[{"given":"Tong","family":"Su","sequence":"first","affiliation":[{"name":"Key Lab of Statistical Modeling and Data Analysis of Yunnan Province, Yunnan University, Kunming 650091, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yafei","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William G.","family":"Branton","sequence":"additional","affiliation":[{"name":"Department of Medicine (Neurology), University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eugene","family":"Asahchop","sequence":"additional","affiliation":[{"name":"Department of Medicine (Neurology), University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Power","sequence":"additional","affiliation":[{"name":"Department of Medicine (Neurology), University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bei","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3011-9216","authenticated-orcid":false,"given":"Linglong","family":"Kong","sequence":"additional","affiliation":[{"name":"Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, AB T6G 2G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niansheng","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Lab of Statistical Modeling and Data Analysis of Yunnan Province, Yunnan University, Kunming 650091, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural features for image classification","volume":"SMC-3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1080\/10618600.2019.1585260","article-title":"Multiclass probability estimation with support vector machines","volume":"28","author":"Wang","year":"2019","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MSP.2015.2462851","article-title":"Speaker recognition by machines and humans: A tutorial review","volume":"32","author":"Hansen","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_4","unstructured":"Duda, R.O., Hart, P.E., and Stork, D.G. (2012). Pattern Classification, John Wiley & Sons."},{"key":"ref_5","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer Science & Business Media."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cristianini, N., and Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press.","DOI":"10.1017\/CBO9780511801389"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1198\/016214507000001120","article-title":"Distance-weighted discrimination","volume":"102","author":"Marron","year":"2007","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1198\/jasa.2010.tm08487","article-title":"Weighted distance weighted discrimination and its asymptotic properties","volume":"105","author":"Qiao","year":"2010","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1002\/wics.1345","article-title":"Distance-weighted discrimination","volume":"7","author":"Marron","year":"2015","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1177\/0962280211428387","article-title":"Some considerations of classification for high dimension low-sample size data","volume":"22","author":"Zhang","year":"2013","journal-title":"Stat. Methods Med. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1111\/rssb.12244","article-title":"Another look at distance-weighted discrimination","volume":"80","author":"Wang","year":"2018","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1198\/jasa.2011.tm10319","article-title":"Hard or soft classification? Large-margin unified machines","volume":"106","author":"Liu","year":"2011","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1080\/10618600.2012.700878","article-title":"Multiclass distance-weighted discrimination","volume":"22","author":"Huang","year":"2013","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1080\/00401706.2018.1529629","article-title":"A multicategory kernel distance weighted discrimination method for multiclass classification","volume":"61","author":"Wang","year":"2019","journal-title":"Technometrics"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1080\/10618600.2015.1049700","article-title":"Sparse distance weighted discrimination","volume":"25","author":"Wang","year":"2016","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1198\/016214506000001383","article-title":"On L1-norm multiclass support vector machines: Methodology and theory","volume":"102","author":"Wang","year":"2007","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1111\/rssb.12100","article-title":"Variable selection for support vector machines in moderately high dimensions","volume":"78","author":"Zhang","year":"2016","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_19","first-page":"8279","article-title":"An error bound for L1-norm support vector machine coefficients in ultra-high dimension","volume":"17","author":"Peng","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1080\/10618600.2012.681250","article-title":"A sparse-group lasso","volume":"22","author":"Simon","year":"2013","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_21","unstructured":"Friedman, J., Hastie, T., and Tibshirani, R. (2010). A note on the group lasso and a sparse group lasso. arXiv."},{"key":"ref_22","unstructured":"Cai, T.T., Zhang, A., and Zhou, Y. (2019). Sparse group lasso: Optimal sample complexity, convergence rate, and statistical inference. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.csda.2018.12.002","article-title":"Sparse wavelet estimation in quantile regression with multiple functional predictors","volume":"136","author":"Yu","year":"2019","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.csda.2015.10.007","article-title":"Regularized quantile regression under heterogeneous sparsity with application to quantitative genetic traits","volume":"95","author":"He","year":"2016","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_25","unstructured":"Huang, H. (2019). Large dimensional analysis of general margin based classification methods. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Huang, H., and Yang, Q. (2020). Large scale analysis of generalization error in learning using margin based classification methods. arXiv.","DOI":"10.1088\/1742-5468\/abbed5"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1080\/10618600.2017.1366915","article-title":"Fast algorithms for large-scale generalized distance weighted discrimination","volume":"27","author":"Lam","year":"2018","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1137\/140964357","article-title":"A convergent 3-block semiproximal alternating direction method of multipliers for conic programming with 4-type constraints","volume":"25","author":"Sun","year":"2015","journal-title":"SIAM J. Optim."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1561\/2400000003","article-title":"Proximal algorithms","volume":"1","author":"Parikh","year":"2014","journal-title":"Found. Trends Optim."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e122450","DOI":"10.1172\/jci.insight.122450","article-title":"HIV-associated sensory polyneuropathy and neuronal injury are associated with miRNA\u2013455-3p induction","volume":"3","author":"Asahchop","year":"2018","journal-title":"JCI Insight"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1214\/ECP.v17-2079","article-title":"A tail inequality for quadratic forms of subgaussian random vectors","volume":"17","author":"Hsu","year":"2012","journal-title":"Electron. Commun. Probab."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/11\/1257\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:29:53Z","timestamp":1760178593000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/11\/1257"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,5]]},"references-count":31,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["e22111257"],"URL":"https:\/\/doi.org\/10.3390\/e22111257","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,5]]}}}