{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T04:37:46Z","timestamp":1784695066006,"version":"3.55.0"},"reference-count":57,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T00:00:00Z","timestamp":1676851200000},"content-version":"vor","delay-in-days":2014,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1505111"],"award-info":[{"award-number":["DMS-1505111"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,1,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Distance-weighted discrimination (DWD) is a modern margin-based classifier with an interesting geometric motivation. It was proposed as a competitor to the support vector machine (SVM). Despite many recent references on DWD, DWD is far less popular than the SVM, mainly because of computational and theoretical reasons. We greatly advance the current DWD methodology and its learning theory. We propose a novel thrifty algorithm for solving standard DWD and generalized DWD, and our algorithm can be several hundred times faster than the existing state of the art algorithm based on second-order cone programming. In addition, we exploit the new algorithm to design an efficient scheme to tune generalized DWD. Furthermore, we formulate a natural kernel DWD approach in a reproducing kernel Hilbert space and then establish the Bayes risk consistency of the kernel DWD by using a universal kernel such as the Gaussian kernel. This result solves an open theoretical problem in the DWD literature. A comparison study on 16 benchmark data sets shows that data-driven generalized DWD consistently delivers higher classification accuracy with less computation time than the SVM.<\/jats:p>","DOI":"10.1111\/rssb.12244","type":"journal-article","created":{"date-parts":[[2017,8,17]],"date-time":"2017-08-17T07:42:44Z","timestamp":1502955764000},"page":"177-198","source":"Crossref","is-referenced-by-count":42,"title":["Another Look at Distance-Weighted Discrimination"],"prefix":"10.1093","volume":"80","author":[{"given":"Boxiang","family":"Wang","sequence":"first","affiliation":[{"name":"University of Minnesota , Minneapolis , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Zou","sequence":"additional","affiliation":[{"name":"University of Minnesota , Minneapolis , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2017,8,16]]},"reference":[{"key":"2023022101111704700_","first-page":"821","article-title":"Theoretical foundations of the potential function method in pattern recognition learning","volume":"25","author":"Aizerman","year":"1964","journal-title":"Automn Remote Control"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10107-002-0339-5","article-title":"Second-order cone programming","volume":"95","author":"Alizadeh","year":"2004","journal-title":"Math. Programmng"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511624216","volume-title":"Neural Network Learning: Theoretical Foundations","author":"Anthony","year":"1999"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1198\/016214505000000907","article-title":"Convexity, classification, and risk bounds","volume":"101","author":"Bartlett","year":"2006","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111704700_","first-page":"43","volume-title":"Advances in Kernel Methods\u2013Support Vector Learning","author":"Bartlett","year":"1999"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex Optimization","author":"Boyd","year":"2004"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"2023022101111704700_","volume-title":"Mxnet: a flexible and efficient machine learning library for heterogeneous distributed systems","author":"Chen","year":"2015"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s10107-016-1007-5","article-title":"An efficient inexact symmetric Gauss-Seidel based majorized ADMM for high-dimensional convex composite conic programming","volume":"161","author":"Chen","year":"2017","journal-title":"Math. Programmng"},{"key":"2023022101111704700_","first-page":"735","volume-title":"Convergence of correction matrix algorithms for multidimensional scaling.","author":"De Leeuw","year":"1977"},{"key":"2023022101111704700_","first-page":"3133","article-title":"Do we need hundreds of classifiers to solve real world classification problems?","volume":"15","author":"Fern\u00e1ndez-Delgado","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1111\/j.1467-9868.2005.00510.x","article-title":"Geometric representation of high dimension, low sample size data","volume":"67","author":"Hall","year":"2005","journal-title":"J. R. Statist. Soc."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning: Prediction, Inference, and Data Mining","author":"Hastie","year":"2009"},{"key":"2023022101111704700_","first-page":"566","volume-title":"Proc. Int. Conf. Machine Learning","author":"Hsieh","year":"2014"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1080\/10618600.2012.700878","article-title":"Multiclass distance-weighted discrimination","volume":"22","author":"Huang","year":"2013","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1093\/bioinformatics\/bts096","article-title":"R\/DWD: distance-weighted discrimination for classification, visualization and batch adjustment","volume":"28","author":"Huang","year":"2012","journal-title":"Bioinformatics"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1198\/0003130042836","article-title":"A tutorial on MM algorithms","volume":"58","author":"Hunter","year":"2004","journal-title":"Am. Statistn"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1214\/009053605000000200","article-title":"Variable selection using MM algorithms","volume":"33","author":"Hunter","year":"2005","journal-title":"Ann. Statist."},{"key":"2023022101111704700_","article-title":"Probabilistic kernel regression models","author":"Jaakkola","year":"1999","journal-title":"Proc. 7th Int. Wrkshp Artificial Intelligence and Statistics"},{"key":"2023022101111704700_","first-page":"1","article-title":"kernlab\u2014an S4 package for kernel methods in R","volume":"11","author":"Karatzoglou","year":"2004","journal-title":"J. Statist. Softwr."},{"key":"2023022101111704700_","volume-title":"Fast algorithms for large scale generalized distance weighted discrimination","author":"Lam","year":"2017"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10618600.2000.10474858","article-title":"Optimization transfer using surrogate objective functions","volume":"9","author":"Lange","year":"2000","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1007\/s10107-012-0612-1","article-title":"MM algorithms for geometric and signomial programming","volume":"143","author":"Lange","year":"2014","journal-title":"Math. Programmng"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s10107-014-0850-5","article-title":"A Schur complement based semi-proximal ADMM for convex quadratic conic programming and extensions","volume":"155","author":"Li","year":"2016","journal-title":"Math. Programmng"},{"key":"2023022101111704700_","first-page":"18","article-title":"Classification and regression by randomForest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News"},{"key":"2023022101111704700_","volume-title":"UCI Machine Learning Repository","author":"Lichman","year":"2013"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1023\/A:1015469627679","article-title":"Support vector machines and the Bayes rule in classification","volume":"6","author":"Lin","year":"2002","journal-title":"Data Minng Knowl. Discov."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.spl.2004.03.002","article-title":"A note on margin-based loss functions in classification","volume":"68","author":"Lin","year":"2004","journal-title":"Statist. Probab. Lett."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1023\/A:1012406528296","article-title":"Support vector machines for classification in nonstandard situations","volume":"46","author":"Lin","year":"2002","journal-title":"Mach. Learn."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1198\/jasa.2011.tm10319","article-title":"Hard or soft classification?: Large-margin unified machines","volume":"106","author":"Liu","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111704700_","volume-title":"Smoothing, functional data analysis, and distance weighted discrimination software","author":"Marron","year":"2013"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1002\/wics.1345","article-title":"Distance-weighted discrimination","volume":"7","author":"Marron","year":"2015","journal-title":"Wiley Interdisc. Rev. Computnl Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1198\/016214507000001120","article-title":"Distance weighted discrimination","volume":"102","author":"Marron","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111704700_","author":"Meyer","year":"2015"},{"key":"2023022101111704700_","first-page":"2651","article-title":"Universal kernels","volume":"7","author":"Micchelli","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111704700_","first-page":"185","article-title":"Fast training of support vector machines using sequential minimal optimization","volume":"12","author":"Platt","year":"1999","journal-title":"Advances in Kernel Methods\u2014Support Vector Learning"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"331","DOI":"10.4310\/SII.2015.v8.n3.a7","article-title":"Distance-weighted support vector machine","volume":"8","author":"Qiao","year":"2015","journal-title":"Statist. Interfc."},{"key":"2023022101111704700_","first-page":"1547","article-title":"Flexible high-dimensional classification machines and their asymptotic properties","volume":"16","author":"Qiao","year":"2015","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1198\/jasa.2010.tm08487","article-title":"Weighted distance weighted discrimination and its asymptotic properties","volume":"105","author":"Qiao","year":"2010","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111704700_","volume-title":"gbm: generalized boosted regression models","author":"Ridgeway","year":"2017"},{"key":"2023022101111704700_","first-page":"349","volume-title":"Advances in Kernel Methods\u2014Support Vector Learning","author":"Shawe-Taylor","year":"2000"},{"key":"2023022101111704700_","first-page":"67","article-title":"On the influence of the kernel on the consistency of support vector machines","volume":"2","author":"Steinwart","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-2440-0","volume-title":"The Nature of Statistical Learning Theory","author":"Vapnik","year":"1995"},{"key":"2023022101111704700_","volume-title":"Statistical Learning Theory","author":"Vapnik","year":"1998"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-21706-2","volume-title":"Modern Applied Statistics with S","author":"Venables","year":"2002"},{"key":"2023022101111704700_","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611970128","volume-title":"Spline Models for Observational Data","author":"Wahba","year":"1990"},{"key":"2023022101111704700_","first-page":"69","article-title":"Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV","volume":"6","author":"Wahba","year":"1999","journal-title":"Advances in Kernel Methods\u2013Support Vector Learning"},{"key":"2023022101111704700_","first-page":"313","article-title":"Soft classification, aka risk estimation, via penalized log likelihood and smoothing spline analysis of variance","volume":"20","author":"Wahba","year":"1994","journal-title":"Santa Fe Institute Studies in the Sciences of Complexity Proc."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1080\/10618600.2015.1049700","article-title":"Sparse distance weighted discrimination","volume":"25","author":"Wang","year":"2016","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1214\/08-STS264","article-title":"The MM alternative to EM","volume":"25","author":"Wu","year":"2010","journal-title":"Statist. Sci."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1080\/10618600.2012.680324","article-title":"An efficient algorithm for computing the HHSVM and its generalizations","volume":"22","author":"Yang","year":"2013","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1214\/aos\/1079120130","article-title":"Statistical behavior and consistency of classification methods based on convex risk minimization","volume":"32","author":"Zhang","year":"2004","journal-title":"Ann. Statist."},{"key":"2023022101111704700_","first-page":"3299","article-title":"Divide and conquer kernel ridge regression: a distributed algorithm with minimax optimal rates","volume":"16","author":"Zhang","year":"2015","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1198\/jcgs.2010.09014","article-title":"MM algorithms for some discrete multivariate distributions","volume":"19","author":"Zhou","year":"2010","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1198\/106186005X25619","article-title":"Kernel logistic regression and the import vector machine","volume":"14","author":"Zhu","year":"2005","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111704700_","first-page":"1509","article-title":"One-step sparse estimates in nonconcave penalized likelihood models","volume":"36","author":"Zou","year":"2008","journal-title":"Ann. Statist."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12244","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12244","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12244","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/am-pdf\/10.1111\/rssb.12244","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/80\/1\/177\/49271397\/jrsssb_80_1_177.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/80\/1\/177\/49271397\/jrsssb_80_1_177.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T09:39:27Z","timestamp":1719394767000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/80\/1\/177\/7048416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,16]]},"references-count":57,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,8,16]]},"published-print":{"date-parts":[[2018,1,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12244","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,1]]},"published":{"date-parts":[[2017,8,16]]}}}