{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T11:04:54Z","timestamp":1782731094946,"version":"3.54.5"},"reference-count":48,"publisher":"MIT Press","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2016,6]]},"abstract":"<jats:p>This letter addresses the robustness problem when learning a large margin classifier in the presence of label noise. In our study, we achieve this purpose by proposing robustified large margin support vector machines. The robustness of the proposed robust support vector classifiers (RSVC), which is interpreted from a weighted viewpoint in this work, is due to the use of nonconvex classification losses. Besides the robustness, we also show that the proposed RSCV is simultaneously smooth, which again benefits from using smooth classification losses. The idea of proposing RSVC comes from M-estimation in statistics since the proposed robust and smooth classification losses can be taken as one-sided cost functions in robust statistics. Its Fisher consistency property and generalization ability are also investigated. Besides the robustness and smoothness, another nice property of RSVC lies in the fact that its solution can be obtained by solving weighted squared hinge loss\u2013based support vector machine problems iteratively. We further show that in each iteration, it is a quadratic programming problem in its dual space and can be solved by using state-of-the-art methods. We thus propose an iteratively reweighted type algorithm and provide a constructive proof of its convergence to a stationary point. Effectiveness of the proposed classifiers is verified on both artificial and real data sets.<\/jats:p>","DOI":"10.1162\/neco_a_00837","type":"journal-article","created":{"date-parts":[[2016,5,3]],"date-time":"2016-05-03T20:41:16Z","timestamp":1462308076000},"page":"1217-1247","source":"Crossref","is-referenced-by-count":45,"title":["Robust Support Vector Machines for Classification with Nonconvex and Smooth Losses"],"prefix":"10.1162","volume":"28","author":[{"given":"Yunlong","family":"Feng","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, ESAT-STADIUS, KU Leuven, 3000 Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuning","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, ESAT-STADIUS, KU Leuven, 3000 Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolin","family":"Huang","sequence":"additional","affiliation":[{"name":"Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, 200400 Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siamak","family":"Mehrkanoon","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johan A. K.","family":"Suykens","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, ESAT-STADIUS, KU Leuven, 3000 Leuven, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1515\/9781400867011"},{"key":"B2","author":"Bache K.","year":"2013","journal-title":"UCI machine learning repository"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1198\/016214505000000907"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1162\/153244303321897690"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1100.0854"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.5.1155"},{"key":"B7","first-page":"1007","volume":"5","author":"Christmann A.","year":"2004","journal-title":"Journal of Machine Learning Research"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.4310\/SII.2009.v2.n3.a5"},{"key":"B9","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1145\/1143844.1143870","author":"Collobert R.","year":"2006","journal-title":"Proceedings of the 23rd International Conference on Machine Learning"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511618796"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04274-4_11"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmva.2009.09.007"},{"key":"B13","first-page":"157","volume-title":"A festschrift for Erich L. Lehmann","author":"Donoho D. L.","year":"1983"},{"key":"B14","first-page":"993","volume":"16","author":"Feng Y.","year":"2015","journal-title":"Journal of Machine Learning Research"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2292894"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1109\/83.392335"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84800-155-8_7"},{"key":"B18","author":"Grant M.","year":"2014","journal-title":"CVX: Matlab software for disciplined convex programming, version 2.1"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177693054"},{"key":"B20","author":"Hampel F. R.","year":"2011","journal-title":"Robust statistics: The approach based on influence functions"},{"key":"B21","first-page":"2185","volume":"15","author":"Huang X.","year":"2014","journal-title":"Journal of Machine Learning Research"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177703732"},{"key":"B23","author":"Kanamori T.","year":"2014","journal-title":"Breakdown point of robust support vector machine"},{"key":"B24","first-page":"63","author":"Krause N.","year":"2004","journal-title":"Proceedings of the 21st International Conference on Machine Learning"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011215321374"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015469627679"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/j.spl.2004.03.002"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.896065"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5165-z"},{"key":"B30","first-page":"1049","volume-title":"Advances in neural information processing systems, 21","author":"Masnadi-Shirazi H.","year":"2009"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-36434-X_1"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1137\/030600862"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1002\/cjs.10105"},{"key":"B34","first-page":"185","volume-title":"Advances in kernel methods\u2014Support vector learning","author":"Platt J.","year":"1999"},{"key":"B35","first-page":"2387","volume":"11","author":"Reid M. D.","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44581-1_27"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1198\/016214503000000639"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2013.07.017"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2004.839514"},{"key":"B40","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-77242-4","author":"Steinwart I.","year":"2008","journal-title":"Support vector machines"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(01)00644-0"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1201\/b17558"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00647"},{"key":"B44","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1145\/1273496.1273620","author":"Wang L.","year":"2007","journal-title":"Proceedings of the 24th International Conference on Machine Learning"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1198\/016214507000000617"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.2012.680866"},{"key":"B47","author":"Yang Y.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1079120130"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00837","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,3]],"date-time":"2025-06-03T00:06:35Z","timestamp":1748909195000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/28\/6\/1217-1247\/8179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6]]},"references-count":48,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2016,6]]}},"alternative-id":["10.1162\/NECO_a_00837"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00837","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,6]]}}}