{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T13:46:23Z","timestamp":1785332783859,"version":"3.55.0"},"reference-count":42,"publisher":"MIT Press","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2014,1]]},"abstract":"<jats:p>The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection based on linear dependency between input features and output values. In this letter, we consider a feature-wise kernelized Lasso for capturing nonlinear input-output dependency. We first show that with particular choices of kernel functions, nonredundant features with strong statistical dependence on output values can be found in terms of kernel-based independence measures such as the Hilbert-Schmidt independence criterion. We then show that the globally optimal solution can be efficiently computed; this makes the approach scalable to high-dimensional problems. The effectiveness of the proposed method is demonstrated through feature selection experiments for classification and regression with thousands of features.<\/jats:p>","DOI":"10.1162\/neco_a_00537","type":"journal-article","created":{"date-parts":[[2013,10,8]],"date-time":"2013-10-08T15:42:59Z","timestamp":1381246979000},"page":"185-207","source":"Crossref","is-referenced-by-count":265,"title":["High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso"],"prefix":"10.1162","volume":"26","author":[{"given":"Makoto","family":"Yamada","sequence":"first","affiliation":[{"name":"Yahoo Labs, 701 1st Ave., Sunnyvale, CA 94098, U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wittawat","family":"Jitkrittum","sequence":"additional","affiliation":[{"name":"University College London, Alexandra House, 17 Queen Square, London, WC1N 3AR, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonid","family":"Sigal","sequence":"additional","affiliation":[{"name":"Disney Research Pittsburgh, Pittsburgh, PA 15213, U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric P.","family":"Xing","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA 15213, U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masashi","family":"Sugiyama","sequence":"additional","affiliation":[{"name":"Tokyo Institute of Technology O-okayama, Meguro-ku, Tokyo, 152-8552, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390161"},{"key":"B2","first-page":"105","volume-title":"Advances in neural information processing systems","volume":"21","author":"Bach F.","year":"2009"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1137\/050626090"},{"key":"B5","first-page":"795","volume":"13","author":"Cortes C.","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"B6","volume-title":"Elements of information theory","author":"Cover T. M.","year":"2006","edition":"2"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.20042"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1142\/S0219720005001004"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1145\/1458082.1458119"},{"key":"B10","first-page":"489","volume-title":"Advances in Neural Information Processing Systems, 20","author":"Fukumizu K.","year":"2008"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/11564089_7"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOS781"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2007.910971"},{"key":"B15","first-page":"779","volume-title":"Advances in neural information processing systems","volume":"18","author":"Li F.","year":"2006"},{"key":"B16","first-page":"969","volume-title":"Advances in neural information processing systems, 21","author":"Liu H.","year":"2009"},{"key":"B17","first-page":"751","volume-title":"International Conference on Machine learning (ICML)","author":"Masaeli M.","year":"2010"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2007.00627.x"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2010.00740.x"},{"key":"B20","volume-title":"Numerical optimization","author":"Nocedal J.","year":"2003"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/13.1.25"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.159"},{"key":"B23","first-page":"389","volume":"13","author":"Raskutti G.","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2009.00718.x"},{"key":"B25","first-page":"1491","volume":"11","author":"Rodriguez-Lujan I.","year":"2010","journal-title":"Journal of Machine Learning Research (JMLR)"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2003.809398"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0602562103"},{"key":"B28","volume-title":"Learning with kernels","author":"Sch\u00f6lkopf B.","year":"2002"},{"key":"B29","first-page":"905","volume-title":"Advances in neural information processing systems","author":"Seeger M.","year":"2002"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2007.909536"},{"key":"B32","first-page":"1393","volume":"13","author":"Song L.","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1162\/153244302760185252"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1214\/13-AOS1095"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-10-S1-S52"},{"issue":"1","key":"B36","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"Tibshirani R.","year":"1996","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"B37","first-page":"1537","volume":"12","author":"Tomioka R.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2009.2016892"},{"key":"B39","first-page":"601","volume-title":"International Conference on Machine Learning (ICML)","author":"Xing E. P.","year":"2001"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2009.06.001"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1137\/070703983"},{"key":"B42","first-page":"673","volume-title":"AAAI Conference on Artificial Intelligence (AAAI)","author":"Zhao Z.","year":"2010"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00537","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T13:58:25Z","timestamp":1716040705000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/26\/1\/185-207\/7936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,1]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,1]]}},"alternative-id":["10.1162\/NECO_a_00537"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00537","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,1]]}}}