{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T16:28:30Z","timestamp":1782404910938,"version":"3.54.5"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,12,3]],"date-time":"2016-12-03T00:00:00Z","timestamp":1480723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National 973 Program of China","award":["2013CB329604"],"award-info":[{"award-number":["2013CB329604"]}]},{"name":"Program for Changjiang Scholars and Innovative Research Team in University (PCSIRT) of the Ministry of Education, China","award":["IRT13059"],"award-info":[{"award-number":["IRT13059"]}]},{"name":"PIMS Post-Doctoral Fellowship Award of the Pacific Institute for the Mathematical Sciences"},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61229301 and 61305064"],"award-info":[{"award-number":["61229301 and 61305064"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSERC Discovery grant"},{"name":"State Key Program of National Natural Science of China","award":["61432008"],"award-info":[{"award-number":["61432008"]}]},{"name":"BCIC NRAS Team Project"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2017,5,31]]},"abstract":"<jats:p>Feature selection is important in many big data applications. Two critical challenges closely associate with big data. First, in many big data applications, the dimensionality is extremely high, in millions, and keeps growing. Second, big data applications call for highly scalable feature selection algorithms in an online manner such that each feature can be processed in a sequential scan. We present SAOLA, a &lt;underline&gt;S&lt;\/underline&gt;calable and &lt;underline&gt;A&lt;\/underline&gt;ccurate &lt;underline&gt;O&lt;\/underline&gt;n&lt;underline&gt;L&lt;\/underline&gt;ine &lt;underline&gt;A&lt;\/underline&gt;pproach for feature selection in this paper. With a theoretical analysis on bounds of the pairwise correlations between features, SAOLA employs novel pairwise comparison techniques and maintains a parsimonious model over time in an online manner. Furthermore, to deal with upcoming features that arrive by groups, we extend the SAOLA algorithm, and then propose a new group-SAOLA algorithm for online group feature selection. The group-SAOLA algorithm can online maintain a set of feature groups that is sparse at the levels of both groups and individual features simultaneously. An empirical study using a series of benchmark real datasets shows that our two algorithms, SAOLA and group-SAOLA, are scalable on datasets of extremely high dimensionality and have superior performance over the state-of-the-art feature selection methods.<\/jats:p>","DOI":"10.1145\/2976744","type":"journal-article","created":{"date-parts":[[2016,12,5]],"date-time":"2016-12-05T16:47:16Z","timestamp":1480956436000},"page":"1-39","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":100,"title":["Scalable and Accurate Online Feature Selection for Big Data"],"prefix":"10.1145","volume":"11","author":[{"given":"Kui","family":"Yu","sequence":"first","affiliation":[{"name":"Simon Fraser University, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xindong","family":"Wu","sequence":"additional","affiliation":[{"name":"University of Louisiana at Lafayette, LA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Ding","sequence":"additional","affiliation":[{"name":"University of Massachusetts Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian","family":"Pei","sequence":"additional","affiliation":[{"name":"Simon Fraser University, BC, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,12,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1756013"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2188387"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0727-6"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(03)00079-1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248548"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944974"},{"key":"e_1_2_1_7_1","unstructured":"Jerome Friedman Trevor Hastie and Robert Tibshirani. 2010. A note on the group lasso and a sparse group lasso. arXiv preprint arXiv:1001.0736.  Jerome Friedman Trevor Hastie and Robert Tibshirani. 2010. A note on the group lasso and a sparse group lasso. arXiv preprint arXiv:1001.0736."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944968"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2351316.2351329"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39804-2_22"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0631-0"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-006-0040-8"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00043-X"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of International Conference on Machine Learning (ICML\u2019 95)","author":"Koller Daphne","year":"1995"},{"key":"e_1_2_1_15_1","volume-title":"Leibler","author":"Kullback Solomon","year":"1951"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0613-2"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2005.66"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792674.1792689"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2006.06.008"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.159"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of International Conference on Machine Learning (ICML\u201903)","author":"Perkins Simon","year":"2003"},{"key":"e_1_2_1_22_1","volume-title":"Flannery","author":"Press William H.","year":"1996"},{"key":"e_1_2_1_23_1","unstructured":"Jonathon Shlens. 2014. Notes on Kullback-Leibler divergence and likelihood. arXiv preprint arXiv:1404.2000.  Jonathon Shlens. 2014. Notes on Kullback-Leibler divergence and likelihood. arXiv preprint arXiv:1404.2000."},{"key":"e_1_2_1_24_1","first-page":"1393","article-title":"Feature selection via dependence maximization","volume":"13","author":"Song Le","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2638579"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of International Conference on Machine Learning (ICML\u201910)","author":"Tan Mingkui"},{"key":"e_1_2_1_27_1","series-title":"Series B (Methodological)","volume-title":"Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society","author":"Tibshirani Robert","year":"1996"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics. Morgan Kaufmann Publishers","author":"Tsamardinos Ioannis"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-6889-7"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.collaboratecom.2012.250689"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.32"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of Conference on Neural Information Processing Systems (NIPS\u201900)","volume":"12","author":"Weston Jason","year":"2000"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339674"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.197"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/3104322.3104469"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.109"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-013-0722-y"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2700409"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.08.026"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788612"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401986"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1044700"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00532.x"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2014.2326099"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of International Conference on Machine Learning (ICML\u201912)","author":"Zhai Yiteng","year":"2012"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-014-0744-0"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI\u201907)","volume":"7","author":"Zhao Zheng","year":"2007"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.222"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248614"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0182-x"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2976744","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2976744","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:56:16Z","timestamp":1750222576000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2976744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,3]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,5,31]]}},"alternative-id":["10.1145\/2976744"],"URL":"https:\/\/doi.org\/10.1145\/2976744","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,3]]},"assertion":[{"value":"2014-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-12-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}