{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T07:42:53Z","timestamp":1782286973883,"version":"3.54.5"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Key NSF of China","award":["62136005"],"award-info":[{"award-number":["62136005"]}]},{"DOI":"10.13039\/501100001809","name":"NSF of China","doi-asserted-by":"crossref","award":["61922087, 61906201, and 62006238"],"award-info":[{"award-number":["61922087, 61906201, and 62006238"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSF for Distinguished Young Scholars of Hunan Province","award":["2019JJ20020"],"award-info":[{"award-number":["2019JJ20020"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>Recently, learning and mining from data streams with incremental feature spaces have attracted extensive attention, where data may dynamically expand over time in both volume and feature dimensions. Existing approaches usually assume that the incoming instances can always receive true labels. However, in many real-world applications, e.g., environment monitoring, acquiring the true labels is costly due to the need of human effort in annotating the data. To tackle this problem, we propose a novel incremental Feature spaces Learning with Label Scarcity (FLLS) algorithm, together with its two variants. When data streams arrive with augmented features, we first leverage the margin-based online active learning to select valuable instances to be labeled and thus build superior predictive models with minimal supervision. After receiving the labels, we combine the online passive-aggressive update rule and margin-maximum principle to jointly update the dynamic classifier in the shared and augmented feature space. Finally, we use the projected truncation technique to build a sparse but efficient model. We theoretically analyze the error bounds of FLLS and its two variants. Also, we conduct experiments on synthetic data and real-world applications to further validate the effectiveness of our proposed algorithms.<\/jats:p>","DOI":"10.1145\/3516368","type":"journal-article","created":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T12:52:22Z","timestamp":1656334342000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Incremental Feature Spaces Learning with Label Scarcity"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1681-5856","authenticated-orcid":false,"given":"Shilin","family":"Gu","sequence":"first","affiliation":[{"name":"The College of Liberal Arts and Science, National University of Defense Technology, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6772-4247","authenticated-orcid":false,"given":"Yuhua","family":"Qian","sequence":"additional","affiliation":[{"name":"The Institute of Big Data Science and Industry, Shanxi University, Shanxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9335-0469","authenticated-orcid":false,"given":"Chenping","family":"Hou","sequence":"additional","affiliation":[{"name":"The College of Liberal Arts and Science, National University of Defense Technology, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"11317","volume-title":"Proceedings of the 37th International Conference on Machine Learning","volume":"119","author":"Zhang Zhenyu","year":"2020","unstructured":"Zhenyu Zhang, Peng Zhao, Yuan Jiang, and Zhi-Hua Zhou. 2020. Learning with feature and distribution evolvable streams. In Proceedings of the 37th International Conference on Machine Learning, Vol. 119, PMLR, 11317\u201311327."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2563424"},{"key":"e_1_3_2_4_2","first-page":"1417","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Hou Bo-Jian","year":"2017","unstructured":"Bo-Jian Hou, Lijun Zhang, and Zhi-Hua Zhou. 2017. Learning with feature evolvable streams. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 1417\u20131427."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2017.2769047"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9006373"},{"key":"e_1_3_2_7_2","unstructured":"Steven C. H. Hoi Doyen Sahoo Jing Lu and Peilin Zhao. 2021. Online learning: A comprehensive survey. Neurocomputing ."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2015.08.010"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.10.014"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2778097"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2550042"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3361559"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3071311"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","unstructured":"Bo-Jian Hou Yu-Hu Yan Peng Zhao and Zhi-Hua Zhou. 2021. Storage fit learning with feature evolvable streams. In Thirty-Fifth AAAI Conference on Artificial Intelligence AAAI 2021 Thirty-Third Conference on Innovative Applications of Artificial Intelligence IAAI 2021 The Eleventh Symposium on Educational Advances in Artificial Intelligence EAAI 2021 Virtual Event February 2-9 2021 . AAAI Press 7729\u20137736. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/16944.","DOI":"10.1609\/aaai.v35i9.16944"},{"key":"e_1_3_2_15_2","article-title":"Feature interaction for streaming feature selection","author":"Zhou Peng","year":"2020","unstructured":"Peng Zhou, Peipei Li, Shu Zhao, and Xindong Wu. 2020. Feature interaction for streaming feature selection. IEEE Transactions on Neural Networks and Learning Systems 32, 10 (2020), 4691\u20134702.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-016-5489-3"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.197"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013232"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3027736"},{"key":"e_1_3_2_20_2","first-page":"2399","article-title":"Manifold regularization: A geometric framework for learning from labeled and unlabeled examples","volume":"7","author":"Belkin Mikhail","year":"2006","unstructured":"Mikhail Belkin, Partha Niyogi, and Vikas Sindhwani. 2006. Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. Journal of Machine Learning Research 7, 85 (2006), 2399\u20132434.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-87479-9_44"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.5555\/2034063.2034101"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219967"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45167-9_28"},{"key":"e_1_3_2_25_2","first-page":"1205","article-title":"Worst-case analysis of selective sampling for linear classification","volume":"7","author":"Cesa-Bianchi Nicol\u00f2","year":"2006","unstructured":"Nicol\u00f2 Cesa-Bianchi, Claudio Gentile, and Luca Zaniboni. 2006. Worst-case analysis of selective sampling for linear classification. Journal of Machine Learning Research 7, 44 (2006), 1205\u20131230.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487647"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 6th Asian Conference on Machine Learning","volume":"39","author":"Lu Jing","year":"2014","unstructured":"Jing Lu, Peilin Zhao, and Steven C. H. Hoi. 2014. Online passive aggressive active learning and its applications. In Proceedings of the 6th Asian Conference on Machine Learning, Vol. 39, JMLR.org."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1005342"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3201604"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/WI-IAT.2015.34"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_3_2_32_2","first-page":"4106","volume-title":"Proceedings of the 35th AAAI Conference on Artificial Intelligence","author":"He Yi","year":"2021","unstructured":"Yi He, Xu Yuan, Sheng Chen, and Xindong Wu. 2021. Online learning in variable feature spaces under incomplete supervision. In Proceedings of the 35th AAAI Conference on Artificial Intelligence. AAAI Press, 4106\u20134114."},{"key":"e_1_3_2_33_2","first-page":"551","article-title":"Online passive-aggressive algorithms","volume":"7","author":"Crammer Koby","year":"2006","unstructured":"Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. 2006. Online passive-aggressive algorithms. Journal of Machine Learning Research 7, 19 (2006), 551\u2013585.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/993483"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-016-5555-y"},{"key":"e_1_3_2_36_2","first-page":"27:1\u201327:27","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang Chih-Chung","year":"2011","unstructured":"Chih-Chung Chang and Chih-Jen Lin. 2011. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 3 (2011), 27:1\u201327:27. Retrieved from http:\/\/www.csie.ntu.edu.tw\/cjlin\/libsvm.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/1137817"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516368","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3516368","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:21Z","timestamp":1750188621000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":36,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3516368"],"URL":"https:\/\/doi.org\/10.1145\/3516368","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]},"assertion":[{"value":"2021-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}