{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:34:24Z","timestamp":1777696464409,"version":"3.51.4"},"reference-count":25,"publisher":"SAGE Publications","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2023,7,20]]},"abstract":"<jats:p>Feature Evolvable Stream Learning (FESL) has received extensive attentions during the past few years where old features could vanish and new features could appear when learning with streaming data. Existing FESL algorithms are mainly designed for simple datasets with low-dimension features, nevertheless they are ineffective to deal with complex streams such as image sequences. Such crux lies in two facts: (1) the shallow model, which is supported to be feasible for the low-dimension streams, fails to reveal the complex nonlinear patterns of images, and (2) the linear mapping used to recover the vanished features from the new ones is inadequate to reconstruct the old features of image streams. In response, this paper explores a new online learning paradigm: Feature Evolvable Learning with Image Streams (FELIS) which attempts to make the online learners less restrictive and more applicable. In particular, we present a novel ensemble residual network (ERN), in which the prediction is weighted combination of classifiers learnt by the feature representations from several residual blocks, such that the learning is able to start with a shallow network that enjoys fast convergence, and then gradually switch to a deeper model when more data has been received to learn more complex hypotheses. Moreover, we amend the first residual block of ERN as an autoencoder, and then proposed a latent representation mapping (LRM) approach to exploit the relationship between the previous and current feature space of the image streams via minimizing the discrepancy of the latent representations from the two different feature spaces. We carried out experiments on both virtual and real scenarios over large-scale images, and the experimental results demonstrate the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3233\/ida-226799","type":"journal-article","created":{"date-parts":[[2023,6,9]],"date-time":"2023-06-09T10:12:26Z","timestamp":1686305546000},"page":"1047-1063","source":"Crossref","is-referenced-by-count":1,"title":["Feature evolvable learning with image streams"],"prefix":"10.1177","volume":"27","author":[{"given":"Tianxiang","family":"Zheng","sequence":"first","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianmin","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yixiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fujia","family":"Yu","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou, Guangdong, China"},{"name":"Fujian Provincial Key Laboratory of Information Processing and Intelligent Control, Minjiang University, Fuzhou, Fujian, China"},{"name":"State Key Laboratory of Information Security (Institute of Information Engineering), Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"10","key":"10.3233\/IDA-226799_ref1","doi-asserted-by":"crossref","first-page":"2709","DOI":"10.1109\/TKDE.2016.2563424","article-title":"Online learning from trapezoidal data streams","volume":"28","author":"Zhang","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"10.3233\/IDA-226799_ref3","doi-asserted-by":"crossref","unstructured":"E. Beyazit, J. Alagurajah and X. Wu, Online learning from data streams with varying feature spaces, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol.\u00a033, 2019, pp.\u00a03232\u20133239.","DOI":"10.1609\/aaai.v33i01.33013232"},{"key":"10.3233\/IDA-226799_ref4","doi-asserted-by":"crossref","unstructured":"Y. He, B. Wu, D. Wu, E. Beyazit, S. Chen and X. Wu, Online learning from capricious data streams: a generative approach, in: International Joint Conference on Artificial Intelligence Main Track, 2019.","DOI":"10.24963\/ijcai.2019\/346"},{"key":"10.3233\/IDA-226799_ref5","doi-asserted-by":"crossref","unstructured":"Y. He, X. Yuan, S. Chen and X. Wu, Online Learning in Variable Feature Spaces under Incomplete Supervision, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol.\u00a035, 2021, pp.\u00a04106\u20134114.","DOI":"10.1609\/aaai.v35i5.16532"},{"key":"10.3233\/IDA-226799_ref6","unstructured":"Z.-Y. Zhang, P. Zhao, Y. Jiang and Z.-H. Zhou, Learning with Feature and Distribution Evolvable Streams, in: International Conference on Machine Learning, PMLR, 2020, pp.\u00a011317\u201311327."},{"issue":"1","key":"10.3233\/IDA-226799_ref11","first-page":"495","article-title":"Libol: A library for online learning algorithms","volume":"15","author":"Hoi","year":"2014","journal-title":"Journal of Machine Learning Research"},{"issue":"6","key":"10.3233\/IDA-226799_ref12","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1037\/h0042519","article-title":"The perceptron: A probabilistic model for information storage and organization in the brain","volume":"65","author":"Rosenblatt","year":"1958","journal-title":"Psychological Review"},{"key":"10.3233\/IDA-226799_ref13","unstructured":"M. Zinkevich, Online convex programming and generalized infinitesimal gradient ascent, in: Proceedings of the 20th International Conference on Machine Learning (icml-03), 2003, pp.\u00a0928\u2013936."},{"issue":"8","key":"10.3233\/IDA-226799_ref15","doi-asserted-by":"crossref","first-page":"2165","DOI":"10.1109\/TSP.2004.830991","article-title":"Online learning with kernels","volume":"52","author":"Kivinen","year":"2004","journal-title":"IEEE Transactions on Signal Processing"},{"issue":"2","key":"10.3233\/IDA-226799_ref16","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s10994-012-5319-2","article-title":"Online multiple kernel classification","volume":"90","author":"Hoi","year":"2013","journal-title":"Machine Learning"},{"key":"10.3233\/IDA-226799_ref17","doi-asserted-by":"crossref","unstructured":"D. Sahoo, S.C. Hoi and B. Li, Online multiple kernel regression, in: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014, pp.\u00a0293\u2013302.","DOI":"10.1145\/2623330.2623712"},{"key":"10.3233\/IDA-226799_ref19","doi-asserted-by":"crossref","unstructured":"K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp.\u00a0770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"10.3233\/IDA-226799_ref20","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.jpdc.2019.03.003","article-title":"The security of machine learning in an adversarial setting: A survey","volume":"130","author":"Wang","year":"2019","journal-title":"Journal of Parallel and Distributed Computing"},{"key":"10.3233\/IDA-226799_ref21","doi-asserted-by":"crossref","unstructured":"S. Teerapittayanon, B. McDanel and H.-T. Kung, Branchynet: Fast inference via early exiting from deep neural networks, in: 2016 23rd International Conference on Pattern Recognition (ICPR), IEEE, 2016, pp.\u00a02464\u20132469.","DOI":"10.1109\/ICPR.2016.7900006"},{"key":"10.3233\/IDA-226799_ref22","unstructured":"G. Zhou, K. Sohn and H. Lee, Online incremental feature learning with denoising autoencoders, in: Artificial Intelligence and Statistics, PMLR, 2012, pp.\u00a01453\u20131461."},{"key":"10.3233\/IDA-226799_ref23","unstructured":"S.-W. Lee, C.-Y. Lee, D.-H. Kwak, J. Kim, J. Kim and B.-T. Zhang, Dual-Memory Deep Learning Architectures for Lifelong Learning of Everyday Human Behaviors., in: IJCAI, 2016, pp.\u00a01669\u20131675."},{"issue":"1","key":"10.3233\/IDA-226799_ref25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"Journal of Computer and System Sciences"},{"issue":"2\u20133","key":"10.3233\/IDA-226799_ref26","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/s10994-007-5016-8","article-title":"Logarithmic regret algorithms for online convex optimization","volume":"69","author":"Hazan","year":"2007","journal-title":"Machine Learning"},{"issue":"2","key":"10.3233\/IDA-226799_ref27","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1561\/2200000018","article-title":"Online learning and online convex optimization","volume":"4","author":"Shalev-Shwartz","year":"2011","journal-title":"Foundations and trends in Machine Learning"},{"issue":"5","key":"10.3233\/IDA-226799_ref28","first-page":"1","article-title":"Scaling learning algorithms towards AI","volume":"34","author":"Bengio","year":"2007","journal-title":"Large-scale Kernel Machines"},{"issue":"4","key":"10.3233\/IDA-226799_ref29","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Computation"},{"key":"10.3233\/IDA-226799_ref31","doi-asserted-by":"crossref","unstructured":"Y. Freund and R.E. Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting, in: Conference on Learning Theory, 1997.","DOI":"10.1006\/jcss.1997.1504"},{"key":"10.3233\/IDA-226799_ref33","unstructured":"J. Read, A. Bifet, G. Holmes and B. Pfahringer, Streaming multi-label classification, in: Proceedings of the Second Workshop on Applications of Pattern Analysis, JMLR Workshop and Conference Proceedings, 2011, pp.\u00a019\u201325."},{"issue":"5786","key":"10.3233\/IDA-226799_ref34","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"issue":"14","key":"10.3233\/IDA-226799_ref35","doi-asserted-by":"crossref","first-page":"e49","DOI":"10.1093\/bioinformatics\/btl242","article-title":"Integrating structured biological data by kernel maximum mean discrepancy","volume":"22","author":"Borgwardt","year":"2006","journal-title":"Bioinformatics"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-226799","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:20:08Z","timestamp":1777454408000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-226799"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,20]]},"references-count":25,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/ida-226799","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,20]]}}}