{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T07:59:35Z","timestamp":1783065575729,"version":"3.54.6"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T00:00:00Z","timestamp":1681776000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T00:00:00Z","timestamp":1681776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001774","name":"University of Sydney","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001774","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the paradigm of online continual learning, one neural network is exposed to a sequence of tasks, where the data arrive in an online fashion and previously seen data are not accessible. Such online fashion causes insufficient learning and severe forgetting on past tasks issues, preventing a good stability-plasticity trade-off, where ideally the network is expected to have high plasticity to adapt to new tasks well and have the stability to prevent forgetting on old tasks simultaneously. To solve these issues, we propose a trust-region adaptive frequency approach, which alternates between standard-process and intra-process updates. Specifically, the standard-process replays data stored in a coreset and interleaves the data with current data, and the intra-process updates the network parameters based on the coreset. Furthermore, to improve the unsatisfactory performance stemming from online fashion, the frequency of the intra-process is adjusted based on a trust region, which is measured by the confidence score of current data. During the intra-process, we distill the dark knowledge to retain useful learned knowledge. Moreover, to store more representative data in the coreset, a confidence-based coreset selection is presented in an online manner. The experimental results on standard benchmarks show that the proposed method significantly outperforms state-of-art continual learning algorithms.<\/jats:p>","DOI":"10.1007\/s11263-023-01775-0","type":"journal-article","created":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T17:02:33Z","timestamp":1681837353000},"page":"1825-1839","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Trust-Region Adaptive Frequency for Online Continual Learning"],"prefix":"10.1007","volume":"131","author":[{"given":"Yajing","family":"Kong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maoying","family":"Qiao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dacheng","family":"Tao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,4,18]]},"reference":[{"key":"1775_CR1","doi-asserted-by":"crossref","unstructured":"Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2017). Expert gate: Lifelong learning with a network of experts. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3366\u20133375).","DOI":"10.1109\/CVPR.2017.753"},{"key":"1775_CR2","doi-asserted-by":"crossref","unstructured":"Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., & Tuytelaars, T. (2018). Memory aware synapses: Learning what (not) to forget. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 139\u2013154).","DOI":"10.1007\/978-3-030-01219-9_9"},{"key":"1775_CR3","doi-asserted-by":"crossref","unstructured":"Aljundi, R., Belilovsky, E., Tuytelaars, T., Charlin, L., Caccia, M., Lin, M., & Page-Caccia, L. (2019a). Online continual learning with maximal interfered retrieval. In Advances in Neural Information Processing Systems (pp. 11849\u201311860).","DOI":"10.1109\/CVPR.2019.01151"},{"key":"1775_CR4","unstructured":"Aljundi, R., Lin, M., Goujaud, B., & Bengio, Y. (2019b). Gradient based sample selection for online continual learning. In Advances in Neural Information Processing Systems (NeurIPS) 32, (pp. 11816\u201311825)."},{"key":"1775_CR5","unstructured":"Arani, E., Sarfraz, F., & Zonooz, B. (2022). Learning fast, learning slow: A general continual learning method based on complementary learning system. In International Conference on Learning Representations (ICLR)."},{"key":"1775_CR6","doi-asserted-by":"crossref","unstructured":"Bang, J., Kim, H., Yoo, Y., Ha, J. W., & Choi, J. (2021). Rainbow memory: Continual learning with a memory of diverse samples. In  Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 8218\u20138227).","DOI":"10.1109\/CVPR46437.2021.00812"},{"key":"1775_CR7","unstructured":"Buzzega, P., Boschini, M., Porrello, A., Abati, D., & Calderara, S. (2020). Dark experience for general continual learning: A strong, simple baseline. arXiv:2004.07211."},{"key":"1775_CR8","doi-asserted-by":"crossref","unstructured":"Buzzega, P., Boschini, M., Porrello, A., & Calderara, S. (2021). Rethinking experience replay: A bag of tricks for continual learning. In 2020 25th International Conference on Pattern Recognition (ICPR), IEEE (pp. 2180\u20132187).","DOI":"10.1109\/ICPR48806.2021.9412614"},{"issue":"2","key":"1775_CR9","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s10107-009-0286-5","volume":"127","author":"C Cartis","year":"2011","unstructured":"Cartis, C., Gould, N. I., & Toint, P. L. (2011). Adaptive cubic regularisation methods for unconstrained optimization. Part I: Motivation, convergence and numerical results. Mathematical Programming, 127(2), 245\u2013295.","journal-title":"Mathematical Programming"},{"key":"1775_CR10","doi-asserted-by":"crossref","unstructured":"Chaudhry, A., Dokania, P. K., Ajanthan, T., & Torr, P. H. (2018a). Riemannian walk for incremental learning: Understanding forgetting and intransigence. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 532\u2013547).","DOI":"10.1007\/978-3-030-01252-6_33"},{"key":"1775_CR11","unstructured":"Chaudhry, A., Ranzato, M., Rohrbach, M., & Elhoseiny, M. (2018b). Efficient lifelong learning with a-gem. arXiv:1812.00420."},{"key":"1775_CR12","unstructured":"Chaudhry, A., Rohrbach, M., Elhoseiny, M., Ajanthan, T., Dokania, P. K., Torr, P. H., & Ranzato, M. (2019). Continual learning with tiny episodic memories. In International conference on machine learning Workshop: Multi-Task and Lifelong Reinforcement Learning."},{"key":"1775_CR13","doi-asserted-by":"crossref","unstructured":"Conn, A. R., Gould, N. I., & Toint, P. L. (2000). Trust region methods. Society for Industrial and Applied Mathematics (SIAM), Philadelphia. vol\u00a01","DOI":"10.1137\/1.9780898719857"},{"key":"1775_CR14","first-page":"3366","volume":"44","author":"M Delange","year":"2021","unstructured":"Delange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2021). A continual learning survey: Defying forgetting in classification tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 3366\u20133385.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"1775_CR15","doi-asserted-by":"publisher","first-page":"2341","DOI":"10.1137\/120880811","volume":"23","author":"S Ghadimi","year":"2013","unstructured":"Ghadimi, S., & Lan, G. (2013). Stochastic first-and zeroth-order methods for nonconvex stochastic programming. SIAM Journal on Optimization, 23(4), 2341\u20132368.","journal-title":"SIAM Journal on Optimization"},{"issue":"6","key":"1775_CR16","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1007\/s11263-021-01453-z","volume":"129","author":"J Gou","year":"2021","unstructured":"Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021). Knowledge distillation: A survey. International Journal of Computer Vision, 129(6), 1789\u20131819.","journal-title":"International Journal of Computer Vision"},{"key":"1775_CR17","doi-asserted-by":"crossref","unstructured":"Grossberg, S. (1982). How does a brain build a cognitive code? In Studies of Mind and Brain: Neural principles of learning, perception, development, cognition, and motor control (pp. 1\u201352). Springer.","DOI":"10.1007\/978-94-009-7758-7_1"},{"key":"1775_CR18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang ,X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 770\u2013778).","DOI":"10.1109\/CVPR.2016.90"},{"key":"1775_CR19","doi-asserted-by":"crossref","unstructured":"Hou, S., Pan, X., Loy, C. C., Wang, Z., & Lin, D. (2018). Lifelong learning via progressive distillation and retrospection. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 437\u2013452).","DOI":"10.1007\/978-3-030-01219-9_27"},{"key":"1775_CR20","doi-asserted-by":"crossref","unstructured":"Hou, S., Pan, X., Loy, C. C., Wang, Z., &Lin, D. (2019). Learning a unified classifier incrementally via rebalancing. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (pp 831\u2013839).","DOI":"10.1109\/CVPR.2019.00092"},{"key":"1775_CR21","doi-asserted-by":"crossref","unstructured":"Isele, D., & Cosgun, A. (2018). Selective experience replay for lifelong learning. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 32, 3302\u20133309.","DOI":"10.1609\/aaai.v32i1.11595"},{"key":"1775_CR22","unstructured":"Jerfel, G., Grant, E., Griffiths, T., &Heller, KA. (2019). Reconciling meta-learning and continual learning with online mixtures of tasks. In Advances in Neural Information Processing Systems (pp. 9122\u20139133)."},{"key":"1775_CR23","unstructured":"Jin, X., Sadhu, A., Du, J., & Ren, X. (2021). Gradient-based editing of memory examples for online task-free continual learning. 2006.15294."},{"issue":"13","key":"1775_CR24","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J Kirkpatrick","year":"2017","unstructured":"Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017). Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences, 114(13), 3521\u20133526.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"1775_CR25","doi-asserted-by":"crossref","unstructured":"Kong, Y., Liu, L., Wang, Z., & Tao, D. (2022). Balancing stability and plasticity through advanced null space in continual learning. InEuropean Conference on Computer Vision.","DOI":"10.1007\/978-3-031-19809-0_13"},{"key":"1775_CR26","volume-title":"Learning multiple layers of features from tiny images","author":"A Krizhevsky","year":"2009","unstructured":"Krizhevsky, A., Hinton, G., et al. (2009). Learning multiple layers of features from tiny images. Citeseer: Princeton."},{"issue":"11","key":"1775_CR27","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278\u20132324.","journal-title":"Proceedings of the IEEE"},{"key":"1775_CR28","unstructured":"Lee, S. W., Kim, J. H., Jun, J., Ha, J. W., & Zhang, B. T. (2017). Overcoming catastrophic forgetting by incremental moment matching. In Advances in Neural Information Processing Systems (pp. 4652\u20134662)."},{"key":"1775_CR29","unstructured":"Li, X., Zhou, Y., Wu, T., Socher, R., & Xiong, C. (2019). Learn to grow: A continual structure learning framework for overcoming catastrophic forgetting. arXiv:1904.00310."},{"issue":"12","key":"1775_CR30","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","volume":"40","author":"Z Li","year":"2017","unstructured":"Li, Z., & Hoiem, D. (2017). Learning without forgetting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(12), 2935\u20132947.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"1775_CR31","unstructured":"Lin, S., Yang, L., Fan, D., & Zhang, J. (2022). Trgp: Trust region gradient projection for continual learning. 2202.02931."},{"key":"1775_CR32","doi-asserted-by":"crossref","unstructured":"Liu, Y., Schiele, B., & Sun, Q. (2021). Adaptive aggregation networks for class-incremental learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (pp. 2544\u20132553).","DOI":"10.1109\/CVPR46437.2021.00257"},{"key":"1775_CR33","unstructured":"Lopez-Paz, D., & Ranzato, M. (2017). Gradient episodic memory for continual learning. In Advances in Neural Information Processing Systems (pp. 6467\u20136476)."},{"key":"1775_CR34","unstructured":"Madaan, D., Yoon, J., Li, Y., Liu, Y., & Hwang, S. J. (2022). Representational continuity for unsupervised continual learning. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=9Hrka5PA7LW."},{"key":"1775_CR35","doi-asserted-by":"crossref","unstructured":"Mallya, A., & Lazebnik, S. (2018). Packnet: Adding multiple tasks to a single network by iterative pruning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 7765\u20137773).","DOI":"10.1109\/CVPR.2018.00810"},{"key":"1775_CR36","doi-asserted-by":"crossref","unstructured":"Mallya, A., Davis, D., & Lazebnik, S. (2018). Piggyback: Adapting a single network to multiple tasks by learning to mask weights. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 67\u201382).","DOI":"10.1007\/978-3-030-01225-0_5"},{"key":"1775_CR37","doi-asserted-by":"crossref","unstructured":"McCloskey, M., & Cohen, N. J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. In Psychology of Learning and Motivation, vol\u00a024 (pp 109\u2013165). Elsevier.","DOI":"10.1016\/S0079-7421(08)60536-8"},{"key":"1775_CR38","doi-asserted-by":"crossref","unstructured":"Mermillod, M., Bugaiska, A., & Bonin, P. (2013). The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects. Frontiers in psychology, vol. 4, 2013, Art. no. 504.","DOI":"10.3389\/fpsyg.2013.00504"},{"key":"1775_CR39","unstructured":"Mirzadeh, S. I., Farajtabar, M., Pascanu, R., & Ghasemzadeh, H. (2020). Understanding the role of training regimes in continual learning. In Advances in Neural Information Processing Systems (NeurIPS), 33, 7308\u20137320."},{"key":"1775_CR40","unstructured":"Nguyen, C. V., Li, Y., Bui, T. D., & Turner, R. E. (2017). Variational continual learning. arXiv:1710.10628."},{"key":"1775_CR41","volume-title":"Numerical optimization","author":"J Nocedal","year":"2006","unstructured":"Nocedal, J., & Wright, S. (2006). Numerical optimization. Berlin: Springer."},{"key":"1775_CR42","doi-asserted-by":"crossref","unstructured":"Ostapenko, O., Puscas, M., Klein, T., Jahnichen, P., & Nabi, M. (2019). Learning to remember: A synaptic plasticity driven framework for continual learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (pp. 11321\u201311329).","DOI":"10.1109\/CVPR.2019.01158"},{"key":"1775_CR43","doi-asserted-by":"crossref","unstructured":"Park, D., Hong, S., Han, B., & Lee, K. M. (2019). Continual learning by asymmetric loss approximation with single-side overestimation. In Proceedings of the IEEE International Conference on Computer Vision (pp. 3335\u201333440).","DOI":"10.1109\/ICCV.2019.00343"},{"issue":"4","key":"1775_CR44","doi-asserted-by":"publisher","first-page":"921","DOI":"10.1007\/s11263-020-01392-1","volume":"129","author":"Y Peng","year":"2021","unstructured":"Peng, Y., Qi, J., Ye, Z., & Zhuo, Y. (2021). Hierarchical visual-textual knowledge distillation for life-long correlation learning. International Journal of Computer Vision, 129(4), 921\u2013941.","journal-title":"International Journal of Computer Vision"},{"key":"1775_CR45","unstructured":"Pham, Q., Liu, C., & Hoi, S. (2021). Dualnet: Continual learning, fast and slow. Advances in Neural Information Processing Systems, 34."},{"key":"1775_CR46","unstructured":"Pham, Q., Liu, C., & Steven, H. (2022). Continual normalization: Rethinking batch normalization for online continual learning. In ICLR."},{"key":"1775_CR47","unstructured":"Rao, D., Visin, F., Rusu, A., Pascanu, R., Teh, Y. W., & Hadsell, R. (2019). Continual unsupervised representation learning. In Advances in Neural Information Processing Systems (pp. 7647\u20137657)."},{"issue":"2","key":"1775_CR48","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1037\/0033-295X.97.2.285","volume":"97","author":"R Ratcliff","year":"1990","unstructured":"Ratcliff, R. (1990). Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions. Psychological Review, 97(2), 285.","journal-title":"Psychological Review"},{"key":"1775_CR49","doi-asserted-by":"crossref","unstructured":"Rebuffi, S. A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017). icarl: Incremental classifier and representation learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2001\u20132010).","DOI":"10.1109\/CVPR.2017.587"},{"key":"1775_CR50","unstructured":"Riemer, M., Cases, I., Ajemian, R., Liu, M., Rish, I., Tu, Y., & Tesauro, G. (2018). Learning to learn without forgetting by maximizing transfer and minimizing interference. arXiv:1810.11910."},{"key":"1775_CR51","unstructured":"Riemer, M., Cases, I., Ajemian, R., Liu, M., Rish, I., Tu, Y., & Tesauro, G. (2019). Learning to learn without forgetting by maximizing transfer and minimizing interference. 1810.11910."},{"key":"1775_CR52","unstructured":"Ritter, H., Botev, A., & Barber, D. (2018). Online structured laplace approximations for overcoming catastrophic forgetting. In Advances in Neural Information Processing Systems (pp. 3738\u20133748)."},{"key":"1775_CR53","unstructured":"Rolnick, D., Ahuja, A., Schwarz, J., Lillicrap, T., & Wayne, G. (2019). Experience replay for continual learning. In Advances in Neural Information Processing Systems (pp. 350\u2013360)."},{"key":"1775_CR54","unstructured":"Rusu, AA., Rabinowitz, NC., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016). Progressive neural networks. arXiv:1606.04671."},{"key":"1775_CR55","unstructured":"Schwarz, J., Czarnecki, W., Luketina, J., Grabska-Barwinska, A., Teh, Y. W., Pascanu, R., & Hadsell, R. (2018). Progress & compress: A scalable framework for continual learning. In International Conference on Machine Learning, PMLR (pp. 4528\u20134537)."},{"key":"1775_CR56","unstructured":"Serra, J., Suris, D., Miron, M., & Karatzoglou, A. (2018). Overcoming catastrophic forgetting with hard attention to the task. In International Conference on Machine Learning, PMLR, (pp. 4548\u20134557)."},{"key":"1775_CR57","unstructured":"Shin, H., Lee, J. K., Kim, J., & Kim, J. (2017). Continual learning with deep generative replay. In Advances in Neural Information Processing Systems (pp. 2990\u20132999)."},{"key":"1775_CR58","unstructured":"Stanford. (2015). Tiny ImageNet Challenge (CS231n). http:\/\/tiny-imagenet.herokuapp.com\/."},{"key":"1775_CR59","unstructured":"Sun, S., Calandriello, D., Hu, H., Li, A., & Titsias, M. (2022). Information-theoretic online memory selection for continual learning. In International Conference on Learning Representations."},{"key":"1775_CR60","doi-asserted-by":"crossref","unstructured":"Tang, S., Chen, D., Zhu, J., Yu, S., & Ouyang, W. (2021). Layerwise optimization by gradient decomposition for continual learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (pp. 9634\u20139643).","DOI":"10.1109\/CVPR46437.2021.00951"},{"issue":"1","key":"1775_CR61","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1145\/3147.3165","volume":"11","author":"JS Vitter","year":"1985","unstructured":"Vitter, J. S. (1985). Random sampling with a reservoir. ACM Transactions on Mathematical Software (TOMS), 11(1), 37\u201357.","journal-title":"ACM Transactions on Mathematical Software (TOMS)"},{"key":"1775_CR62","doi-asserted-by":"crossref","unstructured":"Wang, F. Y., Zhou, D. W., Ye, H. J., & Zhan, D. C. (2022a). Foster: Feature boosting and compression for class-incremental learning. arXiv:2204.04662.","DOI":"10.1007\/978-3-031-19806-9_23"},{"key":"1775_CR63","first-page":"9963","volume":"119","author":"Z Wang","year":"2020","unstructured":"Wang, Z., Liu, L., & Tao, D. (2020). Deep streaming label learning. International Conference on Machine Learning (ICML), 119, 9963\u20139972.","journal-title":"International Conference on Machine Learning (ICML)"},{"key":"1775_CR64","doi-asserted-by":"crossref","unstructured":"Wang, Z., Liu, L., Duan, Y., Kong, Y., & Tao, D. (2022b). Continual learning with lifelong vision transformer. In  Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 171\u2013181).","DOI":"10.1109\/CVPR52688.2022.00027"},{"issue":"8","key":"1775_CR65","doi-asserted-by":"publisher","first-page":"8594","DOI":"10.1609\/aaai.v36i8.20837","volume":"36","author":"Z Wang","year":"2022","unstructured":"Wang, Z., Liu, L., Duan, Y., & Tao, D. (2022). Continual learning through retrieval and imagination. Proceedings of the AAAI Conference on Artificial Intelligence, 36(8), 8594\u20138602. https:\/\/doi.org\/10.1609\/aaai.v36i8.20837. ojs.aaai.org\/index.php\/AAAI\/article\/view\/20837.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"1775_CR66","doi-asserted-by":"crossref","unstructured":"Wang, Z., Liu, L., Kong, Y., Duan, Y., & Tao, D. (2022d). Online continual learning with contrastive vision transformer. In European Conference on Computer Vision.","DOI":"10.1109\/CVPR52688.2022.00027"},{"key":"1775_CR67","unstructured":"Wu, L., Liu, B., Stone, P., & Liu, Q. (2020). Firefly neural architecture descent: A general approach for growing neural networks. In Advances in Neural Information Processing Systems (NeurIPS), 33, 22373\u201322383."},{"key":"1775_CR68","doi-asserted-by":"crossref","unstructured":"Yan, S., Xie, J., & He, X. (2021). Der: Dynamically expandable representation for class incremental learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (pp. 3014\u20133023).","DOI":"10.1109\/CVPR46437.2021.00303"},{"key":"1775_CR69","unstructured":"Yin, D., Farajtabar, M., Li, A., Levine, N., & Mott, A. (2020). Optimization and generalization of regularization-based continual learning: A loss approximation viewpoint. 2006.10974."},{"key":"1775_CR70","unstructured":"Yoon, J., Kim, S., Yang, E., & Hwang, S. J. (2019). Scalable and order-robust continual learning with additive parameter decomposition. arXiv:1902.09432."},{"key":"1775_CR71","unstructured":"Zenke, F., Poole, B., & Ganguli, S. (2017). Continual learning through synaptic intelligence. In International Conference on Machine Learning, PMLR, (pp. 3987\u20133995)."},{"issue":"8","key":"1775_CR72","doi-asserted-by":"publisher","first-page":"2474","DOI":"10.1007\/s11263-021-01473-9","volume":"129","author":"T Zhao","year":"2021","unstructured":"Zhao, T., Han, J., Yang, L., Wang, B., & Zhang, D. (2021). Soda: Weakly supervised temporal action localization based on astute background response and self-distillation learning. International Journal of Computer Vision, 129(8), 2474\u20132498.","journal-title":"International Journal of Computer Vision"},{"key":"1775_CR73","unstructured":"Zhou, G., Sohn, K., & Lee, H. (2012). Online incremental feature learning with denoising autoencoders. In Artificial Intelligence and Statistics (pp. 1453\u20131461)."}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-023-01775-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-023-01775-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-023-01775-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,17]],"date-time":"2023-06-17T09:10:38Z","timestamp":1686993038000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-023-01775-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,18]]},"references-count":73,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["1775"],"URL":"https:\/\/doi.org\/10.1007\/s11263-023-01775-0","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,18]]},"assertion":[{"value":"12 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}