{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T19:03:05Z","timestamp":1773342185074,"version":"3.50.1"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T00:00:00Z","timestamp":1683504000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T00:00:00Z","timestamp":1683504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62071502"],"award-info":[{"award-number":["62071502"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1811461"],"award-info":[{"award-number":["U1811461"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100015956","name":"Special Project for Research and Development in Key areas of Guangdong Province","doi-asserted-by":"publisher","award":["2020B1111190001"],"award-info":[{"award-number":["2020B1111190001"]}],"id":[{"id":"10.13039\/501100015956","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Intell."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep learning has shown its human-level performance in various applications. However, current deep learning models are characterized by catastrophic forgetting of old knowledge when learning new classes. This poses a challenge such as in intelligent diagnosis systems where initially only training data of a limited number of diseases are available. In this case, updating the intelligent system with data of new diseases would inevitably downgrade its performance on previously learned diseases. Inspired by the process of learning new knowledge in human brains, we propose a Bayesian generative model for continual learning built on a fixed pre-trained feature extractor. In this model, knowledge of each old class can be compactly represented by a collection of statistical distributions, e.g., with Gaussian mixture models, and naturally kept from forgetting in continual learning over time. Unlike existing class-incremental learning methods, the proposed approach is not sensitive to the continual learning process and can be additionally well applied to the data-incremental learning scenario. Experiments on multiple medical and natural image classification tasks reveal that the proposed approach outperforms state-of-the-art approaches that even keep some images of old classes during continual learning of new classes.<\/jats:p>","DOI":"10.1007\/s44267-023-00005-y","type":"journal-article","created":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T02:01:30Z","timestamp":1683511290000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Continual learning with Bayesian model based on a fixed pre-trained feature extractor"],"prefix":"10.1007","volume":"1","author":[{"given":"Yang","family":"Yang","sequence":"first","affiliation":[]},{"given":"Zhiying","family":"Cui","sequence":"additional","affiliation":[]},{"given":"Junjie","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Changhong","family":"Zhong","sequence":"additional","affiliation":[]},{"given":"Wei-Shi","family":"Zheng","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8714-0369","authenticated-orcid":false,"given":"Ruixuan","family":"Wang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,5,8]]},"reference":[{"issue":"6","key":"5_CR1","doi-asserted-by":"publisher","first-page":"954","DOI":"10.1038\/s41591-019-0447-x","volume":"25","author":"D. Ardila","year":"2019","unstructured":"Ardila, D., Kiraly, A. P., Bharadwaj, S., Choi, B., Reicher, J. J., Peng, L., Tse, D., Etemadi, M., Ye, W., Corrado, G., Naidich, D. P., & Shetty, S. (2019). End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nature Medicine 25(6), 954\u2013961.","journal-title":"Nature Medicine"},{"key":"5_CR2","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","volume":"24","author":"J. De Fauw","year":"2018","unstructured":"De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O\u2019Donoghue, B., Visentin, D., Van Den Driessche, G., Lakshminarayanan, B., Meyer, C., Mackinder, F., Bouton, S., Ayoub, K., Chopra, R., King, D., Karthikesalingam, A., Hughes, C. O., Raine, R., Hughes, J., Sim, D. A., Egan, C., Tufail, A., Montgomery, H., Hassabis, D., Rees, G., Back, T., Khaw, P. T., Suleyman, M., Cornebise, J., Keane, P. A., & Ronneberger, O. (2018). Clinically applicable deep learning for diagnosis and referral in retinal disease. Nature Medicine 24, 1342\u20131350.","journal-title":"Nature Medicine"},{"key":"5_CR3","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A. Esteva","year":"2017","unstructured":"Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118.","journal-title":"Nature"},{"key":"5_CR4","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","volume":"577","author":"S. M. McKinney","year":"2020","unstructured":"McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., Etemadi, M., Garcia-Vicente, F., Gilbert, F. J., Halling-Brown, M., Hassabis, D., Jansen, S., Karthikesalingam, A., Kelly, C. J., King, D., Ledsam, J. R., Melnick, D., Mostofi, H., Peng, L., Reicher, J. J., Romera-Paredes, B., Sidebottom, R., Suleyman, M., Tse, D., Young, K. C., De Fauw, J., & Shetty, S. (2020). International evaluation of an AI system for breast cancer screening. Nature 577, 89\u201394.","journal-title":"Nature"},{"key":"5_CR5","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.neucom.2019.11.023","volume":"381","author":"G. Ciaparrone","year":"2020","unstructured":"Ciaparrone, G., S\u00e1nchez, F. L., Tabik, S., Troiano, L., Tagliaferri, R., & Herrera, F. (2020). Deep learning in video multi-object tracking: a survey. Neurocomputing 381, 61\u201388.","journal-title":"Neurocomputing"},{"key":"5_CR6","first-page":"2739","volume":"43","author":"D. B. Sam","year":"2021","unstructured":"Sam, D. B., Peri, S. V., Sundararaman, M. N., Kamath, A., & Radhakrishnan, V. B. (2021). Locate, size and count: accurately resolving people in dense crowds via detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 2739\u20132751.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"5_CR7","first-page":"8361","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"H. Xiong","year":"2019","unstructured":"Xiong, H., Lu, H., Liu, C., Liu, L., Cao, Z., & Shen, C. (2019). From open set to closed set: counting objects by spatial divide-and-conquer. In Proceedings of the IEEE international conference on computer vision (pp. 8361\u20138370). Los Alamitos: IEEE."},{"issue":"3","key":"5_CR8","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.1109\/TITS.2018.2838132","volume":"20","author":"X. Hu","year":"2019","unstructured":"Hu, X., Xu, X., Xiao, Y., Chen, H., He, S., Qin, J., & Heng, P.-A. (2019). SINet: a scale-insensitive convolutional neural network for fast vehicle detection. IEEE Transactions on Intelligent Transportation Systems 20(3), 1010\u20131019.","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"5_CR9","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Blog."},{"key":"5_CR10","first-page":"5998","volume-title":"Advances in neural information processing systems","author":"A. Vaswani","year":"2017","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141., & Polosukhin, I. (2017). Attention is all you need. In I. Guyon, U. von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a030, pp. 5998\u20136008). Red Hook: Curran Associates."},{"key":"5_CR11","unstructured":"Baweja, C., Glocker, B., & Kamnitsas, K. (2018). Towards continual learning in medical imaging. arXiv preprint. arXiv:1811.02496."},{"key":"5_CR12","unstructured":"Diethe, T., Borchert, T., Thereska, E., Balle, B., & Lawrence, N. (2019). Continual learning in practice. arXiv preprint. arXiv:1903.05202."},{"issue":"4","key":"5_CR13","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/S1364-6613(99)01294-2","volume":"3","author":"R. M. French","year":"1999","unstructured":"French, R. M. (1999). Catastrophic forgetting in connectionist networks. Trends in Cognitive Sciences 3(4), 128\u2013135.","journal-title":"Trends in Cognitive Sciences"},{"key":"5_CR14","unstructured":"Goodfellow, I. J., Mirza, M., Xiao, D., Courville, A., & Bengio, Y. (2013). An empirical investigation of catastrophic forgetting in gradient-based neural networks. arXiv preprint. arXiv:1312.6211."},{"key":"5_CR15","first-page":"3390","volume-title":"Proceedings of the AAAI conference on artificial intelligence 2018","author":"R. Kemker","year":"2018","unstructured":"Kemker, R., McClure, M., Abitino, A., Hayes, T. L., & Kanan, C. (2018). Measuring catastrophic forgetting in neural networks. In Proceedings of the AAAI conference on artificial intelligence 2018 (pp. 3390\u20133398). Menlo Park: AAAI Press."},{"issue":"13","key":"5_CR16","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J. Kirkpatrick","year":"2017","unstructured":"Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., & Quan, J., Ramalho, T., Grabska-Barwinska, A., Hassabis, D., Clopath, C., Kumaran, D., & Hadsell, R. (2017). Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences of the United States of America 114(13), 3521\u20133526.","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"5_CR17","unstructured":"Yoon, J., Yang, E., Lee, J., & Hwang, S. J. (2018). Lifelong learning with dynamically expandable networks. [Paper presentation]. The 6th International Conference on Learning Representations (ICLR 2018), Vancouver, Canada. https:\/\/openreview.net\/forum?id=Sk7KsfW0-"},{"issue":"12","key":"5_CR18","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","volume":"40","author":"Z. Li","year":"2018","unstructured":"Li, Z., & Hoiem, D. (2018). Learning without forgetting. IEEE Transactions on Pattern Analysis and Machine Intelligence 40(12), 2935\u20132947.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"5_CR19","first-page":"2001","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S.-A. Rebuffi","year":"2017","unstructured":"Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017). iCaRL: incremental classifier and representation learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2001\u20132010). Los Alamitos: IEEE."},{"key":"5_CR20","first-page":"2990","volume-title":"Advances in neural information processing systems","author":"H. Shin","year":"2017","unstructured":"Shin, H., Kwon Lee, J., Kim, J., & Kim, J. (2017). Continual learning with deep generative replay. In I. Guyon, U. von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a030, pp. 2990\u20132999). Red Hook: Curran Associates."},{"key":"5_CR21","first-page":"397","volume-title":"Medical image computing and computer assisted intervention","author":"Y. Yang","year":"2021","unstructured":"Yang, Y., Cui, Z., Xu, J., Zhong, C., Wang, R., & Zheng, W.-S. (2021). Continual learning with Bayesian model based on a fixed pre-trained feature extractor. In Medical image computing and computer assisted intervention (pp. 397\u2013406). Berlin: Springer."},{"key":"5_CR22","first-page":"3931","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"D. Abati","year":"2020","unstructured":"Abati, D., Tomczak, J., Blankevoort, T., Calderara, S., Cucchiara, R., & Bejnordi, B. E. (2020). Conditional channel gated networks for task-aware continual learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3931\u20133940). Los Alamitos: IEEE."},{"key":"5_CR23","first-page":"4394","volume-title":"Advances in neural information processing systems","author":"H. Ahn","year":"2019","unstructured":"Ahn, H., Cha, S., Lee, D., & Moon, T. (2019). Uncertainty-based continual learning with adaptive regularization. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019Alch\u00e9-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a032, pp. 4394\u20134404). Red Hook: Curran Associates."},{"key":"5_CR24","unstructured":"Fernando, C., Banarse, D., Blundell, C., Zwols, Y., Ha, D., Rusu, A. A., Pritzel, A., & PathNet, D. W. (2017). Evolution channels gradient descent in super neural networks. arXiv preprint. arXiv:1701.08734."},{"key":"5_CR25","first-page":"3647","volume-title":"Advances in neural information processing systems","author":"S. Jung","year":"2020","unstructured":"Jung, S., Ahn, H., Cha, S., & Moon, T. (2020). Continual learning with node-importance based adaptive group sparse regularization. In H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, & H. Lin (Eds.), Advances in neural information processing systems (Vol.\u00a033, pp. 3647\u20133658). Red Hook: Curran Associates."},{"key":"5_CR26","first-page":"520","volume-title":"Medical image computing and computer assisted intervention","author":"H.-E. Kim","year":"2018","unstructured":"Kim, H.-E., Kim, S., & Lee, J. (2018). Keep and learn: continual learning by constraining the latent space for knowledge preservation in neural networks. In Medical image computing and computer assisted intervention (pp. 520\u2013528). Berlin: Springer."},{"key":"5_CR27","first-page":"7765","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"A. Mallya","year":"2018","unstructured":"Mallya, A., & Lazebnik, S. (2018). PackNet: adding multiple tasks to a single network by iterative pruning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 7765\u20137773). Los Alamitos: IEEE."},{"key":"5_CR28","first-page":"3987","volume":"70","author":"F. Zenke","year":"2017","unstructured":"Zenke, F., Poole, B., & Ganguli, S. (2017). Continual learning through synaptic intelligence. Proceedings of Machine Learning Research 70, 3987\u20133995.","journal-title":"Proceedings of Machine Learning Research"},{"key":"5_CR29","first-page":"139","volume-title":"Proceedings of the European conference on computer vision","author":"R. Aljundi","year":"2018","unstructured":"Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., & Tuytelaars, T. (2018). Memory aware synapses: learning what (not) to forget. In Proceedings of the European conference on computer vision (pp. 139\u2013154). Berlin: Springer."},{"key":"5_CR30","first-page":"6467","volume-title":"Advances in neural information processing systems","author":"D. Lopez-Paz","year":"2017","unstructured":"Lopez-Paz, D., & Ranzato, M. (2017). Gradient episodic memory for continual learning. In I. Guyon, U. von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a030, pp. 6467\u20136476). Red Hook: Curran Associates."},{"key":"5_CR31","unstructured":"Chaudhry, A., Ranzato, M., Rohrbach, M., & Elhoseiny, M. (2018). Efficient lifelong learning with a-gem. arXiv preprint. arXiv:1812.00420."},{"key":"5_CR32","first-page":"9634","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S. Tang","year":"2021","unstructured":"Tang, S., Chen, D., Zhu, J., Yu, S., & Ouyang, W. (2021). Layerwise optimization by gradient decomposition for continual learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 9634\u20139643). Los Alamitos: IEEE."},{"key":"5_CR33","first-page":"184","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S. Wang","year":"2021","unstructured":"Wang, S., Li, X., Sun, J., & Xu, Z. (2021). Training networks in null space of feature covariance for continual learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 184\u2013193). Los Alamitos: IEEE."},{"key":"5_CR34","first-page":"2544","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Y. Liu","year":"2021","unstructured":"Liu, Y., Schiele, B., & Sun, Q. (2021). Adaptive aggregation networks for class-incremental learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2544\u20132553). Los Alamitos: IEEE."},{"key":"5_CR35","first-page":"3366","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"R. Aljundi","year":"2017","unstructured":"Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2017). Expert gate: lifelong learning with a network of experts. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3366\u20133375). Los Alamitos: IEEE."},{"key":"5_CR36","first-page":"13647","volume-title":"Advances in neural information processing systems","author":"C.-Y. Hung","year":"2019","unstructured":"Hung, C.-Y., Tu, C.-H., Wu, C.-E., Chen, C.-H., Chan, Y.-M., & Chen, C.-S. (2019). Compacting, picking and growing for unforgetting continual learning. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019Alch\u00e9-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a032, pp. 13647\u201313657). Red Hook: Curran Associates."},{"key":"5_CR37","first-page":"476","volume-title":"Medical image computing and computer assisted intervention","author":"N. Karani","year":"2018","unstructured":"Karani, N., Chaitanya, K., Baumgartner, C., & Konukoglu, E. (2018). A lifelong learning approach to brain MR segmentation across scanners and protocols. In Medical image computing and computer assisted intervention (pp. 476\u2013484). Berlin: Springer."},{"key":"5_CR38","unstructured":"Li, X., Zhou, Y., Wu, T., Socher, R., & Xiong, C. (2019). Learn to grow: a continual structure learning framework for overcoming catastrophic forgetting. In International conference on machine learning (pp. 3925\u20133934). PMLR."},{"key":"5_CR39","first-page":"12648","volume-title":"Advances in neural information processing systems","author":"J. Rajasegaran","year":"2019","unstructured":"Rajasegaran, J., Hayat, M., Khan, S. H., Shahbaz Khan, F., & Shao, L. (2019). Random path selection for continual learning. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019Alch\u00e9-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a032, pp. 12648\u201312658). Red Hook: Curran Associates."},{"key":"5_CR40","first-page":"3014","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S. Yan","year":"2021","unstructured":"Yan, S., Xie, J., & He, X. (2021). DER: dynamically expandable representation for class incremental learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3014\u20133023). Los Alamitos: IEEE."},{"key":"5_CR41","unstructured":"Li, Z., Zhong, C., Liu, S., Wang, R., & Zheng, W.-S. (2021). Preserving earlier knowledge in continual learning with the help of all previous feature extractors. arXiv preprint. arXiv:2104.13614."},{"key":"5_CR42","first-page":"9285","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"A. Douillard","year":"2022","unstructured":"Douillard, A., Ram\u00e9, A., Couairon, G., & Cord, C. (2022). DyTox: transformers for continual learning with dynamic token expansion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 9285\u20139295). Los Alamitos: IEEE."},{"key":"5_CR43","first-page":"8661","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"A. Cheraghian","year":"2021","unstructured":"Cheraghian, A., Rahman, S., Ramasinghe, S., Fang, P., Simon, C., Petersson, L., & Harandi, M. (2021). Synthesized feature based few-shot class-incremental learning on a mixture of subspaces. In Proceedings of the IEEE international conference on computer vision (pp. 8661\u20138670). Los Alamitos: IEEE."},{"key":"5_CR44","first-page":"844","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"H. Ahn","year":"2021","unstructured":"Ahn, H., Kwak, J., Lim, S., Bang, H., Kim, H., & Moon, T. (2021). Ss-il: separated softmax for incremental learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 844\u2013853). Los Alamitos: IEEE."},{"key":"5_CR45","first-page":"699","volume-title":"Proceedings of the European conference on computer vision","author":"A. Iscen","year":"2020","unstructured":"Iscen, A., Zhang, J., Lazebnik, S., & Schmid, C. (2020). Memory-efficient incremental learning through feature adaptation. In Proceedings of the European conference on computer vision (pp. 699\u2013715). Berlin: Springer."},{"key":"5_CR46","first-page":"233","volume-title":"Proceedings of the European conference on computer vision","author":"F. M. Castro","year":"2018","unstructured":"Castro, F. M., Mar\u00edn-Jim\u00e9nez, M. J., Guil, N., Schmid, C., & Alahari, K. (2018). End-to-end incremental learning. In Proceedings of the European conference on computer vision (pp. 233\u2013248). Berlin: Springer."},{"key":"5_CR47","first-page":"437","volume-title":"Proceedings of the European conference on computer vision","author":"S. Hou","year":"2018","unstructured":"Hou, S., Pan, X., Loy, C. C., Wang, Z., & Lin, D. (2018). Lifelong learning via progressive distillation and retrospection. In Proceedings of the European conference on computer vision (pp. 437\u2013452). Berlin: Springer."},{"key":"5_CR48","first-page":"4033","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Q. Meng","year":"2020","unstructured":"Meng, Q., & Shin\u2019ichi, S. (2020). ADINet: attribute driven incremental network for retinal image classification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4033\u20134042). Los Alamitos: IEEE."},{"key":"5_CR49","first-page":"4033","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"P. Dhar","year":"2019","unstructured":"Dhar, P., Singh, R. V., Peng, K.-C., Wu, Z., & Chellappa, R. (2019). Learning without memorizing. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4033\u20134042). Los Alamitos: IEEE."},{"key":"5_CR50","first-page":"86","volume-title":"Proceedings of the European conference on computer vision","author":"A. Douillard","year":"2020","unstructured":"Douillard, A., Cord, M., Ollion, C., Robert, T., & Valle, E. (2020). PODNet: pooled outputs distillation for small-tasks incremental learning. In Proceedings of the European conference on computer vision (pp. 86\u2013102). Berlin: Springer."},{"key":"5_CR51","first-page":"831","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S. Hou","year":"2019","unstructured":"Hou, S., Pan, X., Loy, C. C., Wang, Z., & Lin, D. (2019). Learning a unified classifier incrementally via rebalancing. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 831\u2013839). Los Alamitos: IEEE."},{"key":"5_CR52","first-page":"466","volume-title":"Proceedings of the European conference on computer vision","author":"T. L. Hayes","year":"2020","unstructured":"Hayes, T. L., Kafle, K., Shrestha, R., Acharya, M., & Kanan, C. (2020). REMIND your neural network to prevent catastrophic forgetting. In Proceedings of the European conference on computer vision (pp. 466\u2013483). Berlin: Springer."},{"key":"5_CR53","first-page":"7645","volume-title":"Advances in neural information processing systems","author":"D. Rao","year":"2019","unstructured":"Rao, D., Visin, F., Rusu, A., Pascanu, R., Whye Teh, Y., & Hadsell, R. (2019). Continual unsupervised representation learning. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d\u2019Alch\u00e9-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems (Vol.\u00a032, pp. 7645\u20137655). Red Hook: Curran Associates."},{"key":"5_CR54","first-page":"1352","volume-title":"Proceedings of the AAAI conference on artificial intelligence","author":"M. Riemer","year":"2019","unstructured":"Riemer, M., Klinger, T., Bouneffouf, D., & Franceschini, M. (2019). Scalable recollections for continual lifelong learning. In Proceedings of the AAAI conference on artificial intelligence (pp. 1352\u20131359). Menlo Park: AAAI Press."},{"key":"5_CR55","first-page":"11321","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"O. Ostapenko","year":"2019","unstructured":"Ostapenko, O., Puscas, M., Klein, T., Jahnichen, P., & Nabi, M. (2019). Learning to remember: a synaptic plasticity driven framework for continual learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 11321\u201311329). Los Alamitos: IEEE."},{"key":"5_CR56","doi-asserted-by":"crossref","unstructured":"Rios, A., & Itti, L. (2019). Closed-loop memory gan for continual learning. In Proceedings of the international joint conference on artificial intelligence (IJCAI 2019) (pp. 3332\u20133338). IJCAI.","DOI":"10.24963\/ijcai.2019\/462"},{"key":"5_CR57","first-page":"6619","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"Y. Xiang","year":"2019","unstructured":"Xiang, Y., Fu, Y., Ji, P., & Huang, H. (2019). Incremental learning using conditional adversarial networks. In Proceedings of the IEEE international conference on computer vision (pp. 6619\u20136628). Los Alamitos: IEEE."},{"issue":"2","key":"5_CR58","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1037\/a0038939","volume":"122","author":"P. J. Bauer","year":"2015","unstructured":"Bauer, P. J. (2015). A complementary processes account of the development of childhood amnesia and a personal past. Psychological Review 122(2), 204\u2013231.","journal-title":"Psychological Review"},{"issue":"1","key":"5_CR59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cogpsych.2012.08.001","volume":"66","author":"F. Ribordy","year":"2013","unstructured":"Ribordy, F., Jab\u00e8s, A., Lavenex, P. B., & Lavenex, P. (2013). Development of allocentric spatial memory abilities in children from 18 months to 5 years of age. Cognitive Psychology 66(1), 1\u201329.","journal-title":"Cognitive Psychology"},{"issue":"2","key":"5_CR60","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1002\/dev.21004","volume":"55","author":"D. Scarf","year":"2013","unstructured":"Scarf, D., Gross, J., Colombo, M., & Hayne, H. (2013). To have and to hold: episodic memory in 3-and 4-year-old children. Developmental Psychobiology 55(2), 125\u2013132.","journal-title":"Developmental Psychobiology"},{"issue":"7","key":"5_CR61","doi-asserted-by":"publisher","first-page":"1640","DOI":"10.1016\/j.neubiorev.2012.03.001","volume":"36","author":"L. Nadel","year":"2012","unstructured":"Nadel, L., Hupbach, A., Gomez, R., & Newman-Smith, K. (2012). Memory formation, consolidation and transformation. Neuroscience and Biobehavioral Reviews 36(7), 1640\u20131645.","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"5_CR62","unstructured":"Krizhevsky, A., & Hinton, G. (2009). Learning multiple layers of features from tiny images. Technical report, University of Toronto."},{"key":"5_CR63","unstructured":"Welinder, P., Branson, S., Mita, T., Wah, C., Schroff, F., Belongie, S., & Perona, P. (2010) Caltech-UCSD Birds 200. Technical report, California Institute of Technology."},{"key":"5_CR64","first-page":"1449","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"T.-Y. Lin","year":"2015","unstructured":"Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2015). Bilinear cnn models for fine-grained visual recognition. In Proceedings of the IEEE international conference on computer vision (pp. 1449\u20131457). Los Alamitos: IEEE."},{"key":"5_CR65","unstructured":"Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint. arXiv:1409.1556."},{"key":"5_CR66","first-page":"770","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"K. He","year":"2016","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770\u2013778). Los Alamitos: IEEE."},{"key":"5_CR67","first-page":"248","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"J. Deng","year":"2009","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). Imagenet: a large-scale hierarchical image database. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 248\u2013255). Los Alamitos: IEEE."},{"key":"5_CR68","unstructured":"Codella, N. C. F., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S. W., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M. A., Kittler, H., & Halpern, A. (2019). Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the international skin imaging collaboration (ISIC). arXiv preprint. arXiv:1902.03368."},{"key":"5_CR69","first-page":"206","volume-title":"Proceedings of the European conference on computer vision","author":"X. Sun","year":"2016","unstructured":"Sun, X., Yang, J., Sun, M., & Wang, K. (2016). A benchmark for automatic visual classification of clinical skin disease images. In Proceedings of the European conference on computer vision (pp. 206\u2013222). Berlin: Springer."}],"container-title":["Visual Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-023-00005-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44267-023-00005-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-023-00005-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T02:08:03Z","timestamp":1683511683000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44267-023-00005-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,8]]},"references-count":69,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["5"],"URL":"https:\/\/doi.org\/10.1007\/s44267-023-00005-y","relation":{},"ISSN":["2731-9008"],"issn-type":[{"value":"2731-9008","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,8]]},"assertion":[{"value":"17 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 December 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 February 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 May 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5"}}