{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T13:52:24Z","timestamp":1774965144289,"version":"3.50.1"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2024,7,26]],"date-time":"2024-07-26T00:00:00Z","timestamp":1721952000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,26]],"date-time":"2024-07-26T00:00:00Z","timestamp":1721952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p><jats:bold>L<\/jats:bold>ifelong <jats:bold>M<\/jats:bold>achine <jats:bold>L<\/jats:bold>earning (LML) denotes a scenario involving multiple sequential tasks, each accompanied by its respective dataset, in order to solve specific learning problems. In this context, the focus of LML techniques is on utilizing already acquired knowledge to adapt to new tasks efficiently. Essentially, LML concerns about facing new tasks while exploiting the knowledge previously gathered from earlier tasks not only to help in adapting to new tasks but also to enrich the understanding of past ones. By understanding this concept, one can better grasp one of the major obstacles in LML, known as <jats:bold>K<\/jats:bold>nowledge <jats:bold>T<\/jats:bold>ransfer (KT). This systematic literature review aims to explore state-of-the-art KT techniques within LML and assess the evaluation metrics and commonly utilized datasets in this field, thereby keeping the LML research community updated with the latest developments. From an initial pool of 417 articles from four distinguished databases, 30 were deemed highly pertinent for the information extraction phase. The analysis recognizes four primary KT techniques: Replay, Regularization, Parameter Isolation, and Hybrid. This study delves into the characteristics of these techniques across both neural network (NN) and non-neural network (non-NN) frameworks, highlighting their distinct advantages that have captured researchers\u2019 interest. It was found that the majority of the studies focused on supervised learning within an NN modelling framework, particularly employing Parameter Isolation and Hybrid for KT. The paper concludes by pinpointing research opportunities, including investigating non-NN models for Replay and exploring applications outside of computer vision (CV).<\/jats:p>","DOI":"10.1007\/s10462-024-10853-9","type":"journal-article","created":{"date-parts":[[2024,7,26]],"date-time":"2024-07-26T23:03:22Z","timestamp":1722035002000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Knowledge transfer in lifelong machine learning: a systematic literature review"],"prefix":"10.1007","volume":"57","author":[{"given":"Pouya","family":"Khodaee","sequence":"first","affiliation":[]},{"given":"Herna L.","family":"Viktor","sequence":"additional","affiliation":[]},{"given":"Wojtek","family":"Michalowski","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,7,26]]},"reference":[{"key":"10853_CR1","doi-asserted-by":"crossref","unstructured":"Aljundi R, Chakravarty P, Tuytelaars T (2017) Expert gate: Lifelong learning with a network of experts. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), https:\/\/openaccess.thecvf.com\/content_cvpr_2017\/html\/Aljundi_Expert_Gate_Lifelong_CVPR_2017_paper.html","DOI":"10.1109\/CVPR.2017.753"},{"issue":"1","key":"10853_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0278364919887447","volume":"39","author":"OM Andrychowicz","year":"2020","unstructured":"Andrychowicz OM, Baker B, Chociej M et al (2020) Learning dexterous in-hand manipulation. Int J Robot Res 39(1):3\u201320. https:\/\/doi.org\/10.1177\/0278364919887447","journal-title":"Int J Robot Res"},{"key":"10853_CR3","doi-asserted-by":"publisher","unstructured":"Armstrong J, Clifton DA (2022) Continual learning of longitudinal health records. In: 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), pp 01\u201306, https:\/\/doi.org\/10.1109\/BHI56158.2022.9926878","DOI":"10.1109\/BHI56158.2022.9926878"},{"key":"10853_CR4","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1613\/jair.1.11432","volume":"68","author":"D Benavides-Prado","year":"2020","unstructured":"Benavides-Prado D, Koh YS, Riddle P (2020) Towards knowledgeable supervised lifelong learning systems. J Artif Intell Res 68:159\u2013224. https:\/\/doi.org\/10.1613\/jair.1.11432","journal-title":"J Artif Intell Res"},{"key":"10853_CR5","doi-asserted-by":"publisher","unstructured":"Bengio Y, Louradour J, Collobert R et\u00a0al (2009) Curriculum learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp 41\u201348, https:\/\/doi.org\/10.1145\/1553374.1553380","DOI":"10.1145\/1553374.1553380"},{"issue":"5","key":"10853_CR6","doi-asserted-by":"publisher","first-page":"5497","DOI":"10.1109\/TPAMI.2022.3206549","volume":"45","author":"M Boschini","year":"2023","unstructured":"Boschini M, Bonicelli L, Buzzega P et al (2023) Class-incremental continual learning into the extended der-verse. IEEE Trans Pattern Anal Mach Intell 45(5):5497\u20135512. https:\/\/doi.org\/10.1109\/TPAMI.2022.3206549","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"10853_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000016","volume":"3","author":"S Boyd","year":"2011","unstructured":"Boyd S, Parikh N, Chu E et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1\u2013122. https:\/\/doi.org\/10.1561\/2200000016","journal-title":"Found Trends Mach Learn"},{"key":"10853_CR8","doi-asserted-by":"publisher","unstructured":"Cai J, Wang X, Guan C, et\u00a0al (2022) Multimodal continual graph learning with neural architecture search. In: Proceedings of the ACM Web Conference 2022. Association for Computing Machinery, New York, WWW \u201922, p 1292\u20131300, https:\/\/doi.org\/10.1145\/3485447.3512176","DOI":"10.1145\/3485447.3512176"},{"key":"10853_CR9","doi-asserted-by":"publisher","DOI":"10.2200\/S00832ED1V01Y201802AIM037","volume-title":"Lifelong machine learning. Synthesis lectures on artificial intelligence and machine learning","author":"Z Chen","year":"2018","unstructured":"Chen Z, Liu B (2018) Lifelong machine learning. Synthesis lectures on artificial intelligence and machine learning. Morgan Claypool Publishers, Williston. https:\/\/doi.org\/10.2200\/S00832ED1V01Y201802AIM037"},{"key":"10853_CR10","unstructured":"Chen W, Zhou Y, Du N, et\u00a0al (2023) Lifelong language pretraining with distribution-specialized experts. In: Krause A, Brunskill E, Cho K, et\u00a0al (eds) Proceedings of the 40th International Conference on Machine Learning, Proceedings of Machine Learning Research, vol 202. PMLR, pp 5383\u20135395, https:\/\/proceedings.mlr.press\/v202\/chen23aq.html"},{"key":"10853_CR11","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1007\/978-3-319-71246-8_42","volume-title":"Machine learning and knowledge discovery in databases","author":"C Clingerman","year":"2017","unstructured":"Clingerman C, Eaton E (2017) Lifelong learning with gaussian processes. Machine learning and knowledge discovery in databases. Springer International Publishing, Cham, pp 690\u2013704. https:\/\/doi.org\/10.1007\/978-3-319-71246-8_42"},{"issue":"7","key":"10853_CR12","doi-asserted-by":"publisher","first-page":"3366","DOI":"10.1109\/TPAMI.2021.3057446","volume":"44","author":"M De Lange","year":"2022","unstructured":"De Lange M, Aljundi R, Masana M et al (2022) A continual learning survey: defying forgetting in classification tasks. IEEE Trans Pattern Anal Mach Intell 44(7):3366\u20133385. https:\/\/doi.org\/10.1109\/TPAMI.2021.3057446","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10853_CR13","doi-asserted-by":"publisher","unstructured":"Doyle C, Gu\u00e9riau M, Dusparic I (2019) Variational policy chaining for lifelong reinforcement learning. In: 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), pp 1546\u20131550, https:\/\/doi.org\/10.1109\/ICTAI.2019.00222","DOI":"10.1109\/ICTAI.2019.00222"},{"key":"10853_CR14","first-page":"17889","volume-title":"Advances in Neural Information Processing Systems","author":"E Egorov","year":"2021","unstructured":"Egorov E, Kuzina A, Burnaev E (2021) Boovae: boosting approach for continual learning of vae. Advances in Neural Information Processing Systems, vol 34. Curran Associates Inc., Red Hook, pp 17889\u201317901"},{"key":"10853_CR15","doi-asserted-by":"publisher","unstructured":"El\u00a0Khatib A, Nasr M, Karray F (2021) Accounting for the effect of inter-task similarity in continual learning models. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp 1241\u20131247, https:\/\/doi.org\/10.1109\/SMC52423.2021.9658756","DOI":"10.1109\/SMC52423.2021.9658756"},{"key":"10853_CR16","doi-asserted-by":"publisher","unstructured":"Faber K, Corizzo R, Sniezynski B, et\u00a0al (2023) Lifelong learning for anomaly detection: New challenges, perspectives, and insights. arXiv preprint arXiv:2303.07557https:\/\/doi.org\/10.48550\/arXiv.2303.07557","DOI":"10.48550\/arXiv.2303.07557"},{"key":"10853_CR17","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3151511","author":"Q Gao","year":"2022","unstructured":"Gao Q, Luo Z, Klabjan D et al (2022) Efficient architecture search for continual learning. IEEE Trans Neural Netw Learn Syst. https:\/\/doi.org\/10.1109\/TNNLS.2022.3151511","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"10853_CR18","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1016\/j.neunet.2022.08.034","volume":"155","author":"C Gautam","year":"2022","unstructured":"Gautam C, Parameswaran S, Mishra A et al (2022) Tf-gczsl: task-free generalized continual zero-shot learning. Neural Netw 155:487\u2013497. https:\/\/doi.org\/10.1016\/j.neunet.2022.08.034","journal-title":"Neural Netw"},{"key":"10853_CR19","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1007\/s11263-021-01453-z","volume":"129","author":"J Gou","year":"2021","unstructured":"Gou J, Yu B, Maybank SJ et al (2021) Knowledge distillation: a survey. Int J Comput Vis 129:1789\u20131819. https:\/\/doi.org\/10.1007\/s11263-021-01453-z","journal-title":"Int J Comput Vis"},{"key":"10853_CR20","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/978-3-031-18840-4_7","volume-title":"Discovery science","author":"N Gunasekara","year":"2022","unstructured":"Gunasekara N, Gomes H, Bifet A et al (2022) Adaptive neural networks for online domain incremental continual learning. Discovery science. Springer Nature Switzerland, Cham, pp 89\u2013103. https:\/\/doi.org\/10.1007\/978-3-031-18840-4_7"},{"key":"10853_CR21","doi-asserted-by":"crossref","unstructured":"Gunasekara N, Pfahringer B, Gomes HM, et\u00a0al (2023) Survey on online streaming continual learning. In: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, pp 6628\u20136637","DOI":"10.24963\/ijcai.2023\/743"},{"key":"10853_CR22","unstructured":"Gupta P, Chaudhary Y, Runkler T, et\u00a0al (2020) Neural topic modeling with continual lifelong learning. In: Proceedings of the 37th International Conference on Machine Learning, Proceedings of Machine Learning Research, vol 119. PMLR, pp 3907\u20133917, https:\/\/proceedings.mlr.press\/v119\/gupta20a.html"},{"key":"10853_CR23","doi-asserted-by":"publisher","unstructured":"Han Yn, Liu Jw (2022) Selecting related knowledge via efficient channel attention for online continual learning. In: 2022 International Joint Conference on Neural Networks (IJCNN), pp 1\u20137,https:\/\/doi.org\/10.1109\/IJCNN55064.2022.9892898","DOI":"10.1109\/IJCNN55064.2022.9892898"},{"key":"10853_CR24","doi-asserted-by":"publisher","first-page":"24273","DOI":"10.1109\/ACCESS.2022.3154826","volume":"10","author":"A Hassanpour","year":"2022","unstructured":"Hassanpour A, Moradikia M, Yang B et al (2022) Differential privacy preservation in robust continual learning. IEEE Access 10:24273\u201324287. https:\/\/doi.org\/10.1109\/ACCESS.2022.3154826","journal-title":"IEEE Access"},{"key":"10853_CR25","doi-asserted-by":"publisher","unstructured":"Hsu YC, Liu YC, Ramasamy A, et\u00a0al (2018) Re-evaluating continual learning scenarios: A categorization and case for strong baselines. arXiv preprint arXiv:1810.12488https:\/\/doi.org\/10.48550\/arXiv.1810.12488","DOI":"10.48550\/arXiv.1810.12488"},{"issue":"11","key":"10853_CR26","doi-asserted-by":"publisher","first-page":"E2496","DOI":"10.1073\/pnas.1717042115","volume":"115","author":"F Husz\u00e1r","year":"2018","unstructured":"Husz\u00e1r F (2018) Note on the quadratic penalties in elastic weight consolidation. Proce Natl Acad Sci 115(11):E2496\u2013E2497. https:\/\/doi.org\/10.1073\/pnas.1717042115","journal-title":"Proce Natl Acad Sci"},{"key":"10853_CR27","doi-asserted-by":"publisher","DOI":"10.4324\/9780203964408","volume-title":"Towards a comprehensive theory of human learning","author":"P Jarvis","year":"2012","unstructured":"Jarvis P (2012) Towards a comprehensive theory of human learning. Routledge, London. https:\/\/doi.org\/10.4324\/9780203964408"},{"key":"10853_CR28","doi-asserted-by":"publisher","unstructured":"Kalb T, Roschani M, Ruf M, et\u00a0al (2021) Continual learning for class- and domain-incremental semantic segmentation. In: 2021 IEEE Intelligent Vehicles Symposium (IV), pp 1345\u20131351, https:\/\/doi.org\/10.1109\/IV48863.2021.9575493","DOI":"10.1109\/IV48863.2021.9575493"},{"key":"10853_CR29","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1007\/978-3-030-67664-3_41","volume-title":"Machine learning and knowledge discovery in databases","author":"Z Ke","year":"2021","unstructured":"Ke Z, Liu B, Wang H et al (2021) Continual learning with knowledge transfer for sentiment classification. Machine learning and knowledge discovery in databases. Springer International Publishing, Cham, pp 683\u2013698. https:\/\/doi.org\/10.1007\/978-3-030-67664-3_41"},{"key":"10853_CR30","doi-asserted-by":"publisher","unstructured":"Khan MT, Khalid S (2017) Paradigmatic and syntagmatic rule extraction for lifelong machine learning topic models. In: 2017 6th International Conference on Electrical Engineering and Informatics (ICEEI), pp 1\u20136,https:\/\/doi.org\/10.1109\/ICEEI.2017.8312442","DOI":"10.1109\/ICEEI.2017.8312442"},{"issue":"13","key":"10853_CR31","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J Kirkpatrick","year":"2017","unstructured":"Kirkpatrick J, Pascanu R, Rabinowitz N et al (2017) Overcoming catastrophic forgetting in neural networks. Proc Natl Acad Sci 114(13):3521\u20133526. https:\/\/doi.org\/10.1073\/pnas.1611835114","journal-title":"Proc Natl Acad Sci"},{"key":"10853_CR32","doi-asserted-by":"publisher","unstructured":"Korycki L, Krawczyk B (2021) Class-incremental experience replay for continual learning under concept drift. In: 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp 3644\u20133653, https:\/\/doi.org\/10.1109\/CVPRW53098.2021.00404","DOI":"10.1109\/CVPRW53098.2021.00404"},{"key":"10853_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2023.101829","volume":"98","author":"J Kozal","year":"2023","unstructured":"Kozal J, Wozniak M (2023) Increasing depth of neural networks for life-long learning. Inform Fusion 98:101829. https:\/\/doi.org\/10.1016\/j.inffus.2023.101829","journal-title":"Inform Fusion"},{"issue":"3","key":"10853_CR34","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1038\/s42256-022-00452-0","volume":"4","author":"D Kudithipudi","year":"2022","unstructured":"Kudithipudi D, Aguilar-Simon M, Babb J et al (2022) Biological underpinnings for lifelong learning machines. Nat Mach Intell 4(3):196\u2013210. https:\/\/doi.org\/10.1038\/s42256-022-00452-0","journal-title":"Nat Mach Intell"},{"key":"10853_CR35","doi-asserted-by":"publisher","first-page":"4052","DOI":"10.1016\/j.sbspro.2014.01.889","volume":"116","author":"M Laal","year":"2014","unstructured":"Laal M, Laal A, Aliramaei A (2014) Continuing education; lifelong learning. Procedia - Soc Behav Sci 116:4052\u20134056. https:\/\/doi.org\/10.1016\/j.sbspro.2014.01.889","journal-title":"Procedia - Soc Behav Sci"},{"key":"10853_CR36","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.inffus.2019.12.004","volume":"58","author":"T Lesort","year":"2020","unstructured":"Lesort T, Lomonaco V, Stoian A et al (2020) Continual learning for robotics: definition, framework, learning strategies, opportunities and challenges. Inform Fusion 58:52\u201368. https:\/\/doi.org\/10.1016\/j.inffus.2019.12.004","journal-title":"Inform Fusion"},{"issue":"12","key":"10853_CR37","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","volume":"40","author":"Z Li","year":"2018","unstructured":"Li Z, Hoiem D (2018) Learning without forgetting. IEEE Trans Pattern Anal Mach Intell 40(12):2935\u20132947. https:\/\/doi.org\/10.1109\/TPAMI.2017.2773081","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"10853_CR38","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1007\/s10489-020-01786-1","volume":"51","author":"C Li","year":"2021","unstructured":"Li C, Li Y, Zhao Y et al (2021) Sler: self-generated long-term experience replay for continual reinforcement learning. Appl Intell 51(1):185\u2013201. https:\/\/doi.org\/10.1007\/s10489-020-01786-1","journal-title":"Appl Intell"},{"issue":"2","key":"10853_CR39","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1162\/neco_a_01560","volume":"35","author":"H Li","year":"2023","unstructured":"Li H, Ma C, Chen X et al (2023) Dynamic consolidation for continual learning. Neural Comput 35(2):228\u2013248. https:\/\/doi.org\/10.1162\/neco_a_01560","journal-title":"Neural Comput"},{"key":"10853_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.127204","volume":"572","author":"X Li","year":"2024","unstructured":"Li X, Tang B, Li H (2024) Adaer: an adaptive experience replay approach for continual lifelong learning. Neurocomputing 572:127204. https:\/\/doi.org\/10.1016\/j.neucom.2023.127204","journal-title":"Neurocomputing"},{"key":"10853_CR41","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1007\/978-3-319-70058-8_2","volume-title":"Traditional machine learning","author":"H Liu","year":"2018","unstructured":"Liu H, Cocea M (2018) Traditional machine learning. Springer International Publishing, Cham, pp 11\u201322. https:\/\/doi.org\/10.1007\/978-3-319-70058-8_2"},{"key":"10853_CR42","unstructured":"Li X, Zhou Y, Wu T, et\u00a0al (2019) Learn to grow: A continual structure learning framework for overcoming catastrophic forgetting. In: Proceedings of the 36th International Conference on Machine Learning, Proceedings of Machine Learning Research, vol\u00a097. PMLR, pp 3925\u20133934, https:\/\/proceedings.mlr.press\/v97\/li19m.html"},{"key":"10853_CR43","unstructured":"Lopez-Paz D, Ranzato MA (2017) Gradient episodic memory for continual learning. In: Advances in Neural Information Processing Systems, vol\u00a030. Curran Associates, Inc., https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/f87522788a2be2d171666752f97ddebb-Paper.pdf"},{"key":"10853_CR44","doi-asserted-by":"publisher","DOI":"10.1145\/3502728","author":"RA Mahmoud","year":"2022","unstructured":"Mahmoud RA, Hajj H (2022) Multi-objective learning to overcome catastrophic forgetting in time-series applications. ACM Trans Knowl Discov Data. https:\/\/doi.org\/10.1145\/3502728","journal-title":"ACM Trans Knowl Discov Data"},{"key":"10853_CR45","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.neucom.2021.10.021","volume":"469","author":"Z Mai","year":"2022","unstructured":"Mai Z, Li R, Jeong J et al (2022) Online continual learning in image classification: an empirical survey. Neurocomputing 469:28\u201351. https:\/\/doi.org\/10.1016\/j.neucom.2021.10.021","journal-title":"Neurocomputing"},{"key":"10853_CR46","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1016\/j.neunet.2022.08.033","volume":"155","author":"JP Mei","year":"2022","unstructured":"Mei JP, Zhen Y, Zhou Q et al (2022) Taskdrop: a competitive baseline for continual learning of sentiment classification. Neural Networks 155:551\u2013560. https:\/\/doi.org\/10.1016\/j.neunet.2022.08.033","journal-title":"Neural Networks"},{"key":"10853_CR47","doi-asserted-by":"publisher","unstructured":"New A, Baker M, Nguyen E, et\u00a0al (2022) Lifelong learning metrics. arXiv preprint arXiv:2201.08278https:\/\/doi.org\/10.48550\/arXiv.2201.08278","DOI":"10.48550\/arXiv.2201.08278"},{"key":"10853_CR48","doi-asserted-by":"publisher","unstructured":"Pandit T, Kudithipudi D (2020) Relational neurogenesis for lifelong learning agents. Association for Computing Machinery, New York, NY, USA, NICE \u201920, https:\/\/doi.org\/10.1145\/3381755.3381766","DOI":"10.1145\/3381755.3381766"},{"key":"10853_CR49","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","volume":"113","author":"GI Parisi","year":"2019","unstructured":"Parisi GI, Kemker R, Part JL et al (2019) Continual lifelong learning with neural networks: a review. Neural Networks 113:54\u201371. https:\/\/doi.org\/10.1016\/j.neunet.2019.01.012","journal-title":"Neural Networks"},{"key":"10853_CR50","doi-asserted-by":"publisher","unstructured":"Pasunuru R, Bansal M (2019) Continual and multi-task architecture search. arXiv preprint arXiv:1906.05226https:\/\/doi.org\/10.48550\/arXiv.1906.05226","DOI":"10.48550\/arXiv.1906.05226"},{"key":"10853_CR51","unstructured":"Pf\u00fclb B, Gepperth A (2019) A comprehensive, application-oriented study of catastrophic forgetting in dnns. CoRR abs\/1905.08101. http:\/\/arxiv.org\/abs\/1905.08101"},{"key":"10853_CR52","doi-asserted-by":"publisher","unstructured":"Qu H, Rahmani H, Xu L, et\u00a0al (2021) Recent advances of continual learning in computer vision: An overview. arXiv preprint arXiv:2109.11369https:\/\/doi.org\/10.48550\/arXiv.2109.11369","DOI":"10.48550\/arXiv.2109.11369"},{"key":"10853_CR53","unstructured":"Rajasegaran J, Hayat M, Khan SH, et\u00a0al (2019) Random path selection for continual learning. In: Advances in Neural Information Processing Systems, vol\u00a032. Curran Associates, Inc., https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2019\/file\/83da7c539e1ab4e759623c38d8737e9e-Paper.pdf"},{"key":"10853_CR54","doi-asserted-by":"crossref","unstructured":"Rebuffi SA, Kolesnikov A, Sperl G, et\u00a0al (2017) icarl: Incremental classifier and representation learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), https:\/\/openaccess.thecvf.com\/content_cvpr_2017\/html\/Rebuffi_iCaRL_Incremental_Classifier_CVPR_2017_paper.html","DOI":"10.1109\/CVPR.2017.587"},{"key":"10853_CR55","doi-asserted-by":"publisher","unstructured":"Riemer M, Cases I, Ajemian R, et\u00a0al (2019) Learning to learn without forgetting by maximizing transfer and minimizing interference. In: International Conference on Learning Representations, International Conference on Learning Representations, ICLR, https:\/\/doi.org\/10.48550\/arXiv.1810.11910","DOI":"10.48550\/arXiv.1810.11910"},{"issue":"1","key":"10853_CR56","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1609\/aaai.v27i1.8684","volume":"27","author":"P Ruvolo","year":"2013","unstructured":"Ruvolo P, Eaton E (2013) Active task selection for lifelong machine learning. Proc AAAI Conf Artif Intell 27(1):862\u2013868. https:\/\/doi.org\/10.1609\/aaai.v27i1.8684","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"10853_CR57","unstructured":"Schwarz J, Czarnecki W, Luketina J, et\u00a0al (2018) Progress & compress: A scalable framework for continual learning. In: Proceedings of the 35th International Conference on Machine Learning, Proceedings of Machine Learning Research, vol\u00a080. PMLR, pp 4528\u20134537, https:\/\/proceedings.mlr.press\/v80\/schwarz18a.html"},{"issue":"4","key":"10853_CR58","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1109\/TNNLS.2020.3042500","volume":"33","author":"G Sun","year":"2022","unstructured":"Sun G, Cong Y, Wang Q et al (2022) Representative task self-selection for flexible clustered lifelong learning. IEEE Trans Neural Netw Learn Syst 33(4):1467\u20131481. https:\/\/doi.org\/10.1109\/TNNLS.2020.3042500","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"10853_CR59","doi-asserted-by":"publisher","unstructured":"Sun G, Cong Y, Kong Y, et\u00a0al (2018) Clustered lifelong learning via representative task selection. In: 2018 IEEE International Conference on Data Mining (ICDM), pp 1248\u20131253, https:\/\/doi.org\/10.1109\/ICDM.2018.00167","DOI":"10.1109\/ICDM.2018.00167"},{"key":"10853_CR60","doi-asserted-by":"publisher","unstructured":"Sun Q, Liu Y, Chua TS, et\u00a0al (2019) Meta-transfer learning for few-shot learning. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp 403\u2013412, https:\/\/doi.org\/10.48550\/arXiv.1812.02391","DOI":"10.48550\/arXiv.1812.02391"},{"key":"10853_CR61","doi-asserted-by":"publisher","unstructured":"Tessler C, Givony S, Zahavy T, et\u00a0al (2017) A deep hierarchical approach to lifelong learning in minecraft. Proceedings of the AAAI Conference on Artificial Intelligence 31(1). https:\/\/doi.org\/10.1609\/aaai.v31i1.10744","DOI":"10.1609\/aaai.v31i1.10744"},{"key":"10853_CR62","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.126300","volume":"545","author":"S Tian","year":"2023","unstructured":"Tian S, Li W, Ning X et al (2023) Continuous transfer of neural network representational similarity for incremental learning. Neurocomputing 545:126300. https:\/\/doi.org\/10.1016\/j.neucom.2023.126300","journal-title":"Neurocomputing"},{"issue":"12","key":"10853_CR63","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1038\/s42256-022-00568-3","volume":"4","author":"GM Van de Ven","year":"2022","unstructured":"Van de Ven GM, Tuytelaars T, Tolias AS (2022) Three types of incremental learning. Nat Mach Intell 4(12):1185\u20131197. https:\/\/doi.org\/10.1038\/s42256-022-00568-3","journal-title":"Nat Mach Intell"},{"issue":"9","key":"10853_CR64","doi-asserted-by":"publisher","first-page":"4555","DOI":"10.1109\/TPAMI.2021.3069908","volume":"44","author":"X Wang","year":"2022","unstructured":"Wang X, Chen Y, Zhu W (2022) A survey on curriculum learning. IEEE Trans Pattern Anal Mach Intell 44(9):4555\u20134576. https:\/\/doi.org\/10.1109\/TPAMI.2021.3069908","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10853_CR65","doi-asserted-by":"publisher","unstructured":"Wang Z, Li D, Li P (2022b) Latent coreset sampling based data-free continual learning. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. Association for Computing Machinery, New York, NY, USA, CIKM \u201922, p 2077\u20132087, https:\/\/doi.org\/10.1145\/3511808.3557375","DOI":"10.1145\/3511808.3557375"},{"key":"10853_CR66","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.110022","volume":"258","author":"B Yang","year":"2022","unstructured":"Yang B, Fan F, Ni R et al (2022) Continual learning-based trajectory prediction with memory augmented networks. Knowledge-Based Syst 258:110022. https:\/\/doi.org\/10.1016\/j.knosys.2022.110022","journal-title":"Knowledge-Based Syst"},{"key":"10853_CR67","doi-asserted-by":"publisher","unstructured":"Yoon J, Yang E, Lee J, et\u00a0al (2017) Lifelong learning with dynamically expandable networks. arXiv preprint arXiv:1708.01547https:\/\/doi.org\/10.48550\/arXiv.1708.01547","DOI":"10.48550\/arXiv.1708.01547"},{"issue":"1","key":"10853_CR68","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1109\/TCSVT.2023.3285221","volume":"34","author":"D Yu","year":"2024","unstructured":"Yu D, Zhang M, Li M et al (2024) Contrastive correlation preserving replay for online continual learning. IEEE Trans Circ Syst Video Technol 34(1):124\u2013139. https:\/\/doi.org\/10.1109\/TCSVT.2023.3285221","journal-title":"IEEE Trans Circ Syst Video Technol"},{"key":"10853_CR69","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.119098","volume":"214","author":"A Zaman","year":"2023","unstructured":"Zaman A, Yangyu F, Ayub MS et al (2023) Cmdgat: knowledge extraction and retention based continual graph attention network for point cloud registration. Exp Syst Appl 214:119098. https:\/\/doi.org\/10.1016\/j.eswa.2022.119098","journal-title":"Exp Syst Appl"},{"key":"10853_CR70","doi-asserted-by":"crossref","unstructured":"Zhai M, Chen L, Tung F, et\u00a0al (2019) Lifelong gan: Continual learning for conditional image generation. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp 2759\u20132768, https:\/\/openaccess.thecvf.com\/content_ICCV_2019\/papers\/Zhai_Lifelong_GAN_Continual_Learning_for_Conditional_Image_Generation_ICCV_2019_paper.pdf","DOI":"10.1109\/ICCV.2019.00285"},{"key":"10853_CR71","doi-asserted-by":"publisher","unstructured":"Zhang P, Yan Y, Li C, et\u00a0al (2023) Continual learning on dynamic graphs via parameter isolation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, New York, NY, USA, SIGIR \u201923, p 601\u2013611, https:\/\/doi.org\/10.1145\/3539618.3591652","DOI":"10.1145\/3539618.3591652"},{"key":"10853_CR72","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.neunet.2022.02.001","volume":"149","author":"T Zhao","year":"2022","unstructured":"Zhao T, Wang Z, Masoomi A et al (2022) Deep bayesian unsupervised lifelong learning. Neural Networks 149:95\u2013106. https:\/\/doi.org\/10.1016\/j.neunet.2022.02.001","journal-title":"Neural Networks"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10853-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10853-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10853-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T05:20:30Z","timestamp":1723872030000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10853-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,26]]},"references-count":72,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["10853"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10853-9","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,26]]},"assertion":[{"value":"3 July 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"217"}}