{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T21:29:45Z","timestamp":1776893385734,"version":"3.51.2"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2024,4,1]],"date-time":"2024-04-01T00:00:00Z","timestamp":1711929600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":42,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007601","name":"Horizon 2020","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the realm of online continual learning, models are expected to adapt to an ever-changing environment. One of the most persistent hurdles in this adaptation is the mitigation of a phenomenon called \"Catastrophic Forgetting\" (CF). This critical condition occurs when models trained on non-identically distributed data lose performance in previously learned tasks. Rehearsal methods, leveraging the ability to replay older samples, aim to address this challenge by incorporating a buffer of past training samples. However, the absence of known task boundaries complicates the adaptation of current CF mitigation methods. This paper proposes a method attuned to data stream characteristics and online model performance in a resource-constrained environment. The number of training iterations and learning rate emerges as crucial hyperparameters, impacting the efficacy and efficiency of online continual learning. Up to this point, we propose a combination of Experience Replay methodologies, a Drift Detector, and various training convergence policies, specially tailored for scenarios with unknown task boundaries. Experimental results demonstrate the effectiveness of our approach, maintaining or enhancing performance compared to baseline methods, while significantly improving computational efficiency.<\/jats:p>","DOI":"10.1007\/s10489-024-05493-z","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T06:02:46Z","timestamp":1715580166000},"page":"6383-6399","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A rehearsal framework for computational efficiency in online continual learning"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4445-4314","authenticated-orcid":false,"given":"Charalampos","family":"Davalas","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitrios","family":"Michail","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christos","family":"Diou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Iraklis","family":"Varlamis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Konstantinos","family":"Tserpes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,5,13]]},"reference":[{"key":"5493_CR1","doi-asserted-by":"publisher","unstructured":"She Q, Feng F, Hao X, Yang Q, Lan C, Lomonaco V, Shi X, Wang Z, Guo Y, Zhang Y et al (2020) Openloris-object: a robotic vision dataset and benchmark for lifelong deep learning. In: 2020 IEEE international conference on robotics and automation (ICRA), pp 4767\u20134773. https:\/\/doi.org\/10.1109\/ICRA40945.2020.9196887. IEEE","DOI":"10.1109\/ICRA40945.2020.9196887"},{"key":"5493_CR2","doi-asserted-by":"publisher","unstructured":"Fernando C, Banarse D, Blundell C, Zwols Y, Ha D, Rusu AA, Pritzel A, Wierstra D (2017) Pathnet: evolution channels gradient descent in super neural networks. https:\/\/doi.org\/10.48550\/arXiv.1701.08734","DOI":"10.48550\/arXiv.1701.08734"},{"key":"5493_CR3","doi-asserted-by":"publisher","unstructured":"Li Z, Hoiem D (2017) Learning without forgetting. IEEE Trans Pattern Anal Mach Intell 40(12):2935\u20132947. https:\/\/doi.org\/10.48550\/arXiv.1606.09282","DOI":"10.48550\/arXiv.1606.09282"},{"key":"5493_CR4","doi-asserted-by":"publisher","unstructured":"McCloskey M, Cohen NJ (1989) Catastrophic interference in connectionist networks: the sequential learning problem. Psychol Learn Motiv 24:109\u2013165. https:\/\/doi.org\/10.1016\/S0079-7421(08)60536-8","DOI":"10.1016\/S0079-7421(08)60536-8"},{"key":"5493_CR5","doi-asserted-by":"publisher","unstructured":"Bottou L, Bousquet O (2011) The tradeoffs of large-scale learning: optimization for machine learning. The MIT Press. https:\/\/doi.org\/10.7551\/mitpress\/8996.003.0015","DOI":"10.7551\/mitpress\/8996.003.0015"},{"key":"5493_CR6","doi-asserted-by":"publisher","unstructured":"Grossberg ST (2012) Studies of mind and brain: neural principles of learning, perception, development, cognition, and motor control. Springer. https:\/\/doi.org\/10.1007\/978-94-009-7758-7","DOI":"10.1007\/978-94-009-7758-7"},{"key":"5493_CR7","doi-asserted-by":"publisher","unstructured":"De Lange M, Aljundi R, Masana M, Parisot S, Jia X, Leonardis A, Slabaugh G, Tuytelaars T (2021) A continual learning survey: defying forgetting in classification tasks. IEEE Trans Pattern Anal Mach Intell 44(7):3366\u20133385. https:\/\/doi.org\/10.1109\/TPAMI.2021.3057446","DOI":"10.1109\/TPAMI.2021.3057446"},{"key":"5493_CR8","doi-asserted-by":"publisher","unstructured":"Van de Ven GM, Tolias AS (2019) Three scenarios for continual learning. https:\/\/doi.org\/10.48550\/arXiv.1904.07734","DOI":"10.48550\/arXiv.1904.07734"},{"key":"5493_CR9","doi-asserted-by":"publisher","unstructured":"He J, Mao R, Shao Z, Zhu F (2020) Incremental learning in online scenario. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 13926\u201313935 . https:\/\/doi.org\/10.1109\/CVPR42600.2020.01394","DOI":"10.1109\/CVPR42600.2020.01394"},{"key":"5493_CR10","doi-asserted-by":"publisher","unstructured":"Pellegrini L, Graffieti G, Lomonaco V, Maltoni D (2020) Latent replay for real-time continual learning. In: 2020 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp 10203\u201310209. https:\/\/doi.org\/10.1109\/IROS45743.2020.9341460. IEEE","DOI":"10.1109\/IROS45743.2020.9341460"},{"key":"5493_CR11","doi-asserted-by":"publisher","unstructured":"Davalas C, Michail D, Diou C, Varlamis I, Tserpes K (2022) Computationally efficient rehearsal for online continual learning. In: International conference on image analysis and processing, pp 39\u201349. https:\/\/doi.org\/10.1007\/978-3-031-06433-3_4. Springer","DOI":"10.1007\/978-3-031-06433-3_4"},{"key":"5493_CR12","doi-asserted-by":"publisher","unstructured":"Goodfellow I.J, Mirza M, Xiao D, Courville A, Bengio Y (2013) An empirical investigation of catastrophic forgetting in gradient-based neural networks. https:\/\/doi.org\/10.48550\/arXiv.1312.6211","DOI":"10.48550\/arXiv.1312.6211"},{"key":"5493_CR13","unstructured":"Krizhevsky A, Hinton G et al (2009) Learning multiple layers of features from tiny images"},{"issue":"13","key":"5493_CR14","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","volume":"114","author":"J Kirkpatrick","year":"2017","unstructured":"Kirkpatrick J, Pascanu R, Rabinowitz N, Veness J, Desjardins G, Rusu AA, Milan K, Quan J, Ramalho T, Grabska-Barwinska A et al (2017) Overcoming catastrophic forgetting in neural networks. Proc Natl Acad Sci 114(13):3521\u20133526. https:\/\/doi.org\/10.1073\/pnas.1611835114","journal-title":"Proc Natl Acad Sci"},{"key":"5493_CR15","doi-asserted-by":"publisher","unstructured":"Smith JS, Tian J, Halbe S, Hsu Y-C, Kira Z (2023) A closer look at rehearsal-free continual learning. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 2409\u20132419. https:\/\/doi.org\/10.1109\/CVPRW59228.2023.00239","DOI":"10.1109\/CVPRW59228.2023.00239"},{"key":"5493_CR16","doi-asserted-by":"publisher","unstructured":"Zhuo T, Cheng Z, Gao Z, Fan H, Kankanhalli M (2023) Continual learning with strong experience replay. https:\/\/doi.org\/10.48550\/arXiv.2209.13917","DOI":"10.48550\/arXiv.2209.13917"},{"key":"5493_CR17","doi-asserted-by":"publisher","unstructured":"Prabhu A, Torr PH, Dokania PK (2020) Gdumb: a simple approach that questions our progress in continual learning. In: Computer vision\u2013ECCV 2020: 16th European conference, Glasgow, UK, August 23\u201328, 2020, Proceedings, Part II 16, pp 524\u2013540. https:\/\/doi.org\/10.1007\/978-3-030-58536-5_31. Springer","DOI":"10.1007\/978-3-030-58536-5_31"},{"key":"5493_CR18","doi-asserted-by":"publisher","unstructured":"Chaudhry A, Rohrbach M, Elhoseiny M, Ajanthan T, Dokania P, Torr P, Ranzato M (2019) Continual learning with tiny episodic memories. In: Workshop on multi-task and lifelong reinforcement learning. https:\/\/doi.org\/10.48550\/arXiv.1902.10486","DOI":"10.48550\/arXiv.1902.10486"},{"key":"5493_CR19","doi-asserted-by":"publisher","unstructured":"Rebuffi S-A, Kolesnikov A, Sperl G, Lampert CH (2017) icarl: incremental classifier and representation learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2001\u20132010. https:\/\/doi.org\/10.1109\/CVPR.2017.587","DOI":"10.1109\/CVPR.2017.587"},{"key":"5493_CR20","doi-asserted-by":"publisher","unstructured":"Rolnick D, Ahuja A, Schwarz J, Lillicrap T, Wayne G (2019) Experience replay for continual learning. Adv Neural Inf Process Syst 32. https:\/\/doi.org\/10.48550\/arXiv.1811.11682","DOI":"10.48550\/arXiv.1811.11682"},{"key":"5493_CR21","doi-asserted-by":"publisher","unstructured":"Adam S, Busoniu L, Babuska R (2011) Experience replay for real-time reinforcement learning control. IEEE Trans Syst, Man, Cybern, Part C (Appl Rev) 42(2):201\u2013212. https:\/\/doi.org\/10.1109\/TSMCC.2011.2106494","DOI":"10.1109\/TSMCC.2011.2106494"},{"key":"5493_CR22","doi-asserted-by":"publisher","unstructured":"Lopez-Paz D, Ranzato M (2017) Gradient episodic memory for continual learning. Adv Neural Inf Process Syst 30. https:\/\/doi.org\/10.48550\/arXiv.1706.08840","DOI":"10.48550\/arXiv.1706.08840"},{"key":"5493_CR23","doi-asserted-by":"publisher","unstructured":"Milan K, Veness J, Kirkpatrick J, Bowling M, Koop A, Hassabis D (2016) The forget-me-not process. Adv Neural Inf Process Syst 29. https:\/\/doi.org\/10.5555\/3157382.3157512","DOI":"10.5555\/3157382.3157512"},{"key":"5493_CR24","doi-asserted-by":"publisher","unstructured":"Wiewel F, Yang B (2021) Entropy-based sample selection for online continual learning. In: 2020 28th European signal processing conference (EUSIPCO), pp 1477\u20131481. https:\/\/doi.org\/10.23919\/Eusipco47968.2020.9287846. IEEE","DOI":"10.23919\/Eusipco47968.2020.9287846"},{"key":"5493_CR25","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.neunet.2020.12.003","volume":"135","author":"E Belouadah","year":"2021","unstructured":"Belouadah E, Popescu A, Kanellos I (2021) A comprehensive study of class incremental learning algorithms for visual tasks. Neural Netw 135:38\u201354. https:\/\/doi.org\/10.1016\/j.neunet.2020.12.003","journal-title":"Neural Netw"},{"key":"5493_CR26","doi-asserted-by":"publisher","unstructured":"Jodelet Q, Liu X, Murata T (2021) Balanced softmax cross-entropy for incremental learning. In: International conference on artificial neural networks, pp 385\u2013396. https:\/\/doi.org\/10.1016\/j.cviu.2022.103582. Springer","DOI":"10.1016\/j.cviu.2022.103582"},{"key":"5493_CR27","doi-asserted-by":"publisher","unstructured":"Harun M.Y, Gallardo J, Kanan C (2023) Grasp: a rehearsal policy for efficient online continual learning. https:\/\/doi.org\/10.48550\/arXiv.2308.13646","DOI":"10.48550\/arXiv.2308.13646"},{"key":"5493_CR28","doi-asserted-by":"publisher","unstructured":"Zhang Y, Pfahringer B, Frank E, Bifet A, Lim NJS, Jia Y (2022) A simple but strong baseline for online continual learning: repeated augmented rehearsal. Adv Neural Inf Process Syst 35:14771\u201314783. https:\/\/doi.org\/10.48550\/arXiv.2209.13917","DOI":"10.48550\/arXiv.2209.13917"},{"key":"5493_CR29","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.cviu.2022.103582","volume":"23","author":"G Widmer","year":"1996","unstructured":"Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23:69\u2013101. https:\/\/doi.org\/10.1016\/j.cviu.2022.103582","journal-title":"Mach Learn"},{"issue":"2","key":"5493_CR30","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.patrec.2011.08.019","volume":"33","author":"GJ Ross","year":"2012","unstructured":"Ross GJ, Adams NM, Tasoulis DK, Hand DJ (2012) Exponentially weighted moving average charts for detecting concept drift. Pattern Recogn Lett 33(2):191\u2013198. https:\/\/doi.org\/10.1016\/j.patrec.2011.08.019","journal-title":"Pattern Recogn Lett"},{"key":"5493_CR31","doi-asserted-by":"publisher","unstructured":"Lu J, Liu A, Dong F, Gu F, Gama J, Zhang G (2018) Learning under concept drift: a review. IEEE Trans Knowl Data Eng 31(12):2346\u20132363. https:\/\/doi.org\/10.1109\/TKDE.2018.2876857","DOI":"10.1109\/TKDE.2018.2876857"},{"key":"5493_CR32","doi-asserted-by":"publisher","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324. https:\/\/doi.org\/10.1109\/5.726791","DOI":"10.1109\/5.726791"},{"key":"5493_CR33","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778. https:\/\/doi.org\/10.13140\/RG.2.2.33865.52329","DOI":"10.13140\/RG.2.2.33865.52329"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05493-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-024-05493-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-024-05493-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T12:15:06Z","timestamp":1718453706000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-024-05493-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4]]},"references-count":33,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["5493"],"URL":"https:\/\/doi.org\/10.1007\/s10489-024-05493-z","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4]]},"assertion":[{"value":"29 April 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 May 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing of interest"}},{"value":"All data have been used with ethical and informed consent","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent for data used"}}]}}