{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:28:42Z","timestamp":1792787322706,"version":"4.5.0"},"reference-count":64,"publisher":"World Scientific Pub Co Pte Ltd","funder":[{"name":"Shenzhen Science and Technology Program","award":["JCYJ20250604145123031"],"award-info":[{"award-number":["JCYJ20250604145123031"]}]},{"name":"Major Project of Science and Technology Research Program of Chongqing Education Commission","award":["KJZDM202302001"],"award-info":[{"award-number":["KJZDM202302001"]}]},{"name":"Innovative Team Project of Multimodal Artificial Intelligence and Interaction in Guangdong Province","award":["2025KCXTD040"],"award-info":[{"award-number":["2025KCXTD040"]}]},{"name":"Guangxi Key Laboratory of Brain-inspired Computing and Intelligent Chips, Shenzhen Science and Technology Program","award":["20220717173443001"],"award-info":[{"award-number":["20220717173443001"]}]},{"name":"National Natural Science Foundation of China","award":["61876132"],"award-info":[{"award-number":["61876132"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"abstract":"<jats:p>Sequential multitask learning is a major problem for Echo State Networks (ESNs) because of catastrophic forgetting and interference between the tasks. To solve this, a Dual-Loop Task-Orthogonal Framework of Echo State Networks (DLTOF-ESN) model is proposed. It has a well-scaling architecture based on orthogonal parameter updates and a new mechanism named Adaptive Stability Regulation (ASR). DLTOF-ESN is based on dual-loop learning. The inner loop uses orthogonal updates to minimize gradient overlap. The outer loop adapts regularization strength based on changes in the relationships of tasks. Also, in this loop the weight sensitivity and decay-weighted similarity are measured using an adaptive relevance mask. This dual-loop interactive mechanism enables the related tasks to be flexible whilst maintaining important information in the tasks that have a temporal distance. In contrast to the traditional Elastic Weight Consolidation (EWC), which uses a fixed regularization, this DLTOF-ESN dynamically varies the penalties according to the relevance of the task and time. This research integrated SHAP-driven layers of interpretability to the framework, which enables explainability and is useful in high-stakes areas. Model evaluations are performed on three benchmark continual learning datasets, Permuted MNIST, Split CIFAR 100 and CIFAR-10, which have shown that DLTOF-ESN shows improvement in tasks recall of up to 18%, accuracy of up to 17%, and interference of up to 44% compared to EWC + ESN and OL + ESN architectures. Ablation studies confirm the synergy between orthogonal updates and ASR methods, while scalability tests reveal reduced training time and memory overhead with increasing dataset sizes.<\/jats:p>","DOI":"10.1142\/s0129065727500274","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T04:28:22Z","timestamp":1789964902000},"source":"Crossref","is-referenced-by-count":0,"title":["A Dual-Loop Task-Orthogonal Framework for Sequential Multitask Learning in Echo State Networks"],"prefix":"10.1142","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7085-4675","authenticated-orcid":false,"given":"Syeda Shamaila","family":"Zareen","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China"},{"name":"Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, College of Applied Sciences, College of Artificial Intelligence, Shenzhen University, Shenzhen 518060, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4846-6585","authenticated-orcid":false,"given":"Junsong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China"},{"name":"Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, College of Applied Sciences, College of Artificial Intelligence, Shenzhen University, Shenzhen 518060, China"},{"name":"School of Mathematics and Computer Science, Chongqing College of International Business and Economics, Chongqing 401120, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2301-2470","authenticated-orcid":false,"given":"Hong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5787-0724","authenticated-orcid":false,"given":"Wenting","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3089-0725","authenticated-orcid":false,"given":"Yi","family":"Wang","sequence":"additional","affiliation":[{"name":"Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, College of Applied Sciences, College of Artificial Intelligence, Shenzhen University, Shenzhen 518060, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8268-7077","authenticated-orcid":false,"given":"Xiaoxu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Shenzhen Technology University, Shenzhen 518118, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2016-9503","authenticated-orcid":false,"given":"Yan","family":"Kang","sequence":"additional","affiliation":[{"name":"Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, College of Applied Sciences, College of Artificial Intelligence, Shenzhen University, Shenzhen 518060, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2026,10,10]]},"reference":[{"key":"S0129065727500274BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2019.132306"},{"key":"S0129065727500274BIB002","first-page":"1","volume":"61","author":"Ma Z.","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"S0129065727500274BIB003","doi-asserted-by":"crossref","unstructured":"H. Jaeger, Echo state network (2007), https:\/\/www.scholarpedia.org\/article\/Echo_state_network.","DOI":"10.4249\/scholarpedia.2330"},{"key":"S0129065727500274BIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2025.126518"},{"key":"S0129065727500274BIB005","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065715500367"},{"key":"S0129065727500274BIB006","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572150057X"},{"key":"S0129065727500274BIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2024.125249"},{"key":"S0129065727500274BIB008","doi-asserted-by":"publisher","DOI":"10.3389\/fams.2020.616658"},{"key":"S0129065727500274BIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2021.01.025"},{"key":"S0129065727500274BIB010","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572550025X"},{"key":"S0129065727500274BIB011","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065725500340"},{"key":"S0129065727500274BIB012","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572550073X"},{"key":"S0129065727500274BIB013","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500199"},{"key":"S0129065727500274BIB014","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500278"},{"key":"S0129065727500274BIB015","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500291"},{"key":"S0129065727500274BIB016","doi-asserted-by":"crossref","unstructured":"G. M. Van de Ven, N. Soures and D. Kudithipudi, Continual learning and catastrophic forgetting (2024), http:\/\/arxiv.org\/abs\/2403.05175.","DOI":"10.1016\/B978-0-443-15754-7.00073-0"},{"key":"S0129065727500274BIB017","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065725500790"},{"key":"S0129065727500274BIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2018.08.002"},{"key":"S0129065727500274BIB019","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-022-00568-3"},{"key":"S0129065727500274BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/DRBSD754563.2021.00006"},{"key":"S0129065727500274BIB021","volume-title":"Int. Conf. Learning Representations","author":"Hu W.","year":"2019"},{"key":"S0129065727500274BIB022","doi-asserted-by":"publisher","DOI":"10.1142\/S1793962322500301"},{"key":"S0129065727500274BIB023","doi-asserted-by":"publisher","DOI":"10.1142\/S0218625X23500361"},{"key":"S0129065727500274BIB024","doi-asserted-by":"publisher","DOI":"10.3390\/math11224566"},{"key":"S0129065727500274BIB025","doi-asserted-by":"publisher","DOI":"10.1142\/9789814749411_0025"},{"key":"S0129065727500274BIB026","doi-asserted-by":"publisher","DOI":"10.1142\/S0219530519400049"},{"key":"S0129065727500274BIB027","doi-asserted-by":"publisher","DOI":"10.1142\/9789814434102_0002"},{"key":"S0129065727500274BIB028","doi-asserted-by":"publisher","DOI":"10.1142\/S0218202525500563"},{"key":"S0129065727500274BIB029","doi-asserted-by":"publisher","DOI":"10.1145\/3502728"},{"key":"S0129065727500274BIB030","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_01222"},{"key":"S0129065727500274BIB031","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"S0129065727500274BIB032","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-024-02854-1"},{"key":"S0129065727500274BIB033","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-main.82"},{"key":"S0129065727500274BIB034","first-page":"4568","volume-title":"Proc. Int. Conf. Computational Linguistics (COLING)","author":"Kruengkrai C.","year":"2022"},{"key":"S0129065727500274BIB035","doi-asserted-by":"publisher","DOI":"10.3390\/math11030682"},{"key":"S0129065727500274BIB036","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1209"},{"key":"S0129065727500274BIB037","first-page":"5708","volume-title":"Advances in Neural Information Processing Systems","volume":"34","author":"Soen A.","year":"2021"},{"key":"S0129065727500274BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3089505"},{"key":"S0129065727500274BIB039","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_01174"},{"key":"S0129065727500274BIB040","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-021-00284-5"},{"key":"S0129065727500274BIB041","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0080-x"},{"key":"S0129065727500274BIB042","author":"Jaeger H.","year":"2001","journal-title":"GMD Re-port 148, GMD \u2013 German National Research Center for Information Technology"},{"key":"S0129065727500274BIB043","doi-asserted-by":"publisher","DOI":"10.1016\/0925-2312(93)90042-2"},{"key":"S0129065727500274BIB044","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1570147"},{"key":"S0129065727500274BIB045","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2012.2222373"},{"key":"S0129065727500274BIB046","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2020.2963943"},{"key":"S0129065727500274BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2006.875974"},{"key":"S0129065727500274BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2876413"},{"key":"S0129065727500274BIB049","doi-asserted-by":"publisher","DOI":"10.1088\/1751-8121\/ab5d4d"},{"key":"S0129065727500274BIB050","doi-asserted-by":"publisher","DOI":"10.1088\/1751-8121\/abb9ed"},{"key":"S0129065727500274BIB051","doi-asserted-by":"crossref","unstructured":"Z. Qin, F. Yu and X. Chen, Task-adaptive incremental learning for intelligent edge devices, preprint (2019), arXiv:1910.03122.","DOI":"10.1145\/3318216.3363373"},{"key":"S0129065727500274BIB052","doi-asserted-by":"crossref","unstructured":"A. Oursland, Neural networks learn distance metrics, preprint (2025), arXiv:2502.02103.","DOI":"10.32388\/K8RYTK"},{"key":"S0129065727500274BIB053","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"S0129065727500274BIB054","volume-title":"7th Int. Conf. Learning Representations (ICLR)","author":"Chaudhry A.","year":"2019"},{"key":"S0129065727500274BIB055","unstructured":"A. Krizhevsky and G. Hinton, Learning multiple layers of features from tiny images, Tech. Report TR-2009, University of Toronto, Toronto, Ontario, Canada (2009)."},{"key":"S0129065727500274BIB056","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"key":"S0129065727500274BIB057","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17049"},{"key":"S0129065727500274BIB058","doi-asserted-by":"publisher","DOI":"10.3390\/app122211836"},{"key":"S0129065727500274BIB059","unstructured":"J. Du, X. Zhang, H. Shen, X. Xian, G. Wang, J. Zhang, Y. Yang, N. Li, J. Liu and J. Ding, Drift to remember, preprint (2024), arXiv:2409.13997."},{"key":"S0129065727500274BIB060","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2021.07.021"},{"key":"S0129065727500274BIB061","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2682102"},{"key":"S0129065727500274BIB062","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04359-7"},{"key":"S0129065727500274BIB063","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04146-4"},{"key":"S0129065727500274BIB064","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3190448"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065727500274","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T04:09:47Z","timestamp":1791605387000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065727500274"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,10]]},"references-count":64,"alternative-id":["10.1142\/S0129065727500274"],"URL":"https:\/\/doi.org\/10.1142\/s0129065727500274","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,10]]},"article-number":"2750027"}}