{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T15:44:22Z","timestamp":1772207062578,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:00:00Z","timestamp":1729900800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T00:00:00Z","timestamp":1729900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100009001","name":"University of York","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Comput"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Reservoir Computing is a computing model ideal for performing computation on varied physical substrates. However, these physical reservoirs can be difficult to scale up. We propose joining various reservoirs together as an approach to solving this problem, simulating physical reservoirs with Echo State Networks (ESNs). We investigate various methods of combining ESNs to form larger reservoirs, including a method that we dub\n                    <jats:italic>Restricted ESNs<\/jats:italic>\n                    . We provide a notation for describing Restricted ESNs, and use it to benchmark a standard ESN against restricted ones. We investigate two methods to keep the weight matrix density consistent when comparing a Restricted ESN to a standard one, which we call\n                    <jats:italic>overall consistency<\/jats:italic>\n                    and\n                    <jats:italic>patch consistency<\/jats:italic>\n                    . We benchmark restricted ESNs on NARMA10 and the sunspot prediction benchmark, and find that restricted ESNs perform similarly to standard ones. We present some application scenarios in which restricted ESNs may offer advantages over standard ESNs. We then test restricted ESNs on a version of the multi-timescale Multiple Superimposed Sines tasks, in order to establish a baseline performance that can be improved upon in further work. We conclude that we can scale up reservoir performance by linking small homogeneous subreservoirs together without significant loss in performance over a single large reservoir, justifying future work on using heterogeneous subreservoirs for greater flexibility.\n                  <\/jats:p>","DOI":"10.1007\/s11047-024-10004-7","type":"journal-article","created":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T21:01:31Z","timestamp":1729890091000},"page":"149-161","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Modelling and evaluating restricted ESNs on single- and multi-timescale problems"],"prefix":"10.1007","volume":"24","author":[{"given":"Chester","family":"Wringe","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan","family":"Stepney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin A.","family":"Trefzer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,26]]},"reference":[{"issue":"3","key":"10004_CR1","first-page":"697","volume":"11","author":"AF Atiya","year":"2000","unstructured":"Atiya AF, Parlos AG (2000) New results on recurrent network training: unifying the algorithms and accelerating convergence. IEEE TNN 11(3):697\u2013709","journal-title":"IEEE TNN"},{"key":"10004_CR2","first-page":"303","volume":"2010","author":"JB Butcher","year":"2010","unstructured":"Butcher JB, Verstraeten D, Schrauwen B, Haycock PW (2010) Extending reservoir computing with random static projections. ESANN 2010:303\u2013308","journal-title":"ESANN"},{"issue":"3","key":"10004_CR3","doi-asserted-by":"publisher","DOI":"10.1088\/2632-072X\/ac24f3","volume":"2","author":"D Canaday","year":"2021","unstructured":"Canaday D, Pomerance A, Gauthier DJ (2021) Model-free control of dynamical systems with deep reservoir computing. J Phys Complex 2(3):035025","journal-title":"J Phys Complex"},{"issue":"3","key":"10004_CR4","doi-asserted-by":"publisher","DOI":"10.1088\/2634-4386\/ac7db7","volume":"2","author":"M Cucchi","year":"2022","unstructured":"Cucchi M, Abreu S, Ciccone G, Brunner D, Kleemann H (2022) Hands-on reservoir computing: a tutorial for practical implementation. Neuromorphic Comput Eng 2(3):032002","journal-title":"Neuromorphic Comput Eng"},{"key":"10004_CR5","doi-asserted-by":"crossref","unstructured":"Dale M (2018a) Neuroevolution of hierarchical reservoir computers. In: GECCO 2018. ACM, pp 410\u2013417","DOI":"10.1145\/3205455.3205520"},{"key":"10004_CR6","unstructured":"Dale M (2018b) Reservoir Computing in Materio. Ph.D. thesis, University of York"},{"key":"10004_CR7","doi-asserted-by":"crossref","unstructured":"Dale M, O\u2019Keefe S, Sebald A, Stepney S, Trefzer MA (2021) Computing with magnetic thin films: using film geometry to improve dynamics. In: UCNC 2021, volume 12984 of LNCS. Springer, pp 19\u201334","DOI":"10.1007\/978-3-030-87993-8_2"},{"issue":"5","key":"10004_CR8","first-page":"1364","volume":"18","author":"Z Deng","year":"2007","unstructured":"Deng Z, Zhang Y (2007) Collective behavior of a small-world recurrent neural system with scale-free distribution. IEEE TNN 18(5):1364\u20131375","journal-title":"IEEE TNN"},{"key":"10004_CR9","doi-asserted-by":"crossref","unstructured":"Fernando C, Sojakka S (2003) Pattern recognition in a bucket. In: Advances in artificial life. Springer, pp 588\u2013597","DOI":"10.1007\/978-3-540-39432-7_63"},{"issue":"5","key":"10004_CR10","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1016\/j.neunet.2011.02.002","volume":"24","author":"C Gallicchio","year":"2011","unstructured":"Gallicchio C, Micheli A (2011) Architectural and Markovian factors of echo state networks. Neural Netw 24(5):440\u2013456","journal-title":"Neural Netw"},{"issue":"3","key":"10004_CR11","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s12559-017-9461-9","volume":"9","author":"C Gallicchio","year":"2017","unstructured":"Gallicchio C, Micheli A (2017) Echo state property of deep reservoir computing networks. Cognit Comput 9(3):337\u2013350","journal-title":"Cognit Comput"},{"key":"10004_CR12","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.neucom.2016.12.089","volume":"268","author":"C Gallicchio","year":"2017","unstructured":"Gallicchio C, Micheli A, Pedrelli L (2017) Deep reservoir computing: a critical experimental analysis. Neurocomputing 268:87\u201399","journal-title":"Neurocomputing"},{"key":"10004_CR13","doi-asserted-by":"crossref","unstructured":"Harding S, Miller J (2004) Evolution in materio: initial experiments with liquid crystal. In: Proceedings. 2004 NASA\/DoD conference on evolvable hardware, pp 298\u2013305","DOI":"10.1109\/EH.2004.1310844"},{"key":"10004_CR14","doi-asserted-by":"crossref","unstructured":"Iinuma T, Nobukawa S, Yamaguchi S (2022) Assembly of echo state networks driven by segregated low dimensional signals. In: 2022 international joint conference on neural networks (IJCNN), pp 1\u20138","DOI":"10.1109\/IJCNN55064.2022.9892881"},{"key":"10004_CR15","unstructured":"Jaeger H (2001) The \u201cecho state\u201d approach to analysing and training recurrent neural networks - with an erratum note. In: German national research center for information technology GMD technical report, Bonn, Germany, vol 148(34), p 13"},{"key":"10004_CR16","unstructured":"Jaeger H (2004) The echo state approach to recurrent neural networks (presentation). Accessed 29 Nov 2023"},{"key":"10004_CR17","unstructured":"Jaeger H (2007) Discovering multiscale dynamical features with hierarchical echo state networks. Technical Report TR-10, Jacobs University Bremen"},{"issue":"3","key":"10004_CR18","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1016\/j.neunet.2007.04.001","volume":"20","author":"H Jaeger","year":"2007","unstructured":"Jaeger H, Maass W, Principe J (2007) Special issue on echo state networks and liquid state machines. Neural Netw 20(3):287\u2013289","journal-title":"Neural Netw"},{"key":"10004_CR19","doi-asserted-by":"crossref","unstructured":"Jarvis S, Rotter S, Egert U (2010) Extending stability through hierarchical clusters in echo state networks. Front Neuroinform, p 4","DOI":"10.3389\/fninf.2010.00011"},{"issue":"1","key":"10004_CR20","doi-asserted-by":"publisher","first-page":"15532","DOI":"10.1038\/s41598-023-42812-9","volume":"13","author":"Y Kawai","year":"2023","unstructured":"Kawai Y, Park J, Asada M (2023a) Reservoir computing using self-sustained oscillations in a locally connected neural network. Sci Rep 13(1):15532","journal-title":"Sci Rep"},{"key":"10004_CR21","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1016\/j.neunet.2023.04.006","volume":"163","author":"Y Kawai","year":"2023","unstructured":"Kawai Y, Park J, Tsuda I, Asada M (2023b) Learning long-term motor timing\/patterns on an orthogonal basis in random neural networks. Neural Netw 163:298\u2013311","journal-title":"Neural Netw"},{"key":"10004_CR22","doi-asserted-by":"crossref","unstructured":"Luko\u0161evi\u010dius M (2012) A practical guide to applying echo state networks. In: LNCS. Springer, pp 659\u2013686","DOI":"10.1007\/978-3-642-35289-8_36"},{"key":"10004_CR23","unstructured":"Ma Q, Shen L, Cottrell GW (2017a) Deep-ESN: a multiple projection-encoding hierarchical reservoir computing framework. arXiv:1711.05255 [cs.LG]"},{"key":"10004_CR24","doi-asserted-by":"crossref","unstructured":"Ma Q, Shen L, Zhuang W, Chen J (2017b) Decouple adversarial capacities with Dual-Reservoir network. In: ICONIP 2017. Springer, pp 475\u2013483","DOI":"10.1007\/978-3-319-70139-4_48"},{"issue":"3","key":"10004_CR25","doi-asserted-by":"publisher","first-page":"1613","DOI":"10.1109\/TCYB.2019.2919648","volume":"51","author":"Q Ma","year":"2021","unstructured":"Ma Q, Chen E, Lin Z, Yan J, Yu Z, Ng WWY (2021) Convolutional multitimescale echo state network. IEEE Trans Cybern 51(3):1613\u20131625","journal-title":"IEEE Trans Cybern"},{"issue":"11","key":"10004_CR26","doi-asserted-by":"publisher","first-page":"2531","DOI":"10.1162\/089976602760407955","volume":"14","author":"W Maass","year":"2002","unstructured":"Maass W, Natschl\u00e4ger T, Markram H (2002) Real-time computing without stable states. Neural Comput 14(11):2531\u20132560","journal-title":"Neural Comput"},{"issue":"4","key":"10004_CR27","doi-asserted-by":"publisher","first-page":"946","DOI":"10.1109\/TCYB.2016.2533545","volume":"47","author":"ZK Malik","year":"2017","unstructured":"Malik ZK, Hussain A, Wu QJ (2017) Multilayered echo state machine: a novel architecture and algorithm. IEEE Trans Cybern 47(4):946\u2013959","journal-title":"IEEE Trans Cybern"},{"issue":"1","key":"10004_CR28","first-page":"131","volume":"22","author":"A Rodan","year":"2011","unstructured":"Rodan A, Tino P (2011) Minimum complexity echo state network. IEEE TNN 22(1):131\u2013144","journal-title":"IEEE TNN"},{"issue":"2","key":"10004_CR29","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1162\/netn_a_00082","volume":"3","author":"N Rodriguez","year":"2019","unstructured":"Rodriguez N, Izquierdo E, Ahn Y-Y (2019) Optimal modularity and memory capacity of neural reservoirs. Netw Neurosci 3(2):551\u2013566","journal-title":"Netw Neurosci"},{"issue":"5","key":"10004_CR30","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1093\/jigpal\/jzp043","volume":"18","author":"B Roeschies","year":"2010","unstructured":"Roeschies B, Igel C (2010) Structure optimization of reservoir networks. Logic J IGPL 18(5):635\u2013669","journal-title":"Logic J IGPL"},{"key":"10004_CR31","unstructured":"Schwenker F, Labib A (2009) Echo state networks and neural network ensembles to predict sunspots activity. In: ESANN 2009"},{"key":"10004_CR32","doi-asserted-by":"crossref","unstructured":"Stepney S (2021) Non-instantaneous information transfer in physical reservoir computing. In: UCNC 2021 volume 12984 of LNCS. Springer, pp 164\u2013176","DOI":"10.1007\/978-3-030-87993-8_11"},{"key":"10004_CR33","doi-asserted-by":"crossref","unstructured":"Stepney S (2024) Physical reservoir computing: a tutorial. Nat Comput (submitted)","DOI":"10.1007\/s11047-024-09997-y"},{"key":"10004_CR34","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.neunet.2019.03.005","volume":"115","author":"G Tanaka","year":"2019","unstructured":"Tanaka G, Yamane T, H\u00e9roux JB, Nakane R, Kanazawa N, Takeda S, Numata H, Nakano D, Hirose A (2019) Recent advances in physical reservoir computing: a review. Neural Netw 115:100\u2013123","journal-title":"Neural Netw"},{"key":"10004_CR35","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1145\/299157.299174","volume":"42","author":"A Thompson","year":"1999","unstructured":"Thompson A, Layzell P (1999) Analysis of unconventional evolved electronics. Commun ACM 42:71\u201379","journal-title":"Commun ACM"},{"key":"10004_CR36","first-page":"2307","volume":"23","author":"F Triefenbach","year":"2010","unstructured":"Triefenbach F, Jalal A, Schrauwen B, Martens J-P (2010) Phoneme recognition with large hierarchical reservoirs. Adv Neural Inf Process Syst 23:2307\u20132315","journal-title":"Adv Neural Inf Process Syst"},{"issue":"11","key":"10004_CR37","first-page":"2439","volume":"21","author":"F Triefenbach","year":"2013","unstructured":"Triefenbach F, Jalalvand A, Demuynck K, Martens J-P (2013) Acoustic modeling with hierarchical reservoirs. IEEE TASLP 21(11):2439\u20132450","journal-title":"IEEE TASLP"},{"key":"10004_CR38","doi-asserted-by":"crossref","unstructured":"Wierstra D, Gomez FJ, Schmidhuber J (2005) Modeling systems with internal state using evolino. In: GECCO 2025. ACM, pp 1795\u20131802","DOI":"10.1145\/1068009.1068315"},{"key":"10004_CR39","first-page":"186","volume-title":"UCNC 2023, volume 14003 of LNCS","author":"C Wringe","year":"2023","unstructured":"Wringe C, Stepney S, Trefzer MA (2023) Modelling and evaluating restricted ESNS. In: Genova D, Kari J (eds) UCNC 2023, volume 14003 of LNCS. Springer, pp 186\u2013201"},{"issue":"3","key":"10004_CR40","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.neunet.2007.04.014","volume":"20","author":"Y Xue","year":"2007","unstructured":"Xue Y, Yang L, Haykin S (2007) Decoupled echo state networks with lateral inhibition. Neural Netw 20(3):365\u2013376","journal-title":"Neural Netw"},{"issue":"636\u2013646","key":"10004_CR41","first-page":"267","volume":"226","author":"GU Yule","year":"1927","unstructured":"Yule GU (1927) On a method of investigating periodicities in disturbed series, with special reference to Wolfer\u2019s sunspot numbers. Philos Trans R Soc A 226(636\u2013646):267\u2013298","journal-title":"Philos Trans R Soc A"},{"key":"10004_CR42","doi-asserted-by":"publisher","first-page":"81033","DOI":"10.1109\/ACCESS.2023.3299296","volume":"11","author":"H Zhang","year":"2023","unstructured":"Zhang H, Vargas DV (2023) A survey on reservoir computing and its interdisciplinary applications beyond traditional machine learning. IEEE Access 11:81033\u201381070","journal-title":"IEEE Access"}],"container-title":["Natural Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11047-024-10004-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11047-024-10004-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11047-024-10004-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,7]],"date-time":"2025-03-07T01:37:46Z","timestamp":1741311466000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11047-024-10004-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,26]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10004"],"URL":"https:\/\/doi.org\/10.1007\/s11047-024-10004-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3758288\/v1","asserted-by":"object"}]},"ISSN":["1567-7818","1572-9796"],"issn-type":[{"value":"1567-7818","type":"print"},{"value":"1572-9796","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,26]]},"assertion":[{"value":"10 October 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 October 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no Conflict of interest of a financial or personal nature, nor other interests that might be perceived to influence the results and\/or discussion reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable, no human or animal research involved.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}