{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T06:43:24Z","timestamp":1784961804071,"version":"3.55.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T00:00:00Z","timestamp":1607990400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T00:00:00Z","timestamp":1607990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R032823\/1"],"award-info":[{"award-number":["EP\/R032823\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Comput"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We explore the effect of connectivity and topology on the dynamical behaviour of Reservoir Computers. At present, considerable effort is taken to design and hand-craft physical reservoir computers. Both structure and physical complexity are often pivotal to task performance, however, assessing their overall importance is challenging. Using a recently developed framework, we evaluate and compare the dynamical freedom (referring to quality) of neural network structures, as an analogy for physical systems. The results quantify how structure affects the behavioural range of networks. It demonstrates how high quality reached by more complex structures is often also achievable in simpler structures with greater network size. Alternatively, quality is often improved in smaller networks by adding greater connection complexity. This work demonstrates the benefits of using dynamical behaviour to assess the quality of computing substrates, rather than evaluation through benchmark tasks that often provide a narrow and biased insight into the computing quality of physical systems.<\/jats:p>","DOI":"10.1007\/s11047-020-09823-1","type":"journal-article","created":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T06:02:21Z","timestamp":1608012141000},"page":"205-216","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["Reservoir computing quality: connectivity and topology"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1813-7905","authenticated-orcid":false,"given":"Matthew","family":"Dale","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"O\u2019Keefe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angelika","family":"Sebald","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Stepney","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin A.","family":"Trefzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,12,15]]},"reference":[{"key":"9823_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84996-217-9","volume-title":"Game of life cellular automata","author":"A Adamatzky","year":"2010","unstructured":"Adamatzky A (2010) Game of life cellular automata, vol 1. Springer, Berlin"},{"key":"9823_CR2","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1038\/ncomms1476","volume":"2","author":"L Appeltant","year":"2011","unstructured":"Appeltant L, Soriano MC, Van der Sande G, Danckaert J, Massar S, Dambre J, Schrauwen B, Mirasso CR, Fischer I (2011) Information processing using a single dynamical node as complex system. Nat Commun 2:468","journal-title":"Nat Commun"},{"key":"9823_CR3","doi-asserted-by":"publisher","first-page":"58012","DOI":"10.1109\/ACCESS.2018.2873770","volume":"6","author":"A Bala","year":"2018","unstructured":"Bala A, Ismail I, Ibrahim R, Sait SM (2018) Applications of metaheuristics in reservoir computing techniques: a review. IEEE Access 6:58012\u201358029","journal-title":"IEEE Access"},{"issue":"5439","key":"9823_CR4","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1126\/science.286.5439.509","volume":"286","author":"AL Barab\u00e1si","year":"1999","unstructured":"Barab\u00e1si AL, Albert R (1999) Emergence of scaling in random networks. Science 286(5439):509\u2013512","journal-title":"Science"},{"issue":"4","key":"9823_CR5","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1103\/RevModPhys.39.883","volume":"39","author":"SG Brush","year":"1967","unstructured":"Brush SG (1967) History of the Lenz\u2013Ising model. Rev Mod Phys 39(4):883","journal-title":"Rev Mod Phys"},{"issue":"1\u20133","key":"9823_CR6","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/0167-2789(94)90273-9","volume":"75","author":"JP Crutchfield","year":"1994","unstructured":"Crutchfield JP (1994) The calculi of emergence. Phys D 75(1\u20133):11\u201354","journal-title":"Phys D"},{"key":"9823_CR7","doi-asserted-by":"crossref","unstructured":"Dale M, Miller JF, Stepney S, Trefzer MA (2016a) Reservoir computing in materio: an evaluation of configuration through evolution. In: 2016 IEEE symposium series on computational intelligence (SSCI), pp 1\u20138","DOI":"10.1109\/SSCI.2016.7850170"},{"key":"9823_CR8","doi-asserted-by":"crossref","unstructured":"Dale M, Miller JF, Stepney S, Trefzer MA (2016b) Evolving carbon nanotube reservoir computers. In: International conference on unconventional computation and natural computation. Springer, pp 49\u201361","DOI":"10.1007\/978-3-319-41312-9_5"},{"key":"9823_CR9","doi-asserted-by":"publisher","unstructured":"Dale M, Miller JF, Stepney S, Trefzer MA (2017) Reservoir computing in materio: a computational framework for in materio computing. In: 2017 international joint conference on neural networks (IJCNN), pp 2178\u20132185. https:\/\/doi.org\/10.1109\/IJCNN.2017.7966119","DOI":"10.1109\/IJCNN.2017.7966119"},{"key":"9823_CR10","doi-asserted-by":"crossref","unstructured":"Dale M, Dewhirst J, O\u2019Keefe S, Sebald A, Stepney S, Trefzer MA (2019a) The role of structure and complexity on reservoir computing quality. In: International conference on unconventional computation and natural computation. Springer, pp 52\u201364","DOI":"10.1007\/978-3-030-19311-9_6"},{"issue":"2226","key":"9823_CR11","doi-asserted-by":"publisher","first-page":"20180723","DOI":"10.1098\/rspa.2018.0723","volume":"475","author":"M Dale","year":"2019","unstructured":"Dale M, Miller JF, Stepney S, Trefzer MA (2019b) A substrate-independent framework to characterize reservoir computers. Proc R Soc A 475(2226):20180723","journal-title":"Proc R Soc A"},{"issue":"5","key":"9823_CR12","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1109\/TNN.2007.894082","volume":"18","author":"Z Deng","year":"2007","unstructured":"Deng Z, Zhang Y (2007) Collective behavior of a small-world recurrent neural system with scale-free distribution. IEEE Trans Neural Netw 18(5):1364\u20131375","journal-title":"IEEE Trans Neural Netw"},{"key":"9823_CR13","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.neucom.2016.12.089","volume":"268","author":"C Gallicchio","year":"2017","unstructured":"Gallicchio C, Micheli A, Pedrelli L (2017) Deep reservoir computing: a critical experimental analysis. Neurocomputing 268:87\u201399","journal-title":"Neurocomputing"},{"key":"9823_CR14","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1007\/978-3-319-01928-4_6","volume-title":"DNA computing and molecular programming","author":"A Goudarzi","year":"2013","unstructured":"Goudarzi A, Lakin MR, Stefanovic D (2013) DNA reservoir computing: a novel molecular computing approach. In: Rondelez Y, Woods D (eds) DNA computing and molecular programming. Springer, Berlin, pp 76\u201389"},{"key":"9823_CR15","doi-asserted-by":"crossref","unstructured":"Harvey I (2009) The microbial genetic algorithm. In: European conference on artificial life. Springer, pp 126\u2013133","DOI":"10.1007\/978-3-642-21314-4_16"},{"key":"9823_CR16","unstructured":"Jaeger H (2001) Short term memory in echo state networks. Technical report GMD 152, GMD-Forschungszentrum Informationstechnik"},{"key":"9823_CR17","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.neunet.2019.01.002","volume":"112","author":"Y Kawai","year":"2019","unstructured":"Kawai Y, Park J, Asada M (2019) A small-world topology enhances the echo state property and signal propagation in reservoir computing. Neural Netw 112:15\u201323","journal-title":"Neural Netw"},{"key":"9823_CR18","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-9430-5","volume-title":"Equilibrium statistical mechanics of lattice models","author":"DA Lavis","year":"2015","unstructured":"Lavis DA (2015) Equilibrium statistical mechanics of lattice models. Springer, Berlin"},{"issue":"3","key":"9823_CR19","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/j.neunet.2007.04.017","volume":"20","author":"R Legenstein","year":"2007","unstructured":"Legenstein R, Maass W (2007) Edge of chaos and prediction of computational performance for neural circuit models. Neural Netw 20(3):323\u2013334","journal-title":"Neural Netw"},{"key":"9823_CR20","unstructured":"Lehman J, Stanley KO (2008) Exploiting open-endedness to solve problems through the search for novelty. In: ALife XI, pp 329\u2013336"},{"issue":"6799","key":"9823_CR21","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1038\/35023282","volume":"406","author":"S Lloyd","year":"2000","unstructured":"Lloyd S (2000) Ultimate physical limits to computation. Nature 406(6799):1047","journal-title":"Nature"},{"key":"9823_CR22","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1007\/978-3-642-35289-8_36","volume-title":"Neural networks: tricks of the trade","author":"M Luko\u0161evi\u010dius","year":"2012","unstructured":"Luko\u0161evi\u010dius M (2012) A practical guide to applying echo state networks. In: Orr GB, M\u00fcller KR (eds) Neural networks: tricks of the trade. Springer, Berlin, pp 659\u2013686"},{"issue":"3","key":"9823_CR23","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.cosrev.2009.03.005","volume":"3","author":"M Luko\u0161evi\u010dius","year":"2009","unstructured":"Luko\u0161evi\u010dius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3(3):127\u2013149","journal-title":"Comput Sci Rev"},{"key":"9823_CR24","doi-asserted-by":"publisher","first-page":"14945","DOI":"10.1038\/srep14945","volume":"5","author":"S Ort\u00edn","year":"2015","unstructured":"Ort\u00edn S, Soriano MC, Pesquera L, Brunner D, San-Mart\u00edn D, Fischer I, Mirasso C, Guti\u00e9rrez J (2015) A unified framework for reservoir computing and extreme learning machines based on a single time-delayed neuron. Sci Rep 5:14945","journal-title":"Sci Rep"},{"key":"9823_CR25","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1038\/srep00287","volume":"2","author":"Y Paquot","year":"2012","unstructured":"Paquot Y, Duport F, Smerieri A, Dambre J, Schrauwen B, Haelterman M, Massar S (2012) Optoelectronic reservoir computing. Sci Rep 2:287","journal-title":"Sci Rep"},{"issue":"5118","key":"9823_CR26","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1126\/science.261.5118.189","volume":"261","author":"JE Pearson","year":"1993","unstructured":"Pearson JE (1993) Complex patterns in a simple system. Science 261(5118):189\u2013192","journal-title":"Science"},{"key":"9823_CR27","doi-asserted-by":"publisher","first-page":"40","DOI":"10.3389\/frobt.2016.00040","volume":"3","author":"JK Pugh","year":"2016","unstructured":"Pugh JK, Soros LB, Stanley KO (2016) Quality diversity: a new frontier for evolutionary computation. Front Robot AI 3:40","journal-title":"Front Robot AI"},{"key":"9823_CR28","doi-asserted-by":"crossref","unstructured":"Rodan A, Ti\u0148o P (2010) Simple deterministically constructed recurrent neural networks. In: International conference on intelligent data engineering and automated learning. Springer, pp 267\u2013274","DOI":"10.1007\/978-3-642-15381-5_33"},{"issue":"1","key":"9823_CR29","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/TNN.2010.2089641","volume":"22","author":"A Rodan","year":"2011","unstructured":"Rodan A, Ti\u0148o P (2011) Minimum complexity echo state network. IEEE Trans Neural Netw 22(1):131\u2013144","journal-title":"IEEE Trans Neural Netw"},{"key":"9823_CR30","unstructured":"Schrauwen B, Verstraeten D, Van Campenhout J (2007) An overview of reservoir computing: theory, applications and implementations. In: Proceedings of the 15th European symposium on artificial neural networks. Citeseer"},{"issue":"9","key":"9823_CR31","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1016\/j.physd.2008.01.028","volume":"237","author":"S Stepney","year":"2008","unstructured":"Stepney S (2008) The neglected pillar of material computation. Phys D Nonlinear Phenom 237(9):1157\u20131164","journal-title":"Phys D Nonlinear Phenom"},{"key":"9823_CR32","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.neunet.2019.03.005","volume":"115","author":"G Tanaka","year":"2019","unstructured":"Tanaka G, Yamane T, H\u00e9roux JB, Nakane R, Kanazawa N, Takeda S, Numata H, Nakano D, Hirose A (2019) Recent advances in physical reservoir computing: a review. Neural Netw 115:100\u2013123","journal-title":"Neural Netw"},{"issue":"3","key":"9823_CR33","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1016\/j.neunet.2007.04.003","volume":"20","author":"D Verstraeten","year":"2007","unstructured":"Verstraeten D, Schrauwen B, D\u2019Haene M, Stroobandt D (2007) An experimental unification of reservoir computing methods. Neural Netw 20(3):391\u2013403","journal-title":"Neural Netw"},{"issue":"6684","key":"9823_CR34","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1038\/30918","volume":"393","author":"DJ Watts","year":"1998","unstructured":"Watts DJ, Strogatz SH (1998) Collective dynamics of \u2018small-world\u2019 networks. Nature 393(6684):440","journal-title":"Nature"}],"container-title":["Natural Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11047-020-09823-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11047-020-09823-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11047-020-09823-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,16]],"date-time":"2021-06-16T10:13:17Z","timestamp":1623838397000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11047-020-09823-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,15]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["9823"],"URL":"https:\/\/doi.org\/10.1007\/s11047-020-09823-1","relation":{},"ISSN":["1567-7818","1572-9796"],"issn-type":[{"value":"1567-7818","type":"print"},{"value":"1572-9796","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,15]]},"assertion":[{"value":"12 November 2020","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 December 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}