{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:20:37Z","timestamp":1760242837836,"version":"build-2065373602"},"reference-count":21,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2016,12,23]],"date-time":"2016-12-23T00:00:00Z","timestamp":1482451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Recurrent networks with transfer functions that fulfil the Lipschitz continuity with     K = 1     may be echo state networks if certain limitations on the recurrent connectivity are applied. It has been shown that it is sufficient if the largest singular value of the recurrent connectivity is smaller than 1. The main achievement of this paper is a proof under which conditions the network is an echo state network even if the largest singular value is one. It turns out that in this critical case the exact shape of the transfer function plays a decisive role in determining whether the network still fulfills the echo state condition. In addition, several examples with one-neuron networks are outlined to illustrate effects of critical connectivity. Moreover, within the manuscript a mathematical definition for a critical echo state network is suggested.<\/jats:p>","DOI":"10.3390\/e19010003","type":"journal-article","created":{"date-parts":[[2016,12,23]],"date-time":"2016-12-23T04:09:09Z","timestamp":1482466149000},"page":"3","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Echo State Condition at the Critical Point"],"prefix":"10.3390","volume":"19","author":[{"given":"Norbert","family":"Mayer","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 62102, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1109\/5.58337","article-title":"Backpropagation through time: What it does and how to do it","volume":"78","author":"Werbos","year":"1990","journal-title":"Proc. IEEE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.cosrev.2009.03.005","article-title":"Reservoir computing approaches to recurrent neural network training","volume":"3","author":"Jaeger","year":"2009","journal-title":"Comput. Sci. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2531","DOI":"10.1162\/089976602760407955","article-title":"Real-time computing without stable states: A new framework for neural computation based on perturbations","volume":"14","author":"Maass","year":"2002","journal-title":"Neural Comput."},{"unstructured":"Jaeger, H. GMD German National Research Insitute for Computer Science 2011, Available online: https:\/\/pdfs.semanticscholar.org\/8430\/c0b9afa478ae660398704b11dca1221ccf22.pdf.","key":"ref_4"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/s12064-011-0146-8","article-title":"Information processing in echo state networks at the edge of chaos","volume":"131","author":"Boedecker","year":"2012","journal-title":"Theory Biosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1162\/NECO_a_00411","article-title":"Echo state property linked to an input: Exploring a fundamental characteristic of recurrent neural networks","volume":"25","author":"Manjunath","year":"2013","journal-title":"Neural Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1162\/NECO_a_00730","article-title":"Adaptive critical reservoirs with power law forgetting of unexpected input events","volume":"27","author":"Mayer","year":"2015","journal-title":"Neural Comput."},{"unstructured":"Ng, A. CS 229 Machine Learning, UC Stanford. URL. Available online: http:\/\/cs229.stanford.edu\/notes\/cs229-notes1.pdf.","key":"ref_8"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.neunet.2007.04.001","article-title":"Special issue on echo state networks and liquid state machines","volume":"20","author":"Jaeger","year":"2007","journal-title":"Neural Netw."},{"unstructured":"Schrauwen, B., Verstraeten, D., and Van Campenhout, J. (2007, January 25\u201327). An overview of reservoir computing: Theory, applications and implementations. Proceedings of the 15th European Symposium on Artificial Neural Networks, Bruges, Belgium.","key":"ref_10"},{"unstructured":"Jaeger, H. (2002, January 9\u201314). Adaptive nonlinear system identification with echo state networks. Proceedings of the Neural Information Processing Systems: Natural and Synthetic, Vancouver, BC, Canada.","key":"ref_11"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.neunet.2015.12.013","article-title":"A local Echo State Property through the largest Lyapunov exponent","volume":"76","author":"Wainrib","year":"2016","journal-title":"Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"820","DOI":"10.1109\/TNN.2006.872357","article-title":"A Tighter Bound for the Echo State Property","volume":"17","author":"Buehner","year":"2006","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neunet.2012.07.005","article-title":"Re-visiting the echo state property","volume":"35","author":"Yildiz","year":"2012","journal-title":"Neural Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1038\/ncomms1476","article-title":"Information processing using a single dynamical node as complex system","volume":"2","author":"Appeltant","year":"2011","journal-title":"Nat. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"14945","DOI":"10.1038\/srep14945","article-title":"A unified framework for reservoir computing and extreme learning machines based on a single time-delayed neuron","volume":"5","author":"Soriano","year":"2015","journal-title":"Sci. Rep."},{"unstructured":"Natschl\u00e4ger, T., Bertschinger, N., and Legenstein, R.A. (2005, January 7\u201311). At the edge of chaos: Real-time computations and self-organized criticality in recurrent neural networks. Proceedings of the Advances in Neural Information Processing Systems 17, Bonn, Germany.","key":"ref_17"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.neunet.2007.04.017","article-title":"Edge of chaos and prediction of computational performance for neural circuit models","volume":"20","author":"Legenstein","year":"2007","journal-title":"Neural Netw."},{"doi-asserted-by":"crossref","unstructured":"Mayer, N.M. (arXiv, 2016). Critical Echo State Networks that Anticipate Input Using Adaptive Transfer Functions, arXiv.","key":"ref_19","DOI":"10.1007\/978-3-319-59072-1_49"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1037\/0033-295X.103.4.734","article-title":"One hundred years of forgetting: A quantitative description of retention","volume":"103","author":"Rubin","year":"1996","journal-title":"Psychol. Rev."},{"unstructured":"Kahana, M.J., and Adler, M. (2002). Note on the Power Law of Forgetting, University of Pennsylvania.","key":"ref_21"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/1\/3\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:29:09Z","timestamp":1760210949000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/1\/3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,23]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,1]]}},"alternative-id":["e19010003"],"URL":"https:\/\/doi.org\/10.3390\/e19010003","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2016,12,23]]}}}