{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T16:11:27Z","timestamp":1786983087978,"version":"build-2736575974"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,21]],"date-time":"2024-02-21T00:00:00Z","timestamp":1708473600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,21]],"date-time":"2024-02-21T00:00:00Z","timestamp":1708473600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72171172"],"award-info":[{"award-number":["72171172"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62088101"],"award-info":[{"award-number":["62088101"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shanghai Municipal Science and Technology, China Major Project","award":["2021SHZDZX0100"],"award-info":[{"award-number":["2021SHZDZX0100"]}]},{"name":"Shanghai Research Institute of China Engineering Science and Technology Development Strategy, Strategic Research and Consulting Project","award":["2022-DFZD-33-02"],"award-info":[{"award-number":["2022-DFZD-33-02"]}]},{"name":"Chinese Academy of Engineering, Strategic Research and Consulting Program","award":["2022-XY-100"],"award-info":[{"award-number":["2022-XY-100"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton. Intell. Syst."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>With the aim to enhance prediction accuracy for nonlinear time series, this paper put forward an improved deep Echo State Network based on reservoir states reconstruction driven by a Self-Normalizing Activation (SNA) function as the replacement for the traditional Hyperbolic tangent activation function to reduce the model\u2019s sensitivity to hyper-parameters. The Strategy was implemented in a two-state reconstruction process by first inputting the time series data to the model separately. Once, the time data passes through the reservoirs and is activated by the SNA activation function, the new state for the reservoirs is created. The state is input to the next layer, and the concatenate states module saves. Pairs of states are selected from the activated multi-layer reservoirs and input into the state reconstruction module. Multiple input states are transformed through the state reconstruction module and finally saved to the concatenate state module. Two evaluation metrics were used to benchmark against three other ESNs with SNA activation functions to achieve better prediction accuracy.<\/jats:p>","DOI":"10.1007\/s43684-023-00057-3","type":"journal-article","created":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T23:30:47Z","timestamp":1708471847000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Prediction for nonlinear time series by improved deep echo state network based on reservoir states reconstruction"],"prefix":"10.1007","volume":"4","author":[{"given":"Qiufeng","family":"Yu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Teng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ansar","family":"Yasar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"St\u00e9phane","family":"Galland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,21]]},"reference":[{"issue":"3","key":"57_CR1","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/0167-2789(89)90074-2","volume":"35","author":"M. Casdagli","year":"1989","unstructured":"M. Casdagli, Nonlinear prediction of chaotic time series. Phys. D, Nonlinear Phenom. 35(3), 335\u2013356 (1989)","journal-title":"Phys. D, Nonlinear Phenom."},{"key":"57_CR2","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.engappai.2019.08.018","volume":"86","author":"Z. Hajirahimi","year":"2019","unstructured":"Z. Hajirahimi, M. Khashei, Hybrid structures in time series modeling and forecasting: a review. Eng. Appl. Artif. Intell. 86, 83\u2013106 (2019)","journal-title":"Eng. Appl. Artif. Intell."},{"issue":"2","key":"57_CR3","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/MCI.2009.932254","volume":"4","author":"N.I. Sapankevych","year":"2009","unstructured":"N.I. Sapankevych, R. Sankar, Time series prediction using support vector machines: a survey. IEEE Comput. Intell. Mag. 4(2), 24\u201338 (2009). https:\/\/doi.org\/10.1109\/MCI.2009.932254","journal-title":"IEEE Comput. Intell. Mag."},{"key":"57_CR4","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1016\/j.eswa.2016.02.031","volume":"55","author":"G. Heydari","year":"2016","unstructured":"G. Heydari, M.A. Vali, A.A. Gharaveisi, Chaotic time series prediction via artificial neural square fuzzy inference system. Expert Syst. Appl. 55, 461\u2013468 (2016)","journal-title":"Expert Syst. Appl."},{"key":"57_CR5","unstructured":"C. Sun, M. Song, S. Hong et\u00a0al., A review of designs and applications of echo state networks (2020). arXiv preprint. arXiv:2012.02974"},{"issue":"2","key":"57_CR6","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1207\/s15516709cog1402_1","volume":"14","author":"J.L. Elman","year":"1990","unstructured":"J.L. Elman, Finding structure in time. Cogn. Sci. 14(2), 179\u2013211 (1990)","journal-title":"Cogn. Sci."},{"key":"57_CR7","doi-asserted-by":"crossref","unstructured":"D.E. Rumelhart, G.E. Hinton, R.J. Williams, Learning internal representations by error propagation, California Univ. San Diego La Jolla Inst. for Cognitive Science, 1985","DOI":"10.21236\/ADA164453"},{"key":"57_CR8","volume":"3","author":"K. Doya","year":"1992","unstructured":"K. Doya, Bifurcations in the learning of recurrent neural networks 3. Learn. (RTRL) 3, Article ID\u00a017 (1992)","journal-title":"Learn. (RTRL)"},{"key":"57_CR9","volume-title":"Lecture 15: Exploding and Vanishing Gradients","author":"R. Grosse","year":"2017","unstructured":"R. Grosse, Lecture 15: Exploding and Vanishing Gradients (University of Toronto Computer Science, 2017)"},{"issue":"3","key":"57_CR10","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.cosrev.2009.03.005","volume":"3","author":"M. Luko\u0161evi\u010dius","year":"2009","unstructured":"M. Luko\u0161evi\u010dius, H. Jaeger, Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3(3), 127\u2013149 (2009)","journal-title":"Comput. Sci. Rev."},{"key":"57_CR11","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.neucom.2016.12.089","volume":"268","author":"C. Gallicchio","year":"2017","unstructured":"C. Gallicchio, A. Micheli, L. Pedrelli, Deep reservoir computing: a critical experimental analysis. Neurocomputing 268, 87\u201399 (2017)","journal-title":"Neurocomputing"},{"key":"57_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ins.2016.08.081","volume":"373","author":"Q. Ma","year":"2016","unstructured":"Q. Ma, L. Shen, W. Chen et al., Functional echo state network for time series classification. Inf. Sci. 373, 1\u201320 (2016)","journal-title":"Inf. Sci."},{"issue":"9","key":"57_CR13","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1631\/jzus.C1200069","volume":"13","author":"X. Sun","year":"2012","unstructured":"X. Sun, H. Cui, R. Liu et al., Modeling deterministic echo state network with loop reservoir. J. Zhejiang Univ. Sci. C 13(9), 689\u2013701 (2012)","journal-title":"J. Zhejiang Univ. Sci. C"},{"issue":"1","key":"57_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-50158-4","volume":"9","author":"P. Verzelli","year":"2019","unstructured":"P. Verzelli, C. Alippi, L. Livi, Echo state networks with self-normalizing activations on the hyper-sphere. Sci. Rep. 9(1), 1\u201314 (2019)","journal-title":"Sci. Rep."},{"key":"57_CR15","first-page":"1","volume-title":"2020 International Joint Conference on Neural Networks (IJCNN)","author":"Z. Li","year":"2020","unstructured":"Z. Li, T. Tanaka, HP-ESN: echo state networks combined with Hodrick\u2013Prescott filter for nonlinear time-series prediction, in 2020 International Joint Conference on Neural Networks (IJCNN) (IEEE Press, New York, 2020), pp. 1\u20139"},{"issue":"5667","key":"57_CR16","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1126\/science.1091277","volume":"304","author":"H. Jaeger","year":"2004","unstructured":"H. Jaeger, H. Haas, Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667), 78\u201380 (2004)","journal-title":"Science"},{"issue":"3","key":"57_CR17","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/j.neunet.2007.04.016","volume":"20","author":"H. Jaeger","year":"2007","unstructured":"H. Jaeger, M. Luko\u0161evi\u010dius, D. Popovici et al., Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20(3), 335\u2013352 (2007)","journal-title":"Neural Netw."},{"key":"57_CR18","doi-asserted-by":"publisher","first-page":"1717","DOI":"10.1109\/IJCNN.2017.7966058","volume-title":"2017 International Joint Conference on Neural Networks (IJCNN)","author":"H.T. Fan","year":"2017","unstructured":"H.T. Fan, W. Wang, Z. Jin, Performance optimization of echo state networks through principal neuron reinforcement, in 2017 International Joint Conference on Neural Networks (IJCNN) (IEEE Press, New York, 2017), pp. 1717\u20131723"},{"key":"57_CR19","first-page":"19","volume-title":"International Conference on Artificial Neural Networks","author":"\u0160. Babinec","year":"2007","unstructured":"\u0160. Babinec, J. Posp\u00edchal, Improving the prediction accuracy of echo state neural networks by anti-Oja\u2019s learning, in International Conference on Artificial Neural Networks (Springer, Berlin, 2007), pp. 19\u201328"},{"issue":"1","key":"57_CR20","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1109\/TNN.2010.2089641","volume":"22","author":"A. Rodan","year":"2010","unstructured":"A. Rodan, P. Tino, Minimum complexity echo state network. IEEE Trans. Neural Netw. 22(1), 131\u2013144 (2010)","journal-title":"IEEE Trans. Neural Netw."},{"issue":"12","key":"57_CR21","doi-asserted-by":"publisher","first-page":"9465","DOI":"10.1109\/TIM.2020.3003975","volume":"69","author":"Y. Yang","year":"2020","unstructured":"Y. Yang, X. Zhao, X. Liu, A novel echo state network and its application in temperature prediction of exhaust gas from hot blast stove. IEEE Trans. Instrum. Meas. 69(12), 9465\u20139476 (2020)","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"57_CR22","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.ins.2019.09.049","volume":"511","author":"Q. Ma","year":"2020","unstructured":"Q. Ma, L. Shen, G.W. Cottrell, DeePr-ESN: a deep projection-encoding echo-state network. Inf. Sci. 511, 152\u2013171 (2020)","journal-title":"Inf. Sci."},{"key":"57_CR23","doi-asserted-by":"crossref","unstructured":"Z. Carmichael, H. Syed, S. Burtner et\u00a0al., Mod-deepesn: modular deep echo state network (2018). arXiv preprint. arXiv:1808.00523","DOI":"10.32470\/CCN.2018.1239-0"},{"key":"57_CR24","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1016\/j.neucom.2021.08.122","volume":"467","author":"Z. Li","year":"2022","unstructured":"Z. Li, G. Tanaka, Multi-reservoir echo state networks with sequence resampling for nonlinear time-series prediction. Neurocomputing 467, 115\u2013129 (2022)","journal-title":"Neurocomputing"},{"key":"57_CR25","first-page":"90","volume-title":"International Conference on Computational Science","author":"R. Wcis\u0142o","year":"2021","unstructured":"R. Wcis\u0142o, W. Czech, Grouped multi-layer echo state networks with self-normalizing activations, in International Conference on Computational Science (Springer, Cham, 2021), pp. 90\u201397"},{"key":"57_CR26","first-page":"367","volume-title":"International Conference on Artificial Neural Networks","author":"\u0160. Babinec","year":"2006","unstructured":"\u0160. Babinec, J. Posp\u00edchal, Merging echo state and feedforward neural networks for time series forecasting, in International Conference on Artificial Neural Networks (Springer, Berlin, 2006), pp. 367\u2013375"},{"key":"57_CR27","first-page":"1","volume":"70","author":"K. He","year":"2021","unstructured":"K. He, L. Mao, J. Yu et al., Long-term performance prediction of PEMFC based on LASSO-ESN. IEEE Trans. Instrum. Meas. 70, 1\u201311 (2021)","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"57_CR28","unstructured":"H. Jaeger, The \u201cecho state\u201d approach to analysing and training recurrent neural networks-with an erratum note, Bonn, Germany: German National Research Center for Information Technology GMD Technical Report, 148(34), 13 (2001)"},{"issue":"3","key":"57_CR29","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1109\/TNN.2006.872357","volume":"17","author":"M. Buehner","year":"2006","unstructured":"M. Buehner, P. Young, A tighter bound for the echo state property. IEEE Trans. Neural Netw. 17(3), 820\u2013824 (2006)","journal-title":"IEEE Trans. Neural Netw."},{"key":"57_CR30","first-page":"90","volume-title":"International Conference on Computational Science","author":"R. Wcis\u0142o","year":"2021","unstructured":"R. Wcis\u0142o, W. Czech, Grouped multi-layer echo state networks with self-normalizing activations, in International Conference on Computational Science (Springer, Cham, 2021), pp. 90\u201397"},{"issue":"3","key":"57_CR31","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.neunet.2007.04.014","volume":"20","author":"Y. Xue","year":"2007","unstructured":"Y. Xue, L. Yang, S. Haykin, Decoupled echo state networks with lateral inhibition. Neural Netw. 20(3), 365\u2013376 (2007)","journal-title":"Neural Netw."},{"issue":"5","key":"57_CR32","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1016\/0375-9601(76)90101-8","volume":"57","author":"O.E. R\u00f6ssler","year":"1976","unstructured":"O.E. R\u00f6ssler, An equation for continuous chaos. Phys. Lett. A 57(5), 397\u2013398 (1976)","journal-title":"Phys. Lett. A"},{"key":"57_CR33","doi-asserted-by":"publisher","first-page":"1786","DOI":"10.1109\/ICNN.1993.298828","volume-title":"IEEE International Conference on Neural Networks","author":"A.S. Weigend","year":"1993","unstructured":"A.S. Weigend, N.A. Gershenfeld, Results of the time series prediction competition at the Santa Fe Institute, in IEEE International Conference on Neural Networks (IEEE Press, New York, 1993), pp. 1786\u20131793"},{"issue":"23","key":"57_CR34","doi-asserted-by":"publisher","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","volume":"101","author":"A.L. Goldberger","year":"2000","unstructured":"A.L. Goldberger, L.A.N. Amaral, L. Glass et al., PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101(23), e215\u2013e220 (2000)","journal-title":"Circulation"},{"issue":"6","key":"57_CR35","doi-asserted-by":"publisher","first-page":"1621","DOI":"10.1109\/TNNLS.2018.2869131","volume":"30","author":"M. Xu","year":"2018","unstructured":"M. Xu, Y. Yang, M. Han et al., Spatio-temporal interpolated echo state network for meteorological series prediction. IEEE Trans. Neural Netw. Learn. Syst. 30(6), 1621\u20131634 (2018)","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."}],"container-title":["Autonomous Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-023-00057-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43684-023-00057-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-023-00057-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T23:46:55Z","timestamp":1708472815000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43684-023-00057-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,21]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["57"],"URL":"https:\/\/doi.org\/10.1007\/s43684-023-00057-3","relation":{},"ISSN":["2730-616X"],"issn-type":[{"value":"2730-616X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,21]]},"assertion":[{"value":"6 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Prof. Li Li is an editorial board member for Autonomous Intelligent Systems and was not involved in the editorial review, or the decision to publish, this article. All authors declare that there are no other competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"3"}}