{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,3]],"date-time":"2026-01-03T06:28:34Z","timestamp":1767421714363},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Reservoir computing (RC) is considered as a suitable alternative for descending gradient methods in recursive neural networks (RNNs) training. The echo state network (ESN) is a platform for RC and nonlinear system simulation in the cloud environment with many external users. In the past researches, the highest eigenvalue of reservoir connection weight (spectral radius) was used to predict reservoir dynamics. Some researchers have illustrated; the characteristics of scale-free and small-world can improve the approximation capability in echo state networks; however, recent studies have shown importance of the infrastructures such as clusters and the stability criteria of these reservoirs as altered. In this research, we suggest a high clustered ESN called HCESN that its internal neurons are interconnected in form of clusters. Each of the clusters contains one backbone and a number of local nodes. We implemented a classical clustering algorithm, called K-means, and three optimization algorithms including genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO) to improve the clustering efficiency of the new reservoir and compared them with each other. For investigating the spectral radius and predictive power of the resulting reservoirs, we also applied them to the laser time series and the Mackey-Glass dynamical system. It is demonstrated that new clustered reservoirs have some specifications of biologic neural systems and complex networks like average short path length, high clustering coefficient, and power-law distribution. The empirical results illustrated that the ESN based on PSO could strikingly enhance echo state property (ESP) and obtains less chaotic time series prediction error compared with other works and the original version of ESN. Therefore, it can approximate nonlinear dynamical systems and predict the chaotic time series.<\/jats:p>","DOI":"10.1186\/s13638-020-01672-x","type":"journal-article","created":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T16:03:56Z","timestamp":1584115436000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Design of a reservoir for cloud-enabled echo state network with high clustering coefficient"],"prefix":"10.1186","volume":"2020","author":[{"given":"Abbas","family":"Akrami","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Habib","family":"Rostami","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad R.","family":"Khosravi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,3,13]]},"reference":[{"key":"1672_CR1","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/BF02478259","volume":"5","author":"WS McCulloch","year":"1943","unstructured":"W.S. McCulloch, W. Pitts, A Logical Calculus of the Ideas Immanent in Nervous Activity. Bull Math Biol. 5, 115\u2013133 (1943) https:\/\/doi.org\/10.1007\/BF02478259","journal-title":"Bull Math Biol."},{"key":"1672_CR2","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-019-06152-0","volume-title":"Cloud Networking Computing","author":"J Kim","year":"2019","unstructured":"J. Kim, H.J.T. Manaligod, J. Lee, S. Jo, Cloud Networking Computing (2019)"},{"key":"1672_CR3","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.neucom.2016.01.088","volume":"192","author":"S Otte","year":"2016","unstructured":"S. Otte, M.V. Butz, D. Koryakin, F. Becker, M. Liwicki, A. Zell, Optimizing recurrent reservoirs with neuro-evolution. Neurocomputing. 192, 128\u2013138 (2016)","journal-title":"Neurocomputing."},{"key":"1672_CR4","doi-asserted-by":"crossref","unstructured":"Chouikhi, N., Ammar, B., Rokbani, N., Alimi, A. M., & Abraham, A. (2015). A hybrid approach based on particle swarm optimization for echo state network initialization. In Systems, Man, and Cybernetics (SMC), 2015 IEEE International Conference on (pp. 2896-2901). IEEE.","DOI":"10.1109\/SMC.2015.504"},{"key":"1672_CR5","doi-asserted-by":"crossref","unstructured":"J. Chen, D. Liu, F. Hao, H. Wang, Community detection in the dynamic signed network: an intimacy evolutionary clustering algorithm. J Ambient Intelligence Human Comp., 1\u201310 (2019)","DOI":"10.1007\/s12652-019-01215-3"},{"key":"1672_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neunet.2012.07.005","volume":"35","author":"IB Yildiz","year":"2012","unstructured":"I.B. Yildiz, H. Jaeger, S.J. Kiebel, Re-visiting the echo state property. Neural Net. 35, 1\u20139 (2012)","journal-title":"Neural Net."},{"key":"1672_CR7","unstructured":"Jaeger, H. (2001). The \u201cecho state\u201d approach to analyzing and training recurrent neural networks with an erratum Note. Bonn, Germany: German National Research Center for Information Technology GMD Technical The report, 148(34), 13."},{"issue":"3","key":"1672_CR8","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1109\/TNN.2006.872357","volume":"17","author":"M Buehner","year":"2006","unstructured":"M. Buehner, P. Young, A tighter bound for the echo state property. IEEE Trans Neural Netw 17(3), 820\u2013824 (2006)","journal-title":"IEEE Trans Neural Netw"},{"issue":"2","key":"1672_CR9","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1109\/TNNLS.2016.2514275","volume":"28","author":"J Qiao","year":"2017","unstructured":"J. Qiao, F. Li, H. Han, W. Li, Growing Echo-State Network With Multiple Subreservoirs. IEEE Trans. Neural Netw. Learning Syst. 28(2), 391\u2013404 (2017)","journal-title":"IEEE Trans. Neural Netw. Learning Syst."},{"key":"1672_CR10","doi-asserted-by":"crossref","unstructured":"Watts, D. J., & Strogatz, S. H. (1998). Collective dynamics of \u2018small-world\u2019 networks nature, 393(6684), 440.","DOI":"10.1038\/30918"},{"key":"1672_CR11","unstructured":"Barab\u00e1si, A. L., & Albert, R. (1999). The emergence of scaling in random networks.science, 286(5439), 509-512."},{"key":"1672_CR12","doi-asserted-by":"crossref","unstructured":"M.R. Khosravi, S. Samadi, Reliable Data Aggregation in Internet of ViSAR Vehicles Using Chained Dual-Phase Adaptive Interpolation and Data Embedding. IEEE Internet of Things Journal. (2019)","DOI":"10.1109\/JIOT.2019.2952284"},{"issue":"2","key":"1672_CR13","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/nrg1272","volume":"5","author":"AL Barabasi","year":"2004","unstructured":"A.L. Barabasi, Z.N. Oltvai, Network biology: understanding the cell's functional organization. Nat Rev Gen. 5(2), 101 (2004)","journal-title":"Nat Rev Gen."},{"key":"1672_CR14","doi-asserted-by":"crossref","unstructured":"Faloutsos, M., Faloutsos, P., & Faloutsos, C. (1999). On power-law relationships of the internet topology. In ACM SIGCOMM computer communication review (Vol. 29, No. 4, pp. 251-262). ACM.","DOI":"10.1145\/316194.316229"},{"issue":"3","key":"1672_CR15","doi-asserted-by":"publisher","first-page":"036123","DOI":"10.1103\/PhysRevE.65.036123","volume":"65","author":"K Klemm","year":"2002","unstructured":"K. Klemm, V.M. Eguiluz, Highly clustered scale-free networks. Physical Review E 65(3), 036123 (2002)","journal-title":"Physical Review E"},{"issue":"6825","key":"1672_CR16","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1038\/35065725","volume":"410","author":"SH Strogatz","year":"2001","unstructured":"S.H. Strogatz, Exploring complex networks. Nature. 410(6825), 268 (2001)","journal-title":"Nature."},{"issue":"1","key":"1672_CR17","first-page":"61","volume":"1","author":"J Travers","year":"1967","unstructured":"J. Travers, S. Milgram, The small world problem. Psychol Today. 1(1), 61\u201367 (1967)","journal-title":"Psychol Today."},{"key":"1672_CR18","doi-asserted-by":"crossref","unstructured":"Yang, J., He, L., & Kong, B. (2016). Efficient Method for Designing Associative Memory with Contextual small-world Architecture. In 2016 9th International Symposium on Computational Intelligence and Design (ISCID) (Vol. 2, pp. 152-156). IEEE.","DOI":"10.1109\/ISCID.2016.2044"},{"issue":"10","key":"1672_CR19","doi-asserted-by":"publisher","first-page":"e0184683","DOI":"10.1371\/journal.pone.0184683","volume":"12","author":"DH Kim","year":"2017","unstructured":"D.H. Kim, J. Park, B. Kahng, Enhanced storage capacity with errors in scale-free Hopfield neural networks: An analytical study. PloS one. 12(10), e0184683 (2017)","journal-title":"PloS one."},{"key":"1672_CR20","doi-asserted-by":"crossref","unstructured":"Umamaheshwari, S., & Swaminathan, J. N. (2018, January). Man-In-Middle Attack\/for a scale-free Topology. In 2018 International Conference on Computer Communication and Informatics (ICCCI) (pp. 1-4). IEEE.","DOI":"10.1109\/ICCCI.2018.8441202"},{"issue":"05","key":"1672_CR21","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1142\/S0129065711002924","volume":"21","author":"F Han","year":"2011","unstructured":"F. Han, M. Wiercigroch, J.A. Fang, Z. Wang, Excitement and synchronization of small-world neuronal networks with short-term synaptic plasticity. Int J Neural Syst 21(05), 415\u2013425 (2011)","journal-title":"Int J Neural Syst"},{"issue":"3","key":"1672_CR22","doi-asserted-by":"publisher","first-page":"036010","DOI":"10.1088\/1478-3975\/7\/3\/036010","volume":"7","author":"C Li","year":"2010","unstructured":"C. Li, Q. Zheng, Synchronization of the small-world neuronal network with unreliable synapses. Phys Biol. 7(3), 036010 (2010)","journal-title":"Phys Biol."},{"issue":"2","key":"1672_CR23","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.arcontrol.2014.09.003","volume":"38","author":"Y Tang","year":"2014","unstructured":"Y. Tang, F. Qian, H. Gao, J. Kurths, Synchronization in complex networks and its application\u2013a survey of recent advances and challenges. Ann Rev Control. 38(2), 184\u2013198 (2014)","journal-title":"Ann Rev Control."},{"key":"1672_CR24","doi-asserted-by":"crossref","unstructured":"Alderisio, F., & di Bernardo, M. (2018). Controlling the collective behavior of networks of heterogeneous Kuramoto oscillators with phase lags. In 2018 European Control Conference (ECC) (pp. 2248-2253). IEEE.","DOI":"10.23919\/ECC.2018.8550557"},{"key":"1672_CR25","unstructured":"Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication.science, 304(5667), 78-80."},{"issue":"5","key":"1672_CR26","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1109\/TNN.2007.894082","volume":"18","author":"Z Deng","year":"2007","unstructured":"Z. Deng, Y. Zhang, Collective behavior of a small-world recurrent neural system with scale-free Distribution. IEEE Transac Neural Networks. 18(5), 1364\u20131375 (2007)","journal-title":"IEEE Transac Neural Networks."},{"key":"1672_CR27","unstructured":"Sarah J, Stefan R, Ulrich E (2010) Extending stability through hierarchical clusters in Echo State Networks, Frontiers in Neuroinformatics, 2010-volume 4"},{"issue":"2","key":"1672_CR28","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1007\/s10489-015-0652-3","volume":"43","author":"E Najibi","year":"2015","unstructured":"E. Najibi, H. Rostami, SCESN, SPESN, SWESN: Three recurrent neural echo state networks with Clustered reservoirs for prediction of nonlinear and chaotic time-series. Applied Intelligence. 43(2), 460\u2013472 (2015)","journal-title":"Applied Intelligence."},{"issue":"9","key":"1672_CR29","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1016\/S0031-3203(99)00137-5","volume":"33","author":"U Maulik","year":"2000","unstructured":"U. Maulik, S. Bandyopadhyay, Genetic algorithm-based clustering technique. Pattern recognition. 33(9), 1455\u20131465 (2000)","journal-title":"Pattern recognition."},{"key":"1672_CR30","doi-asserted-by":"crossref","unstructured":"S\u00f6rensen, K., & Glover, F. W. (2013). Metaheuristics. Encyclopedia of operations research and management science, 960-970.","DOI":"10.1007\/978-1-4419-1153-7_1167"},{"issue":"4","key":"1672_CR31","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1023\/A:1008202821328","volume":"11","author":"R Storn","year":"1997","unstructured":"R. Storn, K. Price, Differential evolution\u2013a simple and efficient heuristic for global optimization over continuous spaces. J Global Optimization 11(4), 341\u2013359 (1997)","journal-title":"J Global Optimization"},{"key":"1672_CR32","unstructured":"odder, T., Bhattachya, D., & Chakraborty, S., Adaptive Differential Evolution with Intersect Mutation and Repaired Crossover Rate. Int J Comp Intelligence IoT. 2(1) (2019)"},{"issue":"1","key":"1672_CR33","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TEVC.2010.2059031","volume":"15","author":"S Das","year":"2010","unstructured":"S. Das, P.N. Suganthan, Differential evolution: A survey of the state-of-the-art. IEEE Trans Evolutionary Computation. 15(1), 4\u201331 (2010)","journal-title":"IEEE Trans Evolutionary Computation."},{"key":"1672_CR34","doi-asserted-by":"crossref","unstructured":"Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization (PSO). In Proc. IEEE International Conference on Neural Networks, Perth, Australia (pp. 1942-1948).","DOI":"10.1109\/ICNN.1995.488968"},{"issue":"1","key":"1672_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/03610927408827101","volume":"3","author":"T Cali\u0144ski","year":"1974","unstructured":"T. Cali\u0144ski, J. Harabasz, A dendrite method for cluster analysis. Commun Stat Theory Methods 3(1), 1\u201327 (1974)","journal-title":"Commun Stat Theory Methods"},{"key":"1672_CR36","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","volume":"2","author":"DL Davies","year":"1979","unstructured":"D.L. Davies, D.W. Bouldin, A cluster separation measure. IEEE Transac Pattern Anal Machine Intelligence. 2, 224\u2013227 (1979)","journal-title":"IEEE Transac Pattern Anal Machine Intelligence."},{"key":"1672_CR37","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1016\/j.neuroimage.2018.12.011","volume":"188","author":"H Lee","year":"2019","unstructured":"H. Lee, D. Golkowski, D. Jordan, S. Berger, R. Ilg, J. Lee, G. Golmirzaie, Relationship ofcritical dynamics, functional connectivity, and states of consciousness in large-scale human brain networks. NeuroImage. 188, 228\u2013238 (2019)","journal-title":"NeuroImage."},{"key":"1672_CR38","unstructured":"Eguiluz, V. M., Chialvo, D. R., Cecchi, G., Baliki, M., & Apkarian, A. V. (2004) scale-free brain functional networks. Neuroimage, 22, 2330."},{"issue":"2","key":"1672_CR39","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1145\/505680.505683","volume":"30","author":"A Medina","year":"2000","unstructured":"A. Medina, I. Matta, J. Byers, On the origin of power-laws in Internet topologies. ACM SIGCOMM computer communication review. 30(2), 18\u201328 (2000)","journal-title":"ACM SIGCOMM computer communication review."},{"issue":"1","key":"1672_CR40","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1109\/TSMCA.2007.909595","volume":"38","author":"S Das","year":"2008","unstructured":"S. Das, A. Abraham, A. Konar, Automatic clustering using an improved differential evolution algorithm. IEEE Transac Syst Man Cybernetics-Part A: Systems and Humans. 38(1), 218\u2013237 (2008)","journal-title":"IEEE Transac Syst Man Cybernetics-Part A: Systems and Humans."},{"key":"1672_CR41","doi-asserted-by":"crossref","unstructured":"Y. Kawai, J. Park, M. Asada, A small-world topology enhances the echo state property and signal propagation in reservoir computing. Neural Networks. (2019)","DOI":"10.1016\/j.neunet.2019.01.002"},{"key":"1672_CR42","doi-asserted-by":"crossref","unstructured":"Sohn, I. (2017). small-world and scale-free network models for IoT systems. Mobile Information Systems, 2017.","DOI":"10.1155\/2017\/6752048"},{"key":"1672_CR43","doi-asserted-by":"crossref","unstructured":"Faloutsos, M., Faloutsos, P., & Faloutsos, C. (1999). On power-law relationships of the internet topology. In ACM SIGCOMM computer communication review (Vol. 29, No. 4, pp. 251-262).","DOI":"10.1145\/316194.316229"},{"issue":"2","key":"1672_CR44","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1109\/TNNLS.2015.2465174","volume":"27","author":"HG Han","year":"2016","unstructured":"H.G. Han, L. Zhang, Y. Hou, J.F. Qiao, Nonlinear model predictive control based on a self-organizing recurrent neural network. IEEE transactions on neural networks and learning systems 27(2), 402\u2013415 (2016)","journal-title":"IEEE transactions on neural networks and learning systems"},{"key":"1672_CR45","doi-asserted-by":"crossref","unstructured":"Ni, T., Wang, L., Jiang, Q., Zhao, J., & Zhao, Z. (2018). LSHADE with semi-parameter adaptation for chaotic time-series prediction. In Advanced Computational Intelligence (ICACI), 2018 Tenth International Conference on (pp. 741-745). IEEE.","DOI":"10.1109\/ICACI.2018.8377554"},{"issue":"4300","key":"1672_CR46","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1126\/science.267326","volume":"197","author":"MC Mackey","year":"1977","unstructured":"M.C. Mackey, L. Glass, Oscillation and chaos in physiological control systems. Science. 197(4300), 287\u2013289 (1977)","journal-title":"Science."},{"key":"1672_CR47","doi-asserted-by":"crossref","unstructured":"Chandra, R. (2018, July). Multi-Task Modular Backpropagation For Dynamic time-series Prediction. In 2018 International Joint Conference on Neural Networks (IJCNN) (pp. 1-7). IEEE.","DOI":"10.1109\/IJCNN.2018.8489740"},{"key":"1672_CR48","doi-asserted-by":"crossref","unstructured":"Weigend, A. S. (2018). time-series prediction: forecasting the future and understanding the past. Routledge.","DOI":"10.4324\/9780429492648"},{"issue":"2","key":"1672_CR49","first-page":"717","volume":"47","author":"L Aguayo","year":"2018","unstructured":"L. Aguayo, G.A. Barreto, Novelty Detection in time-series Using Self-Organizing Neural Networks: A Comprehensive Evaluation. Neural Processing Letters. 47(2), 717\u2013744 (2018)","journal-title":"Neural Processing Letters."},{"issue":"1","key":"1672_CR50","first-page":"37","volume":"9","author":"B Safarianejadian","year":"2017","unstructured":"B. Safarianejadian, Using Adaptive Neuro Fuzzy Inference System (ANFIS) for Prediction of Soil Fertility for Wheat Cultivation. Biol Forum. 9(1), 37\u201344 (2017)","journal-title":"Biol Forum."},{"issue":"18","key":"1672_CR51","doi-asserted-by":"publisher","first-page":"4197","DOI":"10.1049\/iet-gtd.2019.0319","volume":"13","author":"MJ Mokarram","year":"2019","unstructured":"M.J. Mokarram, Robust and effective parallel process to coordinate multi-area economic dispatch (MAED) problems in the presence of uncertainty, IET Generation. Trans Distribution 13(18), 4197 (2019)","journal-title":"Trans Distribution"},{"key":"1672_CR52","doi-asserted-by":"crossref","unstructured":"M.J. Mokarram, Hybrid Optimization Algorithm to Solve the Nonconvex Multiarea Economic Dispatch Problem. IEEE Syst J. 13(3) (2019)","DOI":"10.1109\/JSYST.2018.2889988"}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-020-01672-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13638-020-01672-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-020-01672-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,18]],"date-time":"2022-10-18T19:45:02Z","timestamp":1666122302000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-020-01672-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,13]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1672"],"URL":"https:\/\/doi.org\/10.1186\/s13638-020-01672-x","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,13]]},"assertion":[{"value":"11 December 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"64"}}