{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:27:27Z","timestamp":1773840447356,"version":"3.50.1"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Chiba Institute of Technology"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Life Robotics"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Robots have been widely used in daily life in recent years. Unlike conventional robots made of rigid materials, soft robots utilize stretchable and flexible materials, allowing flexible movements similar to those of living organisms, which are difficult for traditional robots. Previous studies have used periodic signals to control soft robots, which lead to repetitive motions and make it challenging to generate environment-adapted motions. To address this issue, control methods can be learned through deep reinforcement learning to enable soft robots to select appropriate actions based on observations, improving their adaptability to environmental changes. In addition, as mobile robots have limited onboard resources, it is necessary to conserve battery consumption and achieve low-power control. Therefore, the use of spiking neural networks (SNNs) with neuromorphic chips enables low-power control of soft robots. In this study, we investigated the learning methods for SNNs aimed at controlling soft robots. Experiments were conducted using a caterpillar-like soft robot model based on previous studies, and the effectiveness of the learning method was evaluated.<\/jats:p>","DOI":"10.1007\/s10015-024-00970-7","type":"journal-article","created":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T19:01:37Z","timestamp":1728068497000},"page":"519-527","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Spiking neural networks-based generation of caterpillar-like soft robot crawling motions"],"prefix":"10.1007","volume":"29","author":[{"given":"SeanKein","family":"Yoshioka","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takahiro","family":"Iwata","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"Maruyama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daisuke","family":"Miki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,4]]},"reference":[{"key":"970_CR1","doi-asserted-by":"crossref","unstructured":"Umedachi T, Trimmer BA (2014) Design of a 3d-printed soft robot with posture and steering control. In: 2014 IEEE international conference on robotics and automation (ICRA). IEEE, pp 2874\u20132879","DOI":"10.1109\/ICRA.2014.6907272"},{"key":"970_CR2","doi-asserted-by":"crossref","unstructured":"Seok S, Onal CD, Wood R, Rus D, Kim S (2010) Peristaltic locomotion with antagonistic actuators in soft robotics. In: 2010 IEEE international conference on robotics and automation. IEEE, pp 1228\u20131233","DOI":"10.1109\/ROBOT.2010.5509542"},{"key":"970_CR3","doi-asserted-by":"crossref","unstructured":"Cheng NG, Lobovsky MB, Keating SJ, Setapen AM, Gero KI, Hosoi AE, Iagnemma KD (2012) Design and analysis of a robust, low-cost, highly articulated manipulator enabled by jamming of granular media. In: 2012 IEEE international conference on robotics and automation. IEEE, pp 4328\u20134333","DOI":"10.1109\/ICRA.2012.6225373"},{"issue":"7617","key":"970_CR4","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1038\/nature19100","volume":"536","author":"M Wehner","year":"2016","unstructured":"Wehner M, Truby RL, Fitzgerald DJ, Mosadegh B, Whitesides GM, Lewis JA, Wood RJ (2016) An integrated design and fabrication strategy for entirely soft, autonomous robots. Nature 536(7617):451\u2013455","journal-title":"Nature"},{"issue":"2","key":"970_CR5","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1002\/rob.10070","volume":"20","author":"MW Hannan","year":"2003","unstructured":"Hannan MW, Walker ID (2003) Kinematics and the implementation of an elephant\u2019s trunk manipulator and other continuum style robots. J Robot Syst 20(2):45\u201363","journal-title":"J Robot Syst"},{"issue":"7","key":"970_CR6","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1163\/156855312X626343","volume":"26","author":"C Laschi","year":"2012","unstructured":"Laschi C, Cianchetti M, Mazzolai B, Margheri L, Follador M, Dario P (2012) Soft robot arm inspired by the octopus. Adv Robot 26(7):709\u2013727","journal-title":"Adv Robot"},{"issue":"2","key":"970_CR7","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3182\/6\/2\/026007","volume":"6","author":"HT Lin","year":"2011","unstructured":"Lin HT, Leisk GG, Trimmer B (2011) Goqbot: a caterpillar-inspired soft-bodied rolling robot. Bioinspir Biomim 6(2):026,007","journal-title":"Bioinspir Biomim"},{"key":"970_CR8","doi-asserted-by":"crossref","unstructured":"Li G, Shintake J, Hayashibe M (2021) Deep reinforcement learning framework for underwater locomotion of soft robot. In: 2021 IEEE international conference on robotics and automation (ICRA), pp 12,033\u201312,039","DOI":"10.1109\/ICRA48506.2021.9561145"},{"key":"970_CR9","doi-asserted-by":"crossref","unstructured":"Blouw P, Choo X, Hunsberger E, Eliasmith C (2019) Benchmarking keyword spotting efficiency on neuromorphic hardware. In: Proceedings of the 7th annual neuro-inspired computational elements workshop, NICE \u201919. Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/3320288.3320304"},{"key":"970_CR10","doi-asserted-by":"publisher","first-page":"15,0345","DOI":"10.1109\/ACCESS.2021.3126311","volume":"9","author":"K Naya","year":"2021","unstructured":"Naya K, Kutsuzawa K, Owaki D, Hayashibe M (2021) Spiking neural network discovers energy-efficient hexapod motion in deep reinforcement learning. IEEE Access 9:15,0345-15,0354","journal-title":"IEEE Access"},{"key":"970_CR11","unstructured":"Fujimoto S, van Hoof H, Meger D (2018) Addressing function approximation error in actor-critic methods. https:\/\/arxiv.org\/abs\/1802.09477"},{"key":"970_CR12","unstructured":"Eshraghian JK, Ward M, Neftci E, Wang X, Lenz G, Dwivedi G, Bennamoun M, Jeong DS, Lu WD (2021) Training spiking neural networks using lessons from deep learning. arXiv preprint arXiv:2109.12894"},{"key":"970_CR13","unstructured":"Neftci EO, Mostafa H, Zenke F (2019) Surrogate gradient learning in spiking neural networks. https:\/\/arxiv.org\/abs\/1901.09948"},{"issue":"6","key":"970_CR14","doi-asserted-by":"publisher","first-page":"1514","DOI":"10.1162\/neco_a_01086","volume":"30","author":"F Zenke","year":"2018","unstructured":"Zenke F, Ganguli S (2018) Superspike: supervised learning in multilayer spiking neural networks. Neural Comput 30(6):1514\u20131541","journal-title":"Neural Comput"},{"key":"970_CR15","unstructured":"Tang G, Kumar N, Yoo R, Michmizos K (2021) Deep reinforcement learning with population-coded spiking neural network for continuous control. In: Kober J, Ramos F, Tomlin C (eds) Proceedings of the 2020 Conference on Robot Learning, Proceedings of Machine Learning Research, vol 155. PMLR, pp 2016\u20132029"},{"key":"970_CR16","unstructured":"Kingma D, Ba J (2015) Adam: a method for stochastic optimization. In: International conference on learning representations (ICLR), San Diega, CA, USA"},{"key":"970_CR17","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch. In: NIPS-W"}],"container-title":["Artificial Life and Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-00970-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10015-024-00970-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-00970-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T21:03:28Z","timestamp":1729976608000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10015-024-00970-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,4]]},"references-count":17,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["970"],"URL":"https:\/\/doi.org\/10.1007\/s10015-024-00970-7","relation":{},"ISSN":["1433-5298","1614-7456"],"issn-type":[{"value":"1433-5298","type":"print"},{"value":"1614-7456","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,4]]},"assertion":[{"value":"12 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}