{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T16:10:27Z","timestamp":1783181427884,"version":"3.54.6"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"18","license":[{"start":{"date-parts":[[2022,4,26]],"date-time":"2022-04-26T00:00:00Z","timestamp":1650931200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,26]],"date-time":"2022-04-26T00:00:00Z","timestamp":1650931200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["FPU18\/04321"],"award-info":[{"award-number":["FPU18\/04321"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PID2019-109465RB-I00"],"award-info":[{"award-number":["PID2019-109465RB-I00"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PID2019-105556GB-C33"],"award-info":[{"award-number":["PID2019-105556GB-C33"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PCI2019-111841-2"],"award-info":[{"award-number":["PCI2019-111841-2"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad de Cadiz"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Reward-modulated Spike-Timing-Dependent Plasticity (R-STDP) is a learning method for Spiking Neural Network (SNN) that makes use of an external learning signal to modulate the synaptic plasticity produced by Spike-Timing-Dependent Plasticity (STDP). Combining the advantages of reinforcement learning and the biological plausibility of STDP, online learning on SNN in real-world scenarios can be applied. This paper presents a fully digital architecture, implemented on an Field-Programmable Gate Array (FPGA), including the R-STDP learning mechanism in a SNN. The hardware results obtained are comparable to the software simulations results using the Brian2 simulator. The maximum error is of 0.083 when a 14-bits fix-point precision is used in realtime. The presented architecture shows an accuracy of 95% when tested in an obstacle avoidance problem on mobile robotics with a minimum use of resources.<\/jats:p>","DOI":"10.1007\/s00521-022-07220-6","type":"journal-article","created":{"date-parts":[[2022,4,26]],"date-time":"2022-04-26T05:15:00Z","timestamp":1650950100000},"page":"15649-15660","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Bio-plausible digital implementation of a reward modulated STDP synapse"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5042-9399","authenticated-orcid":false,"given":"Fernando M.","family":"Quintana","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3586-2930","authenticated-orcid":false,"given":"Fernando","family":"Perez-Pe\u00f1a","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0892-8113","authenticated-orcid":false,"given":"Pedro L.","family":"Galindo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,4,26]]},"reference":[{"key":"7220_CR1","doi-asserted-by":"publisher","unstructured":"Bing Z, Meschede C, Huang K, et\u00a0al (2018) End to end learning of spiking neural network based on r-stdp for a lane keeping vehicle. In: IEEE international conference on robotics and automation. IEEE, pp 4725\u20134732. https:\/\/doi.org\/10.1109\/ICRA.2018.8460482","DOI":"10.1109\/ICRA.2018.8460482"},{"key":"7220_CR2","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3389\/fnbot.2019.00018","volume":"13","author":"Z Bing","year":"2019","unstructured":"Bing Z, Baumann I, Jiang Z et al (2019) Supervised learning in snn via reward-modulated spike-timing-dependent plasticity for a target reaching vehicle. Front Neurorobot 13:18. https:\/\/doi.org\/10.3389\/fnbot.2019.00018","journal-title":"Front Neurorobot"},{"key":"7220_CR3","doi-asserted-by":"publisher","unstructured":"Bing Z, Jiang Z, Cheng L, et\u00a0al (2019b) End to end learning of a multi-layered snn based on r-stdp for a target tracking snake-like robot. In: Proceedings\u2013IEEE international conference on robotics and automation. Institute of electrical and electronics engineers Inc., pp 9645\u20139651. https:\/\/doi.org\/10.1109\/ICRA.2019.8793774","DOI":"10.1109\/ICRA.2019.8793774"},{"key":"7220_CR4","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3389\/fnsyn.2010.00011","volume":"2","author":"K Buchanan","year":"2010","unstructured":"Buchanan K, Mellor J (2010) The activity requirements for spike timing-dependent plasticity in the hippocampus. Front Synaptic Neurosci 2:11. https:\/\/doi.org\/10.3389\/fnsyn.2010.00011","journal-title":"Front Synaptic Neurosci"},{"key":"7220_CR5","doi-asserted-by":"publisher","unstructured":"Cassidy A, Andreou AG, Georgiou J (2011) A combinational digital logic approach to stdp. In: IEEE international symposium on circuits and systems, pp 673\u2013676. https:\/\/doi.org\/10.1109\/ISCAS.2011.5937655","DOI":"10.1109\/ISCAS.2011.5937655"},{"key":"7220_CR6","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1109\/JPROC.2014.2304638","volume":"102","author":"SB Furber","year":"2014","unstructured":"Furber SB, Galluppi F, Temple S et al (2014) The spinnaker project. Proc IEEE 102:652\u2013665. https:\/\/doi.org\/10.1109\/JPROC.2014.2304638","journal-title":"Proc IEEE"},{"key":"7220_CR7","doi-asserted-by":"publisher","unstructured":"Gerstner W, Kistler WM, Naud R, et\u00a0al (2014) Synaptic plasticity and learning. In: Neuronal dynamics: from single neurons to networks and models of cognition. Cambridge University Press, pp 491\u2013523. https:\/\/doi.org\/10.1017\/CBO9781107447615.023","DOI":"10.1017\/CBO9781107447615.023"},{"key":"7220_CR8","doi-asserted-by":"publisher","first-page":"2651","DOI":"10.1109\/TCSI.2019.2899356","volume":"66","author":"M Heidarpur","year":"2019","unstructured":"Heidarpur M, Ahmadi A, Ahmadi M et al (2019) Cordic-snn: on-fpga stdp learning with izhikevich neurons. IEEE Trans Circuit Syst I Regul Pap 66:2651\u20132661. https:\/\/doi.org\/10.1109\/TCSI.2019.2899356","journal-title":"IEEE Trans Circuit Syst I Regul Pap"},{"key":"7220_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S00521-021-05832-Y","volume":"2021","author":"SG Hu","year":"2021","unstructured":"Hu SG, Qiao GC, Chen TP et al (2021) Quantized stdp-based online-learning spiking neural network. Neural Comput Appl 2021:1\u201316. https:\/\/doi.org\/10.1007\/S00521-021-05832-Y","journal-title":"Neural Comput Appl"},{"key":"7220_CR10","doi-asserted-by":"publisher","unstructured":"Humaidi AJ, Kadhim TM, Hasan S, et\u00a0al (2020) A generic izhikevich-modelled FPGA-realized architecture: a case study of printed english letter recognition. In: Proceedings of 2020 24th international conference on system theory, control and computing, ICSTCC 2020. Institute of Electrical and Electronics Engineers Inc., pp 825\u2013830. https:\/\/doi.org\/10.1109\/ICSTCC50638.2020.9259707","DOI":"10.1109\/ICSTCC50638.2020.9259707"},{"key":"7220_CR11","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3389\/fnins.2011.00073","volume":"5","author":"G Indiveri","year":"2011","unstructured":"Indiveri G, Linares-Barranco B, Hamilton T et al (2011) Neuromorphic silicon neuron circuits. Front Neurosci 5:73. https:\/\/doi.org\/10.3389\/fnins.2011.00073","journal-title":"Front Neurosci"},{"key":"7220_CR12","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2003.820440","author":"EM Izhikevich","year":"2003","unstructured":"Izhikevich EM (2003) Simple model of spiking neurons. IEEE Trans Neural Netw. https:\/\/doi.org\/10.1109\/TNN.2003.820440","journal-title":"IEEE Trans Neural Netw"},{"key":"7220_CR13","doi-asserted-by":"publisher","first-page":"2443","DOI":"10.1093\/cercor\/bhl152","volume":"17","author":"EM Izhikevich","year":"2007","unstructured":"Izhikevich EM (2007) Solving the distal reward problem through linkage of stdp and dopamine signaling. Cereb Cortex 17:2443\u20132452. https:\/\/doi.org\/10.1093\/cercor\/bhl152","journal-title":"Cereb Cortex"},{"key":"7220_CR14","doi-asserted-by":"publisher","first-page":"1558","DOI":"10.1109\/TCSI.2018.2881753","volume":"66","author":"C Lammie","year":"2019","unstructured":"Lammie C, Hamilton TJ, van Schaik A et al (2019) Efficient fpga implementations of pair and triplet-based stdp for neuromorphic architectures. IEEE Trans Circuit Syst I Regul Pap 66:1558\u20131570. https:\/\/doi.org\/10.1109\/TCSI.2018.2881753","journal-title":"IEEE Trans Circuit Syst I Regul Pap"},{"key":"7220_CR15","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1109\/TBCAS.2017.2759700","volume":"12","author":"S Moradi","year":"2018","unstructured":"Moradi S, Qiao N, Stefanini F et al (2018) A scalable multicore architecture with heterogeneous memory structures for dynamic neuromorphic asynchronous processors (dynaps). IEEE Trans Biomed Circuit Syst 12:106\u2013122. https:\/\/doi.org\/10.1109\/TBCAS.2017.2759700","journal-title":"IEEE Trans Biomed Circuit Syst"},{"issue":"6","key":"7220_CR16","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1007\/s00422-008-0233-1","volume":"98","author":"A Morrison","year":"2008","unstructured":"Morrison A, Diesmann M, Gerstner W (2008) Phenomenological models of synaptic plasticity based on spike timing. Biol Cybern 98(6):459\u2013478. https:\/\/doi.org\/10.1007\/s00422-008-0233-1","journal-title":"Biol Cybern"},{"key":"7220_CR17","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.47314","author":"M Stimberg","year":"2019","unstructured":"Stimberg M, Brette R, Goodman DF (2019) Brian 2, an intuitive and efficient neural simulator. eLife. https:\/\/doi.org\/10.7554\/eLife.47314","journal-title":"eLife"},{"key":"7220_CR18","doi-asserted-by":"publisher","unstructured":"Vasquez Tieck JC, Becker P, Kaiser J, et\u00a0al (2019) Learning target reaching motions with a robotic arm using brain-inspired dopamine modulated STDP. In: Proceedings of 2019 IEEE 18th international conference on cognitive informatics and cognitive computing, ICCI*CC 2019. Institute of Electrical and Electronics Engineers Inc., pp 54\u201361. https:\/\/doi.org\/10.1109\/ICCICC46617.2019.9146079","DOI":"10.1109\/ICCICC46617.2019.9146079"},{"key":"7220_CR19","doi-asserted-by":"publisher","first-page":"665","DOI":"10.3389\/fnins.2018.00665","volume":"12","author":"A Yousefzadeh","year":"2018","unstructured":"Yousefzadeh A, Stromatias E, Soto M et al (2018) On practical issues for stochastic stdp hardware with 1-bit synaptic weights. Front Neurosci 12:665. https:\/\/doi.org\/10.3389\/fnins.2018.00665","journal-title":"Front Neurosci"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-07220-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-022-07220-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-07220-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T18:29:36Z","timestamp":1662056976000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-022-07220-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,26]]},"references-count":19,"journal-issue":{"issue":"18","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["7220"],"URL":"https:\/\/doi.org\/10.1007\/s00521-022-07220-6","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,26]]},"assertion":[{"value":"1 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 March 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"We wish to confirm that there are no known conflicts of interest associated with this publication.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}