{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T12:28:48Z","timestamp":1769171328678,"version":"3.49.0"},"reference-count":56,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":27,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"tdm","delay-in-days":27,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"German Federal Ministry of Education and Research","award":["16ME0398K"],"award-info":[{"award-number":["16ME0398K"]}]},{"name":"Helmholtz Association Initiative and Networking Fund","award":["SO-092, Advanced Computing Architectures"],"award-info":[{"award-number":["SO-092, Advanced Computing Architectures"]}]},{"name":"European Union Horizon 2020 Framework Programme for Research and Innovation","award":["785907 (Human Brain Project SGA2)"],"award-info":[{"award-number":["785907 (Human Brain Project SGA2)"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Neuromorph. Comput. Eng."],"published-print":{"date-parts":[[2023,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Brain-inspired computing proposes a set of algorithmic principles that hold promise for advancing artificial intelligence. They endow systems with self learning capabilities, efficient energy usage, and high storage capacity. A core concept that lies at the heart of brain computation is sequence learning and prediction. This form of computation is essential for almost all our daily tasks such as movement generation, perception, and language. Understanding how the brain performs such a computation is not only important to advance neuroscience, but also to pave the way to new technological brain-inspired applications. A previously developed spiking neural network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. An emerging type of hardware that may efficiently run this type of algorithm is neuromorphic hardware. It emulates the way the brain processes information and maps neurons and synapses directly into a physical substrate. Memristive devices have been identified as potential synaptic elements in neuromorphic hardware. In particular, redox-induced resistive random access memories (ReRAM) devices stand out at many aspects. They permit scalability, are energy efficient and fast, and can implement biological plasticity rules. In this work, we study the feasibility of using ReRAM devices as a replacement of the biological synapses in the sequence learning model. We implement and simulate the model including the ReRAM plasticity using the neural network simulator NEST. We investigate two types of ReRAM memristive devices: (i) a gradual, analog switching device, and (ii) an abrupt, binary switching device. We study the effect of different device properties on the performance characteristics of the sequence learning model, and demonstrate that, in contrast to many other artificial neural networks, this architecture is resilient with respect to changes in the on-off ratio and the conductance resolution, device variability, and device failure.<\/jats:p>","DOI":"10.1088\/2634-4386\/acf1c4","type":"journal-article","created":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T07:44:54Z","timestamp":1695887094000},"page":"034014","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Sequence learning in a spiking neuronal network with memristive synapses"],"prefix":"10.1088","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4367-8236","authenticated-orcid":true,"given":"Younes","family":"Bouhadjar","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9922-4861","authenticated-orcid":true,"given":"Sebastian","family":"Siegel","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5794-5425","authenticated-orcid":true,"given":"Tom","family":"Tetzlaff","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2308-5727","authenticated-orcid":true,"given":"Markus","family":"Diesmann","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5426-9967","authenticated-orcid":false,"given":"Rainer","family":"Waser","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6766-8553","authenticated-orcid":false,"given":"Dirk J","family":"Wouters","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"nceacf1c4bib1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3451210","article-title":"Design of a robust memristive spiking neuromorphic system with unsupervised learning in hardware","volume":"17","author":"Adnan","year":"2021","journal-title":"ACM J. Emerg. Technol. Comput. Syst."},{"key":"nceacf1c4bib2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2016.7727298","article-title":"Resistive memory device requirements for a neural algorithm accelerator","author":"Agarwal","year":"2016"},{"key":"nceacf1c4bib3","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1038\/s41586-018-0180-5","article-title":"Equivalent-accuracy accelerated neural-network training using analogue memory","volume":"558","author":"Ambrogio","year":"2018","journal-title":"Nature"},{"key":"nceacf1c4bib4","doi-asserted-by":"publisher","first-page":"4618","DOI":"10.1109\/TCSI.2020.3018502","article-title":"Variability-aware modeling of filamentary oxide-based bipolar resistive switching cells using SPICE level compact models","volume":"67","author":"Bengel","year":"2020","journal-title":"IEEE Trans. Circuits Syst. I"},{"key":"nceacf1c4bib5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3354265.3354281","article-title":"Constraints on sequence processing speed in biological neuronal networks","author":"Bouhadjar","year":"2019"},{"key":"nceacf1c4bib6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010233","article-title":"Sequence learning, prediction and replay in networks of spiking neurons","volume":"18","author":"Bouhadjar","year":"2022","journal-title":"PLoS Comput. Biol."},{"key":"nceacf1c4bib7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010989","article-title":"Coherent noise enables probabilistic sequence replay in spiking neuronal networks","volume":"19","author":"Bouhadjar","year":"2023","journal-title":"PLoS Comput. Biol."},{"key":"nceacf1c4bib8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002211","article-title":"Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons","volume":"7","author":"Buesing","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"nceacf1c4bib9","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1080\/23746149.2016.1259585","article-title":"Neuromorphic computing using non-volatile memory","volume":"2","author":"Burr","year":"2016","journal-title":"Adv. Phys. X"},{"key":"nceacf1c4bib10","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2015.7372570","article-title":"Mitigating effects of non-ideal synaptic device characteristics for on-chip learning","author":"Chen","year":"2015"},{"key":"nceacf1c4bib11","doi-asserted-by":"publisher","DOI":"10.1063\/1.5108654","article-title":"Exploiting the switching dynamics of HfO2-based ReRAM devices for reliable analog memristive behavior","volume":"7","author":"C\u00fcppers","year":"2019","journal-title":"APL Mater."},{"key":"nceacf1c4bib12","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1038\/s41928-020-00523-3","article-title":"In situ learning using intrinsic memristor variability via Markov chain Monte Carlo sampling","volume":"4","author":"Dalgaty","year":"2021","journal-title":"Nat. Electron."},{"key":"nceacf1c4bib13","doi-asserted-by":"publisher","DOI":"10.1063\/1.5129101","article-title":"Redox-based memristive devices for new computing paradigm","volume":"7","author":"Dittmann","year":"2019","journal-title":"APL Mater."},{"key":"nceacf1c4bib14","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/IEDM.2018.8614489","article-title":"Temporal sequence learning with a history-sensitive probabilistic learning rule intrinsic to oxygen vacancy-based RRAM","author":"Doevenspeck","year":"2018"},{"key":"nceacf1c4bib15","doi-asserted-by":"publisher","first-page":"2571","DOI":"10.1038\/s41467-022-30305-8","article-title":"Neural sampling machine with stochastic synapse allows brain-like learning and inference","volume":"13","author":"Dutta","year":"2022","journal-title":"Nat. Commun."},{"key":"nceacf1c4bib16","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1109\/IMW.2013.6582090","article-title":"Intrinsic switching variability in HfO2 RRAM","author":"Fantini","year":"2013"},{"key":"nceacf1c4bib17","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1016\/j.neuron.2012.08.001","article-title":"The spike-timing dependence of plasticity","volume":"75","author":"Feldman","year":"2012","journal-title":"Neuron"},{"key":"nceacf1c4bib18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.6.064015","article-title":"Uniting gradual and abrupt set processes in resistive switching oxides","volume":"6","author":"Fleck","year":"2016","journal-title":"Phys. Rev. Appl."},{"key":"nceacf1c4bib19","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1016\/B978-0-08-102782-0.00019-8","article-title":"Spiking neural networks for inference and learning: a memristor-based design perspective","author":"Fouda","year":"2020"},{"key":"nceacf1c4bib20","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1038\/nn1859","article-title":"Limits on the memory storage capacity of bounded synapses","volume":"10","author":"Fusi","year":"2007","journal-title":"Nat. Neurosci."},{"key":"nceacf1c4bib21","doi-asserted-by":"publisher","first-page":"1430","DOI":"10.4249\/scholarpedia.1430","article-title":"NEST (Neural simulation tool)","volume":"2","author":"Gewaltig","year":"2007","journal-title":"Scholarpedia J."},{"key":"nceacf1c4bib22","doi-asserted-by":"publisher","first-page":"3697","DOI":"10.1523\/JNEUROSCI.23-09-03697.2003","article-title":"Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity","volume":"23","author":"G\u00fctig","year":"2003","journal-title":"J. Neurosci."},{"key":"nceacf1c4bib23","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4739103","article-title":"NEST 3.0","author":"Hahne","year":"2021"},{"key":"nceacf1c4bib24","doi-asserted-by":"publisher","first-page":"3229","DOI":"10.1109\/TED.2018.2849872","article-title":"Improved switching stability and the effect of an internal series resistor in HfO2\/TiO x bilayer ReRAM cells","volume":"65","author":"Hardtdegen","year":"2018","journal-title":"IEEE Trans. Electron Devices"},{"key":"nceacf1c4bib25","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3389\/fncir.2016.00023","article-title":"Why neurons have thousands of synapses, a theory of sequence memory in neocortex","volume":"10","author":"Hawkins","year":"2016","journal-title":"Front. Neural Circuits"},{"key":"nceacf1c4bib26","doi-asserted-by":"publisher","first-page":"8720","DOI":"10.1007\/s10853-018-2134-6","article-title":"Oxide-based RRAM materials for neuromorphic computing","volume":"53","author":"Hong","year":"2018","journal-title":"J. Mater. Sci."},{"key":"nceacf1c4bib27","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1038\/s41928-018-0092-2","article-title":"In-memory computing with resistive switching devices","volume":"1","author":"Ielmini","year":"2018","journal-title":"Nat. Electron."},{"key":"nceacf1c4bib28","doi-asserted-by":"publisher","first-page":"2","DOI":"10.3389\/fninf.2018.00002","article-title":"Extremely scalable spiking neuronal network simulation code: from laptops to exascale computers","volume":"12","author":"Jordan","year":"2018","journal-title":"Front. Neuroinform."},{"key":"nceacf1c4bib29","doi-asserted-by":"publisher","DOI":"10.1063\/1.4974535","article-title":"Oxygen migration during resistance switching and failure of hafnium oxide memristors","volume":"110","author":"Kumar","year":"2017","journal-title":"Appl. Phys. Lett."},{"key":"nceacf1c4bib30","doi-asserted-by":"publisher","first-page":"78","DOI":"10.3389\/fninf.2014.00078","article-title":"Spiking network simulation code for petascale computers","volume":"8","author":"Kunkel","year":"2014","journal-title":"Front. Neuroinform."},{"key":"nceacf1c4bib31","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3389\/neuro.10.023.2009","article-title":"SORN: a self-organizing recurrent neural network","volume":"3","author":"Lazar","year":"2009","journal-title":"Front. Comput. Neurosci."},{"key":"nceacf1c4bib32","doi-asserted-by":"publisher","first-page":"860","DOI":"10.1109\/JPROC.2014.2310593","article-title":"Noise as a resource for computation and learning in networks of spiking neurons","volume":"102","author":"Maass","year":"2014","journal-title":"Proc. IEEE"},{"key":"nceacf1c4bib33","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1038\/s42254-020-0208-2","article-title":"Physics for neuromorphic computing","volume":"2","author":"Markovi\u0107","year":"2020","journal-title":"Nat. Rev. Phys."},{"key":"nceacf1c4bib34","doi-asserted-by":"publisher","first-page":"e31","DOI":"10.1371\/journal.pcbi.0030031","article-title":"Unsupervised learning of visual features through spike timing dependent plasticity","volume":"3","author":"Masquelier","year":"2007","journal-title":"PLoS Comput. Biol."},{"key":"nceacf1c4bib35","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4740083","article-title":"NESTMl 4.0","author":"Nagendra Babu","year":"2021"},{"key":"nceacf1c4bib36","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1038\/s42256-019-0025-4","article-title":"Reinforcement learning in artificial and biological systems","volume":"1","author":"Neftci","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"nceacf1c4bib37","doi-asserted-by":"publisher","first-page":"241","DOI":"10.3389\/fnins.2016.00241","article-title":"Stochastic synapses enable efficient brain-inspired learning machines","volume":"10","author":"Neftci","year":"2016","journal-title":"Front. Neurosci."},{"key":"nceacf1c4bib38","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.1038\/s41593-021-00857-x","article-title":"Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits","volume":"24","author":"Payeur","year":"2021","journal-title":"Nat. Neurosci."},{"key":"nceacf1c4bib39","doi-asserted-by":"publisher","first-page":"5793","DOI":"10.1038\/s41467-022-33476-6","article-title":"Self-organization of an inhomogeneous memristive hardware for sequence learning","volume":"13","author":"Payvand","year":"2022","journal-title":"Nat. Commun."},{"key":"nceacf1c4bib40","first-page":"93","article-title":"NESTML: a modeling language for spiking neurons","author":"Plotnikov","year":"2016"},{"key":"nceacf1c4bib41","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1007\/s004220050570","article-title":"Exact digital simulation of time-invariant linear systems with applications to neuronal modeling","volume":"81","author":"Rotter","year":"1999","journal-title":"Biol. Cybern."},{"key":"nceacf1c4bib42","doi-asserted-by":"publisher","DOI":"10.1088\/2634-4386\/acca45","article-title":"System model of neuromorphic sequence learning on a memristive crossbar array","volume":"3","author":"Siegel","year":"2023a","journal-title":"Neuromorph. Comput. Eng."},{"key":"nceacf1c4bib43","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1145\/3584954.3585000","article-title":"Demonstration of neuromorphic sequence learning on a memristive array","author":"Siegel","year":"2023b"},{"key":"nceacf1c4bib44","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1109\/TED.2013.2263000","article-title":"Bio-inspired stochastic computing using binary CBRAM synapses","volume":"60","author":"Suri","year":"2013","journal-title":"IEEE Trans. Electron Devices"},{"key":"nceacf1c4bib45","doi-asserted-by":"publisher","first-page":"438","DOI":"10.3389\/fnins.2014.00438","article-title":"A 2-transistor\/1-resistor artificial synapse capable of communication and stochastic learning in neuromorphic systems","volume":"8","author":"Wang","year":"2015","journal-title":"Front. Neurosci."},{"key":"nceacf1c4bib46","author":"Waser","year":"2012a"},{"key":"nceacf1c4bib47","doi-asserted-by":"publisher","first-page":"7628","DOI":"10.1166\/jnn.2012.6652","article-title":"Redox-based resistive switching memories","volume":"12","author":"Waser","year":"2012b","journal-title":"J. Nanosci. Nanotechnol."},{"key":"nceacf1c4bib48","doi-asserted-by":"publisher","first-page":"2632","DOI":"10.1002\/adma.200900375","article-title":"Redox-based resistive switching memories - nanoionic mechanisms, prospects and challenges","volume":"21","author":"Waser","year":"2009","journal-title":"Adv. Mater."},{"key":"nceacf1c4bib49","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1038\/s41563-019-0291-x","article-title":"Memristive crossbar arrays for brain-inspired computing","volume":"18","author":"Xia","year":"2019","journal-title":"Nat. Mater."},{"key":"nceacf1c4bib50","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1038\/nnano.2012.240","article-title":"Memristive devices for computing","volume":"8","author":"Yang","year":"2013","journal-title":"Nat. Nanotechnol."},{"key":"nceacf1c4bib51","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1038\/s41928-022-00869-w","article-title":"Activity-difference training of deep neural networks using memristor crossbars","volume":"6","author":"Yi","year":"2022","journal-title":"Nat. Electron."},{"key":"nceacf1c4bib52","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/JPROC.2018.2790840","article-title":"Neuro-inspired computing with emerging nonvolatile memorys","volume":"106","author":"Yu","year":"2018","journal-title":"Proc. IEEE"},{"key":"nceacf1c4bib53","doi-asserted-by":"publisher","first-page":"26","DOI":"10.3389\/fnins.2011.00026","article-title":"On spike-timing-dependent-plasticity, memristive devices and building a self-learning visual cortex","volume":"5","author":"Zamarre\u00f1o-Ramos","year":"2011","journal-title":"Front. Neurosci."},{"key":"nceacf1c4bib54","doi-asserted-by":"publisher","DOI":"10.1063\/1.5124915","article-title":"Reliability of analog resistive switching memory for neuromorphic computing","volume":"7","author":"Zhao","year":"2020","journal-title":"Appl. Phys. Rev."},{"key":"nceacf1c4bib55","doi-asserted-by":"publisher","DOI":"10.1109\/IEDM19573.2019.8993559","article-title":"A physics-based model of RRAM probabilistic switching for generating stable and accurate stochastic bit-streams","author":"Zhao","year":"2019"},{"key":"nceacf1c4bib56","doi-asserted-by":"publisher","DOI":"10.1063\/1.5118217","article-title":"A comprehensive review on emerging artificial neuromorphic devices","volume":"7","author":"Zhu","year":"2020","journal-title":"Appl. Phys. Rev."}],"container-title":["Neuromorphic Computing and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/acf1c4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/acf1c4\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/acf1c4\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/acf1c4\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T14:43:47Z","timestamp":1697035427000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/acf1c4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,1]]},"references-count":56,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,9,28]]},"published-print":{"date-parts":[[2023,9,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2634-4386\/acf1c4","relation":{},"ISSN":["2634-4386"],"issn-type":[{"value":"2634-4386","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,1]]},"assertion":[{"value":"Sequence learning in a spiking neuronal network with memristive synapses","name":"article_title","label":"Article Title"},{"value":"Neuromorphic Computing and Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2023 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-04-06","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-08-18","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-09-28","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}