{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:01:26Z","timestamp":1750309286280,"version":"3.41.0"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100006602","name":"Air Force Research Laboratory","doi-asserted-by":"crossref","award":["FA8750-21-1-1010"],"award-info":[{"award-number":["FA8750-21-1-1010"]}],"id":[{"id":"10.13039\/100006602","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2025,1,31]]},"abstract":"<jats:p>Spintronic devices that use the spin of electrons as the information state variable have the potential to emulate neuro-synaptic dynamics and can be realized within a compact form-factor, while operating at ultra-low energy-delay point. In this paper, we benchmark the performance of a spintronics hardware platform designed for handling neuromorphic tasks.<\/jats:p>\n          <jats:p>To explore the benefits of spintronics-based hardware on realistic neuromorphic workloads, we developed a Parallel Discrete-Event Simulation model called Doryta, which is further integrated with a materials-to-systems benchmarking framework. The benchmarking framework allows us to obtain quantitative metrics on the throughput and energy of spintronics-based neuromorphic computing and compare these against standard CMOS-based approaches. Although spintronics hardware offers significant energy and latency advantages, we find that for larger neuromorphic circuits, the performance is limited by the interconnection networks rather than the spintronics-based neurons and synapses. This limitation can be overcome by architectural changes to the network.<\/jats:p>\n          <jats:p>Through Doryta we are also able to show the power of neuromorphic computing by simulating Conway\u2019s Game of Life (GoL), thus showing that it is Turing complete. We show that Doryta obtains over 300\u00d7 speedup using 1,024 CPU cores when tested on a convolutional, sparse, neural architecture. When scaled-up 64 times, to a 200 million neuron model, the simulation ran in 3:42 minutes for a total of 2,000 virtual clock steps. The conservative approach of execution was found to be faster in most cases than the optimistic approach, even when a tie-breaking mechanism to guarantee deterministic execution, was deactivated.<\/jats:p>","DOI":"10.1145\/3649464","type":"journal-article","created":{"date-parts":[[2024,3,5]],"date-time":"2024-03-05T12:10:28Z","timestamp":1709640628000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Performance Evaluation of Spintronic-Based Spiking Neural Networks using Parallel Discrete-Event Simulation"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3102-3187","authenticated-orcid":false,"given":"Elkin","family":"Cruz-Camacho","sequence":"first","affiliation":[{"name":"Computer Science, Rensselaer Polytechnic Institute, Troy, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7562-3689","authenticated-orcid":false,"given":"Siyuan","family":"Qian","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0068-7979","authenticated-orcid":false,"given":"Ankit","family":"Shukla","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8304-4911","authenticated-orcid":false,"given":"Neil","family":"McGlohon","sequence":"additional","affiliation":[{"name":"Computer Science, Rensselaer Polytechnic Institute, Troy, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7501-275X","authenticated-orcid":false,"given":"Shaloo","family":"Rakheja","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8862-9844","authenticated-orcid":false,"given":"Christopher","family":"Carothers","sequence":"additional","affiliation":[{"name":"Computer Science, Rensselaer Polytechnic Institute, Troy, United States"}]}],"member":"320","published-online":{"date-parts":[[2024,11,25]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/SIMSYM.1993.639048"},{"key":"e_1_3_4_3_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/PADS.2009.21","volume-title":"Proceedings of the 2009 ACM\/IEEE\/SCS 23rd Workshop on Principles of Advanced and Distributed Simulation","author":"Jr. D. W. Bauer","year":"2009","unstructured":"D. W. Bauer Jr., C. D. Carothers, and A. Holder. 2009. Scalable time warp on blue gene supercomputers. In Proceedings of the 2009 ACM\/IEEE\/SCS 23rd Workshop on Principles of Advanced and Distributed Simulation. IEEE Computer Society, Washington, DC, USA, 35\u201344."},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-007-0047-2"},{"key":"e_1_3_4_5_2","volume-title":"Winning Ways for Your Mathematical Plays. 2: Games in Particular","author":"Berlekamp Elwyn R.","year":"1982","unstructured":"Elwyn R. Berlekamp, John Horton Conway, and Richard K. Guy. 1982. Winning Ways for Your Mathematical Plays. 2: Games in Particular. Academic Press, London."},{"key":"e_1_3_4_6_2","volume-title":"N2S3, an Open-Source Scalable Spiking Neuromorphic Hardware Simulator","author":"Boulet Pierre","year":"2017","unstructured":"Pierre Boulet, Philippe Devienne, Pierre Falez, Guillermo Polito, Mahyar Shahsavari, and Pierre Tirilly. 2017. N2S3, an Open-Source Scalable Spiking Neuromorphic Hardware Simulator. Research Report. Universit\u00e9 de Lille 1, Sciences et Technologies ; CRIStAL UMR 9189."},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10827-007-0038-6"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.5555\/889797"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1002\/adfm.201808104"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63393-6_23"},{"key":"e_1_3_4_11_2","volume-title":"The NEURON Book (1st ed.)","author":"Carnevale Nicholas T.","year":"2009","unstructured":"Nicholas T. Carnevale and Michael L. Hines. 2009. The NEURON Book (1st ed.). Cambridge University Press, USA."},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0743-7315(02)00004-7"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.5555\/2433508.2433588"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/347823.347828"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2013.6707077"},{"key":"e_1_3_4_16_2","unstructured":"Center for Computational Innovations. Artificial intelligence multiprocessing optimized system (AiMOS). cci.rpi.edu. ([n.d.]). https:\/\/cci.rpi.edu\/aimos (accessed Feb 1 2022)."},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1979.230182"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2017.7926972"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.116.207603"},{"key":"e_1_3_4_20_2","article-title":"Neuromorphic computing is Turing-complete","author":"Date Prasanna","year":"2021","unstructured":"Prasanna Date, Catherine Schuman, Bill Kay, and Thomas Potok. 2021. Neuromorphic computing is Turing-complete. arXiv:2104.13983 [cs] (April 2021).","journal-title":"arXiv:2104.13983 [cs]"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2018.112130359"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.11.011.2008"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.128.197201"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASAP.2009.24"},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","unstructured":"I. Fina X. Marti D Yi J. Liu J. H. Chu C. Rayan-Serrao S. Suresha A. B. Shick J. \u017delezn\u00fd T. Jungwirth T. Jungwirth J. Fontcuberta and R. Ramesh. 2014. Anisotropic magnetoresistance in an antiferromagnetic semiconductor. Nature Communications 5 1 (2014) 1--7.","DOI":"10.1038\/ncomms5671"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1557\/s43577-021-00192-3"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-812311-9.00006-2"},{"key":"e_1_3_4_28_2","first-page":"20","article-title":"The fantastic combinations of John Conway\u2019s new solitaire game \u201clife\u201d","volume":"223","author":"Gardner Martin","year":"1970","unstructured":"Martin Gardner. 1970. The fantastic combinations of John Conway\u2019s new solitaire game \u201clife\u201d. Sci. Am. 223 (1970), 20\u2013123.","journal-title":"Sci. Am."},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511815706"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470165973.ch2"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.11.005.2008"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-019-0360-9"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.3389\/conf.neuro.11.2008.01.137"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2013.00118"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","unstructured":"Mat\u011bj Hejda Ekaterina Malysheva Dafydd Owen-Newns Qusay Raghib Ali Al-Taai Weikang Zhang Ignacio Ortega-Piwonka Julien Javaloyes Edward Wasige Victor Dolores-Calzadilla Jos\u00e9 M. L. Figueiredo Bruno Romeira and Antonio Hurtado. 2022. Artificial Optoelectronic Spiking Neuron Based on a Resonant Tunnelling Diode Coupled to a Vertical Cavity Surface Emitting Laser. (June 2022). DOI:10.48550\/arXiv.2206.11044arxiv:physics\/2206.11044","DOI":"10.48550\/arXiv.2206.11044"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmmm.2020.166711"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.118.147202"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1063\/1.5051495"},{"key":"e_1_3_4_39_2","volume-title":"Distributed Simulation and the Time Warp Operating System","author":"Jefferson David","year":"1987","unstructured":"David Jefferson, Brian Beckman, Fred Wieland, Leo Blume, Mike Di Loreto, Phil Hontalas, Pierre Laroche, Kathy Sturdevant, Jack Tupman, Van Warren, John Wedel, Herb Younger, and Steve Bellenot. 1987. Distributed Simulation and the Time Warp Operating System. Technical Report OSTI 5639121. NASA Jet Propulsion Laboratory, Pasadena, CA, USA."},{"key":"e_1_3_4_40_2","volume-title":"Fast Concurrent Simulation using the Time Warp Mechanism","author":"Jefferson David","year":"1985","unstructured":"David Jefferson and Henry Sowizral. 1985. Fast Concurrent Simulation using the Time Warp Mechanism. Technical Report ADA129431. Rand. Corp., Santa Monica, CA, USA. Issue 2."},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3916.3988"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-33697-0"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.4.541"},{"key":"e_1_3_4_44_2","unstructured":"Yann LeCun Corinna Cortes and Christopher J. C. Burges. 1998. The MNIST Handwritten Digit Database. http:\/\/yann.lecun.com\/exdb\/mnist\/ (1998)."},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2008173118"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1063\/5.0046032"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-020-0208-2"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.5555\/3522802.3522807"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.58356"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1254642"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.99.184425"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/102810.102812"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/151261.151266"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/JXCDC.2019.2956112"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/JXCDC.2016.2633251"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.103.024450"},{"key":"e_1_3_4_57_2","volume-title":"4th International ICST Conference on Simulation Tools and Techniques","author":"Pellegrini Alessandro","year":"2012","unstructured":"Alessandro Pellegrini, Roberto Vitali, and Francesco Quaglia. 2012. The ROme OpTimistic simulator: Core internals and programming model. In 4th International ICST Conference on Simulation Tools and Techniques."},{"key":"e_1_3_4_58_2","volume-title":"Introduction to Reversible Computing","author":"Perumalla Kalyan S.","year":"2014","unstructured":"Kalyan S. Perumalla. 2014. Introduction to Reversible Computing. CRC Press\/Taylor & Francis Group, Boca Raton, Florida. QA76.9.R48 P47 2014"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3573900.3593637"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3518997.3531027"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/2901378.2901392"},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3186317"},{"key":"e_1_3_4_63_2","doi-asserted-by":"crossref","unstructured":"Peixin Qin Zexin Feng Xiaorong Zhou Huixin Guo Jinhua Wang Han Yan Xiaoning Wang Hongyu Chen Xin Zhang Haojiang Wu Zengwei Zhu and Zhiqi Liu. 2020. Anomalous Hall effect robust negative magnetoresistance and memory devices based on a noncollinear antiferromagnetic metal. ACS nano 14 5 (2020) 6242--6248.","DOI":"10.1021\/acsnano.0c02325"},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCAS.2013.2296414"},{"key":"e_1_3_4_65_2","article-title":"A survey of neuromorphic computing and neural networks in hardware","author":"Schuman Catherine D.","year":"2017","unstructured":"Catherine D. Schuman, Thomas E. Potok, Robert M. Patton, J. Douglas Birdwell, Mark E. Dean, Garrett S. Rose, and James S. Plank. 2017. A survey of neuromorphic computing and neural networks in hardware. arXiv:1705.06963 [cs] (May 2017). arxiv:cs\/1705.06963","journal-title":"arXiv:1705.06963 [cs]"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.6.064003"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-018-0015-y"},{"key":"e_1_3_4_68_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.17.034037"},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.115.237201"},{"key":"e_1_3_4_70_2","article-title":"It\u2019s hard for neural networks to learn the game of life","author":"Springer Jacob M.","year":"2020","unstructured":"Jacob M. Springer and Garrett T. Kenyon. 2020. It\u2019s hard for neural networks to learn the game of life. arXiv:2009.01398 [cCS, Stat] (Sept. 2020).","journal-title":"arXiv:2009.01398 [cCS, Stat]"},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/224401.224705"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/280265.280267"},{"key":"e_1_3_4_73_2","first-page":"1796","volume-title":"Advances in Neural Information Processing Systems","author":"Sun Xiao","year":"2020","unstructured":"Xiao Sun, Naigang Wang, Chia-Yu Chen, Jiamin Ni, Ankur Agrawal, Xiaodong Cui, Swagath Venkataramani, Kaoutar El Maghraoui, Vijayalakshmi (Viji) Srinivasan, and Kailash Gopalakrishnan. 2020. Ultra-low precision 4-bit training of deep neural networks. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 1796\u20131807."},{"key":"e_1_3_4_74_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-07754-z"},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.101.094404"},{"key":"e_1_3_4_76_2","doi-asserted-by":"crossref","unstructured":"Jacob Torrejon Mathieu Riou Flavio Abreu Araujo Sumito Tsunegi Guru Khalsa Damien Querlioz Paolo Bortolotti Vincent Cros Kay Yakushiji Akio Fukushima Hitoshi Kubota Shinji Yuasa Mark D. Stiles and Julie Grollier. 2017. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547 7664 (2017) 428--431.","DOI":"10.1038\/nature23011"},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.1002\/smsc.202000025"},{"key":"e_1_3_4_78_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.109.137201"},{"key":"e_1_3_4_79_2","volume-title":"Advances in Neural Information Processing Systems","author":"Watts Lloyd","year":"1993","unstructured":"Lloyd Watts. 1993. Event-driven simulation of networks of spiking neurons. In Advances in Neural Information Processing Systems, Vol. 6. Morgan-Kaufmann."},{"key":"e_1_3_4_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/PMBS.2018.8641660"},{"key":"e_1_3_4_81_2","article-title":"Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms","author":"Xiao Han","year":"2017","unstructured":"Han Xiao, Kashif Rasul, and Roland Vollgraf. 2017. Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv:1708.07747 [CS, Stat] (Sept. 2017).","journal-title":"arXiv:1708.07747 [CS, Stat]"},{"key":"e_1_3_4_82_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41567-018-0062-7"},{"key":"e_1_3_4_83_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-017-0006-8"}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3649464","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3649464","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3649464","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:17Z","timestamp":1750291397000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3649464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,25]]},"references-count":82,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,31]]}},"alternative-id":["10.1145\/3649464"],"URL":"https:\/\/doi.org\/10.1145\/3649464","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"type":"print","value":"1049-3301"},{"type":"electronic","value":"1558-1195"}],"subject":[],"published":{"date-parts":[[2024,11,25]]},"assertion":[{"value":"2022-11-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}