{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:25:08Z","timestamp":1750220708496,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T00:00:00Z","timestamp":1584403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,3,17]]},"DOI":"10.1145\/3381755.3381772","type":"proceedings-article","created":{"date-parts":[[2020,6,18]],"date-time":"2020-06-18T23:09:51Z","timestamp":1592521791000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Benchmarking of Neuromorphic Hardware Systems"],"prefix":"10.1145","author":[{"given":"Christoph","family":"Ostrau","sequence":"first","affiliation":[{"name":"Bielefeld University, Bielefeld, Germany"}]},{"given":"Christian","family":"Klarhorst","sequence":"additional","affiliation":[{"name":"Bielefeld University, Bielefeld, Germany"}]},{"given":"Michael","family":"Thies","sequence":"additional","affiliation":[{"name":"Bielefeld University, Bielefeld, Germany"}]},{"given":"Ulrich","family":"R\u00fcckert","sequence":"additional","affiliation":[{"name":"Bielefeld University, Bielefeld, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,6,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Sebastian Billaudelle Yannik Stradmann Korbinian Schreiber Benjamin Cramer Andreas Baumbach Dominik Dold Julian G\u00f6ltz Akos F Kungl Timo C Wunderlich Andreas Hartel etal 2019. Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate. arXiv preprint arXiv:1912.12980 (2019).  Sebastian Billaudelle Yannik Stradmann Korbinian Schreiber Benjamin Cramer Andreas Baumbach Dominik Dold Julian G\u00f6ltz Akos F Kungl Timo C Wunderlich Andreas Hartel et al. 2019. Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate. arXiv preprint arXiv:1912.12980 (2019).","DOI":"10.1109\/ISCAS45731.2020.9180741"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3320288.3320304"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00434"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0788-3"},{"key":"e_1_3_2_1_5_1","volume-title":"The 2013 International Joint Conference on. IEEE, 1--10","author":"Cassidy Andrew S.","year":"2013","unstructured":"Andrew S. Cassidy , Paul Merolla , John V. Arthur , Steven K. Esser , Brian Jackson , Rodrigo Alvarez-Icaza , Piyali Datta , Jun Sawada , Theodore M. Wong , Vitaly Feldman , 2013 . Cognitive computing building block: A versatile and efficient digital neuron model for neurosynaptic cores. In Neural Networks (IJCNN) , The 2013 International Joint Conference on. IEEE, 1--10 . Andrew S. Cassidy, Paul Merolla, John V. Arthur, Steven K. Esser, Brian Jackson, Rodrigo Alvarez-Icaza, Piyali Datta, Jun Sawada, Theodore M. Wong, Vitaly Feldman, et al. 2013. Cognitive computing building block: A versatile and efficient digital neuron model for neurosynaptic cores. In Neural Networks (IJCNN), The 2013 International Joint Conference on. IEEE, 1--10."},{"key":"e_1_3_2_1_6_1","volume-title":"The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks. arXiv preprint arXiv:1910.07407 (","author":"Cramer Benjamin","year":"2019","unstructured":"Benjamin Cramer , Yannik Stradmann , Johannes Schemmel , and Friedemann Zenke . 2019. The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks. arXiv preprint arXiv:1910.07407 ( 2019 ). Benjamin Cramer, Yannik Stradmann, Johannes Schemmel, and Friedemann Zenke. 2019. The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks. arXiv preprint arXiv:1910.07407 ( 2019)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0097-1"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2018.112130359"},{"key":"e_1_3_2_1_9_1","volume-title":"Frontiers In Neuroinformatics, 2009","author":"Davison Andrew","year":"2009","unstructured":"Andrew Davison , Daniel Br\u00fcderle , Jens Kremkow , Eilif Muller , Dejan Pecevski , Laurent Perrinet , and Pierre Yger . 2009 . PyNN: a common interface for neuronal network simulators . Frontiers In Neuroinformatics, 2009 , 2, 11 (2009). Andrew Davison, Daniel Br\u00fcderle, Jens Kremkow, Eilif Muller, Dejan Pecevski, Laurent Perrinet, and Pierre Yger. 2009. PyNN: a common interface for neuronal network simulators. Frontiers In Neuroinformatics, 2009, 2, 11 (2009)."},{"key":"e_1_3_2_1_10_1","volume-title":"Frontiers in Neuroscience","author":"Gabriel","year":"2017","unstructured":"Gabriel A. Fonseca Guerra and Steve B. Furber. 2017. Using Stochastic Spiking Neural Networks on SpiNNaker to Solve Constraint Satisfaction Problems . Frontiers in Neuroscience 11, December ( 2017 ). https:\/\/doi.org\/10.3389\/fnins.2017.00714 10.3389\/fnins.2017.00714 Gabriel A. Fonseca Guerra and Steve B. Furber. 2017. Using Stochastic Spiking Neural Networks on SpiNNaker to Solve Constraint Satisfaction Problems. Frontiers in Neuroscience 11, December (2017). https:\/\/doi.org\/10.3389\/fnins.2017.00714"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2012.142"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.4249\/scholarpedia.1430"},{"key":"e_1_3_2_1_13_1","volume-title":"Extremely scalable spiking neuronal network simulation code: from laptops to exascale computers. Frontiers in neuroinformatics 12","author":"Jordan Jakob","year":"2018","unstructured":"Jakob Jordan , Tammo Ippen , Moritz Helias , Itaru Kitayama , Mitsuhisa Sato , Jun Igarashi , Markus Diesmann , and Susanne Kunkel . 2018. Extremely scalable spiking neuronal network simulation code: from laptops to exascale computers. Frontiers in neuroinformatics 12 ( 2018 ), 2. Jakob Jordan, Tammo Ippen, Moritz Helias, Itaru Kitayama, Mitsuhisa Sato, Jun Igarashi, Markus Diesmann, and Susanne Kunkel. 2018. Extremely scalable spiking neuronal network simulation code: from laptops to exascale computers. Frontiers in neuroinformatics 12 (2018), 2."},{"key":"#cr-split#-e_1_3_2_1_14_1.1","unstructured":"Jakob Jordan H\u00e5kon M0rk Stine Brekke Vennemo Dennis Terhorst Alexander Peyser Tammo Ippen Rajalekshmi Deepu Jochen Martin Eppler Alexander van Meegen Susanne Kunkel Ankur Sinha Tanguy Fardet Sandra Diaz Abigail Morrison Wolfram Schenck David Dahmen Jari Pronold Jonas Stapmanns Guido Trensch Sebastian Spreizer Jessica Mitchell Steffen Graber Johanna Senk Charl Linssen Jan Hahne Alexey Serenko Daniel Naoumenko Eric Thomson Itaru Kitayama Sebastian Berns and Hans Ekkehard Plesser. 2019. NEST 2.18.0. https:\/\/doi.org\/10.5281\/zenodo.2605422 10.5281\/zenodo.2605422"},{"key":"#cr-split#-e_1_3_2_1_14_1.2","unstructured":"Jakob Jordan H\u00e5kon M0rk Stine Brekke Vennemo Dennis Terhorst Alexander Peyser Tammo Ippen Rajalekshmi Deepu Jochen Martin Eppler Alexander van Meegen Susanne Kunkel Ankur Sinha Tanguy Fardet Sandra Diaz Abigail Morrison Wolfram Schenck David Dahmen Jari Pronold Jonas Stapmanns Guido Trensch Sebastian Spreizer Jessica Mitchell Steffen Graber Johanna Senk Charl Linssen Jan Hahne Alexey Serenko Daniel Naoumenko Eric Thomson Itaru Kitayama Sebastian Berns and Hans Ekkehard Plesser. 2019. NEST 2.18.0. https:\/\/doi.org\/10.5281\/zenodo.2605422"},{"key":"e_1_3_2_1_15_1","first-page":"1","article-title":"GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model","author":"Knight James C.","year":"2018","unstructured":"James C. Knight and Thomas Nowotny . 2018 . GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model . Frontiers in Neuroscience 12 , December (2018), 1 -- 19 . https:\/\/doi.org\/10.3389\/fnins.2018.00941 10.3389\/fnins.2018.00941 James C. Knight and Thomas Nowotny. 2018. GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model. Frontiers in Neuroscience 12, December (2018), 1--19. https:\/\/doi.org\/10.3389\/fnins.2018.00941","journal-title":"Frontiers in Neuroscience 12"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Raphaela Kreiser Panin Pienroj Alpha Renner and Yulia Sandamirskaya. 2018. Pose Estimation and Map Formation with Spiking Neural Networks: towards Neuromorphic SLAM. (2018) 2159--2166.  Raphaela Kreiser Panin Pienroj Alpha Renner and Yulia Sandamirskaya. 2018. Pose Estimation and Map Formation with Spiking Neural Networks: towards Neuromorphic SLAM. (2018) 2159--2166.","DOI":"10.1109\/IROS.2018.8594228"},{"key":"e_1_3_2_1_17_1","volume-title":"SpiNNaker 2: A 10 Million Core Processor System for Brain Simulation and Machine Learning. arXiv preprint arXiv:1911.02385","author":"Mayr Christian","year":"2019","unstructured":"Christian Mayr , Sebastian Hoeppner , and Steve Furber . 2019. SpiNNaker 2: A 10 Million Core Processor System for Brain Simulation and Machine Learning. arXiv preprint arXiv:1911.02385 ( 2019 ). Christian Mayr, Sebastian Hoeppner, and Steve Furber. 2019. SpiNNaker 2: A 10 Million Core Processor System for Brain Simulation and Machine Learning. arXiv preprint arXiv:1911.02385 (2019)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBCAS.2017.2759700"},{"key":"e_1_3_2_1_19_1","unstructured":"Christoph Ostrau Christian Klarhorst Michael Thies and Ulrich R\u00fcckert. 2019. Benchmarking and Characterization of event-based Neuromorphic Hardware. (2019).  Christoph Ostrau Christian Klarhorst Michael Thies and Ulrich R\u00fcckert. 2019. Benchmarking and Characterization of event-based Neuromorphic Hardware. (2019)."},{"key":"e_1_3_2_1_20_1","volume-title":"Conference Proceedings: 2019 International Conference on High Performance Computing & Simulation. IEEE.","author":"Ostrau Christoph","year":"2019","unstructured":"Christoph Ostrau , Christian Klarhorst , Michael Thies , and Ulrich R\u00fcckert . 2019 . Comparing Neuromorphic Systems by Solving Sudoku Problems . In Conference Proceedings: 2019 International Conference on High Performance Computing & Simulation. IEEE. Christoph Ostrau, Christian Klarhorst, Michael Thies, and Ulrich R\u00fcckert. 2019. Comparing Neuromorphic Systems by Solving Sudoku Problems. In Conference Proceedings: 2019 International Conference on High Performance Computing & Simulation. IEEE."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0108590"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2013.00011"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCAS.2010.5536970"},{"key":"e_1_3_2_1_24_1","volume-title":"Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System. arXiv preprint arXiv:1703.01909 (mar","author":"Schmitt Sebastian","year":"2017","unstructured":"Sebastian Schmitt , Johann Klaehn , Guillaume Bellec , Andreas Gruebl , Maurice Guettler , Andreas Hartel , Stephan Hartmann , Dan Husmann , Kai Husmann , Vitali Karasenko , Mitja Kleider , Christoph Koke , Christian Mauch , Eric Mueller , Paul Mueller , Johannes Partzsch , Mihai A. Petrovici , Stefan Schiefer , Stefan Scholze , Bernhard Vogginger , Robert Legenstein , Wolfgang Maass , Christian Mayr , Johannes Schemmel , and Karlheinz Meier . 2017. Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System. arXiv preprint arXiv:1703.01909 (mar 2017 ). arXiv:1703.01909 http:\/\/arxiv.org\/abs\/1703.01909 Sebastian Schmitt, Johann Klaehn, Guillaume Bellec, Andreas Gruebl, Maurice Guettler, Andreas Hartel, Stephan Hartmann, Dan Husmann, Kai Husmann, Vitali Karasenko, Mitja Kleider, Christoph Koke, Christian Mauch, Eric Mueller, Paul Mueller, Johannes Partzsch, Mihai A. Petrovici, Stefan Schiefer, Stefan Scholze, Bernhard Vogginger, Robert Legenstein, Wolfgang Maass, Christian Mayr, Johannes Schemmel, and Karlheinz Meier. 2017. Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System. arXiv preprint arXiv:1703.01909 (mar 2017). arXiv:1703.01909 http:\/\/arxiv.org\/abs\/1703.01909"},{"key":"e_1_3_2_1_25_1","volume-title":"Binary associative memories as a benchmark for spiking neuromorphic hardware. Frontiers in computational neuroscience 11","author":"St\u00f6ckel Andreas","year":"2017","unstructured":"Andreas St\u00f6ckel , Christoph Jenzen , Michael Thies , and Ulrich R\u00fcckert . 2017. Binary associative memories as a benchmark for spiking neuromorphic hardware. Frontiers in computational neuroscience 11 ( 2017 ), 71. Andreas St\u00f6ckel, Christoph Jenzen, Michael Thies, and Ulrich R\u00fcckert. 2017. Binary associative memories as a benchmark for spiking neuromorphic hardware. Frontiers in computational neuroscience 11 (2017), 71."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00291"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3354265.3354278"},{"key":"e_1_3_2_1_28_1","volume-title":"Andreas Gr\u00fcbl, Arthur Heimbrecht, Korbinian Schreiber, David St\u00f6ckel, Christian Pehle, et al.","author":"Wunderlich Timo","year":"2018","unstructured":"Timo Wunderlich , Akos F Kungl , Andreas Hartel , Yannik Stradmann , Syed Ahmed Aamir , Andreas Gr\u00fcbl, Arthur Heimbrecht, Korbinian Schreiber, David St\u00f6ckel, Christian Pehle, et al. 2018 . Demonstrating Advantages of Neuromorphic Computation: A Pilot Study . arXiv preprint arXiv:1811.03618 (2018). Timo Wunderlich, Akos F Kungl, Andreas Hartel, Yannik Stradmann, Syed Ahmed Aamir, Andreas Gr\u00fcbl, Arthur Heimbrecht, Korbinian Schreiber, David St\u00f6ckel, Christian Pehle, et al. 2018. Demonstrating Advantages of Neuromorphic Computation: A Pilot Study. arXiv preprint arXiv:1811.03618 (2018)."},{"key":"e_1_3_2_1_29_1","volume-title":"GeNN: a code generation framework for accelerated brain simulations. Scientific reports 6","author":"Yavuz Esin","year":"2016","unstructured":"Esin Yavuz , James Turner , and Thomas Nowotny . 2016. GeNN: a code generation framework for accelerated brain simulations. Scientific reports 6 ( 2016 ). Esin Yavuz, James Turner, and Thomas Nowotny. 2016. GeNN: a code generation framework for accelerated brain simulations. Scientific reports 6 (2016)."}],"event":{"name":"NICE '20: Neuro-inspired Computational Elements Workshop","sponsor":["INTEL Intel Corporation","IBM IBM"],"location":"Heidelberg Germany","acronym":"NICE '20"},"container-title":["Proceedings of the Neuro-inspired Computational Elements Workshop"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3381755.3381772","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3381755.3381772","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:33:07Z","timestamp":1750199587000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3381755.3381772"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,17]]},"references-count":30,"alternative-id":["10.1145\/3381755.3381772","10.1145\/3381755"],"URL":"https:\/\/doi.org\/10.1145\/3381755.3381772","relation":{},"subject":[],"published":{"date-parts":[[2020,3,17]]},"assertion":[{"value":"2020-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}