{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:56Z","timestamp":1750219976291,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8]]},"DOI":"10.1145\/3589737.3605979","type":"proceedings-article","created":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T16:00:57Z","timestamp":1693238457000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Deep Reinforcement Learning Methods for Discovering Novel Neuromorphic Devices"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4435-1799","authenticated-orcid":false,"given":"Douglas Cale","family":"Crowder","sequence":"first","affiliation":[{"name":"Cognitive and Emerging Computing, Sandia National Laboratories, Albuquerque, New Mexico, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3643-0868","authenticated-orcid":false,"given":"John Darby","family":"Smith","sequence":"additional","affiliation":[{"name":"Cognitive and Emerging Computing, Sandia National Laboratories, Albuquerque, New Mexico, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2657-5545","authenticated-orcid":false,"given":"Suma George","family":"Cardwell","sequence":"additional","affiliation":[{"name":"Cognitive and Emerging Computing, Sandia National Laboratories, Albuquerque, New Mexico, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8,28]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Energy efficient UAV-enabled mobile edge computing for IoT devices: a review","author":"Abrar Muhammad","year":"2021","unstructured":"Muhammad Abrar , Ushna Ajmal , Ziyad M Almohaimeed , Xiang Gui , Rizwan Akram , and Roha Masroor . 2021. Energy efficient UAV-enabled mobile edge computing for IoT devices: a review . IEEE Access ( 2021 ). Muhammad Abrar, Ushna Ajmal, Ziyad M Almohaimeed, Xiang Gui, Rizwan Akram, and Roha Masroor. 2021. Energy efficient UAV-enabled mobile edge computing for IoT devices: a review. IEEE Access (2021)."},{"key":"e_1_3_2_1_2_1","volume-title":"A review of non-cognitive applications for neuromorphic computing. Neuromorphic Computing and Engineering","author":"Aimone James","year":"2022","unstructured":"James Aimone , Prasanna Date , Gabriel Fonseca-Guerra , Kathleen Hamilton , Kyle Henke , Bill Kay , Garrett Kenyon , Shruti Kulkarni , Susan Mniszewski , and Maryam Parsa . 2022. A review of non-cognitive applications for neuromorphic computing. Neuromorphic Computing and Engineering ( 2022 ). James Aimone, Prasanna Date, Gabriel Fonseca-Guerra, Kathleen Hamilton, Kyle Henke, Bill Kay, Garrett Kenyon, Shruti Kulkarni, Susan Mniszewski, and Maryam Parsa. 2022. A review of non-cognitive applications for neuromorphic computing. Neuromorphic Computing and Engineering (2022)."},{"key":"e_1_3_2_1_3_1","volume-title":"OpenAI Pieter Abbeel, and Wojciech Zaremba","author":"Andrychowicz Marcin","year":"2017","unstructured":"Marcin Andrychowicz , Filip Wolski , Alex Ray , Jonas Schneider , Rachel Fong , Peter Welinder , Bob McGrew , Josh Tobin , OpenAI Pieter Abbeel, and Wojciech Zaremba . 2017 . Hindsight experience replay. Advances in neural information processing systems 30 (2017). Marcin Andrychowicz, Filip Wolski, Alex Ray, Jonas Schneider, Rachel Fong, Peter Welinder, Bob McGrew, Josh Tobin, OpenAI Pieter Abbeel, and Wojciech Zaremba. 2017. Hindsight experience replay. Advances in neural information processing systems 30 (2017)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1038\/s41586-019-1666-5"},{"key":"e_1_3_2_1_5_1","first-page":"89","article-title":"Neuromorphic computing using non-volatile memory","author":"Burr Geoffrey W","year":"2017","unstructured":"Geoffrey W Burr , Robert M Shelby , Abu Sebastian , Sangbum Kim , Seyoung Kim , Severin Sidler , Kumar Virwani , Masatoshi Ishii , Pritish Narayanan , Alessandro Fumarola , 2017 . Neuromorphic computing using non-volatile memory . Advances in Physics : X 2, 1 (2017), 89 -- 124 . Geoffrey W Burr, Robert M Shelby, Abu Sebastian, Sangbum Kim, Seyoung Kim, Severin Sidler, Kumar Virwani, Masatoshi Ishii, Pritish Narayanan, Alessandro Fumarola, et al. 2017. Neuromorphic computing using non-volatile memory. Advances in Physics: X 2, 1 (2017), 89--124.","journal-title":"Advances in Physics"},{"key":"e_1_3_2_1_6_1","volume-title":"AI-Enhanced Codesign of Neuromorphic Circuit. In 2023 IEEE 65th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE.","author":"Crowder Douglas C","year":"2023","unstructured":"Douglas C Crowder , J Darby Smith , and Suma G Cardwell . 2023 . AI-Enhanced Codesign of Neuromorphic Circuit. In 2023 IEEE 65th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE. Douglas C Crowder, J Darby Smith, and Suma G Cardwell. 2023. AI-Enhanced Codesign of Neuromorphic Circuit. In 2023 IEEE 65th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_7_1","DOI":"10.1088\/1741-2560\/13\/5\/051001"},{"doi-asserted-by":"crossref","unstructured":"Guillermo Gallego Tobi Delbr\u00fcck Garrick Orchard Chiara Bartolozzi Brian Taba Andrea Censi Stefan Leutenegger Andrew J Davison J\u00f6rg Conradt Kostas Daniilidis etal 2020. Event-based vision: A survey. IEEE transactions on pattern analysis and machine intelligence 44 1 (2020) 154--180.  Guillermo Gallego Tobi Delbr\u00fcck Garrick Orchard Chiara Bartolozzi Brian Taba Andrea Censi Stefan Leutenegger Andrew J Davison J\u00f6rg Conradt Kostas Daniilidis et al. 2020. Event-based vision: A survey. IEEE transactions on pattern analysis and machine intelligence 44 1 (2020) 154--180.","key":"e_1_3_2_1_8_1","DOI":"10.1109\/TPAMI.2020.3008413"},{"key":"e_1_3_2_1_9_1","volume-title":"Multilayer feedforward networks are universal approximators. Neural networks 2, 5","author":"Hornik Kurt","year":"1989","unstructured":"Kurt Hornik , Maxwell Stinchcombe , and Halbert White . 1989. Multilayer feedforward networks are universal approximators. Neural networks 2, 5 ( 1989 ), 359--366. Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural networks 2, 5 (1989), 359--366."},{"key":"e_1_3_2_1_10_1","volume-title":"Richard Lazarus Pahlavani, and Andrew Lambert","author":"Jolley Andrew","year":"2023","unstructured":"Andrew Jolley , Saeed Afshar , Greg Cohen , Richard Lazarus Pahlavani, and Andrew Lambert . 2023 . Neuromorphic Sensor Event-Rate Monitoring for Satellite Characterization. Journal of Spacecraft and Rockets ( 2023), 1--12. Andrew Jolley, Saeed Afshar, Greg Cohen, Richard Lazarus Pahlavani, and Andrew Lambert. 2023. Neuromorphic Sensor Event-Rate Monitoring for Satellite Characterization. Journal of Spacecraft and Rockets (2023), 1--12."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1109\/MM.2018.032271057"},{"key":"e_1_3_2_1_12_1","volume-title":"Alex Pappachen James, and Leon Ong Chua","author":"Krestinskaya Olga","year":"2019","unstructured":"Olga Krestinskaya , Alex Pappachen James, and Leon Ong Chua . 2019 . Neuromemristive circuits for edge computing: A review. IEEE transactions on neural networks and learning systems 31, 1 (2019), 4--23. Olga Krestinskaya, Alex Pappachen James, and Leon Ong Chua. 2019. Neuromemristive circuits for edge computing: A review. IEEE transactions on neural networks and learning systems 31, 1 (2019), 4--23."},{"key":"e_1_3_2_1_13_1","volume-title":"Third-order nanocircuit elements for neuromorphic engineering. Nature 585, 7826","author":"Kumar Suhas","year":"2020","unstructured":"Suhas Kumar , R Stanley Williams , and Ziwen Wang . 2020. Third-order nanocircuit elements for neuromorphic engineering. Nature 585, 7826 ( 2020 ), 518--523. Suhas Kumar, R Stanley Williams, and Ziwen Wang. 2020. Third-order nanocircuit elements for neuromorphic engineering. Nature 585, 7826 (2020), 518--523."},{"key":"e_1_3_2_1_14_1","volume-title":"Ebrahim Songhori, Shen Wang, Young-Joon Lee, Eric Johnson, Omkar Pathak, Azade Nazi, et al.","author":"Mirhoseini Azalia","year":"2021","unstructured":"Azalia Mirhoseini , Anna Goldie , Mustafa Yazgan , Joe Wenjie Jiang , Ebrahim Songhori, Shen Wang, Young-Joon Lee, Eric Johnson, Omkar Pathak, Azade Nazi, et al. 2021 . A graph placement methodology for fast chip design. Nature 594, 7862 (2021), 207--212. Azalia Mirhoseini, Anna Goldie, Mustafa Yazgan, Joe Wenjie Jiang, Ebrahim Songhori, Shen Wang, Young-Joon Lee, Eric Johnson, Omkar Pathak, Azade Nazi, et al. 2021. A graph placement methodology for fast chip design. Nature 594, 7862 (2021), 207--212."},{"key":"e_1_3_2_1_15_1","first-page":"278","article-title":"Policy invariance under reward transformations: Theory and application to reward shaping","volume":"99","author":"Ng Andrew Y","year":"1999","unstructured":"Andrew Y Ng , Daishi Harada , and Stuart Russell . 1999 . Policy invariance under reward transformations: Theory and application to reward shaping . In Icml , Vol. 99. 278 -- 287 . Andrew Y Ng, Daishi Harada, and Stuart Russell. 1999. Policy invariance under reward transformations: Theory and application to reward shaping. In Icml, Vol. 99. 278--287.","journal-title":"Icml"},{"key":"e_1_3_2_1_16_1","first-page":"1","article-title":"Stable-Baselines3: Reliable Reinforcement Learning Implementations","volume":"22","author":"Raffin Antonin","year":"2021","unstructured":"Antonin Raffin , Ashley Hill , Adam Gleave , Anssi Kanervisto , Maximilian Ernestus , and Noah Dormann . 2021 . Stable-Baselines3: Reliable Reinforcement Learning Implementations . Journal of Machine Learning Research 22 , 268 (2021), 1 -- 8 . Antonin Raffin, Ashley Hill, Adam Gleave, Anssi Kanervisto, Maximilian Ernestus, and Noah Dormann. 2021. Stable-Baselines3: Reliable Reinforcement Learning Implementations. Journal of Machine Learning Research 22, 268 (2021), 1--8.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_17_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","unstructured":"Richard S Sutton and Andrew G Barto . 2018. Reinforcement learning: An introduction . MIT press . Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press.","key":"e_1_3_2_1_18_1"},{"key":"e_1_3_2_1_19_1","volume-title":"Gert Cauwenberghs, Giacomo Indiveri, Kundan Kumar, Ning Qiao, Johannes Schemmel, Runchun Wang, Elisabetta Chicca, Jennifer Olson Hasler, et al.","author":"Thakur Chetan Singh","year":"2018","unstructured":"Chetan Singh Thakur , Jamal Lottier Molin , Gert Cauwenberghs, Giacomo Indiveri, Kundan Kumar, Ning Qiao, Johannes Schemmel, Runchun Wang, Elisabetta Chicca, Jennifer Olson Hasler, et al. 2018 . Large-scale neuromorphic spiking array processors: A quest to mimic the brain. Frontiers in neuroscience 12 (2018), 891. Chetan Singh Thakur, Jamal Lottier Molin, Gert Cauwenberghs, Giacomo Indiveri, Kundan Kumar, Ning Qiao, Johannes Schemmel, Runchun Wang, Elisabetta Chicca, Jennifer Olson Hasler, et al. 2018. Large-scale neuromorphic spiking array processors: A quest to mimic the brain. Frontiers in neuroscience 12 (2018), 891."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.1145\/3517343.3517353"},{"key":"e_1_3_2_1_21_1","volume-title":"2019 IEEE Space Computing Conference (SCC). IEEE, 33--40","author":"Vineyard Craig","year":"2019","unstructured":"Craig Vineyard , William Severa , Matthew Kagie , Andrew Scholand , and Park Hays . 2019 . A Resurgence in Neuromorphic Architectures Enabling Remote Sensing Computation . In 2019 IEEE Space Computing Conference (SCC). IEEE, 33--40 . Craig Vineyard, William Severa, Matthew Kagie, Andrew Scholand, and Park Hays. 2019. A Resurgence in Neuromorphic Architectures Enabling Remote Sensing Computation. In 2019 IEEE Space Computing Conference (SCC). IEEE, 33--40."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1038\/530144a"},{"key":"e_1_3_2_1_23_1","volume-title":"2021 IEEE Space Computing Conference (SCC). IEEE, 39--45","author":"Yanguas-Gil Angel","year":"2021","unstructured":"Angel Yanguas-Gil , Jaehoon Koo , Sandeep Madireddy , Prasanna Balaprakash , Jeffrey W Elam , and Anil U Mane . 2021 . Neuromorphic architectures for edge computing under extreme environments . In 2021 IEEE Space Computing Conference (SCC). IEEE, 39--45 . Angel Yanguas-Gil, Jaehoon Koo, Sandeep Madireddy, Prasanna Balaprakash, Jeffrey W Elam, and Anil U Mane. 2021. Neuromorphic architectures for edge computing under extreme environments. In 2021 IEEE Space Computing Conference (SCC). IEEE, 39--45."}],"event":{"sponsor":["SIGDA ACM Special Interest Group on Design Automation"],"acronym":"ICONS '23","name":"ICONS '23: 2023 International Conference on Neuromorphic Systems","location":"Santa Fe NM USA"},"container-title":["Proceedings of the 2023 International Conference on Neuromorphic Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589737.3605979","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3589737.3605979","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:21Z","timestamp":1750182561000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589737.3605979"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":23,"alternative-id":["10.1145\/3589737.3605979","10.1145\/3589737"],"URL":"https:\/\/doi.org\/10.1145\/3589737.3605979","relation":{},"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2023-08-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}