{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T05:43:32Z","timestamp":1780465412480,"version":"3.54.1"},"reference-count":68,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T00:00:00Z","timestamp":1716422400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF\u20101900675"],"award-info":[{"award-number":["CCF\u20101900675"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ECCS\u2010 1915550"],"award-info":[{"award-number":["ECCS\u2010 1915550"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000028","name":"Semiconductor Research Corporation","doi-asserted-by":"publisher","award":["Applications Driving Architectures (ADA) Research Center"],"award-info":[{"award-number":["Applications Driving Architectures (ADA) Research Center"]}],"id":[{"id":"10.13039\/100000028","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:p>Neuromorphic computing systems promise high energy efficiency and low latency. In particular, when integrated with neuromorphic sensors, they can be used to produce intelligent systems for a broad range of applications. An event\u2010based camera is such a neuromorphic sensor, inspired by the sparse and asynchronous spike representation of the biological visual system. However, processing the event data requires either using expensive feature descriptors to transform spikes into frames, or using spiking neural networks (SNNs) that are expensive to train. In this work, a neural network architecture is proposed, reservoir nodes\u2010enabled neuromorphic vision sensing network (RN\u2010Net), based on dynamic temporal encoding by on\u2010sensor reservoirs and simple deep neural network (DNN) blocks. The reservoir nodes enable efficient temporal processing of asynchronous events by leveraging the native dynamics of the node devices, while the DNN blocks enable spatial feature processing. Combining these blocks in a hierarchical structure, the RN\u2010Net offers efficient processing for both local and global spatiotemporal features. RN\u2010Net executes dynamic vision tasks created by event\u2010based cameras at the highest accuracy reported to date at one order of magnitude smaller network size. The use of simple DNN and standard backpropagation\u2010based training rules further reduces implementation and training costs.<\/jats:p>","DOI":"10.1002\/aisy.202400265","type":"journal-article","created":{"date-parts":[[2024,5,23]],"date-time":"2024-05-23T21:25:06Z","timestamp":1716499506000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["RN\u2010Net: Reservoir Nodes\u2010Enabled Neuromorphic Vision Sensing Network"],"prefix":"10.1002","volume":"6","author":[{"given":"Sangmnin","family":"Yoo","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science University of Michigan  Ann Arbor 48109 MI USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric Yeu\u2010Jer","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science University of Michigan  Ann Arbor 48109 MI USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science University of Michigan  Ann Arbor 48109 MI USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinxin","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science University of Michigan  Ann Arbor 48109 MI USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4731-1976","authenticated-orcid":false,"given":"Wei D.","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science University of Michigan  Ann Arbor 48109 MI USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,5,23]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.3008413"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2015.00437"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2017.00309"},{"key":"e_1_2_9_5_1","unstructured":"A.Amir B.Taba D.Berg T.Melano J.McKinstry C.Di Nolfo T.Nayak A.Andreopoulos G.Garreau M.Mendoza J.Kusnitz M.Debole S.Esser T.Delbruck M.Flickner D.Modha inProc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) IEEE Piscataway NJ2017."},{"key":"e_1_2_9_6_1","unstructured":"A.Sironi M.Brambilla N.Bourdis X.Lagorce R.Benosman in2018 IEEE\/CVF Conf. on Computer Vision and Pattern Recognition IEEE Piscataway NJ2018."},{"key":"e_1_2_9_7_1","doi-asserted-by":"crossref","unstructured":"G.Tan Y.Wang H.Han Y.Cao F.Wu Z. J.Zha inProc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition IEEE Piscataway NJ2022 2022\u2013June 20062.","DOI":"10.1109\/CVPR52688.2022.01946"},{"key":"e_1_2_9_8_1","unstructured":"R.\u2010J.Zhu Q.Zhao T.Zhang H.Deng Y.Duan M.Zhang L.\u2010J.Deng IEEE Trans. Neural Netw. Learn. Syst.2024 3377717."},{"key":"e_1_2_9_9_1","unstructured":"S.Deng Y.Li S.Zhang S.Gu inInter. Conf. on Learning Representations (ICLR) IEEE Piscataway NJ2022 pp.1\u201317."},{"key":"e_1_2_9_10_1","doi-asserted-by":"crossref","unstructured":"M.Yao H.Gao G.Zhao D.Wang Y.Lin Z.Yang G.Li in2021 IEEE\/CVF International Conf. on Computer Vision (ICCV)Montreal QC Canada2021 pp.10201\u201310210.","DOI":"10.1109\/ICCV48922.2021.01006"},{"key":"e_1_2_9_11_1","first-page":"21056","volume":"25","author":"Fang W.","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"e_1_2_9_12_1","first-page":"2641","volume":"1","author":"Fang W.","year":"2021","journal-title":"Proc. IEEE International Conf. Comput. Vis."},{"key":"e_1_2_9_13_1","doi-asserted-by":"crossref","unstructured":"H.Zheng Y.Wu L.Deng Y.Hu G.Li in35th AAAI Conf. on Artificial Intelligence AAAI 2021 virtual 02 2021 Vol.12B p.11062.","DOI":"10.1609\/aaai.v35i12.17320"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3073016"},{"key":"e_1_2_9_15_1","doi-asserted-by":"crossref","unstructured":"J.Kaiser H.Mostafa E.Neftci Synaptic plasticity dynamics for deep continuous local learning (DECOLLE) 2020 https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2020.00424.","DOI":"10.3389\/fnins.2020.00424"},{"key":"e_1_2_9_16_1","doi-asserted-by":"crossref","unstructured":"A.Kugele T.Pfeil M.Pfeiffer E.Chicca Efficient processing of spatio\u2010temporal data streams with spiking neural networks 2020 https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2020.00439.","DOI":"10.3389\/fnins.2020.00439"},{"key":"e_1_2_9_17_1","unstructured":"S. B.Shrestha G.Orchard Advances in Neural Information Processing Systems2018 2018\u2010December 1412."},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2574707"},{"key":"e_1_2_9_19_1","doi-asserted-by":"crossref","unstructured":"J.Xiao S.Yang Y.Zhang S.Shan X.Chen inProc. \u2010 2020 15th IEEE Inter. Conf. on Automatic Face and Gesture Recognition FG 2020 IEEE Piscataway NJ2020 pp.364\u2013370.","DOI":"10.1109\/FG47880.2020.00132"},{"key":"e_1_2_9_20_1","unstructured":"D.Feng S.Yang S.Shan X.Chen in2021 IEEE Inter. conf. on Multimedia & Expo Workshops (ICMEW) Shenzhen China 2020 pp.1\u20132."},{"key":"e_1_2_9_21_1","unstructured":"B.Martinez P.Ma S.Petridis M.Pantic inICASSP IEEE Inter. Conf. on Acoustics Speech and Signal Processing \u2013 Proc. IEEE Piscataway NJ2020 2020\u2010May 6319."},{"key":"e_1_2_9_22_1","unstructured":"Q.Wang Y.Zhang J.Yuan Y.Lu inProc. \u2010 2019 IEEE Winter Conf. on Applications of Computer Vision WACV 2019 IEEE Piscataway NJ2019 pp.1826\u20131835."},{"key":"e_1_2_9_23_1","doi-asserted-by":"crossref","unstructured":"Y.Wang B.Du Y.Shen K.Wu G.Zhao J.Sun H.Wen inProc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition IEEE Piscataway NJ2019 2019\u2010June 6351.","DOI":"10.1109\/CVPR.2019.00652"},{"key":"e_1_2_9_24_1","doi-asserted-by":"crossref","unstructured":"D.Gehrig A.Loquercio K.Derpanis D.Scaramuzza inProc. of the IEEE Inter. Conf. on Computer Vision IEEE Piscataway NJ2019 2019\u2010October 5632.","DOI":"10.1109\/ICCV.2019.00573"},{"key":"e_1_2_9_25_1","first-page":"3436","volume":"44","author":"Wang Y.","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_2_9_26_1","doi-asserted-by":"crossref","unstructured":"P.Werbos Backpropagation through time: What it does and how to do it 1990 http:\/\/ieeexplore.ieee.org\/document\/58337\/?reload=true.","DOI":"10.1109\/5.58337"},{"key":"e_1_2_9_27_1","doi-asserted-by":"crossref","unstructured":"A.Grimaldi V.Boutin S.Hoi Ieng R.Benosman A robust event\u2010driven approach to always\u2010on object recognition TechRxiv July2023.","DOI":"10.36227\/techrxiv.18003077"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-016-0009-6"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-019-0313-3"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1088\/2634-4386\/ac1b75"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1021\/nn202983n"},{"key":"e_1_2_9_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.10.002"},{"key":"e_1_2_9_33_1","doi-asserted-by":"crossref","unstructured":"Y.Bi A.Chadha A.Abbas E.Bourtsoulatze Y.Andreopoulos in2019 IEEE\/CVF International Confernce on Computer Vision (ICCV) Seoul Korea (South)2019 pp.491\u2013501.","DOI":"10.1109\/ICCV.2019.00058"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364917691115"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3068942"},{"key":"e_1_2_9_36_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2015.00481"},{"key":"e_1_2_9_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_9_38_1","unstructured":"A.Graves ArXiv 2013 1\u201343 https:\/\/doi.org\/10.48550\/arXiv.1308.0850."},{"key":"e_1_2_9_39_1","unstructured":"J.Chung C.Gulcehre K.Cho Y.Bengio in2014 Conference on Neural Information Processing Systems Deep Learning and Representation Learning Workshop Montreal QC Canada December2014 pp.1\u20139."},{"key":"e_1_2_9_40_1","doi-asserted-by":"crossref","unstructured":"Y.Bi A.Chadha A.Abbas E.Bourtsoulatze Y.Andreopoulos inProc. the IEEE Inter. Conf. on Computer Vision IEEE Piscataway NJ2019 2019\u2010Octob 491.","DOI":"10.1109\/ICCV.2019.00058"},{"key":"e_1_2_9_41_1","unstructured":"H.Rebecq T.Horstschaefer D.Scaramuzza inBritish Machine Vision Conf. 2017 BMVC 2017 London UK September2017."},{"key":"e_1_2_9_42_1","unstructured":"A. Z.Zhu L.Yuan K.Chaney K.Daniilidis inIEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops IEEE Piscataway NJ2019 2019\u2010June 1694."},{"key":"e_1_2_9_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2019.2931595"},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00435"},{"key":"e_1_2_9_45_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20123404"},{"key":"e_1_2_9_46_1","doi-asserted-by":"crossref","unstructured":"M.Cannici M.Ciccone A.Romanoni M.Matteucci inIEEEComputer Society Conf. on Computer Vision and Pattern Recognition Workshops IEEE Piscataway NJ2019 2019\u2010June 1656.","DOI":"10.1109\/CVPRW.2019.00209"},{"key":"e_1_2_9_47_1","doi-asserted-by":"crossref","unstructured":"J.Li C.Zhao K.Hamedani Y.Yi in2017 International Joint Conference on Neural Networks (IJCNN) Anchorage AK USA2017 pp.3439\u20133446 ISBN 2161\u20104407.","DOI":"10.1109\/IJCNN.2017.7966288"},{"key":"e_1_2_9_48_1","doi-asserted-by":"publisher","DOI":"10.1002\/adma.202205381"},{"key":"e_1_2_9_49_1","doi-asserted-by":"crossref","unstructured":"H.Fang B.Taylor Z.Li Z.Mei H. H.Li Q.Qiu in2021 58th ACM\/IEEE Design Automation Conference (DAC) San Francisco CA USA 2021 pp.361\u2013366 ISBN 0738\u2010100X.","DOI":"10.1109\/DAC18074.2021.9586133"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/adfm.201501427"},{"key":"e_1_2_9_51_1","first-page":"977","volume":"62","author":"Alomar M. L.","year":"2015","journal-title":"IEEE Trans. Circuits Syst. II: Express Br."},{"key":"e_1_2_9_52_1","unstructured":"S.Ioffe C.Szegedy in32nd Inter. Conf. on Machine Learning ICML 2015 Lille France July2015 Vol.1 p.448."},{"key":"e_1_2_9_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2023.3308088"},{"key":"e_1_2_9_54_1","unstructured":"A.Paszke S.Gross F.Massa A.Lerer J.Bradbury G.Chanan T.Killeen Z.Lin N.Gimelshein L.Antiga A.Desmaison A.Kopf E.Yang Z.DeVito M.Raison A.Tejani S.Chilamkurthy B.Steiner L.Fang J.Bai S.Chintala Vol.32.Curran Associates Inc. 2019 pp.8024\u20138035 https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/bdbca288fee7f92f2bfa9f7012727740\u2010Paper.pdf."},{"key":"e_1_2_9_55_1","unstructured":"Z.Zhang M. R.Sabuncu Advances in Neural Information Processing Systems2018 2018\u2010Decem 8778."},{"key":"e_1_2_9_56_1","unstructured":"D. P.Kingma J. L.Ba in3rd Inter. Conf. on Learning Representations ICLR 2015 \u2013 Conf. Track Proc. San Diego CA USA May 2015 pp.1\u201315."},{"key":"e_1_2_9_57_1","doi-asserted-by":"publisher","DOI":"10.3390\/app10020557"},{"key":"e_1_2_9_58_1","unstructured":"Coral Edge tpu performance benchmarks 2020 https:\/\/coral.ai\/docs\/edgetpu\/benchmarks\/ (accessed May 20 2023)."},{"key":"e_1_2_9_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/smm2.1154"},{"key":"e_1_2_9_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2978109"},{"key":"e_1_2_9_61_1","unstructured":"Y.Li H.Zhou B.Yang Y.Zhang Z.Cui H.Bao G.Zhang inProc. of the IEEE\/CVF Inter. Conf. on Computer Vision (ICCV) IEEE Piscataway NJ2021 pp.934\u2013943."},{"key":"e_1_2_9_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3073673"},{"key":"e_1_2_9_63_1","first-page":"53674","volume":"36","author":"Fang W.","year":"2023","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_9_64_1","doi-asserted-by":"crossref","unstructured":"Z.Wang Y.Fang J.Cao Q.Zhang Z.Wang R.Xu inProc. of the IEEE\/CVF Inter. Conf. on Computer Vision (ICCV) IEEE Piscataway NJ2023 pp.1761\u20131771.","DOI":"10.1109\/ICCV51070.2023.00169"},{"key":"e_1_2_9_65_1","unstructured":"J.Kim J.Bae G.Park D.Zhang Y. M.Kim inProc. of the IEEE\/CVF Inter. Conf. on Computer Vision (ICCV) IEEE Piscataway NJ2021 pp.2146\u20132156."},{"key":"e_1_2_9_66_1","unstructured":"X.She S.Dash S.Mukhopadhyay inInter. Conf. on Learning Representations 2022 https:\/\/openreview.net\/forum?id=bp\u2010LJ4y_XC."},{"key":"e_1_2_9_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58565-5_9"},{"key":"e_1_2_9_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3177744"},{"key":"e_1_2_9_69_1","unstructured":"N.Messikommer D.Gehrig A.Loquercio D.Scaramuzza 2020 http:\/\/rpg.ifi.uzh.ch\/docs\/ECCV20_Messikommer.pdf."}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202400265","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202400265","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T14:30:20Z","timestamp":1759847420000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202400265"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,23]]},"references-count":68,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.1002\/aisy.202400265"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202400265","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,23]]},"assertion":[{"value":"2024-04-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2400265"}}