{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:05:31Z","timestamp":1753891531307,"version":"3.41.2"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>Event-based cameras are bio-inspired vision sensors that mimic the sparse and asynchronous activation of the animal retina, offering advantages such as low latency and low computational load in various robotic applications. However, despite their inherent sparsity, most existing visual processing algorithms are optimized for conventional standard cameras and dense images captured from them, resulting in computational redundancy and high latency when applied to event-based cameras. To address this gap, we propose a sparse convolution operator tailored for event-based cameras. By selectively skipping invalid sub-convolutions and efficiently reorganizing valid computations, our operator reduces computational workload by nearly 90% and achieves almost 2\u00d7 acceleration in processing speed, while maintaining the same accuracy as dense convolution operators. This innovation unlocks the potential of event-based cameras in applications such as autonomous navigation, real-time object tracking, and industrial inspection, enabling low-latency and high-efficiency perception in resource-constrained robotic systems.<\/jats:p>","DOI":"10.3389\/fnbot.2025.1537673","type":"journal-article","created":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T07:53:31Z","timestamp":1741766011000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["High-efficiency sparse convolution operator for event-based cameras"],"prefix":"10.3389","volume":"19","author":[{"given":"Sen","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fusheng","family":"Zha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangji","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mantian","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengfei","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolin","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lining","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,3,12]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1109\/TNNLS.2013.2273537","article-title":"Event-based visual flow","volume":"25","author":"Benosman","year":"2013","journal-title":"IEEE trans. Neural Netw. Learn. Syst"},{"key":"B2","doi-asserted-by":"crossref","first-page":"4725","DOI":"10.1109\/ICRA.2018.8460482","article-title":"\u201cEnd to end learning of spiking neural network based on R-STDP for a lane keeping vehicle,\u201d","volume-title":"2018 IEEE International Conference on Robotics and Automation (ICRA)","author":"Bing","year":"2018"},{"key":"B3","doi-asserted-by":"publisher","first-page":"137","DOI":"10.3389\/fnins.2015.00137","article-title":"On event-based optical flow detection","volume":"9","author":"Brosch","year":"2015","journal-title":"Front. Neurosci"},{"key":"B4","doi-asserted-by":"publisher","first-page":"6376","DOI":"10.1109\/LRA.2024.3401675","article-title":"A2G: Leveraging intuitive physics for force-efficient robotic grasping","volume":"9","author":"Cheng","year":"2024","journal-title":"IEEE Robot. Automat. Lett"},{"key":"B5","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1109\/IJCNN52387.2021.9533514","article-title":"\u201cLearning from event cameras with sparse spiking convolutional neural networks,\u201d","volume-title":"2021 International Joint Conference on Neural Networks (IJCNN)","author":"Cordone","year":"2021"},{"key":"B6","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/TPAMI.2020.3008413","article-title":"Event-based vision: a survey","volume":"44","author":"Gallego","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B7","first-page":"9224","article-title":"\u201c3D semantic segmentation with submanifold sparse convolutional networks,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision And Pattern Recognition","author":"Graham","year":"2018"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00961","article-title":"Submanifold sparse convolutional networks","author":"Graham","year":"2017","journal-title":"arXiv"},{"key":"B9","doi-asserted-by":"publisher","first-page":"12005","DOI":"10.1109\/TITS.2024.3381174","article-title":"Global-local mav detection under challenging conditions based on appearance and motion","volume":"25","author":"Guo","year":"2024","journal-title":"IEEE Trans. Intellig. Transp. Syst"},{"key":"B10","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-70136-3_12","article-title":"\u201cEvent-based target tracking control for a snake robot using a dynamic vision sensor,\u201d","volume-title":"Neural Information Processing: 24th International Conference, ICONIP 2017","author":"Jiang","year":"2017"},{"key":"B11","doi-asserted-by":"crossref","first-page":"8332","DOI":"10.1109\/ICRA.2019.8793924","article-title":"\u201cMixed frame-\/event-driven fast pedestrian detection,\u201d","volume-title":"2019 International Conference on Robotics and Automation (ICRA)","author":"Jiang","year":"2019"},{"volume-title":"Adaptive Time-Slice Block-Matching Optical Flow Algorithm for Dynamic Vision Sensors","year":"2018","author":"Liu","key":"B12"},{"key":"B13","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1038\/s42256-025-00983-2","article-title":"Preserving and combining knowledge in robotic lifelong reinforcement learning","volume":"7","author":"Meng","year":"2025","journal-title":"Nature Mach. Intellig"},{"key":"B14","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-030-58598-3_25","article-title":"\u201cEvent-based asynchronous sparse convolutional networks,\u201d","volume-title":"Computer Vision-ECCV 2020: 16th European Conference","author":"Messikommer","year":"2020"},{"key":"B15","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3389\/fnbot.2019.00038","article-title":"Neuromorphic vision datasets for pedestrian detection, action recognition, and fall detection","volume":"13","author":"Miao","year":"2019","journal-title":"Front. Neurorobot"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1007\/s11263-018-1106-2","article-title":"Real-time intensity-image reconstruction for event cameras using manifold regularisation","volume":"126","author":"Munda","year":"2018","journal-title":"Int. J. Comput. Vis"},{"key":"B17","doi-asserted-by":"publisher","first-page":"437","DOI":"10.3389\/fnins.2015.00437","article-title":"Converting static image datasets to spiking neuromorphic datasets using saccades","volume":"9","author":"Orchard","year":"","journal-title":"Front. Neurosci"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2028","DOI":"10.1109\/TPAMI.2015.2392947","article-title":"HFIRST: a temporal approach to object recognition","volume":"37","author":"Orchard","year":"","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01217","article-title":"Motiondeltacnn: sparse cnn inference of frame differences in moving camera videos","author":"Parger","year":"","journal-title":"arXiv"},{"key":"B20","first-page":"12497","article-title":"\u201cDeltaCNN: end-to-end cnn inference of sparse frame differences in videos,\u201d","author":"Parger","year":"","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"key":"B21","doi-asserted-by":"publisher","first-page":"108796","DOI":"10.1016\/j.patcog.2022.108796","article-title":"3D object detection for autonomous driving: a survey","volume":"130","author":"Qian","year":"2022","journal-title":"Pattern Recognit"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1964","DOI":"10.1109\/TPAMI.2019.2963386","article-title":"High speed and high dynamic range video with an event camera","volume":"43","author":"Rebecq","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B23","first-page":"12371","article-title":"\u201cAEGNN: Asynchronous event-based graph neural networks,\u201d","author":"Schaefer","year":"2022","journal-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"volume-title":"A Primer on Memory Consistency and Cache Coherence","year":"2022","author":"Sorin","key":"B24"},{"key":"B25","first-page":"8445","article-title":"\u201cPseudo-lidar from visual depth estimation: Bridging the gap in 3D object detection for autonomous driving,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wang","year":"2019"},{"key":"B26","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1007\/s11633-022-1340-5","article-title":"Efficient visual recognition: a survey on recent advances and brain-inspired methodologies","volume":"19","author":"Wu","year":"2022","journal-title":"Mach. Intellig. Res"},{"key":"B27","doi-asserted-by":"publisher","first-page":"3337","DOI":"10.3390\/s18103337","article-title":"Second: Sparsely embedded convolutional detection","volume":"18","author":"Yan","year":"2018","journal-title":"Sensors"},{"key":"B28","first-page":"1","article-title":"\u201cAutonomous driving digital twin empowered design automation: an industry perspective,\u201d","volume-title":"2023 60th ACM\/IEEE Design Automation Conference (DAC)","author":"Yu","year":"2023"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2018.XIV.062","article-title":"EV-FLOWNET: Self-supervised optical flow estimation for event-based cameras","author":"Zhu","year":"2018","journal-title":"arXiv"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2025.1537673\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T07:53:40Z","timestamp":1741766020000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2025.1537673\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,12]]},"references-count":29,"alternative-id":["10.3389\/fnbot.2025.1537673"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2025.1537673","relation":{},"ISSN":["1662-5218"],"issn-type":[{"type":"electronic","value":"1662-5218"}],"subject":[],"published":{"date-parts":[[2025,3,12]]},"article-number":"1537673"}}