{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:21:51Z","timestamp":1760149311095,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,7,25]],"date-time":"2023-07-25T00:00:00Z","timestamp":1690243200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62005269"],"award-info":[{"award-number":["62005269"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Event cameras are the emerging bio-mimetic sensors with microsecond-level responsiveness in recent years, also known as dynamic vision sensors. Due to the inherent sensitivity of event camera hardware to light sources and interference from various external factors, various types of noises are inevitably present in the camera\u2019s output results. This noise can degrade the camera\u2019s perception of events and the performance of algorithms for processing event streams. Moreover, since the output of event cameras is in the form of address-event representation, efficient denoising methods for traditional frame images are no longer applicable in this case. Most existing denoising methods for event cameras target background activity noise and sometimes remove real events as noise. Furthermore, these methods are ineffective in handling noise generated by high-frequency flickering light sources and changes in diffused light reflection. To address these issues, we propose an event stream denoising method based on salient region recognition in this paper. This method can effectively remove conventional background activity noise as well as irregular noise caused by diffuse reflection and flickering light source changes without significantly losing real events. Additionally, we introduce an evaluation metric that can be used to assess the noise removal efficacy and the preservation of real events for various denoising methods.<\/jats:p>","DOI":"10.3390\/s23156655","type":"journal-article","created":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T01:09:01Z","timestamp":1690333741000},"page":"6655","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Denoising Method Based on Salient Region Recognition for the Spatiotemporal Event Stream"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-8599-8263","authenticated-orcid":false,"given":"Sichao","family":"Tang","sequence":"first","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"},{"name":"College of Materials Science and Opto-Electronic Technology, University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hengyi","family":"Lv","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuchen","family":"Zhao","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Feng","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hailong","family":"Liu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guoling","family":"Bi","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2259","DOI":"10.1109\/JSSC.2004.836338","article-title":"An ultrawideband CMOS low-noise amplifier for 3.1-10.6-GHz wireless receivers","volume":"39","author":"Bevilacqua","year":"2004","journal-title":"IEEE J. Solid State Circuits"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/16.628824","article-title":"CMOS image sensors: Electronic camera-on-a-chip","volume":"44","author":"Fossum","year":"1997","journal-title":"IEEE Trans. Electron. Devices"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1109\/TCAD.1987.1270271","article-title":"CMOS circuit speed and buffer optimization","volume":"6","author":"Hedenstierna","year":"1987","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, S., and Guo, M. (2019, January 16\u201317). Live Demonstration: CeleX-V: A 1M Pixel Multi-Mode Event-Based Sensor. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00214"},{"key":"ref_5","first-page":"342","article-title":"Event camera-based visual tracking algorith: A survey","volume":"47","author":"Xiaolong","year":"2021","journal-title":"Mini Micro Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Suh, Y., Choi, S., Ito, M., Kim, J., Lee, Y., Seo, J., Jung, H., Yeo, D.-H., Namgung, S., and Bong, J. (2020, January 12\u201314). A 1280 \u00d7 960 Dynamic Vision Sensor with a 4.95-\u03bcm Pixel Pitch and Motion Artifact Minimization. Proceedings of the 2020 IEEE international symposium on circuits and systems (ISCAS), Seville, Spain.","DOI":"10.1109\/ISCAS45731.2020.9180436"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bardow, P., Davison, A.J., and Leutenegger, S. (2016, January 27\u201330). Simultaneous Optical Flow and Intensity Estimation from an Event Camera. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.102"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/JSSC.2007.914337","article-title":"A 128 \u00d7 128 120 dB 15 \u00b5s latency asynchronous temporal contrast vision sensor","volume":"43","author":"Lichtsteiner","year":"2008","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jia, Q.-S., Wen, Z., and Xia, L. (2012, January 5\u20137). Event-Based Sensor Activation for Indoor Occupant Distribution Estimation. Proceedings of the 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV), Guangzhou, China.","DOI":"10.1109\/ICARCV.2012.6485165"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1109\/TMM.2020.2993957","article-title":"Probabilistic undirected graph based denoising method for dynamic vision sensor","volume":"23","author":"Wu","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Glover, A., and Bartolozzi, C. (2017, January 24\u201328). Robust Visual Tracking with a Freely-Moving Event Camera. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206226"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pi\u0105tkowska, E., Belbachir, A.N., Schraml, S., and Gelautz, M. (2012, January 16\u201321). Spatiotemporal Multiple Persons Tracking Using Dynamic Vision Sensor. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238892"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Glover, A., and Bartolozzi, C. (2016, January 9\u201314). Event-Driven Ball Detection and Gaze Fixation in Clutter. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea.","DOI":"10.1109\/IROS.2016.7759345"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1109\/TIE.2014.2334667","article-title":"Proximity sensing based on a dynamic vision sensor for mobile devices","volume":"62","author":"Won","year":"2014","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"15805","DOI":"10.3390\/s131115805","article-title":"Neuro-inspired spike-based motion: From dynamic vision sensor to robot motor open-loop control through spike-VITE","volume":"13","year":"2013","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Colonnier, F., Della Vedova, L., and Orchard, G. (2021). ESPEE: Event-based sensor pose estimation using an extended Kalman filter. Sensors, 21.","DOI":"10.3390\/s21237840"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Litzenberger, M., Kohn, B., Belbachir, A.N., Donath, N., Gritsch, G., Garn, H., Posch, C., and Schraml, S. (2006, January 17\u201320). Estimation of Vehicle Speed Based on Asynchronous Data from a Silicon Retina Optical Sensor. Proceedings of the 2006 IEEE Intelligent Transportation Systems Conference, Toronto, ON, Canada.","DOI":"10.1109\/ITSC.2006.1706816"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Du, B., Li, W., Wang, Z., Xu, M., Gao, T., Li, J., and Wen, H. (2021). Event encryption for neuromorphic vision sensors: Framework, algorithm, and evaluation. Sensors, 21.","DOI":"10.3390\/s21134320"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1394","DOI":"10.1007\/s11263-017-1050-6","article-title":"EMVS: Event-based multi-view stereo\u20143D reconstruction with an event camera in real-time","volume":"126","author":"Rebecq","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhu, A.Z., Yuan, L., Chaney, K., and Daniilidis, K. (2018). EV-FlowNet: Self-supervised optical flow estimation for event-based cameras. arXiv.","DOI":"10.15607\/RSS.2018.XIV.062"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1964","DOI":"10.1109\/TPAMI.2019.2963386","article-title":"High speed and high dynamic range video with an event camera","volume":"43","author":"Rebecq","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mitrokhin, A., Ye, C., Ferm\u00fcller, C., Aloimonos, Y., and Delbruck, T. (2019, January 3\u20138). EV-IMO: Motion Segmentation Dataset and Learning Pipeline for Event Cameras. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8968520"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1007\/s10845-021-01887-9","article-title":"Real-time grasping strategies using event camera","volume":"33","author":"Huang","year":"2022","journal-title":"J. Intell. Manuf."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"55853","DOI":"10.1109\/ACCESS.2021.3071261","article-title":"Neuromorphic eye-in-hand visual servoing","volume":"9","author":"Muthusamy","year":"2021","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1109\/LRA.2018.2793357","article-title":"Ultimate SLAM? Combining events, images, and IMU for robust visual SLAM in HDR and high-speed scenarios","volume":"3","author":"Vidal","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, H., Brandli, C., Li, C., Liu, S.-C., and Delbruck, T. Design of a Spatiotemporal Correlation Filter for Event-Based Sensors. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Lisbon, Portugal, 24\u201427 May 2015.","DOI":"10.1109\/ISCAS.2015.7168735"},{"key":"ref_27","unstructured":"Tian, H. (2000). Noise Analysis in CMOS Image Sensors, Stanford University."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ojeda, F.C., Bisulco, A., Kepple, D., Isler, V., and Lee, D.D. (2020, January 25\u201328). On-Device Event Filtering with Binary Neural Networks for pedestrian Detection Using Neuromorphic Vision Sensors. Proceedings of the 2020 IEEE International Conference on Image Processing (icip), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICIP40778.2020.9191148"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, C., Longinotti, L., Corradi, F., and Delbruck, T. (2019, January 9\u201314). A 132 by 104 10 \u03bcm-Pixel 250 \u03bcW 1kefps Dynamic Vision Sensor with Pixel-Parallel Noise and Spatial Redundancy Suppression. Proceedings of the 2019 Symposium on VLSI Circuits, Kyoto, Japan.","DOI":"10.23919\/VLSIC.2019.8778050"},{"key":"ref_30","unstructured":"Delbruck, T. (2008, January 6\u20137). Frame-Free Dynamic Digital Vision. Proceedings of the International Symposium on Secure-Life Electronics, Advanced Electronics for Quality Life and Society, Tokyo, Japan."},{"key":"ref_31","first-page":"15","article-title":"O(N)-Space Spatiotemporal Filter for Reducing Noise in Neuromorphic Vision Sensors","volume":"9","author":"Khodamoradi","year":"2018","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Delbruck, T., Pfeiffer, M., Juston, R., Orchard, G., M\u00fcggler, E., Linares-Barranco, A., and Tilden, M. (2015, January 24\u201327). Human vs. Computer Slot Car Racing Using an Event and Frame-Based DAVIS Vision Sensor. Proceedings of the 2015 IEEE International Symposium on Circuits and Systems (ISCAS), Lisbon, Portugal.","DOI":"10.1109\/ISCAS.2015.7169170"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Czech, D., and Orchard, G. (2016, January 26\u201329). Evaluating Noise Filtering for Event-Based Asynchronous Change Detection Image Sensors. Proceedings of the 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), Singapore.","DOI":"10.1109\/BIOROB.2016.7523452"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1109\/JPROC.2014.2347355","article-title":"Asynchronous neuromorphic event-driven image filtering","volume":"102","author":"Ieng","year":"2014","journal-title":"Proc. IEEE"},{"key":"ref_35","unstructured":"Afshar, S. (2020). High Speed Event-Based Visual Processing in the Presence of Noise. [Ph.D. Thesis, Western Sydney University]."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Feng, Y., Lv, H., Liu, H., Zhang, Y., Xiao, Y., and Han, C. (2020). Event density based denoising method for dynamic vision sensor. Appl. Sci., 10.","DOI":"10.3390\/app10062024"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1109\/TPAMI.2022.3152999","article-title":"Low cost and latency event camera background activity denoising","volume":"45","author":"Guo","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, Z., Yuan, D., Ng, Y., and Mahony, R. (2022, January 23\u201327). A Linear Comb Filter for Event Flicker Removal. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812003"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Duan, P., Wang, Z.W., Zhou, X., Ma, Y., and Shi, B. (2021, January 20\u201325). EventZoom: Learning to Denoise and Super Resolve Neuromorphic Events. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01263"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2519","DOI":"10.1109\/TPAMI.2022.3172212","article-title":"Time-ordered recent event (TORE) volumes for event cameras","volume":"45","author":"Baldwin","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Baldwin, R., Almatrafi, M., Asari, V., and Hirakawa, K. (2020, January 13\u201319). Event Probability Mask (epm) and Event Denoising Convolutional Neural Network (edncnn) for Neuromorphic Cameras. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00177"},{"key":"ref_42","unstructured":"Koller, D., and Friedman, N. (2009). Probabilistic Graphical Models: Principles and Techniques, MIT Press."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1177\/0278364917691115","article-title":"The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAM","volume":"36","author":"Mueggler","year":"2017","journal-title":"Int. J. Robot. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/15\/6655\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:18:30Z","timestamp":1760127510000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/15\/6655"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,25]]},"references-count":43,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23156655"],"URL":"https:\/\/doi.org\/10.3390\/s23156655","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,7,25]]}}}