{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,28]],"date-time":"2025-05-28T04:16:54Z","timestamp":1748405814122,"version":"3.41.0"},"publisher-location":"Cham","reference-count":37,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031924590","type":"print"},{"value":"9783031924606","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T00:00:00Z","timestamp":1747008000000},"content-version":"vor","delay-in-days":131,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>In this paper we introduce a novel event surface representation designed for encoding temporal information of dynamic vision sensors (DVS) into a multi-channel frame format. Different representations have been proposed to extract features from event streams.<\/jats:p>\n          <jats:p>Among these representations, time surfaces have become a popular choice due to their ability to provide a flattened view of event data over a specified time interval. Despite their widespread adaption, these methods suffer from loss of crucial temporal information. This disadvantage is particularly apparent in DVS applications with repetitive, high-frequency intensity changes, as these signals result in continuously elevated event rates and would therefore benefit from efficient, yet information preserving representations. Moreover, integrating this information into state-of-the-art vision-based machine learning models remains challenging. To address these limitations, we propose Spectral frame Representation of Periodic Events (S-ROPE) which leverages information from frequency domain analysis through the application of the Fourier transformation and arranges the resulting frequency, amplitude and phase into spatially consistent frames. By transforming event streams from the temporal domain to the frequency domain, we demonstrate improved preservation of temporal dynamics, especially for objects displaying high frequency oscillations. We evaluate S-ROPE frames on custom and several publicly available datasets and demonstrate the applicability for three distinct use cases: visualisation, compression and machine learning-based image processing. For the latter, we show that S-ROPE proves useful for object detection in a scenery with high frequency events.<\/jats:p>","DOI":"10.1007\/978-3-031-92460-6_19","type":"book-chapter","created":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T16:37:04Z","timestamp":1748363824000},"page":"307-324","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["S-ROPE: Spectral Frame Representation of\u00a0Periodic Events"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1659-2306","authenticated-orcid":false,"given":"Luis Garcia","family":"Rodriguez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-4610-5879","authenticated-orcid":false,"given":"Jonas","family":"Konrad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8975-1844","authenticated-orcid":false,"given":"Dominik","family":"Drees","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5691-4029","authenticated-orcid":false,"given":"Benjamin","family":"Risse","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,12]]},"reference":[{"key":"19_CR1","unstructured":"Afshar, S., Nicholson, A.P., van Schaik, A., Cohen, G.: Event-based object detection and tracking for space situational awareness (2019). https:\/\/arxiv.org\/abs\/1911.08730"},{"key":"19_CR2","doi-asserted-by":"publisher","unstructured":"Baldwin, R.W., Almatrafi, M., Kaufman, J.R., Asari, V., Hirakawa, K.: Inceptive Event Time-Surfaces for Object Classification Using Neuromorphic Cameras, pp. 395\u2013403. Springer International Publishing (2019). https:\/\/doi.org\/10.1007\/978-3-030-27272-2_35","DOI":"10.1007\/978-3-030-27272-2_35"},{"key":"19_CR3","doi-asserted-by":"crossref","unstructured":"Banerjee, S., Wang, Z.W., Chopp, H.H., Cossairt, O., Katsaggelos, A.: Lossy event compression based on image-derived quad trees and poisson disk sampling (2020). https:\/\/arxiv.org\/abs\/2005.00974","DOI":"10.1109\/ICIP42928.2021.9506546"},{"key":"19_CR4","doi-asserted-by":"crossref","unstructured":"Barchid, S., Mennesson, J., Dj\u00e9raba, C.: Bina-rep event frames: a simple and effective representation for event-based cameras. In: 2022 IEEE International Conference on Image Processing (ICIP), pp. 3998\u20134002. IEEE (2022)","DOI":"10.1109\/ICIP46576.2022.9898061"},{"key":"19_CR5","doi-asserted-by":"publisher","unstructured":"Bardow, P., Davison, A.J., Leutenegger, S.: Simultaneous optical flow and intensity estimation from an event camera. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 884\u2013892 (2016). https:\/\/doi.org\/10.1109\/CVPR.2016.102","DOI":"10.1109\/CVPR.2016.102"},{"key":"19_CR6","doi-asserted-by":"crossref","unstructured":"Deng, Y., Chen, H., Liu, H., Li, Y.: A voxel graph cnn for object classification with event cameras. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1172\u20131181, June 2022","DOI":"10.1109\/CVPR52688.2022.00124"},{"key":"19_CR7","doi-asserted-by":"publisher","unstructured":"Freeman, A.C., Mayer-Patel, K.: Lossy compression for integrating event cameras. In: 2021 Data Compression Conference (DCC), pp. 53\u201362 (2021). https:\/\/doi.org\/10.1109\/DCC50243.2021.00013","DOI":"10.1109\/DCC50243.2021.00013"},{"issue":"1","key":"19_CR8","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/TPAMI.2020.3008413","volume":"44","author":"G Gallego","year":"2022","unstructured":"Gallego, G.: Event-based vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44(1), 154\u2013180 (2022). https:\/\/doi.org\/10.1109\/TPAMI.2020.3008413","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"19_CR9","doi-asserted-by":"crossref","unstructured":"Gebauer, E., Thiele, S., Ouvrard, P., Sicard, A., Risse, B.: Towards a dynamic vision sensor-based insect camera trap. In: Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 7157\u20137166, January 2024","DOI":"10.1109\/WACV57701.2024.00700"},{"key":"19_CR10","doi-asserted-by":"publisher","unstructured":"Gehrig, D., Loquercio, A., Derpanis, K., Scaramuzza, D.: End-to-end learning of representations for asynchronous event-based data. In: 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 5632\u20135642. IEEE, Seoul, Korea (South), October 2019. https:\/\/doi.org\/10.1109\/ICCV.2019.00573, https:\/\/ieeexplore.ieee.org\/document\/9009469\/","DOI":"10.1109\/ICCV.2019.00573"},{"key":"19_CR11","doi-asserted-by":"publisher","unstructured":"Giurgiutiu, V.: 17 - structural health monitoring (shm) of aerospace composites. In: Irving, P., Soutis, C. (eds.) Polymer Composites in the Aerospace Industry (Second Edition), pp. 491\u2013558. Woodhead Publishing Series in Composites Science and Engineering, Woodhead Publishing, 2nd edn. (2020). https:\/\/doi.org\/10.1016\/B978-0-08-102679-3.00017-4, https:\/\/www.sciencedirect.com\/science\/article\/pii\/B9780081026793000174","DOI":"10.1016\/B978-0-08-102679-3.00017-4"},{"key":"19_CR12","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/s11831-015-9145-0","volume":"23","author":"D Goyal","year":"2016","unstructured":"Goyal, D., Pabla, B.: The vibration monitoring methods and signal processing techniques for structural health monitoring: a review. Archives Comput. Methods Eng. 23, 585\u2013594 (2016)","journal-title":"Archives Comput. Methods Eng."},{"key":"19_CR13","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770\u2013778 (2016)","DOI":"10.1109\/CVPR.2016.90"},{"issue":"6","key":"19_CR14","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1177\/0309133317738163","volume":"41","author":"A Kirmse","year":"2017","unstructured":"Kirmse, A., de Ferranti, J.: Calculating the prominence and isolation of every mountain in the world. Prog. Phys. Geogr. 41(6), 788\u2013802 (2017)","journal-title":"Prog. Phys. Geogr."},{"issue":"7","key":"19_CR15","doi-asserted-by":"publisher","first-page":"1346","DOI":"10.1109\/TPAMI.2016.2574707","volume":"39","author":"X Lagorce","year":"2017","unstructured":"Lagorce, X., Orchard, G., Galluppi, F., Shi, B.E., Benosman, R.B.: Hots: a hierarchy of event-based time-surfaces for pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(7), 1346\u20131359 (2017). https:\/\/doi.org\/10.1109\/TPAMI.2016.2574707","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"19_CR16","doi-asserted-by":"publisher","unstructured":"Li, X., Guan, Y., Law, S., Zhao, W.: Monitoring abnormal vibration and structural health conditions of an in-service structure from its shm data. J. Sound Vib. 537, 117185 (2022). https:\/\/doi.org\/10.1016\/j.jsv.2022.117185, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022460X22003819","DOI":"10.1016\/j.jsv.2022.117185"},{"issue":"7","key":"19_CR17","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1007\/s11837-012-0370-9","volume":"64","author":"Y Liu","year":"2012","unstructured":"Liu, Y., Nayak, S.: Structural health monitoring: state of the art and perspectives. JOM 64(7), 789\u2013792 (2012)","journal-title":"JOM"},{"key":"19_CR18","doi-asserted-by":"publisher","unstructured":"Lv, Y., Zhou, L., Liu, Z., Zhang, H.: Structural vibration frequency monitoring based on event camera. Measur. Sci. Technol. 35(8), 085007 (2024). https:\/\/doi.org\/10.1088\/1361-6501\/ad42bf, https:\/\/dx.doi.org\/10.1088\/1361-6501\/ad42bf","DOI":"10.1088\/1361-6501\/ad42bf"},{"key":"19_CR19","doi-asserted-by":"crossref","unstructured":"Manderscheid, J., Sironi, A., Bourdis, N., Migliore, D., Lepetit, V.: Speed invariant time surface for learning to detect corner points with event-based cameras (2019)","DOI":"10.1109\/CVPR.2019.01049"},{"key":"19_CR20","doi-asserted-by":"publisher","unstructured":"Maqueda, A.I., Loquercio, A., Gallego, G., Garcia, N., Scaramuzza, D.: Event-based vision meets deep learning on steering prediction for self-driving cars. In: 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 5419\u20135427. IEEE, Salt Lake City, UT, June 2018. https:\/\/doi.org\/10.1109\/CVPR.2018.00568, https:\/\/ieeexplore.ieee.org\/document\/8578666\/","DOI":"10.1109\/CVPR.2018.00568"},{"key":"19_CR21","doi-asserted-by":"publisher","unstructured":"McReynolds, B., Gra\u00e7a, R., Delbruck, T.: Experimental methods to predict dynamic vision sensor event camera performance. Optical Eng. 61, July 2022. https:\/\/doi.org\/10.1117\/1.OE.61.7.074103","DOI":"10.1117\/1.OE.61.7.074103"},{"key":"19_CR22","doi-asserted-by":"crossref","unstructured":"Peng, Y., Zhang, Y., Xiong, Z., Sun, X., Wu, F.: Get: Group event transformer for event-based vision. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 6038\u20136048 (2023)","DOI":"10.1109\/ICCV51070.2023.00555"},{"key":"19_CR23","first-page":"16639","volume":"33","author":"E Perot","year":"2020","unstructured":"Perot, E., De Tournemire, P., Nitti, D., Masci, J., Sironi, A.: Learning to detect objects with a 1 megapixel event camera. Adv. Neural. Inf. Process. Syst. 33, 16639\u201316652 (2020)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"19_CR24","unstructured":"Prophesee: Prophesee examples (2022). https:\/\/docs.prophesee.ai\/stable\/datasets.html. Accessed 12 June 2024"},{"key":"19_CR25","doi-asserted-by":"crossref","unstructured":"Sabater, A., Montesano, L., Murillo, A.C.: Event transformer. a sparse-aware solution for efficient event data processing. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 2677\u20132686 (2022)","DOI":"10.1109\/CVPRW56347.2022.00301"},{"key":"19_CR26","doi-asserted-by":"publisher","first-page":"1779","DOI":"10.1109\/LSP.2022.3196599","volume":"29","author":"I Schiopu","year":"2022","unstructured":"Schiopu, I., Bilcu, R.C.: Lossless compression of event camera frames. IEEE Signal Process. Lett. 29, 1779\u20131783 (2022). https:\/\/doi.org\/10.1109\/LSP.2022.3196599","journal-title":"IEEE Signal Process. Lett."},{"key":"19_CR27","doi-asserted-by":"crossref","unstructured":"Sironi, A., Brambilla, M., Bourdis, N., Lagorce, X., Benosman, R.: Hats: Histograms of averaged time surfaces for robust event-based object classification (2018)","DOI":"10.1109\/CVPR.2018.00186"},{"key":"19_CR28","doi-asserted-by":"crossref","unstructured":"Stumpp, D.C., Akolkar, H., George, A.D., Benosman, R.: Flow-based visual stream compression for event cameras (2024). https:\/\/arxiv.org\/abs\/2403.08086","DOI":"10.1109\/JIOT.2024.3450428"},{"key":"19_CR29","doi-asserted-by":"crossref","unstructured":"Sun, H., Dao, M.Q., Fremont, V.: 3D-FlowNet: Event-based optical flow estimation with 3D representation, January 2022. http:\/\/arxiv.org\/abs\/2201.12265, arXiv:2201.12265 [cs]","DOI":"10.1109\/IV51971.2022.9827380"},{"key":"19_CR30","doi-asserted-by":"publisher","unstructured":"Tang, Z., Yamazato, T., Arai, S.: A preliminary investigation for event camera-based visible light communication using the propeller-type rotary led transmitter. In: 2022 IEEE International Conference on Communications Workshops (ICC Workshops), pp. 646\u2013650 (2022). https:\/\/doi.org\/10.1109\/ICCWorkshops53468.2022.9814467","DOI":"10.1109\/ICCWorkshops53468.2022.9814467"},{"key":"19_CR31","doi-asserted-by":"crossref","unstructured":"Tapia, R., Mart\u00ednez-de Dios, J.R., Ollero, A.: efft: an event-based method for the efficient computation of exact fourier transforms. IEEE Trans. Pattern Anal. Mach. Intell. (2024)","DOI":"10.1109\/TPAMI.2024.3422209"},{"key":"19_CR32","doi-asserted-by":"publisher","unstructured":"Wang, L., Mostafavi, I.M., Ho, Y.S., Yoon, K.J.: Event-based high dynamic range image and very high frame rate video generation using conditional generative adversarial networks. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10073\u201310082 (2019). https:\/\/doi.org\/10.1109\/CVPR.2019.01032","DOI":"10.1109\/CVPR.2019.01032"},{"key":"19_CR33","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, Y., Yuan, J., Lu, Y.: Space-time event clouds for gesture recognition: from rgb cameras to event cameras. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1826\u20131835. IEEE (2019)","DOI":"10.1109\/WACV.2019.00199"},{"key":"19_CR34","unstructured":"Xie, B., Deng, Y., Shao, Z., Liu, H., Xu, Q., Li, Y.: Event voxel set transformer for spatiotemporal representation learning on event streams (2023). https:\/\/arxiv.org\/abs\/2303.03856"},{"key":"19_CR35","doi-asserted-by":"publisher","unstructured":"Zhao, M., Shen, X., Su, L., Dong, Z.: Power equipment vibration visualization using intelligent sensing method based on event-sensing principle. Global Energy Interconnection 7(2), 228\u2013240 (2024). https:\/\/doi.org\/10.1016\/j.gloei.2024.04.010. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2096511724000318","DOI":"10.1016\/j.gloei.2024.04.010"},{"key":"19_CR36","doi-asserted-by":"publisher","unstructured":"Zhu, A., Yuan, L., Chaney, K., Daniilidis, K.: Ev-flownet: self-supervised optical flow estimation for event-based cameras. In: Robotics: Science and Systems XIV. RSS2018, Robotics: Science and Systems Foundation, June 2018. https:\/\/doi.org\/10.15607\/rss.2018.xiv.062, http:\/\/dx.doi.org\/10.15607\/RSS.2018.XIV.062","DOI":"10.15607\/rss.2018.xiv.062"},{"key":"19_CR37","doi-asserted-by":"publisher","unstructured":"Zhu, A.Z., Yuan, L., Chaney, K., Daniilidis, K.: Unsupervised event-based learning of optical flow, depth, and egomotion. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 989\u2013997. IEEE, Long Beach, CA, USA, June 2019. https:\/\/doi.org\/10.1109\/CVPR.2019.00108, https:\/\/ieeexplore.ieee.org\/document\/8953979\/","DOI":"10.1109\/CVPR.2019.00108"}],"container-title":["Lecture Notes in Computer Science","Computer Vision \u2013 ECCV 2024 Workshops"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-92460-6_19","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T16:37:11Z","timestamp":1748363831000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-92460-6_19"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"ISBN":["9783031924590","9783031924606"],"references-count":37,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-92460-6_19","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025]]},"assertion":[{"value":"12 May 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECCV","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Computer Vision","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Milan","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"29 September 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"eccv2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/eccv2024.ecva.net\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}