{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T17:39:33Z","timestamp":1793727573662,"version":"4.6.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2025,5,22]],"date-time":"2025-05-22T00:00:00Z","timestamp":1747872000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2024YFB3311602"],"award-info":[{"award-number":["2024YFB3311602"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61971178, 62272144, and U20A20183"],"award-info":[{"award-number":["61971178, 62272144, and U20A20183"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Ordos Science and Technology Major","award":["JBGS-2023-002"],"award-info":[{"award-number":["JBGS-2023-002"]}]},{"name":"State Grid Co., Ltd. Headquarters Technology Project","award":["5500-202140127"],"award-info":[{"award-number":["5500-202140127"]}]},{"name":"Major Project of Anhui Province","award":["202423k09020001"],"award-info":[{"award-number":["202423k09020001"]}]},{"name":"Anhui Provincial Natural Science Foundation\u2014Distinguished Young Scholars Project","award":["2408085J040"],"award-info":[{"award-number":["2408085J040"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["JZ2024HGTG0309 and JZ2024AHST0337"],"award-info":[{"award-number":["JZ2024HGTG0309 and JZ2024AHST0337"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,5,31]]},"abstract":"<jats:p>The Audio-visual Classification (AVC) task aims to determine video categories by integrating audio and visual signals. Traditional methods for AVC leverage Artificial Neural Networks (ANNs) that operate on floating-point features, affording large parameter counts and consuming extensive energy. Recent research has shifted towards brain-inspired Spiking Neural Networks (SNNs), which transmit audiovisual information through sparser 0\/1 spike features allowing for better energy efficiency. However, a byproduct of such sparsity is the increased difficulty in effectively encoding and utilizing these spike features. Moreover, the spike firing characteristics based on neuron membrane potential cause asynchronous spike activations due to the heterogeneous distributions of different modalities in the AVC task, resulting in cross-modal asynchronization. This issue is often overlooked by prior SNN models, resulting in lower classification accuracy compared to traditional ANN models. To address these challenges, we present a new Multimodal Interaction Spiking Network (MISNet), the first to successfully balance both accuracy and efficiency for the AVC task. As the core of MISNet, we propose a Multimodal Leaky Integrate-and-fire (MLIF) neuron, which coordinates and synchronizes the spike activations of audiovisual signals within a single neuron, distinguishing it from the prior paradigm of SNNs that relies on multiple separate processing neurons. As a result, our MISNet enables to generate audio and visual spiking features with effective cross-modal fusion. Additionally, we propose to add extra loss regularizations before fusing the obtained audio-visual features for final classification, thereby benefiting unimodal spiking learning for multimodal interaction. We evaluate our method on five audio-visual datasets, demonstrating advanced performance in both accuracy and energy consumption.<\/jats:p>","DOI":"10.1145\/3721981","type":"journal-article","created":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T16:04:03Z","timestamp":1741795443000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Towards Energy-efficient Audio-visual Classification via Multimodal Interactive Spiking Neural Network"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3149-1615","authenticated-orcid":false,"given":"Xu","family":"Liu","sequence":"first","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9502-5558","authenticated-orcid":false,"given":"Na","family":"Xia","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6402-7593","authenticated-orcid":false,"given":"Jinxing","family":"Zhou","sequence":"additional","affiliation":[{"name":"Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2227-8826","authenticated-orcid":false,"given":"Zhangbin","family":"Li","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2594-254X","authenticated-orcid":false,"given":"Dan","family":"Guo","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China and Hefei Comprehensive National Science Center, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,22]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"10998","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"38","author":"Bal Malyaban","year":"2024","unstructured":"Malyaban Bal and Abhronil Sengupta. 2024. SpikingBERT: Distilling BERT to train spiking language models using implicit differentiation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38, 10998\u201311006."},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2336244"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3487403"},{"key":"e_1_3_1_5_2","first-page":"34377","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"35","author":"Duan Chaoteng","year":"2022","unstructured":"Chaoteng Duan, Jianhao Ding, Shiyan Chen, Zhaofei Yu, and Tiejun Huang. 2022. Temporal effective batch normalization in spiking neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 35, 34377\u201334390."},{"key":"e_1_3_1_6_2","first-page":"5844","volume-title":"Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Eyben Florian","year":"2011","unstructured":"Florian Eyben, Stavros Petridis, Bj\u00f6rn Schuller, George Tzimiropoulos, Stefanos Zafeiriou, and Maja Pantic. 2011. Audiovisual classification of vocal outbursts in human conversation using long-short-term memory networks. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 5844\u20135847."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01918"},{"issue":"40","key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1126\/sciadv.adi1480","article-title":"Spikingjelly: An open-source machine learning infrastructure platform for spike-based intelligence","volume":"9","author":"Fang Wei","year":"2023","unstructured":"Wei Fang, Yanqi Chen, Jianhao Ding, Zhaofei Yu, Timoth\u00e9e Masquelier, Ding Chen, Liwei Huang, Huihui Zhou, Guoqi Li, and Yonghong Tian. 2023. Spikingjelly: An open-source machine learning infrastructure platform for spike-based intelligence. Science Advances 9, 40 (2023), 1480.","journal-title":"Science Advances"},{"key":"e_1_3_1_9_2","first-page":"21056","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"34","author":"Fang Wei","year":"2021","unstructured":"Wei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang, Timoth\u00e9e Masquelier, and Yonghong Tian. 2021. Deep residual learning in spiking neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 34, 21056\u201321069."},{"issue":"2","key":"e_1_3_1_10_2","first-page":"1","article-title":"Deepfake video detection via predictive representation learning","volume":"18","author":"Ge Shiming","year":"2022","unstructured":"Shiming Ge, Fanzhao Lin, Chenyu Li, Daichi Zhang, Weiping Wang, and Dan Zeng. 2022. Deepfake video detection via predictive representation learning. ACM Transactions on Multimedia Computing, Communications, and Applications 18, 2 (2022), 1\u201321.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"issue":"11","key":"e_1_3_1_11_2","first-page":"1551","article-title":"Mastering deepfake detection: A cutting-edge approach to distinguish GAN and diffusion-model images","volume":"20","author":"Guarnera Luca","year":"2024","unstructured":"Luca Guarnera, Oliver Giudice, and Sebastiano Battiato. 2024. Mastering deepfake detection: A cutting-edge approach to distinguish GAN and diffusion-model images. ACM Transactions on Multimedia Computing, Communications, and Applications 20, 11 (2024), 1551\u20136857.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"issue":"7","key":"e_1_3_1_12_2","first-page":"6238","volume":"34","author":"Guo Dan","year":"2024","unstructured":"Dan Guo, Kun Li, Bin Hu, Yan Zhang, and Meng Wang. 2024. Benchmarking micro-action recognition: Dataset, methods, and applications. IEEE Transactions on Circuits and Systems for Video Technology 34, 7 (2024), 6238\u20136252.","journal-title":"2024. Benchmarking micro-action recognition: Dataset, methods, and applications. IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2023.3327081"},{"key":"e_1_3_1_14_2","unstructured":"Ruohao Guo Xianghua Ying Yaru Chen Dantong Niu Guangyao Li Liao Qu Yanyu Qi Jinxing Zhou Bowei Xing Wenzhen Yue et al. 2023. Audio-visual instance segmentation. arXiv:2310.18709. Retrieved from https:\/\/arxiv.org\/abs\/2310.18709"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i11.29114"},{"key":"e_1_3_1_16_2","first-page":"156","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"35","author":"Guo Yufei","year":"2022","unstructured":"Yufei Guo, Yuanpei Chen, Liwen Zhang, Xiaode Liu, Yinglei Wang, Xuhui Huang, and Zhe Ma. 2022. IM-Loss: Information maximization loss for spiking neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 35, 156\u2013166."},{"key":"e_1_3_1_17_2","first-page":"36","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Guo YuFei","year":"2023","unstructured":"YuFei Guo, Yuanpei Chen, Liwen Zhang, YingLei Wang, Xiaode Liu, Xinyi Tong, Yuanyuan Ou, Xuhui Huang, and Zhe Ma. 2023. InfLoR-SNN: Reducing information loss for spiking neural networks. In Proceedings of the European Conference on Computer Vision, 36\u201352."},{"key":"e_1_3_1_18_2","first-page":"19420","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Guo Yufei","year":"2023","unstructured":"Yufei Guo, Yuhan Zhang, Yuanpei Chen, Weihang Peng, Xiaode Liu, Liwen Zhang, Xuhui Huang, and Zhe Ma. 2023. Membrane potential batch normalization for spiking neural networks. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 19420\u201319430."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_20_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Huang Yulong","year":"2024","unstructured":"Yulong Huang, Xiaopeng Lin, Hongwei Ren, Yue Zhou, Zunchang Liu, Haotian Fu, Biao Pan, and Bojun Cheng. 2024. CLIF: Complementary leaky integrate-and-fire neuron for spiking neural networks. In Proceedings of the International Conference on Machine Learning. Retrieved from https:\/\/openreview.net\/forum?id=yY6N89IlHa"},{"key":"e_1_3_1_21_2","first-page":"23426","volume-title":"Proceedings of the Advances in Neural Information Processing Systems, Vol","volume":"34","author":"Li Yuhang","year":"2021","unstructured":"Yuhang Li, Yufei Guo, Shanghang Zhang, Shikuang Deng, Yongqing Hai, and Shi Gu. 2021. Differentiable spike: Rethinking gradient-descent for training spiking neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 34, 23426\u201323439."},{"key":"e_1_3_1_22_2","first-page":"3306","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Li Zhangbin","year":"2024","unstructured":"Zhangbin Li, Dan Guo, Jinxing Zhou, Jing Zhang, and Meng Wang. 2024. Object-aware adaptive-positivity learning for audio-visual question answering. In Proceedings of the AAAI Conference on Artificial Intelligence, 3306\u20133314."},{"key":"e_1_3_1_23_2","unstructured":"Zhangbin Li Jinxing Zhou Jing Zhang Shengeng Tang Kun Li and Dan Guo. 2024. Patch-level sounding object tracking for audio-visual question answering. arXiv:2412.10749. Retrieved from https:\/\/arxiv.org\/abs\/2412.10749"},{"key":"e_1_3_1_24_2","first-page":"8922","volume-title":"Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Liu Qianhui","year":"2022","unstructured":"Qianhui Liu, Dong Xing, Lang Feng, Huajin Tang, and Gang Pan. 2022. Event-based multimodal spiking neural network with attention mechanism. In Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing, 8922\u20138926."},{"issue":"3","key":"e_1_3_1_25_2","first-page":"3003","article-title":"Entity-enhanced adaptive reconstruction network for weakly supervised referring expression grounding","volume":"45","author":"Liu Xuejing","year":"2023","unstructured":"Xuejing Liu, Liang Li, Shuhui Wang, Zheng-Jun Zha, Zechao Li, Qi Tian, and Qingming Huang. 2023. Entity-enhanced adaptive reconstruction network for weakly supervised referring expression grounding. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 3 (2023), 3003\u20133018.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(97)00011-7"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Yuxin Mao Xuyang Shen Jing Zhang Zhen Qin Jinxing Zhou Mochu Xiang Yiran Zhong and Yuchao Dai. 2024. TAVGBench: Benchmarking text to audible-video generation. arXiv:2404.14381. Retrieved from https:\/\/arxiv.org\/abs\/2404.14381","DOI":"10.1145\/3664647.3680612"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-021-04362-w"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01212"},{"key":"e_1_3_1_30_2","first-page":"14200","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"34","author":"Nagrani Arsha","year":"2021","unstructured":"Arsha Nagrani, Shan Yang, Anurag Arnab, Aren Jansen, Cordelia Schmid, and Chen Sun. 2021. Attention bottlenecks for multimodal fusion. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 34, 14200\u201314213."},{"issue":"2","key":"e_1_3_1_31_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3588571","article-title":"Self-supervised learning of depth and ego-motion for 3D perception in human computer interaction","volume":"20","author":"Qiao Shanbao","year":"2023","unstructured":"Shanbao Qiao, Neal N. Xiong, Yongbin Gao, Zhijun Fang, Wenjun Yu, Juan Zhang, and Xiaoyan Jiang. 2023. Self-supervised learning of depth and ego-motion for 3D perception in human computer interaction. ACM Transactions on Multimedia Computing, Communications and Applications 20, 2 (2023), 1\u201321.","journal-title":"ACM Transactions on Multimedia Computing, Communications and Applications"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1677-2"},{"key":"e_1_3_1_33_2","first-page":"10585","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Shen Xuyang","year":"2023","unstructured":"Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, et al. 2023. Fine-grained audible video description. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 10585\u201310596."},{"key":"e_1_3_1_34_2","first-page":"5610","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Shi Xinyu","year":"2024","unstructured":"Xinyu Shi, Zecheng Hao, and Zhaofei Yu. 2024. SpikingResformer: Bridging ResNet and vision transformer in spiking neural networks. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 5610\u20135619."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01216-8_16"},{"key":"e_1_3_1_36_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Tsai Yao-Hung Hubert","year":"2018","unstructured":"Yao-Hung Hubert Tsai, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2018. Learning factorized multimodal representations. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=rygqqsA9KX"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2024.3365104"},{"issue":"11","key":"e_1_3_1_38_2","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Van der Maaten Laurens","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 11 (2008), 2579\u20132605.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_1_39_2","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 30."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3226328"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3566126"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33011311"},{"key":"e_1_3_1_43_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Xiao Xiongye","year":"2024","unstructured":"Xiongye Xiao, Gengshuo Liu, Gaurav Gupta, Defu Cao, Shixuan Li, Yaxing Li, Tianqing Fang, Mingxi Cheng, and Paul Bogdan. 2024. Neuro-inspired information-theoretic hierarchical perception for multimodal learning. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=Z9AZsU1Tju"},{"key":"e_1_3_1_44_2","first-page":"1","article-title":"Learning hierarchical visual transformation for domain generalizable visual matching and recognition","volume":"132","author":"Yang Xun","year":"2024","unstructured":"Xun Yang, Tianyu Chang, Tianzhu Zhang, Shanshan Wang, Richang Hong, and Meng Wang. 2024. Learning hierarchical visual transformation for domain generalizable visual matching and recognition. International Journal of Computer Vision 132 (2024), 1\u201327.","journal-title":"International Journal of Computer Vision"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2022.3140611"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-023-4084-6"},{"key":"e_1_3_1_47_2","first-page":"64043","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"36","author":"Yao Man","year":"2023","unstructured":"Man Yao, Jiakui Hu, Zhaokun Zhou, Li Yuan, Yonghong Tian, Bo Xu, and Guoqi Li. 2023. Spike-driven transformer. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 36, 64043\u201364058."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3241201"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2023.3293335"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2024.3432099"},{"key":"e_1_3_1_51_2","first-page":"27456","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Zhang Xiaohui","year":"2024","unstructured":"Xiaohui Zhang, Jaehong Yoon, Mohit Bansal, and Huaxiu Yao. 2024. Multimodal representation learning by alternating unimodal adaptation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 27456\u201327466."},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2782-y"},{"issue":"1","key":"e_1_3_1_53_2","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1109\/TIV.2022.3173662","article-title":"Learning visual semantic map-matching for loosely multi-sensor fusion localization of autonomous vehicles","volume":"8","author":"Zhang Zhihuang","year":"2022","unstructured":"Zhihuang Zhang, Jintao Zhao, Changyao Huang, and Liang Li. 2022. Learning visual semantic map-matching for loosely multi-sensor fusion localization of autonomous vehicles. IEEE Transactions on Intelligent Vehicles 8, 1 (2022), 358\u2013367.","journal-title":"IEEE Transactions on Intelligent Vehicles"},{"key":"e_1_3_1_54_2","unstructured":"Pengcheng Zhao Jinxing Zhou Dan Guo Yang Zhao and Yanxiang Chen. 2024. Multimodal class-aware semantic enhancement network for audio-visual video parsing. arXiv:2412.11248. Retrieved from https:\/\/arxiv.org\/abs\/2412.11248"},{"key":"e_1_3_1_55_2","unstructured":"Jinxing Zhou Dan Guo Ruohao Guo Yuxin Mao Jingjing Hu Yiran Zhong Xiaojun Chang and Meng Wang. 2024. Towards open-vocabulary audio-visual event localization. arXiv:2411.11278. Retrieved from https:\/\/arxiv.org\/abs\/2411.11278"},{"key":"e_1_3_1_56_2","first-page":"1","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Zhou Jinxing","year":"2024","unstructured":"Jinxing Zhou, Dan Guo, Yuxin Mao, Yiran Zhong, Xiaojun Chang, and Meng Wang. 2024. Label-anticipated event disentanglement for audio-visual video parsing. In Proceedings of the European Conference on Computer Vision, 1\u201322."},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3223688"},{"key":"e_1_3_1_58_2","first-page":"1","article-title":"Advancing weakly-supervised audio-visual video parsing via segment-wise pseudo labeling","volume":"132","author":"Zhou Jinxing","year":"2024","unstructured":"Jinxing Zhou, Dan Guo, Yiran Zhong, and Meng Wang. 2024. Advancing weakly-supervised audio-visual video parsing via segment-wise pseudo labeling. International Journal of Computer Vision 132 (2024), 1\u201322.","journal-title":"International Journal of Computer Vision"},{"key":"e_1_3_1_59_2","unstructured":"Jinxing Zhou Xuyang Shen Jianyuan Wang Jiayi Zhang Weixuan Sun Jing Zhang Stan Birchfield Dan Guo Lingpeng Kong Meng Wang et al. 2023. Audio-visual segmentation with semantics. arXiv:2301.13190. Retrieved from https:\/\/arxiv.org\/abs\/2301.13190"},{"key":"e_1_3_1_60_2","first-page":"386","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Zhou Jinxing","year":"2022","unstructured":"Jinxing Zhou, Jianyuan Wang, Jiayi Zhang, Weixuan Sun, Jing Zhang, Stan Birchfield, Dan Guo, Lingpeng Kong, Meng Wang, and Yiran Zhong. 2022. Audio-visual segmentation. In Proceedings of the European Conference on Computer Vision, 386\u2013403."},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00833"},{"key":"e_1_3_1_62_2","unstructured":"Ziheng Zhou Jinxing Zhou Wei Qian Shengeng Tang Xiaojun Chang and Dan Guo. 2024. Dense audio-visual event localization under cross-modal consistency and multi-temporal granularity collaboration. arXiv:2412.12628. Retrieved from https:\/\/arxiv.org\/abs\/2412.12628"},{"key":"e_1_3_1_63_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Zhou Zhaokun","year":"2023","unstructured":"Zhaokun Zhou, Yuesheng Zhu, Chao He, Yaowei Wang, Shuicheng Yans, Yonghong Tian, and Li Yuan. 2023. Spikformer: When spiking neural network meets transformer. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=frE4fUwz_h"},{"key":"e_1_3_1_64_2","first-page":"65366","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","volume":"36","author":"Zhu Yaoyu","year":"2023","unstructured":"Yaoyu Zhu, Wei Fang, Xiaodong Xie, Tiejun Huang, and Zhaofei Yu. 2023. Exploring loss functions for time-based training strategy in spiking neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 36, 65366\u201365379."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721981","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3721981","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:48Z","timestamp":1750295388000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721981"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,22]]},"references-count":63,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5,31]]}},"alternative-id":["10.1145\/3721981"],"URL":"https:\/\/doi.org\/10.1145\/3721981","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,22]]},"assertion":[{"value":"2024-11-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}