{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T13:15:48Z","timestamp":1778246148441,"version":"3.51.4"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62202204"],"award-info":[{"award-number":["62202204"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["JUSRP123032"],"award-info":[{"award-number":["JUSRP123032"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2026,4,30]]},"abstract":"<jats:p>\n                    With the explosive growth of video data, video moment retrieval (VMR) has attracted increasing attention due to its ability to localize semantically relevant moments in untrimmed videos. However, existing VMR approaches usually rely on annotated video-text correspondences or temporal annotations, both of which require significant human effort and are costly to scale. Even worse, the inherent subjectivity in manual labeling often introduces inconsistencies into the training data, further complicating the issue. In this article, we investigate the problem of Zero-Shot Video Moment Retrieval (ZS-VMR) and develop a novel method, Resilient Semantic Pseudo-Text Modeling (RSPT). The core of RSPT is to construct semantically rich pseudo-text embeddings through visually guided perturbations. Specifically, RSPT first generates initial pseudo-texts by injecting random noise into visual features and then learns adaptive noise weights by modeling the correlations between these pseudo-texts and visual features. This enables the generation of diverse and semantically aligned representations from multiple perspectives. To ensure alignment with visual semantics and suppress irrelevant noise, RSPT introduces a quality-aware contrastive loss that regularizes the semantic boundaries of pseudo-texts. Extensive experiments on Charades-STA and ActivityNet-Captions show that RSPT outperforms existing competitive baselines, validating its efficacy. Code is available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/dmcsy\/RSPT\">https:\/\/github.com\/dmcsy\/RSPT<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3796721","type":"journal-article","created":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T15:42:37Z","timestamp":1770738157000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Resilient Semantic Pseudo-Text Embedding for Zero-Shot Video Moment Retrieval"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0716-0918","authenticated-orcid":false,"given":"Donglin","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China and Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, Guildford, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-6242-7970","authenticated-orcid":false,"given":"Weixiang","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0199-5001","authenticated-orcid":false,"given":"Xiao-Jun","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8110-9205","authenticated-orcid":false,"given":"Josef","family":"Kittler","sequence":"additional","affiliation":[{"name":"Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, Guildford, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,3,23]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"2917","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Buch Shyamal","year":"2022","unstructured":"Shyamal Buch, Crist\u00f3bal Eyzaguirre, Adrien Gaidon, Jiajun Wu, Li Fei-Fei, and Juan Carlos Niebles. 2022. Revisiting the \u201cvideo\u201d in video-language understanding. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2917\u20132927."},{"key":"e_1_3_1_3_2","first-page":"193","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV \u201918)","author":"Cai Sijia","year":"2018","unstructured":"Sijia Cai, Wangmeng Zuo, Larry S. Davis, and Lei Zhang. 2018. Weakly-supervised video summarization using variational encoder-decoder and web prior. In Proceedings of the European Conference on Computer Vision (ECCV \u201918), 193\u2013210."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.502"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3532078"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.563"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3075470"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.2307\/2346830"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.618"},{"key":"e_1_3_1_10_2","first-page":"2166","volume-title":"Proceedings of the 38th AAAI Conference on Artificial Intelligence,","volume":"38","author":"Holla Meghana","year":"2024","unstructured":"Meghana Holla and Ismini Lourentzou. 2024. Commonsense for zero-shot natural language video localization. In Proceedings of the 38th AAAI Conference on Artificial Intelligence, Vol. 38, 2166\u20132174."},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1145\/3589335.3651942","volume-title":"Companion Proceedings of the ACM Web Conference 2024","author":"Ji Wei","year":"2024","unstructured":"Wei Ji, Ruiqi Shi, Yinwei Wei, Shanshan Zhao, and Roger Zimmermann. 2024. Weakly supervised video moment retrieval via location-irrelevant proposal learning. In Companion Proceedings of the ACM Web Conference 2024, 1595\u20131603."},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2024.3396272"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3612394"},{"key":"e_1_3_1_14_2","first-page":"2539","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Kim Dahye","year":"2023","unstructured":"Dahye Kim, Jungin Park, Jiyoung Lee, Seongheon Park, and Kwanghoon Sohn. 2023. Language-free training for zero-shot video grounding. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, 2539\u20132548."},{"key":"e_1_3_1_15_2","first-page":"2795","volume-title":"Proceedings of the 38th AAAI Conference on Artificial Intelligence","volume":"38","author":"Kim Sunoh","year":"2024","unstructured":"Sunoh Kim, Jungchan Cho, Joonsang Yu, YoungJoon Yoo, and Jin Young Choi. 2024. Gaussian mixture proposals with pull-push learning scheme to capture diverse events for weakly supervised temporal video grounding. In Proceedings of the 38th AAAI Conference on Artificial Intelligence, Vol. 38, 2795\u20132803."},{"key":"e_1_3_1_16_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980. Retrieved from https:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.83"},{"key":"e_1_3_1_18_2","unstructured":"Jie Lei Tamara L. Berg and Mohit Bansal. 2021. QVHighlights: Detecting moments and highlights in videos via natural language queries. arXiv:2107.09609. Retrieved from https:\/\/arxiv.org\/abs\/2107.09609"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01263"},{"key":"e_1_3_1_20_2","first-page":"65948","article-title":"MomentDiff: Generative video moment retrieval from random to real","volume":"36","author":"Li Pandeng","year":"2023","unstructured":"Pandeng Li, Chen-Wei Xie, Hongtao Xie, Liming Zhao, Lei Zhang, Yun Zheng, Deli Zhao, and Yongdong Zhang. 2023. MomentDiff: Generative video moment retrieval from random to real. Advances in Neural Information Processing Systems 36, (2023), 65948\u201365966.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i2.20060"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3441577"},{"key":"e_1_3_1_23_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv:1907.11692. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2024.3365249"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01082"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00150"},{"issue":"2","key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3429457","article-title":"Interactive search vs. automatic search: An extensive study on video retrieval","volume":"17","author":"Nguyen Phuong-Anh","year":"2021","unstructured":"Phuong-Anh Nguyen and Chong-Wah Ngo. 2021. Interactive search vs. automatic search: An extensive study on video retrieval. ACM Transactions on Multimedia Computing, Communications, and Applications 17, 2 (2021), 1\u201324.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_28_2","unstructured":"Aaron van den Oord Yazhe Li and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv:1807.03748. Retrieved from https:\/\/arxiv.org\/abs\/1807.03748"},{"key":"e_1_3_1_29_2","first-page":"91","volume-title":"Proceedings of the 29th International Conference on Neural Information Processing Systems (NIPS \u201915)","volume":"1","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Proceedings of the 29th International Conference on Neural Information Processing Systems (NIPS \u201915), Vol. 1, 91\u201399."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW54120.2021.00361"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548004"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664647.3680774"},{"key":"e_1_3_1_34_2","first-page":"6575","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wang Lan","year":"2023","unstructured":"Lan Wang, Gaurav Mittal, Sandra Sajeev, Ye Yu, Matthew Hall, Vishnu Naresh Boddeti, and Mei Chen. 2023. Protege: Untrimmed pretraining for video temporal grounding by video temporal grounding. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 6575\u20136585."},{"key":"e_1_3_1_35_2","first-page":"2613","volume-title":". In Proceedings of the AAAI Conference on Artificial Intelligence","volume":"36","author":"Wang Zhenzhi","year":"2022","unstructured":"Zhenzhi Wang, Limin Wang, Tao Wu, Tianhao Li, and Gangshan Wu. 2022. Negative sample matters: A renaissance of metric learning for temporal grounding. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36, 2613\u20132623."},{"issue":"3","key":"e_1_3_1_36_2","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1007\/s13735-024-00335-7","article-title":"LSECA: Local semantic enhancement and cross aggregation for video-text retrieval","volume":"13","author":"Wang Zhiwen","year":"2024","unstructured":"Zhiwen Wang, Donglin Zhang, and Zhikai Hu. 2024. LSECA: Local semantic enhancement and cross aggregation for video-text retrieval. International Journal of Multimedia Information Retrieval 13, 3 (2024), 30.","journal-title":"International Journal of Multimedia Information Retrieval"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01249"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3478025"},{"key":"e_1_3_1_39_2","doi-asserted-by":"crossref","first-page":"112145","DOI":"10.1016\/j.patcog.2025.112145","article-title":"HTVR: Hierarchical text-to-video retrieval based on relative similarity","volume":"171","author":"Zhang Donglin","year":"2025","unstructured":"Donglin Zhang, Zhiwen Wang, Zhikai Hu, and Xiao-Jun Wu. 2025. HTVR: Hierarchical text-to-video retrieval based on relative similarity. Pattern Recognition 171 (2025), 112145.","journal-title":"Pattern Recognition"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2021.108343"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3572032"},{"key":"e_1_3_1_42_2","first-page":"524","volume-title":"Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV \u201921)","author":"Zhang Donglin","year":"2021","unstructured":"Donglin Zhang, Xiao-Jun Wu, and Jun Yu. 2021. Discrete bidirectional matrix factorization hashing for zero-shot cross-media retrieval. In Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV \u201921). Springer, 524\u2013536."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3446774"},{"key":"e_1_3_1_44_2","first-page":"6543","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Zhang Hao","unstructured":"Hao Zhang, Aixin Sun, Wei Jing, and Joey Tianyi Zhou. 2020. Span-based localizing network for natural language video localization. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 6543\u20136554."},{"key":"e_1_3_1_45_2","doi-asserted-by":"crossref","unstructured":"Ke Zhang Wei-Lun Chao Fei Sha and Kristen Grauman. 2016. Video summarization with long short-term memory. arXiv:1605.08110. Retrieved from https:\/\/arxiv.org\/abs\/1605.08110","DOI":"10.1007\/978-3-319-46478-7_47"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i07.6984"},{"key":"e_1_3_1_47_2","first-page":"3517","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"36","author":"Zheng Minghang","year":"2022","unstructured":"Minghang Zheng, Yanjie Huang, Qingchao Chen, and Yang Liu. 2022. Weakly supervised video moment localization with contrastive negative sample mining. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36, 3517\u20133525."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01511"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3796721","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T15:52:05Z","timestamp":1774281125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3796721"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,23]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,4,30]]}},"alternative-id":["10.1145\/3796721"],"URL":"https:\/\/doi.org\/10.1145\/3796721","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,23]]},"assertion":[{"value":"2025-07-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}