{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T23:47:32Z","timestamp":1768348052879,"version":"3.49.0"},"reference-count":93,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2022,9,30]],"date-time":"2022-09-30T00:00:00Z","timestamp":1664496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62201072, 62101064, 62071067, 62171057, 62001054"],"award-info":[{"award-number":["62201072, 62101064, 62071067, 62171057, 62001054"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Ministry of Education and China Mobile Joint Fund","award":["MCM20200202"],"award-info":[{"award-number":["MCM20200202"]}]},{"name":"Beijing University of Posts and Telecommunications-China Mobile Research Institute Joint Innovation Center"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Text-to-video temporal grounding aims to locate a target video moment that semantically corresponds to the given sentence query in an untrimmed video. In this task, fully supervised works require text descriptions for each event along with its temporal segment coordinate for training, which is labor-consuming. Existing weakly supervised works require only video-sentence pairs but cannot achieve satisfactory performance. However, many available annotations in the form of coarse temporal boundaries for sentences are ignored and unexploited. These coarse boundaries are common in streaming media platform and can be collected in a mechanical manner. We propose a novel approach to perform fine-grained text-to-video temporal grounding from these coarse boundaries. We take dense video captioning as base task and leverage the trained captioning model to identify the relevance of each video frame to the sentence query according to the frame participation in event captioning. To quantify the frame participation in event captioning, we propose<jats:italic>event activation sequence<\/jats:italic>, a simple method that highlights the temporal regions which have high correlations to the text modality in videos. Experiments on modified ActivityNet Captions and a use case demonstrate the promising fine-grained performance of our approach.<\/jats:p>","DOI":"10.1145\/3579825","type":"journal-article","created":{"date-parts":[[2023,1,12]],"date-time":"2023-01-12T15:58:54Z","timestamp":1673539134000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Fine-Grained Text-to-Video Temporal Grounding from Coarse Boundary"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6842-4721","authenticated-orcid":false,"given":"Jiachang","family":"Hao","sequence":"first","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3072-7422","authenticated-orcid":false,"given":"Haifeng","family":"Sun","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1691-6457","authenticated-orcid":false,"given":"Pengfei","family":"Ren","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6175-2391","authenticated-orcid":false,"given":"Yiming","family":"Zhong","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2182-2228","authenticated-orcid":false,"given":"Jingyu","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0829-4624","authenticated-orcid":false,"given":"Qi","family":"Qi","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1486-0573","authenticated-orcid":false,"given":"Jianxin","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Haidian District, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,3,16]]},"reference":[{"key":"e_1_3_2_2_2","article-title":"Layer normalization","volume":"1607","author":"Ba Lei Jimmy","year":"2016","unstructured":"Lei Jimmy Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer normalization. CoRR abs\/1607.06450 (2016).","journal-title":"CoRR"},{"key":"e_1_3_2_3_2","first-page":"65","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization. 65\u201372."},{"key":"e_1_3_2_4_2","first-page":"9810","volume-title":"EMNLP","author":"Cao Meng","year":"2021","unstructured":"Meng Cao, Long Chen, Mike Zheng Shou, Can Zhang, and Yuexian Zou. 2021. On pursuit of designing multi-modal transformer for video grounding. In EMNLP. 9810\u20139823."},{"key":"e_1_3_2_5_2","volume-title":"EMNLP","author":"Chen Jingyuan","year":"2018","unstructured":"Jingyuan Chen, Xinpeng Chen, Lin Ma, Zequn Jie, and Tat-Seng Chua. 2018. Temporally grounding natural sentence in video. In EMNLP."},{"key":"e_1_3_2_6_2","article-title":"Retrieval augmented convolutional encoder-decoder networks for video captioning","author":"Chen Jingwen","year":"2022","unstructured":"Jingwen Chen, Yingwei Pan, Yehao Li, Ting Yao, Hongyang Chao, and Tao Mei. 2022. Retrieval augmented convolutional encoder-decoder networks for video captioning. ACM Trans. Multimedia Comput. Commun. Appl. (2022).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i07.6627"},{"key":"e_1_3_2_8_2","volume-title":"ECCV","author":"Chen Shaoxiang","year":"2020","unstructured":"Shaoxiang Chen, Wenhao Jiang, Wei Liu, and Yu-Gang Jiang. 2020. Learning modality interaction for temporal sentence localization and event captioning in videos. In ECCV."},{"key":"e_1_3_2_9_2","volume-title":"AAAI","author":"Chen Shaoxiang","year":"2019","unstructured":"Shaoxiang Chen and Yu-Gang Jiang. 2019. Semantic proposal for activity localization in videos via sentence query. In AAAI."},{"key":"e_1_3_2_10_2","volume-title":"ECCV","author":"Chen Shaoxiang","year":"2020","unstructured":"Shaoxiang Chen and Yu-Gang Jiang. 2020. Hierarchical visual-textual graph for temporal activity localization via language. In ECCV."},{"key":"e_1_3_2_11_2","article-title":"End-to-end multi-modal video temporal grounding","volume":"34","author":"Chen Yi-Wen","year":"2021","unstructured":"Yi-Wen Chen, Yi-Hsuan Tsai, and Ming-Hsuan Yang. 2021. End-to-end multi-modal video temporal grounding. NIPS 34 (2021).","journal-title":"NIPS"},{"key":"e_1_3_2_12_2","first-page":"3063","volume-title":"NIPS","author":"Duan Xuguang","year":"2018","unstructured":"Xuguang Duan, Wen-bing Huang, Chuang Gan, Jingdong Wang, Wenwu Zhu, and Junzhou Huang. 2018. Weakly supervised dense event captioning in videos. In NIPS. 3063\u20133073."},{"key":"e_1_3_2_13_2","volume-title":"ICCV","author":"Gao Jiyang","year":"2017","unstructured":"Jiyang Gao, Chen Sun, Zhenheng Yang, and Ram Nevatia. 2017. TALL: Temporal activity localization via language query. In ICCV."},{"key":"e_1_3_2_14_2","first-page":"1523","volume-title":"ICCV","author":"Gao Junyu","year":"2021","unstructured":"Junyu Gao and Changsheng Xu. 2021. Fast video moment retrieval. In ICCV. 1523\u20131532."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2729019"},{"key":"e_1_3_2_16_2","first-page":"1481","volume-title":"EMNLP","author":"Gao Mingfei","year":"2019","unstructured":"Mingfei Gao, Larry Davis, Richard Socher, and Caiming Xiong. 2019. WSLLN: Weakly supervised natural language localization networks. In EMNLP. 1481\u20131487."},{"key":"e_1_3_2_17_2","volume-title":"NAACL","author":"Ghosh Soham","year":"2019","unstructured":"Soham Ghosh, Anuva Agarwal, Zarana Parekh, and Alexander G. Hauptmann. 2019. ExCL: Extractive clip localization using natural language descriptions. In NAACL."},{"key":"e_1_3_2_18_2","volume-title":"European Conference on Computer Vision","author":"Hao Jiachang","year":"2022","unstructured":"Jiachang Hao, Haifeng Sun, Pengfei Ren, Jingyu Wang, Qi Qi, and Jianxin Liao. 2022. Can shuffling video benefit temporal bias problem: A novel training framework for temporal grounding. In European Conference on Computer Vision."},{"key":"e_1_3_2_19_2","article-title":"Query-aware video encoder for video moment retrieval","author":"Hao Jiachang","year":"2022","unstructured":"Jiachang Hao, Haifeng Sun, Pengfei Ren, Jingyu Wang, Qi Qi, and Jianxin Liao. 2022. Query-aware video encoder for video moment retrieval. Neurocomputing (2022).","journal-title":"Neurocomputing"},{"key":"e_1_3_2_20_2","first-page":"770","volume-title":"CVPR","author":"He Kaiming","year":"2016","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770\u2013778."},{"key":"e_1_3_2_21_2","first-page":"961","volume-title":"CVPR","author":"Heilbron Fabian Caba","year":"2015","unstructured":"Fabian Caba Heilbron, Victor Escorcia, Bernard Ghanem, and Juan Carlos Niebles. 2015. ActivityNet: A large-scale video benchmark for human activity understanding. In CVPR. 961\u2013970."},{"key":"e_1_3_2_22_2","volume-title":"ICCV","author":"Hendricks Lisa Anne","year":"2017","unstructured":"Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, and Bryan C. Russell. 2017. Localizing moments in video with natural language. In ICCV."},{"key":"e_1_3_2_23_2","volume-title":"EMNLP","author":"Hendricks Lisa Anne","year":"2018","unstructured":"Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, and Bryan C. Russell. 2018. Localizing moments in video with temporal language. In EMNLP."},{"key":"e_1_3_2_24_2","first-page":"20","volume-title":"ACM MM","author":"Hou Zhijian","year":"2021","unstructured":"Zhijian Hou, Chong-Wah Ngo, and W. K. Chan. 2021. CONQUER: Contextual query-aware ranking for video corpus moment retrieval. In ACM MM. 20\u201324."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00711"},{"key":"e_1_3_2_26_2","article-title":"Self-adaptive neural module transformer for visual question answering","author":"Huasong Zhong","year":"2020","unstructured":"Zhong Huasong, Jingyuan Chen, Chen Shen, Hanwang Zhang, Jianqiang Huang, and Xian-Sheng Hua. 2020. Self-adaptive neural module transformer for visual question answering. IEEE Transactions on Multimedia (2020).","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 31st British Machine Vision Virtual Conference","author":"Iashin Vladimir","year":"2020","unstructured":"Vladimir Iashin and Esa Rahtu. 2020. A better use of audio-visual cues: Dense video captioning with bi-modal transformer. In Proceedings of the 31st British Machine Vision Virtual Conference. British Machine Vision Association (BMVA)."},{"issue":"2","key":"e_1_3_2_28_2","article-title":"A multi-instance multi-label dual learning approach for video captioning","volume":"17","author":"Ji Wanting","year":"2021","unstructured":"Wanting Ji and Ruili Wang. 2021. A multi-instance multi-label dual learning approach for video captioning. ACM Trans. Multimedia Comput. Commun. Appl. 17, 2s (2021).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_29_2","first-page":"630","volume-title":"Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence","author":"Jin Tao","year":"2021","unstructured":"Tao Jin, Siyu Huang, Ming Chen, Yingming Li, and Zhongfei Zhang. 2021. SBAT: Video captioning with sparse boundary-aware transformer. In Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence. 630\u2013636."},{"issue":"2","key":"e_1_3_2_30_2","article-title":"Video question answering via knowledge-based progressive spatial-temporal attention network","volume":"15","author":"Jin Weike","year":"2019","unstructured":"Weike Jin, Zhou Zhao, Yimeng Li, Jie Li, Jun Xiao, and Yueting Zhuang. 2019. Video question answering via knowledge-based progressive spatial-temporal attention network. ACM Trans. Multimedia Comput. Commun. Appl. 15, 2s (2019).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_31_2","article-title":"A survey on temporal sentence grounding in videos","author":"Lan Xiaohan","year":"2022","unstructured":"Xiaohan Lan, Yitian Yuan, Xin Wang, Zhi Wang, and Wenwu Zhu. 2022. A survey on temporal sentence grounding in videos. ACM Trans. Multimedia Comput. Commun. Appl. (2022).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i07.6793"},{"key":"e_1_3_2_33_2","article-title":"End-to-end modeling via information tree for one-shot natural language spatial video grounding","author":"Li Mengze","year":"2022","unstructured":"Mengze Li, Tianbao Wang, Haoyu Zhang, Shengyu Zhang, Zhou Zhao, Jiaxu Miao, Wenqiao Zhang, Wenming Tan, Jin Wang, Peng Wang, Shiliang Pu, and Fei Wu. 2022. End-to-end modeling via information tree for one-shot natural language spatial video grounding. arXiv preprint arXiv:2203.08013 (2022).","journal-title":"arXiv preprint arXiv:2203.08013"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00782"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1219032"},{"key":"e_1_3_2_36_2","first-page":"11539","volume-title":"AAAI","author":"Lin Zhijie","year":"2020","unstructured":"Zhijie Lin, Zhou Zhao, Zhu Zhang, Qi Wang, and Huasheng Liu. 2020. Weakly-supervised video moment retrieval via semantic completion network. In AAAI. 11539\u201311546."},{"key":"e_1_3_2_37_2","article-title":"Moment retrieval via cross-modal interaction networks with query reconstruction","author":"Lin Zhijie","year":"2020","unstructured":"Zhijie Lin, Zhou Zhao, Zhu Zhang, Zijian Zhang, and Deng Cai. 2020. Moment retrieval via cross-modal interaction networks with query reconstruction. IEEE TIP (2020).","journal-title":"IEEE TIP"},{"key":"e_1_3_2_38_2","volume-title":"ECCV","author":"Liu Bingbin","year":"2018","unstructured":"Bingbin Liu, Serena Yeung, Edward Chou, De-An Huang, Li Fei-Fei, and Juan Carlos Niebles. 2018. Temporal modular networks for retrieving complex compositional activities in videos. In ECCV."},{"key":"e_1_3_2_39_2","first-page":"1298","volume-title":"CVPR","author":"Liu Daochang","year":"2019","unstructured":"Daochang Liu, Tingting Jiang, and Yizhou Wang. 2019. Completeness modeling and context separation for weakly supervised temporal action localization. In CVPR. 1298\u20131307."},{"key":"e_1_3_2_40_2","article-title":"Memory-guided semantic learning network for temporal sentence grounding","author":"Liu Daizong","year":"2022","unstructured":"Daizong Liu, Xiaoye Qu, Xing Di, Yu Cheng, Zichuan Xu, and Pan Zhou. 2022. Memory-guided semantic learning network for temporal sentence grounding. arXiv preprint arXiv:2201.00454 (2022).","journal-title":"arXiv preprint arXiv:2201.00454"},{"key":"e_1_3_2_41_2","first-page":"9292","volume-title":"EMNLP","author":"Liu Daizong","year":"2021","unstructured":"Daizong Liu, Xiaoye Qu, Jianfeng Dong, and Pan Zhou. 2021. Adaptive proposal generation network for temporal sentence localization in videos. In EMNLP. 9292\u20139301."},{"key":"e_1_3_2_42_2","first-page":"11235","volume-title":"CVPR","author":"Liu Daizong","year":"2021","unstructured":"Daizong Liu, Xiaoye Qu, Jianfeng Dong, Pan Zhou, Yu Cheng, Wei Wei, Zichuan Xu, and Yulai Xie. 2021. Context-aware biaffine localizing network for temporal sentence grounding. In CVPR. 11235\u201311244."},{"key":"e_1_3_2_43_2","volume-title":"ACM MM","author":"Liu Daizong","year":"2020","unstructured":"Daizong Liu, Xiaoye Qu, Xiao-Yang Liu, Jianfeng Dong, Pan Zhou, and Zichuan Xu. 2020. Jointly cross-and self-modal graph attention network for query-based moment localization. In ACM MM."},{"key":"e_1_3_2_44_2","first-page":"9302","volume-title":"EMNLP","author":"Liu Daizong","year":"2021","unstructured":"Daizong Liu, Xiaoye Qu, and Pan Zhou. 2021. Progressively guide to attend: An iterative alignment framework for temporal sentence grounding. In EMNLP. 9302\u20139311."},{"key":"e_1_3_2_45_2","article-title":"Exploring motion and appearance information for temporal sentence grounding","author":"Liu Daizong","year":"2022","unstructured":"Daizong Liu, Xiaoye Qu, Pan Zhou, and Yang Liu. 2022. Exploring motion and appearance information for temporal sentence grounding. arXiv preprint arXiv:2201.00457 (2022).","journal-title":"arXiv preprint arXiv:2201.00457"},{"key":"e_1_3_2_46_2","volume-title":"SIGIR","author":"Liu Meng","year":"2018","unstructured":"Meng Liu, Xiang Wang, Liqiang Nie, Xiangnan He, Baoquan Chen, and Tat-Seng Chua. 2018. Attentive moment retrieval in videos. In SIGIR."},{"key":"e_1_3_2_47_2","volume-title":"ACM MM","author":"Liu Meng","year":"2018","unstructured":"Meng Liu, Xiang Wang, Liqiang Nie, Qi Tian, Baoquan Chen, and Tat-Seng Chua. 2018. Cross-modal moment localization in videos. In ACM MM."},{"issue":"3","key":"e_1_3_2_48_2","article-title":"Single-shot semantic matching network for moment localization in videos","volume":"17","author":"Liu Xinfang","year":"2021","unstructured":"Xinfang Liu, Xiushan Nie, Junya Teng, Li Lian, and Yilong Yin. 2021. Single-shot semantic matching network for moment localization in videos. ACM Trans. Multimedia Comput. Commun. Appl. 17, 3 (2021).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_49_2","volume-title":"ICCV","author":"Liu Ziyi","year":"2019","unstructured":"Ziyi Liu, Le Wang, Qilin Zhang, Zhanning Gao, Zhenxing Niu, Nanning Zheng, and Gang Hua. 2019. Weakly supervised temporal action localization through contrast based evaluation networks. In ICCV."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1982.1056489"},{"key":"e_1_3_2_51_2","volume-title":"EMNLP","author":"Lu Chujie","year":"2019","unstructured":"Chujie Lu, Long Chen, Chilie Tan, Xiaolin Li, and Jun Xiao. 2019. DEBUG: A dense bottom-up grounding approach for natural language video localization. In EMNLP."},{"key":"e_1_3_2_52_2","first-page":"420","volume-title":"European Conference on Computer Vision","author":"Ma Fan","year":"2020","unstructured":"Fan Ma, Linchao Zhu, Yi Yang, Shengxin Zha, Gourab Kundu, Matt Feiszli, and Zheng Shou. 2020. SF-net: Single-frame supervision for temporal action localization. In European Conference on Computer Vision. Springer, 420\u2013437."},{"key":"e_1_3_2_53_2","first-page":"156","volume-title":"ECCV","author":"Ma Minuk","year":"2020","unstructured":"Minuk Ma, Sunjae Yoon, Junyeong Kim, Youngjoon Lee, Sunghun Kang, and Chang D. Yoo. 2020. VLANet: Video-language alignment network for weakly-supervised video moment retrieval. In ECCV. 156\u2013171."},{"issue":"4","key":"e_1_3_2_54_2","article-title":"Scenario-aware recurrent transformer for goal-directed video captioning","volume":"18","author":"Man Xin","year":"2022","unstructured":"Xin Man, Deqiang Ouyang, Xiangpeng Li, Jingkuan Song, and Jie Shao. 2022. Scenario-aware recurrent transformer for goal-directed video captioning. ACM Trans. Multimedia Comput. Commun. Appl. 18, 4 (2022).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_55_2","first-page":"11592","volume-title":"CVPR","author":"Mithun Niluthpol Chowdhury","year":"2019","unstructured":"Niluthpol Chowdhury Mithun, Sujoy Paul, and Amit K. Roy-Chowdhury. 2019. Weakly supervised video moment retrieval from text queries. In CVPR. 11592\u201311601."},{"key":"e_1_3_2_56_2","first-page":"9907","volume-title":"CVPR","author":"Moltisanti D.","year":"2019","unstructured":"D. Moltisanti, S. Fidler, and D. Damen. 2019. Action recognition from single timestamp supervision in untrimmed videos. In CVPR. 9907\u20139916."},{"key":"e_1_3_2_57_2","volume-title":"CVPR","author":"Mun Jonghwan","year":"2020","unstructured":"Jonghwan Mun, Minsu Cho, and Bohyung Han. 2020. Local-global video-text interactions for temporal grounding. In CVPR."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00675"},{"key":"e_1_3_2_59_2","first-page":"2765","volume-title":"CVPR","author":"Nan Guoshun","year":"2021","unstructured":"Guoshun Nan, Rui Qiao, Yao Xiao, Jun Liu, Sicong Leng, Hao Zhang, and Wei Lu. 2021. Interventional video grounding with dual contrastive learning. In CVPR. 2765\u20132775."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.497"},{"key":"e_1_3_2_61_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. 311\u2013318."},{"key":"e_1_3_2_62_2","volume-title":"WACV","author":"Rodriguez Cristian","year":"2020","unstructured":"Cristian Rodriguez, Edison Marrese-Taylor, Fatemeh Sadat Saleh, Hongdong Li, and Stephen Gould. 2020. Proposal-free temporal moment localization of a natural-language query in video using guided attention. In WACV."},{"key":"e_1_3_2_63_2","first-page":"10417","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Sadhu Arka","year":"2020","unstructured":"Arka Sadhu, Kan Chen, and Ram Nevatia. 2020. Video object grounding using semantic roles in language description. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 10417\u201310427."},{"key":"e_1_3_2_64_2","first-page":"162","volume-title":"ECCV","author":"Shou Zheng","year":"2018","unstructured":"Zheng Shou, Hang Gao, Lei Zhang, Kazuyuki Miyazawa, and Shih-Fu Chang. 2018. AutoLoc: Weakly-supervised temporal action localization in untrimmed videos. In ECCV. 162\u2013179."},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00156"},{"issue":"2","key":"e_1_3_2_66_2","article-title":"Rich visual and language representation with complementary semantics for video captioning","volume":"15","author":"Tang Pengjie","year":"2019","unstructured":"Pengjie Tang, Hanli Wang, and Qinyu Li. 2019. Rich visual and language representation with complementary semantics for video captioning. ACM Trans. Multimedia Comput. Commun. Appl. 15, 2 (2019).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_67_2","first-page":"5998","volume-title":"NIPS","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NIPS. 5998\u20136008."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_3_2_69_2","volume-title":"AAAI","author":"Wang Jingwen","year":"2020","unstructured":"Jingwen Wang, Lin Ma, and Wenhao Jiang. 2020. Temporally grounding language queries in videos by contextual boundary-aware prediction. In AAAI."},{"key":"e_1_3_2_70_2","first-page":"6402","volume-title":"CVPR","author":"Wang Limin","year":"2017","unstructured":"Limin Wang, Yuanjun Xiong, Dahua Lin, and Luc Van Gool. 2017. UntrimmedNets for weakly supervised action recognition and detection. In CVPR. 6402\u20136411."},{"key":"e_1_3_2_71_2","article-title":"Weakly supervised temporal adjacent network for language grounding","author":"Wang Yuechen","year":"2021","unstructured":"Yuechen Wang, Jiajun Deng, Wengang Zhou, and Houqiang Li. 2021. Weakly supervised temporal adjacent network for language grounding. IEEE Transactions on Multimedia (2021).","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_72_2","first-page":"2986","volume-title":"Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI 2021), 33rd Conference on Innovative Applications of Artificial Intelligence (IAAI 2021), 11th Symposium on Educational Advances in Artificial Intelligence (EAAI 2021), Virtual Event, February 2\u20139, 2021","author":"Xiao Shaoning","year":"2021","unstructured":"Shaoning Xiao, Long Chen, Songyang Zhang, Wei Ji, Jian Shao, Lu Ye, and Jun Xiao. 2021. Boundary proposal network for two-stage natural language video localization. In Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI 2021), 33rd Conference on Innovative Applications of Artificial Intelligence (IAAI 2021), 11th Symposium on Educational Advances in Artificial Intelligence (EAAI 2021), Virtual Event, February 2\u20139, 2021. 2986\u20132994."},{"key":"e_1_3_2_73_2","volume-title":"AAAI","author":"Xu Huijuan","year":"2019","unstructured":"Huijuan Xu, Kun He, Bryan A. Plummer, Leonid Sigal, Stan Sclaroff, and Kate Saenko. 2019. Multilevel language and vision integration for text-to-clip retrieval. In AAAI."},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2941820"},{"issue":"1","key":"e_1_3_2_75_2","first-page":"229","article-title":"STAT: Spatial-temporal attention mechanism for video captioning","volume":"22","author":"Yan Chenggang","year":"2019","unstructured":"Chenggang Yan, Yunbin Tu, Xingzheng Wang, Yongbing Zhang, Xinhong Hao, Yongdong Zhang, and Qionghai Dai. 2019. STAT: Spatial-temporal attention mechanism for video captioning. IEEE Transactions on Multimedia 22, 1 (2019), 229\u2013241.","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3058614"},{"key":"e_1_3_2_77_2","volume-title":"NIPS","author":"Yuan Yitian","year":"2019","unstructured":"Yitian Yuan, Lin Ma, Jingwen Wang, Wei Liu, and Wenwu Zhu. 2019. Semantic conditioned dynamic modulation for temporal sentence grounding in videos. In NIPS."},{"key":"e_1_3_2_78_2","volume-title":"AAAI","author":"Yuan Yitian","year":"2019","unstructured":"Yitian Yuan, Tao Mei, and Wenwu Zhu. 2019. To find where you talk: Temporal sentence localization in video with attention based location regression. In AAAI."},{"issue":"2","key":"e_1_3_2_79_2","article-title":"Moment is important: Language-based video moment retrieval via adversarial learning","volume":"18","author":"Zeng Yawen","year":"2022","unstructured":"Yawen Zeng, Da Cao, Shaofei Lu, Hanling Zhang, Jiao Xu, and Zheng Qin. 2022. Moment is important: Language-based video moment retrieval via adversarial learning. ACM Trans. Multimedia Comput. Commun. Appl. 18, 2 (2022).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"issue":"2","key":"e_1_3_2_80_2","article-title":"Spatiotemporal-textual co-attention network for video question answering","volume":"15","author":"Zha Zheng-Jun","year":"2019","unstructured":"Zheng-Jun Zha, Jiawei Liu, Tianhao Yang, and Yongdong Zhang. 2019. Spatiotemporal-textual co-attention network for video question answering. ACM Trans. Multimedia Comput. Commun. Appl. 15, 2s (2019).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_81_2","volume-title":"CVPR","author":"Zhang Da","year":"2019","unstructured":"Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang, and Larry S. Davis. 2019. MAN: Moment alignment network for natural language moment retrieval via iterative graph adjustment. In CVPR."},{"key":"e_1_3_2_82_2","doi-asserted-by":"crossref","DOI":"10.1109\/TPAMI.2021.3060449","article-title":"Natural language video localization: A revisit in span-based question answering framework","author":"Zhang Hao","year":"2021","unstructured":"Hao Zhang, Aixin Sun, Wei Jing, Liangli Zhen, Joey Tianyi Zhou, and Rick Siow Mong Goh. 2021. Natural language video localization: A revisit in span-based question answering framework. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_83_2","volume-title":"ACL","author":"Zhang Hao","year":"2020","unstructured":"Hao Zhang, Aixin Sun, Wei Jing, and Joey Tianyi Zhou. 2020. Span-based localizing network for natural language video localization. In ACL."},{"key":"e_1_3_2_84_2","article-title":"Multi-scale 2D temporal adjacency networks for moment localization with natural language","author":"Zhang Songyang","year":"2021","unstructured":"Songyang Zhang, Houwen Peng, Jianlong Fu, Yijuan Lu, and Jiebo Luo. 2021. Multi-scale 2D temporal adjacency networks for moment localization with natural language. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_85_2","volume-title":"AAAI","author":"Zhang Songyang","year":"2020","unstructured":"Songyang Zhang, Houwen Peng, Jianlong Fu, and Jiebo Luo. 2020. Learning 2D temporal adjacent networks for moment localization with natural language. In AAAI."},{"issue":"4","key":"e_1_3_2_86_2","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1109\/TMM.2019.2935678","article-title":"Frame augmented alternating attention network for video question answering","volume":"22","author":"Zhang Wenqiao","year":"2019","unstructured":"Wenqiao Zhang, Siliang Tang, Yanpeng Cao, Shiliang Pu, Fei Wu, and Yueting Zhuang. 2019. Frame augmented alternating attention network for video question answering. IEEE Transactions on Multimedia 22, 4 (2019), 1032\u20131041.","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331235"},{"key":"e_1_3_2_88_2","unstructured":"Advances in Neural Information Processing Systems 2020 33 Counterfactual contrastive learning for weakly-supervised vision-language grounding"},{"key":"e_1_3_2_89_2","article-title":"Temporal textual localization in video via adversarial bi-directional interaction networks","author":"Zhang Z.","year":"2020","unstructured":"Z. Zhang, Z. Zhao, Z. Zhang, Z. Lin, Q. Wang, and R. Hong. 2020. Temporal textual localization in video via adversarial bi-directional interaction networks. IEEE TMM (2020).","journal-title":"IEEE TMM"},{"key":"e_1_3_2_90_2","article-title":"Progressive localization networks for language based moment localization","author":"Zheng Qi","year":"2022","unstructured":"Qi Zheng, Jianfeng Dong, Xiaoye Qu, Xun Yang, Yabing Wang, Pan Zhou, Baolong Liu, and Xun Wang. 2022. Progressive localization networks for language based moment localization. ACM Trans. Multimedia Comput. Commun. Appl. (2022).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_91_2","first-page":"8445","volume-title":"CVPR","author":"Zhou Hao","year":"2021","unstructured":"Hao Zhou, Chongyang Zhang, Yan Luo, Yanjun Chen, and Chuanping Hu. 2021. Embracing uncertainty: Decoupling and de-bias for robust temporal grounding. In CVPR. 8445\u20138454."},{"key":"e_1_3_2_92_2","first-page":"8739","volume-title":"CVPR","author":"Zhou Luowei","year":"2018","unstructured":"Luowei Zhou, Yingbo Zhou, Jason J. Corso, Richard Socher, and Caiming Xiong. 2018. End-to-end dense video captioning with masked transformer. In CVPR. 8739\u20138748."},{"key":"e_1_3_2_93_2","article-title":"Multimedia intelligence: When multimedia meets artificial intelligence","author":"Zhu Wenwu","year":"2020","unstructured":"Wenwu Zhu, Xin Wang, and Wen Gao. 2020. Multimedia intelligence: When multimedia meets artificial intelligence. IEEE Transactions on Multimedia (2020).","journal-title":"IEEE Transactions on Multimedia"},{"issue":"1","key":"e_1_3_2_94_2","article-title":"Multichannel attention refinement for video question answering","volume":"16","author":"Zhuang Yueting","year":"2020","unstructured":"Yueting Zhuang, Dejing Xu, Xin Yan, Wenzhuo Cheng, Zhou Zhao, Shiliang Pu, and Jun Xiao. 2020. Multichannel attention refinement for video question answering. ACM Trans. Multimedia Comput. Commun. Appl. 16, 1s (2020).","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579825","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579825","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:27Z","timestamp":1750182687000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,30]]},"references-count":93,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3579825"],"URL":"https:\/\/doi.org\/10.1145\/3579825","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,30]]},"assertion":[{"value":"2022-06-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}