{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T11:51:54Z","timestamp":1783511514555,"version":"3.55.0"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>Video captioning is a challenging task as it needs to  accurately  transform  visual  understanding  into natural language description.  To date, state-of-the-art  methods  inadequately  model  global-local representation across video frames for caption generation, leaving plenty of room for improvement.  In this work, we approach the video captioning task from a new perspective and propose  a GL-RG framework for video captioning, namely a Global-Local Representation Granularity. Our GL-RG demonstrates three advantages over the prior efforts: 1) we explicitly exploit extensive visual representations from different video ranges to improve linguistic expression; 2) we devise a novel global-local encoder to produce rich semantic vocabulary to obtain a descriptive granularity of video contents across frames; 3) we develop an incremental training strategy which organizes model learning in an incremental fashion to incur an optimal captioning behavior. Experimental results on the challenging MSR-VTT and MSVD datasets show that our DL-RG outperforms recent state-of-the-art methods by a significant margin. Code is available at https:\/\/github.com\/ylqi\/GL-RG.<\/jats:p>","DOI":"10.24963\/ijcai.2022\/384","type":"proceedings-article","created":{"date-parts":[[2022,7,15]],"date-time":"2022-07-15T22:55:56Z","timestamp":1657925756000},"page":"2769-2775","source":"Crossref","is-referenced-by-count":52,"title":["GL-RG: Global-Local Representation Granularity for Video Captioning"],"prefix":"10.24963","author":[{"given":"Liqi","family":"Yan","sequence":"first","affiliation":[{"name":"Fudan University"},{"name":"Westlake University"},{"name":"Rochester Institute of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qifan","family":"Wang","sequence":"additional","affiliation":[{"name":"Meta AI"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiming","family":"Cui","sequence":"additional","affiliation":[{"name":"University of Florida"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fuli","family":"Feng","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojun","family":"Quan","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongfang","family":"Liu","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10584","event":{"name":"Thirty-First International Joint Conference on Artificial Intelligence {IJCAI-22}","theme":"Artificial Intelligence","location":"Vienna, Austria","acronym":"IJCAI-2022","number":"31","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2022,7,23]]},"end":{"date-parts":[[2022,7,29]]}},"container-title":["Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T07:09:25Z","timestamp":1658128165000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2022\/384"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2022\/384","relation":{},"subject":[],"published":{"date-parts":[[2022,7]]}}}