{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T23:35:28Z","timestamp":1761176128403,"version":"build-2065373602"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643686318","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:00:00Z","timestamp":1761004800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,10,21]]},"abstract":"<jats:p>Vision-language alignment in video must address the complexity of language, evolving interacting entities, their action chains, and semantic gaps between language and vision. This work introduces Planner-Refiner, a framework to overcome these challenges. Planner-Refiner bridges the semantic gap by iteratively refining visual elements\u2019 space-time representation, guided by language until semantic gaps are minimal. A Planner module schedules language guidance by decomposing complex linguistic prompts into short sentence chains. The Refiner processes each short sentence\u2014a noun-phrase and verb-phrase pair\u2014to direct visual tokens\u2019 self-attention across space then time, achieving efficient single-step refinement. A recurrent system chains these steps, maintaining refined visual token representations. The final representation feeds into task-specific heads for alignment generation. We demonstrate Planner-Refiner\u2019s effectiveness on two video-language alignment tasks: Referring Video Object Segmentation and Temporal Grounding with varying language complexity. We further introduce a new MeViS-X benchmark to assess models\u2019 capability with long queries. Superior performance versus state-of-the-art methods on these benchmarks shows the approach\u2019s potential, especially for complex prompts.<\/jats:p>","DOI":"10.3233\/faia250846","type":"book-chapter","created":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:43:54Z","timestamp":1761126234000},"source":"Crossref","is-referenced-by-count":0,"title":["Planner-Refiner: Dynamic Space-Time Refinement for Vision-Language Alignment in Videos"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-8161-7637","authenticated-orcid":false,"given":"Tuyen","family":"Tran","sequence":"first","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8089-9962","authenticated-orcid":false,"given":"Thao Minh","family":"Le","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4727-6859","authenticated-orcid":false,"given":"Quang-Hung","family":"Le","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6531-8907","authenticated-orcid":false,"given":"Truyen","family":"Tran","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2025"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA250846","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T09:43:54Z","timestamp":1761126234000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA250846"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,21]]},"ISBN":["9781643686318"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia250846","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,21]]}}}