{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,15]],"date-time":"2026-11-15T07:37:48Z","timestamp":1794728268971,"version":"4.9.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"9","funder":[{"name":"Natural Science Foundation of Shandong Province, China","award":["ZR2022ZD02"],"award-info":[{"award-number":["ZR2022ZD02"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>Traditional Vision-and-Language Navigation (VLN) requires an agent to navigate to a target location solely based on visual observations, guided by natural language instructions. Compared to this task, long-instruction VLN involves longer instructions, extended trajectories, and the need to consider more contextual information for global path planning. As a result, it is more challenging and requires accurately aligning the instructions with the agent\u2019s current visual observations, which is accompanied by two significant issues. Firstly, there is a misalignment between actions. The visual observations of the agent at each step lack explicit action-related details, while the instructions contain action-oriented words. Secondly, there is a misalignment between global instructions and local visual observations. The instructions describe the entire navigation trajectory, whereas the agent\u2019s visual observations only provide localized information about a specific position along the trajectory. To address these issues, this article introduces the Action-Perception Alignment Framework (APAF). In this framework, we first design the Action-Contextual Encoding Module (ACEM), which enriches the agent\u2019s visual perception by encoding potential actions with relative heading and elevation angles. We then propose the Dynamic Instruction Weighting Module (DIWM), which adjusts the importance of instruction words based on the agent\u2019s current visual observations, emphasizing those words most relevant to the agent\u2019s visual observations. Our approach significantly outperforms existing methods, achieving state-of-the-art results with improvements of 8.5% and 4.0% in Success Rate (SR) on the long-instruction R4R and RxR datasets, respectively.<\/jats:p>","DOI":"10.1145\/3748656","type":"journal-article","created":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T09:22:17Z","timestamp":1752571337000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Action-Aware Visual-Textual Alignment for Long-Instruction Vision-and-Language Navigation"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7920-8524","authenticated-orcid":false,"given":"Bowen","family":"Huang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2115-6237","authenticated-orcid":false,"given":"Yanwei","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6644-147X","authenticated-orcid":false,"given":"Chuanlin","family":"Lan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5203-3842","authenticated-orcid":false,"given":"Dongchen","family":"Sui","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9066-3347","authenticated-orcid":false,"given":"Xinpeng","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0824-9284","authenticated-orcid":false,"given":"Xiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6305-8125","authenticated-orcid":false,"given":"Mengbai","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6835-5981","authenticated-orcid":false,"given":"Dongxiao","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Shandong University, Qingdao, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,9,11]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475282"},{"key":"e_1_3_1_3_2","unstructured":"Dong An Yuankai Qi Yangguang Li Yan Huang Liang Wang Tieniu Tan and Jing Shao. 2022. BEVBert: Multimodal map pre-training for language-guided navigation. arXiv:2212.04385. Retrieved from https:\/\/arxiv.org\/abs\/2212.04385"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2024.3386695"},{"key":"e_1_3_1_5_2","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems","author":"Anderson Peter","year":"2019","unstructured":"Peter Anderson, Ayush Shrivastava, Devi Parikh, Dhruv Batra, and Stefan Lee. 2019. Chasing ghosts: Instruction following as Bayesian state tracking. In Proceedings of the 33rd International Conference on Neural Information Processing Systems. Curran Associates Inc., Red Hook, NY, Article 34, 11 pages."},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00387"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2017.00081"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","unstructured":"Jingwen Chen Jianjie Luo Yingwei Pan Yehao Li Ting Yao Hongyang Chao and Tao Mei. 2023. Boosting vision-and-language navigation with direction guiding and backtracing. ACM Transactions on Multimedia Computing Communications and Applications 19 1 Article 9 (Jan. 2023) 16 pages. DOI: 10.1145\/3526024","DOI":"10.1145\/3526024"},{"key":"e_1_3_1_9_2","first-page":"10993","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Chen Jinyu","year":"2023","unstructured":"Jinyu Chen, Wenguan Wang, Si Liu, Hongsheng Li, and Yi Yang. 2023. Omnidirectional information gathering for knowledge transfer-based audio-visual navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, 10993\u201311003."},{"key":"e_1_3_1_10_2","first-page":"11276","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Chen Kevin","year":"2021","unstructured":"Kevin Chen, Junshen K. Chen, Jo Chuang, Marynel V\u00e1zquez, and Silvio Savarese. 2021. Topological planning with transformers for vision-and-language navigation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 11276\u201311286."},{"key":"e_1_3_1_11_2","first-page":"38149","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Chen Peihao","year":"2022","unstructured":"Peihao Chen, Dongyu Ji, Kunyang Lin, Runhao Zeng, Thomas Li, Mingkui Tan, and Chuang Gan. 2022. Weakly-supervised multi-granularity map learning for vision-and-language navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 35. Curran Associates, Inc., 38149\u201338161."},{"key":"e_1_3_1_12_2","first-page":"5834","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Chen Shizhe","year":"2021","unstructured":"Shizhe Chen, Pierre-Louis Guhur, Cordelia Schmid, and Ivan Laptev. 2021. History aware multimodal transformer for vision-and-language navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 5834\u20135847."},{"key":"e_1_3_1_13_2","first-page":"638","volume-title":"European Conference on Computer Vision","author":"Chen Shizhe","year":"2022","unstructured":"Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, and Ivan Laptev. 2022. Learning from unlabeled 3D environments for vision-and-language navigation. In European Conference on Computer Vision. Springer, 638\u2013655."},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01604"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3547852"},{"key":"e_1_3_1_16_2","first-page":"8250","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Dang Ronghao","year":"2023","unstructured":"Ronghao Dang, Liuyi Wang, Zongtao He, Shuai Su, Jiagui Tang, Chengju Liu, and Qijun Chen. 2023. Search for or navigate to? Dual adaptive thinking for object navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 8250\u20138259."},{"key":"e_1_3_1_17_2","first-page":"20660","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Deng Zhiwei","year":"2020","unstructured":"Zhiwei Deng, Karthik Narasimhan, and Olga Russakovsky. 2020. Evolving graphical planner: Contextual global planning for vision-and-language navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc., 20660\u201320672."},{"key":"e_1_3_1_18_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4171\u20134186."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.322"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2006.1638022"},{"key":"e_1_3_1_21_2","unstructured":"A. Elfes. 2013. Occupancy grids: A stochastic spatial representation for active robot perception. arXiv:1304.1098. Retrieved from https:\/\/arxiv.org\/abs\/1304.1098"},{"key":"e_1_3_1_22_2","first-page":"3318","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Fried Daniel","year":"2018","unstructured":"Daniel Fried, Ronghang Hu, Volkan Cirik, Anna Rohrbach, Jacob Andreas, Louis-Philippe Morency, Taylor Berg-Kirkpatrick, Kate Saenko, Dan Klein, and Trevor Darrell. 2018. Speaker-follower models for vision-and-language navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 31. Curran Associates, Inc., 3318\u20133329."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00308"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01502"},{"key":"e_1_3_1_25_2","first-page":"1634","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Guhur Pierre-Louis","year":"2021","unstructured":"Pierre-Louis Guhur, Makarand Tapaswi, Shizhe Chen, Ivan Laptev, and Cordelia Schmid. 2021. Airbert: In-domain pretraining for vision-and-language navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 1634\u20131643."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01315"},{"key":"e_1_3_1_27_2","first-page":"7685","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Hong Yicong","year":"2020","unstructured":"Yicong Hong, Cristian Rodriguez, Yuankai Qi, Qi Wu, and Stephen Gould. 2020. Language and visual entity relationship graph for agent navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc., 7685\u20137696."},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00169"},{"key":"e_1_3_1_29_2","first-page":"3055","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Hong Yicong","year":"2023","unstructured":"Yicong Hong, Yang Zhou, Ruiyi Zhang, Franck Dernoncourt, Trung Bui, Stephen Gould, and Hao Tan. 2023. Learning navigational visual representations with semantic map supervision. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, 3055\u20133067."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","unstructured":"Xiaobo Hu Youfang Lin Hehe Fan Shuo Wang Zhihao Wu and Kai Lv. 2024. Building category graphs representation with spatial and temporal attention for visual navigation. ACM Transactions on Multimedia Computing Communications and Applications 20 7 Article 217 (May 2024) 22 pages. DOI: 10.1145\/3653714","DOI":"10.1145\/3653714"},{"key":"e_1_3_1_31_2","unstructured":"Gabriel Ilharco Vihan Jain Alexander Ku Eugene Ie and Jason Baldridge. 2019. General evaluation for instruction conditioned navigation using dynamic time warping. In Visually Grounded Interaction and Language (ViGIL) NeurIPS 2019 Workshop. Retrieved from https:\/\/vigilworkshop.github.io\/static\/papers-2019\/33.pdf"},{"key":"e_1_3_1_32_2","first-page":"4065","volume-title":"Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR)","author":"Irshad Muhammad Zubair","year":"2022","unstructured":"Muhammad Zubair Irshad, Niluthpol Chowdhury Mithun, Zachary Seymour, Han-Pang Chiu, Supun Samarasekera, and Rakesh Kumar. 2022. Semantically-aware spatio-temporal reasoning agent for vision-and-language navigation in continuous environments. In Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR). IEEE, 4065\u20134071."},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1181"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01041"},{"key":"e_1_3_1_35_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Kolesnikov Alexander","year":"2021","unstructured":"Alexander Kolesnikov, Alexey Dosovitskiy, Dirk Weissenborn, Georg Heigold, Jakob Uszkoreit, Lucas Beyer, Matthias Minderer, Mostafa Dehghani, Neil Houlsby, Sylvain Gelly, et al. 2021. An image is worth 16\u2009\u00d7\u200916 words: Transformers for image recognition at scale. In Proceedings of the International Conference on Learning Representations (ICLR). Retrieved from https:\/\/openreview.net\/forum?id=YicbFdNTTy"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1007\/978-3-030-58604-1_7","volume-title":"Computer Vision\u2014ECCV 2020","author":"Krantz Jacob","year":"2020","unstructured":"Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, and Stefan Lee. 2020. Beyond the nav-graph: Vision-and-language navigation in continuous environments. In Computer Vision\u2014ECCV 2020. Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm (Eds.), Springer International Publishing, Cham, 104\u2013120."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.356"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2021.103255"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.82"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1159"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00254"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01496"},{"key":"e_1_3_1_43_2","first-page":"740","volume-title":"Computer Vision\u2014ECCV 2014","author":"Lin Tsung-Yi","year":"2014","unstructured":"Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll\u00e1r, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In Computer Vision\u2014ECCV 2014. David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars (Eds.), Springer International Publishing, Cham, 740\u2013755."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00167"},{"key":"e_1_3_1_45_2","first-page":"16317","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Liu Rui","year":"2024","unstructured":"Rui Liu, Wenguan Wang, and Yi Yang. 2024. Volumetric environment representation for vision-language navigation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 16317\u201316328."},{"key":"e_1_3_1_46_2","first-page":"10968","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Liu Rui","year":"2023","unstructured":"Rui Liu, Xiaohan Wang, Wenguan Wang, and Yi Yang. 2023. Bird\u2019s-eye-view scene graph for vision-language navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, 10968\u201310980."},{"key":"e_1_3_1_47_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv:1907.11692. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00689"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i5.28223"},{"key":"e_1_3_1_50_2","first-page":"7357","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Moudgil Abhinav","year":"2021","unstructured":"Abhinav Moudgil, Arjun Majumdar, Harsh Agrawal, Stefan Lee, and Dhruv Batra. 2021. SOAT: A scene- and object-aware transformer for vision-and-language navigation. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 7357\u20137367."},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01564"},{"key":"e_1_3_1_52_2","first-page":"1655","article-title":"The road to know-where: An object-and-room informed sequential BERT for indoor vision-language navigation","author":"Qi Yuankai","year":"2021","unstructured":"Yuankai Qi, Zizheng Pan, Yicong Hong, Ming-Hsuan Yang, Anton van den Hengel, and Qi Wu. 2021. The road to know-where: An object-and-room informed sequential BERT for indoor vision-language navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 1655\u20131664.","journal-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)"},{"key":"e_1_3_1_53_2","first-page":"303","volume-title":"European Conference on Computer Vision","author":"Qi Yuankai","year":"2020","unstructured":"Yuankai Qi, Zizheng Pan, Shengping Zhang, Anton van den Hengel, and Qi Wu. 2020. Object-and-action aware model for visual language navigation. In Proceedings of the European Conference on Computer Vision. Springer, 303\u2013317."},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01000"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01498"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3234243"},{"key":"e_1_3_1_57_2","first-page":"15758","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Qiao Yanyuan","year":"2023","unstructured":"Yanyuan Qiao, Yuankai Qi, Zheng Yu, Jing Liu, and Qi Wu. 2023. March in Chat: Interactive prompting for remote embodied referring expression. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 15758\u201315767."},{"key":"e_1_3_1_58_2","unstructured":"Wenda Qin Teruhisa Misu and Derry Wijaya. 2021. Explore the potential performance of vision-and-language navigation model: A snapshot ensemble method. arXiv:2111.14267. Retrieved from https:\/\/arxiv.org\/abs\/2111.14267"},{"key":"e_1_3_1_59_2","first-page":"8748","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the International Conference on Machine Learning. PMLR, 8748\u20138763."},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.hcc.2024.100269"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1514"},{"key":"e_1_3_1_63_2","first-page":"2610","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Tan Hao","year":"2019","unstructured":"Hao Tan, Licheng Yu, and Mohit Bansal. 2019. Learning to navigate unseen environments: Back translation with environmental dropout. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2610\u20132621."},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2024.3395633"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00835"},{"key":"e_1_3_1_66_2","first-page":"13139","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wang Liuyi","year":"2024","unstructured":"Liuyi Wang, Zongtao He, Ronghao Dang, Mengjiao Shen, Chengju Liu, and Qijun Chen. 2024. Vision-and-language navigation via causal learning. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 13139\u201313150."},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00679"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01826"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01103"},{"key":"e_1_3_1_70_2","first-page":"15625","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Wang Zihan","year":"2023","unstructured":"Zihan Wang, Xiangyang Li, Jiahao Yang, Yeqi Liu, and Shuqiang Jiang. 2023. GridMM: Grid memory map for vision-and-language navigation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 15625\u201315636."},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.hcc.2024.100235"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3611736"},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548281"},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01003"},{"key":"e_1_3_1_75_2","first-page":"5981","volume-title":"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Zhu Wanrong","year":"2022","unstructured":"Wanrong Zhu, Yuankai Qi, Pradyumna Narayana, Kazoo Sone, Sugato Basu, Xin Wang, Qi Wu, Miguel Eckstein, and William Yang Wang. 2022. Diagnosing vision-and-language navigation: What really matters. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 5981\u20135993."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3748656","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T19:44:16Z","timestamp":1757619856000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3748656"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,11]]},"references-count":74,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3748656"],"URL":"https:\/\/doi.org\/10.1145\/3748656","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,11]]},"assertion":[{"value":"2025-01-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}