{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T15:53:37Z","timestamp":1783439617840,"version":"3.54.6"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100020595","name":"National Science and Technology Council of Taiwan","doi-asserted-by":"crossref","award":["NSTC-109-2223-E-009-002-MY3 and NSTC-111-2634-F-007-002"],"award-info":[{"award-number":["NSTC-109-2223-E-009-002-MY3 and NSTC-111-2634-F-007-002"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,1,31]]},"abstract":"<jats:p>Visual grounding is an essential task in understanding the semantic relationship between the given text description and the target object in an image. Due to the innate complexity of language and the rich semantic context of the image, it is still a challenging problem to infer the underlying relationship and to perform reasoning between the objects in an image and the given expression. Although existing visual grounding methods have achieved promising progress, cross-modal mapping across different domains for the task is still not well handled, especially when the expressions are complex and long. To address the issue, we propose a language-guided residual graph attention network for visual grounding (LRGAT-VG), which enables us to apply deeper graph convolution layers with the assistance of residual connections between them. This allows us to better handle long and complex expressions than other graph-based methods. Furthermore, we perform a Language-guided Data Augmentation (LGDA), which is based on copy-paste operations on pairs of source and target images to increase the diversity of training data while maintaining the relationship between the objects in the image and the expression. With extensive experiments on three visual grounding benchmarks, including RefCOCO, RefCOCO+, and RefCOCOg, LRGAT-VG with LGDA achieves competitive performance with other state-of-the-art graph network-based referring expression approaches and demonstrates its effectiveness.<\/jats:p>","DOI":"10.1145\/3604557","type":"journal-article","created":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T11:26:25Z","timestamp":1686741985000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Language-guided Residual Graph Attention Network and Data Augmentation for Visual Grounding"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0998-251X","authenticated-orcid":false,"given":"Jia","family":"Wang","sequence":"first","affiliation":[{"name":"National Yang Ming Chiao Tung University, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2216-077X","authenticated-orcid":false,"given":"Hong-Han","family":"Shuai","sequence":"additional","affiliation":[{"name":"National Yang Ming Chiao Tung University, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0475-3689","authenticated-orcid":false,"given":"Yung-Hui","family":"Li","sequence":"additional","affiliation":[{"name":"Hon Hai Research Institute, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4662-7875","authenticated-orcid":false,"given":"Wen-Huang","family":"Cheng","sequence":"additional","affiliation":[{"name":"National Taiwan University, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,8,24]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","first-page":"6077","DOI":"10.1109\/CVPR.2018.00636","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201918)","author":"Anderson P.","year":"2018","unstructured":"P. Anderson, X. He, C. Buehler, D. Teney, M. Johnson, S. Gould, and L. Zhang. 2018. Bottom-up and top-down attention for image captioning and visual question answering. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201918). IEEE Computer Society, Los Alamitos, CA, 6077\u20136086."},{"key":"e_1_3_1_3_2","first-page":"39","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916)","author":"Andreas Jacob","year":"2016","unstructured":"Jacob Andreas, Marcus Rohrbach, Trevor Darrell, and Dan Klein. 2016. Neural module networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201916). 39\u201348."},{"key":"e_1_3_1_4_2","volume-title":"Proceedings of 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201921)","author":"Chang Hsiang-Chun","year":"2021","unstructured":"Hsiang-Chun Chang, Hung-Jen Chen, Yu-Chia Shen, Hong-Han Shuai, and Wen-Huang Cheng. 2021. Re-Attention is all you need: Memory-efficient scene text detection via re-attention on uncertain regions. In Proceedings of 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201921). IEEE, 452\u2013459."},{"key":"e_1_3_1_5_2","first-page":"3438","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"34","author":"Chen Deli","year":"2020","unstructured":"Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, and Xu Sun. 2020. Measuring and relieving the over-smoothing problem for graph neural networks from the topological view. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 3438\u20133445."},{"key":"e_1_3_1_6_2","first-page":"824","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)","author":"Chen Kan","year":"2017","unstructured":"Kan Chen, Rama Kovvuri, and Ram Nevatia. 2017. Query-guided regression network with context policy for phrase grounding. In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917). IEEE Computer Society, 824\u2013832."},{"key":"e_1_3_1_7_2","first-page":"1036","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Chen Long","year":"2021","unstructured":"Long Chen, Wenbo Ma, Jun Xiao, Hanwang Zhang, and Shih-Fu Chang. 2021. Ref-NMS: Breaking proposal bottlenecks in two-stage referring expression grounding. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 1036\u20131044."},{"key":"e_1_3_1_8_2","first-page":"1197","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Chen Xinchi","year":"2015","unstructured":"Xinchi Chen, Xipeng Qiu, Chenxi Zhu, Pengfei Liu, and Xuanjing Huang. 2015. Long short-term memory neural networks for Chinese word segmentation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1197\u20131206."},{"key":"e_1_3_1_9_2","first-page":"104","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201920)","author":"Chen Yen-Chun","year":"2020","unstructured":"Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020. Uniter: Universal image-text representation learning. In Proceedings of the European Conference on Computer Vision (ECCV\u201920). Springer, 104\u2013120."},{"key":"e_1_3_1_10_2","volume-title":"Proceedings of the 30th British Machine Vision Conference (BMVC\u201919)","author":"Chen Yi Wen","year":"2020","unstructured":"Yi Wen Chen, Yi Hsuan Tsai, Tiantian Wang, Yen Yu Lin, and Ming Hsuan Yang. 2020. Referring expression object segmentation with caption-aware consistency. In Proceedings of the 30th British Machine Vision Conference (BMVC\u201919)."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475251"},{"issue":"1","key":"e_1_3_1_12_2","article-title":"Extracting keyphrases from research papers using citation networks","volume":"28","author":"Gollapalli Sujatha Das","year":"2014","unstructured":"Sujatha Das Gollapalli and Cornelia Caragea. 2014. Extracting keyphrases from research papers using citation networks. In Proceedings of the AAAI Conference on Artificial Intelligence 28, 1 (June2014).","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"e_1_3_1_13_2","first-page":"1769","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201921)","author":"Deng Jiajun","year":"2021","unstructured":"Jiajun Deng, Zhengyuan Yang, Tianlang Chen, Wengang Zhou, and Houqiang Li. 2021. TransVG: End-to-end visual grounding with transformers. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201921). 1769\u20131779."},{"key":"e_1_3_1_14_2","first-page":"4171","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Minneapolis, MN, 4171\u20134186. DOI:10.18653\/v1\/N19-1423"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3441628"},{"key":"e_1_3_1_16_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo (ICME\u201922)","author":"Du Ye","year":"2022","unstructured":"Ye Du, Zehua Fu, Qingjie Liu, and Yunhong Wang. 2022. Visual grounding with transformers. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME\u201922). IEEE, 1\u20136."},{"key":"e_1_3_1_17_2","first-page":"364","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Dvornik Nikita","year":"2018","unstructured":"Nikita Dvornik, Julien Mairal, and Cordelia Schmid. 2018. Modeling visual context is key to augmenting object detection datasets. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). 364\u2013380."},{"key":"e_1_3_1_18_2","first-page":"682","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Fang Hao-Shu","year":"2019","unstructured":"Hao-Shu Fang, Jianhua Sun, Runzhong Wang, Minghao Gou, Yong-Lu Li, and Cewu Lu. 2019. Instaboost: Boosting instance segmentation via probability map guided copy-pasting. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 682\u2013691."},{"key":"e_1_3_1_19_2","first-page":"6616","article-title":"Large-scale adversarial training for vision-and-language representation learning","volume":"33","author":"Gan Zhe","year":"2020","unstructured":"Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, and Jingjing Liu. 2020. Large-scale adversarial training for vision-and-language representation learning. Adv. Neural Info. Process. Syst. 33 (2020), 6616\u20136628.","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_1_20_2","first-page":"2918","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Ghiasi Golnaz","year":"2021","unstructured":"Golnaz Ghiasi, Yin Cui, Aravind Srinivas, Rui Qian, Tsung-Yi Lin, Ekin D. Cubuk, Quoc V. Le, and Barret Zoph. 2021. Simple copy-paste is a strong data augmentation method for instance segmentation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 2918\u20132928."},{"key":"e_1_3_1_21_2","first-page":"4918","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"He Kaiming","year":"2019","unstructured":"Kaiming He, Ross Girshick, and Piotr Doll\u00e1r. 2019. Rethinking imagenet pre-training. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 4918\u20134927."},{"key":"e_1_3_1_22_2","first-page":"770","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He Kaiming","year":"2016","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.51.4282"},{"key":"e_1_3_1_24_2","first-page":"804","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)","author":"Hu R.","year":"2017","unstructured":"R. Hu, J. Andreas, M. Rohrbach, T. Darrell, and K. Saenko. 2017. Learning to reason: End-to-end module networks for visual question answering. In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917). IEEE Computer Society, Los Alamitos, CA, 804\u2013813."},{"key":"e_1_3_1_25_2","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Hu Ronghang","year":"2017","unstructured":"Ronghang Hu, Marcus Rohrbach, Jacob Andreas, Trevor Darrell, and Kate Saenko. 2017. Modeling relationships in referential expressions with compositional modular networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)."},{"key":"e_1_3_1_26_2","first-page":"4555","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Hu Ronghang","year":"2016","unstructured":"Ronghang Hu, Huazhe Xu, Marcus Rohrbach, Jiashi Feng, Kate Saenko, and Trevor Darrell. 2016. Natural language object retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4555\u20134564."},{"key":"e_1_3_1_27_2","first-page":"1780","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Kamath Aishwarya","year":"2021","unstructured":"Aishwarya Kamath, Mannat Singh, Yann LeCun, Gabriel Synnaeve, Ishan Misra, and Nicolas Carion. 2021. MDETR-modulated detection for end-to-end multi-modal understanding. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 1780\u20131790."},{"key":"e_1_3_1_28_2","volume-title":"Proceedings of the Conference for Learning Representations","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma and J. Ba. 2014. Adam: A method for stochastic optimization. In Proceedings of the Conference for Learning Representations."},{"issue":"1","key":"e_1_3_1_29_2","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1007\/s11263-016-0981-7","article-title":"Visual Genome: Connecting language and vision using crowdsourced dense image annotations","volume":"123","author":"Krishna Ranjay","year":"2017","unstructured":"Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A. Shamma et\u00a0al. 2017. Visual Genome: Connecting language and vision using crowdsourced dense image annotations. Int. J. Comput. Vision 123, 1 (2017), 32\u201373.","journal-title":"Int. J. Comput. Vision"},{"key":"e_1_3_1_30_2","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201919)","author":"Li Guohao","year":"2019","unstructured":"Guohao Li, Matthias Muller, Ali Thabet, and Bernard Ghanem. 2019. DeepGCNs: Can GCNs Go As Deep As CNNs?. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201919)."},{"key":"e_1_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Kun Li Jiaxiu Li Dan Guo Xun Yang and Meng Wang. 2023. Transformer-based visual grounding with cross-modality interaction. ACM Transactions on Multimedia Computing Communications and Applications 19 6 (2023) 1\u201319.","DOI":"10.1145\/3587251"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359753"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3489142"},{"key":"e_1_3_1_34_2","first-page":"10880","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Liao Yue","year":"2020","unstructured":"Yue Liao, Si Liu, Guanbin Li, Fei Wang, Yanjie Chen, Chen Qian, and Bo Li. 2020. A real-time cross-modality correlation filtering method for referring expression comprehension. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 10880\u201310889."},{"key":"e_1_3_1_35_2","first-page":"20123","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201922)","author":"Liao Yue","year":"2022","unstructured":"Yue Liao, Aixi Zhang, Miao Lu, Yongliang Wang, Xiaobo Li, and Si Liu. 2022. GEN-VLKT: Simplify association and enhance interaction understanding for HOI detection. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201922). 20123\u201320132."},{"key":"e_1_3_1_36_2","first-page":"20123","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Liao Yue","year":"2022","unstructured":"Yue Liao, Aixi Zhang, Miao Lu, Yongliang Wang, Xiaobo Li, and Si Liu. 2022. Gen-vlkt: Simplify association and enhance interaction understanding for HOI detection. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20123\u201320132."},{"key":"e_1_3_1_37_2","first-page":"740","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Lin Tsung-Yi","year":"2014","unstructured":"Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll\u00e1r, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In Proceedings of the European Conference on Computer Vision. Springer, 740\u2013755."},{"key":"e_1_3_1_38_2","first-page":"730","volume-title":"Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition (ACPR\u201915)","author":"Liu Shuying","year":"2015","unstructured":"Shuying Liu and Weihong Deng. 2015. Very deep convolutional neural network-based image classification using small training sample size. In Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition (ACPR\u201915). 730\u2013734. DOI:10.1109\/ACPR.2015.7486599"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2022.3197365"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2021.01.011"},{"key":"e_1_3_1_41_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201920)","author":"Luo Gen","year":"2020","unstructured":"Gen Luo, Yiyi Zhou, Xiaoshuai Sun, Liujuan Cao, Chenglin Wu, Cheng Deng, and Rongrong Ji. 2020. Multi-task collaborative network for joint referring expression comprehension and segmentation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201920). 10034\u201310043."},{"key":"e_1_3_1_42_2","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.neucom.2022.07.028","article-title":"CLIP4Clip: An empirical study of CLIP for end to end video clip retrieval and captioning","volume":"508","author":"Luo Huaishao","year":"2022","unstructured":"Huaishao Luo, Lei Ji, Ming Zhong, Yang Chen, Wen Lei, Nan Duan, and Tianrui Li. 2022. CLIP4Clip: An empirical study of CLIP for end to end video clip retrieval and captioning. Neurocomputing 508 (2022), 293\u2013304.","journal-title":"Neurocomputing"},{"key":"e_1_3_1_43_2","first-page":"7102","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Luo Ruotian","year":"2017","unstructured":"Ruotian Luo and Gregory Shakhnarovich. 2017. Comprehension-guided referring expressions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7102\u20137111."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3050059"},{"key":"e_1_3_1_45_2","first-page":"11","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Mao Junhua","year":"2016","unstructured":"Junhua Mao, Jonathan Huang, Alexander Toshev, Oana Camburu, Alan L Yuille, and Kevin Murphy. 2016. Generation and comprehension of unambiguous object descriptions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11\u201320."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3451390"},{"key":"e_1_3_1_47_2","first-page":"792","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201916)","author":"Nagaraja Varun K.","year":"2016","unstructured":"Varun K. Nagaraja, Vlad I. Morariu, and Larry S. Davis. 2016. Modeling context between objects for referring expression understanding. In Proceedings of the European Conference on Computer Vision (ECCV\u201916). Springer, 792\u2013807."},{"key":"e_1_3_1_48_2","article-title":"Im2text: Describing images using 1 million captioned photographs","volume":"24","author":"Ordonez Vicente","year":"2011","unstructured":"Vicente Ordonez, Girish Kulkarni, and Tamara Berg. 2011. Im2text: Describing images using 1 million captioned photographs. Adv. Neural Info. Process. Syst. 24 (2011).","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_1_49_2","first-page":"2641","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Plummer Bryan A.","year":"2015","unstructured":"Bryan A. Plummer, Liwei Wang, Chris M. Cervantes, Juan C. Caicedo, Julia Hockenmaier, and Svetlana Lazebnik. 2015. Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models. In Proceedings of the IEEE International Conference on Computer Vision. 2641\u20132649."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3451215"},{"key":"e_1_3_1_51_2","first-page":"210","volume-title":"Proceedings of the 21st IEEE International Conference on Mobile Data Management (MDM\u201920)","author":"Qin Tianxiang","year":"2020","unstructured":"Tianxiang Qin, Tong Liu, Hexiang Wu, Weiqin Tong, and Shimin Zhao. 2020. RESGCN: RESidual graph convolutional network-based free dock prediction in bike sharing system. In Proceedings of the 21st IEEE International Conference on Mobile Data Management (MDM\u201920). 210\u2013217. DOI:10.1109\/MDM48529.2020.00044"},{"key":"e_1_3_1_52_2","first-page":"546","volume-title":"Proceedings of the 17th European Conference on Computer Vision (ECCV\u201922)","author":"Qu Mengxue","year":"2022","unstructured":"Mengxue Qu, Yu Wu, Wu Liu, Qiqi Gong, Xiaodan Liang, Olga Russakovsky, Yao Zhao, and Yunchao Wei. 2022. SiRi: A simple selective retraining mechanism for transformer-based visual grounding. In Proceedings of the 17th European Conference on Computer Vision (ECCV\u201922). Springer, 546\u2013562."},{"key":"e_1_3_1_53_2","unstructured":"Alec Radford Jong Wook Kim Chris Hallacy Aditya Ramesh Gabriel Goh Sandhini Agarwal Girish Sastry Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger and Ilya Sutskever. 2021. Learning transferable visual models from natural language supervision.Proceedings of Machine Learning Research vol. 139 Marina Meila and Tong Zhang (Eds.). 8748\u20138763."},{"key":"e_1_3_1_54_2","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"28","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. Adv. Neural Info. Process. Syst. 28 (2015).","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_1_55_2","doi-asserted-by":"crossref","unstructured":"Anna Rohrbach Marcus Rohrbach Ronghang Hu Trevor Darrell and Bernt Schiele. 2016. Grounding of Textual Phrases in Images by Reconstruction. In Proceedings of the European Conference on Computer Vision (ECCV\u201916) . 817\u2013834.","DOI":"10.1007\/978-3-319-46448-0_49"},{"key":"e_1_3_1_56_2","first-page":"4694","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Sadhu Arka","year":"2019","unstructured":"Arka Sadhu, Kan Chen, and Ram Nevatia. 2019. Zero-shot grounding of objects from natural language queries. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 4694\u20134703."},{"issue":"5","key":"e_1_3_1_57_2","doi-asserted-by":"crossref","first-page":"49","DOI":"10.4000\/ijcol.478","article-title":"Large-scale datasets for image and video captioning in Italian","volume":"2","author":"Scaiella Antonio","year":"2019","unstructured":"Antonio Scaiella, Danilo Croce, and Roberto Basili. 2019. Large-scale datasets for image and video captioning in Italian. Ital. J. Comput. Linguist. 2, 5 (2019), 49\u201360.","journal-title":"Ital. J. Comput. Linguist."},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_3_1_59_2","first-page":"2556","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics","author":"Sharma Piyush","year":"2018","unstructured":"Piyush Sharma, Nan Ding, Sebastian Goodman, and Radu Soricut. 2018. Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. 2556\u20132565."},{"key":"e_1_3_1_60_2","article-title":"How much can clip benefit vision-and-language tasks?","author":"Shen Sheng","year":"2021","unstructured":"Sheng Shen, Liunian Harold Li, Hao Tan, Mohit Bansal, Anna Rohrbach, Kai-Wei Chang, Zhewei Yao, and Kurt Keutzer. 2021. How much can clip benefit vision-and-language tasks? Retrieved from https:\/\/arXiv:2107.06383.","journal-title":"Retrieved from https:\/\/arXiv:2107.06383"},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","unstructured":"Chon Hou Sio Yu-Jen Ma Hong-Han Shuai Jun-Cheng Chen and Wen-Huang Cheng. 2020. S2SiamFC: Self-supervised fully convolutional Siamese network for visual tracking. In Proceedings of the 28th ACM International Conference on Multimedia (MM\u201920). 1948\u20131957. DOI:10.1145\/3394171.3413611","DOI":"10.1145\/3394171.3413611"},{"key":"e_1_3_1_62_2","first-page":"1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Szegedy Christian","year":"2015","unstructured":"Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1\u20139."},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2298982"},{"key":"e_1_3_1_64_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Adv. Neural Info. Process. Sys. 30 (2017).","journal-title":"Adv. Neural Info. Process. Sys."},{"key":"e_1_3_1_65_2","article-title":"Graph attention networks","author":"Veli\u010dkovi\u0107 Petar","year":"2018","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph attention networks. In Proceedings of the International Conference on Learning Representations.","journal-title":"Proceedings of the International Conference on Learning Representations"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2022.3181759"},{"key":"e_1_3_1_67_2","doi-asserted-by":"crossref","unstructured":"Jia Wang Hung-Yi Wu Jun-Cheng Chen Hong-Han Shuai and Wen-Huang Cheng. 2022. Residual graph attention network and expression-respect data augmentation aided visual grounding. In Proceedings of the IEEE International Conference on Image Processing (ICIP\u201922). 326\u2013330. DOI:10.1109\/ICIP46576.2022.9897564","DOI":"10.1109\/ICIP46576.2022.9897564"},{"key":"e_1_3_1_68_2","first-page":"5005","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Wang Liwei","year":"2016","unstructured":"Liwei Wang, Yin Li, and Svetlana Lazebnik. 2016. Learning deep structure-preserving image-text embeddings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5005\u20135013."},{"key":"e_1_3_1_69_2","doi-asserted-by":"crossref","unstructured":"Peng Wang Qi Wu Jiewei Cao Chunhua Shen Lianli Gao and Anton van den Hengel. 2019. Neighbourhood watch: Referring expression comprehension via language-guided graph attention networks. In IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201919). 1960\u20131968.","DOI":"10.1109\/CVPR.2019.00206"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2022.05.024"},{"key":"e_1_3_1_71_2","doi-asserted-by":"crossref","unstructured":"Hong-Xia Xie Ling Lo Hong-Han Shuai and Wen-Huang Cheng. 2020. AU-assisted graph attention convolutional network for micro-expression recognition. In Proceedings of the 28th ACM International Conference on Multimedia (MM\u201920) . 2871\u20132880. DOI:10.1145\/3394171.3414012","DOI":"10.1145\/3394171.3414012"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3386725"},{"key":"e_1_3_1_73_2","first-page":"9499","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision Pattern Recognition.","author":"Yang Li","year":"2022","unstructured":"Li Yang, Yan Xu, Chunfeng Yuan, Wei Liu, Bing Li, and Weiming Hu. 2022. Improving visual grounding with visual-linguistic verification and iterative reasoning. In Proceedings of the IEEE\/CVF Conference on Computer Vision Pattern Recognition.9499\u20139508."},{"key":"e_1_3_1_74_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201919)","author":"Yang Sibei","year":"2019","unstructured":"Sibei Yang, Guanbin Li, and Yizhou Yu. 2019. Cross-modal relationship inference for grounding referring expressions. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR\u201919)."},{"key":"e_1_3_1_75_2","first-page":"4643","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201919)","author":"Yang S.","year":"2019","unstructured":"S. Yang, G. Li, and Y. Yu. 2019. Dynamic graph attention for referring expression comprehension. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV\u201919). IEEE Computer Society, Los Alamitos, CA, USA, 4643\u20134652. DOI:10.1109\/ICCV.2019.00474"},{"key":"e_1_3_1_76_2","first-page":"9952","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Yang Sibei","year":"2020","unstructured":"Sibei Yang, Guanbin Li, and Yizhou Yu. 2020. Graph-structured referring expression reasoning in the wild. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 9952\u20139961."},{"issue":"8","key":"e_1_3_1_77_2","doi-asserted-by":"crossref","first-page":"2765","DOI":"10.1109\/TPAMI.2020.2973983","article-title":"Relationship-embedded representation learning for grounding referring expressions","volume":"43","author":"Yang Sibei","year":"2020","unstructured":"Sibei Yang, Guanbin Li, and Yizhou Yu. 2020. Relationship-embedded representation learning for grounding referring expressions. IEEE Trans. Pattern Anal. Mach. Intell. 43, 8 (2020), 2765\u20132779.","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"e_1_3_1_78_2","first-page":"4683","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Yang Zhengyuan","year":"2019","unstructured":"Zhengyuan Yang, Boqing Gong, Liwei Wang, Wenbing Huang, Dong Yu, and Jiebo Luo. 2019. A fast and accurate one-stage approach to visual grounding. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 4683\u20134693."},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316767"},{"key":"e_1_3_1_80_2","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918)","author":"Yu Licheng","year":"2018","unstructured":"Licheng Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Mohit Bansal, and Tamara L. Berg. 2018. MAttNet: Modular attention network for referring expression comprehension. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918)."},{"key":"e_1_3_1_81_2","first-page":"69","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Yu Licheng","year":"2016","unstructured":"Licheng Yu, Patrick Poirson, Shan Yang, Alexander C. Berg, and Tamara L. Berg. 2016. Modeling context in referring expressions. In Proceedings of the European Conference on Computer Vision. Springer, 69\u201385."},{"key":"e_1_3_1_82_2","first-page":"7282","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Yu Licheng","year":"2017","unstructured":"Licheng Yu, Hao Tan, Mohit Bansal, and Tamara L. Berg. 2017. A joint speaker-listener-reinforcer model for referring expressions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7282\u20137290."},{"key":"e_1_3_1_83_2","first-page":"4158","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhang Hanwang","year":"2018","unstructured":"Hanwang Zhang, Yulei Niu, and Shih-Fu Chang. 2018. Grounding referring expressions in images by variational context. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4158\u20134166."},{"issue":"1","key":"e_1_3_1_84_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40649-019-0069-y","article-title":"Graph convolutional networks: A comprehensive review","volume":"6","author":"Zhang Si","year":"2019","unstructured":"Si Zhang, Hanghang Tong, Jiejun Xu, and Ross Maciejewski. 2019. Graph convolutional networks: A comprehensive review. Comput. Soc. Netw. 6, 1 (2019), 1\u201323.","journal-title":"Comput. Soc. Netw."},{"key":"e_1_3_1_85_2","first-page":"3598","volume-title":"Proceedings of the 36th AAAI Conference on Artificial Intelligence (AAAI\u201922)","author":"Zhu Chao","year":"2022","unstructured":"Chao Zhu, Hang Dong, Jinshan Pan, Boyang Liang, Yuhao Huang, Lean Fu, and Fei Wang. 2022. Deep recurrent neural network with multi-scale BI-directional propagation for video deblurring. In Proceedings of the 36th AAAI Conference on Artificial Intelligence (AAAI\u201922). AAAI Press, 3598\u20133607."},{"key":"e_1_3_1_86_2","first-page":"4252","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhuang Bohan","year":"2018","unstructured":"Bohan Zhuang, Qi Wu, Chunhua Shen, Ian Reid, and Anton Van Den Hengel. 2018. Parallel attention: A unified framework for visual object discovery through dialogs and queries. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4252\u20134261."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604557","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604557","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:19Z","timestamp":1750178839000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604557"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,24]]},"references-count":85,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,31]]}},"alternative-id":["10.1145\/3604557"],"URL":"https:\/\/doi.org\/10.1145\/3604557","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,24]]},"assertion":[{"value":"2022-11-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}