{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:50Z","timestamp":1750219970665,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FCT - Project NOVA LINCS","award":["UIDB\/04516\/2020"],"award-info":[{"award-number":["UIDB\/04516\/2020"]}]},{"name":"CMU Portugall iFetch project - ERDF, COMPETE 2020, NORTE 2020 and FCT","award":["45920"],"award-info":[{"award-number":["45920"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,10]]},"DOI":"10.1145\/3503161.3548430","type":"proceedings-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T15:42:46Z","timestamp":1665416566000},"page":"5821-5832","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Understanding News Text and Images Connection with Context-enriched Multimodal Transformers"],"prefix":"10.1145","author":[{"given":"Cl\u00e1udio","family":"Bartolomeu","sequence":"first","affiliation":[{"name":"NOVA School of Science and Technology, Caparica, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"N\u00f3brega","sequence":"additional","affiliation":[{"name":"NOVA School of Science and Technology, Caparica, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Semedo","sequence":"additional","affiliation":[{"name":"NOVA School of Science and Technology, Caparica, Portugal"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_2_1_1","DOI":"10.1109\/CVPR.2018.00636"},{"key":"e_1_3_2_2_2_1","volume-title":"2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society","author":"Biten A.","year":"2019","unstructured":"A. Biten , L. Gomez , M. Rusinol , and D. Karatzas . 2019. Good News, Everyone! Context Driven Entity-Aware Captioning for News Images . In 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society , Los Alamitos, CA, USA, 12458--12467. https:\/\/doi.org\/10.1109\/CVPR. 2019 .01275 10.1109\/CVPR.2019.01275 A. Biten, L. Gomez, M. Rusinol, and D. Karatzas. 2019. Good News, Everyone! Context Driven Entity-Aware Captioning for News Images. In 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 12458--12467. https:\/\/doi.org\/10.1109\/CVPR.2019.01275"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_3_1","DOI":"10.1109\/ICCV48922.2021.00045"},{"key":"e_1_3_2_2_4_1","volume-title":"Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu.","author":"Chen Yen-Chun","year":"2020","unstructured":"Yen-Chun Chen , Linjie Li , Licheng Yu , Ahmed El Kholy , Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020 . UNITER : UNiversal Image-TExt Representation Learning. In Computer Vision -- ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XXX (Glasgow, United Kingdom). Springer-Verlag , Berlin, Heidelberg, 104--120. https:\/\/doi.org\/10.1007\/978-3-030-58577-8_7 10.1007\/978-3-030-58577-8_7 Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020. UNITER: UNiversal Image-TExt Representation Learning. In Computer Vision -- ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XXX (Glasgow, United Kingdom). Springer-Verlag, Berlin, Heidelberg, 104--120. https:\/\/doi.org\/10.1007\/978-3-030-58577-8_7"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"1942","author":"Cho Jaemin","year":"2021","unstructured":"Jaemin Cho , Jie Lei , Hao Tan , and Mohit Bansal . 2021 . Unifying Vision-and-Language Tasks via Text Generation . In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 1931-- 1942 . https:\/\/proceedings.mlr.press\/v139\/cho21a.html Jaemin Cho, Jie Lei, Hao Tan, and Mohit Bansal. 2021. Unifying Vision-and-Language Tasks via Text Generation. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 1931--1942. https:\/\/proceedings.mlr.press\/v139\/cho21a.html"},{"key":"e_1_3_2_2_6_1","first-page":"19","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10. 18653\/v1\/N 19 - 1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_2_7_1","volume-title":"AAAI Workshop on Deep Learning on Graphs: Methods and Applications","author":"Dwivedi Vijay Prakash","year":"2021","unstructured":"Vijay Prakash Dwivedi and Xavier Bresson . 2021 . A Generalization of Transformer Networks to Graphs . AAAI Workshop on Deep Learning on Graphs: Methods and Applications (2021). Vijay Prakash Dwivedi and Xavier Bresson. 2021. A Generalization of Transformer Networks to Graphs. AAAI Workshop on Deep Learning on Graphs: Methods and Applications (2021)."},{"key":"e_1_3_2_2_8_1","volume-title":"Jamie Ryan Kiros, and Sanja Fidler","author":"Faghri Fartash","year":"2018","unstructured":"Fartash Faghri , David J Fleet , Jamie Ryan Kiros, and Sanja Fidler . 2018 . VSE : Improving Visual-Semantic Embeddings with Hard Negatives . (2018). https:\/\/github.com\/fartashf\/vsepp Fartash Faghri, David J Fleet, Jamie Ryan Kiros, and Sanja Fidler. 2018. VSE: Improving Visual-Semantic Embeddings with Hard Negatives. (2018). https:\/\/github.com\/fartashf\/vsepp"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_9_1","DOI":"10.3390\/jimaging7080125"},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of the 5th Linguistic Annotation Workshop. Association for Computational Linguistics","author":"Grouin Cyril","year":"2011","unstructured":"Cyril Grouin , Sophie Rosset , Pierre Zweigenbaum , Kar\u00ebn Fort , Olivier Galibert , and Ludovic Quintard . 2011 . Proposal for an Extension of Traditional Named Entities: From Guidelines to Evaluation, an Overview . In Proceedings of the 5th Linguistic Annotation Workshop. Association for Computational Linguistics , Portland, Oregon, USA, 92--100. https:\/\/aclanthology.org\/W11-0411 Cyril Grouin, Sophie Rosset, Pierre Zweigenbaum, Kar\u00ebn Fort, Olivier Galibert, and Ludovic Quintard. 2011. Proposal for an Extension of Traditional Named Entities: From Guidelines to Evaluation, an Overview. In Proceedings of the 5th Linguistic Annotation Workshop. Association for Computational Linguistics, Portland, Oregon, USA, 92--100. https:\/\/aclanthology.org\/W11-0411"},{"unstructured":"Matthew Honnibal and Ines Montani. 2017. spaCy 2: Natural language understanding with Bloom embeddings convolutional neural networks and incremental parsing. https:\/\/spacy.io\/  Matthew Honnibal and Ines Montani. 2017. spaCy 2: Natural language understanding with Bloom embeddings convolutional neural networks and incremental parsing. https:\/\/spacy.io\/","key":"e_1_3_2_2_11_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_12_1","DOI":"10.18653\/v1\/P19-1356"},{"doi-asserted-by":"crossref","unstructured":"Xin Jin and Jiawei Han. 2010. K-Means Clustering. Springer US Boston MA 563--564. https:\/\/doi.org\/10.1007\/978-0-387-30164-8_425 10.1007\/978-0-387-30164-8_425","key":"#cr-split#-e_1_3_2_2_13_1.1","DOI":"10.1007\/978-0-387-30164-8_425"},{"doi-asserted-by":"crossref","unstructured":"Xin Jin and Jiawei Han. 2010. K-Means Clustering. Springer US Boston MA 563--564. https:\/\/doi.org\/10.1007\/978-0-387-30164-8_425","key":"#cr-split#-e_1_3_2_2_13_1.2","DOI":"10.1007\/978-0-387-30164-8_425"},{"key":"e_1_3_2_2_14_1","volume-title":"Working Notes Proceedings of the MediaEval 2021 Workshop, Online, 13--15","author":"Kille Benjamin","year":"2021","unstructured":"Benjamin Kille , Andreas Lommatzsch , \u00d6zlem \u00d6zg\u00f6bek , Mehdi Elahi , and Duc-Tien Dang-Nguyen . 2021 . News Images in MediaEval 2021 . In Working Notes Proceedings of the MediaEval 2021 Workshop, Online, 13--15 December 2021. Benjamin Kille, Andreas Lommatzsch, \u00d6zlem \u00d6zg\u00f6bek, Mehdi Elahi, and Duc-Tien Dang-Nguyen. 2021. News Images in MediaEval 2021. In Working Notes Proceedings of the MediaEval 2021 Workshop, Online, 13--15 December 2021."},{"key":"e_1_3_2_2_15_1","volume-title":"Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba . 2014 . Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12 2014). Diederik Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12 2014)."},{"unstructured":"Niki Kitsantonis Christina Anderson and Emma Bubola. 2022. Countries previously hostile to refugees embrace Ukrainians. https:\/\/www.nytimes.com\/2022\/03\/17\/world\/europe\/europe-countries-refugees-embrace-ukrainians.html'searchResultPosition=11  Niki Kitsantonis Christina Anderson and Emma Bubola. 2022. Countries previously hostile to refugees embrace Ukrainians. https:\/\/www.nytimes.com\/2022\/03\/17\/world\/europe\/europe-countries-refugees-embrace-ukrainians.html'searchResultPosition=11","key":"e_1_3_2_2_16_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_17_1","DOI":"10.1007\/s11263-016-0981-7"},{"key":"e_1_3_2_2_18_1","volume-title":"Computer Vision -- ECCV","author":"Lee Kuang-Huei","year":"2019","unstructured":"Kuang-Huei Lee , Xi Chen , Gang Hua , Houdong Hu , and Xiaodong He. 2018. Stacked Cross Attention for Image-Text Matching . In Computer Vision -- ECCV 2019 ,, Vittorio Ferrari, Martial Hebert , Cristian Sminchisescu, and Yair Weiss (Eds.). Springer International Publishing , Cham, 212--228. Kuang-Huei Lee, Xi Chen, Gang Hua, Houdong Hu, and Xiaodong He. 2018. Stacked Cross Attention for Image-Text Matching. In Computer Vision -- ECCV 2019,, Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.). Springer International Publishing, Cham, 212--228."},{"unstructured":"Liunian Harold Li Mark Yatskar Da Yin Cho-Jui Hsieh and Kai-Wei Chang. 2019. VisualBERT: A Simple and Performant Baseline for Vision and Language. In Arxiv.  Liunian Harold Li Mark Yatskar Da Yin Cho-Jui Hsieh and Kai-Wei Chang. 2019. VisualBERT: A Simple and Performant Baseline for Vision and Language. In Arxiv.","key":"e_1_3_2_2_19_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_20_1","DOI":"10.1007\/978-3-319-10602-1_48"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_21_1","DOI":"10.1145\/3396520"},{"volume-title":"NewsImages: Addressing the Depiction Gap with an Online News Dataset for Text-Image Rematching (MMSys '22)","author":"Lommatzsch Andreas","unstructured":"Andreas Lommatzsch , Benjamin Kille , \u00d6zlem \u00d6zg\u00f6bek , Mingliang Liang , Yuxiao Zhou , Jelena Tesic , Bartolomeu Cl\u00e1udio , Semedo David , Lidia Pivovarova , and Martha Larson . 2022. NewsImages: Addressing the Depiction Gap with an Online News Dataset for Text-Image Rematching (MMSys '22) . Association for Computing Machinery , New York, NY, USA . Andreas Lommatzsch, Benjamin Kille, \u00d6zlem \u00d6zg\u00f6bek, Mingliang Liang, Yuxiao Zhou, Jelena Tesic, Bartolomeu Cl\u00e1udio, Semedo David, Lidia Pivovarova, and Martha Larson. 2022. NewsImages: Addressing the Depiction Gap with an Online News Dataset for Text-Image Rematching (MMSys '22). Association for Computing Machinery, New York, NY, USA.","key":"e_1_3_2_2_22_1"},{"key":"e_1_3_2_2_23_1","volume-title":"Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. dtextquotesingle Alch\u00e9-Buc","author":"Lu Jiasen","year":"2019","unstructured":"Jiasen Lu , Dhruv Batra , Devi Parikh , and Stefan Lee . 2019. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks . In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. dtextquotesingle Alch\u00e9-Buc , E. Fox, and R. Garnett (Eds.), Vol. 32 . Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/ 2019 \/file\/c74d97b01eae257e44aa9d5bade97baf-Paper.pdf Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. dtextquotesingle Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/c74d97b01eae257e44aa9d5bade97baf-Paper.pdf"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_24_1","DOI":"10.1145\/3206025.3206053"},{"key":"e_1_3_2_2_25_1","volume-title":"Saverio Blasi, Jo ao Magalh aes, and Marta Mrak.","author":"Marcelino Gonccalo","year":"2021","unstructured":"Gonccalo Marcelino , David Semedo , Andr\u00e9 Mour ao , Saverio Blasi, Jo ao Magalh aes, and Marta Mrak. 2021 . Assisting News Media Editors with Cohesive Visual Storylines. Association for Computing Machinery , New York, NY, USA, 3257--3265. https:\/\/doi.org\/10.1145\/3474085.3475476 10.1145\/3474085.3475476 Gonccalo Marcelino, David Semedo, Andr\u00e9 Mour ao, Saverio Blasi, Jo ao Magalh aes, and Marta Mrak. 2021. Assisting News Media Editors with Cohesive Visual Storylines. Association for Computing Machinery, New York, NY, USA, 3257--3265. https:\/\/doi.org\/10.1145\/3474085.3475476"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_26_1","DOI":"10.1145\/3323873.3325047"},{"volume-title":"The role of images in framing news stories","author":"Messaris Paul","unstructured":"Paul Messaris and Linus Abraham . 2001. The role of images in framing news stories . Lawrence Erlbaum Associates Publishers , Mahwah, NJ , US, 215--226. Paul Messaris and Linus Abraham. 2001. The role of images in framing news stories. Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US, 215--226.","key":"e_1_3_2_2_27_1"},{"key":"e_1_3_2_2_28_1","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association","author":"Oostdijk Nelleke","year":"2020","unstructured":"Nelleke Oostdijk , Hans van Halteren , Erkan Ba?ar, and Martha Larson . 2020 . The Connection between the Text and Images of News Articles: New Insights for Multimedia Analysis . In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association , Marseille, France, 4343--4351. https:\/\/aclanthology.org\/ 2020.lrec-1.535 Nelleke Oostdijk, Hans van Halteren, Erkan Ba?ar, and Martha Larson. 2020. The Connection between the Text and Images of News Articles: New Insights for Multimedia Analysis. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 4343--4351. https:\/\/aclanthology.org\/2020.lrec-1.535"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_29_1","DOI":"10.24963\/ijcai.2017\/737"},{"key":"e_1_3_2_2_30_1","volume-title":"Garnett (Eds.)","volume":"28","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren , Kaiming He , Ross Girshick , and Jian Sun . 2015 . Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In Advances in Neural Information Processing Systems,, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R . Garnett (Eds.) , Vol. 28 . Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/ 2015\/file\/14bfa6bb14875e45bba028a21ed38046-Paper.pdf Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In Advances in Neural Information Processing Systems,, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett (Eds.), Vol. 28. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/2015\/file\/14bfa6bb14875e45bba028a21ed38046-Paper.pdf"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_31_1","DOI":"10.1109\/CVPR.2015.7298682"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_32_1","DOI":"10.1145\/3343031.3351030"},{"key":"e_1_3_2_2_33_1","volume-title":"Proceedings of the Conference","author":"Tan Hao","year":"2019","unstructured":"Hao Tan and Mohit Bansal . 2019. LXMert: Learning cross-modality encoder representations from transformers. EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing , Proceedings of the Conference ( 2019 ), 5100--5111. https:\/\/doi.org\/10.18653\/v1\/d19--1514 arxiv: 1908.07490 10.18653\/v1 Hao Tan and Mohit Bansal. 2019. LXMert: Learning cross-modality encoder representations from transformers. EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference (2019), 5100--5111. https:\/\/doi.org\/10.18653\/v1\/d19--1514 arxiv: 1908.07490"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_34_1","DOI":"10.1609\/aaai.v34i05.6437"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_35_1","DOI":"10.1109\/CVPR42600.2020.01305"},{"key":"e_1_3_2_2_36_1","volume-title":"Attention Is All You Need. NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , and Illia Polosukhin . 2017 . Attention Is All You Need. NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems (2017). arxiv: 1706.03762 [cs.CL] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems (2017). arxiv: 1706.03762 [cs.CL]"},{"key":"e_1_3_2_2_37_1","volume-title":"2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society","author":"Vinyals O.","year":"2015","unstructured":"O. Vinyals , A. Toshev , S. Bengio , and D. Erhan . 2015. Show and tell: A neural image caption generator . In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society , Los Alamitos, CA, USA, 3156--3164. https:\/\/doi.org\/10.1109\/CVPR. 2015 .7298935 10.1109\/CVPR.2015.7298935 O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. 2015. Show and tell: A neural image caption generator. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 3156--3164. https:\/\/doi.org\/10.1109\/CVPR.2015.7298935"},{"unstructured":"Ali Watkins. 2021. Why New York City may soon be more walkable for blind people. https:\/\/www.nytimes.com\/2021\/12\/27\/nyregion\/nyc-crosswalk-blind-people.html  Ali Watkins. 2021. Why New York City may soon be more walkable for blind people. https:\/\/www.nytimes.com\/2021\/12\/27\/nyregion\/nyc-crosswalk-blind-people.html","key":"e_1_3_2_2_38_1"},{"key":"e_1_3_2_2_39_1","volume-title":"Proceedings of the 2021 Conference of the North American","author":"Xiao Dongling","year":"1865","unstructured":"Dongling Xiao , Yu-Kun Li , Han Zhang , Yu Sun , Hao Tian , Hua Wu , and Haifeng Wang . 2021. ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding . In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics , Online , 1702--1715. https:\/\/doi.org\/10. 1865 3\/v1\/2021.naacl-main.136 10.18653\/v1 Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, and Haifeng Wang. 2021. ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Online, 1702--1715. https:\/\/doi.org\/10.18653\/v1\/2021.naacl-main.136"},{"key":"e_1_3_2_2_40_1","volume-title":"Attend and Tell: Neural Image Caption Generation with Visual Attention. In Proceedings of the 32nd International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"2057","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron Courville , Ruslan Salakhudinov , Rich Zemel , and Yoshua Bengio . 2015 . Show , Attend and Tell: Neural Image Caption Generation with Visual Attention. In Proceedings of the 32nd International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 37), Francis Bach and David Blei (Eds.). PMLR, Lille, France, 2048-- 2057 . https:\/\/proceedings.mlr.press\/v37\/xuc15.html Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In Proceedings of the 32nd International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 37), Francis Bach and David Blei (Eds.). PMLR, Lille, France, 2048--2057. https:\/\/proceedings.mlr.press\/v37\/xuc15.html"},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_41_1","DOI":"10.1109\/LSP.2016.2603342"},{"key":"e_1_3_2_2_42_1","volume-title":"VinVL: Making Visual Representations Matter in Vision-Language Models. CVPR 2021","author":"Zhang Pengchuan","year":"2021","unstructured":"Pengchuan Zhang , Xiujun Li , Xiaowei Hu , Jianwei Yang , Lei Zhang , Lijuan Wang , Yejin Choi , and Jianfeng Gao . 2021 a. VinVL: Making Visual Representations Matter in Vision-Language Models. CVPR 2021 (2021). Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, and Jianfeng Gao. 2021a. VinVL: Making Visual Representations Matter in Vision-Language Models. CVPR 2021 (2021)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_2_43_1","DOI":"10.24963\/ijcai.2021\/462"}],"event":{"sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"acronym":"MM '22","name":"MM '22: The 30th ACM International Conference on Multimedia","location":"Lisboa Portugal"},"container-title":["Proceedings of the 30th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548430","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3548430","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:17Z","timestamp":1750182557000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":44,"alternative-id":["10.1145\/3503161.3548430","10.1145\/3503161"],"URL":"https:\/\/doi.org\/10.1145\/3503161.3548430","relation":{},"subject":[],"published":{"date-parts":[[2022,10,10]]},"assertion":[{"value":"2022-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}