{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T09:53:37Z","timestamp":1766138017884,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100017596","name":"Natural Science Basic Research Program of Shaanxi Province","doi-asserted-by":"publisher","award":["No. 2021JCW-03"],"award-info":[{"award-number":["No. 2021JCW-03"]}],"id":[{"id":"10.13039\/501100017596","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. U19B2037, No. 61876152"],"award-info":[{"award-number":["No. U19B2037, No. 61876152"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shaanxi Provincial Key R&D Program","award":["No. 2021KWZ-03"],"award-info":[{"award-number":["No. 2021KWZ-03"]}]},{"name":"National Key R&D Program of China","award":["No. 2020AAA0106900"],"award-info":[{"award-number":["No. 2020AAA0106900"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,6,27]]},"DOI":"10.1145\/3512527.3531379","type":"proceedings-article","created":{"date-parts":[[2022,6,23]],"date-time":"2022-06-23T22:23:32Z","timestamp":1656023012000},"page":"389-397","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Improving Image Captioning via Enhancing Dual-Side Context Awareness"],"prefix":"10.1145","author":[{"given":"Yiqi","family":"Gao","sequence":"first","affiliation":[{"name":"Northwestern Polytechnical University & National Engineering Lab for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Wang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University & National Engineering Lab for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Suo","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University & National Engineering Lab for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengyang","family":"Sun","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University & National Engineering Lab for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Wang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University & National Engineering Lab for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_24"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00636"},{"key":"e_1_3_2_2_3_1","volume-title":"Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie . 2005 . METEOR: An automatic metric for MT evaluation with improved correlation with human judgments . In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72 . Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization. 65--72."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01059"},{"key":"e_1_3_2_2_5_1","volume-title":"Alpha-Integration Pooling for Convolutional Neural Networks. arXiv preprint arXiv:1811.03436","author":"Eom Hayoung","year":"2018","unstructured":"Hayoung Eom and Heeyoul Choi . 2018. Alpha-Integration Pooling for Convolutional Neural Networks. arXiv preprint arXiv:1811.03436 ( 2018 ). Hayoung Eom and Heeyoul Choi. 2018. Alpha-Integration Pooling for Convolutional Neural Networks. arXiv preprint arXiv:1811.03436 (2018)."},{"key":"e_1_3_2_2_6_1","volume-title":"TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning. arXiv preprint arXiv:2106.10936","author":"Fan Zhihao","year":"2021","unstructured":"Zhihao Fan , Zhongyu Wei , Siyuan Wang , Ruize Wang , Zejun Li , Haijun Shan , and Xuanjing Huang . 2021 . TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning. arXiv preprint arXiv:2106.10936 (2021). Zhihao Fan, Zhongyu Wei, Siyuan Wang, Ruize Wang, Zejun Li, Haijun Shan, and Xuanjing Huang. 2021. TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning. arXiv preprint arXiv:2106.10936 (2021)."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888089.1888092"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01034"},{"key":"e_1_3_2_2_9_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"26","author":"Gupta Ankush","year":"2012","unstructured":"Ankush Gupta , Yashaswi Verma , and C Jawahar . 2012 . Choosing linguistics over vision to describe images . In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 26 . Ankush Gupta, Yashaswi Verma, and C Jawahar. 2012. Choosing linguistics over vision to describe images. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 26."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_2_11_1","volume-title":"Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415","author":"Hendrycks Dan","year":"2016","unstructured":"Dan Hendrycks and Kevin Gimpel . 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 ( 2016 ). Dan Hendrycks and Kevin Gimpel. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016)."},{"key":"e_1_3_2_2_12_1","volume-title":"Image captioning: Transforming objects into words. arXiv preprint arXiv:1906.05963","author":"Herdade Simao","year":"2019","unstructured":"Simao Herdade , Armin Kappeler , Kofi Boakye , and Joao Soares . 2019. Image captioning: Transforming objects into words. arXiv preprint arXiv:1906.05963 ( 2019 ). Simao Herdade, Armin Kappeler, Kofi Boakye, and Joao Soares. 2019. Image captioning: Transforming objects into words. arXiv preprint arXiv:1906.05963 (2019)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00473"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i2.16258"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01028"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"e_1_3_2_2_17_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_2_18_1","volume-title":"Babytalk: Understanding and generating simple image descriptions","author":"Kulkarni Girish","year":"2013","unstructured":"Girish Kulkarni , Visruth Premraj , Vicente Ordonez , Sagnik Dhar , Siming Li , Yejin Choi , Alexander C Berg , and Tamara L Berg . 2013 . Babytalk: Understanding and generating simple image descriptions . IEEE transactions on pattern analysis and machine intelligence 35, 12 (2013), 2891--2903. Girish Kulkarni, Visruth Premraj, Vicente Ordonez, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C Berg, and Tamara L Berg. 2013. Babytalk: Understanding and generating simple image descriptions. IEEE transactions on pattern analysis and machine intelligence 35, 12 (2013), 2891--2903."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00902"},{"key":"e_1_3_2_2_20_1","volume-title":"Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81.","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81. Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74--81."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_22_1","volume-title":"Dual-level collaborative transformer for image captioning. arXiv preprint arXiv:2101.06462","author":"Luo Yunpeng","year":"2021","unstructured":"Yunpeng Luo , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Yongjian Wu , Feiyue Huang , Chia-Wen Lin , and Rongrong Ji. 2021. Dual-level collaborative transformer for image captioning. arXiv preprint arXiv:2101.06462 ( 2021 ). Yunpeng Luo, Jiayi Ji, Xiaoshuai Sun, Liujuan Cao, Yongjian Wu, Feiyue Huang, Chia-Wen Lin, and Rongrong Ji. 2021. Dual-level collaborative transformer for image captioning. arXiv preprint arXiv:2101.06462 (2021)."},{"key":"e_1_3_2_2_23_1","volume-title":"Learnable pooling regions for image classification. arXiv preprint arXiv:1301.3516","author":"Malinowski Mateusz","year":"2013","unstructured":"Mateusz Malinowski and Mario Fritz . 2013. Learnable pooling regions for image classification. arXiv preprint arXiv:1301.3516 ( 2013 ). Mateusz Malinowski and Mario Fritz. 2013. Learnable pooling regions for image classification. arXiv preprint arXiv:1301.3516 (2013)."},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. 747--756","author":"Mitchell Margaret","year":"2012","unstructured":"Margaret Mitchell , Jesse Dodge , Amit Goyal , Kota Yamaguchi , Karl Stratos , Xufeng Han , Alyssa Mensch , Alexander Berg , Tamara Berg , and Hal Daum\u00e9 III. 2012 . Midge: Generating image descriptions from computer vision detections . In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. 747--756 . Margaret Mitchell, Jesse Dodge, Amit Goyal, Kota Yamaguchi, Karl Stratos, Xufeng Han, Alyssa Mensch, Alexander Berg, Tamara Berg, and Hal Daum\u00e9 III. 2012. Midge: Generating image descriptions from computer vision detections. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. 747--756."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01098"},{"key":"e_1_3_2_2_26_1","volume-title":"Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . Bleu: a method for automatic evaluation of machine translation . In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318 . Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 311--318."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.131"},{"key":"e_1_3_2_2_28_1","volume-title":"Image captioning with context-aware auxiliary guidance. arXiv preprint arXiv:2012.05545","author":"Song Zeliang","year":"2020","unstructured":"Zeliang Song , Xiaofei Zhou , Zhendong Mao , and Jianlong Tan . 2020. Image captioning with context-aware auxiliary guidance. arXiv preprint arXiv:2012.05545 ( 2020 ). Zeliang Song, Xiaofei Zhou, Zhendong Mao, and Jianlong Tan. 2020. Image captioning with context-aware auxiliary guidance. arXiv preprint arXiv:2012.05545 (2020)."},{"key":"e_1_3_2_2_29_1","unstructured":"Ilya Sutskever Oriol Vinyals and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems. 3104-- 3112.  Ilya Sutskever Oriol Vinyals and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems. 3104-- 3112."},{"key":"e_1_3_2_2_30_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_3_2_2_32_1","volume-title":"Show and tell: Lessons learned from the 2015 mscoco image captioning challenge","author":"Vinyals Oriol","year":"2016","unstructured":"Oriol Vinyals , Alexander Toshev , Samy Bengio , and Dumitru Erhan . 2016. Show and tell: Lessons learned from the 2015 mscoco image captioning challenge . IEEE transactions on pattern analysis and machine intelligence 39, 4 ( 2016 ), 652--663. Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. 2016. Show and tell: Lessons learned from the 2015 mscoco image captioning challenge. IEEE transactions on pattern analysis and machine intelligence 39, 4 (2016), 652--663."},{"key":"e_1_3_2_2_33_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 2641--2650","author":"Ma Lin","year":"2019","unstructured":"BairuiWang, Lin Ma , Wei Zhang , Wenhao Jiang , JingwenWang, and Wei Liu . 2019 . Controllable video captioning with pos sequence guidance based on gated fusion network . In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 2641--2650 . BairuiWang, Lin Ma,Wei Zhang,Wenhao Jiang, JingwenWang, andWei Liu. 2019. Controllable video captioning with pos sequence guidance based on gated fusion network. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 2641--2650."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i07.6898"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018957"},{"key":"e_1_3_2_2_36_1","volume-title":"Zihang Dai, Yulia Tsvetkov, and Yuan Cao.","author":"Wang Zirui","year":"2021","unstructured":"Zirui Wang , Jiahui Yu , Adams Wei Yu , Zihang Dai, Yulia Tsvetkov, and Yuan Cao. 2021 . Simvlm : Simple visual language model pretraining with weak supervision. arXiv preprint arXiv:2108.10904 (2021). Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, and Yuan Cao. 2021. Simvlm: Simple visual language model pretraining with weak supervision. arXiv preprint arXiv:2108.10904 (2021)."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01094"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01264-9_42"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00271"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01521"}],"event":{"name":"ICMR '22: International Conference on Multimedia Retrieval","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Newark NJ USA","acronym":"ICMR '22"},"container-title":["Proceedings of the 2022 International Conference on Multimedia Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512527.3531379","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3512527.3531379","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:12Z","timestamp":1750188612000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512527.3531379"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":40,"alternative-id":["10.1145\/3512527.3531379","10.1145\/3512527"],"URL":"https:\/\/doi.org\/10.1145\/3512527.3531379","relation":{},"subject":[],"published":{"date-parts":[[2022,6,27]]},"assertion":[{"value":"2022-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}