{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:18:51Z","timestamp":1766269131279,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,10,15]],"date-time":"2018-10-15T00:00:00Z","timestamp":1539561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61622211"],"award-info":[{"award-number":["61622211"]}]},{"name":"National Key R&D Program of China","award":["2017YFB1300201"],"award-info":[{"award-number":["2017YFB1300201"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,10,15]]},"DOI":"10.1145\/3240508.3240632","type":"proceedings-article","created":{"date-parts":[[2018,10,18]],"date-time":"2018-10-18T17:52:08Z","timestamp":1539885128000},"page":"1416-1424","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":73,"title":["Context-Aware Visual Policy Network for Sequence-Level Image Captioning"],"prefix":"10.1145","author":[{"given":"Daqing","family":"Liu","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zheng-Jun","family":"Zha","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanwang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongdong","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Wu","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,10,15]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Spice: Semantic propositional image caption evaluation. In ECCV .","author":"Anderson Peter","year":"2016","unstructured":"Peter Anderson , Basura Fernando , Mark Johnson , and Stephen Gould . 2016 . Spice: Semantic propositional image caption evaluation. In ECCV . Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016. Spice: Semantic propositional image caption evaluation. In ECCV ."},{"key":"e_1_3_2_1_2_1","volume-title":"Bottom-up and top-down attention for image captioning and VQA. arXiv preprint arXiv:1707.07998","author":"Anderson Peter","year":"2017","unstructured":"Peter Anderson , Xiaodong He , Chris Buehler , Damien Teney , Mark Johnson , Stephen Gould , and Lei Zhang . 2017. Bottom-up and top-down attention for image captioning and VQA. arXiv preprint arXiv:1707.07998 ( 2017 ). Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, and Lei Zhang. 2017. Bottom-up and top-down attention for image captioning and VQA. arXiv preprint arXiv:1707.07998 (2017)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_3_2_1_4_1","unstructured":"Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR .  Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR ."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization .","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie . 2005 . METEOR: An automatic metric for MT evaluation with improved correlation with human judgments . In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization . Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization ."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123275"},{"key":"e_1_3_2_1_7_1","volume-title":"Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. In CVPR .","author":"Chen Long","year":"2017","unstructured":"Long Chen , Hanwang Zhang , Jun Xiao , Liqiang Nie , Jian Shao , Wei Liu , and Tat-Seng Chua . 2017 b. Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. In CVPR . Long Chen, Hanwang Zhang, Jun Xiao, Liqiang Nie, Jian Shao, Wei Liu, and Tat-Seng Chua. 2017b. Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. In CVPR ."},{"key":"e_1_3_2_1_8_1","volume-title":"Devi Parikh, and Dhruv Batra.","author":"Das Abhishek","year":"2017","unstructured":"Abhishek Das , Satwik Kottur , Khushi Gupta , Avi Singh , Deshraj Yadav , Jos\u00e9 MF Moura , Devi Parikh, and Dhruv Batra. 2017 . Visual dialog. In CVPR . Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, Jos\u00e9 MF Moura, Devi Parikh, and Dhruv Batra. 2017. Visual dialog. In CVPR ."},{"key":"e_1_3_2_1_9_1","volume-title":"et almbox","author":"Fang Hao","year":"2015","unstructured":"Hao Fang , Saurabh Gupta , Forrest Iandola , Rupesh Srivastava , Li Deng , Piotr Doll\u00e1r , Jianfeng Gao , Xiaodong He , Margaret Mitchell , John Platt , et almbox . 2015 . From captions to visual concepts and back. (2015). Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Doll\u00e1r, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, et almbox. 2015. From captions to visual concepts and back. (2015)."},{"key":"e_1_3_2_1_10_1","volume-title":"Stack-captioning: Coarse-to-fine learning for image captioning. arXiv preprint arXiv:1709.03376","author":"Gu Jiuxiang","year":"2017","unstructured":"Jiuxiang Gu , Jianfei Cai , Gang Wang , and Tsuhan Chen . 2017 . Stack-captioning: Coarse-to-fine learning for image captioning. arXiv preprint arXiv:1709.03376 (2017). Jiuxiang Gu, Jianfei Cai, Gang Wang, and Tsuhan Chen. 2017. Stack-captioning: Coarse-to-fine learning for image captioning. arXiv preprint arXiv:1709.03376 (2017)."},{"key":"e_1_3_2_1_11_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR .  Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR ."},{"key":"e_1_3_2_1_12_1","volume-title":"Long short-term memory. Neural computation","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation ( 1997 ). Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation (1997)."},{"key":"e_1_3_2_1_13_1","unstructured":"Ronghang Hu Jacob Andreas Marcus Rohrbach Trevor Darrell and Kate Saenko. 2017. Learning to Reason: End-To-End Module Networks for Visual Question Answering. In ICCV .  Ronghang Hu Jacob Andreas Marcus Rohrbach Trevor Darrell and Kate Saenko. 2017. Learning to Reason: End-To-End Module Networks for Visual Question Answering. In ICCV ."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Allan Jabri Armand Joulin and Laurens van der Maaten. 2016. Revisiting visual question answering baselines. In ECCV .  Allan Jabri Armand Joulin and Laurens van der Maaten. 2016. Revisiting visual question answering baselines. In ECCV .","DOI":"10.1007\/978-3-319-46484-8_44"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Bharath Hariharan Laurens van der Maaten Judy Hoffman Li Fei-Fei C Lawrence Zitnick and Ross Girshick. 2017. Inferring and Executing Programs for Visual Reasoning. In ICCV .  Justin Johnson Bharath Hariharan Laurens van der Maaten Judy Hoffman Li Fei-Fei C Lawrence Zitnick and Ross Girshick. 2017. Inferring and Executing Programs for Visual Reasoning. In ICCV .","DOI":"10.1109\/ICCV.2017.325"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Andrej Karpathy and Li Fei-Fei. 2015. Deep visual-semantic alignments for generating image descriptions. In CVPR .  Andrej Karpathy and Li Fei-Fei. 2015. Deep visual-semantic alignments for generating image descriptions. In CVPR .","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"e_1_3_2_1_17_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0981-7"},{"key":"e_1_3_2_1_19_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS .   Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS ."},{"key":"e_1_3_2_1_20_1","volume":"201","author":"Lake Brenden M","unstructured":"Brenden M Lake , Tomer D Ullman , Joshua B Tenenbaum , and Samuel J Gershman. 201 7. Building machines that learn and think like people. Behavioral and Brain Sciences (2017). Brenden M Lake, Tomer D Ullman, Joshua B Tenenbaum, and Samuel J Gershman. 2017. Building machines that learn and think like people. Behavioral and Brain Sciences (2017).","journal-title":"Samuel J Gershman."},{"key":"e_1_3_2_1_21_1","volume-title":"Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out (2004). Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out (2004)."},{"key":"e_1_3_2_1_22_1","unstructured":"Tsung-Yi Lin Michael Maire Serge Belongie James Hays Pietro Perona Deva Ramanan Piotr Doll\u00e1r and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In ECCV .  Tsung-Yi Lin Michael Maire Serge Belongie James Hays Pietro Perona Deva Ramanan Piotr Doll\u00e1r and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In ECCV ."},{"key":"e_1_3_2_1_23_1","volume-title":"Improved image captioning via policy gradient optimization of spider. arXiv preprint arXiv:1612.00370","author":"Liu Siqi","year":"2016","unstructured":"Siqi Liu , Zhenhai Zhu , Ning Ye , Sergio Guadarrama , and Kevin Murphy . 2016. Improved image captioning via policy gradient optimization of spider. arXiv preprint arXiv:1612.00370 ( 2016 ). Siqi Liu, Zhenhai Zhu, Ning Ye, Sergio Guadarrama, and Kevin Murphy. 2016. Improved image captioning via policy gradient optimization of spider. arXiv preprint arXiv:1612.00370 (2016)."},{"key":"e_1_3_2_1_24_1","unstructured":"Jiasen Lu Caiming Xiong Devi Parikh and Richard Socher. {n. d.}. Knowing when to look: Adaptive attention via a visual sentinel for image captioning. In CVPR .  Jiasen Lu Caiming Xiong Devi Parikh and Richard Socher. {n. d.}. Knowing when to look: Adaptive attention via a visual sentinel for image captioning. In CVPR ."},{"key":"e_1_3_2_1_25_1","volume-title":"Deep captioning with multimodal recurrent neural networks (m-rnn). arXiv preprint arXiv:1412.6632","author":"Mao Junhua","year":"2014","unstructured":"Junhua Mao , Wei Xu , Yi Yang , Jiang Wang , Zhiheng Huang , and Alan Yuille . 2014. Deep captioning with multimodal recurrent neural networks (m-rnn). arXiv preprint arXiv:1412.6632 ( 2014 ). Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Zhiheng Huang, and Alan Yuille. 2014. Deep captioning with multimodal recurrent neural networks (m-rnn). arXiv preprint arXiv:1412.6632 (2014)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_2_1_27_1","volume-title":"Sequence level training with recurrent neural networks. arXiv preprint arXiv:1511.06732","author":"Ranzato Marc'Aurelio","year":"2015","unstructured":"Marc'Aurelio Ranzato , Sumit Chopra , Michael Auli , and Wojciech Zaremba . 2015. Sequence level training with recurrent neural networks. arXiv preprint arXiv:1511.06732 ( 2015 ). Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. 2015. Sequence level training with recurrent neural networks. arXiv preprint arXiv:1511.06732 (2015)."},{"key":"e_1_3_2_1_28_1","unstructured":"Shaoqing Ren Kaiming He Ross Girshick and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS .   Shaoqing Ren Kaiming He Ross Girshick and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In NIPS ."},{"key":"e_1_3_2_1_29_1","volume-title":"Deep reinforcement learning-based image captioning with embedding reward. arXiv preprint arXiv:1704.03899","author":"Ren Zhou","year":"2017","unstructured":"Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , and Li-Jia Li. 2017. Deep reinforcement learning-based image captioning with embedding reward. arXiv preprint arXiv:1704.03899 ( 2017 ). Zhou Ren, Xiaoyu Wang, Ning Zhang, Xutao Lv, and Li-Jia Li. 2017. Deep reinforcement learning-based image captioning with embedding reward. arXiv preprint arXiv:1704.03899 (2017)."},{"key":"e_1_3_2_1_30_1","volume-title":"Self-critical sequence training for image captioning. arXiv preprint arXiv:1612.00563","author":"Rennie Steven J","year":"2016","unstructured":"Steven J Rennie , Etienne Marcheret , Youssef Mroueh , Jarret Ross , and Vaibhava Goel . 2016. Self-critical sequence training for image captioning. arXiv preprint arXiv:1612.00563 ( 2016 ). Steven J Rennie, Etienne Marcheret, Youssef Mroueh, Jarret Ross, and Vaibhava Goel. 2016. Self-critical sequence training for image captioning. arXiv preprint arXiv:1612.00563 (2016)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/7902.7906"},{"volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","key":"e_1_3_2_1_33_1","unstructured":"Richard S Sutton and Andrew G Barto . 1998. Reinforcement learning: An introduction . MIT press Cambridge . Richard S Sutton and Andrew G Barto. 1998. Reinforcement learning: An introduction .MIT press Cambridge."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073478"},{"key":"e_1_3_2_1_35_1","volume-title":"Cider: Consensus-based image description evaluation. In CVPR .","author":"Vedantam Ramakrishna","year":"2015","unstructured":"Ramakrishna Vedantam , C Lawrence Zitnick , and Devi Parikh . 2015 . Cider: Consensus-based image description evaluation. In CVPR . Ramakrishna Vedantam, C Lawrence Zitnick, and Devi Parikh. 2015. Cider: Consensus-based image description evaluation. In CVPR ."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Oriol Vinyals Alexander Toshev Samy Bengio and Dumitru Erhan. 2015. Show and tell: A neural image caption generator. In CVPR .  Oriol Vinyals Alexander Toshev Samy Bengio and Dumitru Erhan. 2015. Show and tell: A neural image caption generator. In CVPR .","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"e_1_3_2_1_37_1","unstructured":"Ronald J Williams. 199"},{"key":"e_1_3_2_1_38_1","unstructured":"Danfei Xu Yuke Zhu Christopher B Choy and Li Fei-Fei. 2017. Scene graph generation by iterative message passing. In CVPR .  Danfei Xu Yuke Zhu Christopher B Choy and Li Fei-Fei. 2017. Scene graph generation by iterative message passing. In CVPR ."},{"key":"e_1_3_2_1_39_1","unstructured":"Kelvin Xu Jimmy Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhudinov Rich Zemel and Yoshua Bengio. 2015. Show attend and tell: Neural image caption generation with visual attention. In ICML .   Kelvin Xu Jimmy Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhudinov Rich Zemel and Yoshua Bengio. 2015. Show attend and tell: Neural image caption generation with visual attention. In ICML ."},{"key":"e_1_3_2_1_40_1","volume-title":"Boosting image captioning with attributes. OpenReview","author":"Yao Ting","year":"2016","unstructured":"Ting Yao , Yingwei Pan , Yehao Li , Zhaofan Qiu , and Tao Mei . 2016. Boosting image captioning with attributes. OpenReview ( 2016 ). Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, and Tao Mei. 2016. Boosting image captioning with attributes. OpenReview (2016)."},{"key":"e_1_3_2_1_41_1","unstructured":"Lantao Yu Weinan Zhang Jun Wang and Yong Yu. 2017. SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient.. In AAAI .  Lantao Yu Weinan Zhang Jun Wang and Yong Yu. 2017. SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient.. In AAAI ."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Hanwang Zhang Zawlin Kyaw Shih-Fu Chang and Tat-Seng Chua. 2017a. Visual translation embedding network for visual relation detection. In CVPR .  Hanwang Zhang Zawlin Kyaw Shih-Fu Chang and Tat-Seng Chua. 2017a. Visual translation embedding network for visual relation detection. In CVPR .","DOI":"10.1109\/CVPR.2017.331"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Hanwang Zhang Yulei Niu and Shih-Fu Chang. 2018. Grounding Referring Expressions in Images by Variational Context. In CVPR .  Hanwang Zhang Yulei Niu and Shih-Fu Chang. 2018. Grounding Referring Expressions in Images by Variational Context. In CVPR .","DOI":"10.1109\/CVPR.2018.00437"},{"key":"e_1_3_2_1_44_1","volume-title":"Actor-Critic Sequence Training for Image Captioning. arXiv preprint arXiv:1706.09601","author":"Zhang Li","year":"2017","unstructured":"Li Zhang , Flood Sung , Feng Liu , Tao Xiang , Shaogang Gong , Yongxin Yang , and Timothy M Hospedales . 2017b. Actor-Critic Sequence Training for Image Captioning. arXiv preprint arXiv:1706.09601 ( 2017 ). Li Zhang, Flood Sung, Feng Liu, Tao Xiang, Shaogang Gong, Yongxin Yang, and Timothy M Hospedales. 2017b. Actor-Critic Sequence Training for Image Captioning. arXiv preprint arXiv:1706.09601 (2017)."}],"event":{"name":"MM '18: ACM Multimedia Conference","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Seoul Republic of Korea","acronym":"MM '18"},"container-title":["Proceedings of the 26th ACM international conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240632","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3240508.3240632","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:57:34Z","timestamp":1750208254000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240632"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,15]]},"references-count":44,"alternative-id":["10.1145\/3240508.3240632","10.1145\/3240508"],"URL":"https:\/\/doi.org\/10.1145\/3240508.3240632","relation":{},"subject":[],"published":{"date-parts":[[2018,10,15]]},"assertion":[{"value":"2018-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}