{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T10:25:37Z","timestamp":1778840737590,"version":"3.51.4"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,7,24]],"date-time":"2018-07-24T00:00:00Z","timestamp":1532390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Science and Technology Program of Guangzhou, China","award":["201704020180"],"award-info":[{"award-number":["201704020180"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61673402, 61273270 and 60802069"],"award-info":[{"award-number":["61673402, 61273270 and 60802069"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities of China","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"crossref","award":["2017A030311029 and 2016B010109002"],"award-info":[{"award-number":["2017A030311029 and 2016B010109002"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>Image captioning is an increasingly important problem associated with artificial intelligence, computer vision, and natural language processing. Recent works revealed that it is possible for a machine to generate meaningful and accurate sentences for images. However, most existing methods ignore latent emotional information in an image. In this article, we propose a novel image captioning model with Affective Guiding and Selective Attention Mechanism named AG-SAM. In our method, we aim to bridge the affective gap between image captioning and the emotional response elicited by the image. First, we introduce affective components that capture higher-level concepts encoded in images into AG-SAM. Hence, our language model can be adapted to generate sentences that are more passionate and emotive. In addition, a selective gate acting on the attention mechanism controls the degree of how much visual information AG-SAM needs. Experimental results have shown that our model outperforms most existing methods, clearly reflecting an association between images and emotional components that is usually ignored in existing works.<\/jats:p>","DOI":"10.1145\/3226037","type":"journal-article","created":{"date-parts":[[2018,7,24]],"date-time":"2018-07-24T15:50:24Z","timestamp":1532447424000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Image Captioning with Affective Guiding and Selective Attention"],"prefix":"10.1145","volume":"14","author":[{"given":"Anqi","family":"Wang","sequence":"first","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangdong, Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4884-323X","authenticated-orcid":false,"given":"Haifeng","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangdong, Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-Sen University, Guangdong, Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,7,24]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Bahdanau D."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization. 65--72","author":"Banerjee Satanjeev","year":"2005"},{"key":"e_1_2_1_3_1","unstructured":"X. Chen H. Fang T.-Y. Lin R. Vedantam S. Gupta P. Dollar and C. L. Zitnick. 2015. Microsoft COCO captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325.  X. Chen H. Fang T.-Y. Lin R. Vedantam S. Gupta P. Dollar and C. L. Zitnick. 2015. Microsoft COCO captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2599174"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Paul Ekman Wallace V. Friesen and Phoebe Ellsworth. 1972. What emotion dimensions can observers judge from facial behavior? In Emotion in the Human Face. 67--75.  Paul Ekman Wallace V. Friesen and Phoebe Ellsworth. 1972. What emotion dimensions can observers judge from facial behavior? In Emotion in the Human Face. 67--75.","DOI":"10.1016\/B978-0-08-016643-8.50025-2"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"e_1_2_1_7_1","volume-title":"Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth.","author":"Farhadi Ali","year":"2010"},{"key":"e_1_2_1_8_1","volume-title":"The Workshop on Text Summarization Branches Out. 10","author":"Flick Carlos","year":"2004"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2642953"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.40.2.512"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.277"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 28th AAAI Conference on Artificial Intelligence. 73--79","author":"Jiang Yu Gang","year":"2014"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2011.941851"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2598339"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the European Conference on Computer Vision. 740--755","author":"Lin Tsung-Yi"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1873965"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"T.-Y. Lin M. Maire S. Belongie J. Hays P. Perona D. Ramanan P. Dollar and C. L. Zitnick. 2014. Microsoft COCO: Common objects in context. arXiv preprint arXiv:1405.0312.  T.-Y. Lin M. Maire S. Belongie J. Hays P. Perona D. Ramanan P. Dollar and C. L. Zitnick. 2014. Microsoft COCO: Common objects in context. arXiv preprint arXiv:1405.0312.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics. 747--756","author":"Mitchell Margaret","year":"2013"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the IEEE International Conference and Workshops on Automatic Face and Gesture Recognition. 1--6.","author":"Mou Wenxuan","year":"2015"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.185"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.97.3.315"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 860--868","author":"Peng K. C."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1866696.1866717"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the IEEE International Conference on Image Processing. 3230--3234","author":"Wang Xiaohui","year":"2014"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML). 2048--2057","author":"Xu Kelvin","year":"2015"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1049\/el.2017.2351"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the IEEE International Conference on Image Processing. 101--104","author":"Yanulevskaya V."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.503"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00166"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3226037","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3226037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:15:01Z","timestamp":1750281301000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3226037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,24]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3226037"],"URL":"https:\/\/doi.org\/10.1145\/3226037","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,24]]},"assertion":[{"value":"2017-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}