{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T19:26:44Z","timestamp":1779218804616,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,10,15]],"date-time":"2018-10-15T00:00:00Z","timestamp":1539561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2016YFB1001000"],"award-info":[{"award-number":["2016YFB1001000"]}]},{"name":"NVIDIA DGX-1 AI Supercomputer"},{"name":"Huawei Innovation Research Program"},{"name":"National Natural Science Foundation of China","award":["61420106015,61572504"],"award-info":[{"award-number":["61420106015,61572504"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,10,15]]},"DOI":"10.1145\/3240508.3240538","type":"proceedings-article","created":{"date-parts":[[2018,10,18]],"date-time":"2018-10-18T17:52:08Z","timestamp":1539885128000},"page":"63-71","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Hierarchical Memory Modelling for Video Captioning"],"prefix":"10.1145","author":[{"given":"Junbo","family":"Wang","sequence":"first","affiliation":[{"name":"National Laboratory of Pattern Recognition & University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Wang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition & University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Huang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition & University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Wang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition & Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tieniu","family":"Tan","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition & Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,10,15]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Ballas Nicolas","year":"2016","unstructured":"Nicolas Ballas , Li Yao , Chris Pal , and Aaron Courville . 2016 . Delving Deeper into Convolutional Networks for Learning Video Representations . Proceedings of the International Conference on Learning Representations (2016). Nicolas Ballas, Li Yao, Chris Pal, and Aaron Courville. 2016. Delving Deeper into Convolutional Networks for Learning Video Representations. Proceedings of the International Conference on Learning Representations (2016)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.339"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.279181"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics.","author":"David","unstructured":"David L. Chen and William B. Dolan. 2011. Collecting highly parallel data for paraphrase evaluation . In Proceedings of the Annual Meeting of the Association for Computational Linguistics. David L. Chen and William B. Dolan. 2011. Collecting highly parallel data for paraphrase evaluation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics."},{"key":"e_1_3_2_1_5_1","volume-title":"Microsoft COCO captions: Data collection and evaluation server. arXiv","author":"Chen Xinlei","year":"2015","unstructured":"Xinlei Chen , Hao Fang , Tsung-Yi Lin , Ramakrishna Vedantam , Saurabh Gupta , Piotr Doll\u00e1r , and C. Lawrence Zitnick . 2015. Microsoft COCO captions: Data collection and evaluation server. arXiv ( 2015 ). Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Doll\u00e1r, and C. Lawrence Zitnick. 2015. Microsoft COCO captions: Data collection and evaluation server. arXiv (2015)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3348"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2984064"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"e_1_3_2_1_10_1","volume-title":"Neural turing machines. arXiv","author":"Graves Alex","year":"2014","unstructured":"Alex Graves , Greg Wayne , and Ivo Danihelka . 2014. Neural turing machines. arXiv ( 2014 ). Alex Graves, Greg Wayne, and Ivo Danihelka. 2014. Neural turing machines. arXiv (2014)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2891460.2891535"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.273"},{"key":"e_1_3_2_1_13_1","volume-title":"Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning. arXiv","author":"Lu Jiasen","year":"2016","unstructured":"Jiasen Lu , Caiming Xiong , Devi Parikh , and Richard Socher . 2016. Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning. arXiv ( 2016 ). Jiasen Lu, Caiming Xiong, Devi Parikh, and Richard Socher. 2016. Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning. arXiv (2016)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.117"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.497"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.111"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126281"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2984066"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.61"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2984062"},{"key":"e_1_3_2_1_22_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv (2014)."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems.","author":"Sukhbaatar Sainbayar","year":"2015","unstructured":"Sainbayar Sukhbaatar , Jason Weston , Rob Fergus , 2015 . End-to-end memory networks . In Proceedings of the Advances in Neural Information Processing Systems. Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, et al. 2015. End-to-end memory networks. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_24_1","volume-title":"Rethinking the inception architecture for computer vision. arXiv","author":"Szegedy Christian","year":"2015","unstructured":"Christian Szegedy , Vincent Vanhoucke , Sergey Ioffe , Jonathon Shlens , and Zbigniew Wojna . 2015. Rethinking the inception architecture for computer vision. arXiv ( 2015 ). Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the inception architecture for computer vision. arXiv (2015)."},{"key":"e_1_3_2_1_25_1","volume":"201","author":"Thomason Jesse","unstructured":"Jesse Thomason , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , and Raymond J. Mooney. 201 4. Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild. In Proceedings of the 25th International Conference on Computational Linguistics. Jesse Thomason, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, and Raymond J. Mooney. 2014. Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild. In Proceedings of the 25th International Conference on Computational Linguistics.","journal-title":"Raymond J. Mooney."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.61"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.515"},{"key":"e_1_3_2_1_30_1","volume-title":"Translating videos to natural language using deep recurrent neural networks. arXiv","author":"Venugopalan Subhashini","year":"2014","unstructured":"Subhashini Venugopalan , Huijuan Xu , Jeff Donahue , Marcus Rohrbach , Raymond Mooney , and Kate Saenko . 2014. Translating videos to natural language using deep recurrent neural networks. arXiv ( 2014 ). Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, and Kate Saenko. 2014. Translating videos to natural language using deep recurrent neural networks. arXiv (2014)."},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems.","author":"Viola Paul","year":"2005","unstructured":"Paul Viola , John C. Platt , Cha Zhang , 2005 . Multiple instance boosting for object detection . In Proceedings of the Advances in Neural Information Processing Systems. Paul Viola, John C. Platt, Cha Zhang, et al. 2005. Multiple instance boosting for object detection. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00784"},{"key":"e_1_3_2_1_33_1","volume-title":"Memory Networks. In Proceedings of the International Conference on Learning Representations.","author":"Weston Jason","year":"2015","unstructured":"Jason Weston , Sumit Chopra , and Antoine Bordes . 2015 . Memory Networks. In Proceedings of the International Conference on Learning Representations. Jason Weston, Sumit Chopra, and Antoine Bordes. 2015. Memory Networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_1_34_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Wu Qi","unstructured":"Qi Wu , Chunhua Shen , Lingqiao Liu , Anthony Dick , and Anton van den Hengel. 2016. What value do explicit high level concepts have in vision to language problems? In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Qi Wu, Chunhua Shen, Lingqiao Liu, Anthony Dick, and Anton van den Hengel. 2016. What value do explicit high level concepts have in vision to language problems? In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the International Conference on Machine Learning. 2397--2406","author":"Xiong Caiming","year":"2016","unstructured":"Caiming Xiong , Stephen Merity , and Richard Socher . 2016 . Dynamic memory networks for visual and textual question answering . In Proceedings of the International Conference on Machine Learning. 2397--2406 . Caiming Xiong, Stephen Merity, and Richard Socher. 2016. Dynamic memory networks for visual and textual question answering. In Proceedings of the International Conference on Machine Learning. 2397--2406."},{"key":"e_1_3_2_1_36_1","volume-title":"Proceedings of the International Conference on Computer Vision","author":"Xu Huijuan","year":"2015","unstructured":"Huijuan Xu , Subhashini Venugopalan , Vasili Ramanishka , Marcus Rohrbach , and Kate Saenko . 2015 . A multi-scale multiple instance video description network . Proceedings of the International Conference on Computer Vision (2015). Huijuan Xu, Subhashini Venugopalan, Vasili Ramanishka, Marcus Rohrbach, and Kate Saenko. 2015. A multi-scale multiple instance video description network. Proceedings of the International Conference on Computer Vision (2015)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.571"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123448"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.512"},{"key":"e_1_3_2_1_40_1","volume-title":"Boosting image captioning with attributes. arXiv","author":"Yao Ting","year":"2016","unstructured":"Ting Yao , Yingwei Pan , Yehao Li , Zhaofan Qiu , and Tao Mei . 2016. Boosting image captioning with attributes. arXiv ( 2016 ). Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, and Tao Mei. 2016. Boosting image captioning with attributes. arXiv (2016)."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.503"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.496"},{"key":"e_1_3_2_1_43_1","volume-title":"Proceedings of the International Conference on Machine Learning. 421--429","author":"Zaremba Wojciech","year":"2016","unstructured":"Wojciech Zaremba , Tomas Mikolov , Armand Joulin , and Rob Fergus . 2016 . Learning simple algorithms from examples . In Proceedings of the International Conference on Machine Learning. 421--429 . Wojciech Zaremba, Tomas Mikolov, Armand Joulin, and Rob Fergus. 2016. Learning simple algorithms from examples. In Proceedings of the International Conference on Machine Learning. 421--429."},{"key":"e_1_3_2_1_44_1","volume-title":"Recurrent neural network regularization. arXiv","author":"Zaremba Wojciech","year":"2014","unstructured":"Wojciech Zaremba , Ilya Sutskever , and Oriol Vinyals . 2014. Recurrent neural network regularization. arXiv ( 2014 ). Wojciech Zaremba, Ilya Sutskever, and Oriol Vinyals. 2014. Recurrent neural network regularization. arXiv (2014)."}],"event":{"name":"MM '18: ACM Multimedia Conference","location":"Seoul Republic of Korea","acronym":"MM '18","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 26th ACM international conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240538","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3240508.3240538","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:01Z","timestamp":1750207441000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240538"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,15]]},"references-count":44,"alternative-id":["10.1145\/3240508.3240538","10.1145\/3240508"],"URL":"https:\/\/doi.org\/10.1145\/3240508.3240538","relation":{},"subject":[],"published":{"date-parts":[[2018,10,15]]},"assertion":[{"value":"2018-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}