{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T13:09:22Z","timestamp":1790687362228,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,10,15]],"date-time":"2018-10-15T00:00:00Z","timestamp":1539561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Tianjin Natural Science Foundation","award":["no. 15JCYBJC15400"],"award-info":[{"award-number":["no. 15JCYBJC15400"]}]},{"DOI":"10.13039\/501100011002","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["under Grant U1509206,6147"],"award-info":[{"award-number":["under Grant U1509206,6147"]}],"id":[{"id":"10.13039\/501100011002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,10,15]]},"DOI":"10.1145\/3240508.3240563","type":"proceedings-article","created":{"date-parts":[[2018,10,18]],"date-time":"2018-10-18T17:52:08Z","timestamp":1539885128000},"page":"239-247","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":44,"title":["Explore Multi-Step Reasoning in Video Question Answering"],"prefix":"10.1145","author":[{"given":"Xiaomeng","family":"Song","sequence":"first","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yucheng","family":"Shi","sequence":"additional","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Chen","sequence":"additional","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yahong","family":"Han","sequence":"additional","affiliation":[{"name":"Tianjin University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,10,15]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Jacob Andreas Marcus Rohrbach Trevor Darrell and Klein Dan. 2016. Neural Module Networks. In CVPR .  Jacob Andreas Marcus Rohrbach Trevor Darrell and Klein Dan. 2016. Neural Module Networks. In CVPR .","DOI":"10.1109\/CVPR.2016.12"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_3_2_1_3_1","unstructured":"Kyunghyun Cho Bart van Merrienboer cC aglar G\u00fc lcc ehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In EMNLP .  Kyunghyun Cho Bart van Merrienboer cC aglar G\u00fc lcc ehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In EMNLP ."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell and Marcus Rohrbach. 2016. Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding. In EMNLP .  Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell and Marcus Rohrbach. 2016. Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding. In EMNLP .","DOI":"10.18653\/v1\/D16-1044"},{"key":"e_1_3_2_1_5_1","unstructured":"Jiyang Gao Runzhou Ge Kan Chen and Ram Nevatia. 2018. Motion-Appearance Co-memory Networks for Video Question Answering. In CVPR .  Jiyang Gao Runzhou Ge Kan Chen and Ram Nevatia. 2018. Motion-Appearance Co-memory Networks for Video Question Answering. In CVPR ."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Till Haug Octavian-Eugen Ganea and Paulina Grnarova. 2018. Neural Multi-Step Reasoning for Question Answering on Semi-Structured Tables. In ECIR .  Till Haug Octavian-Eugen Ganea and Paulina Grnarova. 2018. Neural Multi-Step Reasoning for Question Answering on Semi-Structured Tables. In ECIR .","DOI":"10.1007\/978-3-319-76941-7_52"},{"key":"e_1_3_2_1_7_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR .  Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR ."},{"key":"e_1_3_2_1_8_1","unstructured":"Ronghang Hu Jacob Andreas Marcus Rohrbach Trevor Darrell and Kate Saenko. 2017. Learning to Reason: End-to-End Module Networks for Visual Question Answering. In ICCV .  Ronghang Hu Jacob Andreas Marcus Rohrbach Trevor Darrell and Kate Saenko. 2017. Learning to Reason: End-to-End Module Networks for Visual Question Answering. In ICCV ."},{"key":"e_1_3_2_1_9_1","unstructured":"Drew A. Hudsonand and Christopher D. Manning. 2018. Compositional Attention Networks for Machine Reasoning. In ICLR .  Drew A. Hudsonand and Christopher D. Manning. 2018. Compositional Attention Networks for Machine Reasoning. In ICLR ."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Yunseok Jang Yale Song Youngjae Yu Youngjin Kim and Gunhee Kim. 2017. TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering. In CVPR .  Yunseok Jang Yale Song Youngjae Yu Youngjin Kim and Gunhee Kim. 2017. TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering. In CVPR .","DOI":"10.1109\/CVPR.2017.149"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Bharath Hariharan Laurens van der Maaten Judy Hoffman Fei-Fei Li C. Lawrence Zitnick and Ross Girshick. 2017a. Inferring and Executing Programs for Visual Reasoning. In ICCV .  Justin Johnson Bharath Hariharan Laurens van der Maaten Judy Hoffman Fei-Fei Li C. Lawrence Zitnick and Ross Girshick. 2017a. Inferring and Executing Programs for Visual Reasoning. In ICCV .","DOI":"10.1109\/ICCV.2017.325"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Bharath Hariharan Laurens van der Maaten Fei-Fei Li C. Lawrence Zitnick and Ross B. Girshick. 2017b. CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning. In CVPR. 1988--1997.  Justin Johnson Bharath Hariharan Laurens van der Maaten Fei-Fei Li C. Lawrence Zitnick and Ross B. Girshick. 2017b. CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning. In CVPR. 1988--1997.","DOI":"10.1109\/CVPR.2017.215"},{"key":"e_1_3_2_1_13_1","unstructured":"Samira Ebrahimi Kahou Adam Atkinson Vincent Michalski \u00c1 kos K\u00e1 d\u00e1 r Adam Trischler and Yoshua Bengio. 2018. FigureQA: An Annotated Figure Dataset for Visual Reasoning. In ICLR .  Samira Ebrahimi Kahou Adam Atkinson Vincent Michalski \u00c1 kos K\u00e1 d\u00e1 r Adam Trischler and Yoshua Bengio. 2018. FigureQA: An Annotated Figure Dataset for Visual Reasoning. In ICLR ."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.223"},{"key":"e_1_3_2_1_15_1","unstructured":"Kyung-Min Kim Min-Oh Heo Seong-Ho Choi and Byoung-Tak Zhang. 2017. DeepStory: Video Story QA by Deep Embedded Memory Networks. In IJCAI .   Kyung-Min Kim Min-Oh Heo Seong-Ho Choi and Byoung-Tak Zhang. 2017. DeepStory: Video Story QA by Deep Embedded Memory Networks. In IJCAI ."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098115"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Tegan Maharaj Nicolas Ballas Anna Rohrbach Aaron Courville and Christopher Pal. 2017. A Dataset and Exploration of Models for Understanding Video Data Through Fill-In-The-Blank Question-Answering. In CVPR. 7359--7368.  Tegan Maharaj Nicolas Ballas Anna Rohrbach Aaron Courville and Christopher Pal. 2017. A Dataset and Exploration of Models for Understanding Video Data Through Fill-In-The-Blank Question-Answering. In CVPR. 7359--7368.","DOI":"10.1109\/CVPR.2017.778"},{"key":"e_1_3_2_1_18_1","unstructured":"Jonghwan Mun Paul Hongsuck Seo Ilchae Jung and Bohyung Han. 2017. MarioQA: Answering Questions by Watching Gameplay Videos. In ICCV .  Jonghwan Mun Paul Hongsuck Seo Ilchae Jung and Bohyung Han. 2017. MarioQA: Answering Questions by Watching Gameplay Videos. In ICCV ."},{"key":"e_1_3_2_1_19_1","unstructured":"Ethan Perez Harm de Vries Florian Strub Vincent Dumoulin and Aaron C. Courville. 2017. Learning Visual Reasoning Without Strong Priors. In ICML .  Ethan Perez Harm de Vries Florian Strub Vincent Dumoulin and Aaron C. Courville. 2017. Learning Visual Reasoning Without Strong Priors. In ICML ."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Ethan Perez Florian Strub Harm de Vries Vincent Dumoulin and Aaron C. Courville. 2018. FiLM: Visual Reasoning with a General Conditioning Layer. In AAAI .  Ethan Perez Florian Strub Harm de Vries Vincent Dumoulin and Aaron C. Courville. 2018. FiLM: Visual Reasoning with a General Conditioning Layer. In AAAI .","DOI":"10.1609\/aaai.v32i1.11671"},{"key":"e_1_3_2_1_21_1","unstructured":"Mengye Ren Ryan Kiros and Richard Zemel. 2015. Exploring Models and Data for Image Question Answering. In NIPS. 2953--2961.   Mengye Ren Ryan Kiros and Richard Zemel. 2015. Exploring Models and Data for Image Question Answering. In NIPS. 2953--2961."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0987-1"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_1_24_1","unstructured":"Adam Santoro David Raposo David G. T. Barrett Mateusz Malinowski Razvan Pascanu Peter Battaglia and Timothy P. Lillicrap. 2017. A simple neural network module for relational reasoning. arXiv preprint arXiv:1706.01427 (2017).  Adam Santoro David Raposo David G. T. Barrett Mateusz Malinowski Razvan Pascanu Peter Battaglia and Timothy P. Lillicrap. 2017. A simple neural network module for relational reasoning. arXiv preprint arXiv:1706.01427 (2017)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Makarand Tapaswi Yukun Zhu Rainer Stiefelhagen Antonio Torralba Raquel Urtasun and Sanja Fidler. 2016. MovieQA: Understanding Stories in Movies through Question-Answering. In CVPR . 4631--4640.  Makarand Tapaswi Yukun Zhu Rainer Stiefelhagen Antonio Torralba Raquel Urtasun and Sanja Fidler. 2016. MovieQA: Understanding Stories in Movies through Question-Answering. In CVPR . 4631--4640.","DOI":"10.1109\/CVPR.2016.501"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240677"},{"key":"e_1_3_2_1_28_1","unstructured":"Aming Wu and Yahong Han. 2018. Multi-modal Circulant Fusion for Video-to-Language and Backward. In IJCAI .  Aming Wu and Yahong Han. 2018. Multi-modal Circulant Fusion for Video-to-Language and Backward. In IJCAI ."},{"key":"e_1_3_2_1_29_1","volume-title":"Attend and Tell: Neural Image Caption Generation with Visual Attention. Computer Science (2015)","author":"Xu Kelvin","year":"2015"},{"key":"e_1_3_2_1_30_1","first-page":"4933","article-title":"Sequential Video VLAD: Training the Aggregation Locally and Temporally","volume":"27","author":"Xu Youjiang","year":"2018","journal-title":"IEEE TIP"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2746267"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Guangyu Robert Yang Igor Ganichev Xiao-Jing Wang Jonathon Shlens and David Sussillo. 2018. A dataset and architecture for visual reasoning with a working memory. arXiv preprint arXiv:1803.06092 (2018).  Guangyu Robert Yang Igor Ganichev Xiao-Jing Wang Jonathon Shlens and David Sussillo. 2018. A dataset and architecture for visual reasoning with a working memory. arXiv preprint arXiv:1803.06092 (2018).","DOI":"10.32470\/CCN.2018.1075-0"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123327"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080655"},{"key":"e_1_3_2_1_35_1","unstructured":"Youngjae Yu Hyungjin Ko Jongwook Choi and Gunhee Kim. 2017. End-to-end Concept Word Detection for Video Captioning Retrieval and Question Answering. In CVPR .  Youngjae Yu Hyungjin Ko Jongwook Choi and Gunhee Kim. 2017. End-to-end Concept Word Detection for Video Captioning Retrieval and Question Answering. In CVPR ."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Kuo-Hao Zeng Tseng-Hung Chen Ching-Yao Chuang Yuan-Hong Liao Juan Carlos Niebles and Min Sun. 2017. Leveraging Video Descriptions to Learn Video Question Answering. In AAAI .  Kuo-Hao Zeng Tseng-Hung Chen Ching-Yao Chuang Yuan-Hong Liao Juan Carlos Niebles and Min Sun. 2017. Leveraging Video Descriptions to Learn Video Question Answering. In AAAI .","DOI":"10.1609\/aaai.v31i1.11238"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Peng Zhang Yash Goyal Douglas Summers-Stay Dhruv Batra and Devi Parikh. 2016. Yin and Yang: Balancing and Answering Binary Visual Questions. In CVPR .  Peng Zhang Yash Goyal Douglas Summers-Stay Dhruv Batra and Devi Parikh. 2016. Yin and Yang: Balancing and Answering Binary Visual Questions. In CVPR .","DOI":"10.1109\/CVPR.2016.542"},{"key":"e_1_3_2_1_38_1","unstructured":"Shichao Zhao Yanbin Liu Yahong Han and Richang Hong. 2017b. Pooling the Convolutional Layers in Deep ConvNets for Video Action Recognition. TCSVT (2017).  Shichao Zhao Yanbin Liu Yahong Han and Richang Hong. 2017b. Pooling the Convolutional Layers in Deep ConvNets for Video Action Recognition. TCSVT (2017)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123364"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Zhou Zhao Qifan Yang Deng Cai Xiaofei He and Yueting Zhuang. 2017c. Video Question Answering via Hierarchical Spatio-Temporal Attention Networks. In IJCAI . 3518--3524.   Zhou Zhao Qifan Yang Deng Cai Xiaofei He and Yueting Zhuang. 2017c. Video Question Answering via Hierarchical Spatio-Temporal Attention Networks. In IJCAI . 3518--3524.","DOI":"10.24963\/ijcai.2017\/492"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-017-1033-7"}],"event":{"name":"MM '18: ACM Multimedia Conference","location":"Seoul Republic of Korea","acronym":"MM '18","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 26th ACM international conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240563","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3240508.3240563","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:57:33Z","timestamp":1750208253000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240508.3240563"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,15]]},"references-count":41,"alternative-id":["10.1145\/3240508.3240563","10.1145\/3240508"],"URL":"https:\/\/doi.org\/10.1145\/3240508.3240563","relation":{},"subject":[],"published":{"date-parts":[[2018,10,15]]},"assertion":[{"value":"2018-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}