{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,7]],"date-time":"2026-06-07T04:20:45Z","timestamp":1780806045647,"version":"3.54.1"},"reference-count":316,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,12,12]],"date-time":"2016-12-12T00:00:00Z","timestamp":1481500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>Integrating computer vision and natural language processing is a novel interdisciplinary field that has received a lot of attention recently. In this survey, we provide a comprehensive introduction of the integration of computer vision and natural language processing in multimedia and robotics applications with more than 200 key references. The tasks that we survey include visual attributes, image captioning, video captioning, visual question answering, visual retrieval, human-robot interaction, robotic actions, and robot navigation. We also emphasize strategies to integrate computer vision and natural language processing models as a unified theme of distributional semantics. We make an analog of distributional semantics in computer vision and natural language processing as image embedding and word embedding, respectively. We also present a unified view for the field and propose possible future directions.<\/jats:p>","DOI":"10.1145\/3009906","type":"journal-article","created":{"date-parts":[[2016,12,13]],"date-time":"2016-12-13T14:34:05Z","timestamp":1481639645000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["Computer Vision and Natural Language Processing"],"prefix":"10.1145","volume":"49","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5567-3104","authenticated-orcid":false,"given":"Peratham","family":"Wiriyathammabhum","sequence":"first","affiliation":[{"name":"University of Maryland, College Park, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas","family":"Summers-Stay","sequence":"additional","affiliation":[{"name":"U.S. Army Research Laboratory, Adelphi, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cornelia","family":"Ferm\u00fcller","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiannis","family":"Aloimonos","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,12,12]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"From images to sentences through scene description graphs using commonsense reasoning and knowledge. arXiv preprint arXiv:1511.03292","author":"Aditya Somak","year":"2015","unstructured":"Somak Aditya , Yezhou Yang , Chitta Baral , Cornelia Fermuller , and Yiannis Aloimonos . 2015. From images to sentences through scene description graphs using commonsense reasoning and knowledge. arXiv preprint arXiv:1511.03292 ( 2015 ). Somak Aditya, Yezhou Yang, Chitta Baral, Cornelia Fermuller, and Yiannis Aloimonos. 2015. From images to sentences through scene description graphs using commonsense reasoning and knowledge. arXiv preprint arXiv:1511.03292 (2015)."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911410459"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2014.10.010"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697055"},{"key":"e_1_2_1_5_1","first-page":"4","article-title":"A method of moments for mixture models and hidden Markov models","volume":"1","author":"Anandkumar Animashree","year":"2012","unstructured":"Animashree Anandkumar , Daniel Hsu , and Sham M. Kakade . 2012 a. A method of moments for mixture models and hidden Markov models . In COLT , Vol. 1. 4 . Animashree Anandkumar, Daniel Hsu, and Sham M. Kakade. 2012a. A method of moments for mixture models and hidden Markov models. In COLT, Vol. 1. 4.","journal-title":"COLT"},{"key":"e_1_2_1_6_1","volume-title":"Kakade","author":"Anandkumar Anima","year":"2012","unstructured":"Anima Anandkumar , Yi-kai Liu, Daniel J. Hsu , Dean P. Foster , and Sham M . Kakade . 2012 b. A spectral algorithm for latent Dirichlet allocation. In Advances in Neural Information Processing Systems . 917--925. Anima Anandkumar, Yi-kai Liu, Daniel J. Hsu, Dean P. Foster, and Sham M. Kakade. 2012b. A spectral algorithm for latent Dirichlet allocation. In Advances in Neural Information Processing Systems. 917--925."},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Andrew J. Anderson Elia Bruni Ulisse Bordignon Massimo Poesio and Marco Baroni. 2013. Of words eyes and brains: Correlating image-based distributional semantic models with neural representations of concepts. In EMNLP. 1960--1970. Andrew J. Anderson Elia Bruni Ulisse Bordignon Massimo Poesio and Marco Baroni. 2013. Of words eyes and brains: Correlating image-based distributional semantic models with neural representations of concepts. In EMNLP. 1960--1970.","DOI":"10.18653\/v1\/D13-1202"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Jacob Andreas Marcus Rohrbach Trevor Darrell and Dan Klein. 2016a. Learning to compose neural networks for question answering. In NAACL. Jacob Andreas Marcus Rohrbach Trevor Darrell and Dan Klein. 2016a. Learning to compose neural networks for question answering. In NAACL.","DOI":"10.18653\/v1\/N16-1181"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.12"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0016261"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2008.10.024"},{"key":"e_1_2_1_13_1","volume-title":"ICLR","author":"Bahdanau Dzmitry","year":"2014","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2014 . Neural machine translation by jointly learning to align and translate . In ICLR 2015. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. In ICLR 2015."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3115\/980451.980860"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1296180"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. ACL. 1533--1544","author":"Banarescu Laura","year":"2012","unstructured":"Laura Banarescu , Claire Bonial , Shu Cai , Madalina Georgescu , Kira Griffitt , Ulf Hermjakob , Kevin Knight , Philipp Koehn , Martha Palmer , and Nathan Schneider . 2012 . Abstract meaning representation (AMR) 1.0 specification . In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. ACL. 1533--1544 . Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. 2012. Abstract meaning representation (AMR) 1.0 specification. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. ACL. 1533--1544."},{"key":"e_1_2_1_17_1","volume-title":"Psychological Modeling: Conflicting Theories","author":"Bandura Albert","year":"1974","unstructured":"Albert Bandura . 1974 . Psychological Modeling: Conflicting Theories . Transaction Publishers . Albert Bandura. 1974. Psychological Modeling: Conflicting Theories. Transaction Publishers."},{"key":"e_1_2_1_18_1","volume-title":"UAI","author":"Barbu Andrei","year":"2012","unstructured":"Andrei Barbu , Alexander Bridge , Zachary Burchill , Dan Coroian , Sven Dickinson , Sanja Fidler , Aaron Michaux , Sam Mussman , Siddharth Narayanaswamy , Dhaval Salvi , and others. 2012 a. Video in sentences out . In UAI 2012. Andrei Barbu, Alexander Bridge, Zachary Burchill, Dan Coroian, Sven Dickinson, Sanja Fidler, Aaron Michaux, Sam Mussman, Siddharth Narayanaswamy, Dhaval Salvi, and others. 2012a. Video in sentences out. In UAI 2012."},{"key":"e_1_2_1_19_1","volume-title":"ACS","author":"Barbu Andrei","year":"2012","unstructured":"Andrei Barbu , Aaron Michaux , Siddharth Narayanaswamy , and Jeffrey Mark Siskind . 2012 b. Simultaneous object detection, tracking, and event recognition . In ACS 2012. Andrei Barbu, Aaron Michaux, Siddharth Narayanaswamy, and Jeffrey Mark Siskind. 2012b. Simultaneous object detection, tracking, and event recognition. In ACS 2012."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944965"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937654"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/lnc3.12170"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2014.2347207"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2505297"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.014"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744023_32"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1625275.1625609"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598228"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976603321780317"},{"key":"e_1_2_1_31_1","volume-title":"Mooney","author":"Beltagy Islam","year":"2015","unstructured":"Islam Beltagy , Stephen Roller , Pengxiang Cheng , Katrin Erk , and Raymond J . Mooney . 2015 . Representing meaning with a combination of logical form and vectors. arXiv preprint arXiv:1505.06816 (2015). Islam Beltagy, Stephen Roller, Pengxiang Cheng, Katrin Erk, and Raymond J. Mooney. 2015. Representing meaning with a combination of logical form and vectors. arXiv preprint arXiv:1505.06816 (2015)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944966"},{"key":"e_1_2_1_34_1","unstructured":"Yoshua Bengio Hugo Larochelle Pascal Lamblin Dan Popovici Aaron Courville Clarence Simard Jerome Louradour and Dumitru Erhan. 2007. Deep architectures for baby AI. (2007). Yoshua Bengio Hugo Larochelle Pascal Lamblin Dan Popovici Aaron Courville Clarence Simard Jerome Louradour and Dumitru Erhan. 2007. Deep architectures for baby AI. (2007)."},{"key":"e_1_2_1_35_1","unstructured":"A. Berg J. Deng and L. Fei-Fei. 2010. Large scale visual recognition challenge (ILSVRC) 2010. Retrieved from http:\/\/www. image-net.org\/challenges\/LSVRC (2010). A. Berg J. Deng and L. Fei-Fei. 2010. Large scale visual recognition challenge (ILSVRC) 2010. Retrieved from http:\/\/www. image-net.org\/challenges\/LSVRC (2010)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2009.5204174"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201904)","volume":"2","author":"Berg Tamara L.","unstructured":"Tamara L. Berg , Alexander C. Berg , Jaety Edwards , Michael Maire , Ryan White , Yee-Whye Teh , Erik Learned-Miller , and David A. Forsyth . 2004. Names and faces in the news . In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201904) , Vol. 2 . IEEE, II--848. Tamara L. Berg, Alexander C. Berg, Jaety Edwards, Michael Maire, Ryan White, Yee-Whye Teh, Erik Learned-Miller, and David A. Forsyth. 2004. Names and faces in the news. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201904), Vol. 2. IEEE, II--848."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1886063.1886114"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.57"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/3013558.3013571"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860460"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_2_1_43_1","volume-title":"Cognitive domain. McKay","author":"Benjamin","year":"1956","unstructured":"Benjamin S. Bloom and others . 1956 . Taxonomy of educational objectives. Vol. 1 : Cognitive domain. McKay , New York , NY (1956), 20--24. Benjamin S. Bloom and others. 1956. Taxonomy of educational objectives. Vol. 1: Cognitive domain. McKay, New York, NY (1956), 20--24."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-1085-y"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390524.2390544"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/2655713.2655714"},{"key":"e_1_2_1_47_1","unstructured":"Donna Byron Alexander Koller Jon Oberlander Laura Stoia and Kristina Striegnitz. 2007. Generating instructions in virtual environments (GIVE): A challenge and an evaluation testbed for NLG. (2007). Donna Byron Alexander Koller Jon Oberlander Laura Stoia and Kristina Striegnitz. 2007. Generating instructions in virtual environments (GIVE): A challenge and an evaluation testbed for NLG. (2007)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1075\/pc.14.2.08can"},{"key":"e_1_2_1_49_1","first-page":"3","article-title":"Toward an architecture for never-ending language learning","volume":"5","author":"Carlson Andrew","year":"2010","unstructured":"Andrew Carlson , Justin Betteridge , Bryan Kisiel , Burr Settles , Estevam R. Hruschka Jr , and Tom M. Mitchell . 2010 . Toward an architecture for never-ending language learning . In AAAI , Vol. 5. 3 . Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka Jr, and Tom M. Mitchell. 2010. Toward an architecture for never-ending language learning. In AAAI, Vol. 5. 3.","journal-title":"AAAI"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2011.04.012"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540063"},{"key":"e_1_2_1_52_1","volume-title":"ACL 2014","author":"Chang Angel X.","year":"2014","unstructured":"Angel X. Chang , Manolis Savva , and Christopher D. Manning . 2014. Semantic parsing for text to 3d scene generation . ACL 2014 ( 2014 ), 17. Angel X. Chang, Manolis Savva, and Christopher D. Manning. 2014. Semantic parsing for text to 3d scene generation. ACL 2014 (2014), 17."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.5555\/2919332.2919813"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2014-564"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326969ECO1502_5"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies\u2014Volume 1. Association for Computational Linguistics, 190--200","author":"David","unstructured":"David L. Chen and William B. Dolan. 2011. Collecting highly parallel data for paraphrase evaluation . In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies\u2014Volume 1. Association for Computational Linguistics, 190--200 . David L. Chen and William B. Dolan. 2011. Collecting highly parallel data for paraphrase evaluation. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies\u2014Volume 1. Association for Computational Linguistics, 190--200."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390173"},{"key":"e_1_2_1_58_1","volume-title":"Piotr Dollar, and C. Lawrence Zitnick","author":"Chen Xinlei","year":"2015","unstructured":"Xinlei Chen , Hao Fang , Tsung-Yi Lin , Ramakrishna Vedantam , Saurabh Gupta , Piotr Dollar, and C. Lawrence Zitnick . 2015 a. Microsoft COCO captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325 (2015). Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Vedantam, Saurabh Gupta, Piotr Dollar, and C. Lawrence Zitnick. 2015a. Microsoft COCO captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325 (2015)."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.178"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1011"},{"key":"e_1_2_1_61_1","unstructured":"Kyunghyun Cho Bart van Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder--decoder approaches. Syntax Sem. Struct. Stat. Transl. (2014) 103. Kyunghyun Cho Bart van Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder--decoder approaches. Syntax Sem. Struct. Stat. Transl. (2014) 103."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2011.12.004"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_2_1_64_1","volume-title":"AAAI Spring Symposium: Quantum Interaction. 52--55","author":"Clark Stephen","year":"2007","unstructured":"Stephen Clark and Stephen Pulman . 2007 . Combining symbolic and distributional models of meaning . In AAAI Spring Symposium: Quantum Interaction. 52--55 . Stephen Clark and Stephen Pulman. 2007. Combining symbolic and distributional models of meaning. In AAAI Spring Symposium: Quantum Interaction. 52--55."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.5.4.554"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 29th Annual Conference on Learning Theory. 698--728","author":"Cohen Nadav","year":"2016","unstructured":"Nadav Cohen , Or Sharir , and Amnon Shashua . 2016 . On the expressive power of deep learning: A tensor analysis . In Proceedings of the 29th Annual Conference on Learning Theory. 698--728 . Nadav Cohen, Or Sharir, and Amnon Shashua. 2016. On the expressive power of deep learning: A tensor analysis. In Proceedings of the 29th Annual Conference on Learning Theory. 698--728."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13218-013-0247-2"},{"key":"e_1_2_1_68_1","unstructured":"Silvia Coradeschi and Alessandro Saffiotti. 2000. Anchoring symbols to sensor data: Preliminary report. In AAAI\/IAAI. 129--135. Silvia Coradeschi and Alessandro Saffiotti. 2000. Anchoring symbols to sensor data: Preliminary report. In AAAI\/IAAI. 129--135."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-6123(07)00020-9"},{"key":"e_1_2_1_70_1","unstructured":"Trevor Darrell. 2010. Learning Representations for Real-world Recognition. Retrieved from http:\/\/www.eecs.berkeley.edu\/&sim;trevor\/colloq.pdf UCB EECS Colloquium {Accessed: 2015 11 1}. Trevor Darrell. 2010. Learning Representations for Real-world Recognition. Retrieved from http:\/\/www.eecs.berkeley.edu\/&sim;trevor\/colloq.pdf UCB EECS Colloquium {Accessed: 2015 11 1}."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.340"},{"key":"e_1_2_1_72_1","volume-title":"ACL 2007","author":"Hal Daum\u00e9","year":"2007","unstructured":"Hal Daum\u00e9 III. 2007 . Frustratingly easy domain adaptation . ACL 2007 (2007), 256. Hal Daum\u00e9 III. 2007. Frustratingly easy domain adaptation. ACL 2007 (2007), 256."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-009-5106-x"},{"key":"e_1_2_1_74_1","unstructured":"Emily L. Denton Wojciech Zaremba Joan Bruna Yann LeCun and Rob Fergus. 2014. Exploiting linear structure within convolutional networks for efficient evaluation. In Advances in Neural Information Processing Systems. 1269--1277. Emily L. Denton Wojciech Zaremba Joan Bruna Yann LeCun and Rob Fergus. 2014. Exploiting linear structure within convolutional networks for efficient evaluation. In Advances in Neural Information Processing Systems. 1269--1277."},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 762--772","author":"Dodge Jesse","year":"2012","unstructured":"Jesse Dodge , Amit Goyal , Xufeng Han , Alyssa Mensch , Margaret Mitchell , Karl Stratos , Kota Yamaguchi , Yejin Choi , Hal Daum\u00e9 III , Alexander C. Berg , and others. 2012 . Detecting visual text . In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 762--772 . Jesse Dodge, Amit Goyal, Xufeng Han, Alyssa Mensch, Margaret Mitchell, Karl Stratos, Kota Yamaguchi, Yejin Choi, Hal Daum\u00e9 III, Alexander C. Berg, and others. 2012. Detecting visual text. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 762--772."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.316"},{"key":"e_1_2_1_78_1","unstructured":"Susan T. Dumais. 2007. LSA and information retrieval: Getting back to basics. Handb. Latent Semant. Anal. (2007) 293--321. Susan T. Dumais. 2007. LSA and information retrieval: Getting back to basics. Handb. Latent Semant. Anal. (2007) 293--321."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2006.1638022"},{"key":"e_1_2_1_80_1","volume-title":"Forsyth","author":"Duygulu Pinar","year":"2002","unstructured":"Pinar Duygulu , Kobus Barnard , Joao F. G. de Freitas , and David A . Forsyth . 2002 . Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Computer Vision ECCV 2002. Springer , 97--112. Pinar Duygulu, Kobus Barnard, Joao F. G. de Freitas, and David A. Forsyth. 2002. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Computer Vision ECCV 2002. Springer, 97--112."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2014.6831803"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487376"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.4249\/scholarpedia.1747"},{"key":"e_1_2_1_84_1","doi-asserted-by":"crossref","unstructured":"Desmond Elliott and Frank Keller. 2013. Image description using visual dependency representations. In EMNLP. 1292--1302. Desmond Elliott and Frank Keller. 2013. Image description using visual dependency representations. In EMNLP. 1292--1302.","DOI":"10.18653\/v1\/D13-1128"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-2074"},{"key":"e_1_2_1_86_1","first-page":"1517","article-title":"Machine reading","volume":"6","author":"Etzioni Oren","year":"2006","unstructured":"Oren Etzioni , Michele Banko , and Michael J. Cafarella . 2006 . Machine reading . In AAAI , Vol. 6. 1517 -- 1519 . Oren Etzioni, Michele Banko, and Michael J. Cafarella. 2006. Machine reading. In AAAI, Vol. 6. 1517--1519.","journal-title":"AAAI"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0275-4"},{"key":"e_1_2_1_88_1","volume-title":"Chai","author":"Fang Rui","year":"2013","unstructured":"Rui Fang , Changsong Liu , Lanbo She , and Joyce Y . Chai . 2013 . Towards situated dialogue: Revisiting referring expression generation. In EMNLP. 392--402. Rui Fang, Changsong Liu, Lanbo She, and Joyce Y. Chai. 2013. Towards situated dialogue: Revisiting referring expression generation. In EMNLP. 392--402."},{"key":"e_1_2_1_89_1","volume-title":"Designing Representational Architectures in Recognition","author":"Farhadi Ali","unstructured":"Ali Farhadi . 2011. Designing Representational Architectures in Recognition . University of Illinois at Urbana-Champaign. Champaign , IL, USA. Ali Farhadi. 2011. Designing Representational Architectures in Recognition. University of Illinois at Urbana-Champaign. Champaign, IL, USA."},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539924"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206772"},{"key":"e_1_2_1_92_1","volume-title":"Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth.","author":"Farhadi Ali","year":"2010","unstructured":"Ali Farhadi , Mohsen Hejrati , Mohammad Amin Sadeghi , Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. 2010 . Every picture tells a story: Generating sentences from images. In Computer Vision--ECCV 2010. Springer , 15--29. Ali Farhadi, Mohsen Hejrati, Mohammad Amin Sadeghi, Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. 2010. Every picture tells a story: Generating sentences from images. In Computer Vision--ECCV 2010. Springer, 15--29."},{"key":"e_1_2_1_93_1","volume-title":"Smith","author":"Faruqui Manaal","year":"2014","unstructured":"Manaal Faruqui , Jesse Dodge , Sujay K. Jauhar , Chris Dyer , Eduard Hovy , and Noah A . Smith . 2014 . Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166 (2014). Manaal Faruqui, Jesse Dodge, Sujay K. Jauhar, Chris Dyer, Eduard Hovy, and Noah A. Smith. 2014. Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166 (2014)."},{"key":"e_1_2_1_94_1","volume-title":"Sparse overcomplete word vector representations. arXiv preprint arXiv:1506.02004","author":"Faruqui Manaal","year":"2015","unstructured":"Manaal Faruqui , Yulia Tsvetkov , Dani Yogatama , Chris Dyer , and Noah Smith . 2015. Sparse overcomplete word vector representations. arXiv preprint arXiv:1506.02004 ( 2015 ). Manaal Faruqui, Yulia Tsvetkov, Dani Yogatama, Chris Dyer, and Noah Smith. 2015. Sparse overcomplete word vector representations. arXiv preprint arXiv:1506.02004 (2015)."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2005.09.012"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.5555\/1896300.1896446"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1021"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"},{"key":"e_1_2_1_99_1","unstructured":"Daryl Fougnie. 2008. The relationship between attention and working memory. New Res. Short-term Mem. (2008) 1--45. Daryl Fougnie. 2008. The relationship between attention and working memory. New Res. Short-term Mem. (2008) 1--45."},{"key":"e_1_2_1_100_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Fouhey D. F.","unstructured":"D. F. Fouhey , A. Gupta , and A. Zisserman . 2016. 3D shape attributes . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. D. F. Fouhey, A. Gupta, and A. Zisserman. 2016. 3D shape attributes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_101_1","volume-title":"What visual attributes characterize an object class? In Computer Vision--ACCV","author":"Fu Jianlong","year":"2014","unstructured":"Jianlong Fu , Jinqiao Wang , Xin-Jing Wang , Yong Rui , and Hanqing Lu. 2015. What visual attributes characterize an object class? In Computer Vision--ACCV 2014 . Springer , 243--259. Jianlong Fu, Jinqiao Wang, Xin-Jing Wang, Yong Rui, and Hanqing Lu. 2015. What visual attributes characterize an object class? In Computer Vision--ACCV 2014. Springer, 243--259."},{"key":"e_1_2_1_102_1","unstructured":"Haoyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang and Wei Xu. 2015. Are you talking to a machine? Dataset and methods for multilingual image question. In Advances in Neural Information Processing Systems. 2296--2304. Haoyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang and Wei Xu. 2015. Are you talking to a machine? Dataset and methods for multilingual image question. In Advances in Neural Information Processing Systems. 2296--2304."},{"key":"e_1_2_1_103_1","unstructured":"D. Garcia-Gasulla J. B\u00e9jar U. Cort\u00e9s E. Ayguad\u00e9 and J. Labarta. 2015. Extracting visual patterns from deep learning representations. arXiv preprint arXiv:1507.08818 (2015). D. Garcia-Gasulla J. B\u00e9jar U. Cort\u00e9s E. Ayguad\u00e9 and J. Labarta. 2015. Extracting visual patterns from deep learning representations. arXiv preprint arXiv:1507.08818 (2015)."},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/2076.001.0001"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1111\/lnc3.12053"},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 1573--1582","author":"Garoufi Konstantina","year":"2010","unstructured":"Konstantina Garoufi and Alexander Koller . 2010 . Automated planning for situated natural language generation . In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 1573--1582 . Konstantina Garoufi and Alexander Koller. 2010. Automated planning for situated natural language generation. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 1573--1582."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12298"},{"key":"e_1_2_1_108_1","volume-title":"Computing Meaning","author":"Garrette Dan","unstructured":"Dan Garrette , Katrin Erk , and Raymond Mooney . 2014. A formal approach to linking logical form and vector-space lexical semantics . In Computing Meaning . Springer , 27--48. Dan Garrette, Katrin Erk, and Raymond Mooney. 2014. A formal approach to linking logical form and vector-space lexical semantics. In Computing Meaning. Springer, 27--48."},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.169"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-013-0658-4"},{"key":"e_1_2_1_112_1","doi-asserted-by":"crossref","unstructured":"Kristen Grauman and Bastian Leibe. 2010. Visual Object Recognition. Number 11. Morgan 8 Claypool Publishers. Kristen Grauman and Bastian Leibe. 2010. Visual Object Recognition. Number 11. Morgan 8 Claypool Publishers.","DOI":"10.1007\/978-3-031-01553-3_3"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.5840\/intstudphil19781065"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.337"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2007.154"},{"key":"e_1_2_1_116_1","unstructured":"Abhinav Gupta. 2009. Beyond nouns and verbs. (2009). Abhinav Gupta. 2009. Beyond nouns and verbs. (2009)."},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0777-6"},{"key":"e_1_2_1_118_1","volume-title":"Visual semantic role labeling. arXiv preprint arXiv:1505.04474","author":"Gupta Saurabh","year":"2015","unstructured":"Saurabh Gupta and Jitendra Malik . 2015. Visual semantic role labeling. arXiv preprint arXiv:1505.04474 ( 2015 ). Saurabh Gupta and Jitendra Malik. 2015. Visual semantic role labeling. arXiv preprint arXiv:1505.04474 (2015)."},{"key":"e_1_2_1_119_1","volume-title":"Davis","author":"Han Xintong","year":"2015","unstructured":"Xintong Han , Bharat Singh , Vlad I. Morariu , and Larry S . Davis . 2015 . Fast automatic video retrieval using web images. arXiv preprint arXiv:1512.03384 (2015). Xintong Han, Bharat Singh, Vlad I. Morariu, and Larry S. Davis. 2015. Fast automatic video retrieval using web images. arXiv preprint arXiv:1512.03384 (2015)."},{"key":"e_1_2_1_120_1","volume-title":"Hand and Rama Chellappa","author":"Emily","year":"2016","unstructured":"Emily M. Hand and Rama Chellappa . 2016 . Attributes for improved attributes: A multi-task network for attribute classification. arXiv preprint arXiv:1604.07360 (2016). Emily M. Hand and Rama Chellappa. 2016. Attributes for improved attributes: A multi-task network for attribute classification. arXiv preprint arXiv:1604.07360 (2016)."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_20"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90087-6"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1080\/00437956.1954.11659520"},{"key":"e_1_2_1_124_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR."},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88682-2_4"},{"key":"e_1_2_1_126_1","volume-title":"Distributed representations","author":"Hinton Geoffrey E.","unstructured":"Geoffrey E. Hinton . 1984. Distributed representations . Technical Report : Carnegie Melon University . Geoffrey E. Hinton. 1984. Distributed representations. Technical Report: Carnegie Melon University."},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_128_1","doi-asserted-by":"crossref","unstructured":"Micah Hodosh Peter Young and Julia Hockenmaier. 2013. Framing image description as a ranking task: Data models and evaluation metrics. J. Artif. Intell. Res. (2013) 853--899. Micah Hodosh Peter Young and Julia Hockenmaier. 2013. Framing image description as a ranking task: Data models and evaluation metrics. J. Artif. Intell. Res. (2013) 853--899.","DOI":"10.1613\/jair.3994"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/312624.312649"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X01000103"},{"key":"e_1_2_1_131_1","first-page":"1","article-title":"A statistical approach for real-time robust background subtraction and shadow detection","volume":"99","author":"Horprasert Thanarat","year":"1999","unstructured":"Thanarat Horprasert , David Harwood , and Larry S. Davis . 1999 . A statistical approach for real-time robust background subtraction and shadow detection . In IEEE ICCV , Vol. 99. 1 -- 19 . Thanarat Horprasert, David Harwood, and Larry S. Davis. 1999. A statistical approach for real-time robust background subtraction and shadow detection. In IEEE ICCV, Vol. 99. 1--19.","journal-title":"IEEE ICCV"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460096.1460104"},{"key":"e_1_2_1_134_1","unstructured":"Julian Jaynes. 2000. The Origin of Consciousness in the Breakdown of the Bicameral Mind. Houghton Mifflin Harcourt. Julian Jaynes. 2000. The Origin of Consciousness in the Breakdown of the Bicameral Mind. Houghton Mifflin Harcourt."},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860459"},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.494"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89447-6_21"},{"key":"e_1_2_1_138_1","volume-title":"Learning visual features from large weakly supervised data. arXiv preprint arXiv:1511.02251","author":"Joulin Armand","year":"2015","unstructured":"Armand Joulin , Laurens van der Maaten , Allan Jabri , and Nicolas Vasilache . 2015. Learning visual features from large weakly supervised data. arXiv preprint arXiv:1511.02251 ( 2015 ). Armand Joulin, Laurens van der Maaten, Allan Jabri, and Nicolas Vasilache. 2015. Learning visual features from large weakly supervised data. arXiv preprint arXiv:1511.02251 (2015)."},{"key":"e_1_2_1_139_1","volume-title":"Department of Computer Science","author":"Karapurkar Alap","year":"2074","unstructured":"Alap Karapurkar . 2008. Modeling human activities. Scholarly Paper Archive , Department of Computer Science , University of Maryland , College Park, MD , 2074 2. Alap Karapurkar. 2008. Modeling human activities. Scholarly Paper Archive, Department of Computer Science, University of Maryland, College Park, MD, 20742."},{"key":"e_1_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"e_1_2_1_142_1","unstructured":"Ryan Kiros Yukun Zhu Ruslan R. Salakhutdinov Richard Zemel Raquel Urtasun Antonio Torralba and Sanja Fidler. 2015. Skip-thought vectors. In Advances in Neural Information Processing Systems. 3276--3284. Ryan Kiros Yukun Zhu Ruslan R. Salakhutdinov Richard Zemel Raquel Urtasun Antonio Torralba and Sanja Fidler. 2015. Skip-thought vectors. In Advances in Neural Information Processing Systems. 3276--3284."},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020346032608"},{"key":"e_1_2_1_144_1","volume-title":"ACL 2007","author":"Koller Alexander","year":"2007","unstructured":"Alexander Koller and Matthew Stone . 2007 . Sentence generation as a planning problem . ACL 2007 (2007), 336. Alexander Koller and Matthew Stone. 2007. Sentence generation as a planning problem. ACL 2007 (2007), 336."},{"key":"e_1_2_1_145_1","volume-title":"International Journal of Computer Vision","author":"Krishna Ranjay","year":"2016","unstructured":"Ranjay Krishna , Yuke Zhu , Oliver Groth , Justin Johnson , Kenji Hata , Joshua Kravitz , Stephanie Chen , Yannis Kalanditis , Li-Jia Li , David A. Shamma , Michael Bernstein , and Li Fei-Fei . 2016. Visual genome: Connecting language and vision using crowdsourced dense image annotations . International Journal of Computer Vision ( 2016 ), 45. Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalanditis, Li-Jia Li, David A. Shamma, Michael Bernstein, and Li Fei-Fei. 2016. Visual genome: Connecting language and vision using crowdsourced dense image annotations. International Journal of Computer Vision (2016), 45."},{"key":"e_1_2_1_146_1","first-page":"10","article-title":"Generating natural-language video descriptions using text-mined knowledge","volume":"2013","author":"Krishnamoorthy Niveda","year":"2013","unstructured":"Niveda Krishnamoorthy , Girish Malkarnenkar , Raymond Mooney , Kate Saenko , and Sergio Guadarrama . 2013 . Generating natural-language video descriptions using text-mined knowledge . NAACL HLT 2013 (2013), 10 . Niveda Krishnamoorthy, Girish Malkarnenkar, Raymond Mooney, Kate Saenko, and Sergio Guadarrama. 2013. Generating natural-language video descriptions using text-mined knowledge. NAACL HLT 2013 (2013), 10.","journal-title":"NAACL HLT"},{"key":"e_1_2_1_147_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems . 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 1097--1105."},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00145"},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.162"},{"key":"e_1_2_1_150_1","unstructured":"Ankit Kumar Ozan Irsoy Jonathan Su James Bradbury Robert English Brian Pierce Peter Ondruska Ishaan Gulrajani and Richard Socher. 2016. Ask me anything: Dynamic memory networks for natural language processing. In ICML. Ankit Kumar Ozan Irsoy Jonathan Su James Bradbury Robert English Brian Pierce Peter Ondruska Ishaan Gulrajani and Richard Socher. 2016. Ask me anything: Dynamic memory networks for natural language processing. In ICML."},{"key":"e_1_2_1_151_1","volume-title":"Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. IEEE, 365--372","author":"Kumar Neeraj","unstructured":"Neeraj Kumar , Alexander C. Berg , Peter N. Belhumeur , and Shree K. Nayar . 2009. Attribute and simile classifiers for face verification . In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. IEEE, 365--372 . Neeraj Kumar, Alexander C. Berg, Peter N. Belhumeur, and Shree K. Nayar. 2009. Attribute and simile classifiers for face verification. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. IEEE, 365--372."},{"key":"e_1_2_1_152_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390524.2390575"},{"key":"e_1_2_1_153_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980382"},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364910369190"},{"key":"e_1_2_1_155_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206594"},{"key":"e_1_2_1_156_1","unstructured":"Victor Lavrenko R. Manmatha and Jiwoon Jeon. 2003. A model for learning the semantics of pictures. In Advances in Neural Information Processing Systems. None. Victor Lavrenko R. Manmatha and Jiwoon Jeon. 2003. A model for learning the semantics of pictures. In Advances in Neural Information Processing Systems. None."},{"key":"e_1_2_1_157_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.68"},{"key":"e_1_2_1_158_1","volume-title":"Tuhoi: Trento universal human object interaction dataset. V8L Net 2014","author":"Le Dieu-Thu","year":"2014","unstructured":"Dieu-Thu Le , Jasper Uijlings , and Raffaella Bernardi . 2014 . Tuhoi: Trento universal human object interaction dataset. V8L Net 2014 (2014), 17. Dieu-Thu Le, Jasper Uijlings, and Raffaella Bernardi. 2014. Tuhoi: Trento universal human object interaction dataset. V8L Net 2014 (2014), 17."},{"key":"e_1_2_1_159_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_160_1","unstructured":"Chee Wee Leong and Rada Mihalcea. 2011. Going beyond text: A hybrid image-text approach for measuring word relatedness. In IJCNLP. 1403--1407. Chee Wee Leong and Rada Mihalcea. 2011. Going beyond text: A hybrid image-text approach for measuring word relatedness. In IJCNLP. 1403--1407."},{"key":"e_1_2_1_161_1","volume-title":"International Encyclopedia of Social and Behavioral Sciences","author":"Levinson Stephen C.","year":"1948","unstructured":"Stephen C. Levinson . 2001. Pragmatics . In International Encyclopedia of Social and Behavioral Sciences : Vol. 17 . Pergamon , 1 1948 --11954. Stephen C. Levinson. 2001. Pragmatics. In International Encyclopedia of Social and Behavioral Sciences: Vol. 17. Pergamon, 11948--11954."},{"key":"e_1_2_1_162_1","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics","volume":"2","author":"Levy Omer","year":"2014","unstructured":"Omer Levy and Yoav Goldberg . 2014 a. Dependencybased word embeddings . In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics , Vol. 2 . 302--308. Omer Levy and Yoav Goldberg. 2014a. Dependencybased word embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Vol. 2. 302--308."},{"key":"e_1_2_1_163_1","unstructured":"Omer Levy and Yoav Goldberg. 2014b. Neural word embedding as implicit matrix factorization. In Advances in Neural Information Processing Systems. 2177--2185. Omer Levy and Yoav Goldberg. 2014b. Neural word embedding as implicit matrix factorization. In Advances in Neural Information Processing Systems. 2177--2185."},{"key":"e_1_2_1_164_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408872"},{"key":"e_1_2_1_165_1","volume-title":"Proceedings of the 15th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 220--228","author":"Li Siming","year":"2011","unstructured":"Siming Li , Girish Kulkarni , Tamara L. Berg , Alexander C. Berg , and Yejin Choi . 2011 . Composing simple image descriptions using web-scale n-grams . In Proceedings of the 15th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 220--228 . Siming Li, Girish Kulkarni, Tamara L. Berg, Alexander C. Berg, and Yejin Choi. 2011. Composing simple image descriptions using web-scale n-grams. In Proceedings of the 15th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 220--228."},{"key":"e_1_2_1_166_1","doi-asserted-by":"publisher","DOI":"10.1145\/2906152"},{"key":"e_1_2_1_167_1","volume-title":"Text Summarization Branches Out: Proceedings of the ACL-04 Workshop","volume":"8","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . Rouge: A package for automatic evaluation of summaries . In Text Summarization Branches Out: Proceedings of the ACL-04 Workshop , Vol. 8 . Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out: Proceedings of the ACL-04 Workshop, Vol. 8."},{"key":"e_1_2_1_168_1","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence. AAAI Press, 2288--2294","author":"Liu Changsong","year":"2015","unstructured":"Changsong Liu and Joyce Yue Chai . 2015 . Learning to mediate perceptual differences in situated human-robot dialogue . In Proceedings of the 29th AAAI Conference on Artificial Intelligence. AAAI Press, 2288--2294 . Changsong Liu and Joyce Yue Chai. 2015. Learning to mediate perceptual differences in situated human-robot dialogue. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. AAAI Press, 2288--2294."},{"key":"e_1_2_1_169_1","volume-title":"Chai","author":"Liu Changsong","year":"2014","unstructured":"Changsong Liu , Lanbo She , Rui Fang , and Joyce Y . Chai . 2014 a. Probabilistic labeling for efficient referential grounding based on collaborative discourse. In ACL ( 2). 13--18. Changsong Liu, Lanbo She, Rui Fang, and Joyce Y. Chai. 2014a. Probabilistic labeling for efficient referential grounding based on collaborative discourse. In ACL (2). 13--18."},{"key":"e_1_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995353"},{"key":"e_1_2_1_171_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_2_1_172_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.93"},{"key":"e_1_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_1_174_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_1_175_1","volume-title":"Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability","volume":"1","author":"James","unstructured":"James MacQueen and others. 1967. Some methods for classification and analysis of multivariate observations . In Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability , Vol. 1 . 281--297. James MacQueen and others. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1. 281--297."},{"key":"e_1_2_1_176_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_24"},{"key":"e_1_2_1_177_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6385560"},{"key":"e_1_2_1_178_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2016.01.019"},{"key":"e_1_2_1_179_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.9"},{"key":"e_1_2_1_180_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1015"},{"key":"e_1_2_1_181_1","volume-title":"Proceedings of RO-MAN (To appear).","author":"Marge Matthew","year":"2016","unstructured":"Matthew Marge , Claire Bonial , Brendan Byrne , Taylor Cassidy , A. William Evans , Susan G. Hill , and Clare Voss . 2016 . Applying the wizard-of-oz technique to multimodal human-robot dialogue . In Proceedings of RO-MAN (To appear). Matthew Marge, Claire Bonial, Brendan Byrne, Taylor Cassidy, A. William Evans, Susan G. Hill, and Clare Voss. 2016. Applying the wizard-of-oz technique to multimodal human-robot dialogue. In Proceedings of RO-MAN (To appear)."},{"key":"e_1_2_1_182_1","volume-title":"Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information","author":"Marr David","year":"1982","unstructured":"David Marr . 1982 . Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information . Henry Holt and Co., Inc. , New York, NY . David Marr. 1982. Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information. Henry Holt and Co., Inc., New York, NY."},{"key":"e_1_2_1_183_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.1273918"},{"key":"e_1_2_1_184_1","volume-title":"Proceedings of the 2012 International Conference on Machine Learning","author":"Cynthia","year":"2012","unstructured":"Cynthia Matuszek*, Nicholas FitzGerald*, Luke Zettlemoyer , Liefeng Bo , and Dieter Fox . 2012 . A joint model of language and perception for grounded attribute learning . In Proceedings of the 2012 International Conference on Machine Learning . Edinburgh, Scotland. Cynthia Matuszek*, Nicholas FitzGerald*, Luke Zettlemoyer, Liefeng Bo, and Dieter Fox. 2012. A joint model of language and perception for grounded attribute learning. In Proceedings of the 2012 International Conference on Machine Learning. Edinburgh, Scotland."},{"key":"e_1_2_1_185_1","volume-title":"Experimental Robotics","author":"Matuszek Cynthia","unstructured":"Cynthia Matuszek , Evan Herbst , Luke Zettlemoyer , and Dieter Fox . 2013. Learning to parse natural language commands to a robot control system . In Experimental Robotics . Springer , 403--415. Cynthia Matuszek, Evan Herbst, Luke Zettlemoyer, and Dieter Fox. 2013. Learning to parse natural language commands to a robot control system. In Experimental Robotics. Springer, 403--415."},{"key":"e_1_2_1_186_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2014.09.031"},{"key":"e_1_2_1_187_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2006.282258"},{"key":"e_1_2_1_188_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783381"},{"key":"e_1_2_1_189_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767755"},{"key":"e_1_2_1_190_1","volume-title":"Blei","author":"Mcauliffe Jon D.","year":"2008","unstructured":"Jon D. Mcauliffe and David M . Blei . 2008 . Supervised topic models. In Advances in Neural Information Processing Systems . 121--128. Jon D. Mcauliffe and David M. Blei. 2008. Supervised topic models. In Advances in Neural Information Processing Systems. 121--128."},{"key":"e_1_2_1_191_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00126"},{"key":"e_1_2_1_192_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03192726"},{"key":"e_1_2_1_193_1","volume-title":"Jones","author":"Meyers Chet","year":"1993","unstructured":"Chet Meyers and Thomas B . Jones . 1993 . Promoting Active Learning. Strategies for the College Classroom . ERIC. Chet Meyers and Thomas B. Jones. 1993. Promoting Active Learning. Strategies for the College Classroom. ERIC."},{"key":"e_1_2_1_194_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119. Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119."},{"key":"e_1_2_1_195_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_196_1","doi-asserted-by":"publisher","DOI":"10.5555\/1204056"},{"key":"e_1_2_1_197_1","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 747--756","author":"Mitchell Margaret","year":"2012","unstructured":"Margaret Mitchell , Xufeng Han , Jesse Dodge , Alyssa Mensch , Amit Goyal , Alex Berg , Kota Yamaguchi , Tamara Berg , Karl Stratos , and Hal Daum\u00e9 III. 2012 . Midge: Generating image descriptions from computer vision detections . In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 747--756 . Margaret Mitchell, Xufeng Han, Jesse Dodge, Alyssa Mensch, Amit Goyal, Alex Berg, Kota Yamaguchi, Tamara Berg, Karl Stratos, and Hal Daum\u00e9 III. 2012. Midge: Generating image descriptions from computer vision detections. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 747--756."},{"key":"e_1_2_1_198_1","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00143"},{"key":"e_1_2_1_199_1","unstructured":"Raymond J. Mooney. 2008. Learning to connect language and perception. In AAAI. 1598--1601. Raymond J. Mooney. 2008. Learning to connect language and perception. In AAAI. 1598--1601."},{"key":"e_1_2_1_200_1","volume-title":"27th AAAI Conference on Artificial Intelligence, Washington 2013 Retrieved","author":"Mooney Raymond J.","year":"2013","unstructured":"Raymond J. Mooney . 2013 . Grounded Language Learning. (7 2013) . 27th AAAI Conference on Artificial Intelligence, Washington 2013 Retrieved November 2, 2015 from http:\/\/videolectures.net\/ aaai2013_mooney_language_learning\/. Raymond J. Mooney. 2013. Grounded Language Learning. (7 2013). 27th AAAI Conference on Artificial Intelligence, Washington 2013 Retrieved November 2, 2015 from http:\/\/videolectures.net\/ aaai2013_mooney_language_learning\/."},{"key":"e_1_2_1_201_1","volume-title":"First International Workshop on Multimedia Intelligent Storage and Retrieval Management. Citeseer, 1--9.","author":"Mori Yasuhide","year":"1999","unstructured":"Yasuhide Mori , Hironobu Takahashi , and Ryuichi Oka . 1999 . Image-to-word transformation based on dividing and vector quantizing images with words . In First International Workshop on Multimedia Intelligent Storage and Retrieval Management. Citeseer, 1--9. Yasuhide Mori, Hironobu Takahashi, and Ryuichi Oka. 1999. Image-to-word transformation based on dividing and vector quantizing images with words. In First International Workshop on Multimedia Intelligent Storage and Retrieval Management. Citeseer, 1--9."},{"key":"e_1_2_1_202_1","volume-title":"Proceedings of the International Workshop on Artificial Intelligence and Statistics. Citeseer, 246--252","author":"Morin Frederic","year":"2005","unstructured":"Frederic Morin and Yoshua Bengio . 2005 . Hierarchical probabilistic neural network language model . In Proceedings of the International Workshop on Artificial Intelligence and Statistics. Citeseer, 246--252 . Frederic Morin and Yoshua Bengio. 2005. Hierarchical probabilistic neural network language model. In Proceedings of the International Workshop on Artificial Intelligence and Statistics. Citeseer, 246--252."},{"key":"e_1_2_1_203_1","unstructured":"Charles William Morris. 1938. Foundations of the theory of signs. (1938). Charles William Morris. 1938. Foundations of the theory of signs. (1938)."},{"key":"e_1_2_1_204_1","doi-asserted-by":"publisher","DOI":"10.1145\/2671188.2749391"},{"key":"e_1_2_1_205_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139369"},{"key":"e_1_2_1_206_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195588"},{"key":"e_1_2_1_207_1","unstructured":"Alexander Novikov Dmitry Podoprikhin Anton Osokin and Dmitry Vetrov. 2015. Tensorizing neural networks. In Advances in Neural Information Processing Systems 28 (NIPS). Alexander Novikov Dmitry Podoprikhin Anton Osokin and Dmitry Vetrov. 2015. Tensorizing neural networks. In Advances in Neural Information Processing Systems 28 (NIPS)."},{"key":"e_1_2_1_208_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011139631724"},{"key":"e_1_2_1_209_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.344"},{"key":"e_1_2_1_210_1","volume-title":"Berg","author":"Ordonez Vicente","year":"2011","unstructured":"Vicente Ordonez , Girish Kulkarni , and Tamara L . Berg . 2011 . Im2text: Describing images using 1 million captioned photographs. In Advances in Neural Information Processing Systems . 1143--1151. Vicente Ordonez, Girish Kulkarni, and Tamara L. Berg. 2011. Im2text: Describing images using 1 million captioned photographs. In Advances in Neural Information Processing Systems. 1143--1151."},{"key":"e_1_2_1_211_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_2_1_212_1","doi-asserted-by":"publisher","DOI":"10.5555\/1751336"},{"key":"e_1_2_1_213_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126281"},{"key":"e_1_2_1_214_1","volume-title":"Bruce Xiaohan Nie, and Song-Chun Zhu","author":"Park Seyoung","year":"2016","unstructured":"Seyoung Park , Bruce Xiaohan Nie, and Song-Chun Zhu . 2016 . Attribute and- or grammar for joint parsing of human attributes, part and pose. arXiv preprint arXiv:1605.02112 (2016). Seyoung Park, Bruce Xiaohan Nie, and Song-Chun Zhu. 2016. Attribute and-or grammar for joint parsing of human attributes, part and pose. arXiv preprint arXiv:1605.02112 (2016)."},{"key":"e_1_2_1_215_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2011.0123"},{"key":"e_1_2_1_216_1","volume-title":"Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014)","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D. Manning . 2014. Glove: Global vectors for word representation . Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014) 12 ( 2014 ), 1532--1543. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global vectors for word representation. Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014) 12 (2014), 1532--1543."},{"key":"e_1_2_1_217_1","volume-title":"Dreams and Imitation in Childhood","author":"Piaget Jean","unstructured":"Jean Piaget . 2013. Play , Dreams and Imitation in Childhood . Vol. 25 . Routledge . Jean Piaget. 2013. Play, Dreams and Imitation in Childhood. Vol. 25. Routledge."},{"key":"e_1_2_1_218_1","volume-title":"A common framework for distributed representation schemes for compositional structure. Connectionist Systems for Knowledge Representation and Deduction","author":"Plate Tony","year":"1997","unstructured":"Tony Plate . 1997. A common framework for distributed representation schemes for compositional structure. Connectionist Systems for Knowledge Representation and Deduction ( 1997 ), 15--34. Tony Plate. 1997. A common framework for distributed representation schemes for compositional structure. Connectionist Systems for Knowledge Representation and Deduction (1997), 15--34."},{"key":"e_1_2_1_219_1","doi-asserted-by":"publisher","DOI":"10.2197\/ipsjtcva.1.83"},{"key":"e_1_2_1_220_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2537320"},{"key":"e_1_2_1_221_1","doi-asserted-by":"publisher","DOI":"10.5555\/1699510.1699512"},{"key":"e_1_2_1_222_1","article-title":"Language ambiguity: A curse and a blessing","volume":"7","author":"Quiroga-Clare Cecilia","year":"2003","unstructured":"Cecilia Quiroga-Clare . 2003 . Language ambiguity: A curse and a blessing . Transl. J. 7 , 1 (2003). Cecilia Quiroga-Clare. 2003. Language ambiguity: A curse and a blessing. Transl. J. 7, 1 (2003).","journal-title":"Transl. J."},{"key":"e_1_2_1_223_1","volume-title":"Zacks","author":"Radvansky Gabriel A.","year":"2014","unstructured":"Gabriel A. Radvansky and Jeffrey M . Zacks . 2014 . Event Cognition. Oxford University Press . Gabriel A. Radvansky and Jeffrey M. Zacks. 2014. Event Cognition. Oxford University Press."},{"key":"e_1_2_1_224_1","unstructured":"Mengye Ren Ryan Kiros and Richard Zemel. 2015. Exploring models and data for image question answering. In Advances in Neural Information Processing Systems. 2953--2961. Mengye Ren Ryan Kiros and Richard Zemel. 2015. Exploring models and data for image question answering. In Advances in Neural Information Processing Systems. 2953--2961."},{"key":"e_1_2_1_225_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.27.070203.144230"},{"key":"e_1_2_1_226_1","volume-title":"Pattern Recognition","author":"Rohrbach Anna","unstructured":"Anna Rohrbach , Marcus Rohrbach , Wei Qiu , Annemarie Friedrich , Manfred Pinkal , and Bernt Schiele . 2014. Coherent multi-sentence video description with variable level of detail . In Pattern Recognition . Springer , 184--195. Anna Rohrbach, Marcus Rohrbach, Wei Qiu, Annemarie Friedrich, Manfred Pinkal, and Bernt Schiele. 2014. Coherent multi-sentence video description with variable level of detail. In Pattern Recognition. Springer, 184--195."},{"key":"e_1_2_1_227_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298940"},{"key":"e_1_2_1_228_1","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1146--1157","author":"Roller Stephen","year":"2013","unstructured":"Stephen Roller and Sabine Schulte Im Walde . 2013 . A multimodal LDA model integrating textual, cognitive and visual modalities . In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1146--1157 . Stephen Roller and Sabine Schulte Im Walde. 2013. A multimodal LDA model integrating textual, cognitive and visual modalities. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 1146--1157."},{"key":"e_1_2_1_229_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1173"},{"key":"e_1_2_1_230_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2323"},{"key":"e_1_2_1_231_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2005.06.013"},{"key":"e_1_2_1_232_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0090-8"},{"key":"e_1_2_1_233_1","volume-title":"VISALOGY: Answering visual analogy questions. In Advances in Neural Information Processing Systems (NIPS-15).","author":"Sadeghi Fereshteh","year":"2015","unstructured":"Fereshteh Sadeghi , C. Lawrence Zitnick , and Ali Farhadi . 2015 . VISALOGY: Answering visual analogy questions. In Advances in Neural Information Processing Systems (NIPS-15). Fereshteh Sadeghi, C. Lawrence Zitnick, and Ali Farhadi. 2015. VISALOGY: Answering visual analogy questions. In Advances in Neural Information Processing Systems (NIPS-15)."},{"key":"e_1_2_1_234_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995711"},{"key":"e_1_2_1_235_1","volume-title":"VerbNet: A broad-coverage, comprehensive verb lexicon (January 1","author":"Schuler Karin Kipper","year":"2005","unstructured":"Karin Kipper Schuler . 2005. VerbNet: A broad-coverage, comprehensive verb lexicon (January 1 , 2005 ). Dissertations available from ProQuest. Paper AAI3179808. http:\/\/repository.upenn.edu\/dissertations\/AAI3179808. Karin Kipper Schuler. 2005. VerbNet: A broad-coverage, comprehensive verb lexicon (January 1, 2005). Dissertations available from ProQuest. Paper AAI3179808. http:\/\/repository.upenn.edu\/dissertations\/AAI3179808."},{"key":"e_1_2_1_236_1","first-page":"258","article-title":"Symmetric pattern based word embeddings for improved word similarity prediction","volume":"2015","author":"Schwartz Roy","year":"2015","unstructured":"Roy Schwartz , Roi Reichart , and Ari Rappoport . 2015 . Symmetric pattern based word embeddings for improved word similarity prediction . CoNLL 2015 (2015), 258 . Roy Schwartz, Roi Reichart, and Ari Rappoport. 2015. Symmetric pattern based word embeddings for improved word similarity prediction. CoNLL 2015 (2015), 258.","journal-title":"CoNLL"},{"key":"e_1_2_1_237_1","volume-title":"Proceedings of the 2015 AAAI Fall Symposium Series.","author":"Shukla Nishant","year":"2015","unstructured":"Nishant Shukla , Caiming Xiong , and Song-Chun Zhu . 2015 . A unified framework for human-robot knowledge transfer . In Proceedings of the 2015 AAAI Fall Symposium Series. Nishant Shukla, Caiming Xiong, and Song-Chun Zhu. 2015. A unified framework for human-robot knowledge transfer. In Proceedings of the 2015 AAAI Fall Symposium Series."},{"key":"e_1_2_1_238_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.99"},{"key":"e_1_2_1_239_1","unstructured":"Carina Silberer Vittorio Ferrari and Mirella Lapata. 2013. Models of semantic representation with visual attributes. In ACL (1). 572--582. Carina Silberer Vittorio Ferrari and Mirella Lapata. 2013. Models of semantic representation with visual attributes. In ACL (1). 572--582."},{"key":"e_1_2_1_240_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_1_241_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.518"},{"key":"e_1_2_1_242_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.790"},{"key":"e_1_2_1_243_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00177"},{"key":"e_1_2_1_244_1","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML-11)","author":"Socher Richard","unstructured":"Richard Socher , Cliff C. Lin , Chris Manning , and Andrew Y. Ng . 2011. Parsing natural scenes and natural language with recursive neural networks . In Proceedings of the 28th International Conference on Machine Learning (ICML-11) . 129--136. Richard Socher, Cliff C. Lin, Chris Manning, and Andrew Y. Ng. 2011. Parsing natural scenes and natural language with recursive neural networks. In Proceedings of the 28th International Conference on Machine Learning (ICML-11). 129--136."},{"key":"e_1_2_1_245_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697059"},{"key":"e_1_2_1_246_1","unstructured":"Mark Steedman. 1996. Surface structure and interpretation. (1996). Mark Steedman. 1996. Surface structure and interpretation. (1996)."},{"key":"e_1_2_1_247_1","unstructured":"Sainbayar Sukhbaatar Jason Weston Rob Fergus and others. 2015. End-to-end memory networks. In Advances in Neural Information Processing Systems. 2440--2448. Sainbayar Sukhbaatar Jason Weston Rob Fergus and others. 2015. End-to-end memory networks. In Advances in Neural Information Processing Systems. 2440--2448."},{"key":"e_1_2_1_248_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6385483"},{"key":"e_1_2_1_249_1","unstructured":"Douglas Alan Summers-Stay. 2013. Productive vision: Methods for automatic image comprehension. (2013). Douglas Alan Summers-Stay. 2013. Productive vision: Methods for automatic image comprehension. (2013)."},{"key":"e_1_2_1_250_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6630858"},{"key":"e_1_2_1_251_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_2_1_252_1","volume-title":"Manning","author":"Tai Kai Sheng","year":"2015","unstructured":"Kai Sheng Tai , Richard Socher , and Christopher D . Manning . 2015 . Improved semantic representations from tree-structured long short-term memory networks. In ACL. Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved semantic representations from tree-structured long short-term memory networks. In ACL."},{"key":"e_1_2_1_253_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.220"},{"key":"e_1_2_1_254_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298792"},{"key":"e_1_2_1_255_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.501"},{"key":"e_1_2_1_256_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102464"},{"key":"e_1_2_1_257_1","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2014.X.024"},{"key":"e_1_2_1_258_1","volume-title":"Seth J. Teller, and Nicholas Roy.","author":"Tellex Stefanie","year":"2011","unstructured":"Stefanie Tellex , Thomas Kollar , Steven Dickerson , Matthew R. Walter , Ashis Gopal Banerjee , Seth J. Teller, and Nicholas Roy. 2011 . Understanding natural language commands for robotic navigation and mobile manipulation. In AAAI. Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R. Walter, Ashis Gopal Banerjee, Seth J. Teller, and Nicholas Roy. 2011. Understanding natural language commands for robotic navigation and mobile manipulation. In AAAI."},{"key":"e_1_2_1_259_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"e_1_2_1_260_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299147"},{"key":"e_1_2_1_261_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6224589"},{"key":"e_1_2_1_262_1","volume-title":"Proceedings of the 25th International Conference on Computational Linguistics (COLING).","author":"Thomason Jesse","year":"2014","unstructured":"Jesse Thomason , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , and Raymond Mooney . 2014 . Integrating language and vision to generate natural language descriptions of videos in the wild . In Proceedings of the 25th International Conference on Computational Linguistics (COLING). Jesse Thomason, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, and Raymond Mooney. 2014. Integrating language and vision to generate natural language descriptions of videos in the wild. In Proceedings of the 25th International Conference on Computational Linguistics (COLING)."},{"key":"e_1_2_1_263_1","doi-asserted-by":"publisher","DOI":"10.5555\/2832415.2832516"},{"key":"e_1_2_1_264_1","unstructured":"Sebastian Thrun Wolfram Burgard and Dieter Fox. 2005. Probabilistic Robotics. MIT Press. Sebastian Thrun Wolfram Burgard and Dieter Fox. 2005. Probabilistic Robotics. MIT Press."},{"key":"e_1_2_1_265_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888150.1888179"},{"key":"e_1_2_1_266_1","volume-title":"Using descriptive video services to create a large data source for video annotation research. arXiv preprint arXiv:1503.01070","author":"Torabi Atousa","year":"2015","unstructured":"Atousa Torabi , Christopher Pal , Hugo Larochelle , and Aaron Courville . 2015. Using descriptive video services to create a large data source for video annotation research. arXiv preprint arXiv:1503.01070 ( 2015 ). Atousa Torabi, Christopher Pal, Hugo Larochelle, and Aaron Courville. 2015. Using descriptive video services to create a large data source for video annotation research. arXiv preprint arXiv:1503.01070 (2015)."},{"key":"e_1_2_1_267_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995347"},{"key":"e_1_2_1_268_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.05.017"},{"key":"e_1_2_1_269_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-6642-x"},{"key":"e_1_2_1_270_1","volume-title":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 384--394","author":"Turian Joseph","year":"2010","unstructured":"Joseph Turian , Lev Ratinov , and Yoshua Bengio . 2010 . Word representations: A simple and general method for semi-supervised learning . In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 384--394 . Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: A simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 384--394."},{"key":"e_1_2_1_271_1","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.1991.3.1.71"},{"key":"e_1_2_1_272_1","volume-title":"Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 4712--4721","author":"Jasper R.","unstructured":"Jasper R. R. Uijlings and Vittorio Ferrari. 2015. Situational object boundary detection . In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 4712--4721 . Jasper R. R. Uijlings and Vittorio Ferrari. 2015. Situational object boundary detection. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 4712--4721."},{"key":"e_1_2_1_273_1","first-page":"1","article-title":"Dimensionality reduction: A comparative review","volume":"10","author":"van der Maaten Laurens J. P.","year":"2009","unstructured":"Laurens J. P. van der Maaten , Eric O. Postma , and H. Jaap van den Herik . 2009 . Dimensionality reduction: A comparative review . J. Mach. Learn. Res. 10 , 1 -- 41 (2009), 66--71. Laurens J. P. van der Maaten, Eric O. Postma, and H. Jaap van den Herik. 2009. Dimensionality reduction: A comparative review. J. Mach. Learn. Res. 10, 1--41 (2009), 66--71.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_274_1","first-page":"105","article-title":"Structures profondes et traduction automatique. Le syst\u00e8me du CETA","volume":"13","author":"Vauquois Bernard","year":"1968","unstructured":"Bernard Vauquois . 1968 . Structures profondes et traduction automatique. Le syst\u00e8me du CETA . Rev. Roum. Ling. 13 , 2 (1968), 105 -- 130 . Bernard Vauquois. 1968. Structures profondes et traduction automatique. Le syst\u00e8me du CETA. Rev. Roum. Ling. 13, 2 (1968), 105--130.","journal-title":"Rev. Roum. Ling."},{"key":"e_1_2_1_275_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299087"},{"key":"e_1_2_1_276_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.515"},{"key":"e_1_2_1_277_1","doi-asserted-by":"crossref","unstructured":"Subhashini Venugopalan Huijuan Xu Jeff Donahue Marcus Rohrbach Raymond Mooney and Kate Saenko. 2015b. Translating videos to natural language using deep recurrent neural networks. In NAACL HLT. Subhashini Venugopalan Huijuan Xu Jeff Donahue Marcus Rohrbach Raymond Mooney and Kate Saenko. 2015b. Translating videos to natural language using deep recurrent neural networks. In NAACL HLT.","DOI":"10.3115\/v1\/N15-1173"},{"key":"e_1_2_1_278_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"e_1_2_1_279_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"},{"key":"e_1_2_1_280_1","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21539"},{"key":"e_1_2_1_281_1","volume-title":"Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909)","author":"Wang Chong","year":"2009","unstructured":"Chong Wang , David Blei , and Fei-Fei Li . 2009 . Simultaneous image classification and annotation . In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909) . IEEE, 1903--1910. Chong Wang, David Blei, and Fei-Fei Li. 2009. Simultaneous image classification and annotation. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201909). IEEE, 1903--1910."},{"key":"e_1_2_1_282_1","doi-asserted-by":"publisher","DOI":"10.1145\/2333112.2333120"},{"key":"e_1_2_1_283_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1988.23856"},{"key":"e_1_2_1_284_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Wu Qi","unstructured":"Qi Wu , Peng Wang , Chunhua Shen , Anton van den Hengel, and Anthony Dick. 2015b. Ask me anything: Free-form visual question answering based on knowledge from external sources . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Qi Wu, Peng Wang, Chunhua Shen, Anton van den Hengel, and Anthony Dick. 2015b. Ask me anything: Free-form visual question answering based on knowledge from external sources. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_285_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1912--1920","author":"Wu Zhirong","year":"2015","unstructured":"Zhirong Wu , Shuran Song , Aditya Khosla , Fisher Yu , Linguang Zhang , Xiaoou Tang , and Jianxiong Xiao . 2015 a. 3d shapenets: A deep representation for volumetric shapes . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1912--1920 . Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015a. 3d shapenets: A deep representation for volumetric shapes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1912--1920."},{"key":"e_1_2_1_286_1","unstructured":"Caiming Xiong Stephen Merity and Richard Socher. 2016. Dynamic memory networks for visual and textual question answering. In ICML. Caiming Xiong Stephen Merity and Richard Socher. 2016. Dynamic memory networks for visual and textual question answering. In ICML."},{"key":"e_1_2_1_287_1","volume-title":"A multi-scale multiple instance video description network. arXiv preprint arXiv:1505.05914","author":"Xu Huijuan","year":"2015","unstructured":"Huijuan Xu , Subhashini Venugopalan , Vasili Ramanishka , Marcus Rohrbach , and Kate Saenko . 2015b. A multi-scale multiple instance video description network. arXiv preprint arXiv:1505.05914 ( 2015 ). Huijuan Xu, Subhashini Venugopalan, Vasili Ramanishka, Marcus Rohrbach, and Kate Saenko. 2015b. A multi-scale multiple instance video description network. arXiv preprint arXiv:1505.05914 (2015)."},{"key":"e_1_2_1_288_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning. 2048--2057","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron Courville , Ruslan Salakhudinov , Rich Zemel , and Yoshua Bengio . 2015 a. Show, attend and tell: Neural image caption generation with visual attention . In Proceedings of the 32nd International Conference on Machine Learning. 2048--2057 . Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015a. Show, attend and tell: Neural image caption generation with visual attention. In Proceedings of the 32nd International Conference on Machine Learning. 2048--2057."},{"key":"e_1_2_1_289_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299023"},{"key":"e_1_2_1_290_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.331"},{"key":"e_1_2_1_291_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1066"},{"key":"e_1_2_1_292_1","volume-title":"Neural self talk: Image understanding via continuous questioning and answering. arXiv preprint arXiv:1512.03460","author":"Yang Yezhou","year":"2015","unstructured":"Yezhou Yang , Yi Li , Cornelia Fermuller , and Yiannis Aloimonos . 2015a. Neural self talk: Image understanding via continuous questioning and answering. arXiv preprint arXiv:1512.03460 ( 2015 ). Yezhou Yang, Yi Li, Cornelia Fermuller, and Yiannis Aloimonos. 2015a. Neural self talk: Image understanding via continuous questioning and answering. arXiv preprint arXiv:1512.03460 (2015)."},{"key":"e_1_2_1_293_1","volume-title":"Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI-15)","author":"Yang Yezhou","year":"2015","unstructured":"Yezhou Yang , Yi Li , Cornelia Fermuller , and Yiannis Aloimonos . 2015 b. Robot learning manipulation action plans by \u201cwatching\u201d unconstrained videos from the world wide web . In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI-15) . Yezhou Yang, Yi Li, Cornelia Fermuller, and Yiannis Aloimonos. 2015b. Robot learning manipulation action plans by \u201cwatching\u201d unconstrained videos from the world wide web. In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI-15)."},{"key":"e_1_2_1_294_1","doi-asserted-by":"publisher","DOI":"10.5555\/2145432.2145484"},{"key":"e_1_2_1_295_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631179"},{"key":"e_1_2_1_296_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126386"},{"key":"e_1_2_1_297_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.512"},{"key":"e_1_2_1_298_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.597"},{"key":"e_1_2_1_299_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.293"},{"key":"e_1_2_1_300_1","volume-title":"Smith","author":"Yogatama Dani","year":"2014","unstructured":"Dani Yogatama , Manaal Faruqui , Chris Dyer , and Noah A . Smith . 2014 . Learning word representations with hierarchical sparse coding. arXiv preprint arXiv:1406.2035 (2014). Dani Yogatama, Manaal Faruqui, Chris Dyer, and Noah A. Smith. 2014. Learning word representations with hierarchical sparse coding. arXiv preprint arXiv:1406.2035 (2014)."},{"key":"e_1_2_1_301_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2015.1095653"},{"key":"e_1_2_1_302_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00166"},{"key":"e_1_2_1_303_1","doi-asserted-by":"crossref","unstructured":"Haonan Yu N. Siddharth Andrei Barbu and Jeffrey Mark Siskind. 2015b. A compositional framework for grounding language inference generation and acquisition in video. J. Artif. Intell. Res. (2015) 601--713. Haonan Yu N. Siddharth Andrei Barbu and Jeffrey Mark Siskind. 2015b. A compositional framework for grounding language inference generation and acquisition in video. J. Artif. Intell. Res. (2015) 601--713.","DOI":"10.1613\/jair.4556"},{"key":"e_1_2_1_304_1","unstructured":"Haonan Yu and Jeffrey Mark Siskind. 2013. Grounded language learning from video described with sentences. In ACL (1). 53--63. Haonan Yu and Jeffrey Mark Siskind. 2013. Grounded language learning from video described with sentences. In ACL (1). 53--63."},{"key":"e_1_2_1_305_1","volume-title":"Video paragraph captioning using hierarchical recurrent neural networks. arXiv preprint arXiv:1510.07712","author":"Yu Haonan","year":"2015","unstructured":"Haonan Yu , Jiang Wang , Zhiheng Huang , Yi Yang , and Wei Xu. 2015c. Video paragraph captioning using hierarchical recurrent neural networks. arXiv preprint arXiv:1510.07712 ( 2015 ). Haonan Yu, Jiang Wang, Zhiheng Huang, Yi Yang, and Wei Xu. 2015c. Video paragraph captioning using hierarchical recurrent neural networks. arXiv preprint arXiv:1510.07712 (2015)."},{"key":"e_1_2_1_306_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.283"},{"key":"e_1_2_1_307_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126320"},{"key":"e_1_2_1_308_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139371"},{"key":"e_1_2_1_309_1","volume-title":"Proceedings of the National Conference on Artificial Intelligence. 1050--1055","author":"John","unstructured":"John M. Zelle and Raymond J. Mooney. 1996. Learning to parse database queries using inductive logic programming . In Proceedings of the National Conference on Artificial Intelligence. 1050--1055 . John M. Zelle and Raymond J. Mooney. 1996. Learning to parse database queries using inductive logic programming. In Proceedings of the National Conference on Artificial Intelligence. 1050--1055."},{"key":"e_1_2_1_310_1","volume-title":"Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI).","author":"Luke","unstructured":"Luke S. Zettlemoyer and Michael Collins. 2005. Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars . In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI). Luke S. Zettlemoyer and Michael Collins. 2005. Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI)."},{"key":"e_1_2_1_311_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.05.013"},{"key":"e_1_2_1_312_1","volume-title":"Grosky","author":"Zhao Rong","year":"2002","unstructured":"Rong Zhao and William I . Grosky . 2002 . Bridging the semantic gap in image retrieval. Distributed Multimedia Databases: Techniques and Applications ( 2002), 14--36. Rong Zhao and William I. Grosky. 2002. Bridging the semantic gap in image retrieval. Distributed Multimedia Databases: Techniques and Applications (2002), 14--36."},{"key":"e_1_2_1_313_1","doi-asserted-by":"publisher","DOI":"10.1145\/954339.954342"},{"key":"e_1_2_1_314_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.179"},{"key":"e_1_2_1_315_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.540"},{"key":"e_1_2_1_316_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.11"},{"key":"e_1_2_1_317_1","volume-title":"Building a large-scale multimodal knowledge base for visual question answering. arXiv preprint arXiv:1507.05670","author":"Zhu Yuke","year":"2015","unstructured":"Yuke Zhu , Ce Zhang , Christopher R\u00e9 , and Li Fei-Fei . 2015b. Building a large-scale multimodal knowledge base for visual question answering. arXiv preprint arXiv:1507.05670 ( 2015 ). Yuke Zhu, Ce Zhang, Christopher R\u00e9, and Li Fei-Fei. 2015b. Building a large-scale multimodal knowledge base for visual question answering. arXiv preprint arXiv:1507.05670 (2015)."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009906","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3009906","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:34Z","timestamp":1750273534000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009906"}},"subtitle":["Recent Approaches in Multimedia and Robotics"],"short-title":[],"issued":{"date-parts":[[2016,12,12]]},"references-count":316,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3009906"],"URL":"https:\/\/doi.org\/10.1145\/3009906","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,12]]},"assertion":[{"value":"2016-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-12-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}