{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:20:07Z","timestamp":1750220407876,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["SFB 169"],"award-info":[{"award-number":["SFB 169"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3481002","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"673-681","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Gaze-based Multimodal Meaning Recovery for Noisy\u00a0\/\u00a0Complex Environments"],"prefix":"10.1145","author":[{"given":"\u00d6zge","family":"Ala\u00e7am","sequence":"first","affiliation":[{"name":"Language Technology, Universit\u00e4t Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ganeshan","family":"Malhotra","sequence":"additional","affiliation":[{"name":"BITS Pilani Goa, India and Language Technology, Universit\u00e4t Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugen","family":"Ruppert","sequence":"additional","affiliation":[{"name":"Base.camp, Universit\u00e4t Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Biemann","sequence":"additional","affiliation":[{"name":"Language Technology, Universit\u00e4t Hamburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Crossmodal Language Comprehension\u00a0\u2013 Psycholinguistic Insights and Computational Approaches. Frontiers in Neurorobotics 14:2","author":"Ala\u00e7am \u00d6zge","year":"2020","unstructured":"\u00d6zge Ala\u00e7am , Xingshan Li , Wolfgang Menzel , and Tobias Staron . 2020. Crossmodal Language Comprehension\u00a0\u2013 Psycholinguistic Insights and Computational Approaches. Frontiers in Neurorobotics 14:2 ( 2020 ). \u00d6zge Ala\u00e7am, Xingshan Li, Wolfgang Menzel, and Tobias Staron. 2020. Crossmodal Language Comprehension\u00a0\u2013 Psycholinguistic Insights and Computational Approaches. Frontiers in Neurorobotics 14:2 (2020)."},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the12th International Conference on Language Resources and Evaluation (LREC)","author":"Ala\u00e7am \u00d6zge","year":"2020","unstructured":"\u00d6zge Ala\u00e7am , Eugen Ruppert , Amr\u00a0 R. Salama , Tobias Staron , and Wolfgang Menzel . 2020 . Eye4Ref: A Multimodal Eye Movement Dataset of Referentially Complex Situations . In Proceedings of the12th International Conference on Language Resources and Evaluation (LREC) . Marseille, France, 2396\u20132404. \u00d6zge Ala\u00e7am, Eugen Ruppert, Amr\u00a0R. Salama, Tobias Staron, and Wolfgang Menzel. 2020. Eye4Ref: A Multimodal Eye Movement Dataset of Referentially Complex Situations. In Proceedings of the12th International Conference on Language Resources and Evaluation (LREC). Marseille, France, 2396\u20132404."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073642"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11933-5_43"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/11564096_47"},{"volume-title":"O\u2019Reilly Media","author":"Bird Steven","key":"e_1_3_2_1_6_1","unstructured":"Steven Bird , Ewan Klein , and Edward Loper . 2009. Natural language processing with Python: analyzing text with the natural language toolkit . \u201d O\u2019Reilly Media , Inc .\u201d. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. \u201d O\u2019Reilly Media, Inc.\u201d."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20020543"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzm\u00e1n Edouard Grave Myle Ott Luke Zettlemoyer and Veselin Stoyanov. 2019. Unsupervised Cross-lingual Representation Learning at Scale. arXiv preprint arXiv:1301.3781(2019).  Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzm\u00e1n Edouard Grave Myle Ott Luke Zettlemoyer and Veselin Stoyanov. 2019. Unsupervised Cross-lingual Representation Learning at Scale. arXiv preprint arXiv:1301.3781(2019).","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2019). Minneapolis, Minnesota, USA, 4171\u20134186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2019). Minneapolis, Minnesota, USA, 4171\u20134186."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30111-0_35"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1216438110"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/13506280802685552"},{"key":"e_1_3_2_1_13_1","volume-title":"Long short-term memory. Neural computation 9, 8","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation 9, 8 ( 1997 ), 1735\u20131780. Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735\u20131780."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CogInfoCom.2013.6719243"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3229434.3229452"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-6408"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2133"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2392800.2392806"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613749"},{"key":"e_1_3_2_1_20_1","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692(2019).  Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692(2019)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1068\/p5896"},{"key":"e_1_3_2_1_22_1","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781(2013).  Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781(2013)."},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems -","volume":"2","author":"Mikolov Tomas","unstructured":"Tomas Mikolov , Ilya Sutskever , Kai Chen , G. Corrado , and J. Dean . 2013. Distributed Representations of Words and Phrases and their Compositionality . In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2 . Lake Tahoe, Nevada, 3111\u20133119. Tomas Mikolov, Ilya Sutskever, Kai Chen, G. Corrado, and J. Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2. Lake Tahoe, Nevada, 3111\u20133119."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1035"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 40th Annual Meeting of the Cognitive Science Society","author":"Mitev Nikolina","year":"2018","unstructured":"Nikolina Mitev , Patrick Renner , Thies Pfeiffer , and Maria Staudte . 2018 . Using Listener Gaze to Refer in Installments Benefits Understanding . In Proceedings of the 40th Annual Meeting of the Cognitive Science Society . Madison,Wisconsin, USA, 2122\u20132127. Nikolina Mitev, Patrick Renner, Thies Pfeiffer, and Maria Staudte. 2018. Using Listener Gaze to Refer in Installments Benefits Understanding. In Proceedings of the 40th Annual Meeting of the Cognitive Science Society. Madison,Wisconsin, USA, 2122\u20132127."},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 13th international conference on Intelligent user interfaces","author":"Prasov Zahar","year":"2008","unstructured":"Zahar Prasov and Joyce\u00a0 Y Chai . 2008 . What\u2019s in a gaze? The role of eye-gaze in reference resolution in multimodal conversational interfaces . In Proceedings of the 13th international conference on Intelligent user interfaces . Gran Canaria, Spain, 20\u201329. Zahar Prasov and Joyce\u00a0Y Chai. 2008. What\u2019s in a gaze? The role of eye-gaze in reference resolution in multimodal conversational interfaces. In Proceedings of the 13th international conference on Intelligent user interfaces. Gran Canaria, Spain, 20\u201329."},{"key":"e_1_3_2_1_27_1","unstructured":"Wasifur Rahman Md\u00a0Kamrul Hasan Amir Zadeh Louis-Philippe Morency and Mohammed\u00a0Ehsan Hoque. 2019. M-BERT: Injecting Multimodal Information in the BERT Structure. arXiv preprint arXiv:1908.05787(2019).  Wasifur Rahman Md\u00a0Kamrul Hasan Amir Zadeh Louis-Philippe Morency and Mohammed\u00a0Ehsan Hoque. 2019. M-BERT: Injecting Multimodal Information in the BERT Structure. arXiv preprint arXiv:1908.05787(2019)."},{"key":"e_1_3_2_1_28_1","volume-title":"Seven Reasons Why Eye-tracking Will Fundamentally Change VR. Forbes","author":"Rogers Sol","year":"2019","unstructured":"Sol Rogers . 2019. Seven Reasons Why Eye-tracking Will Fundamentally Change VR. Forbes ( 2019 ). https:\/\/www.forbes.com\/sites\/solrogers\/2019\/02\/05\/seven-reasons-why-eye-tracking-will-fundamentally-change-vr\/ Sol Rogers. 2019. Seven Reasons Why Eye-tracking Will Fundamentally Change VR. Forbes (2019). https:\/\/www.forbes.com\/sites\/solrogers\/2019\/02\/05\/seven-reasons-why-eye-tracking-will-fundamentally-change-vr\/"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-3005"},{"key":"e_1_3_2_1_30_1","volume-title":"Grounded language interpretation of robotic commands through structured learning. Artificial Intelligence 278","author":"Vanzo Andrea","year":"2020","unstructured":"Andrea Vanzo , Danilo Croce , Emanuele Bastianelli , Roberto Basili , and Daniele Nardi . 2020. Grounded language interpretation of robotic commands through structured learning. Artificial Intelligence 278 ( 2020 ). Andrea Vanzo, Danilo Croce, Emanuele Bastianelli, Roberto Basili, and Daniele Nardi. 2020. Grounded language interpretation of robotic commands through structured learning. Artificial Intelligence 278 (2020)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2018.0036"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/751"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2012.2216979"}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481002","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3481002","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:19:01Z","timestamp":1750191541000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481002"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":34,"alternative-id":["10.1145\/3462244.3481002","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3481002","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}