{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:21:21Z","timestamp":1750220481141,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":49,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["FA9550-18-1- 0465"],"award-info":[{"award-number":["FA9550-18-1- 0465"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005713","name":"Office of the Secretary of Defense","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005713","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3479925","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"150-158","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Decision-Theoretic Question Generation for Situated Reference Resolution: An Empirical Study and Computational Model"],"prefix":"10.1145","author":[{"given":"Felix","family":"Gervits","sequence":"first","affiliation":[{"name":"U.S. Army Research Laboratory, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gordon","family":"Briggs","sequence":"additional","affiliation":[{"name":"U.S. Naval Research Laboratory, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Roque","sequence":"additional","affiliation":[{"name":"Human-Robot Interaction Laboratory, Tufts University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Genki A.","family":"Kadomatsu","sequence":"additional","affiliation":[{"name":"Tufts University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dean","family":"Thurston","sequence":"additional","affiliation":[{"name":"Tufts University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Scheutz","sequence":"additional","affiliation":[{"name":"Human-Robot Interaction Laboratory, Tufts University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Marge","sequence":"additional","affiliation":[{"name":"Computational and Information Sciences Directorate, U.S. Army Research Laboratory, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451735"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594279"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157693"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/2621996"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.21437\/Eurospeech.1999-341"},{"volume-title":"Using language","author":"Clark H","key":"e_1_3_2_1_6_1","unstructured":"Herbert\u00a0 H Clark . 1996. Using language . Cambridge university press . Herbert\u00a0H Clark. 1996. Using language. Cambridge university press."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0277(86)90010-7"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3115\/1067807.1067818"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.2.2.Deits"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3115\/1225753.1225754"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1228716.1228727"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/2392800.2392843"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the The 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue.","author":"Gervits Felix","year":"2021","unstructured":"Felix Gervits , Antonio Roque , Gordon Briggs , Matthias Scheutz , and Matthew Marge . 2021 . How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus . In Proceedings of the The 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue. Felix Gervits, Antonio Roque, Gordon Briggs, Matthias Scheutz, and Matthew Marge. 2021. How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus. In Proceedings of the The 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1088463.1088489"},{"key":"e_1_3_2_1_15_1","volume-title":"AutoTutor: A Cognitive System That Simulates a Tutor Through Mixed-Initiative Dialogue. Cognitive systems: Human cognitive models in systems design 177","author":"Graesser C","year":"2005","unstructured":"Arthur\u00a0 C Graesser , Andrew Olney , Brian\u00a0 C Haynes , and Patrick Chipman . 2005. AutoTutor: A Cognitive System That Simulates a Tutor Through Mixed-Initiative Dialogue. Cognitive systems: Human cognitive models in systems design 177 ( 2005 ). Arthur\u00a0C Graesser, Andrew Olney, Brian\u00a0C Haynes, and Patrick Chipman. 2005. AutoTutor: A Cognitive System That Simulates a Tutor Through Mixed-Initiative Dialogue. Cognitive systems: Human cognitive models in systems design 177 (2005)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136795"},{"key":"e_1_3_2_1_17_1","volume-title":"AAAI Fall Symposium.","author":"Hemachandra Sachithra","year":"2014","unstructured":"Sachithra Hemachandra , Matthew\u00a0 R Walter , and Seth\u00a0 J Teller . 2014 . Information Theoretic Question Asking to Improve Spatial Semantic Representations .. In AAAI Fall Symposium. Sachithra Hemachandra, Matthew\u00a0R Walter, and Seth\u00a0J Teller. 2014. Information Theoretic Question Asking to Improve Spatial Semantic Representations.. In AAAI Fall Symposium."},{"key":"e_1_3_2_1_18_1","volume-title":"Repairing conversational misunderstandings and non-understandings. Speech communication 15, 3-4","author":"Hirst Graeme","year":"1994","unstructured":"Graeme Hirst , Susan McRoy , Peter Heeman , Philip Edmonds , and Diane Horton . 1994. Repairing conversational misunderstandings and non-understandings. Speech communication 15, 3-4 ( 1994 ), 213\u2013229. Graeme Hirst, Susan McRoy, Peter Heeman, Philip Edmonds, and Diane Horton. 1994. Repairing conversational misunderstandings and non-understandings. Speech communication 15, 3-4 (1994), 213\u2013229."},{"volume-title":"UM99 User Modeling","author":"Horvitz Eric","key":"e_1_3_2_1_19_1","unstructured":"Eric Horvitz and Tim Paek . 1999. A computational architecture for conversation . In UM99 User Modeling . Springer , 201\u2013210. Eric Horvitz and Tim Paek. 1999. A computational architecture for conversation. In UM99 User Modeling. Springer, 201\u2013210."},{"key":"e_1_3_2_1_20_1","volume-title":"Joint Generation and Bi-Encoder for Situated Interactive MultiModal Conversations. In AAAI 2021 DSTC9 Workshop.","author":"Huang Xin","year":"2021","unstructured":"Xin Huang , Chor\u00a0Seng Tan , Yan\u00a0Bin Ng , Wei Shi , Kheng\u00a0Hui Yeo , Ridong Jiang , and Jung-jae Kim. 2021 . Joint Generation and Bi-Encoder for Situated Interactive MultiModal Conversations. In AAAI 2021 DSTC9 Workshop. Xin Huang, Chor\u00a0Seng Tan, Yan\u00a0Bin Ng, Wei Shi, Kheng\u00a0Hui Yeo, Ridong Jiang, and Jung-jae Kim. 2021. Joint Generation and Bi-Encoder for Situated Interactive MultiModal Conversations. In AAAI 2021 DSTC9 Workshop."},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the 7th Workshop on Formal Semantics and Pragmatics of Dialogue (Diabrck. Citeseer.","author":"Hulstijn Joris","year":"2003","unstructured":"Joris Hulstijn . 2003 . Roles in dialogue . In Proceedings of the 7th Workshop on Formal Semantics and Pragmatics of Dialogue (Diabrck. Citeseer. Joris Hulstijn. 2003. Roles in dialogue. In Proceedings of the 7th Workshop on Formal Semantics and Pragmatics of Dialogue (Diabrck. Citeseer."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5949"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2016.04.002"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5925"},{"volume-title":"Dialogues With Social Robots","author":"Komatani Kazunori","key":"e_1_3_2_1_25_1","unstructured":"Kazunori Komatani , Tsugumi Otsuka , Satoshi Sato , and Mikio Nakano . 2017. Question selection based on expected utility to acquire information through dialogue . In Dialogues With Social Robots . Springer , 79\u201391. Kazunori Komatani, Tsugumi Otsuka, Satoshi Sato, and Mikio Nakano. 2017. Question selection based on expected utility to acquire information through dialogue. In Dialogues With Social Robots. Springer, 79\u201391."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5772\/5701"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Pierre Lison. 2013. Model-based bayesian reinforcement learning for dialogue management. arXiv preprint arXiv:1304.1819(2013).  Pierre Lison. 2013. Model-based bayesian reinforcement learning for dialogue management. arXiv preprint arXiv:1304.1819(2013).","DOI":"10.21437\/Interspeech.2013-138"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the SIGDIAL 2013 Conference. 78\u201386","author":"Liu Changsong","year":"2013","unstructured":"Changsong Liu , Rui Fang , Lanbo She , and Joyce Chai . 2013 . Modeling collaborative referring for situated referential grounding . In Proceedings of the SIGDIAL 2013 Conference. 78\u201386 . Changsong Liu, Rui Fang, Lanbo She, and Joyce Chai. 2013. Modeling collaborative referring for situated referential grounding. In Proceedings of the SIGDIAL 2013 Conference. 78\u201386."},{"key":"e_1_3_2_1_29_1","volume-title":"Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue (SemDial).","author":"Marge Matthew","year":"2020","unstructured":"Matthew Marge , Felix Gervits , Gordon Briggs , Matthias Scheutz , and Antonio Roque . 2020 . Let\u2019s do that first! A Comparative Analysis of Instruction-Giving in Human-Human and Human-Robot Situated Dialogue . In Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue (SemDial). Matthew Marge, Felix Gervits, Gordon Briggs, Matthias Scheutz, and Antonio Roque. 2020. Let\u2019s do that first! A Comparative Analysis of Instruction-Giving in Human-Human and Human-Robot Situated Dialogue. In Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue (SemDial)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2014.09.031"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2820748"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the SIGDIAL 2010 Conference. 221\u2013224","author":"Misu Teruhisa","year":"2010","unstructured":"Teruhisa Misu , Komei Sugiura , Kiyonori Ohtake , Chiori Hori , Hideki Kashioka , Hisashi Kawai , and Satoshi Nakamura . 2010 . Modeling spoken decision making dialogue and optimization of its dialogue strategy . In Proceedings of the SIGDIAL 2010 Conference. 221\u2013224 . Teruhisa Misu, Komei Sugiura, Kiyonori Ohtake, Chiori Hori, Hideki Kashioka, Hisashi Kawai, and Satoshi Nakamura. 2010. Modeling spoken decision making dialogue and optimization of its dialogue strategy. In Proceedings of the SIGDIAL 2010 Conference. 221\u2013224."},{"key":"e_1_3_2_1_33_1","unstructured":"Seungwhan Moon Satwik Kottur Paul\u00a0A Crook Ankita De Shivani Poddar Theodore Levin David Whitney Daniel Difranco Ahmad Beirami Eunjoon Cho 2020. Situated and interactive multimodal conversations. arXiv preprint arXiv:2006.01460(2020).  Seungwhan Moon Satwik Kottur Paul\u00a0A Crook Ankita De Shivani Poddar Theodore Levin David Whitney Daniel Difranco Ahmad Beirami Eunjoon Cho 2020. Situated and interactive multimodal conversations. arXiv preprint arXiv:2006.01460(2020)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3029798.3038373"},{"key":"e_1_3_2_1_35_1","volume-title":"The use of influence diagrams in structuring complex decision problems. Readings on the principles and applications of decision analysis 2","author":"Owen L","year":"1978","unstructured":"Daniel\u00a0 L Owen . 1978. The use of influence diagrams in structuring complex decision problems. Readings on the principles and applications of decision analysis 2 ( 1978 ), 763\u2013771. Daniel\u00a0L Owen. 1978. The use of influence diagrams in structuring complex decision problems. Readings on the principles and applications of decision analysis 2 (1978), 763\u2013771."},{"key":"e_1_3_2_1_36_1","volume-title":"ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems.","author":"Paek Tim","year":"2003","unstructured":"Tim Paek . 2003 . Toward a taxonomy of communication errors . In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems. Tim Paek. 2003. Toward a taxonomy of communication errors. In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/2073946.2073999"},{"volume-title":"Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 3041\u20133046","author":"Prodanov P.","key":"e_1_3_2_1_38_1","unstructured":"P. Prodanov and A. Drygajlo . 2005. Decision Networks for Repair Strategies in Speech-Based Interaction with Mobile Tour-Guide Robots . In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 3041\u20133046 . P. Prodanov and A. Drygajlo. 2005. Decision Networks for Repair Strategies in Speech-Based Interaction with Mobile Tour-Guide Robots. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 3041\u20133046."},{"key":"e_1_3_2_1_39_1","unstructured":"David Schlangen Sina Zarrie\u00df and Casey Kennington. 2015. Resolving references to objects in photographs using the words-as-classifiers model. arXiv preprint arXiv:1510.02125(2015).  David Schlangen Sina Zarrie\u00df and Casey Kennington. 2015. Resolving references to objects in photographs using the words-as-classifiers model. arXiv preprint arXiv:1510.02125(2015)."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2004.11.005"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.11485"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33197-8_29"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/981823.981833"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2006.06.008"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451767"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Tom Williams Gordon Briggs Bradley Oosterveld and Matthias Scheutz. 2015. Going Beyond Literal Command-Based Instructions: Extending Robotic Natural Language Interaction Capabilities.. In AAAI. 1387\u20131393.  Tom Williams Gordon Briggs Bradley Oosterveld and Matthias Scheutz. 2015. Going Beyond Literal Command-Based Instructions: Extending Robotic Natural Language Interaction Capabilities.. In AAAI. 1387\u20131393.","DOI":"10.1609\/aaai.v29i1.9377"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-018-9795-5"},{"key":"e_1_3_2_1_48_1","volume-title":"How visual salience wins the battle for awareness. Nature neuroscience 8, 8","author":"Yantis Steven","year":"2005","unstructured":"Steven Yantis . 2005. How visual salience wins the battle for awareness. Nature neuroscience 8, 8 ( 2005 ), 975\u2013977. Steven Yantis. 2005. How visual salience wins the battle for awareness. Nature neuroscience 8, 8 (2005), 975\u2013977."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Hendrik Zender Geert-Jan\u00a0M Kruijff and Ivana Kruijff-Korbayov\u00e1. 2009. Situated Resolution and Generation of Spatial Referring Expressions for Robotic Assistants.. In IJCAI. 1604\u20131609.  Hendrik Zender Geert-Jan\u00a0M Kruijff and Ivana Kruijff-Korbayov\u00e1. 2009. Situated Resolution and Generation of Spatial Referring Expressions for Robotic Assistants.. In IJCAI. 1604\u20131609.","DOI":"10.3115\/1610195.1610217"}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479925","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479925","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479925","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:54Z","timestamp":1750193334000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479925"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":49,"alternative-id":["10.1145\/3462244.3479925","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3479925","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}