{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:59:52Z","timestamp":1776106792517,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. Army Research Office","award":["W911NF-20-2-0053"],"award-info":[{"award-number":["W911NF-20-2-0053"]}]},{"name":"Swedish Foundation for Strategic Research","award":["GMT14-0082"],"award-info":[{"award-number":["GMT14-0082"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3479887","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"112-120","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["A Systematic Cross-Corpus Analysis of Human Reactions to Robot Conversational Failures"],"prefix":"10.1145","author":[{"given":"Dimosthenis","family":"Kontogiorgos","sequence":"first","affiliation":[{"name":"KTH Royal Institute of Technology, Sweden"}]},{"given":"Minh","family":"Tran","sequence":"additional","affiliation":[{"name":"Computer Science, University of Southern California, USA"}]},{"given":"Joakim","family":"Gustafson","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology, Sweden"}]},{"given":"Mohammad","family":"Soleymani","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70022-9_29"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383652.3423901"},{"key":"e_1_3_2_2_3_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Artstein Ron","year":"2018","unstructured":"Ron Artstein , Jill Boberg , Alesia Gainer , Jonathan Gratch , Emmanuel Johnson , Anton Leuski , Gale Lucas , and David Traum . 2018 . The Niki and Julie Corpus: collaborative multimodal dialogues between humans, robots, and virtual agents . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Ron Artstein, Jill Boberg, Alesia Gainer, Jonathan Gratch, Emmanuel Johnson, Anton Leuski, Gale Lucas, and David Traum. 2018. The Niki and Julie Corpus: collaborative multimodal dialogues between humans, robots, and virtual agents. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v067.i01"},{"key":"e_1_3_2_2_6_1","volume-title":"A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD explorations newsletter 6, 1","author":"Batista EAPA","year":"2004","unstructured":"Gustavo\u00a0 EAPA Batista , Ronaldo\u00a0 C Prati , and Maria\u00a0Carolina Monard . 2004. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD explorations newsletter 6, 1 ( 2004 ), 20\u201329. Gustavo\u00a0EAPA Batista, Ronaldo\u00a0C Prati, and Maria\u00a0Carolina Monard. 2004. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD explorations newsletter 6, 1 (2004), 20\u201329."},{"key":"e_1_3_2_2_8_1","volume-title":"Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue. 128\u2013143","author":"Bohus Dan","year":"2005","unstructured":"Dan Bohus and Alexander Rudnicky . 2005 . Sorry and I Didn\u2019t Catch That!-An Investigation of Non-understanding Errors and Recovery Strategies . In Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue. 128\u2013143 . Dan Bohus and Alexander Rudnicky. 2005. Sorry and I Didn\u2019t Catch That!-An Investigation of Non-understanding Errors and Recovery Strategies. In Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue. 128\u2013143."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/03637758809376158"},{"key":"e_1_3_2_2_10_1","volume-title":"Static and Temporal Differences in Social Signals Between Error-Free and Erroneous Situations in Human-Robot Collaboration. In International Conference on Social Robotics. Springer, 189\u2013199","author":"Cahya Dito\u00a0Eka","year":"2019","unstructured":"Dito\u00a0Eka Cahya , Rahul Ramakrishnan , and Manuel Giuliani . 2019 . Static and Temporal Differences in Social Signals Between Error-Free and Erroneous Situations in Human-Robot Collaboration. In International Conference on Social Robotics. Springer, 189\u2013199 . Dito\u00a0Eka Cahya, Rahul Ramakrishnan, and Manuel Giuliani. 2019. Static and Temporal Differences in Social Signals Between Error-Free and Erroneous Situations in Human-Robot Collaboration. In International Conference on Social Robotics. Springer, 189\u2013199."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_2_12_1","unstructured":"Herbert\u00a0H Clark and Susan\u00a0E Brennan. 1991. Grounding in communication.(1991).  Herbert\u00a0H Clark and Susan\u00a0E Brennan. 1991. Grounding in communication.(1991)."},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). 4171\u20134186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171\u20134186."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874246"},{"key":"e_1_3_2_2_15_1","volume-title":"Attitudes: Foundations, functions, and consequences. The handbook of social psychology(2007), 123\u2013145.","author":"Fazio H","year":"2007","unstructured":"Russell\u00a0 H Fazio and Michael\u00a0 A Olson . 2007 . Attitudes: Foundations, functions, and consequences. The handbook of social psychology(2007), 123\u2013145. Russell\u00a0H Fazio and Michael\u00a0A Olson. 2007. Attitudes: Foundations, functions, and consequences. The handbook of social psychology(2007), 123\u2013145."},{"key":"e_1_3_2_2_16_1","volume-title":"On the impact of different types of errors on trust in human-robot interaction: Are laboratory-based HRI experiments trustworthy?Interaction Studies 20, 3","author":"Flook Rebecca","year":"2019","unstructured":"Rebecca Flook , Anas Shrinah , Luc Wijnen , Kerstin Eder , Chris Melhuish , and S\u00e9verin Lemaignan . 2019. On the impact of different types of errors on trust in human-robot interaction: Are laboratory-based HRI experiments trustworthy?Interaction Studies 20, 3 ( 2019 ), 455\u2013486. Rebecca Flook, Anas Shrinah, Luc Wijnen, Kerstin Eder, Chris Melhuish, and S\u00e9verin Lemaignan. 2019. On the impact of different types of errors on trust in human-robot interaction: Are laboratory-based HRI experiments trustworthy?Interaction Studies 20, 3 (2019), 455\u2013486."},{"key":"e_1_3_2_2_17_1","unstructured":"Raphaela Gehle Karola Pitsch Timo Dankert and Sebastian Wrede. 2015. Effects of a robot\u2019s unexpected reactions in robot-to-group interactions. (2015).  Raphaela Gehle Karola Pitsch Timo Dankert and Sebastian Wrede. 2015. Effects of a robot\u2019s unexpected reactions in robot-to-group interactions. (2015)."},{"key":"e_1_3_2_2_18_1","volume-title":"Systematic analysis of video data from different human\u2013robot interaction studies: a categorization of social signals during error situations. Frontiers in psychology 6","author":"Giuliani Manuel","year":"2015","unstructured":"Manuel Giuliani , Nicole Mirnig , Gerald Stollnberger , Susanne Stadler , Roland Buchner , and Manfred Tscheligi . 2015. Systematic analysis of video data from different human\u2013robot interaction studies: a categorization of social signals during error situations. Frontiers in psychology 6 ( 2015 ), 931. Manuel Giuliani, Nicole Mirnig, Gerald Stollnberger, Susanne Stadler, Roland Buchner, and Manfred Tscheligi. 2015. Systematic analysis of video data from different human\u2013robot interaction studies: a categorization of social signals during error situations. Frontiers in psychology 6 (2015), 931."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324900002485"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2016.7745138"},{"key":"e_1_3_2_2_21_1","volume-title":"Prosodic and other cues to speech recognition failures. Speech communication 43, 1-2","author":"Hirschberg Julia","year":"2004","unstructured":"Julia Hirschberg , Diane Litman , and Marc Swerts . 2004. Prosodic and other cues to speech recognition failures. Speech communication 43, 1-2 ( 2004 ), 155\u2013175. Julia Hirschberg, Diane Litman, and Marc Swerts. 2004. Prosodic and other cues to speech recognition failures. Speech communication 43, 1-2 (2004), 155\u2013175."},{"key":"e_1_3_2_2_22_1","volume-title":"Understanding and resolving failures in human-robot interaction: Literature review and model development. Frontiers in psychology 9","author":"Honig Shanee","year":"2018","unstructured":"Shanee Honig and Tal Oron-Gilad . 2018. Understanding and resolving failures in human-robot interaction: Literature review and model development. Frontiers in psychology 9 ( 2018 ), 861. Shanee Honig and Tal Oron-Gilad. 2018. Understanding and resolving failures in human-robot interaction: Literature review and model development. Frontiers in psychology 9 (2018), 861."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Jeesun Kim and Chris Davis. 2016. The Consistency and Stability of Acoustic and Visual Cues for Different Prosodic Attitudes.. In INTERSPEECH. 57\u201361.  Jeesun Kim and Chris Davis. 2016. The Consistency and Stability of Acoustic and Visual Cues for Different Prosodic Attitudes.. In INTERSPEECH. 57\u201361.","DOI":"10.21437\/Interspeech.2016-1505"},{"key":"e_1_3_2_2_24_1","unstructured":"Dimosthenis Kontogiorgos Andre Pereira and Joakim Gustafson. 2021. Grounding behaviours with conversational interfaces: effects of embodiment and failures. Journal on Multimodal User Interfaces(2021) 1\u201316.  Dimosthenis Kontogiorgos Andre Pereira and Joakim Gustafson. 2021. Grounding behaviours with conversational interfaces: effects of embodiment and failures. Journal on Multimodal User Interfaces(2021) 1\u201316."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319502.3374782"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376372"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.3115\/1034678.1034729"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4647"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/191666.191703"},{"key":"e_1_3_2_2_31_1","first-page":"2001","article-title":"Linguistic inquiry and word count: LIWC 2001. Mahway","volume":"71","author":"Pennebaker W","year":"2001","unstructured":"James\u00a0 W Pennebaker , Martha\u00a0 E Francis , and Roger\u00a0 J Booth . 2001 . Linguistic inquiry and word count: LIWC 2001. Mahway : Lawrence Erlbaum Associates 71 , 2001 (2001), 2001 . James\u00a0W Pennebaker, Martha\u00a0E Francis, and Roger\u00a0J Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates 71, 2001 (2001), 2001.","journal-title":"Lawrence Erlbaum Associates"},{"key":"e_1_3_2_2_32_1","volume-title":"R: A Language and Environment for Statistical Computing.","author":"Team R Core","year":"2020","unstructured":"R Core Team . 2020 . R: A Language and Environment for Statistical Computing. (2020). https:\/\/www.R-project.org\/ R Core Team. 2020. R: A Language and Environment for Statistical Computing. (2020). https:\/\/www.R-project.org\/"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Albert Rilliard Donna Erickson Takaaki Shochi and Jo\u00e3o\u00a0Ant\u00f4nio de Moraes. 2013. Social face to face communication-American English attitudinal prosody.. In INTERSPEECH. 1648\u20131652.  Albert Rilliard Donna Erickson Takaaki Shochi and Jo\u00e3o\u00a0Ant\u00f4nio de Moraes. 2013. Social face to face communication-American English attitudinal prosody.. In INTERSPEECH. 1648\u20131652.","DOI":"10.21437\/Interspeech.2013-427"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1515\/semi.1973.8.4.289"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"crossref","unstructured":"Chao Shi Masahiro Shiomi Christian Smith Takayuki Kanda and Hiroshi Ishiguro. 2013. A Model of Distributional Handing Interaction for a Mobile Robot.. In Robotics: science and systems. 24\u201328.  Chao Shi Masahiro Shiomi Christian Smith Takayuki Kanda and Hiroshi Ishiguro. 2013. A Model of Distributional Handing Interaction for a Mobile Robot.. In Robotics: science and systems. 24\u201328.","DOI":"10.15607\/RSS.2013.IX.055"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171271"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2004.11.005"},{"key":"e_1_3_2_2_39_1","unstructured":"Gabriel Skantze and Jens Edlund. 2004. Early error detection on word level. In COST278 and ISCA Tutorial and Research Workshop (ITRW) on Robustness Issues in Conversational Interaction.  Gabriel Skantze and Jens Edlund. 2004. Early error detection on word level. In COST278 and ISCA Tutorial and Research Workshop (ITRW) on Robustness Issues in Conversational Interaction."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/645297.757423"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136785"},{"key":"e_1_3_2_2_42_1","volume-title":"Proceedings of the 17th international conference on machine learning. 1111\u20131118","author":"Walker Marilyn","year":"2000","unstructured":"Marilyn Walker , Jerry Wright , and Irene Langkilde . 2000 . Using natural language processing and discourse features to identify understanding errors in a spoken dialogue system . In Proceedings of the 17th international conference on machine learning. 1111\u20131118 . Marilyn Walker, Jerry Wright, and Irene Langkilde. 2000. Using natural language processing and discourse features to identify understanding errors in a spoken dialogue system. In Proceedings of the 17th international conference on machine learning. 1111\u20131118."}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Montr\u00e9al QC Canada","acronym":"ICMI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479887","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479887","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3479887","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:54Z","timestamp":1750193334000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3479887"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":40,"alternative-id":["10.1145\/3462244.3479887","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3479887","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}