{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:56:44Z","timestamp":1773392204314,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Swedish Research Council","award":["Grant 2016-03698"],"award-info":[{"award-number":["Grant 2016-03698"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3418873","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:34Z","timestamp":1603361074000},"page":"625-629","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Detection of Listener Uncertainty in Robot-Led Second Language Conversation Practice"],"prefix":"10.1145","author":[{"given":"Ronald","family":"Cumbal","sequence":"first","affiliation":[{"name":"KTH - Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9","family":"Lopes","sequence":"additional","affiliation":[{"name":"Heriot Watt University, Edinburgh, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olov","family":"Engwall","sequence":"additional","affiliation":[{"name":"KTH - Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Cognitive Behavioural Systems : COST 2102 International Training School","author":"Moubayed Samer Al","year":"2011","unstructured":"Samer Al Moubayed , Jonas Beskow , Gabriel Skantze , and Bj\u00f6rn Granstr\u00f6m . 2012. Furhat : A Back-projected Human-like Robot Head for Multiparty HumanMachine Interaction . In Cognitive Behavioural Systems : COST 2102 International Training School , Dresden, Germany , February 21--26, 2011 , Revised Selected Papers (Lecture Notes in Computer Science). 114--130. https:\/\/doi.org\/10.1007\/978--3--64234584--5_9 QC 20121123. 10.1007\/978--3--64234584--5_9 Samer Al Moubayed, Jonas Beskow, Gabriel Skantze, and Bj\u00f6rn Granstr\u00f6m. 2012. Furhat : A Back-projected Human-like Robot Head for Multiparty HumanMachine Interaction. In Cognitive Behavioural Systems : COST 2102 International Training School, Dresden, Germany, February 21--26, 2011, Revised Selected Papers (Lecture Notes in Computer Science). 114--130. https:\/\/doi.org\/10.1007\/978--3--64234584--5_9 QC 20121123."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Nigel Bosch Yuxuan Chen and Sidney D'Mello. 2014. It's Written on Your Face: Detecting Affective States from Facial Expressions while Learning Computer Programming. In Intelligent Tutoring Systems Stefan Trausan-Matu Kristy Elizabeth Boyer Martha Crosby and Kitty Panourgia (Eds.). Springer International Publishing.  Nigel Bosch Yuxuan Chen and Sidney D'Mello. 2014. It's Written on Your Face: Detecting Affective States from Facial Expressions while Learning Computer Programming. In Intelligent Tutoring Systems Stefan Trausan-Matu Kristy Elizabeth Boyer Martha Crosby and Kitty Panourgia (Eds.). Springer International Publishing.","DOI":"10.1007\/978-3-319-07221-0_5"},{"key":"e_1_3_2_2_4_1","volume-title":"Uncertainty in Robot Assisted Second Language Conversation Practice. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction (HRI '20)","author":"Cumbal Ronald","year":"2020","unstructured":"Ronald Cumbal , Jos\u00e9 Lopes , and Olov Engwall . 2020 . Uncertainty in Robot Assisted Second Language Conversation Practice. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction (HRI '20) . Association for Computing Machinery, New York, NY, USA, 171--173. https:\/\/doi.org\/10.1145\/3371382.3378306 10.1145\/3371382.3378306 Ronald Cumbal, Jos\u00e9 Lopes, and Olov Engwall. 2020. Uncertainty in Robot Assisted Second Language Conversation Practice. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction (HRI '20). Association for Computing Machinery, New York, NY, USA, 171--173. https:\/\/doi.org\/10.1145\/3371382.3378306"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2012.05.003"},{"key":"#cr-split#-e_1_3_2_2_6_1.1","doi-asserted-by":"crossref","unstructured":"Jeroen Dral Dirk Heylen and Rieks Akker. 2011. Detecting Uncertainty in Spoken Dialogues: An Exploratory Research for the Automatic Detection of Speaker Uncertainty by Using Prosodic Markers. 67--77. https:\/\/doi.org\/10.1007\/978--94007--1757--2_6 10.1007\/978--94007--1757--2_6","DOI":"10.1007\/978-94-007-1757-2_6"},{"key":"#cr-split#-e_1_3_2_2_6_1.2","doi-asserted-by":"crossref","unstructured":"Jeroen Dral Dirk Heylen and Rieks Akker. 2011. Detecting Uncertainty in Spoken Dialogues: An Exploratory Research for the Automatic Detection of Speaker Uncertainty by Using Prosodic Markers. 67--77. https:\/\/doi.org\/10.1007\/978--94007--1757--2_6","DOI":"10.1007\/978-94-007-1757-2_6"},{"key":"e_1_3_2_2_7_1","volume-title":"Proceedings of the 2007 Conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work. IOS Press, NLD, 161--168","author":"D'mello Sidney","year":"2007","unstructured":"Sidney D'mello and Arthur Graesser . 2007 . Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments . In Proceedings of the 2007 Conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work. IOS Press, NLD, 161--168 . Sidney D'mello and Arthur Graesser. 2007. Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments. In Proceedings of the 2007 Conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work. IOS Press, NLD, 161--168."},{"key":"e_1_3_2_2_8_1","volume-title":"International Journal of Social Robotics 11 (03","author":"Engwall Olov","year":"2020","unstructured":"Olov Engwall , Jos\u00e9 Lopes , and Ann \u00c5hlund . 2020. Robot Interaction Styles for Conversation Practice in Second Language Learning . International Journal of Social Robotics 11 (03 2020 ). https:\/\/doi.org\/10.1007\/s12369-020-00635-y 10.1007\/s12369-020-00635-y Olov Engwall, Jos\u00e9 Lopes, and Ann \u00c5hlund. 2020. Robot Interaction Styles for Conversation Practice in Second Language Learning. International Journal of Social Robotics 11 (03 2020). https:\/\/doi.org\/10.1007\/s12369-020-00635-y"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0022263"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-6393(94)90073-6"},{"key":"e_1_3_2_2_11_1","volume-title":"Estimating Uncertainty in Task-Oriented Dialogue. In 2019 International Conference on Multimodal Interaction (ICMI '19)","author":"Kontogiorgos Dimosthenis","year":"2019","unstructured":"Dimosthenis Kontogiorgos , Andre Pereira , and Joakim Gustafson . 2019 . Estimating Uncertainty in Task-Oriented Dialogue. In 2019 International Conference on Multimodal Interaction (ICMI '19) . Association for Computing Machinery, New York, NY, USA, 414--418. https:\/\/doi.org\/10.1145\/3340555.3353722 10.1145\/3340555.3353722 Dimosthenis Kontogiorgos, Andre Pereira, and Joakim Gustafson. 2019. Estimating Uncertainty in Task-Oriented Dialogue. In 2019 International Conference on Multimodal Interaction (ICMI '19). Association for Computing Machinery, New York, NY, USA, 414--418. https:\/\/doi.org\/10.1145\/3340555.3353722"},{"key":"e_1_3_2_2_12_1","volume-title":"Ninth International Conference on Spoken Language Processing.","author":"Kumar Rohit","year":"2006","unstructured":"Rohit Kumar , Carolyn P Ros\u00e9 , and Diane J Litman . 2006 . Identification of confusion and surprise in spoken dialog using prosodic features . In Ninth International Conference on Spoken Language Processing. Rohit Kumar, Carolyn P Ros\u00e9, and Diane J Litman. 2006. Identification of confusion and surprise in spoken dialog using prosodic features. In Ninth International Conference on Spoken Language Processing."},{"key":"e_1_3_2_2_13_1","unstructured":"Zhongxiu Liu Visit Pataranutaporn Jaclyn Ocumpaugh and Ryan Shaun Joazeiro de Baker. 2013. Sequences of Frustration and Confusion and Learning. In EDM.  Zhongxiu Liu Visit Pataranutaporn Jaclyn Ocumpaugh and Ryan Shaun Joazeiro de Baker. 2013. Sequences of Frustration and Confusion and Learning. In EDM."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-4781.2011.01232_1.x"},{"key":"#cr-split#-e_1_3_2_2_15_1.1","doi-asserted-by":"crossref","unstructured":"Brian McFee Colin Raffel Dawen Liang Daniel Ellis Matt Mcvicar Eric Battenberg and Oriol Nieto. 2015. librosa: Audio and Music Signal Analysis in Python. 18--24. https:\/\/doi.org\/10.25080\/Majora-7b98e3ed-003 10.25080\/Majora-7b98e3ed-003","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"#cr-split#-e_1_3_2_2_15_1.2","doi-asserted-by":"crossref","unstructured":"Brian McFee Colin Raffel Dawen Liang Daniel Ellis Matt Mcvicar Eric Battenberg and Oriol Nieto. 2015. librosa: Audio and Music Signal Analysis in Python. 18--24. https:\/\/doi.org\/10.25080\/Majora-7b98e3ed-003","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"e_1_3_2_2_16_1","volume-title":"A review of the applicability of robots in education. Technology for Education and Learning 1 (06","author":"Mubin Omar","year":"2013","unstructured":"Omar Mubin , Catherine Stevens , Suleman Shahid , Abdullah Mahmud , and JianJie Dong . 2013. A review of the applicability of robots in education. Technology for Education and Learning 1 (06 2013 ). https:\/\/doi.org\/10.2316\/Journal.209.2013.1.209-0015 10.2316\/Journal.209.2013.1.209-0015 Omar Mubin, Catherine Stevens, Suleman Shahid, Abdullah Mahmud, and JianJie Dong. 2013. A review of the applicability of robots in education. Technology for Education and Learning 1 (06 2013). https:\/\/doi.org\/10.2316\/Journal.209.2013.1.209-0015"},{"key":"e_1_3_2_2_17_1","volume-title":"Eye tracking and early detection of confusion in digital learning environments: Proof of concept. Australasian Journal of Educational Technology 32 (12","author":"Pachman Mariya","year":"2016","unstructured":"Mariya Pachman , Amael Arguel , L. Lockyer , Gregor Kennedy , and Jason Lodge . 2016. Eye tracking and early detection of confusion in digital learning environments: Proof of concept. Australasian Journal of Educational Technology 32 (12 2016 ). https:\/\/doi.org\/10.14742\/ajet.3060 10.14742\/ajet.3060 Mariya Pachman, Amael Arguel, L. Lockyer, Gregor Kennedy, and Jason Lodge. 2016. Eye tracking and early detection of confusion in digital learning environments: Proof of concept. Australasian Journal of Educational Technology 32 (12 2016). https:\/\/doi.org\/10.14742\/ajet.3060"},{"key":"e_1_3_2_2_18_1","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Ga\u00ebl Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , Ron Weiss , Vincent Dubourg , 2011 . Scikit-learn: Machine learning in Python . Journal of machine learning research 12 , Oct (2011), 2825 -- 2830 . Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12, Oct (2011), 2825--2830.","journal-title":"Journal of machine learning research 12"},{"key":"e_1_3_2_2_19_1","volume-title":"Recognizing Uncertainty in Speech. EURASIP journal on advances in signal processing 2011 (03","author":"Pon-Barry Heather","year":"2011","unstructured":"Heather Pon-Barry and Stuart Shieber . 2011. Recognizing Uncertainty in Speech. EURASIP journal on advances in signal processing 2011 (03 2011 ). https:\/\/doi.org\/10.1155\/2011\/251753 10.1155\/2011 Heather Pon-Barry and Stuart Shieber. 2011. Recognizing Uncertainty in Speech. EURASIP journal on advances in signal processing 2011 (03 2011). https:\/\/doi.org\/10.1155\/2011\/251753"},{"key":"e_1_3_2_2_20_1","volume-title":"The Preference for Self-Correction in the Organization of Repair in Conversation. Language 53 (06","author":"Schegloff Emanuel","year":"1977","unstructured":"Emanuel Schegloff , Gail Jefferson , and Harvey Sacks . 1977. The Preference for Self-Correction in the Organization of Repair in Conversation. Language 53 (06 1977 ), 361--382. https:\/\/doi.org\/10.2307\/413107 10.2307\/413107 Emanuel Schegloff, Gail Jefferson, and Harvey Sacks. 1977. The Preference for Self-Correction in the Organization of Repair in Conversation. Language 53 (06 1977), 361--382. https:\/\/doi.org\/10.2307\/413107"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Tobias Schrank and Barbara Schuppler. 2015. Automatic detection of uncertainty in spontaneous German dialogue. In INTERSPEECH.  Tobias Schrank and Barbara Schuppler. 2015. Automatic detection of uncertainty in spontaneous German dialogue. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2015-434"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jml.2005.02.003"},{"key":"e_1_3_2_2_24_1","volume-title":"Sanne Van der Ven, and Paul Leseman","author":"van den Berghe Rianne","year":"2018","unstructured":"Rianne van den Berghe , Josje Verhagen , Ora Oudgenoeg-Paz , Sanne Van der Ven, and Paul Leseman . 2018 . Social Robots for Language Learning: A Review. Review of Educational Research ( 12 2018). https:\/\/doi.org\/10.3102\/0034654318821286 10.3102\/0034654318821286 Rianne van den Berghe, Josje Verhagen, Ora Oudgenoeg-Paz, Sanne Van der Ven, and Paul Leseman. 2018. Social Robots for Language Learning: A Review. Review of Educational Research (12 2018). https:\/\/doi.org\/10.3102\/0034654318821286"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418873","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418873","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:49Z","timestamp":1750197769000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418873"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":25,"alternative-id":["10.1145\/3382507.3418873","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3418873","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}