{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T23:22:30Z","timestamp":1784676150394,"version":"3.55.0"},"reference-count":146,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T00:00:00Z","timestamp":1559347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100002081","name":"Irish Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002081","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title\/><jats:p>Speech interfaces are growing in popularity. Through a review of 99 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in the field of human\u2013computer interaction (HCI). We find that studies are usability\/theory-focused or explore wider system experiences, evaluating Wizard of Oz, prototypes or developed systems. Measuring task and interaction was common, as was using self-report questionnaires to measure concepts like usability and user attitudes. A thematic analysis of the research found that speech HCI work focuses on nine key topics: system speech production, design insight, modality comparison, experiences with interactive voice response systems, assistive technology and accessibility, user speech production, using speech technology for development, peoples\u2019 experiences with intelligent personal assistants and how user memory affects speech interface interaction. From these insights we identify gaps and challenges in speech research, notably taking into account technological advancements, the need to develop theories of speech interface interaction, grow critical mass in this domain, increase design work and expand research from single to multiple user interaction contexts so as to reflect current use contexts. We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research.<\/jats:p><\/jats:sec><jats:sec><jats:title>RESEARCH HIGHLIGHTS<\/jats:title><jats:p>Most papers focused on usability\/theory-based or wider system experience research with a focus on Wizard of Oz and developed systems Questionnaires on usability and user attitudes often used but few were reliable or validated Thematic analysis showed nine primary research topics Challenges identified in theoretical approaches and design guidelines, engaging with technological advances, multiple user and in the wild contexts, critical research mass and barriers to building speech interfaces<\/jats:p><\/jats:sec>","DOI":"10.1093\/iwc\/iwz016","type":"journal-article","created":{"date-parts":[[2019,5,31]],"date-time":"2019-05-31T19:12:10Z","timestamp":1559329930000},"page":"349-371","source":"Crossref","is-referenced-by-count":150,"title":["The State of Speech in HCI: Trends, Themes and Challenges"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9237-1057","authenticated-orcid":false,"given":"Leigh","family":"Clark","sequence":"first","affiliation":[{"name":"School of Information and Communication Studies, University College Dublin, Belfield, Dublin 4, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Doyle","sequence":"additional","affiliation":[{"name":"School of Information and Communication Studies, University College Dublin, Belfield, Dublin 4, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Garaialde","sequence":"additional","affiliation":[{"name":"School of Information and Communication Studies, University College Dublin, Belfield, Dublin 4, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emer","family":"Gilmartin","sequence":"additional","affiliation":[{"name":"Speech Communication Laboratory, Trinity College Dublin, 7-9 South Leinster Street, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"Schl\u00f6gl","sequence":"additional","affiliation":[{"name":"MCI Management Center, Universit\u00e4tsstra\u03b2e 15, 6020 Innsbruck, Innsbruck, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jens","family":"Edlund","sequence":"additional","affiliation":[{"name":"Department of Speech, Music and Hearing, KTH Royal Institute of Technology, Lindstedtsv\u00e4agen 24, 114 28 Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Aylett","sequence":"additional","affiliation":[{"name":"CereProc Ltd, Codebase, Argyle House, 3 Lady Lawson Street, Edinburgh, EH3 9DR, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jo\u00e3o","family":"Cabral","sequence":"additional","affiliation":[{"name":"School of Computer Science and Statistics, Trinity College Dublin, College Green, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cosmin","family":"Munteanu","sequence":"additional","affiliation":[{"name":"Institute of Communication, Culture, Information and Technology, University of Toronto Mississauga, 3359 Mississauga Road, Mississauga, ON L5L 1C6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin","family":"Edwards","sequence":"additional","affiliation":[{"name":"School of Information and Communication Studies, University College Dublin, Belfield, Dublin 4, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"R Cowan","sequence":"additional","affiliation":[{"name":"School of Information and Communication Studies, University College Dublin, Belfield, Dublin 4, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,9,11]]},"reference":[{"key":"2020072307164794000_ref1","first-page":"236","volume-title":"Computer Aided Conversation for Severely Physically Impaired Non-speaking People, In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems","author":"Alm","year":"1993"},{"key":"2020072307164794000_ref2","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1006\/imms.1993.1026","article-title":"User representations of computer systems in human-computer speech interaction","volume":"38","author":"Amalberti","year":"1993","journal-title":"Int. J. Man-Mach. Stud."},{"key":"2020072307164794000_ref3","first-page":"749","volume-title":"None of a CHInd: Relationship Counselling for HCI and Speech Technology. In CHI'14 Extended Abstracts on Human Factors in Computing Systems","author":"Aylett","year":"2014"},{"key":"2020072307164794000_ref4","first-page":"2085","volume-title":"Interactive Radio: A New Platform for Calm Computing, In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems","author":"Aylett","year":"2015"},{"key":"2020072307164794000_ref5","volume-title":"In Proceedings of the SIGCHI conference on human factors in computing systems","author":"Bargas-avila","year":"2011"},{"key":"2020072307164794000_ref6","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s12193-009-0016-6","article-title":"To talk or not to talk with a computer","volume":"2","author":"Batliner","year":"2008","journal-title":"J. Multimodal User In."},{"key":"2020072307164794000_ref7","first-page":"170","article-title":"Factors affecting user perception of a spoken language vs. textual search interface: A content analysis","volume":"28","author":"Begany","year":"2015","journal-title":"Interact. Comput."},{"key":"2020072307164794000_ref8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1080\/01449299508914621","article-title":"A comparison of mouse and speech input control of a text-annotation system","volume":"14","author":"Bekker","year":"1995","journal-title":"Behav. Inf. Technol."},{"key":"2020072307164794000_ref9","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1007\/s10209-004-0106-x","article-title":"Using speech and dialogue for interactive TV navigation","volume":"3","author":"Berglund","year":"2004","journal-title":"Universal Access Inf."},{"key":"2020072307164794000_ref10","first-page":"1173","volume-title":"Listening to your inner voices: Investigating means for voice notifications, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Bhatia","year":"2006"},{"key":"2020072307164794000_ref11","first-page":"1265","volume-title":"Taking the time to care: empowering low health literacy hospital patients with virtual nurse agents, In Proceedings of the SIGCHI conference on human factors in computing systems","author":"Bickmore","year":"2009"},{"key":"2020072307164794000_ref12","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.cognition.2011.05.011","article-title":"The role of beliefs in lexical alignment: Evidence from dialogs with humans and computers","volume":"121","author":"Branigan","year":"2011","journal-title":"Cognition"},{"key":"2020072307164794000_ref13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual. Res. Psychol"},{"key":"2020072307164794000_ref14","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S1071-5819(03)00018-1","article-title":"Emotion and sociable humanoid robots","volume":"59","author":"Breazeal","year":"2003","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref15","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1037\/0278-7393.22.6.1482","article-title":"Conceptual pacts and lexical choice in conversation","volume":"22","author":"Brennan","year":"1996","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn"},{"key":"2020072307164794000_ref16","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511813085","volume-title":"Politeness: Some Universals in Language Usage","author":"Brown","year":"1987"},{"key":"2020072307164794000_ref17","doi-asserted-by":"crossref","first-page":"4138","DOI":"10.1109\/ROBOT.2002.1014396","volume":"4","author":"Bruce","year":"2002","journal-title":"In Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No. 02CH37292)"},{"key":"2020072307164794000_ref18","author":"Buchheit","year":"1990"},{"key":"2020072307164794000_ref19","author":"","year":"2018"},{"key":"2020072307164794000_ref20","doi-asserted-by":"crossref","first-page":"4960","DOI":"10.1109\/ICASSP.2016.7472621","article-title":"Listen, attend and spell: a neural network for large vocabulary conversational speech recognition","author":"Chan","year":"2016","journal-title":"In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)"},{"key":"2020072307164794000_ref21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2983926","article-title":"A multimodal approach to assessing user experiences with agent helpers","volume":"6","author":"Clark","year":"2016","journal-title":"ACM Trans. Interact. Intell. Syst."},{"key":"2020072307164794000_ref22","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1145\/2851581.2886425","volume-title":"Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems","author":"Cohen","year":"2016"},{"key":"2020072307164794000_ref23","first-page":"69","volume-title":"Demonstration of sketch-thru-plan: a multimodal interface for command and control","author":"Cohen","year":"2013"},{"key":"2020072307164794000_ref24","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1145\/2935334.2935386","volume-title":"Proceedings of the 18th international conference on human-computer interaction with mobile devices and services","author":"Corbett","year":"2016"},{"key":"2020072307164794000_ref25","first-page":"155","volume-title":"Does voice anthropomorphism affect lexical alignment in speech-based human-computer dialogue?, Proc. 3rd Annual ACM SIGGRAPH Symposium","author":"Cowan","year":"2015"},{"key":"2020072307164794000_ref26","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.ijhcs.2015.05.008","article-title":"Voice anthropomorphism, interlocutor modelling and alignment effects on syntactic choices in human\u2212computer dialogue","volume":"83","author":"Cowan","year":"2015","journal-title":"Int, J. Hum. Comp. Stud"},{"key":"2020072307164794000_ref27","first-page":"2805","volume-title":"Towards Understanding How Speech Output Affects Navigation System Credibility, In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems","author":"Cowan","year":"2016"},{"key":"2020072307164794000_ref28","first-page":"1","volume-title":"What Can I Help You With?\u2019: Infrequent Users\u2019 Experiences of Intelligent Personal Assistants, Proc. 3rd Annual ACM SIGGRAPH Symposium, In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services","author":"Cowan","year":"2017"},{"key":"2020072307164794000_ref29","doi-asserted-by":"crossref","first-page":"2833","DOI":"10.1145\/2470654.2481392","volume-title":"Conference on human factors in computing systems-proceedings","author":"Cuendet","year":"2013"},{"key":"2020072307164794000_ref30","first-page":"1431","volume-title":"Facilitating Development of Pragmatic Competence through a Voice-driven Video Learning Interface, In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems","author":"Culbertson","year":"2017"},{"key":"2020072307164794000_ref31","first-page":"193","volume-title":"Wizard Of Oz Studies\u2014Why And How. Intelligent User Interfaces, In Proceedings of the International Conference on Intelligent User Interfaces (IUI 1993)","author":"Dahlb\u00e4ck","year":"1993"},{"key":"2020072307164794000_ref32","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1145\/1240624.1240859","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Dahlb\u00e4ck","year":"2007"},{"key":"2020072307164794000_ref33","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/01449290412331328563","article-title":"Speech-based cursor control using grids: modelling performance and comparisons with other solutions","volume":"24","author":"Dai","year":"2005","journal-title":"Behaviour and Information Technology"},{"key":"2020072307164794000_ref34","doi-asserted-by":"crossref","first-page":"2770","DOI":"10.1145\/3025453.3025514","volume-title":"Proceedings of the 2017 CHI conference on human factors in computing systems","author":"DeRenzi","year":"2017"},{"key":"2020072307164794000_ref35","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1006\/ijhc.1997.0182","article-title":"Negative feedback in information dialogues: identification, classification and problem-solving procedures","volume":"48","author":"Derriks","year":"1998","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref36","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1080\/0144929021000013482","article-title":"Automated telephone answering systems and aging","volume":"21","author":"Dulude","year":"2002","journal-title":"Behaviour & Information Technology"},{"key":"2020072307164794000_ref37","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1016\/j.intcom.2010.07.001","article-title":"The impact of voice characteristics on user response in an interactive voice response system","volume":"22","author":"Evans","year":"2010","journal-title":"Interact. Comput"},{"key":"2020072307164794000_ref38","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1145\/1035575.1035576","article-title":"Using confidence scores to improve hands-free speech based navigation in continuous dictation systems","volume":"11","author":"Feng","year":"2004","journal-title":"ACM Trans. Comput. Hum. Interact"},{"key":"2020072307164794000_ref39","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1016\/j.ijhcs.2005.12.001","article-title":"A longitudinal evaluation of hands-free speech-based navigation during dictation","volume":"64","author":"Feng","year":"2006","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref40","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s10209-010-0185-9","article-title":"Speech-based navigation and error correction: a comprehensive comparison of two solutions","volume":"10","author":"Feng","year":"2011","journal-title":"Univers. Access Inf. Soc"},{"key":"2020072307164794000_ref41","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1016\/j.ijhcs.2008.07.006","article-title":"Route-following assistance for travelers with cognitive impairments: a comparison of four prompt modes","volume":"66","author":"Fickas","year":"2008","journal-title":"Int. J. Hum. Comput Stud"},{"key":"2020072307164794000_ref42","first-page":"158","volume-title":"Shall we mix synthetic speech and human speech? Impact on users\u2019 performance, perception, and attitude, In proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2001)","author":"Gong","year":"2001"},{"key":"2020072307164794000_ref43","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1145\/1013115.1013137","volume-title":"Tutor Design for Speech-Based Interfaces, In Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques","author":"Hakulinen","year":"2004"},{"key":"2020072307164794000_ref44","first-page":"429","volume-title":"NLify: Lightweight Spoken Natural Language Interfaces via Exhaustive Paraphrasing, In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing","author":"Han","year":"2013"},{"key":"2020072307164794000_ref45","first-page":"3473","volume-title":"Effect of Machine Translation in Interlingual Conversation: Lessons from a Formative Study, In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems","author":"Hara","year":"2015"},{"key":"2020072307164794000_ref46","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1145\/1452392.1452407","volume-title":"Proceedings of the 10th international conference on multimodal interfaces","author":"Harada","year":"2008"},{"key":"2020072307164794000_ref47","first-page":"347","volume-title":"Longitudinal Study of People Learning to Use Continuous Voice-Based Cursor ControlProc. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Harada","year":"2009"},{"key":"2020072307164794000_ref48","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1006\/imms.1993.1011","article-title":"Gestures with speech for graphic manipulation","volume":"38","author":"Hauptmann","year":"1993","journal-title":"Int. J. Man Mach. Stud"},{"key":"2020072307164794000_ref49","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1145\/2557500.2557509","volume-title":"Proceedings of the 19th international conference on intelligent user interfaces","author":"Hofmann","year":"2014"},{"key":"2020072307164794000_ref50","first-page":"4","author":"Hone","year":"2014","journal-title":"Usability measurement for speech systems: SASSI revisited, Designing Speech and Language Interactions Workshop, CHI 2014"},{"key":"2020072307164794000_ref51","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1006\/ijhc.2000.0456","article-title":"Designing habitable dialogues for speech-based interaction with computers","volume":"54","author":"Hone","year":"2001","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref52","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1017\/S1351324900002497","article-title":"Towards a tool for the subjective assessment of speech system interfaces (SASSI)","volume":"6","author":"Hone","year":"2000","journal-title":"Nat. Lang. Eng"},{"key":"2020072307164794000_ref53","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.ijhcs.2005.06.002","article-title":"Current practice in measuring usability: challenges to usability studies and research","volume":"64","author":"Hornb\u00e6k","year":"2006","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref54","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0010-0277(96)81418-1","article-title":"When do speakers take into account common ground?","volume":"59","author":"Horton","year":"1996","journal-title":"Cognition"},{"key":"2020072307164794000_ref55","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1080\/01449290512331319058","article-title":"The impact of Interface metaphor and context of use on the usability of a speech-based mobile city guide service","volume":"24","author":"Howell","year":"2005","journal-title":"Behaviour & Information Technology"},{"key":"2020072307164794000_ref56","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1016\/j.ijhcs.2006.03.002","article-title":"Visualisation improves the usability of voice-operated mobile phone services","volume":"64","author":"Howell","year":"2006","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref57","first-page":"1127","volume-title":"Interaction Science SIG: Overcoming Challenges","author":"Howes","year":"2014"},{"key":"2020072307164794000_ref58","first-page":"1343","volume-title":"Context & usability testing: user-modeled information presentation in easy and difficult driving conditions In Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Hu","year":"2007"},{"key":"2020072307164794000_ref59","first-page":"463","volume-title":"Hang on a sec!: effects of proactive mediation of phone conversations while driving, In Proceedings of the SIGCHI conference on human factors in computing systems","author":"Iqbal","year":"2011"},{"key":"2020072307164794000_ref60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10447318.2014.925774","article-title":"Menu navigation with in-vehicle technologies: auditory menu cues improve dual task performance, preference, and workload","volume":"31","author":"Jeon","year":"2015","journal-title":"Int. J. Hum. Comput. Int"},{"key":"2020072307164794000_ref61","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1207\/S15327590IJHC1302_5","article-title":"\u2018You talking to me?\u2019 Exploring voice in self-service user interfaces","volume":"13","author":"Johnson","year":"2001","journal-title":"Int. J. Hum. Comput. Int"},{"key":"2020072307164794000_ref62","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1007\/s10209-005-0002-z","article-title":"Adaptation and user expertise modelling in AthosMail","volume":"4","author":"Jokinen","year":"2006","journal-title":"Univers. Access Inf. Soc"},{"key":"2020072307164794000_ref63","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-02134-3","volume-title":"Spoken Dialogue Systems","author":"Jokinen","year":"2010"},{"key":"2020072307164794000_ref64","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1080\/01449290512331335609","article-title":"Effects of the rate of computer-mediated speech on emotion-related subjective and physiological responses","volume":"24","author":"Kallinen","year":"2005","journal-title":"Behaviour & Information Technology"},{"key":"2020072307164794000_ref65","volume-title":"Intelligent Personal Assistant-Products, Technologies and Market: 2017\u20132022","author":"Kamitis","year":"2016"},{"key":"2020072307164794000_ref66","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1080\/014492997119860","article-title":"Public attitudes toward voice-based electronic messaging technologies in the United States: a national survey of opinions about voice response units and telephone answering machines","volume":"16","author":"Katz","year":"1997","journal-title":"Behaviour and Information Technology"},{"key":"2020072307164794000_ref67","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1111\/1467-8721.ep13175613","article-title":"The egocentric basis of language use: insights from a processing approach","volume":"7","author":"Keysar","year":"1998","journal-title":"Curr. Dir. Psychol. Sci"},{"key":"2020072307164794000_ref68","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.ijhcs.2016.09.004","article-title":"Explicit feedback from users attenuates memory biases in human-system dialogue","volume":"97","author":"Knutsen","year":"2017","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref69","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1145\/2663204.2663244","volume-title":"Proceedings of the 16th international conference on multimodal interaction","author":"Kousidis","year":"2014"},{"key":"2020072307164794000_ref70","first-page":"2277","volume-title":"Voice typing: a new speech interaction model for dictation on touchscreen devices, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Kumar","year":"2012"},{"key":"2020072307164794000_ref71","first-page":"1191","volume-title":"Museum guide robot based on sociological interaction analysis, In Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Kuno","year":"2007"},{"key":"2020072307164794000_ref72","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1145\/258549.258829","volume-title":"Proceedings of the ACM SIGCHI conference on human factors in computing systems","author":"Lai","year":"1997"},{"key":"2020072307164794000_ref73","first-page":"1","article-title":"Assistive technology devices and home accessibility features: prevalence, payment, need, and trends","volume":"217","author":"LaPlante","year":"1992","journal-title":"Adv Data Vital Health Stat"},{"key":"2020072307164794000_ref74","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.apergo.2017.04.003","article-title":"Steering the conversation: a linguistic exploration of natural language interactions with a digital assistant during simulated driving.","volume":"63","author":"Large","year":"2017","journal-title":"Applied ergonomics"},{"key":"2020072307164794000_ref75","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.chb.2004.10.006","article-title":"Mode and modal transfer effects on performance and discourse organization with an information retrieval dialogue system in natural language","volume":"22","author":"Le Bigot","year":"2006","journal-title":"Comput. Human Behav"},{"key":"2020072307164794000_ref76","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1080\/0144929X.2011.563800","article-title":"Investigating memory constraints on recall of options in interactive voice response system messages","volume":"32","author":"Le Bigot","year":"2013","journal-title":"Behaviour & Information Technology"},{"key":"2020072307164794000_ref77","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1016\/j.ijhcs.2007.07.002","article-title":"Effect of modality on collaboration with a dialogue system","volume":"65","author":"Le Bigot","year":"2007","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref78","doi-asserted-by":"crossref","first-page":"3331","DOI":"10.1145\/2470654.2466455","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Leahu","year":"2013"},{"key":"2020072307164794000_ref79","first-page":"289","article-title":"Designing social presence of social actors in human Computer Human Interaction","volume":"5","author":"Lee","year":"2003","journal-title":"New Horizons"},{"key":"2020072307164794000_ref80","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.chb.2010.07.011","article-title":"A primer to human threading","volume":"27","author":"Liapis","year":"2011","journal-title":"Comput. Hum. Behav"},{"key":"2020072307164794000_ref81","first-page":"3967","volume-title":"Empirical evidence for a diminished sense of agency in speech interfaces, In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems","author":"Limerick","year":"2015"},{"key":"2020072307164794000_ref82","doi-asserted-by":"crossref","first-page":"67","DOI":"10.18653\/v1\/P16-4012","volume-title":"Proceedings of ACL-2016 system demonstrations","author":"Lison","year":"2016"},{"key":"2020072307164794000_ref83","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1023\/A:1015036910358","article-title":"Designing and evaluating an adaptive spoken dialogue system","volume":"12","author":"Litman","year":"2002","journal-title":"User Model. User-Adapt. Interact"},{"key":"2020072307164794000_ref84","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1145\/1357054.1357205","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"L\u00f6hr","year":"2008"},{"key":"2020072307164794000_ref85","doi-asserted-by":"crossref","first-page":"5286","DOI":"10.1145\/2858036.2858288","volume-title":"Proceedings of the 2016 CHI conference on human factors in computing systems","author":"Luger","year":"2016"},{"key":"2020072307164794000_ref86","first-page":"20","volume-title":"Human perception of intended addressee during computer-assisted meetings, In Proceedings of the 8th international conference on Multimodal interfaces","author":"Lunsford","year":"2006"},{"key":"2020072307164794000_ref87","first-page":"167","volume-title":"Audio-visual cues distinguishing self- from system-directed speech in younger and older adults, In Proceedings of the 7th international conference on Multimodal interfaces","author":"Lunsford","year":"2005"},{"key":"2020072307164794000_ref88","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.ijhcs.2015.08.003","article-title":"Sonification of guidance data during road crossing for people with visual impairments or blindness","volume":"85","author":"Mascetti","year":"2016","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref89","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-32967-3","volume-title":"The conversational interface: talking to smart devices","author":"McTear","year":"2016"},{"key":"2020072307164794000_ref90","first-page":"1741","volume-title":"A comparison of mobile money-transfer UIs for non-literate and semi-literate users, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Medhi","year":"2009"},{"key":"2020072307164794000_ref91","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1959022.1959024","article-title":"Designing mobile interfaces for novice and low-literacy users","volume":"18","author":"Medhi","year":"2011","journal-title":"ACM Trans. Comput. Hum. Interact"},{"key":"2020072307164794000_ref92","first-page":"927","volume-title":"A systematic review of quantitative studies on the enjoyment of digital entertainment games, In Proceedings of the 32nd annual ACM conference on Human factors in computing systems","author":"Mekler","year":"2014"},{"key":"2020072307164794000_ref93","first-page":"59","volume-title":"From vocal to multimodal dialogue management, In Proceedings of the 8th international Conference on Multimodal interfaces","author":"Melichar","year":"2006"},{"key":"2020072307164794000_ref94","first-page":"249","author":"Mendelson","year":"2017"},{"key":"2020072307164794000_ref95","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1109\/QOMEX.2009.5246986","article-title":"A taxonomy of quality of service and Quality of Experience of multimodal human-machine interaction","author":"Moller","year":"2009","journal-title":"In 2009 International Workshop on Quality of Multimedia Experience. IEEE"},{"key":"2020072307164794000_ref96","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1006\/ijhc.1996.0053","article-title":"The impacts on user performance and satisfaction of a voice-based front-end Interface for a standard software tool","volume":"45","author":"Molnar","year":"1996","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref97","first-page":"371","volume-title":"Team reactions to voiced agent instructions in a pervasive game, In Proceedings of the 2013 international conference on Intelligent user interfaces","author":"Moran","year":"2013"},{"key":"2020072307164794000_ref98","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1145\/3027063.3027086","volume-title":"Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems","author":"Munteanu","year":"2017"},{"key":"2020072307164794000_ref99","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1145\/2559206.2567826","volume-title":"CHI\u201914 extended abstracts on human factors in computing systems","author":"Munteanu","year":"2014"},{"key":"2020072307164794000_ref100","article-title":"Does speech input system lead to improved performance for elderly? Discussion of problems when using speech interfaces for elderly","author":"Murata","year":"2002","journal-title":"Proceedings of the IEEE International Conference on Systems, Man and Cybernetics"},{"key":"2020072307164794000_ref101","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1006\/ijhc.1996.0052","article-title":"Dialogue design in speech-mediated data-entry: the role of syntactic constraints and feedback","volume":"45","author":"Murray","year":"1996","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref102","first-page":"329","volume-title":"Does computer-generated speech manifest personality? an experimental test of similarity-attraction, In Proceedings of the SIGCHI conference on Human Factors in Computing Systems","author":"Nass","year":"2000"},{"key":"2020072307164794000_ref103","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1145\/191666.191729","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems, Proc. 3rd Annual ACM SIGGRAPH Symposium","author":"Nielsen","year":"1994"},{"key":"2020072307164794000_ref104","volume-title":"The Design of Everyday Things (revised and expanded edition)","author":"Norman","year":"2013"},{"key":"2020072307164794000_ref105","author":"van den Oord","year":"2017"},{"key":"2020072307164794000_ref106","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1145\/1027933.1027957","volume-title":"Proceedings of the 6th international conference on multimodal interfaces","author":"Oviatt","year":"2004"},{"key":"2020072307164794000_ref107","first-page":"969","volume-title":"Implicit user-adaptive system engagement in speech and pen interfaces, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Oviatt","year":"2008"},{"key":"2020072307164794000_ref108","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.1016\/j.chb.2008.05.010","article-title":"The role of spatial abilities and age in performance in an auditory computer navigation task","volume":"24","author":"Pak","year":"2008","journal-title":"Comput. Hum. Behav"},{"key":"2020072307164794000_ref109","first-page":"51","volume-title":"A comparative study of speech and dialed input voice interfaces in rural India, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Patel","year":"2009"},{"key":"2020072307164794000_ref110","volume-title":"Designing Voice User Interfaces: Principles of Conversational Experiences","author":"Pearl","year":"2016","edition":"1st edn"},{"key":"2020072307164794000_ref111","first-page":"961","volume-title":"A study of out-of-turn interaction in menu-based, IVR, voicemail systems, In Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Perugini","year":"2007"},{"key":"2020072307164794000_ref112","article-title":"Supporting medical conversations between deaf and hearing individuals with tabletop displays","author":"Piper","year":"2008","journal-title":"CSCW 08- conference proceedings, 2008 ACM conference on computer supported cooperative work"},{"key":"2020072307164794000_ref113","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1016\/j.ijhcs.2013.02.002","article-title":"Modelling human tutors\u2019 feedback to inform natural language interfaces for learning","volume":"71","author":"Porayska-Pomsta","year":"2013","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref114","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1145\/2998181.2998298","volume-title":"Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing","author":"Porcheron","year":"2017"},{"key":"2020072307164794000_ref115","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1207\/s15327590ijhc1903_1","article-title":"Speech-based text entry for mobile handheld devices: an analysis of efficacy and error correction techniques for server-based solutions","volume":"19","author":"Price","year":"2005","journal-title":"Int. J. Hum. Comput. Interact"},{"key":"2020072307164794000_ref116","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1007\/s10209-005-0006-8","article-title":"Motion does matter: an examination of speech-based text entry on the move","volume":"4","author":"Price","year":"2006","journal-title":"Universal Access Inf. Soc"},{"key":"2020072307164794000_ref117","first-page":"8","volume-title":"Proceedings of the 5th international conference on Multimodal interfaces","author":"Qvarfordt","year":"2003"},{"key":"2020072307164794000_ref118","first-page":"281","volume-title":"Crowdsourcing ratings of caller engagement in thin-slice videos of human-machine dialog: benefits and pitfalls, Proc. 3rd Annual ACM SIGGRAPH Symposium, In Proceedings of the 19th ACM International Conference on Multimodal Interaction","author":"Ramanarayanan","year":"2017"},{"key":"2020072307164794000_ref119","doi-asserted-by":"crossref","first-page":"2803","DOI":"10.1145\/2470654.2481389","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Raza","year":"2013"},{"key":"2020072307164794000_ref120","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1145\/1152215.1152224","volume-title":"Proceedings of the 8th conference on human-computer interaction with mobile devices and services","author":"Sammon","year":"2006"},{"key":"2020072307164794000_ref121","doi-asserted-by":"crossref","first-page":"2769","DOI":"10.1145\/1978942.1979353","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Sato","year":"2011"},{"key":"2020072307164794000_ref122","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.ijhcs.2014.11.004","article-title":"Modeling input modality choice in mobile graphical and speech interfaces","volume":"75","author":"Schaffer","year":"2015","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref123","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1007\/s10209-002-0034-6","article-title":"Speech-based cursor control: understanding the effects of target size, cursor speed, and command selection","volume":"2","author":"Sears","year":"2002","journal-title":"Universal Access Inf. Soc"},{"key":"2020072307164794000_ref124","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1207\/S15327051HCI1803_2","article-title":"Hands-free, speech-based navigation during dictation: difficulties, consequences, and solutions","volume":"18","author":"Sears","year":"2003","journal-title":"Hum. Comput. Interact"},{"key":"2020072307164794000_ref125","first-page":"63","article-title":"The limits of speech recognition","volume-title":"Communications of the ACM,","author":"Shneiderman","year":"2000"},{"key":"2020072307164794000_ref126","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1145\/267505.267514","article-title":"Direct manipulation vs. interface agents","volume":"4","author":"Shneiderman","year":"1997","journal-title":"Interactions"},{"key":"2020072307164794000_ref127","volume-title":"Designing the User Interface: Strategies for Effective Human-Computer Interaction","author":"Shneiderman","year":"2016","edition":"6th"},{"key":"2020072307164794000_ref128","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1145\/2858036.2858416","volume-title":"Proceedings of the 2016 CHI conference on human factors in computing systems","author":"Sivaraman","year":"2016"},{"key":"2020072307164794000_ref129","first-page":"3593","volume-title":"Too much humanness for human-robot interaction: exposure to highly humanlike robots elicits aversive responding in observers","author":"Strait","year":"2015"},{"key":"2020072307164794000_ref130","first-page":"283","volume-title":"A comparative study of speech in the call center: natural language call routing vs. touch-tone menus","author":"Suhm","year":"2002"},{"key":"2020072307164794000_ref131","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1145\/371127.371166","article-title":"Multimodal error correction for speech user interfaces","volume":"8","author":"Suhm","year":"2001","journal-title":"ACM Transactions on Computer-Human Interaction"},{"key":"2020072307164794000_ref132","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.ijhcs.2006.06.005","article-title":"Driver safety and information from afar: an experimental driving simulator study of wireless vs. in-car information services","volume":"66","author":"Takayama","year":"2008","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref133","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2544066","article-title":"Designing interfaces for multiple-goal environments: experimental insights from in-vehicle speech interfaces","volume":"21","author":"Truschin","year":"2014","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"2020072307164794000_ref134","first-page":"77","volume-title":"Responding to subtle, fleeting changes in the user\u2019s internal state, Proc. 3rd Annual ACM SIGGRAPH Symposium, In Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Tsukahara","year":"2001"},{"key":"2020072307164794000_ref135","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1145\/3025453.3025640","volume-title":"Proceedings of the 2017 CHI conference on human factors in computing systems","author":"Vashistha","year":"2017"},{"key":"2020072307164794000_ref136","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1145\/2070481.2070506","volume-title":"Proceedings of the 13th international conference on multimodal interfaces","author":"Vetek","year":"2011"},{"key":"2020072307164794000_ref137","first-page":"582","volume-title":"What can I say? Evaluating a spoken language interface to email, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Walker","year":"1998"},{"key":"2020072307164794000_ref138","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1016\/j.chb.2008.03.014","article-title":"A pen and speech-based storytelling system for Chinese children","volume":"24","author":"Wang","year":"2008","journal-title":"Comput. Human Behav"},{"key":"2020072307164794000_ref139","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1145\/1054972.1055086","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Wang","year":"2005"},{"key":"2020072307164794000_ref140","volume-title":"Designing Effective Speech Interfaces","author":"Weinschenk","year":"2000"},{"key":"2020072307164794000_ref141","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1080\/01449290600717783","article-title":"Hidden menu options in automated human \u2013 computer telephone dialogues: dissonance in the user\u2019s mental model","volume":"26","author":"Wilke","year":"2007","journal-title":"Behaviour & Information Technology"},{"key":"2020072307164794000_ref142","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.ijhcs.2004.08.001","article-title":"System-initiated digressive proposals in automated human\u2013computer telephone dialogues: the use of contrasting politeness strategies","volume":"62","author":"Wilkie","year":"2005","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"2020072307164794000_ref143","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.chb.2014.10.015","article-title":"Carrot and stick 2.0: the benefits of natural and motivational prosody in computer-assisted learning","volume":"43","author":"Wolff","year":"2015","journal-title":"Comput. Human Behav"},{"key":"2020072307164794000_ref144","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.intcom.2009.05.009","article-title":"Reducing working memory load in spoken dialogue systems","volume":"21","author":"Wolters","year":"2009","journal-title":"Interact. Comput"},{"key":"2020072307164794000_ref145","author":"World Health Organization","year":"2001"},{"key":"2020072307164794000_ref146","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1145\/223904.223952","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Yankelovich","year":"1995"}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/31\/4\/349\/33525046\/iwz016.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/31\/4\/349\/33525046\/iwz016.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T03:27:16Z","timestamp":1694921236000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/31\/4\/349\/5560013"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,1]]},"references-count":146,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,9,11]]},"published-print":{"date-parts":[[2019,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/iwc\/iwz016","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,6]]},"published":{"date-parts":[[2019,6,1]]}}}