{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T21:03:08Z","timestamp":1781902988685,"version":"3.54.5"},"reference-count":96,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T00:00:00Z","timestamp":1642118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Leverhulme Trust as part of the Doctoral Training Programme for the Ecological Study of the Brain","award":["DS-2017-026"],"award-info":[{"award-number":["DS-2017-026"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>Voice assistants have become hugely popular in the home as domestic and entertainment devices. Recently, there has been a move towards developing them for work settings. For example,<jats:italic>Alexa for Business<\/jats:italic>and<jats:italic>IBM Watson<\/jats:italic><jats:italic>for Business<\/jats:italic>were designed to improve productivity, by assisting with various tasks, such as scheduling meetings and taking minutes. However, this kind of assistance is largely limited to planning and managing user's work. How might they be developed to do more by way of empowering people at work? Our research is concerned with achieving this by developing an agent with the role of a facilitator that assists users during an ongoing task. Specifically, we were interested in whether the modality in which the agent interacts with users makes a difference: How does a voice versus screen-based agent interaction affect user behavior? We hypothesized that voice would be more immediate and emotive, resulting in more fluid conversations and interactions. Here, we describe a user study that compared the benefits of using voice versus screen-based interactions when interacting with a system incorporating an agent, involving pairs of participants doing an exploratory data analysis task that required them to make sense of a series of data visualizations. The findings from the study show marked differences between the two conditions, with voice resulting in more turn-taking in discussions, questions asked, more interactions with the system and a tendency towards more immediate, faster-paced discussions following agent prompts. We discuss the possible reasons for why talking and being prompted by a voice assistant may be preferable and more effective at mediating human-human conversations and we translate some of the key insights of this research into design implications.<\/jats:p>","DOI":"10.1145\/3484221","type":"journal-article","created":{"date-parts":[[2022,1,14]],"date-time":"2022-01-14T16:50:20Z","timestamp":1642179020000},"page":"1-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":47,"title":["It's Good to Talk: A Comparison of Using Voice Versus Screen-Based Interactions for Agent-Assisted Tasks"],"prefix":"10.1145","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7338-5242","authenticated-orcid":false,"given":"Leon","family":"Reicherts","sequence":"first","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yvonne","family":"Rogers","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Licia","family":"Capra","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ethan","family":"Wood","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tu Dinh","family":"Duong","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Sebire","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,1,14]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376776"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3311956"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2011.339"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1080\/026870399402073"},{"key":"e_1_3_3_6_2","article-title":"Articulate2: Toward a conversational interface for visual data exploration","author":"Aurisano Jillian","year":"2016","unstructured":"Jillian Aurisano, Abhinav Kumar, Alberto Gonzalez, Jason Leigh, Barbara DiEugenio, and Andrew Johnson. 2016. Articulate2: Toward a conversational interface for visual data exploration. In Proceedings of the IEEE Visualization 2016.","journal-title":"Proceedings of the IEEE Visualization 2016"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2020.3024605"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-39540-7_7"},{"issue":"2","key":"e_1_3_3_9_2","first-page":"170","article-title":"Factors affecting user perception of a spoken language vs. textual search interface: a content analysis","volume":"28","author":"Begany Grace M.","year":"2016","unstructured":"Grace M. Begany, Ning Sa, and Xiaojun Yuan. 2016. Factors affecting user perception of a spoken language vs. textual search interface: a content analysis. Interacting with Computers 28, 2 (2016), 170\u2013180. DOI:https:\/\/doi.org\/10.1093\/iwc\/iwv029","journal-title":"Interacting with Computers"},{"key":"e_1_3_3_10_2","first-page":"96","article-title":"Using voice assistant skills in family life","author":"Beirl Diana","year":"2019","unstructured":"Diana Beirl, Nicola Yuill, and Yvonne Rogers. 2019. Using voice assistant skills in family life. In Proceedings of the 13th International Conference on Computer Supported Collaborative Learning. International Society of the Learning Sciences, 96\u2013103.","journal-title":"Proceedings of the 13th International Conference on Computer Supported Collaborative Learning"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1080\/09500693.2017.1366674"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140130903306666"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300636"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2014.965823"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1080\/03057260701828101"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1093\/iwc\/iwz016"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3405755.3406163"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/169891.169968"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022334530417"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1080\/00220671.1986.10885720"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025227"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0022674"},{"issue":"1","key":"e_1_3_3_23_2","first-page":"20","article-title":"The quantitative analysis of turntaking in multiparticipant conversations","volume":"3","author":"Dubois Sylvie","year":"1996","unstructured":"Sylvie Dubois, Martine Boutin, and David Sankoff. 1996. The quantitative analysis of turntaking in multiparticipant conversations. University of Pennsylvania Working Papers in Linguistics 3, 1 (1996), 20.","journal-title":"University of Pennsylvania Working Papers in Linguistics"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/1810543.1810548"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174047"},{"issue":"3","key":"e_1_3_3_26_2","first-page":"8","article-title":"Bots as language learning tools","volume":"10","author":"Fryer Luke","year":"2006","unstructured":"Luke Fryer and Rollo Carpenter. 2006. Bots as language learning tools. Language Learning & Technology 10, 3 (2006), 8\u201314.","journal-title":"Language Learning & Technology"},{"issue":"3","key":"e_1_3_3_27_2","first-page":"183","article-title":"A preliminary report on analyses of classroom interaction","volume":"9","author":"Gallagher James J.","year":"1963","unstructured":"James J. Gallagher and Mary Jane Aschner. 1963. A preliminary report on analyses of classroom interaction. Merrill-Palmer Quarterly of Behavior and Development 9, 3 (1963), 183\u2013194.","journal-title":"Merrill-Palmer Quarterly of Behavior and Development"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807478"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172999"},{"key":"e_1_3_3_30_2","first-page":"10","volume-title":"Proceedings of the Workshop on Question Generation","author":"Graesser Art","year":"2008","unstructured":"Art Graesser, Vasile Rus, and Zhiqiang Cai. 2008. Question classification schemes. In Proceedings of the Workshop on Question Generation, 10\u201317."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0024974"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.5555\/567363.567366"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.164"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2004-592"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmz022"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.3115\/116580.116652"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781526435385"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11747-020-00753-z"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744684"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25566-3_40"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3299034"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.wocn.2018.07.001"},{"key":"e_1_3_3_43_2","article-title":"Ava: From data to insights through conversations","author":"John Rogers Jeffrey Leo","year":"2017","unstructured":"Rogers Jeffrey Leo John, Navneet Potti, and Jignesh M. Patel. 2017. Ava: From data to insights through conversations. In Proceedings of the Conference on Innovative Data Systems Research (CIDR\u201917).","journal-title":"Proceedings of the Conference on Innovative Data Systems Research (CIDR\u201917)"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188445"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1080\/10899995.2019.1675447"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/0361-476X(89)90022-2"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/1041-6080(94)90008-6"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005635"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2004.10.006"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.07.002"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.07.009"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702379"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103658"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30139-4_35"},{"key":"e_1_3_3_55_2","article-title":"Level and trends of overweight and obesity","author":"Marinez Ramon","year":"2015","unstructured":"Ramon Marinez. 2015. Level and trends of overweight and obesity. Tableau Public. Retrieved August 27, 2020 from https:\/\/public.tableau.com\/profile\/ramon.martinez#!\/vizhome\/LevelandTrendsofOverweightandObesity\/Overweightandobesitylevel.","journal-title":"Tableau Public"},{"key":"e_1_3_3_56_2","first-page":"33","article-title":"When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface","author":"Marshall Paul","year":"2008","unstructured":"Paul Marshall, Eva Hornecker, Richard Morris, Nick Sheep Dalton, and Yvonne Rogers. 2008. When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface. In Proceedings of the 2017 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. IEEE, 33\u201340. DOI:https:\/\/doi.org\/10.1109\/TABLETOP.2008.4660181","journal-title":"Proceedings of the 2017 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11200-8_20"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998335"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1080\/03043797.2018.1538324"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022378312670"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(14)60460-8"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3432942"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174214"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998298"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174033"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053246"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/958432.958478"},{"key":"e_1_3_3_68_2","volume-title":"L'entretien Psychologique et le Counselling. De l'approche Centr\u00e9e Sur La Personne Aux Interventions Cibl\u00e9es","author":"Reicherts Michael","year":"2015","unstructured":"Michael Reicherts. 2015. L'entretien Psychologique et le Counselling. De l'approche Centr\u00e9e Sur La Personne Aux Interventions Cibl\u00e9es. Edition ZKS-Verlag, Coburg."},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3314191"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300587"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1353\/lan.1974.0010"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.2970512"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984588"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302270"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3469595.3469620"},{"key":"e_1_3_3_76_2","volume-title":"Interaction Design: Beyond Human-Computer Interaction (5th. ed.)","author":"Sharp Helen","year":"2019","unstructured":"Helen Sharp, Yvonne Rogers, and Jenny Preece. 2019. Interaction Design: Beyond Human-Computer Interaction (5th. ed.). John Wiley, UK."},{"key":"e_1_3_3_77_2","volume-title":"Proceedings of the 4th Corpus Linguistics Conference","author":"Shawar Bayan Abu","year":"2007","unstructured":"Bayan Abu Shawar and Eric Atwell. 2007. Fostering language learner autonomy through adaptive conversation tutors. In Proceedings of the 4th Corpus Linguistics Conference."},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1741118"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.103862"},{"key":"e_1_3_3_80_2","first-page":"78","article-title":"Interacting with a conversational agent system for educational purposes in online courses","author":"Song Donggil","year":"2017","unstructured":"Donggil Song, Eun Young Oh, and Marilyn Rice. 2017. Interacting with a conversational agent system for educational purposes in online courses. In Proceedings of the 2017 10th International Conference on Human System Interactions. 78\u201382. DOI:https:\/\/doi.org\/10.1109\/HSI.2017.8005002","journal-title":"Proceedings of the 2017 10th International Conference on Human System Interactions"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745219"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376782"},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.2312\/eurovisshort.20171133"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.5555\/1894345.1894369"},{"issue":"1","key":"e_1_3_3_85_2","first-page":"99","article-title":"Conversational agents improve peer learning through building on prior knowledge","volume":"20","author":"Tegos Stergios","year":"2017","unstructured":"Stergios Tegos and Stavros Demetriadis. 2017. Conversational agents improve peer learning through building on prior knowledge. Journal of Educational Technology & Society 20, 1 (2017), 99\u2013111.","journal-title":"Journal of Educational Technology & Society"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.5688\/ajpe777155"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986918"},{"issue":"1","key":"e_1_3_3_88_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/00031305.1980.10482706","article-title":"We need both exploratory and confirmatory","volume":"34","author":"Tukey John W.","year":"1980","unstructured":"John W. Tukey. 1980. We need both exploratory and confirmatory. The American Statistician 34, 1 (1980), 23\u201325. DOI:https:\/\/doi.org\/10.2307\/2682991","journal-title":"The American Statistician"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1091\/mbc.e12-09-0660"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055086"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-020-00332-0"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376781"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3313090"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/2147783.2147784"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466120"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1002\/1098-2736(200102)38:2<159::AID-TEA1002>3.0.CO;2-J"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/1851600.1851665"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484221","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484221","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:13Z","timestamp":1750191433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,14]]},"references-count":96,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,6,30]]}},"alternative-id":["10.1145\/3484221"],"URL":"https:\/\/doi.org\/10.1145\/3484221","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,14]]},"assertion":[{"value":"2020-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}