{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:53:32Z","timestamp":1776092012747,"version":"3.50.1"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T00:00:00Z","timestamp":1701216000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["72001085, 71810107003"],"award-info":[{"award-number":["72001085, 71810107003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["2662021JGQD006"],"award-info":[{"award-number":["2662021JGQD006"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSSFC","award":["18ZDA109"],"award-info":[{"award-number":["18ZDA109"]}]},{"name":"AIM Institute and BIC Center"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>With the development of digital virtual assistants (DVA), academics and practitioners have increased attention to the DVA user experience. However, the measurement scale of DVA user experience is still under-researched, which may hinder further empirical study on human-DVA interaction. This study rigorously developed dimensions and associated scales of the DVA user experience. We employed a mixed-method approach that integrated qualitative and quantitative methods. This study first developed multilevel dimensions of DVA user experience based on consumers\u2019 online reviews (n = 21,314), then adopted the ten-step method to develop the associate measurement scale with reliability and validity by collecting and examining three data sets (pretest: n = 368, refinement and validation: n = 585, cross-validation: n = 567). This study fills the gap of a lack of research on the classification and measurement of DVA user experience and provides a reference for practitioners in developing DVA and continuously improving the DVA user experience.<\/jats:p>","DOI":"10.1145\/3622782","type":"journal-article","created":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T12:06:02Z","timestamp":1695384362000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["User Experience of Digital Voice Assistant: Conceptualization and Measurement"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5630-9216","authenticated-orcid":false,"given":"Qian","family":"Chen","sequence":"first","affiliation":[{"name":"College of Economics &amp; Management, Huazhong Agricultural University, Hubei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9270-5507","authenticated-orcid":false,"given":"Yeming","family":"Gong","sequence":"additional","affiliation":[{"name":"Artificial Intelligence in Management Institute, EMLYON Business School, Avenue Guy de Collongue, Ecully, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2736-8011","authenticated-orcid":false,"given":"Yaobin","family":"Lu","sequence":"additional","affiliation":[{"name":"Modern Information Management Research Center, School of Management, Huazhong University of Science and Technology, Hubei, China"}]}],"member":"320","published-online":{"date-parts":[[2023,11,29]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Aurora Mobile. 2019. Aurora big data: Why capital love VPA speaker? The penetration rate of VPA speaker app industry is 2.15%. Which still has broad room for improvemen t . https:\/\/www.techsir.com\/a\/201905\/53581.html https:\/\/www.techsir.com\/a\/201905\/53581.html. Retrieved from https:\/\/www.techsir.com\/a\/201905\/53581.html"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1080\/00913367.2017.1405755"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979336"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/02681102.2016.1173002"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.2307\/3250921"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2013.03.012"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2017.01.004"},{"key":"e_1_3_2_10_2","first-page":"189","volume-title":"Usability Evaluation in Industry","author":"Brooke J.","year":"1996","unstructured":"J. Brooke. 1996. SUS: A \u201cquick and dirty\u201d usability scale. In Usability Evaluation in Industry. Taylor & Francis, London, UK, 189\u2013194."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40622-014-0069-6"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1080\/02642060802629919"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.2.17331.07202"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00988593"},{"key":"e_1_3_2_15_2","volume-title":"Basics of Qualitative Research: Grounded Theory Procedures and Techniques","author":"Corbin J. M.","year":"2008","unstructured":"J. M. Corbin and A. L. Strauss. 2008. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Sage, Newbury Park."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.4018\/IJESMA.2017070101"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00427"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3233\/AIC-130582"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.2307\/249008"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8551.2006.00500.x"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2010.499850"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1177\/1094428110378369"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcom.2012.06.001"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.07.009"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2020.08.058"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.2307\/23044042"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.emj.2007.08.005"},{"key":"e_1_3_2_28_2","volume-title":"The Discovery of Grounded Theory","author":"Glaser B.","year":"1967","unstructured":"B. Glaser and A. Strauss. 1967. The Discovery of Grounded Theory. Aldine, Chicago."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2014.987358"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1512714.1512717"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1304_07"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2010.04.002"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1080\/01449290500330331"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1136\/pgmj.25.288.471"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1093\/jcr\/ucx105"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1086\/208906"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2020.102250"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1080\/13645570902996301"},{"key":"e_1_3_2_40_2","unstructured":"Beijing 2021 Monthly sales tracking report of China's smart speaker equipment market"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1080\/01449299408914616"},{"key":"e_1_3_2_42_2","first-page":"88","volume-title":"Proceedings of Measuring Behavior, Noldus Information Technology, Wageningen","author":"Jsselsteijn W","year":"2008","unstructured":"W Jsselsteijn, W. Van Den Hoogen, and C. Klimmt. 2008. Measuring the experience of digital game enjoyment. In Proceedings of Measuring Behavior, Noldus Information Technology, Wageningen, Netherlands, 88\u201389."},{"key":"e_1_3_2_43_2","unstructured":"Insight and Info. 2019. 2018 China online shopping e-commerce market analysis report - research on industry operation and development prospects."},{"key":"e_1_3_2_44_2","unstructured":"ISO. 1998. ISO 9241\u2014Ergonomic requirements for office work with visual display terminals (VDTs). Part 11: Guidance on Usability . (available from www.iso.org\/iso\/en\/CatalogueListPage.CatalogueList). Geneva Switzerland."},{"key":"e_1_3_2_45_2","unstructured":"ISO\/IEC. 2001. Software engineering - Product quality - Part 1: Quality model. https:\/\/www.iso.org\/standard\/22749.html"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3311956"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2007.12.002"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1089\/cyber.2014.0675"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445579"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1108\/JRIM-01-2018-0022"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2015.05.017"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343413.3377962"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2010.04.006"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1108\/INTR-06-2020-0327"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1080\/10864415.2004.11044299"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106680"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/0147-1767(85)90062-8"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00347"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/585597.585616"},{"issue":"1","key":"e_1_3_2_61_2","first-page":"209","article-title":"Toward a theory of organizational socialization","volume":"1","author":"Van Maanen J.","year":"1979","unstructured":"J. Van Maanen and E. H. Schein. 1979. Toward a theory of organizational socialization. Research in Organizational Behavior 1, 1 (1979), 209\u2013264.","journal-title":"Research in Organizational Behavior"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.2307\/23044045"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.2501\/ijmr-53-6-771-792"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.2307\/256727"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.05.009"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376522"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447679"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300277"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.2752\/175470811X13071166525216"},{"key":"e_1_3_2_70_2","first-page":"1","volume-title":"AMCIS 2017 - America's Conference on Information Systems: A Tradition of Innovation","author":"Nasirian Farzaneh","year":"2017","unstructured":"Farzaneh Nasirian, Mohsen Ahmadian, and One Ki Daniel Lee. 2017. AI-based voice assistant systems: Evaluating from the interaction and trust perspectives. AMCIS 2017 - America's Conference on Information Systems: A Tradition of Innovation (2017), 1\u201310."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bushor.2016.03.004"},{"issue":"3","key":"e_1_3_2_72_2","first-page":"196","article-title":"Adoption of mobile technologies for Chinese consumers","volume":"8","author":"Park J. K.","year":"2007","unstructured":"J. K. Park, S. J. Yang, and X. Lehto. 2007. Adoption of mobile technologies for Chinese consumers. Journal of Electronic Commerce Research 8, 3 (2007), 196\u2013206.","journal-title":"Journal of Electronic Commerce Research"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1057\/s41303-016-0001-6"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053246"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3484221"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11747-007-0040-6"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00309"},{"key":"e_1_3_2_78_2","volume-title":"Experiential Marketing: How to get Customers to Sense, Feel, Think, Act, Relate to your Company and Brands","author":"Schmitt B. H.","year":"1999","unstructured":"B. H. Schmitt. 1999. Experiential Marketing: How to get Customers to Sense, Feel, Think, Act, Relate to your Company and Brands. The Free Press, New York."},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1362\/026725799784870496"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3386867"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451712"},{"key":"e_1_3_2_82_2","first-page":"1","article-title":"What's new? Novelty in consumer research","volume":"39","author":"Shavitt Sharon","year":"2011","unstructured":"Sharon Shavitt and Walter H. Stellner. 2011. What's new? Novelty in consumer research. Advances in Consumer Research 39, (2011), 1\u20136.","journal-title":"Advances in Consumer Research"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2017.02.006"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1509\/jmkg.72.2.99"},{"key":"e_1_3_2_85_2","volume-title":"Basics of Qualitative Research:Techniques and Procedures for Developing Grounded Theory","author":"Strauss A. L.","year":"1998","unstructured":"A. L. Strauss and J. M. Corbin. 1998. Basics of Qualitative Research:Techniques and Procedures for Developing Grounded Theory. Sage, Thousand Oaks."},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.2017.1297642"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300833"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2006.11.003"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2575.2009.00328.x"},{"issue":"3","key":"e_1_3_2_90_2","first-page":"71","article-title":"Enhancing and empowering: Customer experience","volume":"9","author":"Varma R. T. R.","year":"2012","unstructured":"R. T. R. Varma. 2012. Enhancing and empowering: Customer experience. SCMS Journal of Indian Management 9, 3 (2012), 71\u201378.","journal-title":"SCMS Journal of Indian Management"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1080\/1097198X.2010.10856507"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2013\/37.1.02"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.5555\/2017197.2017202"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1080\/1097198X.2010.10856507"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jretai.2008.11.001"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2015.08.008"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.3724\/SP.J.1042.2017.01942"},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.2307\/20721425"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2015.01.008"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622782","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3622782","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:04Z","timestamp":1750178224000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622782"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,29]]},"references-count":98,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3622782"],"URL":"https:\/\/doi.org\/10.1145\/3622782","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,29]]},"assertion":[{"value":"2021-06-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}