{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T12:51:28Z","timestamp":1769950288977,"version":"3.49.0"},"reference-count":90,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1170937, 2004316"],"award-info":[{"award-number":["1170937, 2004316"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DP190102627"],"award-info":[{"award-number":["DP190102627"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,11,7]]},"abstract":"<jats:p>Smart speakers have become exceedingly popular and entered many people's homes due to their ability to engage users with natural conversations. Researchers have also looked into using smart speakers as an interface to collect self-reported health data through conversations. Responding to surveys prompted by smart speakers requires users to listen to questions and answer in voice without any visual stimuli. Compared to traditional web-based surveys, where users can see questions and answers visually, voice surveys may be more cognitively challenging. Therefore, to collect reliable survey data, it is important to understand what types of questions are suitable to be administered by smart speakers. We selected five common survey questionnaires and deployed them as voice surveys and web surveys in a within-subject study. Our 24 participants answered questions using voice and web questionnaires in one session. They then repeated the same study session after 1 week to provide a \"retest'' response. Our results suggest that voice surveys have comparable reliability to web surveys. We find that, when using 5-point or 7-point scales, voice surveys take about twice as long as web surveys. Based on objective measurements, such as response agreement and test-retest reliability, and subjective evaluations of user experience, we recommend that researchers consider adopting the binary scale and 5-point numerical scales for voice surveys on smart speakers.<\/jats:p>","DOI":"10.1145\/3555606","type":"journal-article","created":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T22:59:06Z","timestamp":1668207546000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Understanding How to Administer Voice Surveys through Smart Speakers"],"prefix":"10.1145","volume":"6","author":[{"given":"Jing","family":"Wei","sequence":"first","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiwei","family":"Jiang","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaofan","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Difeng","family":"Yu","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge","family":"Goncalves","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tilman","family":"Dingler","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vassilis","family":"Kostakos","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. WaveNet: A generative model for raw audio. https:\/\/deepmind.com\/blog\/article\/wavenet-generative-modelraw-audio [n.d.]. WaveNet: A generative model for raw audio. https:\/\/deepmind.com\/blog\/article\/wavenet-generative-modelraw-audio"},{"key":"e_1_2_1_2_1","volume-title":"The SAGE encyclopedia of communication research methods","author":"Allen Mike","unstructured":"Mike Allen . 2017. The SAGE encyclopedia of communication research methods . Sage Publications . Mike Allen. 2017. The SAGE encyclopedia of communication research methods. Sage Publications."},{"key":"e_1_2_1_3_1","volume-title":"Information transmission in the survey interview: Number of response categories and the reliability of attitude measurement. Sociological methodology","author":"Alwin Duane F","year":"1992","unstructured":"Duane F Alwin . 1992. Information transmission in the survey interview: Number of response categories and the reliability of attitude measurement. Sociological methodology ( 1992 ), 83--118. Duane F Alwin. 1992. Information transmission in the survey interview: Number of response categories and the reliability of attitude measurement. Sociological methodology (1992), 83--118."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11162-011-9251-2"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264901"},{"key":"e_1_2_1_6_1","unstructured":"John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189 194 (1996) 4--7. John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189 194 (1996) 4--7."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1108\/03090569810243776"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102410"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411810"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2442882.2442891"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 5, CSCW1","author":"Cheng Ti-Chung","year":"2021","unstructured":"Ti-Chung Cheng , Tiffany Wenting Li , Yi-Hung Chou , Karrie Karahalios , and Hari Sundaram . 2021 . \" I can show what I really like.\" Eliciting Preferences via Quadratic Voting . Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--43. Ti-Chung Cheng, Tiffany Wenting Li, Yi-Hung Chou, Karrie Karahalios, and Hari Sundaram. 2021. \" I can show what I really like.\" Eliciting Preferences via Quadratic Voting. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--43."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/23337214211005869"},{"key":"e_1_2_1_13_1","first-page":"377","article-title":"Speech data entry: results of a test of voice recognition for survey data collection","volume":"8","author":"Clayton Richard L","year":"1992","unstructured":"Richard L Clayton and Debbie LS Winter . 1992 . Speech data entry: results of a test of voice recognition for survey data collection . JOURNAL OF OFFICIAL STATISTICS-STOCKHOLM- 8 (1992), 377 -- 377 . Richard L Clayton and Debbie LS Winter. 1992. Speech data entry: results of a test of voice recognition for survey data collection. JOURNAL OF OFFICIAL STATISTICS-STOCKHOLM- 8 (1992), 377--377.","journal-title":"JOURNAL OF OFFICIAL STATISTICS-STOCKHOLM-"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/147078530805000106"},{"key":"e_1_2_1_15_1","volume-title":"Audio-computer interviewing to measure risk behaviour for HIV among injecting drug users: a quasi-randomised trial. The Lancet 353, 9165","author":"Des Jarlais Don C","year":"1999","unstructured":"Don C Des Jarlais , Denise Paone , Judith Milliken , Charles F Turner , Heather Miller , James Gribble , Qiuhu Shi , Holly Hagan , and Samuel R Friedman . 1999. Audio-computer interviewing to measure risk behaviour for HIV among injecting drug users: a quasi-randomised trial. The Lancet 353, 9165 ( 1999 ), 1657--1661. Don C Des Jarlais, Denise Paone, Judith Milliken, Charles F Turner, Heather Miller, James Gribble, Qiuhu Shi, Holly Hagan, and Samuel R Friedman. 1999. Audio-computer interviewing to measure risk behaviour for HIV among injecting drug users: a quasi-randomised trial. The Lancet 353, 9165 (1999), 1657--1661."},{"key":"e_1_2_1_16_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_2_1_17_1","volume-title":"Assessing well-being","author":"Diener Ed","unstructured":"Ed Diener , Derrick Wirtz , Robert Biswas-Diener , William Tov , Chu Kim-Prieto , Dong-won Choi, and Shigehiro Oishi . 2009. New measures of well-being . In Assessing well-being . Springer , 247--266. Ed Diener, Derrick Wirtz, Robert Biswas-Diener, William Tov, Chu Kim-Prieto, Dong-won Choi, and Shigehiro Oishi. 2009. New measures of well-being. In Assessing well-being. Springer, 247--266."},{"key":"e_1_2_1_18_1","volume-title":"Survey mode as a source of instability in responses across surveys. Field methods 17, 1","author":"Dillman Don A","year":"2005","unstructured":"Don A Dillman and Leah Melani Christian . 2005. Survey mode as a source of instability in responses across surveys. Field methods 17, 1 ( 2005 ), 30--52. Don A Dillman and Leah Melani Christian. 2005. Survey mode as a source of instability in responses across surveys. Field methods 17, 1 (2005), 30--52."},{"key":"e_1_2_1_19_1","volume-title":"Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Social science research 38, 1","author":"Dillman Don A","year":"2009","unstructured":"Don A Dillman , Glenn Phelps , Robert Tortora , Karen Swift , Julie Kohrell , Jodi Berck , and Benjamin L Messer . 2009. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Social science research 38, 1 ( 2009 ), 1--18. Don A Dillman, Glenn Phelps, Robert Tortora, Karen Swift, Julie Kohrell, Jodi Berck, and Benjamin L Messer. 2009. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Social science research 38, 1 (2009), 1--18."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0041-1726510"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381002"},{"key":"e_1_2_1_22_1","volume-title":"Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sexually transmitted infections 81, 5","author":"Ghanem Khalil G","year":"2005","unstructured":"Khalil G Ghanem , Heidi E Hutton , Jonathan M Zenilman , Rebecca Zimba , and Emily J Erbelding . 2005. Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sexually transmitted infections 81, 5 ( 2005 ), 421--425. Khalil G Ghanem, Heidi E Hutton, Jonathan M Zenilman, Rebecca Zimba, and Emily J Erbelding. 2005. Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sexually transmitted infections 81, 5 (2005), 421--425."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/002224378402100406"},{"key":"e_1_2_1_24_1","volume-title":"Problematic mobile phone use: Validity and reliability of the Problematic Use of Mobile Phone (PUMP) Scale in a German sample. Addictive behaviors reports 12","author":"Graben Katharina","year":"2020","unstructured":"Katharina Graben , Bettina K Doering , Franziska Jeromin , and Antonia Barke . 2020. Problematic mobile phone use: Validity and reliability of the Problematic Use of Mobile Phone (PUMP) Scale in a German sample. Addictive behaviors reports 12 ( 2020 ), 100297. Katharina Graben, Bettina K Doering, Franziska Jeromin, and Antonia Barke. 2020. Problematic mobile phone use: Validity and reliability of the Problematic Use of Mobile Phone (PUMP) Scale in a German sample. Addictive behaviors reports 12 (2020), 100297."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376320"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Allyson L Holbrook Melanie C Green and Jon A Krosnick. 2003. Telephone versus face-to-face interviewing of national probability samples with long questionnaires: Comparisons of respondent satisficing and social desirability response bias. Public opinion quarterly 67 1 (2003) 79--125. Allyson L Holbrook Melanie C Green and Jon A Krosnick. 2003. Telephone versus face-to-face interviewing of national probability samples with long questionnaires: Comparisons of respondent satisficing and social desirability response bias. Public opinion quarterly 67 1 (2003) 79--125.","DOI":"10.1086\/346010"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274345"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. Association for Computing Machinery","author":"Jiang Jiepu","year":"2013","unstructured":"Jiepu Jiang , Wei Jeng , and Daqing He . 2013 . How do users respond to voice input errors? Lexical and phonetic query reformulation in voice search . In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. Association for Computing Machinery , New York, NY, USA, 143--152. Jiepu Jiang, Wei Jeng, and Daqing He. 2013. How do users respond to voice input errors? Lexical and phonetic query reformulation in voice search. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. Association for Computing Machinery, New York, NY, USA, 143--152."},{"key":"e_1_2_1_29_1","volume-title":"Himanshu Himanshu, et al.","author":"Khullar Aman","year":"2021","unstructured":"Aman Khullar , Priyadarshi Hitesh , Shoaib Rahman , Deepak Kumar , Rachit Pandey , Praveen Kumar , Rajeshwari Tripathi , Prince Prince , Ankit Akash Jha , Himanshu Himanshu, et al. 2021 . Costs and Benefits of Conducting Voice-based Surveys Versus Keypress-based Surveys on Interactive Voice Response Systems. In ACM SIGCAS Conference on Computing and Sustainable Societies. Association for Computing Machinery , New York, NY, USA, 288--298. Aman Khullar, Priyadarshi Hitesh, Shoaib Rahman, Deepak Kumar, Rachit Pandey, Praveen Kumar, Rajeshwari Tripathi, Prince Prince, Ankit Akash Jha, Himanshu Himanshu, et al. 2021. Costs and Benefits of Conducting Voice-based Surveys Versus Keypress-based Surveys on Interactive Voice Response Systems. In ACM SIGCAS Conference on Computing and Sustainable Societies. Association for Computing Machinery, New York, NY, USA, 288--298."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300316"},{"key":"e_1_2_1_31_1","volume-title":"Loup Ventures says 75% of U.S. households will have smart speakers by","author":"Kinsella Bret","year":"2025","unstructured":"Bret Kinsella . 2019. Loup Ventures says 75% of U.S. households will have smart speakers by 2025 , Google to surpass Amazon in market share. https:\/\/voicebot.ai\/2019\/06\/18\/loup-ventures-says-75-of-u-s-households-will-have-smartspeakers-by-2025-google-to-surpass-amazon-in-market-share\/ Bret Kinsella. 2019. Loup Ventures says 75% of U.S. households will have smart speakers by 2025, Google to surpass Amazon in market share. https:\/\/voicebot.ai\/2019\/06\/18\/loup-ventures-says-75-of-u-s-households-will-have-smartspeakers-by-2025-google-to-surpass-amazon-in-market-share\/"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196784"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1915768117"},{"key":"e_1_2_1_34_1","volume-title":"Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied cognitive psychology 5, 3","author":"Krosnick Jon A","year":"1991","unstructured":"Jon A Krosnick . 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied cognitive psychology 5, 3 ( 1991 ), 213--236. Jon A Krosnick. 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied cognitive psychology 5, 3 (1991), 213--236."},{"key":"e_1_2_1_35_1","volume-title":"The Palgrave handbook of survey research","author":"Krosnick Jon A","unstructured":"Jon A Krosnick . 2018. Questionnaire design . In The Palgrave handbook of survey research . Springer , 439--455. Jon A Krosnick. 2018. Questionnaire design. In The Palgrave handbook of survey research. Springer, 439--455."},{"key":"e_1_2_1_36_1","volume-title":"Comparisons of party identification and policy preferences: The impact of survey question format. American Journal of Political Science","author":"Krosnick Jon A","year":"1993","unstructured":"Jon A Krosnick and Matthew K Berent . 1993. Comparisons of party identification and policy preferences: The impact of survey question format. American Journal of Political Science ( 1993 ), 941--964. Jon A Krosnick and Matthew K Berent. 1993. Comparisons of party identification and policy preferences: The impact of survey question format. American Journal of Political Science (1993), 941--964."},{"key":"e_1_2_1_37_1","volume-title":"Satisficing in surveys: Initial evidence. New directions for evaluation","author":"Krosnick Jon A","year":"1996","unstructured":"Jon A Krosnick , Sowmya Narayan , and Wendy R Smith . 1996. Satisficing in surveys: Initial evidence. New directions for evaluation 1996 , 70 (1996), 29--44. Jon A Krosnick, Sowmya Narayan, and Wendy R Smith. 1996. Satisficing in surveys: Initial evidence. New directions for evaluation 1996, 70 (1996), 29--44."},{"key":"e_1_2_1_38_1","volume-title":"The measurement of observer agreement for categorical data. biometrics","author":"Richard Landis J","year":"1977","unstructured":"J Richard Landis and Gary G Koch . 1977. The measurement of observer agreement for categorical data. biometrics ( 1977 ), 159--174. J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159--174."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327590ijhc1903_4"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1926180.1926183"},{"key":"e_1_2_1_41_1","volume-title":"A technique for the measurement of attitudes. Archives of psychology","author":"Likert Rensis","year":"1932","unstructured":"Rensis Likert . 1932. A technique for the measurement of attitudes. Archives of psychology ( 1932 ). Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of psychology (1932)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376616"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","first-page":"e0190902","DOI":"10.1371\/journal.pone.0190902","article-title":"Survey research with a random digit dial national mobile phone sample in Ghana: methods and sample quality","volume":"13","author":"L'Engle Kelly","year":"2018","unstructured":"Kelly L'Engle , Eunice Sefa , Edward Akolgo Adimazoya , Emmanuel Yartey , Rachel Lenzi , Cindy Tarpo , Nii Lante Heward-Mills , Katherine Lew , and Yvonne Ampeh . 2018 . Survey research with a random digit dial national mobile phone sample in Ghana: methods and sample quality . PloS one 13 , 1 (2018), e0190902 . Kelly L'Engle, Eunice Sefa, Edward Akolgo Adimazoya, Emmanuel Yartey, Rachel Lenzi, Cindy Tarpo, Nii Lante Heward-Mills, Katherine Lew, and Yvonne Ampeh. 2018. Survey research with a random digit dial national mobile phone sample in Ghana: methods and sample quality. PloS one 13, 1 (2018), e0190902.","journal-title":"PloS one"},{"key":"e_1_2_1_44_1","volume-title":"Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers","author":"Maharjan Raju","unstructured":"Raju Maharjan , Per B\u00e6kgaard , and Jakob E Bardram . 2019. \" Hear me out\" smart speaker based conversational agent to monitor symptoms in mental health. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers . Association for Computing Machinery , New York, NY, USA , 929--933. Raju Maharjan, Per B\u00e6kgaard, and Jakob E Bardram. 2019. \" Hear me out\" smart speaker based conversational agent to monitor symptoms in mental health. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, New York, NY, USA, 929--933."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3469595.3469600"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531673"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675221"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1123\/jsep.26.2.191"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1086\/317989"},{"key":"e_1_2_1_50_1","volume-title":"Measuring problematic mobile phone use: development and preliminary psychometric properties of the PUMP scale. Journal of addiction 2013","author":"Merlo Lisa J","year":"2013","unstructured":"Lisa J Merlo , Amanda M Stone , and Alex Bibbey . 2013. Measuring problematic mobile phone use: development and preliminary psychometric properties of the PUMP scale. Journal of addiction 2013 ( 2013 ). Lisa J Merlo, Amanda M Stone, and Alex Bibbey. 2013. Measuring problematic mobile phone use: development and preliminary psychometric properties of the PUMP scale. Journal of addiction 2013 (2013)."},{"key":"e_1_2_1_51_1","volume-title":"Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods?","author":"Miller Elizabeth T","year":"2009","unstructured":"Elizabeth T Miller , Dan J Neal , Lisa J Roberts , John S Boer , Sally O Cresskr , Jane Metrik , and G Alan Marlatt . 2009. Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods? ( 2009 ). Elizabeth T Miller, Dan J Neal, Lisa J Roberts, John S Boer, Sally O Cresskr, Jane Metrik, and G Alan Marlatt. 2009. Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods? (2009)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173580"},{"key":"e_1_2_1_53_1","volume-title":"The measurement of meaning. Number 47","author":"Osgood Charles Egerton","unstructured":"Charles Egerton Osgood , George J Suci , and Percy H Tannenbaum . 1957. The measurement of meaning. Number 47 . University of Illinois press. Charles Egerton Osgood, George J Suci, and Percy H Tannenbaum. 1957. The measurement of meaning. Number 47. University of Illinois press."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCNT45670.2019.8944754"},{"key":"e_1_2_1_55_1","volume-title":"The Oxford handbook of American elections and political behavior","author":"Pasek Josh","unstructured":"Josh Pasek and Jon A Krosnick . 2010. Optimizing survey questionnaire design in political science . In The Oxford handbook of American elections and political behavior . Oxford University Press . Josh Pasek and Jon A Krosnick. 2010. Optimizing survey questionnaire design in political science. In The Oxford handbook of American elections and political behavior. Oxford University Press."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518709"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1360-0443.2004.00740.x"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174214"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 3, CSCW","author":"Pradhan Alisha","year":"2019","unstructured":"Alisha Pradhan , Leah Findlater , and Amanda Lazar . 2019 . \" Phantom Friend\" or\" Just a Box with Information\" Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults . Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--21. Alisha Pradhan, Leah Findlater, and Amanda Lazar. 2019. \" Phantom Friend\" or\" Just a Box with Information\" Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--21."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236112.3236130"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451827"},{"key":"e_1_2_1_62_1","volume-title":"Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers","author":"Quiroz Juan C","unstructured":"Juan C Quiroz , Tristan Bongolan , and Kiran Ijaz . 2020. Alexa depression and anxiety self-tests: a preliminary analysis of user experience and trust . In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers . Association for Computing Machinery , New York, NY, USA , 494--496. Juan C Quiroz, Tristan Bongolan, and Kiran Ijaz. 2020. Alexa depression and anxiety self-tests: a preliminary analysis of user experience and trust. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. Association for Computing Machinery, New York, NY, USA, 494--496."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445417"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439318810715"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.107034"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1108\/09564230610667122"},{"key":"e_1_2_1_67_1","volume-title":"Measures of political attitudes","author":"Robinson John P","unstructured":"John P Robinson , Phillip R Shaver , and Lawrence S Wrightsman . 1999. Measures of political attitudes . Academic Press . John P Robinson, Phillip R Shaver, and Lawrence S Wrightsman. 1999. Measures of political attitudes. Academic Press."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1086\/268973"},{"key":"e_1_2_1_69_1","volume-title":"Four Years in Review: Statistical Practices of Likert Scales in Human-Robot Interaction Studies. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction","author":"Schrum Mariah L.","unstructured":"Mariah L. Schrum , Michael Johnson , Muyleng Ghuy , and Matthew C. Gombolay . 2020 . Four Years in Review: Statistical Practices of Likert Scales in Human-Robot Interaction Studies. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction ( Cambridge, United Kingdom) (HRI '20). Association for Computing Machinery, New York, NY, USA, 43--52. https:\/\/doi.org\/10.1145\/3371382.3380739 10.1145\/3371382.3380739 Mariah L. Schrum, Michael Johnson, Muyleng Ghuy, and Matthew C. Gombolay. 2020. Four Years in Review: Statistical Practices of Likert Scales in Human-Robot Interaction Studies. In Companion of the 2020 ACM\/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI '20). Association for Computing Machinery, New York, NY, USA, 43--52. https:\/\/doi.org\/10.1145\/3371382.3380739"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.2350050304"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTD.2007.4937399"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439311404508"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1177\/0081175015570096"},{"key":"e_1_2_1_74_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/110381299443807","article-title":"The ADL taxonomy-from individual categorical data to ordinal categorical data","volume":"6","author":"Sonn Ulla","year":"1999","unstructured":"Ulla Sonn , Kristina T\u00f6rnquist , and Elisabeth Svensson . 1999 . The ADL taxonomy-from individual categorical data to ordinal categorical data . Scandinavian Journal of Occupational Therapy 6 , 1 (jan 1999), 11--20. https:\/\/doi.org\/10.1080\/ 110381299443807 Ulla Sonn, Kristina T\u00f6rnquist, and Elisabeth Svensson. 1999. The ADL taxonomy-from individual categorical data to ordinal categorical data. Scandinavian Journal of Occupational Therapy 6, 1 (jan 1999), 11--20. https:\/\/doi.org\/10.1080\/ 110381299443807","journal-title":"Scandinavian Journal of Occupational Therapy"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1287\/mksc.8.3.205"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449210"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-7916(94)00072-T"},{"key":"e_1_2_1_78_1","volume-title":"Cognitive processes underlying context effects in attitude measurement. Psychological bulletin 103, 3","author":"Tourangeau Roger","year":"1988","unstructured":"Roger Tourangeau and Kenneth A Rasinski . 1988. Cognitive processes underlying context effects in attitude measurement. Psychological bulletin 103, 3 ( 1988 ), 299. Roger Tourangeau and Kenneth A Rasinski. 1988. Cognitive processes underlying context effects in attitude measurement. Psychological bulletin 103, 3 (1988), 299."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145386"},{"key":"e_1_2_1_80_1","volume-title":"Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280, 5365","author":"Turner Charles F","year":"1998","unstructured":"Charles F Turner , Leighton Ku , Susan M Rogers , Laura D Lindberg , Joseph H Pleck , and Freya L Sonenstein . 1998. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280, 5365 ( 1998 ), 867--873. Charles F Turner, Leighton Ku, Susan M Rogers, Laura D Lindberg, Joseph H Pleck, and Freya L Sonenstein. 1998. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280, 5365 (1998), 867--873."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123988"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449239"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376561"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494965"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517432"},{"key":"e_1_2_1_86_1","volume-title":"Examining the psychometric properties of the behavioral regulation in exercise questionnaire. Measurement in physical education and exercise science 6, 1","author":"Wilson Philip M","year":"2002","unstructured":"Philip M Wilson , Wendy M Rodgers , and Shawn N Fraser . 2002. Examining the psychometric properties of the behavioral regulation in exercise questionnaire. Measurement in physical education and exercise science 6, 1 ( 2002 ), 1--21. Philip M Wilson, Wendy M Rodgers, and Shawn N Fraser. 2002. Examining the psychometric properties of the behavioral regulation in exercise questionnaire. Measurement in physical education and exercise science 6, 1 (2002), 1--21."},{"key":"e_1_2_1_87_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1111\/j.1751-9861.2006.tb00021.x","article-title":"?It's Who I Am.. . Really!'The importance of integrated regulation in exercise contexts 1","volume":"11","author":"Loitz Christina C","year":"2006","unstructured":"PhilipMWilson,WendyMRodgers, Christina C Loitz , and Giulia Scime . 2006 . ?It's Who I Am.. . Really!'The importance of integrated regulation in exercise contexts 1 . Journal of Applied Biobehavioral Research 11 , 2 (2006), 79 -- 104 . PhilipMWilson,WendyMRodgers, Christina C Loitz, and Giulia Scime. 2006. ?It's Who I Am.. . Really!'The importance of integrated regulation in exercise contexts 1. Journal of Applied Biobehavioral Research 11, 2 (2006), 79--104.","journal-title":"Journal of Applied Biobehavioral Research"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381804"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376810"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfr009"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555606","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555606","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:03Z","timestamp":1750182543000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":90,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2022,11,7]]}},"alternative-id":["10.1145\/3555606"],"URL":"https:\/\/doi.org\/10.1145\/3555606","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}