{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:37:58Z","timestamp":1776101878984,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445680","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T05:28:50Z","timestamp":1620451730000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Older Adults\u2019 Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems"],"prefix":"10.1145","author":[{"given":"Mingming","family":"Fan","sequence":"first","affiliation":[{"name":"School of Information, Rochester Institute of Technology, United States"}]},{"given":"Qiwen","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Information, Rochester Institute of Technology, United States"}]},{"given":"Vinita","family":"Tibdewal","sequence":"additional","affiliation":[{"name":"School of Information, Rochester Institute of Technology, United States"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/3190862.3190865"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173618"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240838"},{"key":"e_1_3_2_1_4_1","unstructured":"Paul Boersma and David Weenink. [n.d.]. Praat: doing Phonetics by Computer. http:\/\/www.fon.hum.uva.nl\/praat\/.  Paul Boersma and David Weenink. [n.d.]. Praat: doing Phonetics by Computer. http:\/\/www.fon.hum.uva.nl\/praat\/."},{"key":"e_1_3_2_1_5_1","volume-title":"Thinking aloud: Reconciling theory and practice","author":"Boren Ted","year":"2000","unstructured":"Ted Boren and Judith Ramey . 2000. Thinking aloud: Reconciling theory and practice . IEEE transactions on professional communication 43, 3( 2000 ), 261\u2013278. Ted Boren and Judith Ramey. 2000. Thinking aloud: Reconciling theory and practice. IEEE transactions on professional communication 43, 3(2000), 261\u2013278."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858198"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518948"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979267"},{"key":"e_1_3_2_1_9_1","volume-title":"The use of think-aloud to evaluate a navigation structure for a multimedia health and wellness application for older adults and their caregivers. Educational gerontology 41, 12","author":"Chung Jane","year":"2015","unstructured":"Jane Chung , Shomir Chaudhuri , Thai Le , Nai-Ching Chi , Hilaire\u00a0 J Thompson , and George Demiris . 2015. The use of think-aloud to evaluate a navigation structure for a multimedia health and wellness application for older adults and their caregivers. Educational gerontology 41, 12 ( 2015 ), 916\u2013929. Jane Chung, Shomir Chaudhuri, Thai Le, Nai-Ching Chi, Hilaire\u00a0J Thompson, and George Demiris. 2015. The use of think-aloud to evaluate a navigation structure for a multimedia health and wellness application for older adults and their caregivers. Educational gerontology 41, 12 (2015), 916\u2013929."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2010.2052859"},{"key":"e_1_3_2_1_11_1","volume-title":"The handbook of aging and cognition","author":"Craik IM","unstructured":"Fergus\u00a0 IM Craik and Timothy\u00a0 A Salthouse . 2011. The handbook of aging and cognition . Psychology press . Fergus\u00a0IM Craik and Timothy\u00a0A Salthouse. 2011. The handbook of aging and cognition. Psychology press."},{"key":"e_1_3_2_1_12_1","unstructured":"Joseph\u00a0S Dumas Joseph\u00a0S Dumas and Janice Redish. 1999. A practical guide to usability testing. Intellect books.  Joseph\u00a0S Dumas Joseph\u00a0S Dumas and Janice Redish. 1999. A practical guide to usability testing. Intellect books."},{"key":"e_1_3_2_1_13_1","unstructured":"F\u00a0Ci Eisler. 1986. Cycle linguistics: Experiments in spontaneous speech.  F\u00a0Ci Eisler. 1986. Cycle linguistics: Experiments in spontaneous speech."},{"key":"e_1_3_2_1_14_1","volume-title":"Combining concurrent think-aloud protocols and eye-tracking observations: An analysis of verbalizations and silences","author":"Elling Sanne","year":"2012","unstructured":"Sanne Elling , Leo Lentz , and Menno De\u00a0Jong . 2012. Combining concurrent think-aloud protocols and eye-tracking observations: An analysis of verbalizations and silences . IEEE transactions on professional communication 55, 3( 2012 ), 206\u2013220. Sanne Elling, Leo Lentz, and Menno De\u00a0Jong. 2012. Combining concurrent think-aloud protocols and eye-tracking observations: An analysis of verbalizations and silences. IEEE transactions on professional communication 55, 3(2012), 206\u2013220."},{"key":"e_1_3_2_1_15_1","unstructured":"K\u00a0Anders Ericsson and Herbert\u00a0A Simon. 1984. Protocol analysis: Verbal reports as data.the MIT Press.  K\u00a0Anders Ericsson and Herbert\u00a0A Simon. 1984. Protocol analysis: Verbal reports as data.the MIT Press."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385732"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325281"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/3532708.3532711"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934797"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208365"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2016.09.009"},{"key":"e_1_3_2_1_22_1","unstructured":"Nielsen\u00a0Norman Group. [n.d.]. Demonstrate Thinking Aloud by Showing Users a Video. https:\/\/www.nngroup.com\/articles\/thinking-aloud-demo-video\/.  Nielsen\u00a0Norman Group. [n.d.]. Demonstrate Thinking Aloud by Showing Users a Video. https:\/\/www.nngroup.com\/articles\/thinking-aloud-demo-video\/."},{"key":"e_1_3_2_1_23_1","unstructured":"Christian Herbst. 2019. A Python library for voice analysis. https:\/\/homepage.univie.ac.at\/christian.herbst\/python\/namespacepraat_util.html.  Christian Herbst. 2019. A Python library for voice analysis. https:\/\/homepage.univie.ac.at\/christian.herbst\/python\/namespacepraat_util.html."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2015.1065691"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1304_05"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21753-1_5"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2132176.2132220"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10919-008-0055-9"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/10810730802659095"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Edward Loper and Steven Bird. 2002. NLTK: the natural language toolkit. arXiv preprint cs\/0205028(2002).  Edward Loper and Steven Bird. 2002. NLTK: the natural language toolkit. arXiv preprint cs\/0205028(2002).","DOI":"10.3115\/1118108.1118117"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2924"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2011.2182569"},{"key":"e_1_3_2_1_34_1","volume-title":"Usability engineering","author":"Nielsen Jakob","unstructured":"Jakob Nielsen . 1994. Usability engineering . Elsevier . Jakob Nielsen. 1994. Usability engineering. Elsevier."},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of Society for Technical Communication (STC) Summit","author":"Olmsted-Hawala Erica","year":"2012","unstructured":"Erica Olmsted-Hawala and Jennifer\u00a0Romano Bergstrom . 2012 . Think-aloud protocols: Does age make a difference . Proceedings of Society for Technical Communication (STC) Summit , Chicago, IL (2012). Erica Olmsted-Hawala and Jennifer\u00a0Romano Bergstrom. 2012. Think-aloud protocols: Does age make a difference. Proceedings of Society for Technical Communication (STC) Summit, Chicago, IL (2012)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-20892-3_46"},{"key":"e_1_3_2_1_37_1","volume-title":"Honest signals: how they shape our world","author":"Pentland Alex","unstructured":"Alex Pentland . 2010. Honest signals: how they shape our world . MIT press . Alex Pentland. 2010. Honest signals: how they shape our world. MIT press."},{"key":"e_1_3_2_1_38_1","volume-title":"Handbook of usability testing: how to plan, design and conduct effective tests","author":"Rubin Jeffrey","unstructured":"Jeffrey Rubin and Dana Chisnell . 2008. Handbook of usability testing: how to plan, design and conduct effective tests . John Wiley & Sons . Jeffrey Rubin and Dana Chisnell. 2008. Handbook of usability testing: how to plan, design and conduct effective tests. John Wiley & Sons."},{"key":"e_1_3_2_1_39_1","volume-title":"A theory of cognitive aging","author":"Salthouse Timothy","unstructured":"Timothy Salthouse . 2000. A theory of cognitive aging . Elsevier . Timothy Salthouse. 2000. A theory of cognitive aging. Elsevier."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.1190"},{"key":"e_1_3_2_1_41_1","unstructured":"Mr. Tappy. [n.d.]. Mr. Tappy - Mobile UX research made easy.https:\/\/www.mrtappy.com\/.  Mr. Tappy. [n.d.]. Mr. Tappy - Mobile UX research made easy.https:\/\/www.mrtappy.com\/."},{"key":"e_1_3_2_1_42_1","volume-title":"Usability Professionals Association Conference.","author":"Tullis Tom","year":"2002","unstructured":"Tom Tullis , Stan Fleischman , Michelle McNulty , Carrie Cianchette , and Margaret Bergel . 2002 . An empirical comparison of lab and remote usability testing of web sites . In Usability Professionals Association Conference. Tom Tullis, Stan Fleischman, Michelle McNulty, Carrie Cianchette, and Margaret Bergel. 2002. An empirical comparison of lab and remote usability testing of web sites. In Usability Professionals Association Conference."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868914.1868979"},{"key":"e_1_3_2_1_44_1","volume-title":"The impact of two different think-aloud instructions in a usability test: a case of just following orders?Behaviour & Information Technology 33, 2","author":"Zhao Tingting","year":"2014","unstructured":"Tingting Zhao , Sharon McDonald , and Helen\u00a0 M Edwards . 2014. The impact of two different think-aloud instructions in a usability test: a case of just following orders?Behaviour & Information Technology 33, 2 ( 2014 ), 163\u2013183. Tingting Zhao, Sharon McDonald, and Helen\u00a0M Edwards. 2014. The impact of two different think-aloud instructions in a usability test: a case of just following orders?Behaviour & Information Technology 33, 2 (2014), 163\u2013183."}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445680","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445680","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:39Z","timestamp":1750195719000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445680"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":43,"alternative-id":["10.1145\/3411764.3445680","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445680","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}