{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T08:12:09Z","timestamp":1780992729932,"version":"3.54.1"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"EICS","license":[{"start":{"date-parts":[[2020,6,18]],"date-time":"2020-06-18T00:00:00Z","timestamp":1592438400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2020,6,18]]},"abstract":"<jats:p>This study compared the results of a usability inspection conducted under two separate conditions: An explicit concurrent think-aloud that required explanations and silent working. 12 student analysts inspected two travel websites thinking-aloud and working in silence to produce a set of problem predictions. Overall, the silent working condition produced more initial predictions, but the think-aloud condition yielded a greater proportion of accurate predictions as revealed by falsification testing. The analysts used a range of problem discovery methods with system searching being favoured by the silent working condition and the more active, goal playing discovery method in the think-aloud condition. Thinking-aloud was also associated with a broader spread of knowledge resources.<\/jats:p>","DOI":"10.1145\/3397876","type":"journal-article","created":{"date-parts":[[2020,6,18]],"date-time":"2020-06-18T21:54:38Z","timestamp":1592517278000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["The Impact of Thinking-Aloud on Usability Inspection"],"prefix":"10.1145","volume":"4","author":[{"given":"Sharon","family":"McDonald","sequence":"first","affiliation":[{"name":"University of Sunderland, Sunderland, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gilbert","family":"Cockton","sequence":"additional","affiliation":[{"name":"University of Sunderland, Sunderland, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alastair","family":"Irons","sequence":"additional","affiliation":[{"name":"University of Sunderland, Sunderland, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,6,18]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"439","article-title":"Eliciting self-explanations improves understanding","volume":"18","author":"Chi M.T.H.","year":"1994","unstructured":"Chi , M.T.H. , de Leeuw , N. , Chiu , M.H. and La Vancher , C. ( 1994 ) Eliciting self-explanations improves understanding . Cognitive Science , 18 , 439 -- 477 Chi, M.T.H., de Leeuw, N., Chiu, M.H. and La Vancher, C. (1994) Eliciting self-explanations improves understanding. Cognitive Science, 18, 439--477","journal-title":"Cognitive Science"},{"key":"e_1_2_1_2_1","first-page":"145","volume-title":"Proceedings of the HCI03 Conference on People and Computers XVII","author":"Cockton G","year":"2003","unstructured":"Cockton , G , Woolrych , A , Hall , L , Hindmarch , M. ( 2003 ): Changing Analysts' Tunes: The Surprising Impact of a New Instrument for Usability Inspect . In: Proceedings of the HCI03 Conference on People and Computers XVII , 2003, .pp. 145 -- 162 Cockton, G, Woolrych, A, Hall, L, Hindmarch, M. (2003): Changing Analysts' Tunes: The Surprising Impact of a New Instrument for Usability Inspect. In: Proceedings of the HCI03 Conference on People and Computers XVII , 2003, .pp. 145--162"},{"key":"e_1_2_1_3_1","first-page":"1433","volume-title":"Association for Computing Machinery","author":"Cockton G","year":"2004","unstructured":"Cockton , G , Woolrych , A and Hindmarch , M ( 2004 ) Reconditioned merchandise: extended structured report formats in usability inspection. In: Extended abstracts of the 2004 conference on Human factors and computing systems - CHI '04 . Association for Computing Machinery , New York , pp. 1433 -- 1436 . ISBN 1--58113--703--6 Cockton, G, Woolrych, A and Hindmarch, M (2004) Reconditioned merchandise: extended structured report formats in usability inspection. In: Extended abstracts of the 2004 conference on Human factors and computing systems - CHI '04. Association for Computing Machinery, New York, pp. 1433--1436. ISBN 1--58113--703--6"},{"key":"e_1_2_1_4_1","first-page":"1279","volume-title":"The Human-Computer Interaction Handbook: fundamentals, evolving technologies, and emerging applications [","author":"Cockton G","year":"2012","unstructured":"Cockton , G , Woolrych , A , Hornb\u00e6k , K and Fr\u00f8kj\u00e6r , E ( 2012 ) Inspection-based evaluations . In: The Human-Computer Interaction Handbook: fundamentals, evolving technologies, and emerging applications [ 3 rd edition]. CRC Press , Boca Raton, FL , pp. 1279 -- 1298 . ISBN 978--1439829431 Cockton, G, Woolrych, A, Hornb\u00e6k, K and Fr\u00f8kj\u00e6r, E (2012) Inspection-based evaluations. In: The Human-Computer Interaction Handbook: fundamentals, evolving technologies, and emerging applications [3rd edition]. CRC Press, Boca Raton, FL, pp. 1279--1298. ISBN 978--1439829431","edition":"3"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"e_1_2_1_6_1","first-page":"161","volume-title":"Empirical validation of a usability inspection method for model-driven Web development Journal of Systems and Software, 68 (1)","author":"Fernandez A.","year":"2013","unstructured":"Fernandez , A. , Anrahao , S and Insfran , E ( 2013 ) Empirical validation of a usability inspection method for model-driven Web development Journal of Systems and Software, 68 (1) p 161 -- 186 . Fernandez, A., Anrahao, S and Insfran, E (2013) Empirical validation of a usability inspection method for model-driven Web development Journal of Systems and Software, 68 (1) p161--186."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0021663"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290701773842"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1501_14"},{"key":"e_1_2_1_10_1","volume-title":"Rapid Contextual Design. Morgan Kaufmann","author":"Holtzblatt K.","year":"2004","unstructured":"Holtzblatt , K. , Wendell , J and Wood , S. , ( 2004 ) Rapid Contextual Design. Morgan Kaufmann Holtzblatt, K., Wendell, J and Wood, S., (2004) Rapid Contextual Design. Morgan Kaufmann"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290801939400"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028014.1028016"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2008.08.005"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357197"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2006.10.001"},{"key":"e_1_2_1_16_1","volume-title":"ISO 9241--210:2019 Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems","author":"International Standards Organisation","year":"2019","unstructured":"International Standards Organisation . ( 2019 ) ISO 9241--210:2019 Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems International Standards Organisation. (2019) ISO 9241--210:2019 Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193129804201902"},{"key":"e_1_2_1_18_1","volume-title":"Design method: Instrument, competence or agenda. Multiple Ways to Design Research: Research Cases Reshape the Design Discipline. M. Botta (ed). Swiss Design Network, 280--293","author":"Keinonen T.","year":"2009","unstructured":"Keinonen , T. ( 2009 ). Design method: Instrument, competence or agenda. Multiple Ways to Design Research: Research Cases Reshape the Design Discipline. M. Botta (ed). Swiss Design Network, 280--293 Keinonen, T. (2009). Design method: Instrument, competence or agenda. Multiple Ways to Design Research: Research Cases Reshape the Design Discipline. M. Botta (ed). Swiss Design Network, 280--293"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/014492997119824"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481407"},{"key":"e_1_2_1_21_1","volume-title":"Look Who's Talking: Evaluating the Utility of Interventions During an Interactive Think-Aloud. Interacting with Computers, doi:10.1093\/iwc\/iwv014","author":"McDonald S.","year":"2015","unstructured":"McDonald , S. , Zhao , T and Edwards , H.M . ( 2015 ) Look Who's Talking: Evaluating the Utility of Interventions During an Interactive Think-Aloud. Interacting with Computers, doi:10.1093\/iwc\/iwv014 10.1093\/iwc McDonald, S., Zhao, T and Edwards, H.M. (2015) Look Who's Talking: Evaluating the Utility of Interventions During an Interactive Think-Aloud. Interacting with Computers, doi:10.1093\/iwc\/iwv014"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278154"},{"key":"e_1_2_1_23_1","volume-title":"Fourth Nordichi conference on human computer interaction.","author":"Monahan K","year":"2006","unstructured":"Monahan , K , McDonald , S and Cockton , G ( 2006 ) Modified Contextual Design as a Field Evaluation Method . In: Fourth Nordichi conference on human computer interaction. Monahan, K, McDonald, S and Cockton, G (2006) Modified Contextual Design as a Field Evaluation Method. In: Fourth Nordichi conference on human computer interaction."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142834"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/286498.286741"},{"key":"e_1_2_1_26_1","volume-title":"The Reflective Practitioner: How Professionals Think in Action","author":"Sch\u00f6n D.A.","year":"1983","unstructured":"Sch\u00f6n , D.A. ( 1983 ). The Reflective Practitioner: How Professionals Think in Action . Basic Books Sch\u00f6n, D.A. (1983). The Reflective Practitioner: How Professionals Think in Action. Basic Books"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2006.885865"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0201_1"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of HCI","volume":"2","author":"Woolrych A.","year":"2004","unstructured":"Woolrych , A. , Cockton , G. and Hindmarch , M ., ( 2004 ) Falsification Testing for Usability Inspection Method Assessment . Proceedings of HCI 2004, Volume 2 , eds. A. Dearden and Leon Watts, Research Press International, 137--140, 1--897851--13--8 Woolrych, A., Cockton, G. and Hindmarch, M., (2004) Falsification Testing for Usability Inspection Method Assessment. Proceedings of HCI 2004, Volume 2, eds. A. Dearden and Leon Watts, Research Press International, 137--140, 1--897851--13--8"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2011.555314"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/2630561.2630567"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397876","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397876","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:53Z","timestamp":1750199933000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,18]]},"references-count":31,"journal-issue":{"issue":"EICS","published-print":{"date-parts":[[2020,6,18]]}},"alternative-id":["10.1145\/3397876"],"URL":"https:\/\/doi.org\/10.1145\/3397876","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,18]]},"assertion":[{"value":"2020-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}