{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T16:55:10Z","timestamp":1794675310556,"version":"4.9.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,6,10]],"date-time":"2023-06-10T00:00:00Z","timestamp":1686355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>When computers unexpectedly delay or thwart goal attainment, frustration ensues. The central studies of the extent, content, and impact of such frustration were done more than 15 years ago. We revisit this issue after computers have become more mature and computer use is more extensive. To this end, we had 234 crowdsourced participants log the frustrating episodes they experienced with their computers during one hour of computer use. The average time lost due to frustrating episodes was between 11% and 20% of the one-hour period. Though this is less time lost than in the earlier studies, frustration remains a common user experience. While shorter, the median level of frustration during the episodes was high (7 on a 9-point scale). The frustration level correlated with task importance and time lost but was unaffected by computer experience and largely unaffected by computer self-efficacy. In addition, participants indicated that 84% of the episodes had happened before, that 87% could happen again, and that they were unable to resolve 26% of the episodes. This high rate of recurrence and lack of control likely added to the frustration level. The episodes spanned various issues pertaining to performance (49%), usability (36%), and utility (16%).<\/jats:p>","DOI":"10.1145\/3582432","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T07:27:32Z","timestamp":1675063652000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":54,"title":["Frustration: Still a Common User Experience"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0019-8531","authenticated-orcid":false,"given":"Morten","family":"Hertzum","sequence":"first","affiliation":[{"name":"Roskilde University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8742-1198","authenticated-orcid":false,"given":"Kasper","family":"Hornb\u00e6k","sequence":"additional","affiliation":[{"name":"University of Copenhagen"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,6,10]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518804"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolecon.2005.03.020"},{"key":"e_1_3_1_4_2","volume-title":"Proceedings of the Graphics Interface 2022 Conference","author":"Alharbi Ohoud","year":"2022","unstructured":"Ohoud Alharbi and Wolfgang Stuerzlinger. 2022. Auto-cucumber: The impact of autocorrection failures on users\u2019 frustration. In Proceedings of the Graphics Interface 2022 Conference. Canadian Information Processing Society, Mississauga, ON."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.3.396"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/13645579.2018.1563966"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.12.003"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.5.4.323"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.106.1.59"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781410609663"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2004.03.015"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68213-6"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2006.11.016"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119057574.whbva040"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858511"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327590ijhc1703_3"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-9088-8_3"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1037\/10022-000"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1080\/00221309.1990.9917772"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/67880.67884"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1177\/1071181321651054"},{"key":"e_1_3_1_23_2","first-page":"62","article-title":"The Upgrade: Why doctors hate their computers","volume":"12","author":"Gawande Atul","year":"2018","unstructured":"Atul Gawande. 2018. The Upgrade: Why doctors hate their computers. New Yorker November 12 (2018), 62\u201373. Retrieved from https:\/\/www.newyorker.com\/magazine\/2018\/11\/12\/why-doctors-hate-their-computers. Accessed February 12, 2023.","journal-title":"New Yorker"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/1010884.1010885"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2018.e00872"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753556"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1904_2"},{"key":"e_1_3_1_28_2","first-page":"11","volume-title":"DHRS2010: Proceedings of the 10th Danish Human-Computer Interaction Research Symposium. Computer Science Research Report #132","author":"Hertzum Morten","year":"2010","unstructured":"Morten Hertzum. 2010. Frustration: A common user experience. In DHRS2010: Proceedings of the 10th Danish Human-Computer Interaction Research Symposium. Computer Science Research Report #132, Morten Hertzum and Magnus Hansen (Eds.). Roskilde University, Roskilde, DK, 11\u201314."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2021.1876927"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2021.2000642"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2013\/37.2.04"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1103572"},{"issue":"2","key":"e_1_3_1_33_2","first-page":"39","article-title":"Attractive quality and must-be quality","volume":"14","author":"Kano Noriaki","year":"1984","unstructured":"Noriaki Kano. 1984. Attractive quality and must-be quality. Journal of the Japanese Society for Quality Control 14, 2 (1984), 39\u201348.","journal-title":"Journal of the Japanese Society for Quality Control"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2008.07.008"},{"key":"e_1_3_1_35_2","volume-title":"The Trouble with Computers: Usefulness, Usability, and Productivity","author":"Landauer Thomas K.","year":"1995","unstructured":"Thomas K. Landauer. 1995. The Trouble with Computers: Usefulness, Usability, and Productivity. MIT Press, Cambridge, MA."},{"key":"e_1_3_1_36_2","volume-title":"Research Methods in Human-Computer Interaction","author":"Lazar Jonathan","year":"2017","unstructured":"Jonathan Lazar, Jinjuan H. Feng, and Harry Hochheiser. 2017. Research Methods in Human-Computer Interaction (2nd ed.). Morgan Kaufmann, Cambridge, MA.","edition":"2"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2005.06.001"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1080\/01449290500196963"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1085313.1085348"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/765891.765959"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/1297144.1297165"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2379057.2379097"},{"key":"e_1_3_1_43_2","volume-title":"The Platform Economy in Europe: Results from the Second ETUI Internet and Platform Work Survey","author":"Piasna Agnieszka","year":"2022","unstructured":"Agnieszka Piasna, Wouter Zwysen, and Jan Drahokoupil. 2022. The Platform Economy in Europe: Results from the Second ETUI Internet and Platform Work Survey. Working paper 2022.05. European Trade Union Institute, Brussels."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.15346\/hc.v9i1.106"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(97)00019-2"},{"issue":"2","key":"e_1_3_1_46_2","first-page":"212","article-title":"The impact of aging on self-efficacy and computer skill acquisition","volume":"17","author":"Reed Kendra","year":"2005","unstructured":"Kendra Reed, D. Harold Doty, and Douglas R. 2005. The impact of aging on self-efficacy and computer skill acquisition. Journal of Managerial Issues 17, 2 (2005), 212\u2013228. Retrieved from https:\/\/www.jstor.org\/stable\/40604496.","journal-title":"Journal of Managerial Issues"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2013.858460"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.5860\/choice.46-2138"},{"key":"e_1_3_1_49_2","first-page":"13","article-title":"Human factors and usability - Whence and whither?","author":"Shackel Brian","year":"1985","unstructured":"Brian Shackel. 1985. Human factors and usability - Whence and whither? In Software-Erqonomie\u201985: Mensch-Computer-lnteraktion. 13\u201331.","journal-title":"Software-Erqonomie\u201985: Mensch-Computer-lnteraktion"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.4103\/ipj.ipj_81_19"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/332833.332843"},{"key":"e_1_3_1_53_2","volume-title":"Card sorting: Designing Usable Categories","author":"Spencer Donna","year":"2009","unstructured":"Donna Spencer. 2009. Card sorting: Designing Usable Categories. Rosenfeld, New York."},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.annemergmed.2004.04.006"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2724710"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-800935-2.00011-7"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2012.733412"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582432","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582432","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T14:08:48Z","timestamp":1750169328000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,10]]},"references-count":56,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3582432"],"URL":"https:\/\/doi.org\/10.1145\/3582432","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,10]]},"assertion":[{"value":"2022-10-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-09","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}