{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T08:57:40Z","timestamp":1766048260765,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2011,5,7]],"date-time":"2011-05-07T00:00:00Z","timestamp":1304726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2011,5,7]]},"DOI":"10.1145\/1979742.1979788","type":"proceedings-article","created":{"date-parts":[[2011,5,9]],"date-time":"2011-05-09T12:48:29Z","timestamp":1304945309000},"page":"1441-1446","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Weak inter-rater reliability in heuristic evaluation of video games"],"prefix":"10.1145","author":[{"given":"Gareth R.","family":"White","sequence":"first","affiliation":[{"name":"The University of Sussex, Brighton, United Kingdom"}]},{"given":"Pejman","family":"Mirza-babaei","sequence":"additional","affiliation":[{"name":"The University of Sussex, Brighton, United Kingdom"}]},{"given":"Graham","family":"McAllister","sequence":"additional","affiliation":[{"name":"The University of Sussex, Brighton, United Kingdom"}]},{"given":"Judith","family":"Good","sequence":"additional","affiliation":[{"name":"The University of Sussex, Brighton, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2011,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"B. Bailey. Judging the severity of usability issues on web sites: This doesn't work. http:\/\/www.usability.gov\/ articles\/newsletter\/pubs\/102005news.html Last accessed July 9 2010.  B. Bailey. Judging the severity of usability issues on web sites: This doesn't work. http:\/\/www.usability.gov\/ articles\/newsletter\/pubs\/102005news.html Last accessed July 9 2010."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-0353-0_11"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986083"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02774-1_60"},{"key":"e_1_3_2_1_5_1","volume-title":"Evaluating User Experience in Games - Concepts and Methods","author":"Desurvire H.","year":"2010","unstructured":"H. Desurvire and C. Wiberg . User experience design for inexperienced gamers: GAP - game approachability guidelines . In R. Bernhaupt (ed.), Evaluating User Experience in Games - Concepts and Methods , Springer-Verlag ( 2010 ), chapter 8. H. Desurvire and C. Wiberg. User experience design for inexperienced gamers: GAP - game approachability guidelines. In R. Bernhaupt (ed.), Evaluating User Experience in Games - Concepts and Methods, Springer-Verlag (2010), chapter 8."},{"key":"e_1_3_2_1_6_1","first-page":"3","article-title":"Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, &","volume":"35","author":"Faulkner L.","year":"2003","unstructured":"L. Faulkner . Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers 35 , 3 ( 2003 ), 379--383. L. Faulkner. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers 35, 3 (2003), 379--383.","journal-title":"Computers"},{"key":"e_1_3_2_1_7_1","volume-title":"Heuristics and usability guidelines for the creation and evaluation of fun in video games. Department of Telecommunications","author":"Federoff M.","year":"2002","unstructured":"M. Federoff . Heuristics and usability guidelines for the creation and evaluation of fun in video games. Department of Telecommunications , Indiana University , USA , 2002 . http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download? doi=10.1.1.89.8294&rep=rep1&type=pdf, Last accessed 18 February 2011. M. Federoff. Heuristics and usability guidelines for the creation and evaluation of fun in video games. Department of Telecommunications, Indiana University, USA, 2002. http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download? doi=10.1.1.89.8294&rep=rep1&type=pdf, Last accessed 18 February 2011."},{"key":"e_1_3_2_1_8_1","unstructured":"D. Freelon. Recal for ordinal interval and ratio data (OIR). http:\/\/dfreelon.org\/utils\/recalfront\/ recal-oir\/ Last accessed 22 September 2010.  D. Freelon. Recal for ordinal interval and ratio data (OIR). http:\/\/dfreelon.org\/utils\/recalfront\/ recal-oir\/ Last accessed 22 September 2010."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/19312450709336664"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327590IJHC1501_14"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2008.08.005"},{"key":"e_1_3_2_1_12_1","volume-title":"Proc. HCI'07","author":"Hwang W.","year":"2007","unstructured":"W. Hwang and G. Salvendy . What makes evaluators to find more usability problems?: a meta-analysis for individual detection rates . In Proc. HCI'07 , Springer-Verlag ( 2007 ), 499--507. W. Hwang and G. Salvendy. What makes evaluators to find more usability problems?: a meta-analysis for individual detection rates. In Proc. HCI'07, Springer-Verlag (2007), 499--507."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/286498.286737"},{"key":"e_1_3_2_1_14_1","volume-title":"Proc. Human Factors and Ergonomics Society Annual Meeting 42","author":"John B. E.","year":"1998","unstructured":"B. E. John . The evaluator effect in usability studies: Problem detection and severity judgments . Proc. Human Factors and Ergonomics Society Annual Meeting 42 , 5, ( 1998 ), 1336--1340. B. E. John. The evaluator effect in usability studies: Problem detection and severity judgments. Proc. Human Factors and Ergonomics Society Annual Meeting 42, 5, (1998), 1336--1340."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/634067.634127"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1621841.1621856"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929032000173951"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142834"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/191666.191729"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169166"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97281"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357282"}],"event":{"name":"CHI '11: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Vancouver BC Canada","acronym":"CHI '11"},"container-title":["CHI '11 Extended Abstracts on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1979742.1979788","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1979742.1979788","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:05:57Z","timestamp":1750244757000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1979742.1979788"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,5,7]]},"references-count":22,"alternative-id":["10.1145\/1979742.1979788","10.1145\/1979742"],"URL":"https:\/\/doi.org\/10.1145\/1979742.1979788","relation":{},"subject":[],"published":{"date-parts":[[2011,5,7]]},"assertion":[{"value":"2011-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}