{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T15:53:49Z","timestamp":1774108429669,"version":"3.50.1"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Interact. Comput."],"published-print":{"date-parts":[[2016,11]]},"DOI":"10.1093\/iwc\/iww006","type":"journal-article","created":{"date-parts":[[2016,10,19]],"date-time":"2016-10-19T17:22:37Z","timestamp":1476897757000},"page":"843-861","source":"Crossref","is-referenced-by-count":13,"title":["Group<i>vs<\/i>Individual Web Accessibility Evaluations: Effects with Novice Evaluators"],"prefix":"10.1093","volume":"28","author":[{"given":"Giorgio","family":"Brajnik","sequence":"first","affiliation":[]},{"given":"Markel","family":"Vigo","sequence":"additional","affiliation":[]},{"given":"Yeliz","family":"Yesilada","sequence":"additional","affiliation":[]},{"given":"Simon","family":"Harper","sequence":"additional","affiliation":[]}],"member":"286","published-online":{"date-parts":[[2016,4,25]]},"reference":[{"key":"2016101910222202000_28.6.843.1","doi-asserted-by":"crossref","unstructured":"Abou-Zahra, S. (2008) Web Accessibility Evaluation. In Harper, S. and Yesilada, Y. (eds), Web Accessibility: A Foundation for Research 1st edn, Human-Computer Interaction Series, chapter 7, pp. 79\u2013106. Springer, London. ISBN 978-1-84800-049-0.","DOI":"10.1007\/978-1-84800-050-6_7"},{"key":"2016101910222202000_28.6.843.2","doi-asserted-by":"crossref","unstructured":"Bailey, C. , Pearson, E. and Gkatzidou, V. (2014) Measuring and Comparing the Reliability of the Structured Walkthrough Evaluation Method with Novices and Experts. In Web for All Conference. ACM Press, Seoul, South Korea.","DOI":"10.1145\/2596695.2596696"},{"key":"2016101910222202000_28.6.843.3","first-page":"246","article-title":"The expertise effect on web accessibility evaluation methods","volume":"260","author":"Brajnik","year":"2011","journal-title":"Hum. Comput. Interact."},{"key":"2016101910222202000_28.6.843.4","first-page":"8:1","article-title":"Is accessibility conformance an elusive property? A study of validity and reliability of WCAG 2.0","volume":"20","author":"Brajnik","year":"2012","journal-title":"ACM Trans. Access. Comput."},{"key":"2016101910222202000_28.6.843.5","unstructured":"DRC . (2004) The Web: Access and Inclusion for Disabled People. Technical Report, Disability Rights Commission (DRC), UK."},{"key":"2016101910222202000_28.6.843.6","doi-asserted-by":"crossref","first-page":"379","DOI":"10.3758\/BF03195514","article-title":"Beyond the five-user assumption: benefits of increased sample sizes in usability testing","volume":"350","author":"Faulkner","year":"2003","journal-title":"Behav. Res. Methods Instrum. Comput."},{"key":"2016101910222202000_28.6.843.7","unstructured":"Fischer, D. and Wyatt, T. (2011) The Case for a WCAG-Based Evaluation Scheme with a Graded Rating Scale. In RDWG Symposium on Website Accessibility Metrics, W3C Research Notes. W3C. http:\/\/www.w3.org\/WAI\/RD\/2011\/metrics\/paper7\/."},{"key":"2016101910222202000_28.6.843.8","doi-asserted-by":"crossref","unstructured":"F\u00f8lstad, A. (2008) The Effect of Group Discussions in Usability Inspection: A Pilot Study. In Proc. of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges, Nordichi \u201808, pp. 467\u2013470. ACM, New York, NY, USA. ISBN 978-1-59593-704-9, 10.1145\/1463160.1463221. http:\/\/doi.acm.org\/10.1145\/1463160.1463221.","DOI":"10.1145\/1463160.1463221"},{"key":"2016101910222202000_28.6.843.9","doi-asserted-by":"crossref","unstructured":"Freire, A.P. , Russo, C.M. and Fortes, R.P.M. (2008) A Survey on the Accessibility Awareness of People Involved in Web Development Projects in Brazil. In Proc. of the 2008 International Cross-disciplinary Conference on Web Accessibility (W4A), W4A \u201808, pp. 87\u201396. ACM, New York, NY, USA, ISBN 978-1-60558-153-8, 10.1145\/1368044.1368064. http:\/\/doi.acm.org\/10.1145\/1368044.1368064.","DOI":"10.1145\/1368044.1368064"},{"key":"2016101910222202000_28.6.843.10","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1207\/s15327051hci1303_2","article-title":"Damaged merchandise: a review of experiments that compare usability evaluation methods","volume":"130","author":"Gray","year":"1998","journal-title":"Hum. Comput. Interact."},{"key":"2016101910222202000_28.6.843.11","unstructured":"Henry, S.L. and Grossnickle, M. (2007) Just Ask: Integrating Accessibility Throughout Design. Lulu.com, ISBN 1430319526."},{"key":"2016101910222202000_28.6.843.12","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1207\/S15327590IJHC1304_05","article-title":"The evaluator effect: a chilling fact about usability evaluation methods","volume":"10","author":"Hertzum","year":"2001","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"2016101910222202000_28.6.843.13","doi-asserted-by":"crossref","unstructured":"Hertzum, M. , Jacobsen, N.E. and Molich, R. (2002) Usability Inspections by Groups of Specialists: Perceived Agreement in Spite of Disparate Observations. In CHI 2002 Extended Abstracts on Human Factors in Computing Systems, pp. 662\u2013663. ACM.","DOI":"10.1145\/506443.506534"},{"key":"2016101910222202000_28.6.843.14","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1037\/0033-2909.91.3.517","article-title":"Group versus individual performance: are N+1 heads better than one?","volume":"910","author":"Hill","year":"1982","journal-title":"Psychol. Bull."},{"key":"2016101910222202000_28.6.843.15","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1080\/07370020802278205","article-title":"A study of the evaluator effect in usability testing","volume":"230","author":"Hornb\u00e6k","year":"2008","journal-title":"Hum. Comput. Interact."},{"key":"2016101910222202000_28.6.843.16","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1145\/1735223.1735255","article-title":"Number of people required for usability evaluation: the 10\u00b12 rule","volume":"530","author":"Hwang","year":"2010","journal-title":"Commun. ACM."},{"key":"2016101910222202000_28.6.843.17","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/0010-0285(77)90015-9","article-title":"A process model for missionaries-cannibals and other river-crossing problems","volume":"90","author":"Jeffries","year":"1977","journal-title":"Cognit. Psychol."},{"key":"2016101910222202000_28.6.843.18","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1037\/0021-9010.74.5.834","article-title":"A realistic test of individual versus group consensus decision making","volume":"740","author":"Michaelsen","year":"1989","journal-title":"J. Appl. Psychol."},{"key":"2016101910222202000_28.6.843.19","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/0030-5073(84)90014-X","article-title":"Group versus individual decision making: an investigation of performance measures, decision strategies, and process losses\/gains","volume":"330","author":"Miner","year":"1984","journal-title":"Organ. Behav. Hum. Perform."},{"key":"2016101910222202000_28.6.843.20","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1992) Finding Usability Problems Through Heuristic Evaluation. In Proc. of CHI 1992, pp. 373\u2013380. ACM, Monterey, CA, USA.","DOI":"10.1145\/142750.142834"},{"key":"2016101910222202000_28.6.843.21","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994) Heuristic Evaluation. In Nielsen, J. and Mack, R.L. (eds), Usability Inspection Methods. John Wiley and Sons.","DOI":"10.1145\/259963.260531"},{"key":"2016101910222202000_28.6.843.22","unstructured":"Nielsen, J. (2002) Heuristic evaluation. www.useit.com\/papers\/heuristic."},{"key":"2016101910222202000_28.6.843.23","doi-asserted-by":"crossref","unstructured":"Power, C. , Freire, A. , Petrie, H. and Swallow, D. (2012) Guidelines are Only Half of the Story: Accessibility Problems Encountered by Blind Users On the Web. In Proc. of the SIGCHI conference on human factors in computing systems, CHI 2012, pp. 433\u2013442. ACM.","DOI":"10.1145\/2207676.2207736"},{"key":"2016101910222202000_28.6.843.24","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/2133806.2133824","article-title":"Sample size in usability studies","volume":"550","author":"Schmettow","year":"2012","journal-title":"Commun. ACM."},{"key":"2016101910222202000_28.6.843.25","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1207\/s15327590ijhc0903_2","article-title":"Heuristic walkthroughs: finding the problems without the noise","volume":"90","author":"Sears","year":"1997","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"2016101910222202000_28.6.843.26","unstructured":"Thatcher, J. , Burks, M. , Heilmann, C. , Henry, S. , Kirkpatrick, A. , Lauke, P. , Lawson, B. , Regan, B. , Rutter, R. , Urban, M. and Waddell, C. (2006) Web Accessibility: Web Standards and Regulatory Compliance. FriendsofED."},{"key":"2016101910222202000_28.6.843.27","doi-asserted-by":"crossref","unstructured":"Trewin, S. , Cragun, B. , Swart, C. , Brezin, J. and Richards, J. (2010) Accessibility Challenges and Tool Features: An IBM Web Developer Perspective. In Proc. of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A \u201810, pp. 32:1\u201332:10. ACM, New York, NY, USA, ISBN 978-1-4503-0045-2, 10.1145\/1805986.1806029. http:\/\/doi.acm.org\/10.1145\/1805986.1806029.","DOI":"10.1145\/1805986.1806029"},{"key":"2016101910222202000_28.6.843.28","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.intcom.2011.01.001","article-title":"Automatic web accessibility metrics: where we are and where we can go","volume":"230","author":"Vigo","year":"2011","journal-title":"Interact. Comput."},{"key":"2016101910222202000_28.6.843.29","unstructured":"W3C\/WAI. (2008) Web content accessibility guidelines (wcag) 2.0. World Wide Web Consortium --- Web Accessibility Initiative. www.w3.org\/TR\/WCAG20."},{"key":"2016101910222202000_28.6.843.30","unstructured":"W3C Web. (2002) Accessibility Initiative WAI. Using combined expertise to evaluate web accessibility. http:\/\/www.w3.org\/WAI\/eval\/reviewteams.html. (accessed January 15, 2014)."},{"key":"2016101910222202000_28.6.843.31","unstructured":"W3C Web Accessibility Initiative WAI. (2014) Website accessibility conformance evaluation methodology (WCAG-EM) 1.0. http:\/\/www.w3.org\/TR\/WCAG-EM\/."},{"key":"2016101910222202000_28.6.843.32","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1037\/0021-9010.76.6.803","article-title":"Member competence, group interaction, and group decision making: A longitudinal study","volume":"760","author":"Watson","year":"1991","journal-title":"J. Appl. Psychol."},{"key":"2016101910222202000_28.6.843.33","first-page":"119","article-title":"Exploring perceptions of web accessibility: a survey approach","volume":"340","author":"Yesilada","year":"2014","journal-title":"Behav. Inf. Technol."}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/28\/6\/843\/7920095\/iww006.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,10]],"date-time":"2022-07-10T19:17:34Z","timestamp":1657480654000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article-lookup\/doi\/10.1093\/iwc\/iww006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,25]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,10,19]]},"published-print":{"date-parts":[[2016,11]]}},"alternative-id":["10.1093\/iwc\/iww006"],"URL":"https:\/\/doi.org\/10.1093\/iwc\/iww006","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,4,25]]}}}