{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T00:14:44Z","timestamp":1780964084366,"version":"3.54.1"},"reference-count":43,"publisher":"Informa UK Limited","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Human\u2013Computer Interaction"],"published-print":{"date-parts":[[1998,9]]},"DOI":"10.1207\/s15327051hci1303_2","type":"journal-article","created":{"date-parts":[[2005,3,23]],"date-time":"2005-03-23T19:16:17Z","timestamp":1111605377000},"page":"203-261","source":"Crossref","is-referenced-by-count":328,"title":["Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods"],"prefix":"10.1080","volume":"13","author":[{"given":"Wayne D.","family":"Gray","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marilyn C.","family":"Salzman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"301","published-online":{"date-parts":[[2009,12,9]]},"reference":[{"key":"p_1_14","unstructured":"Bailey, G. D. (1992). Iterative methodology anddesigner training in human-computer interface design. Unpublished doctoral dissertation, New Mexico State university, Las Cruces, New Mexico."},{"key":"p_2_15","unstructured":"Bailey, G. D. (1993). Iterative methodology and designer training in human-cornputer interface design. Roceedings of the ACMINTERCHI'93 ConfGrence on Human Factors in Computing 9stemr, 198-205. New York: ACM."},{"key":"p_3_16","unstructured":"Bailey, R. W., Allan, R. W. & Raiello, P. (1992). Usability testingvs. heuristic evaluation: A head-to-head comparison. Roceedings of the Human Factors Society 36th Annual Meeting, 409-413. Santa Monica, CA: Human Factors Society."},{"key":"p_4_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1207\/s15327051hci0501_1","volume":"5","author":"Bovair S.","year":"1990","journal-title":"Human-Computer Interaction"},{"key":"p_5_18","unstructured":"Card, S. K., Moran, T. P. & Newell, A. (1983). Thepsychology oflruman-computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc."},{"key":"p_6_19","unstructured":"Cook, T. D. & Campbell, D. T. (1979). Quari-experimentation: Design and analysis issues forfild settings. Chicago: Rand McNally."},{"key":"p_7_20","doi-asserted-by":"crossref","unstructured":"Cuomo, D. L, & Bowen, C. B. (1994). Understanding usability issues addressed by three user-system interface evaluation techniques. In-ng With Comfitcrs, 686-108.","DOI":"10.1016\/0953-5438(94)90006-X"},{"key":"p_8_21","unstructured":"Desurvire, H. W., Kondziela, J. M. & Atwood, M. E. (1992). What is gained and lost when using evaluation methods other than empirical testing. Roceedings of the HCI'92 Conference on People and Computers VII, 89- 102. New York: Cambridge University Press."},{"issue":"4","key":"p_9_22","first-page":"58","volume":"23","author":"Desurvire N.","year":"1991","journal-title":"SZGCHZ Bulbtin"},{"key":"p_10_23","unstructured":"Desumre, H. & Thomas, J. C. (1993). Enhancing the performance of interface evaluators using non-empirical usability methods. o f t h Hur~ratl Fketors and ErgonomicsSocicty 37th AnntralMccting, 1132-1 1 onica, CA: Human Factors and Ergonomics Society."},{"key":"p_11_24","unstructured":"Franzke, M. (1994). Exploration and exgrrisRcedpefortnancs with dirplay-bawd systems (Ph.D. Dissertation ICS Tech. Rep. 94-07). Boulder: University of Colorado."},{"key":"p_12_25","unstructured":"Franzke, M. (1995). Turnin research into practice: Characteristics of display-based interaction. Rrrrrdiqg oj!! AcM C ' ~ r 9 5 ~ o n . m e on Humtan &&or$ in C0mp\"k'ng +stems, 421-428. New York: ACM."},{"key":"p_13_26","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1207\/s15327051hci0803_3","volume":"8","author":"Gray W. D.","year":"1993","journal-title":"Human-Computer Interaction"},{"key":"p_14_27","unstructured":"Green, T. R. G. (1989). Cognitive dimensions of notations. Proudings of the HCI'89 Confcrmc on PcQple and Computers V; 443-460. Cambridge, England: Cambridge University Press."},{"key":"p_15_28","unstructured":"Jeffries, R., Miller, J. R., Wharton, C. & Uyeda, K. M. (1991). User interface evaluation in the real world: A com arison of four techniques. Rwceedings of the ACM CHI'91 Confcrewe on Human actors J ACM."},{"key":"p_16_29","unstructured":"in Computing J ) s t m , 119-124. New York:"},{"key":"p_17_30","doi-asserted-by":"crossref","unstructured":"John, B. E. (1994). Toward a deeper comparison of methods: A reaction to Nielsen & Phillips and new data. Procedings of the ACM CHZY4 Confrrmce on Human Factors in Computing +stems, 285-286. New York: ACM.","DOI":"10.1145\/259963.260495"},{"key":"p_18_31","doi-asserted-by":"publisher","DOI":"10.1145\/235833.236054"},{"key":"p_19_32","doi-asserted-by":"publisher","DOI":"10.1145\/235833.236050"},{"key":"p_20_33","unstructured":"John, B. E. & Mashyna, M. M. (1997). Evaluating a multimedia authoring tool with Cognitive Walltthrough and think-aloud user studies. Journal ofthe Amm'can Society ofInfirniution Scicncc, 48, 1004-1022."},{"key":"p_21_34","doi-asserted-by":"crossref","unstructured":"Karat, C.M., Campbell, R. & Fiegel, T. (1992). Comparison of empirical testing and walkthrough methods in user interface evaluation. Proceedings of the ACM CH192 Conferme on Human Factors in Computing Systems, 397-404. New York: ACM.","DOI":"10.1145\/142750.142873"},{"key":"p_22_35","unstructured":"Keppel, G. & Saufley, W. H., Jr. (1980). Introduction to &st@ and analysis. San Francisco: Freeman."},{"key":"p_23_36","doi-asserted-by":"crossref","unstructured":"Kieras, D. (1997). Aguide to GOMS model usability evaluationusing NGOMSL. In M. Helander, T. K. Landeuer, & P. Rabhu (Eds.), Handbook ofhurcm-com#uter interaction (2nd ed., pp. 733-766). New York: Elsevier.","DOI":"10.1016\/B978-044481862-1.50097-2"},{"key":"p_24_37","doi-asserted-by":"crossref","unstructured":"Landauer, T. K. (1988). Research methods in human-computer interaction. In M. Helander (Ed.), m e handbook of human-computer interaction (pp. 905-928). New York: Elsevier.","DOI":"10.1016\/B978-0-444-70536-5.50047-6"},{"key":"p_25_38","unstructured":"Lewis, C. & Polson, P. G. (1992). Cognitive wa1kthroughs:A methodfor theory-based evaluation of user interfaces. Paper presented at the Tutorial presented at the CHI'92 Conference on Human Factors in Computing Systems, Monterey, CA."},{"key":"p_26_39","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1177\/001872089403600215","volume":"36","author":"Lewis J. R.","year":"1994","journal-title":"Human Factors"},{"key":"p_27_40","doi-asserted-by":"publisher","DOI":"10.1145\/77481.77486"},{"key":"p_28_41","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1992). Finding usability problems through heuristic evaluation. hoceedings of the ACM CHI'92 Confcrence on Human Factors in Computing Systems, 373-380. New York: ACM.","DOI":"10.1145\/142750.142834"},{"key":"p_29_42","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993). Usability engineering. Boston: Academic.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"p_30_43","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994a). Enhancing the explanatory power of usability heuristics. Proceedings of the ACM CHI'94 ConfGrence on Human Factors in Computing Systems, 152-158. New York: ACM.","DOI":"10.1145\/259963.260333"},{"key":"p_31_44","unstructured":"Nielsen, J. (1994b). Heuristic evaluation. In J. Nielsen & R. L. Mack (Eds.), Usability insfiection methodr (pp. 25-62). New York: Wiley."},{"key":"p_32_45","doi-asserted-by":"crossref","unstructured":"Nielsen, J. & Molich, R. (1990). Heuristic evaluation of user interfaces. Proceedings of the ACM CHI'90 Conference on Human Factors in Computing Systems, 249-256. New York: ACM.","DOI":"10.1145\/97243.97281"},{"key":"p_33_46","doi-asserted-by":"crossref","unstructured":"Nielsen, J. &Phillips, V. L. (1993). Estimating the relative usability of two interfaces: Heuristic, formal, and empirical methods compared. Proceedings of the ACM ZNTERCHI'93 Confcrence on Human Factors in Computing Systems, 214-221. New York: ACM.","DOI":"10.1145\/169059.169173"},{"key":"p_34_47","unstructured":"Olson, J. S. & Moran, T. P. (1996). Mapping the method muddle: Guidance in using methods for user interface design. In M. Rudisill, C. Lewis, P. G. Polson, & T. D. McKay (Eds.), Human-computer intetface designs: Succtss stories, emerging methodr, and real world context (pp. 269-300). San Francisco: Kaufmann."},{"key":"p_35_48","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(92)90039-N"},{"key":"p_36_49","first-page":"673","volume":"97","author":"Poulton E. C.","year":"1982","journal-title":"Psychological Bubtin"},{"key":"p_37_50","unstructured":"Scriven, M. (1977). The methodolo of evaluation. In A. A. Bellack & H. M. Kliebard (Eds.), Curriculum and evaluation gp. 334-371). Berkeley, CA: McCutchan."},{"key":"p_38_51","doi-asserted-by":"crossref","unstructured":"Smilowitz, E. D., Darnell, M. J. & Benson, A. E. (1993). Are we overlooking some usability testing methods? A comparison of lab, beta, and forum tests. Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting, 300-303. Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129303700410"},{"key":"p_39_52","doi-asserted-by":"crossref","unstructured":"Smith, S. L. & Mosier, J. N. (1986). Guidelines for designing user interface software (ESD-TR-86-278). Bedford, MA: MITRE Corporation.","DOI":"10.21236\/ADA177198"},{"key":"p_40_53","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1177\/001872089203400407","volume":"34","author":"Virzi R. A.","year":"1992","journal-title":"Human Factors"},{"key":"p_41_54","doi-asserted-by":"crossref","unstructured":"Virzi, R. A., Sorce, J. F. & Herbert, L. B. (1993). A comparison of three usability evaluation methods: Heuristic, think-aloud, and performance testing. Proceedings of thc Humun Factors and Ergonomics Socitty 37th Annual Meeting, 309-313. Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129303700412"},{"key":"p_42_55","doi-asserted-by":"crossref","unstructured":"Wharton, C., Bradford, J., Jeffries, R. & Franzke, M. (1992). Applying cognitive walkthroughs to more complex user interfaces: Experiences, issues, and recommendations. PrdurdingJ of the ACM CHP92 CO)yCmrn~ on Ilkman Factors in Computing 5)1stmr, 381-388. New York: ACM.","DOI":"10.1145\/142750.142864"},{"key":"p_43_56","unstructured":"Wharton, C., Rieman, J., Lewis, C. & Polson, P. (1994). The cognitive walkthrough method: A practitioner's guide. In J. Nielsen & R. L. Mack (Eds.), Usability i+- tion metbdr. New York: Wiley."}],"container-title":["Human\u2013Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.tandfonline.com\/doi\/pdf\/10.1207\/s15327051hci1303_2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,2,5]],"date-time":"2019-02-05T09:43:47Z","timestamp":1549359827000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.tandfonline.com\/doi\/abs\/10.1207\/s15327051hci1303_2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1998,9]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2009,12,9]]},"published-print":{"date-parts":[[1998,9]]}},"alternative-id":["10.1207\/s15327051hci1303_2"],"URL":"https:\/\/doi.org\/10.1207\/s15327051hci1303_2","relation":{},"ISSN":["0737-0024","1532-7051"],"issn-type":[{"value":"0737-0024","type":"print"},{"value":"1532-7051","type":"electronic"}],"subject":[],"published":{"date-parts":[[1998,9]]}}}