{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T17:01:38Z","timestamp":1775581298952,"version":"3.50.1"},"reference-count":48,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2020,1,8]],"date-time":"2020-01-08T00:00:00Z","timestamp":1578441600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p> The goal of the research presented in this paper was to determine if the positively worded System Usability Scale (SUS) can be used in place of the positively and negatively worded standard SUS instrument for the subjective assessment of usability, and whether the results found here replicate those of Sauro and Lewis. <\/jats:p><\/jats:sec><jats:sec><jats:title>Background<\/jats:title><jats:p> Sauro and Lewis\u2019 previous study found no evidence that responses to SUS items differed across the standard SUS and the modified, positively worded version of the SUS when participants assessed websites. This study replicates and extends this work by examining a large number of different systems with larger sample sizes to add to the generalizability of previous findings. <\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p> So that participants could retrospectively assess 20 products, the standard SUS was administered to 268 participants and the positive SUS to 698 participants. SUS scores were computed and the data analyzed using psychometric methods to explore how the two versions of the SUS differed. <\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p> The standard and positive versions of the SUS yielded similar SUS scores. In addition, both versions of the scale demonstrated evidence in support of reliability and validity. <\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p> Either version of the SUS can be used with confidence to measure subjective usability. Furthermore, the scores generated from both versions of the SUS can be directly compared. <\/jats:p><\/jats:sec><jats:sec><jats:title>Applications<\/jats:title><jats:p> In situations where cognitive load, participants\u2019 spoken language, or item consistency with other surveys being given may be a factor, the positive SUS is a viable alternative to the standard SUS. <\/jats:p><\/jats:sec>","DOI":"10.1177\/0018720819881556","type":"journal-article","created":{"date-parts":[[2020,1,8]],"date-time":"2020-01-08T21:52:53Z","timestamp":1578520373000},"page":"987-998","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":43,"title":["Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS)"],"prefix":"10.1177","volume":"63","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0460-179X","authenticated-orcid":false,"given":"Philip","family":"Kortum","sequence":"first","affiliation":[{"name":"Rice University, Houston, TX, USA"}]},{"given":"Claudia Ziegler","family":"Acemyan","sequence":"additional","affiliation":[{"name":"Rice University, Houston, TX, USA"}]},{"given":"Frederick L.","family":"Oswald","sequence":"additional","affiliation":[{"name":"Rice University, Houston, TX, USA"}]}],"member":"179","published-online":{"date-parts":[[2020,1,8]]},"reference":[{"key":"bibr1-0018720819881556","volume-title":"Human Factors","author":"Acemyan C. Z."},{"key":"bibr2-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1147\/sj.384.0551"},{"key":"bibr3-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"bibr4-0018720819881556","first-page":"114","volume":"4","author":"Bangor A.","year":"2009","journal-title":"Journal of Usability Studies"},{"key":"bibr5-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.38.2.143.18840"},{"key":"bibr6-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1002\/job.1960"},{"key":"bibr7-0018720819881556","first-page":"189","volume-title":"Usability evaluation in industry","author":"Brooke J.","year":"1996"},{"key":"bibr8-0018720819881556","first-page":"29","volume":"8","author":"Brooke J.","year":"2013","journal-title":"Journal of Usability Studies"},{"key":"bibr9-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1002\/pfi.21749"},{"key":"bibr10-0018720819881556","volume-title":"Statistical power analysis for the behavioral sciences","author":"Cohen J.","year":"1988","edition":"2"},{"key":"bibr11-0018720819881556","first-page":"2896","volume-title":"Proceedings of the Survey Research Methods Section, American Statistical Association","author":"Colosi R.","year":"2005"},{"key":"bibr12-0018720819881556","first-page":"185","volume":"1","author":"Finstad K.","year":"2006","journal-title":"Journal of Usability Studies"},{"key":"bibr13-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2010.04.004"},{"key":"bibr14-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2009.12.017"},{"key":"bibr15-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/01449290600802031"},{"key":"bibr16-0018720819881556","volume-title":"Usability assessment: How to measure the usability of products, services, and systems","author":"Kortum P. T.","year":"2016"},{"key":"bibr17-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2018.1437865"},{"key":"bibr18-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2012.681221"},{"key":"bibr19-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2017.1336317"},{"key":"bibr20-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2015.1064658"},{"key":"bibr21-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/1094428105284919"},{"key":"bibr22-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1145\/126729.1056077"},{"key":"bibr23-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/154193129203601617"},{"key":"bibr24-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2018.1455307"},{"key":"bibr25-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02806-9_12"},{"key":"bibr26-0018720819881556","first-page":"183","volume":"12","author":"Lewis J. R.","year":"2017","journal-title":"Journal of Usability Studies"},{"issue":"2","key":"bibr27-0018720819881556","first-page":"3","volume":"8","author":"Lund A. M.","year":"2001","journal-title":"Usability Interface"},{"key":"bibr28-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.70.4.810"},{"issue":"2","key":"bibr29-0018720819881556","first-page":"56","volume":"7","author":"McLellan S.","year":"2012","journal-title":"Journal of Usability Studies"},{"key":"bibr30-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1007\/s10869-011-9252-3"},{"key":"bibr31-0018720819881556","volume-title":"Psychometric theory","author":"Nunnally J. C.","year":"1978"},{"key":"bibr32-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1126\/science.aac4716"},{"key":"bibr33-0018720819881556","doi-asserted-by":"publisher","DOI":"10.19173\/irrodl.v16i2.1955"},{"key":"bibr34-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/1745691612465253"},{"issue":"4","key":"bibr35-0018720819881556","first-page":"114","volume":"4","author":"Qasem M. A. N.","year":"2014","journal-title":"Asian Journal of Research in Social Sciences and Humanities"},{"key":"bibr36-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1145\/2493190.2493204"},{"key":"bibr37-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/00224545.1983.9924470"},{"key":"bibr38-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/02602930802618344"},{"key":"bibr39-0018720819881556","first-page":"192","volume":"27","author":"Salazar M. S.","year":"2015","journal-title":"Psicothema"},{"key":"bibr40-0018720819881556","volume-title":"A practical guide to the System Usability Scale: Background, benchmarks & best practices","author":"Sauro J.","year":"2011"},{"key":"bibr41-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979266"},{"key":"bibr42-0018720819881556","volume-title":"Quantifying the user experience: Practical statistics for user research","author":"Sauro J.","year":"2016","edition":"2"},{"key":"bibr43-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/193229681200600208"},{"key":"bibr44-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/014662168500900405"},{"key":"bibr45-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1177\/001316448104100420"},{"key":"bibr46-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0068967"},{"key":"bibr47-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/09500790608668322"},{"key":"bibr48-0018720819881556","doi-asserted-by":"publisher","DOI":"10.1080\/14664200308668290"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720819881556","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0018720819881556","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720819881556","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,2]],"date-time":"2025-03-02T18:25:05Z","timestamp":1740939905000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0018720819881556"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,8]]},"references-count":48,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["10.1177\/0018720819881556"],"URL":"https:\/\/doi.org\/10.1177\/0018720819881556","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,8]]}}}