{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T00:40:47Z","timestamp":1787964047385,"version":"build-2784847793"},"reference-count":19,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Usability testing is valuable for assessing a new tool or system\u2019s usefulness and ease-of-use. Several established methods of usability testing exist, including think-aloud testing. Although usability testing has been shown to be crucial for successful clinical decision support (CDS) tool development, it is often difficult to conduct across multisite development projects due to its time- and labor-intensiveness, cost, and the skills required to conduct the testing.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n Our objective was to develop a new method of usability testing that would enable efficient acquisition and dissemination of results among multiple sites. We sought to address the existing barriers to successfully completing usability testing during CDS tool development.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We combined individual think-aloud testing and focus groups into one session and performed sessions serially across 4 sites (snowball group usability testing) to assess the usability of two CDS tools designed for use by nurses in primary and urgent care settings. We recorded each session and took notes in a standardized format. Each site shared feedback from their individual sessions with the other sites in the study so that they could incorporate that feedback into their tools prior to their own testing sessions.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n The group testing and snowballing components of our new usability testing method proved to be highly beneficial. We identified 3 main benefits of snowball group usability testing. First, by interviewing several participants in a single session rather than individuals over the course of weeks, each site was able to quickly obtain their usability feedback. Second, combining the individualized think-aloud component with a focus group component in the same session helped study teams to more easily notice similarities in feedback among participants and to discuss and act upon suggestions efficiently. Third, conducting usability testing in series across sites allowed study teams to incorporate feedback based on previous sites\u2019 sessions prior to conducting their own testing.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Snowball group usability testing provides an efficient method of obtaining multisite feedback on newly developed tools and systems, while addressing barriers typically associated with traditional usability testing methods. This method can be applied to test a wide variety of tools, including CDS tools, prior to launch so that they can be efficiently optimized.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/55316","type":"journal-article","created":{"date-parts":[[2024,10,30]],"date-time":"2024-10-30T16:06:36Z","timestamp":1730304396000},"page":"e55316-e55316","source":"Crossref","is-referenced-by-count":4,"title":["Snowball Group Usability Testing for Rapid and Iterative Multisite Tool Development: Method Development Study"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0498-8779","authenticated-orcid":false,"given":"Katherine L","family":"Dauber-Decker","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7287-6816","authenticated-orcid":false,"given":"David","family":"Feldstein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2545-8504","authenticated-orcid":false,"given":"Rachel","family":"Hess","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2099-0852","authenticated-orcid":false,"given":"Devin","family":"Mann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4087-5261","authenticated-orcid":false,"given":"Eun Ji","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9857-1826","authenticated-orcid":false,"given":"Pranisha","family":"Gautam-Goyal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1498-2717","authenticated-orcid":false,"given":"Jeffrey","family":"Solomon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1153-6313","authenticated-orcid":false,"given":"Sundas","family":"Khan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2507-128X","authenticated-orcid":false,"given":"Fatima","family":"Malik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8586-9955","authenticated-orcid":false,"given":"Lynn","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6208-5110","authenticated-orcid":false,"given":"Ainsley","family":"Huffman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2573-3847","authenticated-orcid":false,"given":"Paul D","family":"Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4095-1598","authenticated-orcid":false,"given":"Wendy","family":"Halm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2635-8999","authenticated-orcid":false,"given":"Alice","family":"Yuroff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8576-1102","authenticated-orcid":false,"given":"Safiya","family":"Richardson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,2,18]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jbi.2004.01.003","article-title":"Cognitive and usability engineering methods for the evaluation of clinical information systems","volume":"37","author":"Kushniruk","journal-title":"J Biomed Inform"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2017.06.003","article-title":"\u201cThink aloud\u201d and \u201cnear live\u201d usability testing of two complex clinical decision support tools","volume":"106","author":"Richardson","journal-title":"Int J Med Inform"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","DOI":"10.2196\/humanfactors.4537","article-title":"Usability testing of a complex clinical decision support tool in the emergency department: lessons learned","volume":"2","author":"Press","journal-title":"JMIR Hum Factors"},{"issue":"11","key":"R4","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1016\/j.ijmedinf.2012.02.009","article-title":"Integrating usability testing and think-aloud protocol analysis with \u201cnear-live\u201d clinical simulations in evaluating clinical decision support","volume":"81","author":"Li","journal-title":"Int J Med Inform"},{"issue":"2","key":"R5","doi-asserted-by":"publisher","DOI":"10.2196\/21270","article-title":"Developing a decision aid to facilitate informed decision making about invasive mechanical ventilation and lung transplantation among adults with cystic fibrosis: usability testing","volume":"8","author":"Dauber-Decker","journal-title":"JMIR Hum Factors"},{"issue":"6","key":"R6","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1038\/bdj.2008.192","article-title":"Methods of data collection in qualitative research: interviews and focus groups","volume":"204","author":"Gill","journal-title":"Br Dent J"},{"issue":"4","key":"R7","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1016\/j.cptl.2016.03.021","article-title":"Qualitative research methods: why, when, and how to conduct interviews and focus groups in pharmacy research","volume":"8","author":"Rosenthal","journal-title":"Curr Pharm Teach Learn"},{"key":"R8","doi-asserted-by":"crossref","unstructured":"Antibiotic resistance threats in the United States, 2019. Centers for Disease Control and Prevention; Nov2019. [doi: 10.15620\/cdc:82532]","DOI":"10.15620\/cdc:82532"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2147\/IDR.S234610","article-title":"Antimicrobial resistance: implications and costs","volume":"12","author":"Dadgostar","journal-title":"Infect Drug Resist"},{"issue":"12","key":"R10","doi-asserted-by":"publisher","first-page":"894","DOI":"10.1038\/nrmicro2693","article-title":"Tackling antibiotic resistance","volume":"9","author":"Bush","journal-title":"Nat Rev Microbiol"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1038\/s41591-020-01201-9","article-title":"Antibiotic resistance: a call to action to prevent the next epidemic of inequality","volume":"27","author":"Nadimpalli","journal-title":"N Med"},{"issue":"17","key":"R12","doi-asserted-by":"publisher","first-page":"1864","DOI":"10.1001\/jama.2016.4151","article-title":"Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010-2011","volume":"315","author":"Fleming-Dutra","journal-title":"JAMA"},{"issue":"6","key":"R13","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1093\/cid\/ciu422","article-title":"Use of influenza antiviral agents by ambulatory care clinicians during the 2012-2013 influenza season","volume":"59","author":"Havers","journal-title":"Clin Infect Dis"},{"issue":"9","key":"R14","doi-asserted-by":"publisher","first-page":"664","DOI":"10.7326\/0003-4819-113-9-664","article-title":"Clinical prediction rule for pulmonary infiltrates","volume":"113","author":"Heckerling","journal-title":"Ann Intern Med"},{"issue":"11","key":"R15","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1001\/archinternmed.2012.950","article-title":"Large-scale validation of the Centor and McIsaac scores to predict group A streptococcal pharyngitis","volume":"172","author":"Fine","journal-title":"Arch Intern Med"},{"issue":"1","key":"R16","first-page":"75","volume":"158","author":"McIsaac","journal-title":"CMAJ"},{"issue":"3","key":"R17","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1177\/0272989X8100100304","article-title":"The diagnosis of strep throat in adults in the emergency room","volume":"1","author":"Centor","journal-title":"Med Decis Making"},{"key":"R18","unstructured":"Briggs J . Magee SW McAvey MM Conville T , editors. Telephone Triage Protocols for Nursing. 5thed. Wolters Kluwer Health; 2015. ISBN: 9781451194296"},{"key":"R19","unstructured":"Brooke J . SUS: A \u201cquick and dirty\u201d usability scale. In: Jordan PW Thomas B Weerdmeester BA McClelland IL , editors. Usability Evaluation in Industry. Taylor & Francis; 1996. ISBN: 9780429157011"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e55316","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:42:55Z","timestamp":1782841375000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e55316"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,18]]},"references-count":19,"URL":"https:\/\/doi.org\/10.2196\/55316","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,18]]},"article-number":"v9i1e55316"}}