{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:45:12Z","timestamp":1785545112991,"version":"3.56.0"},"reference-count":32,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Hum Factors"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Patients with traumatic brain injury are at an increased risk of developing venous thromboembolism. Clinical decision support systems (CDSSs) may improve the use of venous thromboembolism prophylaxis protocols, yet suffer from poor compliance among end users due to a lack of user-centered design.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The objective of this work was to improve the content, design, and workflow integration of a traumatic brain injury\u2013CDSS based on feedback from experts and end users.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n The CDSS was evaluated leveraging a dual usability approach. A set of usability experts (n=3) and trauma providers (n=5) performed heuristic evaluations and usability testing by end users. Data was collected through a triangulation of methods and analyzed using qualitative (thematic) and quantitative (descriptive) analyses.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Among the 145 total issues identified across both methods, 66 issues were found to be unique. Of the 66, a total of 17 issues were found by heuristic evaluations, 43 by usability testing by end users, and 6 were found across both methods. Thematic analysis was conducted on the 66 unique issues, which were further assigned to themes and subsequent subthemes. We identified 13 unique themes. The 3 most prevalent themes of 66 issues were lack of supporting evidence (n=17, 26%), operational barriers arising from the test environment (n=11, 17%), formatting inconsistencies, and lack of following standards (n=8, 12%). The system\u2019s usability scale survey score was 77.5 (SD 16, 95% CI 57.6-97.4), interpreted as an acceptable or good usability range. The mean response score for Single Ease Questions for all tasks was 5.9 (SD 0.53).<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Combining expert and end user\u2013driven usability evaluation methods identified a more comprehensive list of issues. This can facilitate the optimization of the traumatic brain injury\u2013CDSS, resulting in improved usability and care management.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/60268","type":"journal-article","created":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T01:25:08Z","timestamp":1747013108000},"page":"e60268-e60268","source":"Crossref","is-referenced-by-count":1,"title":["Leveraging Dual Usability Methods to Evaluate Clinical Decision Support Among Patients With Traumatic Brain Injury: Mixed Methods Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9432-3086","authenticated-orcid":false,"given":"Rubina F","family":"Rizvi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6620-4956","authenticated-orcid":false,"given":"Sameen","family":"Faisal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6312-0497","authenticated-orcid":false,"given":"Mark","family":"Sussman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3768-7159","authenticated-orcid":false,"given":"Patricia","family":"Mendlick","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-8614-0874","authenticated-orcid":false,"given":"Sam","family":"Brown","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1027-3537","authenticated-orcid":false,"given":"Elizabeth","family":"Lindemann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7018-5261","authenticated-orcid":false,"given":"Sean","family":"Switzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5193-1663","authenticated-orcid":false,"given":"Genevieve B","family":"Melton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8079-5565","authenticated-orcid":false,"given":"Christopher J","family":"Tignanelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,7,30]]},"reference":[{"key":"R1","unstructured":"Get the facts about TBI | concussion | traumatic brain injury. CDC Injury Center. 2023. URL: https:\/\/www.cdc.gov\/traumatic-brain-injury\/data-research\/facts-stats\/?CDC_AAref_Val=https:\/\/www.cdc.gov\/traumaticbraininjury\/get_the_facts.html [Accessed 21-06-2025]"},{"issue":"4","key":"R2","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.jcjq.2019.11.007","article-title":"Implementation of a prophylactic anticoagulation guideline for patients with traumatic brain injury","volume":"46","author":"Tignanelli","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"24","key":"R3","doi-asserted-by":"publisher","first-page":"1601","DOI":"10.1056\/NEJM199412153312401","article-title":"A prospective study of venous thromboembolism after major trauma","volume":"331","author":"Geerts","journal-title":"N Engl J Med"},{"issue":"6","key":"R4","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1001\/archsurg.137.6.696","article-title":"Prospective evaluation of the safety of enoxaparin prophylaxis for venous thromboembolism in patients with intracranial hemorrhagic injuries","volume":"137","author":"Norwood","journal-title":"Arch Surg"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.2147\/JBM.S125209","article-title":"Antithrombotics in trauma: management strategies in the older patients","volume":"8","author":"Wong","journal-title":"J Blood Med"},{"issue":"10","key":"R6","doi-asserted-by":"publisher","first-page":"1821","DOI":"10.1089\/neu.2012.2459","article-title":"Pharmacologic venous thromboembolism prophylaxis after traumatic brain injury: a critical literature review","volume":"29","author":"Phelan","journal-title":"J Neurotrauma"},{"issue":"3","key":"R7","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1097\/TA.0000000000003475","article-title":"American Association for the Surgery of Trauma\/American College of Surgeons-Committee on Trauma Clinical Protocol for inpatient venous thromboembolism prophylaxis after trauma","volume":"92","author":"Yorkgitis","journal-title":"J Trauma Acute Care Surg"},{"issue":"20","key":"R8","doi-asserted-by":"publisher","first-page":"1737","DOI":"10.1089\/neu.2014.3366","article-title":"The Parkland Protocol\u2019s modified Berne-Norwood criteria predict two tiers of risk for traumatic brain injury progression","volume":"31","author":"Pastorek","journal-title":"J Neurotrauma"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1001\/archsurg.2012.2024","article-title":"Improved prophylaxis and decreased rates of preventable harm with the use of a mandatory computerized clinical decision support tool for prophylaxis for venous thromboembolism in trauma","volume":"147","author":"Haut","journal-title":"Arch Surg"},{"issue":"2","key":"R10","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1016\/j.jamcollsurg.2020.04.023","article-title":"Clinical decision support intervention for rib fracture treatment","volume":"231","author":"Macheel","journal-title":"J Am Coll Surg"},{"issue":"12","key":"R11","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.17094","article-title":"Effectiveness of a hospital-based computerized decision support system on clinician recommendations and patient outcomes: a randomized clinical trial","volume":"2","author":"Moja","journal-title":"JAMA Netw Open"},{"key":"R12","unstructured":"Clinical decision support. Agency for Healthcare Research and Quality. 2022. URL: https:\/\/www.ahrq.gov\/cpi\/about\/otherwebsites\/clinical-decision-support\/index.html [Accessed 21-06-2025]"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1097\/SLA.0000000000005853","article-title":"Artificial intelligence-enabled decision support in surgery: state-of-the-art and future directions","volume":"278","author":"Loftus","journal-title":"Ann Surg"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.jamcollsurg.2020.05.023","article-title":"Clinical decision support intervention and time to imaging in older patients with traumatic brain injury","volume":"231","author":"Nguyen","journal-title":"J Am Coll Surg"},{"issue":"21","key":"R15","doi-asserted-by":"publisher","first-page":"2816","DOI":"10.1001\/jama.283.21.2816","article-title":"A clinical decision support system for prevention of venous thromboembolism: effect on physician behavior","volume":"283","author":"Durieux","journal-title":"JAMA"},{"issue":"11","key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/30743","article-title":"Implementation of an anticoagulation practice guideline for COVID-19 via a clinical decision support system in a large academic health system and its evaluation: observational study","volume":"9","author":"Shah","journal-title":"JMIR Med Inform"},{"key":"R17","volume":"2003","author":"Kawamoto","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/58036","article-title":"Benefits of clinical decision support systems for the management of noncommunicable chronic diseases: targeted literature review","volume":"13","author":"Grechuta","journal-title":"Interact J Med Res"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: benefits, risks, and strategies for success","volume":"3","author":"Sutton","journal-title":"NPJ Digit Med"},{"issue":"2","key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/31758","article-title":"Assessing the usability of a clinical decision support system: heuristic evaluation","volume":"9","author":"Cho","journal-title":"JMIR Hum Factors"},{"issue":"3","key":"R21","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1200\/JOP.200017","article-title":"Importance of testing for usability when selecting and implementing an electronic health or medical record system","volume":"6","author":"Corrao","journal-title":"J Oncol Pract"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1186\/s13012-017-0644-2","article-title":"What hinders the uptake of computerized decision support systems in hospitals? A qualitative study and framework for implementation","volume":"12","author":"Liberati","journal-title":"Implement Sci"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.8912","article-title":"Reasons for physicians not adopting clinical decision support systems: critical analysis","volume":"6","author":"Khairat","journal-title":"JMIR Med Inform"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","DOI":"10.2196\/29019","article-title":"Barriers to and facilitators for acceptance of comprehensive clinical decision support system-driven care maps for patients with thoracic trauma: interview study among health care providers and nurses","volume":"9","author":"Jones","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","DOI":"10.1136\/tsaco-2020-000643","article-title":"Venous thromboembolism prophylaxis in the trauma intensive care unit: an American Association for the Surgery of Trauma Critical Care Committee Clinical Consensus Document","volume":"6","author":"Rappold","journal-title":"Trauma Surg Acute Care Open"},{"key":"R26","unstructured":"10 usability heuristics for user interface design. Nielsen Norman Group. 2023. URL: https:\/\/www.nngroup.com\/articles\/ten-usability-heuristics [Accessed 21-06-2025]"},{"key":"R27","unstructured":"Severity ratings for usability problems: article by Jakob Nielsen. Nielsen Norman Group. 2023. URL: https:\/\/www.nngroup.com\/articles\/how-to-rate-the-severity-of-usability-problems [Accessed 21-06-2025]"},{"issue":"7","key":"R28","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","article-title":"The System Usability Scale: past, present, and future","volume":"34","author":"Lewis","journal-title":"Int J Hum-Comput Interact"},{"key":"R29","unstructured":"Sauro J . 10 things to know about the Single Ease Question (SEQ). Measuring U. 2012. URL: https:\/\/measuringu.com\/seq10\/ [Accessed 21-06-2025]"},{"key":"R30","unstructured":"Lewis J Sauro J . How to estimate SUS using the UX-lite. Measuring U. 2021. URL: https:\/\/measuringu.com\/how-to-estimate-sus-with-ux-lite\/ [Accessed 30-07-2025]"},{"issue":"4","key":"R31","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1177\/154193129203600431","article-title":"Usability testing vs. heuristic evaluation: a head-to-head comparison","volume":"36","author":"Bailey","journal-title":"Proc Hum Factors Soc Ann Meet"},{"key":"R32","unstructured":"Desurvire HW . Faster, cheaper!! Are usability inspection methods as effective as empirical testing? In: Usability Inspection Methods. John Wiley & Sons, Inc; 1994:173-202."}],"container-title":["JMIR Human Factors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/humanfactors.jmir.org\/2025\/1\/e60268","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:31:57Z","timestamp":1785537117000},"score":1,"resource":{"primary":{"URL":"https:\/\/humanfactors.jmir.org\/2025\/1\/e60268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,30]]},"references-count":32,"URL":"https:\/\/doi.org\/10.2196\/60268","relation":{},"ISSN":["2292-9495"],"issn-type":[{"value":"2292-9495","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,30]]},"article-number":"v12i4e60268"}}