{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T16:24:46Z","timestamp":1787847886827,"version":"build-2784847793"},"reference-count":34,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T00:00:00Z","timestamp":1787788800000},"content-version":"am","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Australian Government Research Training Program (RTP) Scholarship"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Human Factors (HF) principles are essential for safe and effective clinical decision support (CDS), yet existing guidance is fragmented and rarely evaluated in real world settings. A novel, evidence-based, vendor-agnostic HF-informed guideline was developed to address this gap. This study evaluated its perceived usefulness, usability, and impact on CDS design and optimization.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>A 2-phase explanatory sequential mixed methods approach was used. Phase 1 involved a survey of guideline users (n\u2009=\u200925) assessing usefulness, ease of use, satisfaction, and influence on decision-making. Phase 2 included semi-structured interviews (n\u2009=\u200910) to explore real-world application experiences. Quantitative data were analyzed descriptively, and qualitative data were analyzed thematically using a general inductive approach.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Findings were consistently positive. Participants reported that the guideline was easy to use and supported structured, evidence-based CDS decision-making. It improved confidence in selecting and designing CDS interventions, with particular value placed on its consolidated format and step-by-step approach. Suggested enhancements included adding practical tools, worked examples, and case studies to support broader application across contexts.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>This study represents the first real-world evaluation of a consolidated HF-informed CDS guideline, addressing the gap between theory and practice. Results indicate that integrated, accessible HF guidance can strengthen consistency and quality in CDS design, particularly when embedded within routine workflows and governance processes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The guideline is a valuable, practical resource for CDS design and optimization. Future research should assess its impact on post-implementation optimization and include objective measures of usability, safety, and CDS effectiveness to further demonstrate its value.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocag138","type":"journal-article","created":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T11:22:55Z","timestamp":1785151375000},"source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of a clinical decision support design guideline"],"prefix":"10.1093","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3913-9697","authenticated-orcid":false,"given":"Selvana","family":"Awad","sequence":"first","affiliation":[{"name":"Faculty of Medicine and Health, The University of Sydney ,","place":["Australia"]},{"name":"eHealth NSW ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Loveday","sequence":"additional","affiliation":[{"name":"eHealth NSW ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Baillie","sequence":"additional","affiliation":[{"name":"Faculty of Medicine and Health, The University of Sydney ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1645-9126","authenticated-orcid":false,"given":"Melissa T","family":"Baysari","sequence":"additional","affiliation":[{"name":"Faculty of Medicine and Health, The University of Sydney ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,8,27]]},"reference":[{"key":"2026082711491004900_ocag138-B1","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1197\/jamia.M2334","article-title":"A roadmap for national action on clinical decision support","volume":"14","author":"Osheroff","year":"2007","journal-title":"J Am Med Inform Assoc"},{"key":"2026082711491004900_ocag138-B2","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: benefits, risks, and strategies for success","volume":"3","author":"Sutton","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2026082711491004900_ocag138-B3","doi-asserted-by":"crossref","first-page":"e988","DOI":"10.1097\/PTS.0000000000000868","article-title":"Identifying health information technology usability issues contributing to medication errors across medication process stages","volume":"17","author":"Adams","year":"2021","journal-title":"J Patient Saf"},{"key":"2026082711491004900_ocag138-B4","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1080\/00140139.2012.661087","article-title":"A strategy for human factors\/ergonomics: developing the discipline and profession","volume":"55","author":"Dul","year":"2012","journal-title":"Ergonomics"},{"key":"2026082711491004900_ocag138-B5","doi-asserted-by":"publisher","first-page":"105017","DOI":"10.1016\/j.ijmedinf.2023.105017","article-title":"Human factors and safety analysis methods used in the design and redesign of electronic medication management systems: a systematic review","volume":"172","author":"Awad","year":"2023","journal-title":"Int J Med Inform"},{"key":"2026082711491004900_ocag138-B6","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1093\/jamia\/ocz095","article-title":"Medication safety alert fatigue may be reduced via interaction design and clinical role tailoring: a systematic review","volume":"26","author":"Hussain","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2026082711491004900_ocag138-B7","doi-asserted-by":"publisher","first-page":"e73324","DOI":"10.2196\/73324","article-title":"Expert views on criteria for evaluation of human factors methods: qualitative interview study","volume":"13","author":"Awad","year":"2026","journal-title":"JMIR Hum Factors."},{"key":"2026082711491004900_ocag138-B8","doi-asserted-by":"publisher","first-page":"100182","DOI":"10.1016\/j.mcpdig.2024.11.003","article-title":"Development of a human factors-based guideline to support the design, evaluation, and continuous improvement of clinical decision support","volume":"3","author":"Awad","year":"2025","journal-title":"Mayo Clin Proc Digit Health"},{"key":"2026082711491004900_ocag138-B9","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.apergo.2013.04.023","article-title":"Human factors systems approach to healthcare quality and patient safety","volume":"45","author":"Carayon","year":"2014","journal-title":"Appl Ergon"},{"key":"2026082711491004900_ocag138-B10","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1197\/jamia.M1370","article-title":"Ten commandments for effective clinical decision support: Making the practice of evidence-based medicine a reality","volume":"10","author":"Bates","year":"2003","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"2026082711491004900_ocag138-B11","doi-asserted-by":"publisher","first-page":"105091","DOI":"10.1016\/j.ijmedinf.2023.105091","article-title":"Comparison of the validity, perceived usefulness, and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability","volume":"175","author":"Marcilly","year":"2023","journal-title":"Int J Med Inform"},{"key":"2026082711491004900_ocag138-B12","doi-asserted-by":"publisher","first-page":"e332","DOI":"10.1136\/amiajnl-2013-002279","article-title":"Evaluation of medication alerts in electronic health records for compliance with human factors principles","volume":"21","author":"Phansalkar","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2026082711491004900_ocag138-B13","volume-title":"Healthcare Information and Management Systems Society. Improving Outcomes with Clinical Decision Support: An Implementer\u2019s Guide","author":"Osheroff","year":"2012","edition":"2nd ed"},{"key":"2026082711491004900_ocag138-B14","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1136\/jamia.2009.002030","article-title":"Governance for clinical decision support: case studies and recommended practices from leading institutions","volume":"18","author":"Wright","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2026082711491004900_ocag138-B15","doi-asserted-by":"publisher","first-page":"3179","DOI":"10.1007\/s11606-021-06737-1","article-title":"A consensus-based checklist for reporting of survey studies (CROSS)","volume":"36","author":"Sharma","year":"2021","journal-title":"J Gen Intern Med JGIM"},{"key":"2026082711491004900_ocag138-B16","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1093\/intqhc\/mzm042","article-title":"Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups","volume":"19","author":"Tong","year":"2007","journal-title":"Int J Qual Health Care"},{"key":"2026082711491004900_ocag138-B17","first-page":"42","article-title":"The five \u201crights\u201d of clinical decision support","volume":"84","author":"Campbell","year":"2013","journal-title":"J AHIMA"},{"key":"2026082711491004900_ocag138-B18","author":"International Organization for Standardization"},{"key":"2026082711491004900_ocag138-B19","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"key":"2026082711491004900_ocag138-B20","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-5251-5","volume-title":"Organizational Learning: Creating, Retaining and Transferring Knowledge","author":"Argote","year":"2012","edition":"2nd ed"},{"key":"2026082711491004900_ocag138-B21","volume-title":"Diffusion of Innovations","author":"Rogers","year":"2003","edition":"5th ed"},{"key":"2026082711491004900_ocag138-B22","doi-asserted-by":"publisher","first-page":"111830","DOI":"10.1016\/j.jclinepi.2025.111830","article-title":"What makes a good guideline? A systematic review and analysis of 120 clinical practice guidelines in orthogeriatric care and related fields using the AGREE II tool","volume":"184","author":"Fotteler","year":"2025","journal-title":"J Clin Epidemiol"},{"key":"2026082711491004900_ocag138-B23","doi-asserted-by":"publisher","first-page":"E839","DOI":"10.1503\/cmaj.090449","article-title":"AGREE II: advancing guideline development, reporting and evaluation in health care","volume":"182","author":"Brouwers","year":"2010","journal-title":"Can Med Assoc J CMAJ"},{"key":"2026082711491004900_ocag138-B24","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1186\/s13012-024-01389-1","article-title":"Models and frameworks for assessing the implementation of clinical practice guidelines: a systematic review","volume":"19","author":"Freitas de Mello","year":"2024","journal-title":"Implement Sci"},{"key":"2026082711491004900_ocag138-B25","doi-asserted-by":"publisher","first-page":"S116","DOI":"10.7326\/M19-0871","article-title":"Studying workflow and workarounds in EHR-supported work to improve health system performance","volume":"172","author":"Zheng","year":"2020","journal-title":"Ann Intern Med"},{"key":"2026082711491004900_ocag138-B26","doi-asserted-by":"publisher","first-page":"e017572","DOI":"10.1136\/bmjopen-2017-017572","article-title":"Effectiveness of implementation strategies for the improvement of guideline and protocol adherence in emergency care: a systematic review","volume":"8","author":"Ebben","year":"2018","journal-title":"BMJ Open"},{"key":"2026082711491004900_ocag138-B27","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.xjtc.2025.05.005","article-title":"A beginner\u2019s guide to implementation science","volume":"32","author":"de Waard","year":"2025","journal-title":"JTCVS Tech"},{"key":"2026082711491004900_ocag138-B28","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1055\/s-0039-1677907","article-title":"Human factors and usability for health information technology: old and new challenges","volume":"28","author":"Carayon","year":"2019","journal-title":"Yearb Med Inform"},{"key":"2026082711491004900_ocag138-B29","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1055\/s-0042-1748856","article-title":"Clinical decision support stewardship: best practices and techniques to monitor and improve interruptive alerts","volume":"13","author":"Chaparro","year":"2022","journal-title":"Appl Clin Inform"},{"key":"2026082711491004900_ocag138-B30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1055\/s-0039-3402715","article-title":"Reducing alert burden in electronic health records: state of the art recommendations from four health systems","volume":"11","author":"McGreevey","year":"2020","journal-title":"Appl Clin Inform"},{"key":"2026082711491004900_ocag138-B31","doi-asserted-by":"publisher","first-page":"e69333","DOI":"10.2196\/69333","article-title":"Optimizing clinical decision support system functionality by leveraging specific human-computer interaction elements: insights from a systematic review","volume":"12","author":"Azadi","year":"2025","journal-title":"JMIR Hum Factors."},{"key":"2026082711491004900_ocag138-B32","doi-asserted-by":"publisher","DOI":"10.5772\/intechopen.92291","volume-title":"Recent Advances in Digital System Diagnosis and Management of Healthcare","author":"Miller","year":"2020"},{"key":"2026082711491004900_ocag138-B33","author":"U.S. Food & Drug Administration","year":"2018"},{"key":"2026082711491004900_ocag138-B34","doi-asserted-by":"publisher","first-page":"89","DOI":"10.4324\/9781003109945-25","volume-title":"Implementation or Continuous Design? The Contribution of Human Factors and Engineering to Healthcare Quality and Patient Safety","author":"Carayon","year":"2022","edition":"1st ed"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocag138\/70820134\/ocag138.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocag138\/70820134\/ocag138.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T15:49:21Z","timestamp":1787845761000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article\/doi\/10.1093\/jamia\/ocag138\/8771912"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,27]]},"references-count":34,"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocag138","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,27]]},"article-number":"ocag138"}}