{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T07:28:30Z","timestamp":1791876510990,"version":"4.3.4"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T00:00:00Z","timestamp":1628812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100007747","name":"University of Utah","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100007747","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The purpose of the study was to explore the theoretical underpinnings of effective clinical decision support (CDS) factors using the comparative effectiveness results.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We leveraged search results from a previous systematic literature review and updated the search to screen articles published from January 2017 to January 2020. We included randomized controlled trials and cluster randomized controlled trials that compared a CDS intervention with and without specific factors. We used random effects meta-regression procedures to analyze clinician behavior for the aggregate effects. The theoretical model was the Unified Theory of Acceptance and Use of Technology (UTAUT) model with motivational control.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Thirty-four studies were included. The meta-regression models identified the importance of effort expectancy (estimated coefficient\u2009=\u2009\u22120.162; P\u2009=\u2009.0003); facilitating conditions (estimated coefficient\u2009=\u20090.094; P\u2009=\u2009.013); and performance expectancy with motivational control (estimated coefficient\u2009=\u20091.029; P\u2009=\u2009.022). Each of these factors created a significant impact on clinician behavior. The meta-regression model with the multivariate analysis explained a large amount of the heterogeneity across studies (R2\u00a0=\u00a088.32%).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Three positive factors were identified: low effort to use, low controllability, and providing more infrastructure and implementation strategies to support the CDS. The multivariate analysis suggests that passive CDS could be effective if users believe the CDS is useful and\/or social expectations to use the CDS intervention exist.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Overall, a modified UTAUT model that includes motivational control is an appropriate model to understand psychological factors associated with CDS effectiveness and to guide CDS design, implementation, and optimization.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab160","type":"journal-article","created":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T19:09:51Z","timestamp":1626289791000},"page":"2514-2522","source":"Crossref","is-referenced-by-count":17,"title":["A theory-based meta-regression of factors influencing clinical decision support adoption and implementation"],"prefix":"10.1093","volume":"28","author":[{"given":"Siru","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1081-1670","authenticated-orcid":false,"given":"Thomas J","family":"Reese","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4282-9338","authenticated-orcid":false,"given":"Kensaku","family":"Kawamoto","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9954-6799","authenticated-orcid":false,"given":"Guilherme","family":"Del Fiol","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8297-2860","authenticated-orcid":false,"given":"Charlene","family":"Weir","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,8,13]]},"reference":[{"issue":"7494","key":"2021101218235433100_ocab160-B1","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","article-title":"Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success","volume":"330","author":"Kawamoto","year":"2005","journal-title":"BMJ"},{"issue":"12","key":"2021101218235433100_ocab160-B2","doi-asserted-by":"crossref","first-page":"e12","DOI":"10.2105\/AJPH.2014.302164","article-title":"Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis","volume":"104","author":"Moja","year":"2014","journal-title":"Am J Public Health"},{"key":"2021101218235433100_ocab160-B3","doi-asserted-by":"crossref","first-page":"f657","DOI":"10.1136\/bmj.f657","article-title":"Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials","volume":"346","author":"Roshanov","year":"2013","journal-title":"BMJ"},{"issue":"10","key":"2021101218235433100_ocab160-B4","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","article-title":"Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review","volume":"293","author":"Garg","year":"2005","journal-title":"JAMA"},{"issue":"1","key":"2021101218235433100_ocab160-B5","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1186\/s13012-018-0790-1","article-title":"A systematic review of trials evaluating success factors of interventions with computerised clinical decision support","volume":"13","author":"Van de Velde","year":"2018","journal-title":"Implement Sci"},{"key":"2021101218235433100_ocab160-B6","first-page":"361","article-title":"Clinical decision support provided within physician order entry systems: a systematic review of features effective for changing clinician behavior","volume":"14","author":"Kawamoto","year":"2003","journal-title":"AMIA Annu Symp Proc"},{"key":"2021101218235433100_ocab160-B7","first-page":"1","article-title":"Enabling health care decisionmaking through clinical decision support and knowledge management","author":"Lobach","year":"2012","journal-title":"Evid Rep Technol Assess (Full Rep)"},{"key":"2021101218235433100_ocab160-B8","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.jbi.2015.05.007","article-title":"The perils of meta-regression to identify clinical decision support system success factors","volume":"56","author":"Fillmore","year":"2015","journal-title":"J Biomed Inform"},{"issue":"2","key":"2021101218235433100_ocab160-B9","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1080\/17437199.2014.899059","article-title":"Efficacy of physical activity interventions in post-natal populations: systematic review, meta-analysis and content coding of behaviour change techniques","volume":"9","author":"Gilinsky","year":"2015","journal-title":"Health Psychol Rev"},{"issue":"1","key":"2021101218235433100_ocab160-B10","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1080\/17437199.2010.513298","article-title":"Identifying active ingredients in complex behavioural interventions for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: a systematic review","volume":"6","author":"Dombrowski","year":"2012","journal-title":"Health Psychol Rev"},{"issue":"1","key":"2021101218235433100_ocab160-B11","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/s13012-017-0605-9","article-title":"A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems","volume":"12","author":"Atkins","year":"2017","journal-title":"Implement Sci"},{"key":"2021101218235433100_ocab160-B12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/s13012-015-0209-1","article-title":"A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project","volume":"10","author":"Powell","year":"2015","journal-title":"Implement Sci"},{"issue":"7262","key":"2021101218235433100_ocab160-B13","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1136\/bmj.321.7262.694","article-title":"Framework for design and evaluation of complex interventions to improve health","volume":"321","author":"Campbell","year":"2000","journal-title":"BMJ"},{"key":"2021101218235433100_ocab160-B14","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/1748-5908-6-42","article-title":"The behaviour change wheel: a new method for characterising and designing behaviour change interventions","volume":"6","author":"Michie","year":"2011","journal-title":"Implement Sci"},{"issue":"4","key":"2021101218235433100_ocab160-B15","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1111\/j.1464-0597.2008.00341.x","article-title":"From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques","volume":"57","author":"Michie","year":"2008","journal-title":"Appl Psychol"},{"key":"2021101218235433100_ocab160-B16","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User acceptance of information technology: toward a unified view","volume":"27","author":"Venkatesh","year":"2003","journal-title":"MIS Q"},{"issue":"1","key":"2021101218235433100_ocab160-B17","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1186\/s12911-021-01465-2","article-title":"A systematic review of theoretical constructs in CDS literature","volume":"21","author":"Liu","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"key":"2021101218235433100_ocab160-B18","first-page":"1","volume-title":"2020 IEEE International Conference on Healthcare Informatics (ICHI)","author":"Liu","year":"2020"},{"issue":"Suppl 6","key":"2021101218235433100_ocab160-B19","doi-asserted-by":"crossref","first-page":"S7","DOI":"10.1097\/MLR.0b013e3181da3709","article-title":"Defining comparative effectiveness research","volume":"48","author":"Sox","year":"2010","journal-title":"Med Care"},{"issue":"1","key":"2021101218235433100_ocab160-B20","doi-asserted-by":"crossref","first-page":"g7647","DOI":"10.1136\/bmj.g7647","article-title":"Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation","volume":"349","author":"Shamseer","year":"2015","journal-title":"BMJ"},{"key":"2021101218235433100_ocab160-B21","author":"Higgins"},{"issue":"3","key":"2021101218235433100_ocab160-B22","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1111\/j.1741-6787.2005.00032.x","article-title":"Teaching EBP: asking searchable, answerable clinical questions","volume":"2","author":"Fineout-Overholt","year":"2005","journal-title":"Worldviews Evid Based Nurs"},{"issue":"2","key":"2021101218235433100_ocab160-B23","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1197\/jamia.M2334","article-title":"A roadmap for national action on clinical decision support","volume":"14","author":"Osheroff","year":"2007","journal-title":"J Am Med Inform Assoc"},{"key":"2021101218235433100_ocab160-B24","article-title":"RoB 2: a revised tool for assessing risk of bias in randomised trials","volume":"366","author":"Sterne","year":"2019","journal-title":"BMJ"},{"key":"2021101218235433100_ocab160-B25","article-title":"Chapter 23: including variants on randomized trials","author":"Higgins","year":"2021","journal-title":"Cochrane Handbook for Systematic Reviews of Interventions Version 6.2."},{"key":"2021101218235433100_ocab160-B26","author":"Cohen","year":"2013"},{"issue":"7414","key":"2021101218235433100_ocab160-B27","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/bmj.327.7414.557","article-title":"Measuring inconsistency in meta-analyses","volume":"327","author":"Higgins","year":"2003","journal-title":"BMJ"},{"key":"2021101218235433100_ocab160-B28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/0470870168.ch1","article-title":"Publication bias in meta-analysis","volume-title":"Publication Bias in Meta-Analysis.","author":"Rothstein","year":"2006"},{"key":"2021101218235433100_ocab160-B29","doi-asserted-by":"crossref","first-page":"d4002","DOI":"10.1136\/bmj.d4002","article-title":"Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials","volume":"343","author":"Sterne","year":"2011","journal-title":"BMJ"},{"key":"2021101218235433100_ocab160-B30","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-21416-0","volume-title":"Meta-Analysis with R","author":"Schwarzer","year":"2015"},{"issue":"1","key":"2021101218235433100_ocab160-B31","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.artmed.2013.05.002","article-title":"Physicians\u2019 responses to clinical decision support on an intensive care unit: comparison of four different alerting methods","volume":"59","author":"Scheepers-Hoeks","year":"2013","journal-title":"Artif Intell Med"},{"issue":"3","key":"2021101218235433100_ocab160-B32","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.ahj.2008.11.003","article-title":"Patient education and provider decision support to control blood pressure in primary care: a cluster randomized trial","volume":"157","author":"Bosworth","year":"2009","journal-title":"Am Heart J"},{"key":"2021101218235433100_ocab160-B33","first-page":"63","article-title":"Feedback and training to improve use of an electronic prescribing system: a randomised controlled trial","volume":"239","author":"Leung","year":"2017","journal-title":"Stud Health Technol Inform"},{"issue":"6","key":"2021101218235433100_ocab160-B34","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1001\/jama.2016.0275","article-title":"Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial","volume":"315","author":"Meeker","year":"2016","journal-title":"JAMA"},{"issue":"4","key":"2021101218235433100_ocab160-B35","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1136\/qshc.2004.012617","article-title":"A trial of education, prompts, and opinion leaders to improve prescription of lipid modifying therapy by primary care physicians for patients with ischemic heart disease","volume":"14","author":"Bloomfield","year":"2005","journal-title":"Qual Saf Heal Care"},{"issue":"9","key":"2021101218235433100_ocab160-B36","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1001\/archinte.166.9.1009","article-title":"Reducing warfarin medication interactions: an interrupted time series evaluation","volume":"166","author":"Feldstein","year":"2006","journal-title":"Arch Intern Med"},{"issue":"6","key":"2021101218235433100_ocab160-B37","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1111\/j.1532-5415.2006.00734.x","article-title":"Computerized prescribing alerts and group academic detailing to reduce the use of potentially inappropriate medications in older people","volume":"54","author":"Simon","year":"2006","journal-title":"J Am Geriatr Soc"},{"issue":"5","key":"2021101218235433100_ocab160-B38","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1001\/archinte.166.5.507","article-title":"An intervention to overcome clinical inertia and improve diabetes mellitus control in a primary care setting: Improving Primary Care of African Americans with Diabetes (IPCAAD) 8","volume":"166","author":"Ziemer","year":"2006","journal-title":"Arch Intern Med"},{"issue":"10","key":"2021101218235433100_ocab160-B39","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1111\/j.1525-1497.2005.0197.x","article-title":"Patients and computers as reminders to screen for diabetes in family practice: randomized-controlled trial","volume":"20","author":"Kenealy","year":"2005","journal-title":"J Gen Intern Med"},{"issue":"12","key":"2021101218235433100_ocab160-B40","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1111\/acem.13860","article-title":"A multifaceted intervention to improve patient knowledge and safe use of opioids: results of the ED EMC 2 randomized controlled trial","volume":"26","author":"McCarthy","year":"2019","journal-title":"Acad Emerg Med"},{"issue":"1","key":"2021101218235433100_ocab160-B41","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1177\/0009922816688261","article-title":"Electronic heath record prompts may increase screening for secondhand smoke exposure","volume":"57","author":"Thomas","year":"2018","journal-title":"Clin Pediatr (Phila)"},{"key":"2021101218235433100_ocab160-B42","doi-asserted-by":"crossref","first-page":"215013271985306","DOI":"10.1177\/2150132719853061","article-title":"Promoting adherence to influenza vaccination recommendations in pediatric practice","volume":"10","author":"Werk","year":"2019","journal-title":"J Prim Care Community Health"},{"issue":"4","key":"2021101218235433100_ocab160-B43","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1197\/jamia.M1090","article-title":"Preparation and use of preconstructed orders, order sets, and order menus in a computerized provider order entry system","volume":"10","author":"Payne","year":"2003","journal-title":"J Am Med Inform Assoc"},{"key":"2021101218235433100_ocab160-B44","first-page":"892","article-title":"Order sets in computerized physician order entry systems: an analysis of seven sites","volume":"2010","author":"Wright","year":"2010","journal-title":"AMIA. Annu Symp Proc"},{"issue":"6","key":"2021101218235433100_ocab160-B45","doi-asserted-by":"crossref","first-page":"464","DOI":"10.3122\/jabfm.18.6.464","article-title":"Template-guided versus undirected written medical documentation: a prospective, randomized trial in a family medicine residency clinic","volume":"18","author":"Mulvehill","year":"2005","journal-title":"J Am Board Fam Pract"},{"issue":"1","key":"2021101218235433100_ocab160-B46","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1186\/s12873-018-0188-z","article-title":"Strategies for improving physician documentation in the emergency department: a systematic review","volume":"18","author":"Lorenzetti","year":"2018","journal-title":"BMC Emerg Med"},{"issue":"1","key":"2021101218235433100_ocab160-B47","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.jbi.2007.05.006","article-title":"Towards an on-demand peer feedback system for a clinical knowledge base: a case study with order sets","volume":"41","author":"Hulse","year":"2008","journal-title":"J Biomed Inform"},{"issue":"3","key":"2021101218235433100_ocab160-B48","doi-asserted-by":"crossref","first-page":"331","DOI":"10.4338\/ACI-2010-05-RA-0031","article-title":"Best practices in clinical decision support","volume":"1","author":"Wright","year":"2010","journal-title":"Appl Clin Inform"},{"key":"2021101218235433100_ocab160-B49","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.ijmedinf.2016.12.001","article-title":"Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis","volume":"98","author":"Kilsdonk","year":"2017","journal-title":"Int J Med Inform"},{"issue":"6","key":"2021101218235433100_ocab160-B50","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.ijmedinf.2007.08.011","article-title":"An evaluation framework for Health Information Systems: human, organization, and technology-fit factors (HOT-fit)","volume":"77","author":"Yusof","year":"2008","journal-title":"Int J Med Inform"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/11\/2514\/40576489\/ocab160.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/11\/2514\/40576489\/ocab160.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,17]],"date-time":"2021-10-17T22:47:03Z","timestamp":1634510823000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/11\/2514\/6350783"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,13]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,8,13]]},"published-print":{"date-parts":[[2021,10,12]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab160","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,11,1]]},"published":{"date-parts":[[2021,8,13]]}}}