{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T15:02:58Z","timestamp":1775055778879,"version":"3.50.1"},"reference-count":30,"publisher":"Georg Thieme Verlag KG","issue":"04","license":[{"start":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T00:00:00Z","timestamp":1662508800000},"content-version":"vor","delay-in-days":37,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Requiring accountable justifications\u2014visible, clinician-recorded explanations for not following a clinical decision support (CDS) alert\u2014has been used to steer clinicians away from potentially guideline-discordant decisions. Understanding themes from justifications across clinical content areas may reveal how clinicians rationalize decisions and could help inform CDS alerts.<\/jats:p><jats:p>\n          Methods\u2003We conducted a qualitative evaluation of the free-text justifications entered by primary care physicians from three pilot interventions designed to reduce opioid prescribing and, in older adults, high-risk polypharmacy and overtesting. Clinicians encountered alerts when triggering conditions were met within the chart. Clinicians were asked to change their course of action or enter a justification for the action that would be displayed in the chart. We extracted all justifications and grouped justifications with common themes. Two authors independently coded each justification and resolved differences via discussion. Three physicians used a modified Delphi technique to rate the clinical appropriateness of the justifications.<\/jats:p><jats:p>\n          Results\u2003There were 560 justifications from 50 unique clinicians. We grouped these into three main themes used to justify an action: (1) report of a particular diagnosis or symptom (e.g., for \u201canxiety\u201d or \u201cacute pain\u201d); (2) provision of further contextual details about the clinical case (e.g., tried and failed alternatives, short-term supply, or chronic medication); and (3) noting communication between clinician and patient (e.g., \u201crisks and benefits discussed\u201d). Most accountable justifications (65%) were of uncertain clinical appropriateness.<\/jats:p><jats:p>\n          Conclusion\u2003Most justifications clinicians entered across three separate clinical content areas fit within a small number of themes, and these common rationales may aid in the design of effective accountable justification interventions. Justifications varied in terms of level of clinical detail. On their own, most justifications did not clearly represent appropriate clinical decision making.<\/jats:p>","DOI":"10.1055\/s-0042-1756366","type":"journal-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T23:04:51Z","timestamp":1662591891000},"page":"820-827","source":"Crossref","is-referenced-by-count":4,"title":["A Qualitative Description of Clinician Free-Text Rationales Entered within Accountable Justification Interventions"],"prefix":"10.1055","volume":"13","author":[{"given":"Tiffany","family":"Brown","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"}]},{"given":"Brittany","family":"Zelch","sequence":"additional","affiliation":[{"name":"Loyola University Chicago Stritch School of Medicine, Maywood, Illinois, United States"}]},{"given":"Ji Young","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"}]},{"given":"Jason N.","family":"Doctor","sequence":"additional","affiliation":[{"name":"Leonard D. Schaeffer Center for Health Policy & Economics, University of Southern California, Los Angeles, California, United States"}]},{"given":"Jeffrey A.","family":"Linder","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"}]},{"given":"Mark D.","family":"Sullivan","sequence":"additional","affiliation":[{"name":"Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington, United States"}]},{"given":"Noah J.","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Anderson School of Management, University of California at Los Angeles, Los Angeles, California, United States"}]},{"given":"Theresa A.","family":"Rowe","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"}]},{"given":"Daniella","family":"Meeker","sequence":"additional","affiliation":[{"name":"Leonard D. Schaeffer Center for Health Policy & Economics, University of Southern California, Los Angeles, California, United States"}]},{"given":"Tara","family":"Knight","sequence":"additional","affiliation":[{"name":"Leonard D. Schaeffer Center for Health Policy & Economics, University of Southern California, Los Angeles, California, United States"}]},{"given":"Mark W.","family":"Friedberg","sequence":"additional","affiliation":[{"name":"Blue Cross Blue Shield of Massachusetts, Boston, Massachusetts, United States"},{"name":"Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States"}]},{"given":"Stephen D.","family":"Persell","sequence":"additional","affiliation":[{"name":"Division of General Internal Medicine, Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"},{"name":"Center for Primary Care Innovation, Institute for Public Health and Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, United States"}]}],"member":"194","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"issue":"01","key":"ref1","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1186\/s12913-021-06496-z","article-title":"Nudging healthcare professionals in clinical settings: a scoping review of the literature","volume":"21","author":"A Sant'Anna","year":"2021","journal-title":"BMC Health Serv Res"},{"issue":"07","key":"ref2","doi-asserted-by":"crossref","first-page":"e048801","DOI":"10.1136\/bmjopen-2021-048801","article-title":"Systematic review of clinician-directed nudges in healthcare contexts","volume":"11","author":"B S Last","year":"2021","journal-title":"BMJ Open"},{"issue":"06","key":"ref3","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1001\/jama.2016.0275","article-title":"Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial","volume":"315","author":"D Meeker","year":"2016","journal-title":"JAMA"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1186\/1471-2334-13-290","article-title":"Use of behavioral economics and social psychology to improve treatment of acute respiratory infections (BEARI): rationale and design of a cluster randomized controlled trial [1RC4AG039115-01]\u2013study protocol and baseline practice and provider characteristics","volume":"13","author":"S D Persell","year":"2013","journal-title":"BMC Infect Dis"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1186\/s12879-016-1715-8","article-title":"Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial","volume":"16","author":"S D Persell","year":"2016","journal-title":"BMC Infect Dis"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"106329","DOI":"10.1016\/j.cct.2021.106329","article-title":"The protocol of the Application of Economics & Social psychology to improve Opioid Prescribing Safety Trial 1 (AESOPS-1): electronic health record nudges","volume":"103","author":"M A Kelley","year":"2021","journal-title":"Contemp Clin Trials"},{"issue":"11","key":"ref7","doi-asserted-by":"crossref","first-page":"3254","DOI":"10.1007\/s11606-020-06119-z","article-title":"Implementation of a behavioral economics electronic health record (BE-EHR) module to reduce overtreatment of diabetes in older adults","volume":"35","author":"H M Belli","year":"2020","journal-title":"J Gen Intern Med"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"106649","DOI":"10.1016\/j.cct.2021.106649","article-title":"Design of Behavioral Economic Applications to Geriatrics Leveraging Electronic Health Records (BEAGLE): a pragmatic cluster randomized controlled trial","volume":"112","author":"T Brown","year":"2022","journal-title":"Contemp Clin Trials"},{"issue":"01","key":"ref9","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1186\/s13012-021-01147-7","article-title":"Implementing nudges to promote utilization of low tidal volume ventilation (INPUT): a stepped-wedge, hybrid type III trial of strategies to improve evidence-based mechanical ventilation management","volume":"16","author":"M P Kerlin","year":"2021","journal-title":"Implement Sci"},{"issue":"03","key":"ref10","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1055\/s-0041-1730030","article-title":"Evaluation of clinical decision support to reduce sedative-hypnotic prescribing in older adults","volume":"12","author":"N N Joglekar","year":"2021","journal-title":"Appl Clin Inform"},{"issue":"11","key":"ref11","doi-asserted-by":"crossref","first-page":"2777","DOI":"10.1007\/s11606-021-07296-1","article-title":"Development of high-risk geriatric polypharmacy electronic clinical quality measures and a pilot test of EHR nudges based on these measures","volume":"37","author":"S D Persell","year":"2022","journal-title":"J Gen Intern Med"},{"issue":"02","key":"ref12","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1093\/ageing\/afu145","article-title":"STOPP\/START criteria for potentially inappropriate prescribing in older people: version 2","volume":"44","author":"D O'Mahony","year":"2015","journal-title":"Age Ageing"},{"issue":"11","key":"ref14","doi-asserted-by":"crossref","first-page":"2227","DOI":"10.1111\/jgs.13702","article-title":"American Geriatrics Society 2015 updated Beers Criteria for potentially inappropriate medication use in older adults","volume":"63","author":"By the American Geriatrics Society 2015 Beers Criteria Update Expert Panel","year":"2015","journal-title":"J Am Geriatr Soc"},{"issue":"09","key":"ref16","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"H F Hsieh","year":"2005","journal-title":"Qual Health Res"},{"issue":"03","key":"ref17","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1287\/mnsc.9.3.458","article-title":"An experimental application of the DELPHI method to the use of experts","volume":"9","author":"N Dalkey","year":"1963","journal-title":"Manage Sci"},{"issue":"05","key":"ref18","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1093\/jamia\/ocx106","article-title":"Clinical decision support alert malfunctions: analysis and empirically derived taxonomy","volume":"25","author":"A Wright","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref19","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1136\/amiajnl-2013-001813","article-title":"Overrides of medication-related clinical decision support alerts in outpatients","volume":"21","author":"K C Nanji","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"06","key":"ref20","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1093\/jamia\/ocaa222","article-title":"Renal medication-related clinical decision support (CDS) alerts and overrides in the inpatient setting following implementation of a commercial electronic health record: implications for designing more effective alerts","volume":"28","author":"S N Shah","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref21","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1186\/s13643-017-0627-z","article-title":"Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence","volume":"6","author":"R Backman","year":"2017","journal-title":"Syst Rev"},{"issue":"01","key":"ref22","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1197\/jamia.M1868","article-title":"Improving acceptance of computerized prescribing alerts in ambulatory care","volume":"13","author":"N R Shah","year":"2006","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref23","doi-asserted-by":"crossref","first-page":"225","DOI":"10.7326\/0003-4819-152-4-201002160-00007","article-title":"Frequency of inappropriate medical exceptions to quality measures","volume":"152","author":"S D Persell","year":"2010","journal-title":"Ann Intern Med"},{"key":"ref24","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.math.2016.10.006","article-title":"Quiet dissent: the attitudes, beliefs and behaviours of UK osteopaths who reject low back pain guidance - a qualitative study","volume":"27","author":"J Figg-Latham","year":"2017","journal-title":"Musculoskelet Sci Pract"},{"issue":"01","key":"ref25","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1186\/s12875-021-01440-w","article-title":"Examining primary care physician rationale for not following geriatric choosing wisely recommendations","volume":"22","author":"T A Rowe","year":"2021","journal-title":"BMC Fam Pract"},{"issue":"02","key":"ref26","doi-asserted-by":"crossref","first-page":"299","DOI":"10.4338\/ACI-2015-10-CR-0143","article-title":"Sinusitis treatment guideline adherence in the e-visit setting: a performance improvement project","volume":"7","author":"K L Smith","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"02","key":"ref27","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1055\/s-0038-1660849","article-title":"Incorporating guideline adherence and practice implementation issues into the design of decision support for beta-blocker titration for heart failure","volume":"9","author":"M W Smith","year":"2018","journal-title":"Appl Clin Inform"},{"key":"ref28","doi-asserted-by":"crossref","first-page":"m3256","DOI":"10.1136\/bmj.m3256","article-title":"Details matter: predicting when nudging clinicians will succeed or fail","volume":"370","author":"C R Fox","year":"2020","journal-title":"BMJ"},{"issue":"02","key":"ref29","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1046\/j.1369-6513.1999.00045.x","article-title":"Is \u2018shared decision-making\u2019 feasible in consultations for upper respiratory tract infections? Assessing the influence of antibiotic expectations using discourse analysis","volume":"2","author":"G Elwyn","year":"1999","journal-title":"Health Expect"},{"issue":"05","key":"ref30","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/j.japh.2021.04.003","article-title":"Older adults' perceptions of deprescribing chronic benzodiazepines","volume":"61","author":"J Choi","year":"2021","journal-title":"J Am Pharm Assoc (Wash DC)"},{"issue":"07","key":"ref31","doi-asserted-by":"crossref","first-page":"e98","DOI":"10.1093\/geronb\/gbx138","article-title":"Decision-making preferences and deprescribing: perspectives of older adults and companions about their medicines","volume":"73","author":"K Weir","year":"2018","journal-title":"J Gerontol B Psychol Sci Soc Sci"},{"key":"ref32","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/1748-5908-6-42","article-title":"The behaviour change wheel: a new method for characterising and designing behaviour change interventions","volume":"6","author":"S Michie","year":"2011","journal-title":"Implement Sci"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0042-1756366.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T23:05:19Z","timestamp":1662591919000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0042-1756366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8]]},"references-count":30,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2022,8,11]]},"published-print":{"date-parts":[[2022,8]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0042-1756366","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8]]}}}