{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T19:00:04Z","timestamp":1778180404745,"version":"3.51.4"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>To describe and evaluate a clinical decision support system (CDSS) for empirical antibiotic therapy using a systematic framework.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A reporting framework for behavior change intervention implementation was used, which includes several domains: development, evaluation and implementation. Within the development domain a description is given of the engagement of stakeholders, a rationale for how the CDSS may influence antibiotic prescribing and a detailed outline of how the system was developed. Within the evaluation domain a technical validation is performed and the interaction between potential users and the CDSS is analyzed. Within the domain of implementation a description is given on how the CDSS was tested in the real world and the strategies that were used for implementation and adoption of the CDSS.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Development: a CDSS was developed, with the involvement of stakeholders, to assist empirical antibiotic prescribing by physicians. Evaluation: Technical problems were determined during the validation process and corrected in a new CDSS version. A usability study was performed to assess problems in the system-user interaction. Implementation: In 114 patients the antibiotic advice that was generated by the CDSS was followed. For 54 patients the recommendations were not adhered to.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>This study describes the development and validation of a CDSS for empirical antibiotic therapy and shows the usefulness of the systematic framework for reporting CDSS interventions. In addition it shows that CDSS recommendations are not always adhered to which is associated with incorrect use of the system.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-022-01860-3","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T05:02:41Z","timestamp":1652158961000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["The development and implementation of a guideline-based clinical decision support system to improve empirical antibiotic prescribing"],"prefix":"10.1186","volume":"22","author":[{"given":"H.","family":"Akhloufi","sequence":"first","affiliation":[]},{"given":"H.","family":"van der Sijs","sequence":"additional","affiliation":[]},{"given":"D. C.","family":"Melles","sequence":"additional","affiliation":[]},{"given":"C. P.","family":"van der Hoeven","sequence":"additional","affiliation":[]},{"given":"M.","family":"Vogel","sequence":"additional","affiliation":[]},{"given":"J. W.","family":"Mouton","sequence":"additional","affiliation":[]},{"given":"A.","family":"Verbon","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"1860_CR1","unstructured":"CDC. Core Elements of Hospital Antibiotic Stewardship Programs: CDC; 2014. https:\/\/www.cdc.gov\/getsmart\/healthcare\/implementation\/core-elements.html"},{"issue":"11","key":"1860_CR2","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1016\/j.cmi.2017.08.026","volume":"23","author":"OJ Dyar","year":"2017","unstructured":"Dyar OJ, Huttner B, Schouten J, Pulcini C. Esgap. What is antimicrobial stewardship? Clin Microbiol Infect. 2017;23(11):793\u20138.","journal-title":"Clin Microbiol Infect"},{"issue":"4","key":"1860_CR3","doi-asserted-by":"publisher","first-page":"1245","DOI":"10.1093\/jac\/dku497","volume":"70","author":"P Howard","year":"2014","unstructured":"Howard P, Pulcini C, on behalf of the ESCMID Study Group for Antimicrobial Policies (ESGAP) and ISC Group on Antimicrobial Stewardship, et al. An international cross-sectional survey of antimicrobial stewardship programmes in hospitals. J Antimicrob Chemother. 2014;70(4):1245\u201355.","journal-title":"J Antimicrob Chemother"},{"issue":"2","key":"1860_CR4","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1086\/510393","volume":"44","author":"TH Dellit","year":"2007","unstructured":"Dellit TH, Owens RC, McGowan JE, Gerding DN, Weinstein RA, Burke JP, et al. Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis. 2007;44(2):159\u201377.","journal-title":"Clin Infect Dis"},{"issue":"7","key":"1860_CR5","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1016\/S1473-3099(16)00065-7","volume":"16","author":"EC Schuts","year":"2016","unstructured":"Schuts EC, Hulscher M, Mouton JW, Verduin CM, Stuart J, Overdiek H, et al. Current evidence on hospital antimicrobial stewardship objectives: a systematic review and meta-analysis. Lancet Infect Dis. 2016;16(7):847\u201356.","journal-title":"Lancet Infect Dis"},{"issue":"2","key":"1860_CR6","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1093\/cid\/ciu747","volume":"60","author":"CMA van den Bosch","year":"2014","unstructured":"van den Bosch CMA, Geerlings SE, Natsch S, Prins JM, Hulscher MEJL, Perl TM. Quality indicators to measure appropriate antibiotic use in hospitalized adults. Clin Infect Dis. 2014;60(2):281\u201391.","journal-title":"Clin Infect Dis"},{"issue":"7156","key":"1860_CR7","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1136\/bmj.317.7156.465","volume":"317","author":"LA Bero","year":"1998","unstructured":"Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998;317(7156):465\u20138.","journal-title":"BMJ"},{"issue":"8","key":"1860_CR8","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1016\/j.cmi.2017.02.028","volume":"23","author":"TM Rawson","year":"2017","unstructured":"Rawson TM, Moore LSP, Hernandez B, Charani E, Castro-Sanchez E, Herrero P, et al. A systematic review of clinical decision support systems for antimicrobial management: are we failing to investigate these interventions appropriately? Clin Microbiol Infect. 2017;23(8):524\u201332.","journal-title":"Clin Microbiol Infect"},{"issue":"7494","key":"1860_CR9","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","volume":"330","author":"K Kawamoto","year":"2005","unstructured":"Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765.","journal-title":"BMJ"},{"issue":"10","key":"1860_CR10","doi-asserted-by":"publisher","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","volume":"293","author":"AX Garg","year":"2005","unstructured":"Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223\u201338.","journal-title":"JAMA"},{"issue":"4","key":"1860_CR11","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1016\/j.medmal.2016.02.007","volume":"46","author":"P Le Coz","year":"2016","unstructured":"Le Coz P, Carlet J, Roblot F, Pulcini C. Human resources needed to perform antimicrobial stewardship teams\u2019 activities in French hospitals. Med Mal Infect. 2016;46(4):200\u20136.","journal-title":"Med Mal Infect"},{"issue":"12","key":"1860_CR12","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.1016\/j.cmi.2018.07.005","volume":"24","author":"J Ten Oever","year":"2018","unstructured":"Ten Oever J, Harmsen M, Schouten J, Ouwens M, van der Linden PD, Verduin CM, et al. Human resources required for antimicrobial stewardship teams: a Dutch consensus report. Clin Microbiol Infect. 2018;24(12):1273\u20139.","journal-title":"Clin Microbiol Infect"},{"issue":"5","key":"1860_CR13","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1046\/j.1365-2796.1997.00232.x","volume":"242","author":"L Leibovici","year":"1997","unstructured":"Leibovici L, Gitelman V, Yehezkelli Y, Poznanski O, Milo G, Paul M, et al. Improving empirical antibiotic treatment: prospective, nonintervention testing of a decision support system. J Intern Med. 1997;242(5):395\u2013400.","journal-title":"J Intern Med"},{"issue":"8","key":"1860_CR14","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1001\/archinte.1994.00420080076008","volume":"154","author":"RS Evans","year":"1994","unstructured":"Evans RS, Classen DC, Pestotnik SL, Lundsgaarde HP, Burke JP. Improving empiric antibiotic selection using computer decision support. Arch Intern Med. 1994;154(8):878\u201384.","journal-title":"Arch Intern Med"},{"key":"1860_CR15","unstructured":"Warner Jr H, Reimer L, Suvinier D, Li L, Nelson M. Modeling empiric antibiotic therapy evaluation of QID. Proc AMIA Symp. 1999:440\u20134."},{"issue":"5","key":"1860_CR16","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1016\/j.ijmedinf.2004.04.002","volume":"73","author":"CJ Mullett","year":"2004","unstructured":"Mullett CJ, Thomas JG, Smith CL, Sarwari AR, Khakoo RA. Computerized antimicrobial decision support: an offline evaluation of a database-driven empiric antimicrobial guidance program in hospitalized patients with a bloodstream infection. Int J Med Inform. 2004;73(5):455\u201360.","journal-title":"Int J Med Inform"},{"issue":"6","key":"1860_CR17","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1093\/jac\/dkl372","volume":"58","author":"M Paul","year":"2006","unstructured":"Paul M, Andreassen S, Tacconelli E, Nielsen AD, Almanasreh N, Frank U, et al. Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. J Antimicrob Chemother. 2006;58(6):1238\u201345.","journal-title":"J Antimicrob Chemother"},{"issue":"1","key":"1860_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1055\/s-0038-1676587","volume":"10","author":"BE Jones","year":"2019","unstructured":"Jones BE, Collingridge DS, Vines CG, Post H, Holmen J, Allen TL, et al. CDS in a learning health care system: identifying physicians\u2019 reasons for rejection of best-practice recommendations in pneumonia through computerized clinical decision support. Appl Clin Inform. 2019;10(1):1\u20139.","journal-title":"Appl Clin Inform"},{"issue":"1","key":"1860_CR19","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1197\/jamia.M1166","volume":"11","author":"V Sintchenko","year":"2004","unstructured":"Sintchenko V, Coiera E, Iredell JR, Gilbert GL. Comparative impact of guidelines, clinical data, and decision support on prescribing decisions: an interactive web experiment with simulated cases. J Am Med Inform Assoc. 2004;11(1):71\u20137.","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"1860_CR20","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1177\/1062860605281175","volume":"20","author":"KB Stevenson","year":"2005","unstructured":"Stevenson KB, Barbera J, Moore JW, Samore MH, Houck P. Understanding keys to successful implementation of electronic decision support in rural hospitals: analysis of a pilot study for antimicrobial prescribing. Am J Med Qual. 2005;20(6):313\u20138.","journal-title":"Am J Med Qual"},{"issue":"2","key":"1860_CR21","doi-asserted-by":"publisher","first-page":"368","DOI":"10.4338\/ACI-2013-09-RA-0069","volume":"5","author":"RS Hum","year":"2014","unstructured":"Hum RS, Cato K, Sheehan B, Patel S, Duchon J, DeLaMora P, et al. Developing clinical decision support within a commercial electronic health record system to improve antimicrobial prescribing in the neonatal ICU. Appl Clin Inform. 2014;5(2):368\u201387.","journal-title":"Appl Clin Inform"},{"issue":"8","key":"1860_CR22","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s11908-019-0683-8","volume":"21","author":"B Rittmann","year":"2019","unstructured":"Rittmann B, Stevens MP. Clinical decision support systems and their role in antibiotic stewardship: a systematic review. Curr Infect Dis Rep. 2019;21(8):29.","journal-title":"Curr Infect Dis Rep"},{"issue":"11","key":"1860_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3310\/hta23110","volume":"23","author":"MC Gulliford","year":"2019","unstructured":"Gulliford MC, Juszczyk D, Prevost AT, Soames J, McDermott L, Sultana K, et al. Electronically delivered interventions to reduce antibiotic prescribing for respiratory infections in primary care: cluster RCT using electronic health records and cohort study. Health Technol Assess. 2019;23(11):1\u201370.","journal-title":"Health Technol Assess"},{"issue":"3","key":"1860_CR24","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1016\/j.clinthera.2019.01.018","volume":"41","author":"E Carracedo-Martinez","year":"2019","unstructured":"Carracedo-Martinez E, Gonzalez-Gonzalez C, Teixeira-Rodrigues A, Prego-Dominguez J, Takkouche B, Herdeiro MT, et al. Computerized clinical decision support systems and antibiotic prescribing: a systematic review and meta-analysis. Clin Ther. 2019;41(3):552\u201381.","journal-title":"Clin Ther"},{"issue":"1","key":"1860_CR25","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1186\/s13012-018-0772-3","volume":"13","author":"S Van de Velde","year":"2018","unstructured":"Van de Velde S, Kunnamo I, Roshanov P, Kortteisto T, Aertgeerts B, Vandvik PO, et al. The GUIDES checklist: development of a tool to improve the successful use of guideline-based computerised clinical decision support. Implement Sci. 2018;13(1):86.","journal-title":"Implement Sci"},{"issue":"1","key":"1860_CR26","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1177\/2167702613497932","volume":"2","author":"LS Onken","year":"2014","unstructured":"Onken LS, Carroll KM, Shoham V, Cuthbert BN, Riddle M. Reenvisioning clinical science: unifying the discipline to improve the public health. Clin Psychol Sci. 2014;2(1):22\u201334.","journal-title":"Clin Psychol Sci"},{"issue":"9","key":"1860_CR27","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0223073","volume":"14","author":"H Akhloufi","year":"2019","unstructured":"Akhloufi H, Verhaegh SJC, Jaspers MWM, Melles DC, van der Sijs H, Verbon A. A usability study to improve a clinical decision support system for the prescription of antibiotic drugs. PLoS ONE. 2019;14(9): e0223073.","journal-title":"PLoS ONE"},{"key":"1860_CR28","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.a1655","volume":"337","author":"P Craig","year":"2008","unstructured":"Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337: a1655.","journal-title":"BMJ"},{"issue":"2","key":"1860_CR29","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.ijantimicag.2015.12.006","volume":"47","author":"AL Chow","year":"2016","unstructured":"Chow AL, Ang A, Chow CZ, Ng TM, Teng C, Ling LM, et al. Implementation hurdles of an interactive, integrated, point-of-care computerised decision support system for hospital antibiotic prescription. Int J Antimicrob Agents. 2016;47(2):132\u20139.","journal-title":"Int J Antimicrob Agents"},{"issue":"1","key":"1860_CR30","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1186\/s13012-017-0644-2","volume":"12","author":"EG Liberati","year":"2017","unstructured":"Liberati EG, Ruggiero F, Galuppo L, Gorli M, Gonz\u00e1lez-Lorenzo M, Maraldi M, et al. What hinders the uptake of computerized decision support systems in hospitals? A qualitative study and framework for implementation. Implement Sci. 2017;12(1):113.","journal-title":"Implement Sci"},{"issue":"1","key":"1860_CR31","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1186\/s13012-018-0790-1","volume":"13","author":"S Van de Velde","year":"2018","unstructured":"Van de Velde S, Heselmans A, Delvaux N, Brandt L, Marco-Ruiz L, Spitaels D, et al. A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implement Sci. 2018;13(1):114.","journal-title":"Implement Sci"},{"issue":"e1","key":"1860_CR32","doi-asserted-by":"publisher","first-page":"e9","DOI":"10.1136\/amiajnl-2013-001684","volume":"20","author":"KM Cresswell","year":"2013","unstructured":"Cresswell KM, Bates DW, Sheikh A. Ten key considerations for the successful implementation and adoption of large-scale health information technology. J Am Med Inform Assoc. 2013;20(e1):e9\u201313.","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"1860_CR33","doi-asserted-by":"publisher","first-page":"9910","DOI":"10.1007\/s10916-012-9910-7","volume":"37","author":"D Buenestado","year":"2013","unstructured":"Buenestado D, Elorz J, P\u00e9rez-Yarza EG, Iruetaguena A, Segundo U, Barrena R, et al. Evaluating acceptance and user experience of a guideline-based clinical decision support system execution platform. J Med Syst. 2013;37(2):9910.","journal-title":"J Med Syst"},{"key":"1860_CR34","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/j.ijmedinf.2018.01.011","volume":"112","author":"RW Grout","year":"2018","unstructured":"Grout RW, Cheng ER, Carroll AE, Bauer NS, Downs SM. A six-year repeated evaluation of computerized clinical decision support system user acceptability. Int J Med Inform. 2018;112:74\u201381.","journal-title":"Int J Med Inform"},{"issue":"8","key":"1860_CR35","first-page":"2353","volume":"75","author":"T Delory","year":"2020","unstructured":"Delory T, Jeanmougin P, Lariven S, Aubert JP, Peiffer-Smadja N, Bo\u00eblle PY, et al. A computerized decision support system (CDSS) for antibiotic prescription in primary care-Antibioclic: implementation, adoption and sustainable use in the era of extended antimicrobial resistance. J Antimicrob Chemother. 2020;75(8):2353\u201362.","journal-title":"J Antimicrob Chemother"},{"issue":"1","key":"1860_CR36","doi-asserted-by":"publisher","first-page":"108e1","DOI":"10.1016\/j.cmi.2018.03.029","volume":"25","author":"DR MacFadden","year":"2019","unstructured":"MacFadden DR, Coburn B, Shah N, Robicsek A, Savage R, Elligsen M, et al. Decision-support models for empiric antibiotic selection in Gram-negative bloodstream infections. Clin Microbiol Infect. 2019;25(1):108e1\u20137.","journal-title":"Clin Microbiol Infect"},{"issue":"3","key":"1860_CR37","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1111\/jpc.14191","volume":"55","author":"M Mostaghim","year":"2019","unstructured":"Mostaghim M, Snelling T, McMullan B, Ewe YH, Bajorek B. Impact of clinical decision support on empirical antibiotic prescribing for children with community-acquired pneumonia. J Paediatr Child Health. 2019;55(3):305\u201311.","journal-title":"J Paediatr Child Health"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01860-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01860-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01860-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T05:03:08Z","timestamp":1652158988000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01860-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1860"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01860-3","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]},"assertion":[{"value":"1 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"According to the Dutch Medical Research in Humans Act, medical ethical approval was not required and patients did not need to provide informed consent, since their data were handled anonymously by the researcher [MEC-2016-101].","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"127"}}