{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T21:02:57Z","timestamp":1790197377241,"version":"4.1.0"},"reference-count":28,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Anticoagulants are high-alert medications with substantial risk of serious bleeding, yet dosing and prescribing errors remain common. Although clinical decision support systems (CDSSs) can mitigate these errors, their impact is constrained by alert fatigue and limited interpretability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>We developed and validated a hybrid CDSS that integrates rule-based logic with machine learning to improve the safe use of anticoagulants.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This multicenter study used electronic health record data on anticoagulant prescriptions from 3 tertiary hospitals (1 for system development and internal validation and 2 for external validation). The hybrid CDSS combined a knowledge-based rule engine with a machine learning model trained to predict whether an anticoagulant prescription would require pharmacist intervention. The system was iteratively refined through pilot testing, internal validation, and external validation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 75,200 anticoagulant prescriptions were used for model development. The final hybrid CDSS comprised 44 patient-specific rules and 1129 drug-drug interaction rules, combined with a CatBoost classifier (version 1.2.5; Yandex) for alert prioritization. During internal validation, 88 (18.9%) alerts were generated; all were technically correct; 88.6% (n=78) were deemed clinically relevant; 86.4% (n=76) were considered clinically useful; and 13.6% (n=12) required pharmacist intervention. In external validation across 2 hospitals, alert rates ranged from 22.6% (7\/31) to 32.1% (310\/966), with 18.8% (22\/117) to 57.1% (4\/7) of alerts requiring pharmacist intervention. The hybrid CDSS showed strong discrimination (area under the receiver operating characteristic curve 0.871\u20100.963). No false negatives were identified, but the estimates should be interpreted cautiously given the short validation periods and limited number of intervention-requiring prescriptions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>A hybrid CDSS integrating rule-based logic with machine learning demonstrated high technical accuracy and clinical relevance across multiple institutions, suggesting its potential as a practical tool for supporting pharmacist-led anticoagulant prescription review.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/101202","type":"journal-article","created":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T20:21:56Z","timestamp":1790194916000},"page":"e101202-e101202","source":"Crossref","is-referenced-by-count":0,"title":["A Hybrid Rule-Based and Machine Learning\u2013Based Clinical Decision Support System to Support Prescription Review: Development and External Validation Study"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-7877-7913","authenticated-orcid":false,"given":"Jonghyun","family":"Jeong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3626-3999","authenticated-orcid":false,"given":"Kyu-Nam","family":"Heo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8257-2783","authenticated-orcid":false,"given":"A Jeong","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1163-3611","authenticated-orcid":false,"given":"Jin Hee","family":"Baek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8174-8172","authenticated-orcid":false,"given":"Yun Hee","family":"Jo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0594-7175","authenticated-orcid":false,"given":"Sunghwan","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-0529-9573","authenticated-orcid":false,"given":"Mingi","family":"Jo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1607-9828","authenticated-orcid":false,"given":"Young-Mi","family":"Ah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0662-0388","authenticated-orcid":false,"given":"Ji Min","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0123-8227","authenticated-orcid":false,"given":"Sae Won","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6733-4820","authenticated-orcid":false,"given":"Junho","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0688-0278","authenticated-orcid":false,"given":"Sangil","family":"Min","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2261-7330","authenticated-orcid":false,"given":"Ju-Yeun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,23]]},"reference":[{"issue":"7","key":"R1","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1001\/jamacardio.2022.1292","article-title":"Efficacy and safety considerations with dose-reduced direct oral anticoagulants: a review","volume":"7","author":"Bikdeli","journal-title":"JAMA Cardiol"},{"issue":"4","key":"R2","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1007\/s00228-021-03212-y","article-title":"Prevalence, contributory factors and severity of medication errors associated with direct-acting oral anticoagulants in adult patients: a systematic review and meta-analysis","volume":"78","author":"Al Rowily","journal-title":"Eur J Clin Pharmacol"},{"key":"R3","unstructured":"High-alert medications in acute care settings. ECRI. 2024. URL: https:\/\/home.ecri.org\/blogs\/ismp-resources\/high-alert-medications-in-acute-care-settings [Accessed 18-08-2026]"},{"key":"R4","unstructured":"High risk medcines and systems. Australian commission on safety and quality in health care. URL: https:\/\/www.safetyandquality.gov.au\/clinical-topics\/medicines-safety-and-quality\/high-risk-medicines-and-systems [Accessed 18-08-2026]"},{"issue":"2","key":"R5","doi-asserted-by":"publisher","first-page":"116","DOI":"10.24304\/kjcp.2022.32.2.116","article-title":"Developing national level high alert medication lists for acute care setting in Korea","volume":"32","author":"Han","journal-title":"Korean J Clin Pharm"},{"issue":"4","key":"R6","doi-asserted-by":"publisher","first-page":"498","DOI":"10.32429\/jkshp.2022.39.4.006","article-title":"Developing national level high alert medication lists for long-term care patients","volume":"39","author":"Lee","journal-title":"J Korean Soc Health-Syst Pharm"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.3389\/fphar.2019.00425","article-title":"Preventable cases of oral anticoagulant-induced bleeding: data from the spontaneous reporting system","volume":"10","author":"Mascolo","journal-title":"Front Pharmacol"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.3389\/fphar.2021.581293","article-title":"Real-world prevalence of direct oral anticoagulant off-label doses in atrial fibrillation: an epidemiological meta-analysis","volume":"12","author":"Shen","journal-title":"Front Pharmacol"},{"issue":"2","key":"R9","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1016\/j.jacasi.2023.11.014","article-title":"Bleeding risk in asian patients: potential for thrombin amplification pathway blockade using factor XI inhibitors","volume":"4","author":"Liang","journal-title":"JACC Asia"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/s40264-024-01476-8","article-title":"Comparative effectiveness and safety of off-label underdosed direct oral anticoagulants in Asian patients with atrial fibrillation: a systematic review and meta-analysis","volume":"48","author":"Mongkhon","journal-title":"Drug Saf"},{"issue":"12","key":"R11","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.121.007971","article-title":"Off-label under- and overdosing of direct oral anticoagulants in patients with atrial fibrillation: a meta-analysis","volume":"14","author":"Zhang","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"7","key":"R12","doi-asserted-by":"publisher","first-page":"e587","DOI":"10.1097\/PTS.0000000000000417","article-title":"Prescribing errors with low-molecular-weight heparins","volume":"17","author":"Slikkerveer","journal-title":"J Patient Saf"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2023.107869","article-title":"Ability of machine-learning based clinical decision support system to reduce alert fatigue, wrong-drug errors, and alert users about look alike, sound alike medication","volume":"243","author":"Chen","journal-title":"Comput Methods Programs Biomed"},{"issue":"17","key":"R14","doi-asserted-by":"publisher","first-page":"5798","DOI":"10.3390\/app10175798","article-title":"Machine learning in high-alert medication treatment: a study on the cardiovascular drug","volume":"10","author":"Tai","journal-title":"Appl Sci"},{"issue":"1","key":"R15","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-022-01885-8","article-title":"Development and assessment of PharmaCheck: an electronic screening tool for the prevention of twenty major adverse drug events","volume":"22","author":"Skalafouris","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-022-01979-3","article-title":"OntoPharma: ontology based clinical decision support system to reduce medication prescribing errors","volume":"22","author":"Calvo-Cidoncha","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-022-01860-3","article-title":"The development and implementation of a guideline-based clinical decision support system to improve empirical antibiotic prescribing","volume":"22","author":"Akhloufi","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"R18","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1055\/s-0039-1693426","article-title":"Development and evaluation of a clinical decision support system to improve medication safety","volume":"10","author":"Ib\u00e1\u00f1ez-Garcia","journal-title":"Appl Clin Inform"},{"issue":"11","key":"R19","doi-asserted-by":"publisher","first-page":"1688","DOI":"10.1093\/jamia\/ocaa154","article-title":"A machine learning-based clinical decision support system to identify prescriptions with a high risk of medication error","volume":"27","author":"Corny","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/s40264-021-01123-6","article-title":"Hybrid method incorporating a rule-based approach and deep learning for prescription error prediction","volume":"45","author":"Lee","journal-title":"Drug Saf"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0748-5","article-title":"Development and implementation of \u201cCheck of Medication Appropriateness\u201d (CMA): advanced pharmacotherapy-related clinical rules to support medication surveillance","volume":"19","author":"Quintens","journal-title":"BMC Med Inform Decis Mak"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: benefits, risks, and strategies for success","volume":"3","author":"Sutton","journal-title":"NPJ Digit Med"},{"issue":"4","key":"R23","doi-asserted-by":"publisher","first-page":"280","DOI":"10.4258\/hir.2014.20.4.280","article-title":"Differences of reasons for alert overrides on contraindicated co-prescriptions by admitting department","volume":"20","author":"Ahn","journal-title":"Healthc Inform Res"},{"issue":"2","key":"R24","doi-asserted-by":"publisher","DOI":"10.1177\/14604582241263242","article-title":"Override rate of drug-drug interaction alerts in clinical decision support systems: a brief systematic review and meta-analysis","volume":"30","author":"Felisberto","journal-title":"Health Informatics J"},{"key":"R25","unstructured":"Integrated Drug Safety Information System (NEDRUG) [Article in Korean]. URL: https:\/\/nedrug.mfds.go.kr [Accessed 18-08-2026]"},{"key":"R26","unstructured":"UpToDate Lexidrug. URL: https:\/\/online.lexi.com [Accessed 18-08-2026]"},{"key":"R27","unstructured":"Merative micromedex. URL: https:\/\/www.micromedexsolutions.com [Accessed 18-08-2026]"},{"issue":"10","key":"R28","doi-asserted-by":"publisher","first-page":"1790","DOI":"10.1111\/imj.15957","article-title":"Prevalence and predictors of inappropriate dosing of direct oral anticoagulants","volume":"53","author":"Ko","journal-title":"Intern Med J"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T20:21:58Z","timestamp":1790194918000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e101202"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,23]]},"references-count":28,"URL":"https:\/\/doi.org\/10.2196\/101202","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,23]]},"article-number":"v28i7e101202"}}