{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T22:21:46Z","timestamp":1776378106930,"version":"3.51.2"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2020,9,28]],"date-time":"2020-09-28T00:00:00Z","timestamp":1601251200000},"content-version":"vor","delay-in-days":1,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To improve patient safety and clinical outcomes by reducing the risk of prescribing errors, we tested the accuracy of a hybrid clinical decision support system in prioritizing prescription checks.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Data from electronic health records were collated over a period of 18 months. Inferred scores at a patient level (probability of a patient\u2019s set of active orders to require a pharmacist review) were calculated using a hybrid approach (machine learning and a rule-based expert system). A clinical pharmacist analyzed randomly selected prescription orders over a 2-week period to corroborate our findings. Predicted scores were compared with the pharmacist\u2019s review using the area under the receiving-operating characteristic curve and area under the precision-recall curve. These metrics were compared with existing tools: computerized alerts generated by a clinical decision support (CDS) system and a literature-based multicriteria query prioritization technique. Data from 10\u00a0716 individual patients (133\u00a0179 prescription orders) were used to train the algorithm on the basis of 25 features in a development dataset.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>While the pharmacist analyzed 412 individual patients (3364 prescription orders) in an independent validation dataset, the areas under the receiving-operating characteristic and precision-recall curves of our digital system were 0.81 and 0.75, respectively, thus demonstrating greater accuracy than the CDS system (0.65 and 0.56, respectively) and multicriteria query techniques (0.68 and 0.56, respectively).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Our innovative digital tool was notably more accurate than existing techniques (CDS system and multicriteria query) at intercepting potential prescription errors.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>By primarily targeting high-risk patients, this novel hybrid decision support system improved the accuracy and reliability of prescription checks in a hospital setting.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa154","type":"journal-article","created":{"date-parts":[[2020,6,30]],"date-time":"2020-06-30T11:37:44Z","timestamp":1593517064000},"page":"1688-1694","source":"Crossref","is-referenced-by-count":141,"title":["A machine learning\u2013based clinical decision support system to identify prescriptions with a high risk of medication error"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4303-6479","authenticated-orcid":false,"given":"Jennifer","family":"Corny","sequence":"first","affiliation":[{"name":"Pharmacy Department, Groupe Hospitalier Paris Saint Joseph, Paris, France"}]},{"given":"Asok","family":"Rajkumar","sequence":"additional","affiliation":[{"name":"Pharmacy Department, Groupe Hospitalier Paris Saint Joseph, Paris, France"}]},{"given":"Olivier","family":"Martin","sequence":"additional","affiliation":[{"name":"Lumio Medical, Paris, France"}]},{"given":"Xavier","family":"Dode","sequence":"additional","affiliation":[{"name":"Centre National Hospitalier d\u2019Information sur le M\u00e9dicament, Paris, France"},{"name":"Pharmacy Department, Hospices Civils de Lyon University Hospital, Lyon, France"}]},{"given":"Jean-Patrick","family":"Lajonch\u00e8re","sequence":"additional","affiliation":[{"name":"Groupe Hospitalier Paris Saint Joseph, Paris, France"}]},{"given":"Olivier","family":"Billuart","sequence":"additional","affiliation":[{"name":"Medical Information Department, Groupe Hospitalier Paris Saint Joseph, Paris, France"}]},{"given":"Yvonnick","family":"B\u00e9zie","sequence":"additional","affiliation":[{"name":"Pharmacy Department, Groupe Hospitalier Paris Saint Joseph, Paris, France"}]},{"given":"Anne","family":"Buronfosse","sequence":"additional","affiliation":[{"name":"Medical Information Department, Groupe Hospitalier Paris Saint Joseph, Paris, France"}]}],"member":"286","published-online":{"date-parts":[[2020,9,27]]},"reference":[{"key":"2020111714264535200_ocaa154-B1","doi-asserted-by":"crossref","first-page":"i2139","DOI":"10.1136\/bmj.i2139","article-title":"Medical error\u2013the third leading cause of death in the US","volume":"353","author":"Makary","year":"2016","journal-title":"BMJ"},{"key":"2020111714264535200_ocaa154-B2","volume-title":"To Err is Human: Building a Safer Health System","year":"2000"},{"issue":"5","key":"2020111714264535200_ocaa154-B3","doi-asserted-by":"crossref","first-page":"452","DOI":"10.7861\/clinmedicine.2-5-452","article-title":"An organisation with a memory","volume":"2","author":"Donaldson","year":"2002","journal-title":"Clin Med"},{"issue":"6","key":"2020111714264535200_ocaa154-B4","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1093\/intqhc\/mzp047","article-title":"Impact and preventability of adverse events in Spanish public hospitals: results of the Spanish National Study of Adverse Events (ENEAS)","volume":"21","author":"Aranaz-Andr\u00e9s","year":"2009","journal-title":"Int J Qual Health Care"},{"key":"2020111714264535200_ocaa154-B5","doi-asserted-by":"crossref","first-page":"h3239","DOI":"10.1136\/bmj.h3239","article-title":"Avoidability of hospital deaths and association with hospital-wide mortality ratios: retrospective case record review and regression analysis","volume":"351","author":"Hogan","year":"2015","journal-title":"BMJ"},{"issue":"Suppl 1","key":"2020111714264535200_ocaa154-B6","first-page":"W5","article-title":"Taking the pulse of health care systems: experiences of patients with health problems in six countries","volume":"24","author":"Schoen","year":"2005","journal-title":"Health Aff (Millwood)"},{"key":"2020111714264535200_ocaa154-B7","year":"2019"},{"issue":"6","key":"2020111714264535200_ocaa154-B8","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1056\/NEJM199102073240604","article-title":"Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I","volume":"324","author":"Brennan","year":"1991","journal-title":"N Engl J Med"},{"issue":"4","key":"2020111714264535200_ocaa154-B9","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/BF02600255","article-title":"Relationship between medication errors and adverse drug events","volume":"10","author":"Bates","year":"1995","journal-title":"J Gen Intern Med"},{"issue":"7","key":"2020111714264535200_ocaa154-B10","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1001\/archinte.164.7.785","article-title":"The epidemiology of prescribing errors: the potential impact of computerized prescriber order entry","volume":"164","author":"Bobb","year":"2004","journal-title":"Arch Intern Med"},{"issue":"4","key":"2020111714264535200_ocaa154-B11","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1007\/s11096-013-9771-2","article-title":"Potential medication errors associated with computer prescriber order entry","volume":"35","author":"Villama\u00f1\u00e1n","year":"2013","journal-title":"Int J Clin Pharm"},{"issue":"1","key":"2020111714264535200_ocaa154-B12","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1186\/s13643-017-0627-z","article-title":"Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence","volume":"6","author":"Backman","year":"2017","journal-title":"Syst Rev"},{"issue":"2","key":"2020111714264535200_ocaa154-B13","first-page":"195","article-title":"Clinical decision support alert appropriateness: a review and proposal for improvement","volume":"14","author":"McCoy","year":"2014","journal-title":"Ochsner J"},{"issue":"1","key":"2020111714264535200_ocaa154-B14","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1186\/s13063-017-1798-6","article-title":"Impact of a pharmacist-led medication review on hospital readmission in a pediatric and elderly population: study protocol for a randomized open-label controlled trial","volume":"18","author":"Renaudin","year":"2017","journal-title":"Trials"},{"issue":"2","key":"2020111714264535200_ocaa154-B15","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1136\/jech.2005.035188","article-title":"Where now for pharmacist led medication review?","volume":"60","author":"Holland","year":"2006","journal-title":"J Epidemiol Community Health"},{"issue":"5","key":"2020111714264535200_ocaa154-B16","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1007\/s11096-018-0668-y","article-title":"Identification of variables influencing pharmaceutical interventions to improve medication review efficiency","volume":"40","author":"Cornuault","year":"2018","journal-title":"Int J Clin Pharm"},{"issue":"2","key":"2020111714264535200_ocaa154-B17","doi-asserted-by":"crossref","first-page":"e0171995","DOI":"10.1371\/journal.pone.0171995","article-title":"Improving medication safety: Development and impact of a multivariate model-based strategy to target high-risk patients","volume":"12","author":"Nguyen","year":"2017","journal-title":"PLoS One"},{"key":"2020111714264535200_ocaa154-B18","author":"Jarr\u00e9","year":"2016"},{"issue":"4","key":"2020111714264535200_ocaa154-B19","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1136\/svn-2017-000101","article-title":"Artificial intelligence in healthcare: past, present and future","volume":"2","author":"Jiang","year":"2017","journal-title":"Stroke Vasc Neurol"},{"key":"2020111714264535200_ocaa154-B20","year":"2019"},{"issue":"5\u20136","key":"2020111714264535200_ocaa154-B21","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.pharma.2008.07.009","article-title":"Theriaque: independent-drug database for good use of drugs by health practitioners","volume":"66","author":"Husson","year":"2008","journal-title":"Ann Pharm Fr"},{"key":"2020111714264535200_ocaa154-B22","doi-asserted-by":"crossref","DOI":"10.1145\/1143844.1143874","volume-title":"The relationship between precision-recall and ROC curves. In: proceedings of the 23rd international conference on Machine learning-ICML \u201906","author":"Davis","year":"2006"},{"key":"2020111714264535200_ocaa154-B23","author":"Bertail","year":"2008"},{"issue":"1","key":"2020111714264535200_ocaa154-B24","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1186\/s12911-017-0430-8","article-title":"Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system","volume":"17","author":"Ancker","year":"2017","journal-title":"BMC Med Inform Decis Mak"},{"issue":"21","key":"2020111714264535200_ocaa154-B25","doi-asserted-by":"crossref","first-page":"1774","DOI":"10.2146\/ajhp160387","article-title":"Identifying and characterizing preventable adverse drug events for prioritizing pharmacist intervention in hospitals","volume":"74","author":"Jeon","year":"2017","journal-title":"Am J Health Syst Pharm"},{"issue":"23","key":"2020111714264535200_ocaa154-B26","doi-asserted-by":"crossref","first-page":"1970","DOI":"10.2146\/ajhp160995","article-title":"Development and validation of a complexity score to rank hospitalized patients at risk for preventable adverse drug events","volume":"74","author":"Winterstein","year":"2017","journal-title":"Am J Health Syst Pharm"},{"issue":"12","key":"2020111714264535200_ocaa154-B27","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1093\/jamia\/ocz135","article-title":"Reducing drug prescription errors and adverse drug events by application of a probabilistic, machine learning based clinical decision support system in an inpatient setting","volume":"26","author":"Segal","year":"2019","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/11\/1688\/34363832\/ocaa154.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/11\/1688\/34363832\/ocaa154.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,17]],"date-time":"2020-11-17T19:28:02Z","timestamp":1605641282000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/11\/1688\/5912186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,27]]},"references-count":27,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,9,27]]},"published-print":{"date-parts":[[2020,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa154","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,11]]},"published":{"date-parts":[[2020,9,27]]}}}