{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:27:56Z","timestamp":1761395276746},"reference-count":16,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T00:00:00Z","timestamp":1533600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Development and maintenance of order sets is a knowledge-intensive task for off-the-shelf machine-learning algorithms alone. We hypothesize that integrating clinical knowledge with machine learning can facilitate effective development and maintenance of order sets while promoting best practices in ordering. To this end, we simulated the revision of an \u201cAM Lab Order Set\u201d under 6 revision approaches. Revisions included changes in the order set content or default settings through 1) population statistics, 2) individualized prediction using machine learning, and 3) clinical knowledge. Revision criteria were determined using electronic health record (EHR) data from 2014 to 2015. Each revision\u2019s clinical appropriateness, workload from using the order set, and generalizability across time were evaluated using EHR data from 2016 and 2017. Our results suggest a potential order set revision approach that jointly leverages clinical knowledge and machine learning to improve usability while updating contents based on latest clinical knowledge and best practices.<\/jats:p>","DOI":"10.1093\/jamia\/ocy099","type":"journal-article","created":{"date-parts":[[2018,7,7]],"date-time":"2018-07-07T05:57:05Z","timestamp":1530943025000},"page":"1547-1551","source":"Crossref","is-referenced-by-count":8,"title":["Developing and maintaining clinical decision support using clinical knowledge and machine learning: the case of order sets"],"prefix":"10.1093","volume":"25","author":[{"given":"Yiye","family":"Zhang","sequence":"first","affiliation":[{"name":"Division of Health Informatics, Department of Healthcare Policy and Research, Weill Cornell Medicine, Cornell University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Trepp","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Columbia University Irving Medical Center, Columbia University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiguang","family":"Wang","sequence":"additional","affiliation":[{"name":"Decision, Operations and Information Technologies Department, Robert H. Smith School of Business, University of Maryland, College Park, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge","family":"Luna","sequence":"additional","affiliation":[{"name":"Value Institute NewYork-Presbyterian Hospital, New York, NY, USA"},{"name":"Department of Epidemiology, Columbia University Irving Medical Center, Columbia University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David K","family":"Vawdrey","sequence":"additional","affiliation":[{"name":"Value Institute NewYork-Presbyterian Hospital, New York, NY, USA"},{"name":"Department of Biomedical Informatics, Columbia University Irving Medical Center, Columbia University, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victoria","family":"Tiase","sequence":"additional","affiliation":[{"name":"Value Institute NewYork-Presbyterian Hospital, New York, NY, USA"},{"name":"Department of Information Services, NewYork-Presbyterian Hospital, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,8,7]]},"reference":[{"issue":"4","key":"2020110612231698000_ocy099-B1","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1197\/jamia.M1090","article-title":"Preparation and use of preconstructed orders, order sets, and order menus in a computerized provider order entry system","volume":"10","author":"Payne","year":"2003","journal-title":"J Am Med Inform Assoc"},{"issue":"e2","key":"2020110612231698000_ocy099-B2","doi-asserted-by":"crossref","first-page":"e304","DOI":"10.1136\/amiajnl-2013-002316","article-title":"Paving the COWpath: data-driven design of pediatric order sets","volume":"21","author":"Zhang","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612231698000_ocy099-B3","first-page":"549","article-title":"Structuring order sets for interoperable distribution","author":"McClay","year":"2006","journal-title":"AMIA Ann Symp Proc"},{"issue":"1","key":"2020110612231698000_ocy099-B4","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1378\/chest.12-0949","article-title":"Order sets in electronic health records: principles of good practice","volume":"143","author":"McGreevey","year":"2013","journal-title":"Chest"},{"key":"2020110612231698000_ocy099-B5","first-page":"657","article-title":"Visualization of order set creation and usage patterns in early implementation phases of an electronic health record","volume":"2016","author":"Hulse","year":"2016","journal-title":"AMIA Annu Symp Proc"},{"issue":"1102","key":"2020110612231698000_ocy099-B6","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1136\/postgradmedj-2016-134513","article-title":"Reducing unnecessary testing: an intervention to improve resident ordering practices","volume":"93","author":"Melendez-Rosado","year":"2017","journal-title":"Postgrad Med J"},{"issue":"5","key":"2020110612231698000_ocy099-B7","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1197\/jamia.M1811","article-title":"Interventions to regulate ordering of serum magnesium levels: report of an unintended consequence of decision support","volume":"12","author":"Rosenbloom","year":"2005","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2020110612231698000_ocy099-B8","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1093\/jamia\/ocw136","article-title":"Predicting inpatient clinical order patterns with probabilistic topic models vs conventional order sets","volume":"24","author":"Chen","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612231698000_ocy099-B9","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.jbi.2014.09.003","article-title":"The use of sequential pattern mining to predict next prescribed medications","volume":"53","author":"Wright","year":"2015","journal-title":"J Biomed Inform"},{"issue":"3","key":"2020110612231698000_ocy099-B10","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1136\/amiajnl-2013-002008","article-title":"Clinical decision support for atypical orders: detection and warning of atypical medication orders submitted to a computerized provider order entry system","volume":"21","author":"Woods","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612231698000_ocy099-B11","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1093\/jamia\/ocv091","article-title":"OrderRex: clinical order decision support and outcome predictions by data-mining electronic medical records","volume":"23","author":"Chen","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612231698000_ocy099-B12","first-page":"819","article-title":"Automated development of order sets and corollary orders by data mining in an ambulatory computerized physician order entry system","volume":"2006","author":"Wright","year":"2006","journal-title":"AMIA Ann Symp Proc"},{"issue":"2","key":"2020110612231698000_ocy099-B13","doi-asserted-by":"crossref","first-page":"335.","DOI":"10.1377\/hlthaff.2017.1532","article-title":"The choosing wisely campaign","volume":"37","author":"Goldbach","year":"2018","journal-title":"Health Affairs"},{"issue":"26","key":"2020110612231698000_ocy099-B14","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1056\/NEJMp1702071","article-title":"Machine learning and prediction in medicine\u2014beyond the peak of inflated expectations","volume":"376","author":"Chen","year":"2017","journal-title":"N Engl J Med"},{"key":"2020110612231698000_ocy099-B15","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"2020110612231698000_ocy099-B16","first-page":"1871","article-title":"LIBLINEAR: a library for large linear classification","volume":"9","author":"Fan","year":"2008","journal-title":"J Mach Learn Res"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/11\/1547\/34150517\/ocy099.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/11\/1547\/34150517\/ocy099.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,27]],"date-time":"2022-08-27T02:26:53Z","timestamp":1661567213000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/25\/11\/1547\/5067938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,7]]},"references-count":16,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,8,7]]},"published-print":{"date-parts":[[2018,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy099","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,11]]},"published":{"date-parts":[[2018,8,7]]}}}