{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T09:46:01Z","timestamp":1778233561938,"version":"3.51.4"},"reference-count":58,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,10,27]],"date-time":"2020-10-27T00:00:00Z","timestamp":1603756800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000066","name":"National Institute of Environmental Health Sciences","doi-asserted-by":"publisher","award":["K01ES026837"],"award-info":[{"award-number":["K01ES026837"]}],"id":[{"id":"10.13039\/100000066","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"the Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","award":["GBMF8040"],"award-info":[{"award-number":["GBMF8040"]}],"id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Stanford Human-Centered Artificial Intelligence Seed"},{"name":"University Healthcare Alliance and Packard Children\u2019s Health Alliance clinics"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,12,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To assess usability and usefulness of a machine learning-based order recommender system applied to simulated clinical cases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>43 physicians entered orders for 5 simulated clinical cases using a clinical order entry interface with or without access to a previously developed automated order recommender system. Cases were randomly allocated to the recommender system in a 3:2 ratio. A panel of clinicians scored whether the orders placed were clinically appropriate. Our primary outcome included the difference in clinical appropriateness scores. Secondary outcomes included total number of orders, case time, and survey responses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Clinical appropriateness scores per order were comparable for cases randomized to the order recommender system (mean difference -0.11 order per score, 95% CI: [-0.41, 0.20]). Physicians using the recommender placed more orders (median 16 vs 15 orders, incidence rate ratio 1.09, 95%CI: [1.01-1.17]). Case times were comparable with the recommender system. Order suggestions generated from the recommender system were more likely to match physician needs than standard manual search options. Physicians used recommender suggestions in 98% of available cases. Approximately 95% of participants agreed the system would be useful for their workflows.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>User testing with a simulated electronic medical record interface can assess the value of machine learning and clinical decision support tools for clinician usability and acceptance before live deployments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Clinicians can use and accept machine learned clinical order recommendations integrated into an electronic order entry interface in a simulated setting. The clinical appropriateness of orders entered was comparable even when supported by automated recommendations.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa190","type":"journal-article","created":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T23:16:19Z","timestamp":1595718979000},"page":"1850-1859","source":"Crossref","is-referenced-by-count":19,"title":["OrderRex clinical user testing: a randomized trial of recommender system decision support on simulated cases"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4631-3307","authenticated-orcid":false,"given":"Andre","family":"Kumar","sequence":"first","affiliation":[{"name":"Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Rachael C","family":"Aikens","sequence":"additional","affiliation":[{"name":"Program in Biomedical Informatics, Stanford University, Stanford, California, USA"},{"name":"Department of Statistics, Stanford University, Stanford, California, USA"}]},{"given":"Jason","family":"Hom","sequence":"additional","affiliation":[{"name":"Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Lisa","family":"Shieh","sequence":"additional","affiliation":[{"name":"Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Jonathan","family":"Chiang","sequence":"additional","affiliation":[{"name":"Department of Medicine, Center for Biomedical Informatics Research, Stanford University, Stanford, California, USA"}]},{"given":"David","family":"Morales","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stanford University, Stanford, California, USA"}]},{"given":"Divya","family":"Saini","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stanford University, Stanford, California, USA"}]},{"given":"Mark","family":"Musen","sequence":"additional","affiliation":[{"name":"Department of Medicine, Center for Biomedical Informatics Research, Stanford University, Stanford, California, USA"}]},{"given":"Michael","family":"Baiocchi","sequence":"additional","affiliation":[{"name":"Department of Epidemiology and Public Health, Stanford University, Stanford, California, USA"}]},{"given":"Russ","family":"Altman","sequence":"additional","affiliation":[{"name":"Departments of Bioengineering, Genetics, Medicine, and Biomedical Data Science, Stanford University, Stanford, California, USA"}]},{"given":"Mary K","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Geriatrics Research Education and Clinical Center, Veteran Affairs Palo Alto Health Care System, Palo Alto, California, USA"},{"name":"Primary Care and Outcomes Research (PCOR), Department of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Steven","family":"Asch","sequence":"additional","affiliation":[{"name":"Primary Care and Population Health, Department of Medicine, Stanford University, Stanford, California, USA"},{"name":"Center for Innovation to Implementation, Veteran Affairs Palo Alto Health Care System, Palo Alto, California, USA"}]},{"given":"Jonathan H","family":"Chen","sequence":"additional","affiliation":[{"name":"Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California, USA"},{"name":"Department of Medicine, Center for Biomedical Informatics Research, Stanford University, Stanford, California, USA"}]}],"member":"286","published-online":{"date-parts":[[2020,10,27]]},"reference":[{"key":"2020121009244333700_ocaa190-B1","volume-title":"Crossing the Quality Chasm: A New Health System for the 21st Century","author":"Richardson","year":"2001"},{"issue":"8","key":"2020121009244333700_ocaa190-B2","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1001\/jama.2009.205","article-title":"Scientific evidence underlying the ACC\/AHA clinical practice guidelines","volume":"301","author":"Tricoci","year":"2009","journal-title":"JAMA"},{"issue":"177","key":"2020121009244333700_ocaa190-B3","first-page":"54163","article-title":"Health information technology: standards, implementation specifications, and certification criteria for electronic health record technology, 2014 Edition; revisions to the permanent certification program for health information technology","volume":"77","year":"2012","journal-title":"Fed Regist"},{"issue":"9","key":"2020121009244333700_ocaa190-B4","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1097\/MLR.0b013e3182a67209","article-title":"Big data meets the electronic medical record: a commentary on \u201cidentifying patients at increased risk for unplanned readmission","volume":"51","author":"de Lissovoy","year":"2013","journal-title":"Med Care"},{"issue":"19","key":"2020121009244333700_ocaa190-B5","doi-asserted-by":"crossref","first-page":"1758","DOI":"10.1056\/NEJMp1108726","article-title":"Evidence-based medicine in the EMR era","volume":"365","author":"Frankovich","year":"2011","journal-title":"N Engl J Med"},{"issue":"7","key":"2020121009244333700_ocaa190-B6","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.1377\/hlthaff.2014.0099","article-title":"A \u201cgreen button\u201d for using aggregate patient data at the point of care","volume":"33","author":"Longhurst","year":"2014","journal-title":"Health Aff"},{"key":"2020121009244333700_ocaa190-B7","volume-title":"Best Care at Lower Cost: The Path to Continuously Learning Health Care in America","author":"Smith","year":"2013"},{"issue":"7","key":"2020121009244333700_ocaa190-B8","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1377\/hlthaff.2014.0053","article-title":"Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system","volume":"33","author":"Krumholz","year":"2014","journal-title":"Health Aff"},{"issue":"11","key":"2020121009244333700_ocaa190-B9","doi-asserted-by":"crossref","first-page":"942","DOI":"10.1197\/j.aem.2007.06.023","article-title":"Decision support technology in knowledge translation","volume":"14","author":"Holroyd","year":"2007","journal-title":"Acad Emerg Med"},{"issue":"12","key":"2020121009244333700_ocaa190-B10","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1001\/archinte.163.12.1409","article-title":"Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review","volume":"163","author":"Kaushal","year":"2003","journal-title":"Arch Intern Med"},{"issue":"5","key":"2020121009244333700_ocaa190-B11","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1136\/jamia.1997.0040364","article-title":"A randomized trial of \u201ccorollary orders\u201d to prevent errors of omission","volume":"4","author":"Overhage","year":"1997","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2020121009244333700_ocaa190-B12","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1197\/jamia.M1370","article-title":"Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality","volume":"10","author":"Bates","year":"2003","journal-title":"J Am Med Inform Assoc"},{"key":"2020121009244333700_ocaa190-B13","first-page":"987","article-title":"When order sets do not align with clinician workflow: assessing practice patterns in the electronic health record","volume":"28","author":"Li","year":"2019","journal-title":"BMJ Qual Saf"},{"issue":"6","key":"2020121009244333700_ocaa190-B14","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1001\/jamainternmed.2016.1220","article-title":"To cure sometimes, to relieve often, to comfort always","volume":"176","author":"Kumar","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"2","key":"2020121009244333700_ocaa190-B15","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/j.jbi.2007.09.003","article-title":"Grand challenges in clinical decision support","volume":"41","author":"Sittig","year":"2008","journal-title":"J Biomed Inform"},{"issue":"S 01","key":"2020121009244333700_ocaa190-B16","doi-asserted-by":"crossref","first-page":"S103","DOI":"10.15265\/IYS-2016-s034","article-title":"Clinical decision support: a 25 year retrospective and a 25 year vision","volume":"25","author":"Middleton","year":"2016","journal-title":"Yearb Med Inform"},{"issue":"3","key":"2020121009244333700_ocaa190-B17","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1093\/jamia\/ocw136","article-title":"Predicting inpatient clinical order patterns with probabilistic topic models vs conventional order sets","volume":"24","author":"Chen","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2020121009244333700_ocaa190-B18","first-page":"1469","article-title":"Data-driven order set generation and evaluation in the pediatric environment","volume":"2012","author":"Zhang","year":"2012","journal-title":"AMIA Annu Symp Proc"},{"key":"2020121009244333700_ocaa190-B19","first-page":"333","article-title":"A recommendation algorithm for automating corollary order generation","volume":"2009","author":"Klann","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"key":"2020121009244333700_ocaa190-B20","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.jbi.2014.09.003","article-title":"The use of sequential pattern mining to predict next prescribed medications","volume":"53","author":"Wright","year":"2015","journal-title":"J Biomed Inform"},{"key":"2020121009244333700_ocaa190-B21","author":"Chen","year":"2016"},{"issue":"2","key":"2020121009244333700_ocaa190-B22","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1093\/jamia\/ocv091","article-title":"OrderRex: clinical order decision support and outcome predictions by data-mining electronic medical records","volume":"23","author":"Chen","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2020121009244333700_ocaa190-B23","first-page":"673","article-title":"Using machine learning to predict the information seeking behavior of clinicians using an electronic medical record system","volume":"2018","author":"King","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"12","key":"2020121009244333700_ocaa190-B24","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1093\/jamia\/ocz171","article-title":"Predicting emergency department orders with multilabel machine learning techniques and simulating effects on length of stay","volume":"26","author":"Hunter-Zinck","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"2020121009244333700_ocaa190-B25","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.4338\/ACI-2017-05-RA-0079","article-title":"Physician beliefs about the meaningful use of the electronic health record: a follow-up study","volume":"08","author":"Emani","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2020121009244333700_ocaa190-B26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1001\/jama.2017.19198","article-title":"What this computer needs is a physician: humanism and artificial intelligence","volume":"319","author":"Verghese","year":"2018","journal-title":"JAMA"},{"key":"2020121009244333700_ocaa190-B27","author":"Gawande","year":"2018"},{"key":"2020121009244333700_ocaa190-B28","first-page":"435","article-title":"Data-mining electronic medical records for clinical order recommendations: wisdom of the crowd or tyranny of the mob?","volume":"2015","author":"Chen","year":"2015","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2020121009244333700_ocaa190-B29","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.jbi.2018.09.005","article-title":"An evaluation of clinical order patterns machine-learned from clinician cohorts stratified by patient mortality outcomes","volume":"86","author":"Wang","year":"2018","journal-title":"J Biomed Inform"},{"issue":"1","key":"2020121009244333700_ocaa190-B30","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MIC.2003.1167344","article-title":"Amazon.com recommendations: item-to-item collaborative filtering","volume":"7","author":"Linden","year":"2003","journal-title":"IEEE Internet Comput"},{"issue":"3","key":"2020121009244333700_ocaa190-B31","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MIC.2017.72","article-title":"Two decades of recommender systems at Amazon.com","volume":"21","author":"Smith","year":"2017","journal-title":"IEEE Internet Comput"},{"issue":"4","key":"2020121009244333700_ocaa190-B32","doi-asserted-by":"crossref","first-page":"e56","DOI":"10.1093\/cid\/cir073","article-title":"Clinical practice guideline for the use of antimicrobial agents in neutropenic patients with cancer: 2010 update by the Infectious Diseases Society of America","volume":"52","author":"Freifeld","year":"2011","journal-title":"Clin Infect Dis"},{"issue":"9","key":"2020121009244333700_ocaa190-B33","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1086\/425368","article-title":"Practice guidelines for the management of bacterial meningitis","volume":"39","author":"Tunkel","year":"2004","journal-title":"Clin Infect Dis"},{"issue":"8","key":"2020121009244333700_ocaa190-B34","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1016\/j.jacc.2015.11.061","article-title":"Management of pulmonary embolism: an update","volume":"67","author":"Konstantinides","year":"2016","journal-title":"J Am Coll Cardiol"},{"issue":"21","key":"2020121009244333700_ocaa190-B35","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1016\/j.jacc.2014.03.022","article-title":"2014 AHA\/ACC\/HRS Guideline for the management of patients with atrial fibrillation: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines and the Heart Rhythm Society","volume":"64","author":"January","year":"2014","journal-title":"J Am Coll Cardiol"},{"issue":"3","key":"2020121009244333700_ocaa190-B36","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1002\/hep.21907","article-title":"Prevention and management of gastroesophageal varices and variceal hemorrhage in cirrhosis","volume":"46","author":"Garcia-Tsao","year":"2007","journal-title":"Hepatology"},{"key":"2020121009244333700_ocaa190-B37","first-page":"89","article-title":"Physician usage and acceptance of a machine learning recommender system for simulated clinical order entry","volume":"2020","author":"Chiang","year":"2020","journal-title":"AMIA Summits Transl Sci Proc"},{"key":"2020121009244333700_ocaa190-B38","first-page":"391","article-title":"STRIDE\u2013An integrated standards-based translational research informatics platform","volume":"2009","author":"Lowe","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"issue":"10","key":"2020121009244333700_ocaa190-B39","first-page":"1","article-title":"The Delphi technique: making sense of consensus","volume":"12","author":"Hsu","year":"2007","journal-title":"Pract Assess Res Eval"},{"issue":"2","key":"2020121009244333700_ocaa190-B40","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"key":"2020121009244333700_ocaa190-B41","doi-asserted-by":"crossref","first-page":"205031211882292","DOI":"10.1177\/2050312118822927","article-title":"Grounded theory research: A design framework for novice researchers","volume":"7","author":"Chun Tie","year":"2019","journal-title":"SAGE Open Med"},{"issue":"2","key":"2020121009244333700_ocaa190-B42","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/00031305.2016.1154108","article-title":"The ASA statement on p-values: context, process, and purpose","volume":"70","author":"Wasserstein","year":"2016","journal-title":"Am Stat"},{"key":"2020121009244333700_ocaa190-B43","article-title":"Fitting Linear Mixed-Effects Models using lme4 [Internet]","author":"Bates","year":"2014","journal-title":"arXiv [Stat.CO]"},{"key":"2020121009244333700_ocaa190-B44","first-page":"4","article-title":"vcd: visualizing categorical data","volume":"1","author":"Zeileis","year":"2020","journal-title":"R Package Version"},{"key":"2020121009244333700_ocaa190-B45","author":"Gamer","year":"2019"},{"issue":"6","key":"2020121009244333700_ocaa190-B46","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1513\/AnnalsATS.201507-466OC","article-title":"Order set to improve the care of patients hospitalized for an exacerbation of chronic obstructive pulmonary disease","volume":"13","author":"Brown","year":"2016","journal-title":"Ann ATS"},{"issue":"7","key":"2020121009244333700_ocaa190-B47","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1177\/0885066617746089","article-title":"Implementation of a goal-directed mechanical ventilation order set driven by respiratory therapists improves compliance with best practices for mechanical ventilation","volume":"34","author":"Radosevich","year":"2019","journal-title":"J Intensive Care Med"},{"issue":"02","key":"2020121009244333700_ocaa190-B48","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1055\/s-0039-1683877","article-title":"Comparison of antibiotic dosing before and after implementation of an electronic order set","volume":"10","author":"Nichols","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"7","key":"2020121009244333700_ocaa190-B49","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1002\/ajh.23450","article-title":"Impact of a venous thromboembolism prophylaxis \u201csmart order set\u201d: improved compliance, fewer events","volume":"88","author":"Zeidan","year":"2013","journal-title":"Am J Hematol"},{"issue":"9","key":"2020121009244333700_ocaa190-B50","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1007\/s11606-019-05057-9","article-title":"Effect of electronic clinical decision support on 25(OH) vitamin D testing","volume":"34","author":"Chin","year":"2019","journal-title":"J Gen Intern Med"},{"issue":"1","key":"2020121009244333700_ocaa190-B51","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/s11606-018-4663-8","article-title":"An electronic best practice alert based on choosing wisely guidelines reduces thrombophilia testing in the outpatient setting","volume":"34","author":"Jun","year":"2019","journal-title":"J Gen Intern Med"},{"key":"2020121009244333700_ocaa190-B52","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.ijmedinf.2017.03.006","article-title":"Decaying relevance of clinical data towards future decisions in data-driven inpatient clinical order sets","volume":"102","author":"Chen","year":"2017","journal-title":"Int J Med Inform"},{"issue":"16","key":"2020121009244333700_ocaa190-B53","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1056\/NEJMoa1800965","article-title":"Education outcomes in a duty-hour flexibility trial in internal medicine","volume":"378","author":"Desai","year":"2018","journal-title":"N Engl J Med"},{"issue":"3","key":"2020121009244333700_ocaa190-B54","first-page":"300","article-title":"Duty-hour flexibility trial in internal medicine","volume":"379","author":"Kumar","year":"2018","journal-title":"N Engl J Med"},{"issue":"2","key":"2020121009244333700_ocaa190-B55","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1001\/jamainternmed.2015.6831","article-title":"Internal medicine resident computer usage: an electronic audit of an inpatient service","volume":"176","author":"Ouyang","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"8","key":"2020121009244333700_ocaa190-B56","doi-asserted-by":"crossref","first-page":"e0221300","DOI":"10.1371\/journal.pone.0221300","article-title":"How are medical students using the Electronic Health Record (EHR)?: An analysis of EHR use on an inpatient medicine rotation","volume":"14","author":"Chi","year":"2019","journal-title":"PLoS One"},{"issue":"2","key":"2020121009244333700_ocaa190-B57","doi-asserted-by":"crossref","first-page":"e0205379","DOI":"10.1371\/journal.pone.0205379","article-title":"Characterizing electronic health record usage patterns of inpatient medicine residents using event log data","volume":"14","author":"Wang","year":"2019","journal-title":"PLoS One"},{"issue":"3","key":"2020121009244333700_ocaa190-B58","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.jclinepi.2013.08.015","article-title":"Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects","volume":"67","author":"McCambridge","year":"2014","journal-title":"J Clin Epidemiol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1850\/34838644\/ocaa190.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1850\/34838644\/ocaa190.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,10]],"date-time":"2020-12-10T09:41:42Z","timestamp":1607593302000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/12\/1850\/5940667"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,27]]},"references-count":58,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,10,27]]},"published-print":{"date-parts":[[2020,12,9]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa190","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.02.24.20025890","asserted-by":"object"}]},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,12]]},"published":{"date-parts":[[2020,10,27]]}}}