{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T02:11:04Z","timestamp":1782180664544,"version":"3.54.5"},"reference-count":32,"publisher":"Georg Thieme Verlag KG","issue":"01","funder":[{"name":"National Institutes of Health\/National Library of Medicine","award":["T15LM011271"],"award-info":[{"award-number":["T15LM011271"]}]},{"DOI":"10.13039\/100000052","name":"NIH Office of the Director","doi-asserted-by":"crossref","award":["DP5OD029610"],"award-info":[{"award-number":["DP5OD029610"]}],"id":[{"id":"10.13039\/100000052","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Costs vary substantially among electronic medical knowledge resources used for clinical decision support, warranting periodic assessment of institution-wide adoption.<\/jats:p><jats:p>\n          Objectives\u2003To compare two medical knowledge resources, UpToDate and DynaMed Plus, regarding accuracy and time required to answer standardized clinical questions and user experience.<\/jats:p><jats:p>\n          Methods\u2003A crossover trial design was used, wherein physicians were randomized to first use one of the two medical knowledge resources to answer six standardized questions. Following use of each resource, they were surveyed regarding their user experience. The percentage of accurate answers and time required to answer each question were recorded. The surveys assessed ease of use, enjoyment using the resource, quality of information, and ability to assess level of evidence. Tests of carry-over effects were performed. Themes were identified within open-ended survey comments regarding overall user experience.<\/jats:p><jats:p>\n          Results\u2003Among 26 participating physicians, accuracy of answers differed by 4 percentage points or less. For all but one question, there were no significant differences in the time required for completion. Most participants felt both resources were easy to use, contained high quality of information, and enabled assessment of the level of evidence. A greater proportion of participants endorsed enjoyment of use with UpToDate (23\/26, 88%) compared with DynaMed Plus (16\/26, 62%). Themes from open-ended comments included interface\/information presentation, coverage of clinical topics, search functions, and utility for clinical decision-making. The majority (59%) of open-ended comments expressed an overall preference for UpToDate, compared with 19% preferring DynaMed Plus.<\/jats:p><jats:p>\n          Conclusion\u2003DynaMed Plus is noninferior to UpToDate with respect to ability to achieve accurate answers, time required for answering clinical questions, ease of use, quality of information, and ability to assess level of evidence. However, user experience was more positive with UpToDate. Future studies of electronic medical knowledge resources should continue to emphasize evaluation of usability and user experience.<\/jats:p>","DOI":"10.1055\/s-0041-1742216","type":"journal-article","created":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T00:04:26Z","timestamp":1643846666000},"page":"139-147","source":"Crossref","is-referenced-by-count":12,"title":["Comparing the Use of DynaMed and UpToDate by Physician Trainees in Clinical Decision-Making: A Randomized Crossover Trial"],"prefix":"10.1055","volume":"13","author":[{"given":"Sally L.","family":"Baxter","sequence":"additional","affiliation":[{"name":"Health Department of Biomedical Informatics, University of California San Diego, La Jolla, California, United States"},{"name":"Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lina","family":"Lander","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Clay","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Bell","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristen","family":"Hansen","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amanda","family":"Walker","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Tai-Seale","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, University of California San Diego, La Jolla, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2022,2,2]]},"reference":[{"issue":"02","key":"ref1","doi-asserted-by":"crossref","first-page":"e20","DOI":"10.2196\/mededu.8188","article-title":"Comparison of the impact of Wikipedia, UpToDate, and a digital textbook on short-term knowledge acquisition among medical students: randomized controlled trial of three web-based resources","volume":"3","author":"M A Scaffidi","year":"2017","journal-title":"JMIR Med Educ"},{"issue":"03","key":"ref2","doi-asserted-by":"crossref","first-page":"e10769","DOI":"10.2196\/10769","article-title":"Exploring how evidence is used in care through an organizational ethnography of two teaching hospitals","volume":"21","author":"B Lander","year":"2019","journal-title":"J Med Internet Res"},{"issue":"01","key":"ref3","doi-asserted-by":"crossref","first-page":"e4","DOI":"10.2196\/mededu.4267","article-title":"Information-seeking behaviors of medical students: a cross-sectional web-based survey","volume":"1","author":"A M O'Carroll","year":"2015","journal-title":"JMIR Med Educ"},{"issue":"03","key":"ref4","doi-asserted-by":"crossref","first-page":"e16279","DOI":"10.2196\/16279","article-title":"Undergraduate medical students' search for health information online: explanatory cross-sectional study","volume":"8","author":"T Loda","year":"2020","journal-title":"JMIR Med Inform"},{"issue":"02","key":"ref5","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.ajem.2007.03.031","article-title":"Answering clinical questions in the ED","volume":"26","author":"M A Graber","year":"2008","journal-title":"Am J Emerg Med"},{"issue":"04","key":"ref6","first-page":"293","article-title":"How to find answers to clinical questions","volume":"79","author":"M H Ebell","year":"2009","journal-title":"Am Fam Physician"},{"issue":"01","key":"ref7","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1111\/hir.12002","article-title":"How doctors make use of online, point-of-care clinical decision support systems: a case study of UpToDate\u00a9","volume":"30","author":"J Addison","year":"2013","journal-title":"Health Info Libr J"},{"issue":"01","key":"ref8","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1002\/chp.1340240106","article-title":"Physicians' Internet information-seeking behaviors","volume":"24","author":"N L Bennett","year":"2004","journal-title":"J Contin Educ Health Prof"},{"issue":"02","key":"ref9","doi-asserted-by":"crossref","first-page":"305","DOI":"10.4338\/ACI-2014-11-RA-0104","article-title":"Point-of-care knowledge-based resource needs of clinicians: a survey from a large academic medical center","volume":"6","author":"M A Ellsworth","year":"2015","journal-title":"Appl Clin Inform"},{"issue":"07","key":"ref10","doi-asserted-by":"crossref","first-page":"e13315","DOI":"10.2196\/13315","article-title":"Impact of clinicians' use of electronic knowledge resources on clinical and learning outcomes: systematic review and meta-analysis","volume":"21","author":"L A Maggio","year":"2019","journal-title":"J Med Internet Res"},{"issue":"01","key":"ref12","doi-asserted-by":"crossref","first-page":"e15","DOI":"10.2196\/jmir.5234","article-title":"Providing doctors with high-quality information: an updated evaluation of web-based point-of-care information summaries","volume":"18","author":"K H Kwag","year":"2016","journal-title":"J Med Internet Res"},{"issue":"04","key":"ref13","doi-asserted-by":"crossref","first-page":"e117","DOI":"10.2196\/mhealth.6189","article-title":"Breadth of coverage, ease of use, and quality of mobile point-of-care tool information summaries: an evaluation","volume":"4","author":"E Johnson","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"06","key":"ref14","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1370\/afm.370","article-title":"Physicians answer more clinical questions and change clinical decisions more often with synthesized evidence: a randomized trial in primary care","volume":"3","author":"B S Alper","year":"2005","journal-title":"Ann Fam Med"},{"issue":"03","key":"ref15","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3949\/ccjm.84a.15087","article-title":"Staying afloat in a sea of information: point-of-care resources","volume":"84","author":"R Andrews","year":"2017","journal-title":"Cleve Clin J Med"},{"issue":"01","key":"ref16","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1080\/02763869.2019.1547055","article-title":"Reevaluating point-of-care resources: community engagement in difficult collection choices","volume":"38","author":"R R Walden","year":"2019","journal-title":"Med Ref Serv Q"},{"issue":"03","key":"ref17","doi-asserted-by":"crossref","first-page":"247","DOI":"10.3163\/1536-5050.99.3.012","article-title":"Developing and using a rubric for evaluating evidence-based medicine point-of-care tools","volume":"99","author":"S Shurtz","year":"2011","journal-title":"J Med Libr Assoc"},{"issue":"02","key":"ref18","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1080\/02763869.2018.1439221","article-title":"DynaMed Plus\u00ae: an evidence-based clinical reference resource","volume":"37","author":"D H Charbonneau","year":"2018","journal-title":"Med Ref Serv Q"},{"key":"ref19","first-page":"64","article-title":"Technology acceptance models in health informatics: TAM and UTAUT","volume":"263","author":"E Ammenwerth","year":"2019","journal-title":"Stud Health Technol Inform"},{"issue":"01","key":"ref20","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2009.07.002","article-title":"The technology acceptance model: its past and its future in health care","volume":"43","author":"R J Holden","year":"2010","journal-title":"J Biomed Inform"},{"issue":"04","key":"ref21","first-page":"435","article-title":"An evaluation of five bedside information products using a user-centered, task-oriented approach","volume":"94","author":"R Campbell","year":"2006","journal-title":"J Med Libr Assoc"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"l4378","DOI":"10.1136\/bmj.l4378","article-title":"CONSORT 2010 statement: extension to randomised crossover trials","volume":"366","author":"K Dwan","year":"2019","journal-title":"BMJ"},{"issue":"01","key":"ref24","doi-asserted-by":"crossref","first-page":"e21","DOI":"10.2196\/jmir.1539","article-title":"Type of evidence behind point-of-care clinical information products: a bibliometric analysis","volume":"13","author":"A M Ketchum","year":"2011","journal-title":"J Med Internet Res"},{"issue":"06","key":"ref25","doi-asserted-by":"crossref","first-page":"e175","DOI":"10.2196\/jmir.2105","article-title":"How current are leading evidence-based medical textbooks? An analytic survey of four online textbooks","volume":"14","author":"R Jeffery","year":"2012","journal-title":"J Med Internet Res"},{"key":"ref26","doi-asserted-by":"crossref","first-page":"d5856","DOI":"10.1136\/bmj.d5856","article-title":"Speed of updating online evidence based point of care summaries: prospective cohort analysis","volume":"343","author":"R Banzi","year":"2011","journal-title":"BMJ"},{"issue":"03","key":"ref27","doi-asserted-by":"crossref","first-page":"382","DOI":"10.5195\/jmla.2021.1176","article-title":"UpToDate versus DynaMed: a cross-sectional study comparing the speed and accuracy of two point-of-care information tools","volume":"109","author":"G Bradley-Ridout","year":"2021","journal-title":"J Med Libr Assoc"},{"issue":"01","key":"ref28","doi-asserted-by":"crossref","first-page":"38","DOI":"10.3163\/1536-5050.101.1.007","article-title":"The value of library and information services in patient care: results of a multisite study","volume":"101","author":"J G Marshall","year":"2013","journal-title":"J Med Libr Assoc"},{"issue":"10","key":"ref29","first-page":"878","article-title":"Evaluation of e-textbooks. DynaMed, MD Consult and UpToDate","volume":"37","author":"F Goodyear-Smith","year":"2008","journal-title":"Aust Fam Physician"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/S0140-6736(16)31592-6","article-title":"Progress in evidence-based medicine: a quarter century on","volume":"390","author":"B Djulbegovic","year":"2017","journal-title":"Lancet"},{"issue":"07","key":"ref31","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1097\/ACM.0b013e3182951959","article-title":"Evidence-based medicine training in undergraduate medical education: a review and critique of the literature published 2006-2011","volume":"88","author":"L A Maggio","year":"2013","journal-title":"Acad Med"},{"issue":"01","key":"ref32","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1186\/s13643-020-01311-y","article-title":"A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education","volume":"9","author":"B Kumaravel","year":"2020","journal-title":"Syst Rev"},{"issue":"05","key":"ref33","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1136\/bmjebm-2020-111542","article-title":"Understanding of research results, evidence summaries and their applicability-not critical appraisal-are core skills of medical curriculum","volume":"26","author":"K AO Tikkinen","year":"2021","journal-title":"BMJ Evid Based Med"},{"key":"ref34","first-page":"206","volume-title":"A mathematical model of the finding of usability problems","author":"J Nielsen","year":"1993"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0041-1742216.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T00:04:59Z","timestamp":1643846699000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0041-1742216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1]]},"references-count":32,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2022,1,5]]},"published-print":{"date-parts":[[2022,1]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0041-1742216","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1]]}}}