{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T07:32:38Z","timestamp":1776843158617,"version":"3.51.2"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T00:00:00Z","timestamp":1664409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01 LM013778-01"],"award-info":[{"award-number":["R01 LM013778-01"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009457","name":"American Medical Association","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009457","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,12,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Electronic health record audit logs capture a time-sequenced record of clinician activities while using the system. Audit log data therefore facilitate unobtrusive measurement at scale of clinical work activities and workflow as well as derivative, behavioral proxies (eg, teamwork). Given its considerable research potential, studies leveraging these data have burgeoned. As the field has matured, the challenges of using the data to answer significant research questions have come into focus. In this Perspective, we draw on our research experiences and insights from the broader audit log literature to advance audit log research. Specifically, we make 2 complementary recommendations that would facilitate substantial progress toward audit log-based measures that are: (1) transparent and validated, (2) standardized to allow for multisite studies, (3) sensitive to meaningful variability, (4) broader in scope to capture key aspects of clinical work including teamwork and coordination, and (5) linked to patient and clinical outcomes.<\/jats:p>","DOI":"10.1093\/jamia\/ocac173","type":"journal-article","created":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T16:33:54Z","timestamp":1663346034000},"page":"167-171","source":"Crossref","is-referenced-by-count":39,"title":["Using electronic health record audit log data for research: insights from early efforts"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4119-4836","authenticated-orcid":false,"given":"Thomas","family":"Kannampallil","sequence":"first","affiliation":[{"name":"Department of Anesthesiology, Washington University School of Medicine , St Louis, Missouri,","place":["USA"]},{"name":"Institute for Informatics, Washington University School of Medicine , St Louis, Missouri,","place":["USA"]}]},{"given":"Julia","family":"Adler-Milstein","sequence":"additional","affiliation":[{"name":"Department of Medicine, Center for Clinical Informatics and Improvement Research, University of California , San Francisco, California,","place":["USA"]}]}],"member":"286","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"key":"2026041420160462600_ocac173-B1","doi-asserted-by":"crossref","first-page":"103343","DOI":"10.1016\/j.jbi.2019.103343","article-title":"EHR audit logs: a new goldmine for health services research?","volume":"101","author":"Adler-Milstein","year":"2020","journal-title":"J Biomed Inform"},{"issue":"5","key":"2026041420160462600_ocac173-B2","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1093\/jamia\/ocaa305","article-title":"Conceptual considerations for using EHR-based activity logs to measure clinician burnout and its effects","volume":"28","author":"Kannampallil","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2026041420160462600_ocac173-B3","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1093\/jamiaopen\/ooz003","article-title":"Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden and improves providers\u2019 perceived control over their workload in the EHR","volume":"2","author":"DiAngi","year":"2019","journal-title":"JAMIA Open"},{"issue":"1","key":"2026041420160462600_ocac173-B4","doi-asserted-by":"crossref","first-page":"e4","DOI":"10.2196\/humanfactors.9371","article-title":"Reducing misses and near misses related to multitasking on the electronic health record: observational study and qualitative analysis","volume":"5","author":"Ratanawongsa","year":"2018","journal-title":"JMIR Hum Factors"},{"issue":"7","key":"2026041420160462600_ocac173-B5","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1097\/CCM.0b013e31821858a0","article-title":"The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance","volume":"39","author":"Ahmed","year":"2011","journal-title":"Crit Care Med"},{"issue":"2","key":"2026041420160462600_ocac173-B6","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1093\/jamia\/ocy145","article-title":"Physician stress and burnout: the impact of health information technology","volume":"26","author":"Gardner","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2026041420160462600_ocac173-B7","author":"National Academies of Sciences, Engineering, and Medicine, National Academy of Medicine, Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well-Being","year":"2019"},{"issue":"7","key":"2026041420160462600_ocac173-B8","first-page":"836","article-title":"Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction","volume":"91","author":"Shanafelt","year":"2016","journal-title":"Elsevier"},{"issue":"1","key":"2026041420160462600_ocac173-B9","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1093\/jamiaopen\/ooy016","article-title":"The electronic elephant in the room: physicians and the electronic health record","volume":"1","author":"Kroth","year":"2018","journal-title":"JAMIA Open"},{"issue":"e1","key":"2026041420160462600_ocac173-B10","doi-asserted-by":"crossref","first-page":"e100","DOI":"10.1136\/amiajnl-2013-001875","article-title":"Electronic medical records and physician stress in primary care: results from the MEMO Study","volume":"21","author":"Babbott","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2026041420160462600_ocac173-B11","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1197\/jamia.M1700","article-title":"The impact of electronic health records on time efficiency of physicians and nurses: a systematic review","volume":"12","author":"Poissant","year":"2005","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2026041420160462600_ocac173-B12","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1016\/j.healthpol.2018.05.014","article-title":"The impact of electronic health record systems on clinical documentation times: a systematic review","volume":"122","author":"Baumann","year":"2018","journal-title":"Health Policy"},{"issue":"6","key":"2026041420160462600_ocac173-B13","doi-asserted-by":"crossref","first-page":"706","DOI":"10.4300\/JGME-D-16-00847.1","article-title":"Attending physician remote access of the electronic health record and implications for resident supervision: a mixed methods study","volume":"9","author":"Martin","year":"2017","journal-title":"J Grad Med Educ"},{"issue":"5","key":"2026041420160462600_ocac173-B14","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1370\/afm.2121","article-title":"Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations","volume":"15","author":"Arndt","year":"2017","journal-title":"Ann Fam Med"},{"issue":"3","key":"2026041420160462600_ocac173-B15","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1093\/jamia\/ocz196","article-title":"Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods","volume":"27","author":"Rule","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2026041420160462600_ocac173-B16","article-title":"Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures","author":"Rule","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2026041420160462600_ocac173-B17","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1093\/jamia\/ocz223","article-title":"Metrics for assessing physician activity using electronic health record log data","volume":"27","author":"Sinsky","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2026041420160462600_ocac173-B18","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1055\/s-0041-1733851","article-title":"Measuring electronic health record use in the pediatric ICU using audit-logs and screen recordings","volume":"12","author":"Sinha","year":"2021","journal-title":"Appl Clin Inform"},{"issue":"9","key":"2026041420160462600_ocac173-B19","doi-asserted-by":"crossref","first-page":"2165","DOI":"10.1007\/s11606-022-07620-3","article-title":"Temporal associations between EHR-derived workload, burnout, and errors: a prospective cohort study","volume":"37","author":"Lou","year":"2022","journal-title":"J Gen Intern Med"},{"issue":"2","key":"2026041420160462600_ocac173-B20","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1001\/jamainternmed.2015.6831","article-title":"Internal medicine resident computer usage: an electronic audit of an inpatient service","volume":"176","author":"Ouyang","year":"2016","journal-title":"JAMA Intern Med"},{"issue":"10","key":"2026041420160462600_ocac173-B21","doi-asserted-by":"crossref","first-page":"e2128790","DOI":"10.1001\/jamanetworkopen.2021.28790","article-title":"Analysis of electronic health record use and clinical productivity and their association with physician turnover","volume":"4","author":"Melnick","year":"2021","journal-title":"JAMA Netw Open"},{"issue":"3","key":"2026041420160462600_ocac173-B22","doi-asserted-by":"crossref","DOI":"10.1161\/CIRCOUTCOMES.116.003326","article-title":"Smartphone-based geofencing to ascertain hospitalizations","volume":"10","author":"Nguyen","year":"2017","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"4","key":"2026041420160462600_ocac173-B23","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1093\/jamia\/ocz222","article-title":"Have you got the time? Challenges using vendor electronic health record metrics of provider efficiency","volume":"27","author":"Hron","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2026041420160462600_ocac173-B24"},{"issue":"1","key":"2026041420160462600_ocac173-B25","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1097\/MLR.0000000000001450","article-title":"Measuring primary care exam length using electronic health record data","volume":"59","author":"Neprash","year":"2021","journal-title":"Med Care"},{"issue":"3","key":"2026041420160462600_ocac173-B26","doi-asserted-by":"crossref","first-page":"169","DOI":"10.7326\/M18-3684","article-title":"Physician time spent using the electronic health record during outpatient encounters: a descriptive study","volume":"172","author":"Overhage","year":"2020","journal-title":"Ann Intern Med"},{"issue":"4","key":"2026041420160462600_ocac173-B27","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1093\/jamia\/ocz220","article-title":"Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians","volume":"27","author":"Adler-Milstein","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2026041420160462600_ocac173-B28","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1377\/hlthaff.2018.05509","article-title":"Physicians\u2019 well-being linked to in-basket messages generated by algorithms in electronic health records","volume":"38","author":"Tai-Seale","year":"2019","journal-title":"Health Aff (Millwood)"},{"issue":"1","key":"2026041420160462600_ocac173-B29","doi-asserted-by":"crossref","first-page":"e22","DOI":"10.1016\/j.bja.2022.04.012","article-title":"Effect of clinician attention switching on workload and wrong-patient errors","volume":"129","author":"Lou","year":"2022","journal-title":"Br J Anaesth"},{"issue":"1","key":"2026041420160462600_ocac173-B30","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1207\/s15516709cog2601_3","article-title":"Spanning seven orders of magnitude: a challenge for cognitive modeling","volume":"26","author":"Anderson","year":"2002","journal-title":"Cogn Sci"},{"issue":"9","key":"2026041420160462600_ocac173-B31","doi-asserted-by":"crossref","first-page":"e28998","DOI":"10.2196\/28998","article-title":"Measuring collaboration through concurrent electronic health record usage: network analysis study","volume":"9","author":"Li","year":"2021","journal-title":"JMIR Med Inform"},{"issue":"6","key":"2026041420160462600_ocac173-B32","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1093\/jamia\/ocaa338","article-title":"Mining tasks and task characteristics from electronic health record audit logs with unsupervised machine learning","volume":"28","author":"Chen","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"4-05","key":"2026041420160462600_ocac173-B33","first-page":"109","article-title":"Modeling care team structures in the neonatal intensive care unit through network analysis of EHR audit logs","volume":"58","author":"Chen","year":"2019","journal-title":"Methods Inf Med"},{"key":"2026041420160462600_ocac173-B34","first-page":"953","article-title":"Context is key: using the audit log to capture contextual factors affecting stroke care processes","volume":"2020","author":"Noshad","year":"2020","journal-title":"AMIA Annu Symp Proc"},{"issue":"18","key":"2026041420160462600_ocac173-B35","doi-asserted-by":"crossref","first-page":"1780","DOI":"10.1001\/jama.2019.3698","article-title":"Effect of restriction of the number of concurrently open records in an electronic health record on wrong-patient order errors: a randomized clinical trial","volume":"321","author":"Adelman","year":"2019","journal-title":"JAMA"},{"issue":"2","key":"2026041420160462600_ocac173-B36","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1136\/amiajnl-2012-001055","article-title":"Understanding and preventing wrong-patient electronic orders: a randomized controlled trial","volume":"20","author":"Adelman","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2026041420160462600_ocac173-B37","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1542\/peds.2015-0007","article-title":"Use of temporary names for newborns and associated risks","volume":"136","author":"Adelman","year":"2015","journal-title":"Pediatrics"},{"issue":"5","key":"2026041420160462600_ocac173-B38","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1542\/peds.2016-2863","article-title":"Evaluating serial strategies for preventing wrong-patient orders in the NICU","volume":"139","author":"Adelman","year":"2017","journal-title":"Pediatrics"},{"issue":"8","key":"2026041420160462600_ocac173-B39","doi-asserted-by":"crossref","first-page":"1791","DOI":"10.1093\/jamia\/ocab072","article-title":"Association between limiting the number of open records in a tele-critical care setting and retract\u2013reorder errors","volume":"28","author":"Udeh","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2026041420160462600_ocac173-B40","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1093\/jamia\/ocv202","article-title":"PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability","volume":"23","author":"Kirby","year":"2016","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/1\/167\/47829277\/ocac173.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/1\/167\/47829277\/ocac173.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T00:28:38Z","timestamp":1776212918000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/1\/167\/6730781"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,29]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,9,29]]},"published-print":{"date-parts":[[2022,12,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac173","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,1,1]]},"published":{"date-parts":[[2022,9,29]]}}}