{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T11:09:32Z","timestamp":1773486572346,"version":"3.50.1"},"reference-count":18,"publisher":"Georg Thieme Verlag KG","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Time spent in the electronic health record (EHR) has been identified as an important unit of measure for health care provider clinical activity. The lack of validation of audit-log based inpatient EHR time may have resulted in underuse of this data in studies focusing on inpatient patient outcomes, provider efficiency, provider satisfaction, etc. This has also led to a dearth of clinically relevant EHR usage metrics consistent with inpatient provider clinical activity.<\/jats:p><jats:p>\n          Objective\u2003The aim of our study was to validate audit-log based EHR times using observed EHR-times extracted from screen recordings of EHR usage in the inpatient setting.<\/jats:p><jats:p>\n          Methods\u2003This study was conducted in a 36-bed pediatric intensive care unit (PICU) at Lucile Packard Children's Hospital Stanford between June 11 and July 14, 2020. Attending physicians, fellow physicians, hospitalists, and advanced practice providers with \u22650.5 full-time equivalent (FTE) for the prior four consecutive weeks and at least one EHR session recording were included in the study. Citrix session recording player was used to retrospectively review EHR session recordings that were captured as the provider interacted with the EHR.<\/jats:p><jats:p>\n          Results\u2003EHR use patterns varied by provider type. Audit-log based total EHR time correlated strongly with both observed total EHR time (r\u2009=\u20090.98, p\u2009&lt;\u20090.001) and observed active EHR time (r\u2009=\u20090.95, p\u2009&lt;\u20090.001). Each minute of audit-log based total EHR time corresponded to 0.95 (0.87\u20131.02) minutes of observed total EHR time and 0.75 (0.67\u20130.83) minutes of observed active EHR time. Results were similar when stratified by provider role.<\/jats:p><jats:p>\n          Conclusion\u2003Our study found inpatient audit-log based EHR time to correlate strongly with observed EHR time among pediatric critical care providers. These findings support the use of audit-log based EHR-time as a surrogate measure for inpatient provider EHR use, providing an opportunity for researchers and other stakeholders to leverage EHR audit-log data in measuring clinical activity and tracking outcomes of workflow improvement efforts longitudinally and across provider groups.<\/jats:p>","DOI":"10.1055\/s-0041-1733851","type":"journal-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T22:52:26Z","timestamp":1628722346000},"page":"737-744","source":"Crossref","is-referenced-by-count":18,"title":["Measuring Electronic Health Record Use in the Pediatric ICU Using Audit-Logs and Screen Recordings"],"prefix":"10.1055","volume":"12","author":[{"given":"Amrita","family":"Sinha","sequence":"additional","affiliation":[{"name":"Division of Pediatric Critical Care Medicine, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States"}]},{"given":"Lindsay A.","family":"Stevens","sequence":"additional","affiliation":[{"name":"Division of General Pediatrics, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States"}]},{"given":"Felice","family":"Su","sequence":"additional","affiliation":[{"name":"Division of Pediatric Critical Care Medicine, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States"}]},{"given":"Natalie M.","family":"Pageler","sequence":"additional","affiliation":[{"name":"Division of Pediatric Critical Care Medicine, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States"},{"name":"Division of Biomedical Informatics Research, Department of Medicine, Stanford University School of Medicine, Stanford, California, United States"}]},{"given":"Daniel S.","family":"Tawfik","sequence":"additional","affiliation":[{"name":"Division of Pediatric Critical Care Medicine, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States"}]}],"member":"194","published-online":{"date-parts":[[2021,8,11]]},"reference":[{"issue":"08","key":"ref1","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1377\/hlthaff.2016.1651","article-title":"HITECH act drove large gains in hospital electronic health record adoption","volume":"36","author":"J Adler-Milstein","year":"2017","journal-title":"Health Aff (Millwood)"},{"issue":"10","key":"ref2","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1056\/NEJMp1703370","article-title":"The HITECH era and the path forward","volume":"377","author":"V Washington","year":"2017","journal-title":"N Engl J Med"},{"issue":"04","key":"ref7","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1093\/jamia\/ocz223","article-title":"Metrics for assessing physician activity using electronic health record log data","volume":"27","author":"C A Sinsky","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref8","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1093\/jamia\/ocz196","article-title":"Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods","volume":"27","author":"A Rule","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"103343","DOI":"10.1016\/j.jbi.2019.103343","article-title":"EHR audit logs: A new goldmine for health services research?","volume":"101","author":"J Adler-Milstein","year":"2020","journal-title":"J Biomed Inform"},{"issue":"02","key":"ref10","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1093\/jamia\/ocy145","article-title":"Physician stress and burnout: the impact of health information technology","volume":"26","author":"R L Gardner","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"ref11","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1093\/jamiaopen\/ooz003","article-title":"Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden and improves providers' perceived control over their workload in the EHR","volume":"2","author":"Y T DiAngi","year":"2019","journal-title":"JAMIA Open"},{"issue":"05","key":"ref12","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1370\/afm.2121","article-title":"Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations","volume":"15","author":"B G Arndt","year":"2017","journal-title":"Ann Fam Med"},{"issue":"01","key":"ref13","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1093\/jamia\/ocx098","article-title":"Secondary use of electronic health record data for clinical workflow analysis","volume":"25","author":"M R Hribar","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"ref14","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1001\/jamaophthalmol.2017.4187","article-title":"Time requirements for electronic health record use in an academic ophthalmology center","volume":"135","author":"S Read-Brown","year":"2017","journal-title":"JAMA Ophthalmol"},{"key":"ref15","first-page":"1909","article-title":"Secondary use of EHR timestamp data: validation and application for workflow optimization","volume":"2015","author":"M R Hribar","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"issue":"04","key":"ref16","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1377\/hlthaff.2016.0811","article-title":"Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine","volume":"36","author":"M Tai-Seale","year":"2017","journal-title":"Health Aff (Millwood)"},{"issue":"03","key":"ref18","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/j.ophtha.2018.10.009","article-title":"Data-driven scheduling for improving patient efficiency in ophthalmology clinics","volume":"126","author":"M R Hribar","year":"2019","journal-title":"Ophthalmology"},{"issue":"02","key":"ref19","first-page":"e0205379","article-title":"Characterizing electronic health record usage patterns of inpatient medicine residents using event log data","volume":"14","author":"J K Wang","year":"2019"},{"issue":"03","key":"ref21","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1136\/jamia.2010.004333","article-title":"Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review","volume":"17","author":"K M Unertl","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"05","key":"ref22","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1136\/amiajnl-2011-000083","article-title":"Using the time and motion method to study clinical work processes and workflow: methodological inconsistencies and a call for standardized research","volume":"18","author":"K Zheng","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.jbi.2014.02.017","article-title":"Time motion studies in healthcare: what are we talking about?","volume":"49","author":"M Lopetegui","year":"2014","journal-title":"J Biomed Inform"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-17272-9","volume-title":"Cognitive Informatics for Biomedicine: Human Computer Interaction in Healthcare","author":"V L Patel","year":"2015"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0041-1733851.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T22:52:34Z","timestamp":1628722354000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0041-1733851"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":18,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2021,8,4]]},"published-print":{"date-parts":[[2021,8]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0041-1733851","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8]]}}}