{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,21]],"date-time":"2025-09-21T18:06:23Z","timestamp":1758477983458},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,9,9]],"date-time":"2019-09-09T00:00:00Z","timestamp":1567987200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,9,9]],"date-time":"2019-09-09T00:00:00Z","timestamp":1567987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Monitoring and managing resident workload is a cornerstone of policy in graduate medical education, and the duty hours metric is the backbone of current regulations. While the duty hours metric measures hours worked, it does not capture differences in intensity of work completed during those hours, which may independently contribute to fatigue and burnout. Few such metrics exist. Digital data streams generated during the usual course of hospital operations can serve as a novel source of insight into workload intensity by providing high-resolution, minute-by-minute data at the individual level; however, study and use of these data streams for workload monitoring has been limited to date. Paging data is one such data stream. In this work, we analyze over 500,000 pages\u2014two full years of pages in an academic internal medicine residency program\u2014to characterize paging patterns among housestaff. We demonstrate technical feasibility, validity, and utility of paging burden as a metric to provide insight into resident workload beyond duty hours alone, and illustrate a general framework for evaluation and incorporation of novel digital data streams into resident workload monitoring.<\/jats:p>","DOI":"10.1038\/s41746-019-0165-2","type":"journal-article","created":{"date-parts":[[2019,9,9]],"date-time":"2019-09-09T10:03:08Z","timestamp":1568023388000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Beyond duty hours: leveraging large-scale paging data to monitor resident workload"],"prefix":"10.1038","volume":"2","author":[{"given":"Amit","family":"Kaushal","sequence":"first","affiliation":[]},{"given":"Laurence","family":"Katznelson","sequence":"additional","affiliation":[]},{"given":"Robert A.","family":"Harrington","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,9,9]]},"reference":[{"key":"165_CR1","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1056\/NEJM198803243181209","volume":"318","author":"DA Asch","year":"1988","unstructured":"Asch, D. A. & Parker, R. M. The Libby Zion case. One step forward or two steps backward? N. Engl. J. Med. 318, 771\u2013775 (1988).","journal-title":"N. Engl. J. Med."},{"key":"165_CR2","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1056\/NEJMoa041401","volume":"352","author":"LK Barger","year":"2005","unstructured":"Barger, L. K. et al. Extended work shifts and the risk of motor vehicle crashes among interns. N. Engl. J. Med. 352, 125\u2013134 (2005).","journal-title":"N. Engl. J. Med."},{"key":"165_CR3","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0030487","volume":"3","author":"LK Barger","year":"2006","unstructured":"Barger, L. K. et al. Impact of extended-duration shifts on medical errors, adverse events, and attentional failures. PLoS Med. 3, e487 (2006).","journal-title":"PLoS Med."},{"key":"165_CR4","doi-asserted-by":"publisher","first-page":"2374","DOI":"10.1001\/jama.2014.15277","volume":"312","author":"R Rajaram","year":"2014","unstructured":"Rajaram, R. et al. Association of the 2011 ACGME resident duty hour reform with general surgery patient outcomes and with resident examination performance. JAMA 312, 2374\u20132384 (2014).","journal-title":"JAMA"},{"key":"165_CR5","doi-asserted-by":"publisher","first-page":"2364","DOI":"10.1001\/jama.2014.15273","volume":"312","author":"MS Patel","year":"2014","unstructured":"Patel, M. S. et al. Association of the 2011 ACGME resident duty hour reforms with mortality and readmissions among hospitalized medicare patients. JAMA 312, 2364\u20132373 (2014).","journal-title":"JAMA"},{"key":"165_CR6","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1056\/NEJMoa1515724","volume":"374","author":"KY Bilimoria","year":"2016","unstructured":"Bilimoria, K. Y. et al. National cluster-randomized trial of duty-hour flexibility in surgical training. N. Engl. J. Med. 374, 713\u2013727 (2016).","journal-title":"N. Engl. J. Med."},{"key":"165_CR7","doi-asserted-by":"publisher","first-page":"1585","DOI":"10.1056\/NEJM198812153192406","volume":"319","author":"MH Katz","year":"1988","unstructured":"Katz, M. H. & Schroeder, S. A. The sounds of the hospital. Paging patterns in three teaching hospitals. N. Engl. J. Med. 319, 1585\u20131589 (1988).","journal-title":"N. Engl. J. Med."},{"key":"165_CR8","first-page":"307","volume":"151","author":"R Harvey","year":"1994","unstructured":"Harvey, R., Jarrett, P. G. & Peltekian, K. M. Patterns of paging medical interns during night calls at two teaching hospitals. CMAJ 151, 307\u2013311 (1994).","journal-title":"CMAJ"},{"key":"165_CR9","doi-asserted-by":"publisher","first-page":"467","DOI":"10.4300\/JGME-D-11-00306.1","volume":"4","author":"KM Fargen","year":"2012","unstructured":"Fargen, K. M., O\u2019Connor, T., Raymond, S., Sporrer, J. M. & Friedman, W. A. An observational study of hospital paging practices and workflow interruption among on-call junior neurological surgery residents. J. Grad. Med. Educ. 4, 467\u2013471 (2012).","journal-title":"J. Grad. Med. Educ."},{"key":"165_CR10","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.1001\/jamainternmed.2017.2133","volume":"177","author":"A Luxenberg","year":"2017","unstructured":"Luxenberg, A., Chan, B., Khanna, R. & Sarkar, U. Efficiency and interpretability of text paging communication for medical inpatients: a mixed-methods analysis. JAMA Intern. Med. 177, 1218\u20131220 (2017).","journal-title":"JAMA Intern. Med."},{"key":"165_CR11","doi-asserted-by":"publisher","first-page":"1324","DOI":"10.1111\/j.1553-2712.2011.01236.x","volume":"18","author":"AJ Singer","year":"2011","unstructured":"Singer, A. J., Thode, H. C., Viccellio, P. & Pines, J. M. The association between length of emergency department boarding and mortality. Acad. Emerg. Med. 18, 1324\u20131329 (2011).","journal-title":"Acad. Emerg. Med."},{"key":"165_CR12","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1097\/MEJ.0b013e328344917e","volume":"18","author":"PK Plunkett","year":"2011","unstructured":"Plunkett, P. K., Byrne, D. G., Breslin, T., Bennett, K. & Silke, B. Increasing wait times predict increasing mortality for emergency medical admissions. Eur. J. Emerg. Med. 18, 192\u2013196 (2011).","journal-title":"Eur. J. Emerg. Med."},{"key":"165_CR13","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1016\/j.ajem.2013.06.028","volume":"31","author":"RG Hill","year":"2013","unstructured":"Hill, R. G., Sears, L. M. & Melanson, S. W. 4000 clicks: a productivity analysis of electronic medical records in a community hospital ED. Am. J. Emerg. Med. 31, 1591\u20131594 (2013).","journal-title":"Am. J. Emerg. Med."},{"key":"165_CR14","doi-asserted-by":"publisher","first-page":"753","DOI":"10.7326\/M16-0961","volume":"165","author":"C Sinsky","year":"2016","unstructured":"Sinsky, C. et al. Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties. Ann. Intern. Med. 165, 753\u2013760 (2016).","journal-title":"Ann. Intern. Med."},{"key":"165_CR15","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1001\/jamainternmed.2015.6831","volume":"176","author":"D Ouyang","year":"2016","unstructured":"Ouyang, D., Chen, J. H., Hom, J. & Chi, J. Internal medicine resident computer usage: an electronic audit of an inpatient service. JAMA Intern. Med. 176, 252\u2013254 (2016).","journal-title":"JAMA Intern. Med."},{"key":"165_CR16","unstructured":"Bontemps, T. Kawhi: In-season rest key to availability in Finals. espn.com https:\/\/www.espn.com\/nba\/story\/_\/id\/26922607\/kawhi-season-rest-key-availability-finals. (Accessed 18 July 2019)."},{"key":"165_CR17","first-page":"391","volume":"2009","author":"HJ Lowe","year":"2009","unstructured":"Lowe, H. J., Ferris, T. A., Hernandez, P. M. & Weber, S. C. STRIDE\u2013An integrated standards-based translational research informatics platform. AMIA Annu. Symp. Proc. 2009, 391\u2013395 (2009).","journal-title":"AMIA Annu. Symp. Proc."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0165-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0165-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0165-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T18:32:59Z","timestamp":1671301979000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0165-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,9]]},"references-count":17,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["165"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0165-2","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,9]]},"assertion":[{"value":"15 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 August 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"87"}}