{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T08:44:50Z","timestamp":1775810690403,"version":"3.50.1"},"reference-count":56,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T00:00:00Z","timestamp":1693180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"NewYork-Presbyterian and Weill Cornell Medicine"},{"DOI":"10.13039\/100019945","name":"Clinical and Translational Science Center","doi-asserted-by":"publisher","award":["UL1TR002384"],"award-info":[{"award-number":["UL1TR002384"]}],"id":[{"id":"10.13039\/100019945","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,17]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Generation of automated clinical notes has been posited as a strategy to mitigate physician burnout. In particular, an automated narrative summary of a patient\u2019s hospital stay could supplement the hospital course section of the discharge summary that inpatient physicians document in electronic health record (EHR) systems. In the current study, we developed and evaluated an automated method for summarizing the hospital course section using encoder-decoder sequence-to-sequence transformer models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We fine-tuned BERT and BART models and optimized for factuality through constraining beam search, which we trained and tested using EHR data from patients admitted to the neurology unit of an academic medical center.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The approach demonstrated good ROUGE scores with an R-2 of 13.76. In a blind evaluation, 2 board-certified physicians rated 62% of the automated summaries as meeting the standard of care, which suggests the method may be useful clinically.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and conclusion<\/jats:title>\n                  <jats:p>To our knowledge, this study is among the first to demonstrate an automated method for generating a discharge summary hospital course that approaches a quality level of what a physician would write.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad177","type":"journal-article","created":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T19:37:21Z","timestamp":1693251441000},"page":"1995-2003","source":"Crossref","is-referenced-by-count":36,"title":["A method to automate the discharge summary hospital course for neurology patients"],"prefix":"10.1093","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7793-6331","authenticated-orcid":false,"given":"Vince C","family":"Hartman","sequence":"first","affiliation":[{"name":"Cornell Tech , New York, NY 10044, United States"},{"name":"Abstractive Health , New York, NY 10022, United States"}]},{"given":"Sanika S","family":"Bapat","sequence":"additional","affiliation":[{"name":"Cornell Tech , New York, NY 10044, United States"},{"name":"Abstractive Health , New York, NY 10022, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5586-9940","authenticated-orcid":false,"given":"Mark G","family":"Weiner","sequence":"additional","affiliation":[{"name":"Department of Medicine, Weill Cornell Medicine , New York, NY 10065, United States"},{"name":"Department of Population Health, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"given":"Babak B","family":"Navi","sequence":"additional","affiliation":[{"name":"Department of Neurology and Feil Family Brain and Mind Research Institute, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9518-4399","authenticated-orcid":false,"given":"Evan T","family":"Sholle","sequence":"additional","affiliation":[{"name":"Department of Population Health, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7624-769X","authenticated-orcid":false,"suffix":"Jr","given":"Thomas R","family":"Campion","sequence":"additional","affiliation":[{"name":"Department of Population Health, Weill Cornell Medicine , New York, NY 10065, United States"},{"name":"Clinical & Translational Science Center, Weill Cornell Medicine , New York, NY 10065, United States"}]}],"member":"286","published-online":{"date-parts":[[2023,8,28]]},"reference":[{"issue":"5","key":"2023111709552181000_ocad177-B1","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1370\/afm.2121","article-title":"Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations","volume":"15","author":"Arndt","year":"2017","journal-title":"Ann Fam Med"},{"key":"2023111709552181000_ocad177-B2","volume-title":"Physician Burnout in the Electronic Health Record Era: Are We Ignoring the Real Cause","author":"Downing","year":"2018"},{"issue":"12","key":"2023111709552181000_ocad177-B3","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1016\/j.mayocp.2015.08.023","article-title":"Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014","volume":"90","author":"Shanafelt","year":"2015","journal-title":"Mayo Clin Proc"},{"issue":"1","key":"2023111709552181000_ocad177-B4","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1038\/s41746-019-0190-1","article-title":"Challenges of developing a digital scribe to reduce clinical documentation burden","volume":"2","author":"Quiroz","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2023111709552181000_ocad177-B5","first-page":"323; Washington, DC","author":"Hunter","year":"2008"},{"key":"2023111709552181000_ocad177-B6","author":"Shing","year":"2021"},{"key":"2023111709552181000_ocad177-B7","author":"Alsentzer","year":"2018"},{"issue":"8","key":"2023111709552181000_ocad177-B8","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1001\/jama.297.8.831","article-title":"Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care","volume":"297","author":"Kripalani","year":"2007","journal-title":"JAMA"},{"issue":"9","key":"2023111709552181000_ocad177-B9","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1111\/j.1445-5994.2009.02105.x","article-title":"Continuity of care: when do patients visit community healthcare providers after leaving hospital?","volume":"41","author":"Roughead","year":"2011","journal-title":"Intern Med J"},{"issue":"3","key":"2023111709552181000_ocad177-B10","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1046\/j.1525-1497.2002.10741.x","article-title":"Effect of discharge summary availability during post-discharge visits on hospital readmission","volume":"17","author":"Van Walraven","year":"2002","journal-title":"J Gen Intern Med"},{"issue":"10","key":"2023111709552181000_ocad177-B11","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1007\/s00228-009-0680-1","article-title":"Improved quality in the hospital discharge summary reduces medication errors\u2014LIMM: Landskrona Integrated Medicines Management","volume":"65","author":"Bergkvist","year":"2009","journal-title":"Eur J Clin Pharmacol"},{"key":"2023111709552181000_ocad177-B12","volume-title":"Advances in Patient Safety: New Directions and Alternative Approaches","author":"Kind","year":"2008"},{"issue":"12","key":"2023111709552181000_ocad177-B13","first-page":"555-AP11","article-title":"Design and hospitalwide implementation of a standardized discharge summary in an electronic health record","volume":"42","author":"Dean","year":"2016","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2023111709552181000_ocad177-B14","first-page":"4794","author":"Adams","year":"2021"},{"key":"2023111709552181000_ocad177-B15","first-page":"216","author":"Hartman","year":"2022"},{"issue":"1","key":"2023111709552181000_ocad177-B16","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data"},{"key":"2023111709552181000_ocad177-B17","doi-asserted-by":"crossref","first-page":"13248","DOI":"10.1109\/ACCESS.2021.3052783","article-title":"A survey of the state-of-the-art models in neural abstractive text summarization","volume":"9","author":"Syed","year":"2021","journal-title":"IEEE Access"},{"key":"2023111709552181000_ocad177-B18","first-page":"4171","author":"Kenton","year":"2019"},{"key":"2023111709552181000_ocad177-B19","first-page":"7871","author":"Lewis","year":"2020"},{"key":"2023111709552181000_ocad177-B20","first-page":"5998","author":"Vaswani","year":"2017"},{"key":"2023111709552181000_ocad177-B21","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1162\/tacl_a_00313","article-title":"Leveraging pre-trained checkpoints for sequence generation tasks","volume":"8","author":"Rothe","year":"2020","journal-title":"Trans Assoc Comput Linguist"},{"key":"2023111709552181000_ocad177-B22","author":"Rohde","year":"2021"},{"key":"2023111709552181000_ocad177-B23","author":"Yalunin","year":"2022"},{"key":"2023111709552181000_ocad177-B24","author":"Cai","year":"2022; ,"},{"key":"2023111709552181000_ocad177-B25","first-page":"2979","article-title":"Summarizing patients\u2019 problems from hospital progress notes using pre-trained sequence-to-sequence models","volume":"2022","author":"Gao","year":"2022","journal-title":"Proc Int Conf Comput Ling"},{"key":"2023111709552181000_ocad177-B26","first-page":"4958","author":"Krishna","year":"2021"},{"key":"2023111709552181000_ocad177-B27","first-page":"3755","author":"Joshi","year":"2020"},{"key":"2023111709552181000_ocad177-B28","first-page":"5108","author":"Zhang","year":"2020"},{"key":"2023111709552181000_ocad177-B29","first-page":"194","author":"Sun","year":"2019"},{"key":"2023111709552181000_ocad177-B30","author":"Zhang","year":"2020"},{"key":"2023111709552181000_ocad177-B31","author":"Beltagy","year":"2020"},{"key":"2023111709552181000_ocad177-B32","first-page":"4098","author":"Gehrmann","year":"2018"},{"key":"2023111709552181000_ocad177-B33","doi-asserted-by":"crossref","first-page":"3029","DOI":"10.1109\/TASLP.2020.3037401","article-title":"A divide-and-conquer approach to the summarization of long documents","volume":"28","author":"Gidiotis","year":"2020","journal-title":"IEEE\/ACM Trans Audio Speech Lang Process"},{"issue":"4","key":"2023111709552181000_ocad177-B34","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1016\/j.jbi.2011.03.008","article-title":"Summarization of clinical information: a conceptual model","volume":"44","author":"Feblowitz","year":"2011","journal-title":"J Biomed Inform"},{"issue":"4","key":"2023111709552181000_ocad177-B35","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1093\/jamia\/ocab266","article-title":"An architecture for research computing in health to support clinical and translational investigators with electronic patient data","volume":"29","author":"Campion","year":"2022","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2023111709552181000_ocad177-B36","doi-asserted-by":"crossref","first-page":"e184852","DOI":"10.1001\/jamanetworkopen.2018.4852","article-title":"Comparison of the complexity of patients seen by different medical subspecialists in a universal health care system","volume":"1","author":"Tonelli","year":"2018","journal-title":"JAMA Netw Open"},{"key":"2023111709552181000_ocad177-B37"},{"key":"2023111709552181000_ocad177-B38","first-page":"1365","author":"Mullenbach","year":"2021"},{"key":"2023111709552181000_ocad177-B39","author":"Cao","year":"2\u20137, 2018;  ,"},{"key":"2023111709552181000_ocad177-B40","author":"Durmus","year":"2020"},{"key":"2023111709552181000_ocad177-B41","first-page":"2214","author":"Falke","year":"2019"},{"key":"2023111709552181000_ocad177-B42","first-page":"718","author":"Zhu","year":"2021"},{"key":"2023111709552181000_ocad177-B43","first-page":"555","author":"King","year":"2022"},{"key":"2023111709552181000_ocad177-B44","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1162\/tacl_a_00346","article-title":"Best-first beam search","volume":"8","author":"Meister","year":"2020","journal-title":"Trans Assoc Comput Linguist"},{"issue":"Database issue","key":"2023111709552181000_ocad177-B45","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2023111709552181000_ocad177-B46","first-page":"404","author":"Mihalcea","year":"2004"},{"key":"2023111709552181000_ocad177-B47","author":"Xiong","year":"2022"},{"issue":"3","key":"2023111709552181000_ocad177-B48","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1016\/j.amjsurg.2015.12.005","article-title":"Readability of discharge summaries: with what level of information are we dismissing our patients?","volume":"211","author":"Choudhry","year":"2016","journal-title":"Am J Surg"},{"key":"2023111709552181000_ocad177-B49","doi-asserted-by":"crossref","first-page":"S5","DOI":"10.1097\/01.ACM.0000236516.63055.8b","article-title":"Are discharge summaries teachable? The effects of a discharge summary curriculum on the quality of discharge summaries in an internal medicine residency program","volume":"81","author":"Myers","year":"2006","journal-title":"Acad Med"},{"key":"2023111709552181000_ocad177-B50","first-page":"1449","author":"Goyal","year":"2021"},{"issue":"8","key":"2023111709552181000_ocad177-B51","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1093\/intqhc\/mzy075","article-title":"Impact of the implementation of electronic health records on the quality of discharge summaries and on the coding of hospitalization episodes","volume":"30","author":"Bernal","year":"2018","journal-title":"Int J Qual Health Care"},{"issue":"3","key":"2023111709552181000_ocad177-B52","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1016\/j.sapharm.2012.04.004","article-title":"Interrater agreement and interrater reliability: key concepts, approaches, and applications","volume":"9","author":"Gisev","year":"2013","journal-title":"Res Social Adm Pharm"},{"key":"2023111709552181000_ocad177-B53","first-page":"1410","author":"Ladhak","year":"2022"},{"key":"2023111709552181000_ocad177-B54","first-page":"17; Washington, DC","author":"Aronson","year":"2001"},{"issue":"5","key":"2023111709552181000_ocad177-B55","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2023111709552181000_ocad177-B56","author":"Kraljevic","year":"2019"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/12\/1995\/53477606\/ocad177.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/12\/1995\/53477606\/ocad177.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T13:29:03Z","timestamp":1700227743000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/12\/1995\/7252876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,28]]},"references-count":56,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,8,28]]},"published-print":{"date-parts":[[2023,11,17]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad177","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,12,1]]},"published":{"date-parts":[[2023,8,28]]}}}