{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T10:10:12Z","timestamp":1788775812989,"version":"build-2803163510"},"reference-count":24,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["shmpublications.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Hospital Medicine"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>After\u2010visit summaries (AVSs) are essential for a safe hospital discharge, yet are often written above literacy levels, omit key information, and are produced under substantial clinical time pressure. Large language models (LLMs) offer a potential solution, while performance and safety in real clinical workflows remain uncertain.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To compare the quality, understandability, actionability, and safety of LLM\u2010generated versus physician\u2010authored after\u2010visit summaries for hospitalized patients.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a retrospective, blinded comparison of physician\u2010authored AVSs and LLM\u2010generated AVSs for 50 adults discharged from the University of California San Diego Health hospital medicine service in 2023. The physician\u2010authored hospital course served as source text for generating AVSs using GPT\u20104 and Gemma 3n 2. Both were prompted to produce sixth\u2010grade level, patient\u2010centered AVSs. Five attending physicians independently evaluated each AVS using the Patient Education Materials Assessment Tool (PEMAT) for understandability and actionability and the AVSrubric, an instrument assessing accuracy, comprehensiveness, clarity, consistency with the medical record, tone and empathy, and potential for harm.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      LLM\u2010generated AVSs had higher PEMAT scores than physician\u2010authored AVSs (understandability: 85.5% (GPT\u20104), 87.5% (Gemma), and 66.1% (physician\u2010authored); actionability: 70.9% (GPT\u20104), 74.1% (Gemma) vs. 56.7% (physician\u2010authored); all\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u2009.001). On the AVSrubric, LLM\u2010generated AVSs received higher ratings than physician\u2010authored AVSs across all domains with GPT\u20104 demonstrating significantly higher in all five, while Gemma showed significant improvements in clarity, readability, tone, and empathy.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>In this blinded evaluation, LLM\u2010generated AVSs were clearer, more comprehensive, and more empathetic than physician\u2010authored AVSs and were associated with lower physician\u2010rated potential for harm. A physician\u2010in\u2010the\u2010loop LLM workflow may improve discharge communication while reducing clinician burden and warrants prospective evaluation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/jhm.70435","type":"journal-article","created":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T09:38:46Z","timestamp":1788773926000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Comparison of physician\u2010authored and artificial intelligence\u2010generated after\u2010visit summaries: A blinded comparative study"],"prefix":"10.1002","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-7997-3053","authenticated-orcid":false,"given":"Milla","family":"Kviatkovsky","sequence":"first","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0588-2871","authenticated-orcid":false,"given":"Caden","family":"Stewart","sequence":"additional","affiliation":[{"name":"The Hal\u0131c\u0131o\u011flu Data Science Institute La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5668-0728","authenticated-orcid":false,"given":"Annalise","family":"McDonald","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Xing","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9927-0849","authenticated-orcid":false,"given":"Sara","family":"Gianella","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Gelberg","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-6198-0467","authenticated-orcid":false,"given":"Bryan","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shadi","family":"Mayasy","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristina","family":"Djekic","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maryann","family":"Ally","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3613-816X","authenticated-orcid":false,"given":"Ian","family":"Jenkins","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Smarr","sequence":"additional","affiliation":[{"name":"The Hal\u0131c\u0131o\u011flu Data Science Institute La Jolla California USA"},{"name":"The Shu Chien\u2014Gene Lay Department of Bioengineering La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8980-2330","authenticated-orcid":false,"given":"Karandeep","family":"Singh","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3158-5681","authenticated-orcid":false,"given":"Robert","family":"El\u2010Kareh","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Medicine University of California San Diego La Jolla California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,7]]},"reference":[{"issue":"8","key":"e_1_2_8_2_1","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2021.19346","article-title":"Interventions to improve communication at hospital discharge and rates of readmission: a systematic review and meta\u2010analysis","volume":"4","author":"Becker C","year":"2021","journal-title":"JAMA Network Open"},{"issue":"3","key":"e_1_2_8_3_1","doi-asserted-by":"crossref","DOI":"10.1136\/bmjoq-2021-001810","article-title":"Improving patient understanding on discharge from the short stay unit: an integrated human factors and quality improvement approach","volume":"11","author":"Cook JLE","year":"2022","journal-title":"BMJ Open Qual"},{"issue":"18","key":"e_1_2_8_4_1","first-page":"1715","article-title":"Quality of discharge practices and patient understanding at an academic medical center","volume":"173","author":"Horwitz LI","year":"2013","journal-title":"JAMA Intern Med"},{"issue":"5","key":"e_1_2_8_5_1","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1001\/jamainternmed.2023.0070","article-title":"Assessment of patient education delivered at time of hospital discharge","volume":"183","author":"Trivedi SP","year":"2023","journal-title":"JAMA Intern Med"},{"key":"e_1_2_8_6_1","volume-title":"Facilitating Patient Understanding of Discharge Instructions: Workshop Summary","author":"Roundtable on Health Literacy; Board on Population Health and Public Health Practice; Institute of Medicine","year":"2014"},{"issue":"3","key":"e_1_2_8_7_1","doi-asserted-by":"crossref","DOI":"10.1136\/bmjoq-2021-001419","article-title":"Empowering patients: simplifying discharge instructions","volume":"10","author":"DeSai C","year":"2021","journal-title":"BMJ Open Qual"},{"issue":"9","key":"e_1_2_8_8_1","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1001\/archinte.1997.00440300148014","article-title":"Patient\u2010physician communication at hospital discharge and patients' understanding of the postdischarge treatment plan","volume":"157","author":"Calkins DR","year":"1997","journal-title":"Arch Intern Med"},{"issue":"5","key":"e_1_2_8_9_1","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1016\/S0025-6196(11)60728-3","article-title":"Functional health literacy and understanding of medications at discharge","volume":"83","author":"Maniaci MJ","year":"2008","journal-title":"Mayo Clin Proc"},{"issue":"5","key":"e_1_2_8_10_1","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1370\/afm.2121","article-title":"Tethered to the EHR: primary care physician workload assessment using EHR event log data and time\u2010motion observations","volume":"15","author":"Arndt BG","year":"2017","journal-title":"Ann Fam Med"},{"issue":"3","key":"e_1_2_8_11_1","doi-asserted-by":"crossref","first-page":"169","DOI":"10.7326\/M18-3684","article-title":"Physician time spent using the electronic health record during outpatient encounters: a descriptive study","volume":"172","author":"Overhage JM","year":"2020","journal-title":"Ann Intern Med"},{"issue":"11","key":"e_1_2_8_12_1","doi-asserted-by":"crossref","first-page":"753","DOI":"10.7326\/M16-0961","article-title":"Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties","volume":"165","author":"Sinsky C","year":"2016","journal-title":"Ann Intern Med"},{"issue":"18","key":"e_1_2_8_13_1","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1001\/archinternmed.2012.3199","article-title":"Burnout and satisfaction with work\u2010life balance among US physicians relative to the general US population","volume":"172","author":"Shanafelt TD","year":"2012","journal-title":"Arch Intern Med"},{"key":"e_1_2_8_14_1","doi-asserted-by":"crossref","DOI":"10.17226\/25521","volume-title":"Taking Action Against Clinician Burnout: A Systems Approach to Professional Well\u2010Being","author":"National Academies of Sciences, Engineering, and Medicine; National Academy of Medicine; Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well\u2010Being","year":"2019"},{"issue":"3","key":"e_1_2_8_15_1","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2024.0357","article-title":"Generative artificial intelligence to transform inpatient discharge summaries to Patient\u2010Friendly language and format","volume":"7","author":"Zaretsky J","year":"2024","journal-title":"JAMA Netw Open"},{"issue":"1","key":"e_1_2_8_16_1","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-025-01618-7","article-title":"Automated generation of discharge summaries: leveraging large language models with clinical data","volume":"15","author":"Ganzinger M","year":"2025","journal-title":"Sci Rep"},{"key":"e_1_2_8_17_1","doi-asserted-by":"crossref","unstructured":"OsborneT AbbasiS HongS et al. Towards inpatient discharge summary automation via large language models: a multidimensional evaluation with a HIPAA\u2010compliant instance of GPT\u20104o and clinical expert assessment. medRxiv. Preprint posted April 3 2025.doi:10.1101\/2025.04.03.25325204","DOI":"10.1101\/2025.04.03.25325204"},{"issue":"1","key":"e_1_2_8_18_1","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1038\/s41746-024-01336-w","article-title":"The quality and safety of using generative AI to produce patient\u2010centred discharge instructions","volume":"7","author":"Stanceski K","year":"2024","journal-title":"npj Digit Med"},{"key":"e_1_2_8_19_1","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1002\/jhm.70163","article-title":"Quality assessment of artificial intelligence\u2010generated versus human\u2010written hospital summaries evaluating detail, usefulness, and continuity of care","volume":"21","author":"Challener D","year":"2025","journal-title":"J Hosp Med"},{"issue":"8","key":"e_1_2_8_20_1","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2025.26339","article-title":"Evaluating hospital course summarization by an electronic health Record\u2013Based large language model","volume":"8","author":"Small WR","year":"2025","journal-title":"JAMA Netw Open"},{"issue":"8","key":"e_1_2_8_21_1","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2025.26350","article-title":"Advancing toward clinical deployment of AI\u2010generated discharge summaries\u2014beyond the bench","volume":"8","author":"Raghu Subramanian C","year":"2025","journal-title":"JAMA Netw Open"},{"issue":"3","key":"e_1_2_8_22_1","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/j.pec.2014.05.027","article-title":"Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information","volume":"96","author":"Shoemaker SJ","year":"2014","journal-title":"Patient Educ Couns"},{"issue":"6","key":"e_1_2_8_23_1","doi-asserted-by":"crossref","DOI":"10.1097\/MD.0000000000032791","article-title":"How understandable are the patient education materials about flat foot on the internet for parents?","volume":"102","author":"\u00c7iftci S","year":"2023","journal-title":"Medicine"},{"key":"e_1_2_8_24_1","doi-asserted-by":"crossref","DOI":"10.1161\/JAHA.123.030140","article-title":"Evaluating readability, understandability, and actionability of online printable patient education materials for cholesterol management: a systematic review","volume":"13","author":"Bhatt C","year":"2024","journal-title":"J Am Heart Assoc"},{"key":"e_1_2_8_25_1","doi-asserted-by":"crossref","DOI":"10.2196\/60336","article-title":"Patient\u2010representing population's perceptions of GPT\u2010generated versus standard emergency department discharge instructions: randomized blind survey assessment","volume":"26","author":"Huang T","year":"2024","journal-title":"J Med Internet Res"}],"container-title":["Journal of Hospital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/shmpublications.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jhm.70435","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/shmpublications.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/jhm.70435","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/shmpublications.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jhm.70435","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T09:38:51Z","timestamp":1788773931000},"score":1,"resource":{"primary":{"URL":"https:\/\/shmpublications.onlinelibrary.wiley.com\/doi\/10.1002\/jhm.70435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,7]]},"references-count":24,"alternative-id":["10.1002\/jhm.70435"],"URL":"https:\/\/doi.org\/10.1002\/jhm.70435","archive":["Portico"],"relation":{},"ISSN":["1553-5592","1553-5606"],"issn-type":[{"value":"1553-5592","type":"print"},{"value":"1553-5606","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,7]]},"assertion":[{"value":"2026-02-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"jhm.70435"}}