{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:50:17Z","timestamp":1791420617499,"version":"4.3.3"},"reference-count":33,"publisher":"American Academy of Pediatrics (AAP)","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"\n BACKGROUND AND OBJECTIVES<\/jats:title>\n Patients and caregivers who use languages other than English in health care settings rarely receive language-concordant discharge instructions. Large language models show promise for improving access to translations but must be validated to ensure their output is safe for clinical use. This study measured the quality of GPT-4o medical translations to Portuguese, Haitian Creole, and Arabic.<\/jats:p>\n <\/jats:sec>\n \n METHODS<\/jats:title>\n Previously translated personalized discharge instructions (performed by professional human translators) were extracted from inpatient admissions at a large US pediatric academic medical center. The discharge instructions were translated to Portuguese, Haitian Creole, and Arabic by GPT-4o. Medical translators then evaluated the translations using both the Multidimensional Quality Metrics (MQM) framework and a preference scale.<\/jats:p>\n <\/jats:sec>\n \n RESULTS<\/jats:title>\n Translations of 14 to 20 discharge instructions for each of the 3 languages were evaluated. Noninferiority testing showed no significant difference in translation quality between GPT-4o and human translations for Portuguese and Arabic, but worse performance by GPT-4o than human translations for Haitian Creole (mean MQM score 90.5\u2009\u00b1 SD\u20095.5 vs 97.0\u2009\u00b1\u2009SD 2.1). Linguists preferred the human translation over GPT-4o in 69% (SE\u2009=\u20097%) of the Haitian Creole cases.<\/jats:p>\n <\/jats:sec>\n \n CONCLUSIONS<\/jats:title>\n In this cross-sectional study, GPT-4o translation performance of pediatric discharge instructions was noninferior for Portuguese and Arabic but was worse in Haitian Creole. Human validation of medical translations remains necessary for all languages, but large language models can be used to draft high-quality translations in languages with proven high performance, while resources are shifted toward more intensive post-editing of translations in languages with lower performance.<\/jats:p>\n <\/jats:sec>","DOI":"10.1542\/hpeds.2026-009476","type":"journal-article","created":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:02:33Z","timestamp":1791417753000},"source":"Crossref","is-referenced-by-count":0,"title":["GPT-4o Translation of Pediatric Discharge Instructions Across Languages"],"prefix":"10.1542","author":[{"given":"Daniel J","family":"Kats","sequence":"first","affiliation":[{"name":"1Division of General Pediatrics, Department of Pediatrics, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mondira","family":"Ray","sequence":"additional","affiliation":[{"name":"1Division of General Pediatrics, Department of Pediatrics, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joss","family":"Moorkens","sequence":"additional","affiliation":[{"name":"3School of Applied Language & Intercultural Studies, Dublin City University, Dublin, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dinesh","family":"Rai","sequence":"additional","affiliation":[{"name":"4Innovation and Digital Health Accelerator, Boston Children\u2019s Hospital, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan CL","family":"Brewster","sequence":"additional","affiliation":[{"name":"1Division of General Pediatrics, Department of Pediatrics, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"},{"name":"5Department of Neonatology, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alisa","family":"Khan","sequence":"additional","affiliation":[{"name":"1Division of General Pediatrics, Department of Pediatrics, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Rader","sequence":"additional","affiliation":[{"name":"4Innovation and Digital Health Accelerator, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"6Department of Anesthesia, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John S","family":"Brownstein","sequence":"additional","affiliation":[{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"},{"name":"4Innovation and Digital Health Accelerator, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"7Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan D","family":"Hron","sequence":"additional","affiliation":[{"name":"1Division of General Pediatrics, Department of Pediatrics, Boston Children\u2019s Hospital, Boston, Massachusetts"},{"name":"2Department of Pediatrics, Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"417","published-online":{"date-parts":[[2026,10,8]]},"reference":[{"issue":"12","key":"2026100720022819900_r1","doi-asserted-by":"crossref","first-page":"e203215","DOI":"10.1001\/jamapediatrics.2020.3215","article-title":"Association Between Parent Comfort With English and Adverse Events Among Hospitalized Children","volume":"174","author":"Khan","year":"2020","journal-title":"JAMA Pediatr."},{"issue":"2","key":"2026100720022819900_r2","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1093\/intqhc\/mzl069","article-title":"Language proficiency and adverse events in US hospitals: a pilot study","volume":"19","author":"Divi","year":"2007","journal-title":"Int J Qual Health Care."},{"issue":"3","key":"2026100720022819900_r3","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1542\/hpeds.2012-0091","article-title":"Association between language, serious adverse events, and length of stay among hospitalized children","volume":"3","author":"Lion","year":"2013","journal-title":"Hosp Pediatr."},{"issue":"10","key":"2026100720022819900_r4","doi-asserted-by":"crossref","first-page":"1294","DOI":"10.1007\/s11606-012-2041-5","article-title":"Professional language interpretation and inpatient length of stay and readmission rates","volume":"27","author":"Lindholm","year":"2012","journal-title":"J Gen Intern Med."},{"issue":"3","key":"2026100720022819900_r5","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1542\/peds.2005-0521","article-title":"Are language barriers associated with serious medical events in hospitalized pediatric patients?","volume":"116","author":"Cohen","year":"2005","journal-title":"Pediatrics."},{"issue":"8","key":"2026100720022819900_r6","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1001\/jamapediatrics.2022.1831","article-title":"Association of Patient and Family Reports of Hospital Safety Climate With Language Proficiency in the US","volume":"176","author":"Khan","year":"2022","journal-title":"JAMA Pediatr."},{"key":"2026100720022819900_r7","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.ajem.2024.09.024","article-title":"Languages other than English in a pediatric ED: Documentation, extended stays, and revisits","volume":"85","author":"Ray","year":"2024","journal-title":"Am J Emerg Med."},{"issue":"6","key":"2026100720022819900_r8","doi-asserted-by":"crossref","first-page":"e2022059386","DOI":"10.1542\/peds.2022-059386","article-title":"Undertriage for Children With Caregivers Preferring Languages Other Than English","volume":"151","author":"Rojas","year":"2023","journal-title":"Pediatrics."},{"issue":"2","key":"2026100720022819900_r9","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.acap.2013.10.003","article-title":"Parental limited English proficiency and health outcomes for children with special health care needs: a systematic review","volume":"14","author":"Eneriz-Wiemer","year":"2014","journal-title":"Acad Pediatr."},{"issue":"2","key":"2026100720022819900_r10","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.jpeds.2005.10.046","article-title":"Primary language of parent is associated with disparities in pediatric preventive care","volume":"148","author":"Cohen","year":"2006","journal-title":"J Pediatr."},{"issue":"1","key":"2026100720022819900_r11","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1186\/s12913-018-3823-1","article-title":"Language assistance for limited English proficiency patients in a public ED: determining the unmet need","volume":"19","author":"Taira","year":"2019","journal-title":"BMC Health Serv Res."},{"issue":"7","key":"2026100720022819900_r12","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1542\/hpeds.2018-0250","article-title":"Completeness of Written Discharge Guidance for English- and Spanish-Speaking Patient Families","volume":"9","author":"Platter","year":"2019","journal-title":"Hosp Pediatr."},{"issue":"11","key":"2026100720022819900_r13","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1542\/hpeds.2021-005981","article-title":"Improving Discharge Instructions for Hospitalized Children With Limited English Proficiency","volume":"11","author":"Choe","year":"2021","journal-title":"Hosp Pediatr."},{"issue":"3","key":"2026100720022819900_r14","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1542\/hpeds.2020-000745","article-title":"Disparity in Nurse Discharge Communication for Hospitalized Families Based on English Proficiency","volume":"11","author":"Choe","year":"2021","journal-title":"Hosp Pediatr."},{"key":"2026100720022819900_r15","article-title":"ACA Continues to Break Down Barriers to Health Care for all Americans","author":"Office for Civil Rights","year":"2016"},{"key":"2026100720022819900_r16","article-title":"Guidance to Federal Financial Assistance Recipients Regarding Title VI Prohibition Against National Origin Discrimination Affecting Limited English Proficient Persons","author":"Department of Justice"},{"issue":"17","key":"2026100720022819900_r17","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1001\/jama.2024.15296","article-title":"Artificial Intelligence for Language Translation: The Equity Is in the Details","volume":"332","author":"Lion","year":"2024","journal-title":"JAMA."},{"issue":"1","key":"2026100720022819900_r18","doi-asserted-by":"crossref","first-page":"e2023065573","DOI":"10.1542\/peds.2023-065573","article-title":"Performance of ChatGPT and Google Translate for Pediatric Discharge Instruction Translation","volume":"154","author":"Brewster","year":"2024","journal-title":"Pediatrics."},{"issue":"11","key":"2026100720022819900_r19","doi-asserted-by":"crossref","first-page":"6161","DOI":"10.1007\/s00405-024-08708-8","article-title":"The utility of ChatGPT as a generative medical translator","volume":"281","author":"Grimm","year":"2024","journal-title":"Eur Arch Oto-Rhino-Laryngol."},{"issue":"9","key":"2026100720022819900_r20","doi-asserted-by":"crossref","first-page":"e2532312","DOI":"10.1001\/jamanetworkopen.2025.32312","article-title":"Accuracy of Artificial Intelligence vs Professionally Translated Discharge Instructions","volume":"8","author":"Martos","year":"2025","journal-title":"JAMA Netw Open."},{"issue":"3","key":"2026100720022819900_r21","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1136\/bmjqs-2024-018384","article-title":"Evaluation of the accuracy and safety of machine translation of patient-specific discharge instructions: a comparative analysis","volume":"35","author":"Kong","year":"2026","journal-title":"BMJ Qual Saf."},{"key":"2026100720022819900_r22","article-title":"To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation","author":"Kocmi","year":"2021"},{"key":"2026100720022819900_r23","article-title":"Span-Level Machine Translation Meta-Evaluation","author":"Perrella","year":"2026"},{"issue":"9","key":"2026100720022819900_r24","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1001\/jamapediatrics.2025.1729","article-title":"Evaluating a Large Language Model in Translating Patient Instructions to Spanish Using a Standardized Framework","volume":"179","author":"Ray","year":"2025","journal-title":"JAMA Pediatr."},{"issue":"12","key":"2026100720022819900_r25","doi-asserted-by":"crossref","first-page":"455","DOI":"10.5565\/rev\/tradumatica.77","article-title":"Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics","author":"Lommel","year":"2014","journal-title":"Tradum\u00e0tica Tecnol Trad."},{"key":"2026100720022819900_r26","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/978-3-319-91241-7_6","volume-title":"Translation Quality Assessment: From Principles to Practice","author":"Lommel","year":"2018"},{"key":"2026100720022819900_r27","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1162\/tacl_a_00437","article-title":"Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation","volume":"9","author":"Freitag","year":"2021","journal-title":"Trans Assoc Comput Linguist."},{"key":"2026100720022819900_r28","article-title":"MQM Council","author":"Multidimensional Quality Metrics"},{"key":"2026100720022819900_r29","article-title":"Language Models are Few-Shot Learners","author":"Brown"},{"key":"2026100720022819900_r30","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1162\/tacl_a_00638","article-title":"Lost in the Middle: How Language Models Use Long Contexts","volume":"12","author":"Liu","year":"2024","journal-title":"Trans Assoc Comput Linguist."},{"issue":"88","key":"2026100720022819900_r31","first-page":"37522","article-title":"Nondiscrimination in Health Programs and Activities","volume":"89","author":"Office for Civil Rights, Office of the Secretary, Department of Health and Human Services, Centers for Medicare & Medicaid Services, Department of Health and Human Services","year":"2024","journal-title":"Fed Regist."},{"issue":"23","key":"2026100720022819900_r32","doi-asserted-by":"crossref","first-page":"244","DOI":"10.5565\/rev\/tradumatica.520","article-title":"Machine Translation at the Hospital: Healthcare Professionals\u2019 Perspectives on Use, Appropriateness, and Policy","author":"Valdez","year":"2025","journal-title":"Tradum\u00e0tica Tecnol Trad."},{"issue":"1","key":"2026100720022819900_r33","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1038\/s41746-025-02055-6","article-title":"Evaluating human-in-the-loop strategies for artificial intelligence-enabled translation of patient discharge instructions: a multidisciplinary analysis","volume":"8","author":"Brewster","year":"2025","journal-title":"NPJ Digit Med."}],"container-title":["Hospital Pediatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/doi\/10.1542\/hpeds.2026-009476\/1975747\/hosppeds.2026009476.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/doi\/10.1542\/hpeds.2026-009476\/1975747\/hosppeds.2026009476.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:02:37Z","timestamp":1791417757000},"score":1,"resource":{"primary":{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article\/doi\/10.1542\/hpeds.2026-009476\/210798\/GPT-4o-Translation-of-Pediatric-Discharge"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,8]]},"references-count":33,"URL":"https:\/\/doi.org\/10.1542\/hpeds.2026-009476","relation":{},"ISSN":["2154-1663","2154-1671"],"issn-type":[{"value":"2154-1663","type":"print"},{"value":"2154-1671","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,8]]},"article-number":"e2026009476"}}