{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T09:02:19Z","timestamp":1774602139216,"version":"3.50.1"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T00:00:00Z","timestamp":1724371200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Patients are increasingly being given direct access to their medical records. However, radiology reports are written for clinicians and typically contain medical jargon, which can be confusing. One solution is for radiologists to provide a \u201ccolloquial\u201d version that is accessible to the layperson. Because manually generating these colloquial translations would represent a significant burden for radiologists, a way to automatically produce accurate, accessible patient-facing reports is desired. We propose a novel method to produce colloquial translations of radiology reports by providing specialized prompts to a large language model (LLM).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Our method automatically extracts and defines medical terms and includes their definitions in the LLM prompt. Using our method and a naive strategy, translations were generated at 4 different reading levels for 100 de-identified neuroradiology reports from an academic medical center. Translations were evaluated by a panel of radiologists for accuracy, likability, harm potential, and readability.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Our approach translated the Findings and Impression sections at the 8th-grade level with accuracies of 88% and 93%, respectively. Across all grade levels, our approach was 20% more accurate than the baseline method. Overall, translations were more readable than the original reports, as evaluated using standard readability indices.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>We find that our translations at the eighth-grade level strike an optimal balance between accuracy and readability. Notably, this corresponds to nationally recognized recommendations for patient-facing health communication. We believe that using this approach to draft patient-accessible reports will benefit patients without significantly increasing the burden on radiologists.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae223","type":"journal-article","created":{"date-parts":[[2024,8,24]],"date-time":"2024-08-24T00:27:34Z","timestamp":1724459254000},"page":"2660-2667","source":"Crossref","is-referenced-by-count":12,"title":["Generating colloquial radiology reports with large language models"],"prefix":"10.1093","volume":"31","author":[{"given":"Cynthia Crystal","family":"Tang","sequence":"first","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Supriya","family":"Nagesh","sequence":"additional","affiliation":[{"name":"Amazon Web Services , East Palo Alto, CA 94303,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0833-9148","authenticated-orcid":false,"given":"David A","family":"Fussell","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Justin","family":"Glavis-Bloom","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Nina","family":"Mishra","sequence":"additional","affiliation":[{"name":"Amazon Web Services , East Palo Alto, CA 94303,","place":["United States"]}]},{"given":"Charles","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Gillean","family":"Cortes","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Robert","family":"Hill","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Jasmine","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Angellica","family":"Gordon","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Joshua","family":"Wright","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Hayden","family":"Troutt","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]},{"given":"Rod","family":"Tarrago","sequence":"additional","affiliation":[{"name":"Amazon Web Services , Seattle, WA 98121,","place":["United States"]}]},{"given":"Daniel S","family":"Chow","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, University of California, Irvine , Irvine, CA 92868,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2024,8,23]]},"reference":[{"issue":"8","key":"2024102107542999500_ocae223-B1","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1016\/j.jacr.2018.03.032","article-title":"Radiology report readability: an opportunity to improve patient communication","volume":"15","author":"Trofimova","year":"2018","journal-title":"J Am Coll Radiol"},{"issue":"2","key":"2024102107542999500_ocae223-B2","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1007\/s10278-021-00439-0","article-title":"Radiology reporting in the era of patient-centered care: how can we improve readability?","volume":"34","author":"Patil","year":"2021","journal-title":"J Digit Imaging"},{"issue":"7","key":"2024102107542999500_ocae223-B3","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1016\/j.jacr.2021.01.016","article-title":"21st century Cures Act: patient-facing implications of information blocking","volume":"18","author":"Mehan","year":"2021","journal-title":"J Am Coll Radiol"},{"issue":"4","key":"2024102107542999500_ocae223-B4","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.jacr.2011.12.023","article-title":"Access to radiologic reports via a patient portal: clinical simulations to investigate patient preferences","volume":"9","author":"Johnson","year":"2012","journal-title":"J Am Coll Radiol"},{"issue":"1","key":"2024102107542999500_ocae223-B5","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/s13244-020-00930-2","article-title":"Understanding patient needs and gaps in radiology reports through online discussion forum analysis","volume":"12","author":"Alarifi","year":"2021","journal-title":"Insights Imaging"},{"issue":"3","key":"2024102107542999500_ocae223-B6","doi-asserted-by":"crossref","first-page":"e233572","DOI":"10.1001\/jamanetworkopen.2023.3572","article-title":"Perspectives of patients about immediate access to test results through an online patient portal","volume":"6","author":"Steitz","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"3","key":"2024102107542999500_ocae223-B7","doi-asserted-by":"crossref","first-page":"407","DOI":"10.59249\/NKOY5498","article-title":"Focus: big data: artificial intelligence to improve patient understanding of radiology reports","volume":"96","author":"Amin","year":"2023","journal-title":"Yale J Biol Med"},{"issue":"9","key":"2024102107542999500_ocae223-B8","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1016\/j.acra.2017.03.005","article-title":"Patients\u2019 use and evaluation of an online system to annotate radiology reports with lay language definitions","volume":"24","author":"Cook","year":"2017","journal-title":"Acad Radiol"},{"issue":"4","key":"2024102107542999500_ocae223-B9","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1007\/s10278-016-9864-2","article-title":"PORTER: a prototype system for patient-oriented radiology reporting","volume":"29","author":"Oh","year":"2016","journal-title":"J Digit Imaging"},{"issue":"12","key":"2024102107542999500_ocae223-B10","doi-asserted-by":"crossref","first-page":"e8536","DOI":"10.2196\/jmir.8536","article-title":"Text simplification using consumer health vocabulary to generate patient-centered radiology reporting: translation and evaluation","volume":"19","author":"Qenam","year":"2017","journal-title":"J Med Internet Res"},{"issue":"8","key":"2024102107542999500_ocae223-B11","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nature Medicine"},{"issue":"1","key":"2024102107542999500_ocae223-B12","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1038\/s41746-023-00873-0","article-title":"The imperative for regulatory oversight of large language models (or generative AI) in healthcare","volume":"6","author":"Mesk\u00f3","year":"2023","journal-title":"NPJ Digital Medicine"},{"key":"2024102107542999500_ocae223-B13","doi-asserted-by":"crossref","DOI":"10.1067\/j.cpradiol.2023.08.018","article-title":"Radiology reading room for the future: harnessing the power of large language models like ChatGPT","author":"Tippareddy","year":"2023","journal-title":"Curr Probl Diagn Radiol"},{"key":"2024102107542999500_ocae223-B14","author":"Doshi-Velez","year":"2017"},{"issue":"2","key":"2024102107542999500_ocae223-B15","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1148\/radiol.16142770","article-title":"Natural language processing in radiology: a systematic review","volume":"279","author":"Pons","year":"2016","journal-title":"Radiology"},{"issue":"1","key":"2024102107542999500_ocae223-B16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s42492-023-00136-5","article-title":"Translating radiology reports into plain language using ChatGPT and GPT-4 with prompt learning: results, limitations, and potential","volume":"6","author":"Lyu","year":"2023","journal-title":"Vis Comput Ind Biomed Art"},{"issue":"12","key":"2024102107542999500_ocae223-B17","first-page":"e50881","article-title":"Assessing ChatGPT\u2019s proficiency in simplifying radiological reports for healthcare professionals and patients","volume":"15","author":"Sarangi","year":"2023","journal-title":"Cureus"},{"issue":"5","key":"2024102107542999500_ocae223-B18","doi-asserted-by":"crossref","first-page":"2817","DOI":"10.1007\/s00330-023-10213-1","article-title":"ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports","volume":"34","author":"Jeblick","year":"2023","journal-title":"Eur Radiol"},{"issue":"1","key":"2024102107542999500_ocae223-B19","doi-asserted-by":"crossref","first-page":"e0000082","DOI":"10.1371\/journal.pdig.0000082","article-title":"Synthetic data in health care: a narrative review","volume":"2","author":"Gonzales","year":"2023","journal-title":"PLOS Digit Health"},{"issue":"4","key":"2024102107542999500_ocae223-B20","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.jemermed.2019.06.043","article-title":"Quality, trustworthiness, readability, and accuracy of medical information regarding common pediatric emergency medicine-related complaints on the web","volume":"57","author":"Rothrock","year":"2019","journal-title":"J Emerg Med"},{"key":"2024102107542999500_ocae223-B21","author":"Kincaid","year":"1975"},{"key":"2024102107542999500_ocae223-B22","author":"Dhuliawala","year":"2023"},{"key":"2024102107542999500_ocae223-B23","first-page":"1844","author":"Bhatia","year":"2019"},{"key":"2024102107542999500_ocae223-B24","volume-title":"The technique of clear writing","author":"Gunning","year":"1968","edition":"Rev ed"},{"key":"2024102107542999500_ocae223-B25","first-page":"639","article-title":"SMOG grading-a new readability formula","volume":"12","author":"McLaughlin","year":"1969","journal-title":"J Read"},{"issue":"2","key":"2024102107542999500_ocae223-B26","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1037\/h0076540","article-title":"A computer readability formula designed for machine scoring","volume":"60","author":"Coleman","year":"1975","journal-title":"J Appl Psychol"},{"key":"2024102107542999500_ocae223-B27","first-page":"1","article-title":"Automated readability index","author":"Smith","year":"1967","journal-title":"Amrl Tr"},{"key":"2024102107542999500_ocae223-B28","author":"Wang","year":"2023"},{"issue":"9","key":"2024102107542999500_ocae223-B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3560815","article-title":"Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing","volume":"55","author":"Liu","year":"2023","journal-title":"ACM Comput Surv"},{"issue":"10","key":"2024102107542999500_ocae223-B30","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s10916-021-01761-4","article-title":"Deep learning-based natural language processing in radiology: the impact of report complexity, disease prevalence, dataset size, and algorithm type on model performance","volume":"45","author":"Olthof","year":"2021","journal-title":"J Med Syst"},{"key":"2024102107542999500_ocae223-B31","doi-asserted-by":"crossref","first-page":"2374373521998847","DOI":"10.1177\/2374373521998847","article-title":"Readability of patient education materials from high-impact medical journals: a 20-year analysis","volume":"8","author":"Rooney","year":"2021","journal-title":"J Patient Exp"},{"key":"2024102107542999500_ocae223-B32","first-page":"31210","author":"Shi","year":"2023"},{"issue":"4","key":"2024102107542999500_ocae223-B33","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1097\/JU.0000000000003615","article-title":"Evaluating the effectiveness of artificial intelligence-powered large language models application in disseminating appropriate and readable health information in urology","volume":"210","author":"Davis","year":"2023","journal-title":"J Urol"},{"key":"2024102107542999500_ocae223-B34","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.clinimag.2018.12.006","article-title":"Readability of radiology reports: implications for patient-centered care","volume":"54","author":"Martin-Carreras","year":"2019","journal-title":"Clin Imaging"},{"issue":"6","key":"2024102107542999500_ocae223-B35","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.jacr.2014.12.009","article-title":"Patients prefer results from the ordering provider and access to their radiology reports","volume":"12","author":"Cabarrus","year":"2015","journal-title":"J Am Coll Radiol"},{"issue":"2","key":"2024102107542999500_ocae223-B36","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1148\/radiol.2512090177","article-title":"The radiology report of the future","volume":"251","author":"Hall","year":"2009","journal-title":"Radiology"},{"key":"2024102107542999500_ocae223-B37","author":"Youdelman","year":"2022"},{"key":"2024102107542999500_ocae223-B38","author":"Fu","year":"2023"},{"issue":"17","key":"2024102107542999500_ocae223-B39","doi-asserted-by":"crossref","first-page":"19053","DOI":"10.1609\/aaai.v38i17.29872","article-title":"Scieval: a multi-level large language model evaluation benchmark for scientific research","volume":"38","author":"Sun","year":"2024","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2024102107542999500_ocae223-B40","author":"Jiang","year":"2023"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/11\/2660\/59813704\/ocae223.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/11\/2660\/59813704\/ocae223.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,21]],"date-time":"2024-10-21T07:55:03Z","timestamp":1729497303000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/11\/2660\/7740004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,23]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,8,23]]},"published-print":{"date-parts":[[2024,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae223","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,11]]},"published":{"date-parts":[[2024,8,23]]}}}