{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T00:36:34Z","timestamp":1793752594703,"version":"4.6.1"},"reference-count":35,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Radiology reports convey critical medical information to health care providers and patients. Unfortunately, they are often difficult for patients to comprehend, causing confusion and anxiety, thereby limiting patient engagement in health care decision-making. Large language models (LLMs) like ChatGPT (OpenAI) can create simplified, patient-friendly report summaries to increase accessibility, albeit with errors.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n We evaluated the accuracy and clarity of ChatGPT-generated summaries compared to original radiologist-assessed radiology reports, assessed patients\u2019 understanding and satisfaction with the summaries compared to the original reports, and compared the readability of the original reports and summaries using validated readability metrics.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We anonymized 30 radiology reports created by neuroradiologists at our institution (6 brain magnetic resonance imaging, 6 brain computed tomography, 6 head and neck computed tomography angiography, 6 neck computed tomography, and 6 spine computed tomography). These anonymized reports were processed by ChatGPT to produce patient-centric summaries. Four board-certified neuroradiologists evaluated the ChatGPT-generated summaries on quality and accuracy compared to the original reports, and 4 patient volunteers separately evaluated the reports and summaries on perceived understandability and satisfaction. Readability was assessed using word count and validated readability scales.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n After reading the summary, patient confidence in understanding (98%, 116\/118 vs 26%, 31\/118) and satisfaction regarding the level of jargon\/terminology (91%, 107\/118 vs 8%, 9\/118) and time taken to understand the content (97%, 115\/118 vs 23%, 27\/118) substantially improved. Ninety-two percent (108\/118) of responses indicated the summary clarified patients\u2019 questions about the report, and 98% (116\/118) of responses indicated patients would use the summary if available, with 67% (79\/118) of responses indicating they would want access to both the report and summary, while 26% (31\/118) of responses indicated only wanting the summary. Eighty-three percent (100\/120) of radiologist responses indicated the summary represented the original report \u201cextremely well\u201d or \u201cvery well,\u201d with only 5% (6\/120) of responses indicating it did so \u201cslightly well\u201d or \u201cnot well at all.\u201d Five percent (6\/120) of responses indicated there was missing relevant medical information in the summary, 12% (14\/120) reported instances of overemphasis of nonsignificant findings, and 18% (22\/120) reported instances of underemphasis of significant findings. No fabricated findings were identified. Overall, 83% (99\/120) of responses indicated that the summary would definitely\/probably not lead patients to incorrect conclusions about the original report, with 10% (12\/120) of responses indicating the summaries may do so.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n ChatGPT-generated summaries could significantly improve perceived comprehension and satisfaction while accurately reflecting most key information from original radiology reports. Instances of minor omissions and under-\/overemphasis were noted in some summaries, underscoring the need for ongoing validation and oversight. Overall, these artificial intelligence\u2013generated, patient-centric summaries hold promise for enhancing patient-centered communication in radiology.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/76097","type":"journal-article","created":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T02:55:07Z","timestamp":1750992907000},"page":"e76097-e76097","source":"Crossref","is-referenced-by-count":14,"title":["Evaluating the Quality and Understandability of Radiology Report Summaries Generated by ChatGPT: Survey Study"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7125-8628","authenticated-orcid":false,"given":"Alexis","family":"Sunshine","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5928-7402","authenticated-orcid":false,"given":"Grace H","family":"Honce","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2315-7767","authenticated-orcid":false,"given":"Andrew L","family":"Callen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0808-307X","authenticated-orcid":false,"given":"David A","family":"Zander","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7110-8444","authenticated-orcid":false,"given":"Jody L","family":"Tanabe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4977-6833","authenticated-orcid":false,"given":"Samantha L","family":"Pisani Petrucci","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8678-7945","authenticated-orcid":false,"given":"Chen-Tan","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3799-2624","authenticated-orcid":false,"given":"Justin M","family":"Honce","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,8,27]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"407","DOI":"10.59249\/NKOY5498","article-title":"Artificial intelligence to improve patient understanding of radiology reports","volume":"96","author":"Amin","journal-title":"Yale J Biol Med"},{"issue":"3","key":"R2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.231593","article-title":"Quantitative evaluation of large language models to streamline radiology report impressions: a multimodal retrospective analysis","volume":"310","author":"Doshi","journal-title":"Radiology"},{"issue":"10","key":"R3","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph17103673","article-title":"Full radiology report through patient web portal: a literature review","volume":"17","author":"Alarifi","journal-title":"Int J Environ Res Public Health"},{"issue":"12 Pt B","key":"R4","doi-asserted-by":"publisher","first-page":"1608","DOI":"10.1016\/j.jacr.2016.09.007","article-title":"Implications of direct patient online access to radiology reports through patient web portals","volume":"13","author":"Lee","journal-title":"J Am Coll Radiol"},{"issue":"7","key":"R5","doi-asserted-by":"publisher","DOI":"10.2196\/12595","article-title":"Patient attitudes about viewing their radiology images online: preintervention survey","volume":"21","author":"Halaska","journal-title":"J Med Internet Res"},{"issue":"2 Pt B","key":"R6","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.jacr.2021.10.008","article-title":"Patient-friendly radiology reporting-implementation and outcomes","volume":"19","author":"Kemp","journal-title":"J Am Coll Radiol"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1186\/s13244-020-00864-9","article-title":"Enhancing clinician and patient understanding of radiology reports: a scoping review of international guidelines","volume":"11","author":"Farmer","journal-title":"Insights Imaging"},{"issue":"6","key":"R8","doi-asserted-by":"publisher","first-page":"1252","DOI":"10.3174\/ajnr.A5151","article-title":"Enhancing the radiologist-patient relationship through improved communication: a quantitative readability analysis in spine radiology","volume":"38","author":"Hansberry","journal-title":"AJNR Am J Neuroradiol"},{"issue":"3","key":"R9","doi-asserted-by":"publisher","first-page":"602","DOI":"10.2214\/AJR.18.20197","article-title":"Readability of lumbar spine MRI reports: will patients understand?","volume":"212","author":"Yi","journal-title":"AJR Am J Roentgenol"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooac085","article-title":"A systematic review of the effectiveness of patient education through patient portals","volume":"6","author":"Johnson","journal-title":"JAMIA Open"},{"issue":"9","key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/18976","article-title":"Patient portal functionalities and patient outcomes among patients with diabetes: systematic review","volume":"22","author":"Alturkistani","journal-title":"J Med Internet Res"},{"issue":"4","key":"R12","doi-asserted-by":"publisher","first-page":"875","DOI":"10.2214\/AJR.18.21047","article-title":"Readability of patient education materials from RadiologyInfo.org: has there been progress over the past 5 years?","volume":"213","author":"Bange","journal-title":"AJR Am J Roentgenol"},{"issue":"12","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8536","article-title":"Text simplification using consumer health vocabulary to generate patient-centered radiology reporting: translation and evaluation","volume":"19","author":"Qenam","journal-title":"J Med Internet Res"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1148\/radiol.11101913","article-title":"Improving communication of diagnostic radiology findings through structured reporting","volume":"260","author":"Schwartz","journal-title":"Radiology"},{"issue":"4","key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/29496","article-title":"Understanding patient experiences, opinions, and actions taken after viewing their own radiology images online: web-based survey","volume":"6","author":"Norris","journal-title":"JMIR Form Res"},{"issue":"8","key":"R16","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.jvir.2015.03.019","article-title":"Readability of online patient education materials related to IR","volume":"26","author":"McEnteggart","journal-title":"J Vasc Interv Radiol"},{"issue":"7","key":"R17","doi-asserted-by":"publisher","first-page":"4331","DOI":"10.1007\/s00330-023-10370-3","article-title":"Patient-centered radiology: a roadmap for outpatient imaging","volume":"34","author":"Recht","journal-title":"Eur Radiol"},{"issue":"3","key":"R18","doi-asserted-by":"publisher","first-page":"e105","DOI":"10.1016\/S2589-7500(23)00019-5","article-title":"Generating scholarly content with ChatGPT: ethical challenges for medical publishing","volume":"5","author":"Liebrenz","journal-title":"Lancet Digit Health"},{"issue":"3","key":"R19","doi-asserted-by":"publisher","first-page":"721","DOI":"10.3350\/cmh.2023.0089","article-title":"Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma","volume":"29","author":"Yeo","journal-title":"Clin Mol Hepatol"},{"issue":"8","key":"R20","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1001\/jama.2024.0555","article-title":"AI-generated clinical summaries require more than accuracy","volume":"331","author":"Goodman","journal-title":"JAMA"},{"issue":"12","key":"R21","doi-asserted-by":"publisher","first-page":"1849","DOI":"10.1007\/s11547-024-01915-7","article-title":"ChatGPT and radiology report: potential applications and limitations","volume":"129","author":"Parillo","journal-title":"Radiol med"},{"issue":"5","key":"R22","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1016\/j.sapharm.2012.05.009","article-title":"Assessing readability formula differences with written health information materials: application, results, and recommendations","volume":"9","author":"Wang","journal-title":"Res Social Adm Pharm"},{"issue":"3","key":"R23","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","author":"Flesch","journal-title":"Journal of Applied Psychology"},{"issue":"5","key":"R24","doi-asserted-by":"publisher","first-page":"1245","DOI":"10.1007\/s11999-008-0193-8","article-title":"Readability of online patient education materials from the AAOS web site","volume":"466","author":"Sabharwal","journal-title":"Clin Orthop Relat Res"},{"issue":"2","key":"R25","doi-asserted-by":"publisher","DOI":"10.1148\/rycan.230086","article-title":"Evaluating the use of ChatGPT to accurately simplify patient-centered information about breast cancer prevention and screening","volume":"6","author":"Haver","journal-title":"Radiol Imaging Cancer"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1177\/20552076231221620","article-title":"Feasibility and acceptability of ChatGPT generated radiology report summaries for cancer patients","volume":"9","author":"Chung","journal-title":"Digit Health"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","first-page":"13218","DOI":"10.1038\/s41598-024-63824-z","article-title":"Patient-centered radiology reports with generative artificial intelligence: adding value to radiology reporting","volume":"14","author":"Park","journal-title":"Sci Rep"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2024.108307","article-title":"Decoding medical jargon: the use of AI language models (ChatGPT-4, BARD, microsoft copilot) in radiology reports","volume":"126","author":"Tepe","journal-title":"Patient Educ Couns"},{"issue":"8","key":"R29","doi-asserted-by":"publisher","first-page":"1621","DOI":"10.1007\/s00256-024-04599-2","article-title":"Translating musculoskeletal radiology reports into patient-friendly summaries using ChatGPT-4","volume":"53","author":"Kuckelman","journal-title":"Skeletal Radiol"},{"issue":"5","key":"R30","doi-asserted-by":"publisher","first-page":"2817","DOI":"10.1007\/s00330-023-10213-1","article-title":"ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports","volume":"34","author":"Jeblick","journal-title":"Eur Radiol"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","DOI":"10.1186\/s42492-023-00136-5","article-title":"Translating radiology reports into plain language using ChatGPT and GPT-4 with prompt learning: results, limitations, and potential","volume":"6","author":"Lyu","journal-title":"Vis Comput Ind Biomed Art"},{"key":"R32","unstructured":"Usage policies. OpenAI. URL: https:\/\/openai.com\/policies\/usage-policies\/ [Accessed 20-06-2025]"},{"key":"R33","unstructured":"Consumer perceptions of AI in healthcare. UserTesting. URL: https:\/\/www.usertesting.com\/resources\/reports\/consumer-perceptions-ai-healthcare [Accessed 20-06-2025]"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","first-page":"e107","DOI":"10.1016\/S2589-7500(23)00021-3","article-title":"ChatGPT: the future of discharge summaries?","volume":"5","author":"Patel","journal-title":"Lancet Digit Health"},{"issue":"12","key":"R35","doi-asserted-by":"publisher","first-page":"2133","DOI":"10.5664\/jcsm.10808","article-title":"ChatGPT, obstructive sleep apnea, and patient education","volume":"19","author":"Campbell","journal-title":"J Clin Sleep Med"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e76097","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:07:31Z","timestamp":1782842851000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e76097"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,27]]},"references-count":35,"URL":"https:\/\/doi.org\/10.2196\/76097","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,27]]},"article-number":"v9i3e76097"}}