{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T16:05:11Z","timestamp":1790697911969,"version":"4.1.0"},"reference-count":60,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T00:00:00Z","timestamp":1784764800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of VitreoRetinal Diseases"],"abstract":"<jats:sec>\n                    <jats:title>Purpose:<\/jats:title>\n                    <jats:p>To evaluate the readability, quality, and misinformation of patient education materials generated by large language models, including ChatGPT-4o (OpenAI), Gemini 1.5 Pro (Google), and Copilot Pro (Microsoft), compared with American Society of Retina Specialists (ASRS) brochures for retinal diseases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>A cross-sectional comparative analysis was performed by generating patient education materials on 3 retinal conditions: retinal detachment, diabetic retinopathy, and age-related macular degeneration. Materials were created using a general prompt (prompt A) and a prompt specifying a sixth-grade readability level (prompt B). Readability was evaluated using 6 validated metrics. Quality was assessed through DISCERN and the Patient Education Materials Assessment Tool. Misinformation was graded using a 5-point Likert scale. Assessments were performed independently by 2 masked retina specialists.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      Average readability of Gemini (11.65;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .005) and Copilot (11.23;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .003) materials was significantly better than that of ASRS materials (14.17), whereas ChatGPT showed no significant difference (12.85;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .06). ChatGPT\u2019s average readability was significantly lower compared with Gemini (12.85 vs 11.65;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .01) and Copilot (12.85 vs 11.23;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .001). Prompt B significantly improved readability across all large language models relative to ASRS but still exceeded the sixth-grade readability level. DISCERN scores were comparable across groups. ASRS materials had an understandability score of 74.37%, which was significantly lower than ChatGPT (94.44%;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .02) and Gemini 1.5 (95.83%,\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = .02) scores. No significant differences were observed for actionability or misinformation. Readability showed no significant correlation with quality or misinformation (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &gt; .05).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Large language models, when appropriately prompted, can generate retina-related patient education material with superior readability compared with existing ASRS brochures, while maintaining comparable quality and accuracy. Large language models represent a promising approach for addressing literacy barriers, though expert oversight remains essential.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/24741264261460669","type":"journal-article","created":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T20:10:47Z","timestamp":1784837447000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Using Large Language Models to Generate Retina Patient Education Material: A Comparative Analysis With American Society of Retina Specialists Patient Brochures"],"prefix":"10.1177","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-1637-2417","authenticated-orcid":false,"given":"Khaldon F.","family":"Abbas","sequence":"first","affiliation":[{"name":"Ivey Eye Institute, St. Joseph\u2019s Health Care Centre, London, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monali S.","family":"Malvankar-Mehta","sequence":"additional","affiliation":[{"name":"Ivey Eye Institute, St. Joseph\u2019s Health Care Centre, London, ON, Canada"},{"name":"Department of Ophthalmology and Visual Sciences, University of Western Ontario, London, ON, Canada"},{"name":"Department of Epidemiology and Biostatistics, University of Western Ontario, London, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Verena","family":"Juncal","sequence":"additional","affiliation":[{"name":"Ivey Eye Institute, St. Joseph\u2019s Health Care Centre, London, ON, Canada"},{"name":"Department of Ophthalmology and Visual Sciences, University of Western Ontario, London, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phil","family":"Hooper","sequence":"additional","affiliation":[{"name":"Ivey Eye Institute, St. Joseph\u2019s Health Care Centre, London, ON, Canada"},{"name":"Department of Ophthalmology and Visual Sciences, University of Western Ontario, London, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Sheidow","sequence":"additional","affiliation":[{"name":"Ivey Eye Institute, St. Joseph\u2019s Health Care Centre, London, ON, Canada"},{"name":"Department of Ophthalmology and Visual Sciences, University of Western Ontario, London, ON, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,7,23]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Institute of Medicine (US) Committee on Health Literacy. Health Literacy: A Prescription to End Confusion. Nielsen-Bohlman L Panzer AM Kindig DA eds. National Academies Press (US); 2004. Accessed November 11 2024. http:\/\/www.ncbi.nlm.nih.gov\/books\/NBK216032\/"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcjo.2024.07.018"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2016.01.020"},{"issue":"29","key":"e_1_3_3_5_2","article-title":"Effectiveness of health education in the self-care and adherence of patients with heart failure: a meta-analysis","volume":"19","author":"Tinoco JMVP","year":"2021","unstructured":"Tinoco JMVP, Figueiredo LDS, Flores PVP, et al. Effectiveness of health education in the self-care and adherence of patients with heart failure: a meta-analysis. Rev Lat Am Enfermagem. 2021;19(29):e3389.","journal-title":"Rev Lat Am Enfermagem"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.oret.2023.09.008"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare9121740"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/aos.15661"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40942-023-00511-7"},{"key":"e_1_3_3_10_2","unstructured":"Eurostat. One in two EU citizens look for health information online. 2021. Accessed December 17 2024. https:\/\/ec.europa.eu\/eurostat\/web\/products-eurostat-news\/-\/edn-20210406-1"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/0033354919874074"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-012-2046-0"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/0738-3991(95)00710-H"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.5812\/atr.18161"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1097\/QMH.0000000000000162"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.3399\/bjgp15X685285"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.NPR.0000541468.54290.49"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199707243370411"},{"key":"e_1_3_3_19_2","unstructured":"Weiss BD. Health Literacy: A Manual for Clinicians. American Medical Association Foundation and American Medical Association; 2003. Accessed November 13 2024. http:\/\/lib.ncfh.org\/pdfs\/6617.pdf"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.oret.2022.03.015"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.2147\/OPTH.S401492"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjophth-2021-000966"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1080\/09273948.2023.2203759"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1080\/09273948.2020.1737144"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1080\/09273948.2017.1413396"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12886-016-0315-0"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ogla.2022.03.004"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1097\/IJG.0000000000002012"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/08820538.2021.1915341"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaapos.2015.07.286"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1080\/08820538.2021.1919721"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2013.0252"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49186-4_31"},{"issue":"1","key":"e_1_3_3_34_2","first-page":"29","article-title":"Chatbots: are they really useful?","volume":"22","author":"Abu Shawar B","year":"2007","unstructured":"Abu Shawar B, Atwell E. Chatbots: are they really useful? BAND. 2007;22(1):29-49.","journal-title":"BAND"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.2196\/15589"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.23956\/ijarcsse.v8i4.630"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.14257\/ijunesst.2015.8.7.28"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32967-3"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1136\/bjophthalmol-2018-313173"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1080\/08820538.2023.2209166"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00417-023-06123-z"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2023.1144"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2023.6917"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.57795"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcm13216512"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2014.6104"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1111\/jhn.12466"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1136\/jech.53.2.105"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2014.05.027"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2023.2947"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1097\/IOP.0000000000002549"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajo.2024.04.004"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1080\/08164622.2023.2298812"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12262-024-04112-y"},{"key":"e_1_3_3_55_2","article-title":"Readability of patient education materials from high-impact medical journals: a 20 year analysis","volume":"8","author":"Rooney MK","year":"2021","unstructured":"Rooney MK, Santiago G, Perni S, et al. Readability of patient education materials from high-impact medical journals: a 20 year analysis. J Patient Exp. 2021;8:2374373521998847.","journal-title":"J Patient Exp"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327655JCHN1701_02"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2020.104230"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfo.2023.07.001"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1503\/cmaj.160177"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1097\/IJG.0000000000002338"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637364"}],"container-title":["Journal of VitreoRetinal Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/24741264261460669","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/24741264261460669","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/24741264261460669","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T15:24:21Z","timestamp":1790695461000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/24741264261460669"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,23]]},"references-count":60,"alternative-id":["10.1177\/24741264261460669"],"URL":"https:\/\/doi.org\/10.1177\/24741264261460669","relation":{},"ISSN":["2474-1264","2474-1272"],"issn-type":[{"value":"2474-1264","type":"print"},{"value":"2474-1272","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,23]]},"article-number":"24741264261460669"}}