{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T02:43:25Z","timestamp":1780627405953,"version":"3.54.1"},"reference-count":27,"publisher":"SLACK, Inc.","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Pediatr Ophthalmol Strabismus"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>To assess the medical accuracy and readability of responses provided by ChatGPT (OpenAI), the most widely used artificial intelligence\u2013powered chatbot, regarding questions about strabismus.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>Thirty-four questions were input into ChatGPT 3.5 (free version) and 4.0 (paid version) at three time intervals (day 0, 1 week, and 1 month) in two distinct geographic locations (California and Florida) in March 2024. Two pediatric ophthalmologists rated responses as \u201cacceptable,\u201d \u201caccurate but missing key information or minor inaccuracies,\u201d or \u201cinaccurate and potentially harmful.\u201d The online tool, Readable, measured the Flesch-Kincaid Grade Level and Flesch Reading Ease Score to assess readability.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>\n              Overall, 64% of responses by ChatGPT were \u201cacceptable;\u201d but the proportion of \u201cacceptable\u201d responses differed by version (47% for ChatGPT 3.5 vs 53% for 4.0,\n              <jats:italic toggle=\"yes\">P<\/jats:italic>\n              &lt; .05) and state (77% of California vs 51% of Florida,\n              <jats:italic toggle=\"yes\">P<\/jats:italic>\n              &lt; .001). Responses in Florida were more likely to be \u201cinaccurate and potentially harmful\u201d compared to those in California (6.9% vs. 1.5%,\n              <jats:italic toggle=\"yes\">P<\/jats:italic>\n              &lt; .001). Over 1 month, the overall percentage of \u201cacceptable\u201d responses increased (60% at day 0, 64% at 1 week, and 67% at 1 month,\n              <jats:italic toggle=\"yes\">P<\/jats:italic>\n              &gt; .05), whereas \u201cinaccurate and potentially harmful\u201d responses decreased (5% at day 0, 5% at 1 week, and 3% at 1 month,\n              <jats:italic toggle=\"yes\">P<\/jats:italic>\n              &gt; .05). On average, responses scored a Flesch-Kincaid Grade Level score of 15, equating to a higher than high school grade reading level.\n            <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>Although most of ChatGPT's responses to strabismus questions were clinically acceptable, there were variations in responses across time and geographic regions. The average reading level exceeded a high school level and demonstrated low readability. Although ChatGPT demonstrates potential as a supplementary resource for parents and patients with strabismus, improving the accuracy and readability of free versions of ChatGPT may increase its utility.<\/jats:p>\n            <jats:p>\n              <jats:bold>\n                [\n                <jats:italic toggle=\"yes\">J Pediatr Ophthalmol Strabismus<\/jats:italic>\n                . 2025;62(3):220\u2013227.]\n              <\/jats:bold>\n            <\/jats:p>\n          <\/jats:sec>","DOI":"10.3928\/01913913-20250110-02","type":"journal-article","created":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T14:38:36Z","timestamp":1739975916000},"page":"220-227","source":"Crossref","is-referenced-by-count":3,"title":["Accuracy and Readability of ChatGPT Responses to Patient-Centric Strabismus Questions"],"prefix":"10.3928","volume":"62","author":[{"given":"Ashlyn A.","family":"Gary","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James M.","family":"Lai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elyana V.T.","family":"Locatelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle M.","family":"Falcone","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kara M.","family":"Cavuoto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2308","reference":[{"key":"e_1_3_1_2_2","unstructured":"Radford A. NK Salimans T. Sutskever I. Improving language understanding by generative pre-training. 2018."},{"key":"e_1_3_1_3_2","unstructured":"Team B. ChatGPT\/OpenAI Statistics: How Many People Use ChatGPT? https:\/\/backlinko.com\/chatgpt-stats"},{"key":"e_1_3_1_4_2","unstructured":"Marr B. Revolutionizing Healthcare: The Top 14 Uses Of Chat-GPT In Medicine And Wellness. https:\/\/www.forbes.com\/sites\/bernardmarr\/2023\/03\/02\/revolutionizing-healthcare-the-top-14-uses-of-chatgpt-in-medicine-and-wellness\/"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.4274\/MMJ.galenos.2024.03154"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2023.1144"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2023.2909"},{"key":"e_1_3_1_9_2","unstructured":"Meer DV. Number of ChatGPT Users and Key Stats (June 2024). https:\/\/www.namepepper.com\/chatgpt-users"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","unstructured":"Sanchez MM Whitman MC. Genetics of strabismus. Front Ophthalmol (Lausanne). 2023;3 10.3389\/fopht.2023.1233866","DOI":"10.3389\/fopht.2023.1233866"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.3928\/01913913-20231005-02"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230424"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.600333"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1097\/GOX.0000000000005575"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cbi.2014.06.029"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/and.14607"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/2473974X221133308"},{"key":"e_1_3_1_18_2","unstructured":"About Readability. https:\/\/readable.com\/readability\/#goodscore"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00428-017-2173-4"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.3322\/canjclin.48.3.151"},{"key":"e_1_3_1_21_2","volume-title":"Health Literacy: A Manual for Clinicians","author":"Weis B","year":"2003","unstructured":"Weis B. Health Literacy: A Manual for Clinicians. American Medical Association, American Medical Foundation; 2003."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.2147\/IJGM.S456659"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2023.1256459"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.2196\/47479"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_3_1_26_2","unstructured":"GPT-4 is OpenAI's most advanced system producing safer and more useful responses. https:\/\/openai.com\/index\/gpt-4\/"},{"key":"e_1_3_1_27_2","unstructured":"Open AI. Privacy policy. https:\/\/openai.com\/policies\/privacy-policy\/"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.927"}],"container-title":["Journal of Pediatric Ophthalmology &amp; Strabismus"],"original-title":[],"language":"en","deposited":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T10:46:31Z","timestamp":1747392391000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.healio.com\/doi\/10.3928\/01913913-20250110-02"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5]]},"references-count":27,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.3928\/01913913-20250110-02"],"URL":"https:\/\/doi.org\/10.3928\/01913913-20250110-02","relation":{},"ISSN":["0191-3913","1938-2405"],"issn-type":[{"value":"0191-3913","type":"print"},{"value":"1938-2405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5]]}}}