{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T05:03:42Z","timestamp":1789621422416,"version":"build-2803163510"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T00:00:00Z","timestamp":1789603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Ophthalmol."],"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>This cross-sectional evaluation of model outputs evaluates the accuracy, readability, transparency, objectivity, completeness, and bias of GPT-4o mini responses to common oculoplastic patient questions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The study was reviewed and deemed exempt from institutional review board approval. Thirty-three questions were developed across eight clinical domains: floppy eyelid syndrome, cicatricial ectropion, entropion, blepharoplasty, facial aging, brow lift, ptosis, and facial nerve function. Seven domains contained four patient-centered questions, while the facial aging domain contained five questions, for a total of 33 questions. On September 16, 2024, GPT-4o mini was prompted for each question with a standardized prompt requesting responses from the perspective of an expert oculofacial surgeon, using the latest medical guidelines. Verbatim responses were recorded. Six American Society of Ophthalmic Plastic and Reconstructive Surgery fellowship-trained surgeons independently evaluated each response using a 5-point Likert scale assessing clinical accuracy, completeness, transparency, objectivity, and bias. Readability was assessed using established readability indices.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>GPT-4o mini demonstrated moderate clinical accuracy and completeness. Clinical accuracy was rated favorably in 51% of ratings (101\/198), while completeness was rated favorably in 42% (84\/198). Transparency and objectivity demonstrated stronger performance. 78% of ratings (155\/198) agreed or strongly agreed that responses were transparent and 76% of ratings (150\/198) agreed or strongly agreed that responses were objective. 8% of ratings (16\/198) agreed or strongly agreed that Bias was present, while 65% (129\/198) disagreed or strongly disagreed. Readability analyses demonstrated that ratings required college- to graduate-level reading ability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>GPT-4o mini generated transparent and objective ratings with low measured bias but demonstrated limitations in clinical accuracy, completeness, and readability. These findings apply specifically to GPT-4o mini and should not be generalized to other large language models. Future investigations should compare contemporary language models, evaluate alternative prompting strategies, and investigate multimodal systems that integrate text, clinical photographs, periocular anatomy, and patient symptoms.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fopht.2026.1718017","type":"journal-article","created":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T04:29:30Z","timestamp":1789619370000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Accuracy, readability, and bias of GPT-4o mini responses to oculoplastic patient questions"],"prefix":"10.3389","volume":"6","author":[{"given":"Terry","family":"Henry","sequence":"first","affiliation":[{"name":"Virginia Commonwealth University (VCU) Medical Center","place":["Richmond, VA, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Grace","family":"Staes","sequence":"additional","affiliation":[{"name":"Howard University College of Medicine","place":["Washington, DC, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexius","family":"Russell","sequence":"additional","affiliation":[{"name":"Uniformed Services University of the Health Sciences","place":["Bethesda, MD, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikisha Q.","family":"Richards-Walker","sequence":"additional","affiliation":[{"name":"Virginia Commonwealth University (VCU) Medical Center","place":["Richmond, VA, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,17]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2024.1477898","article-title":"Large language models in patient education: a scoping review of applications in medicine","volume":"11","author":"Aydin","year":"2024","journal-title":"Front Med"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.5455\/aim.2024.33.4-10","article-title":"The use of large language models in generating patient education materials: a scoping review","volume":"33","author":"AlSammarraie","year":"2025","journal-title":"Acta Inform Med"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.survophthal.2010.03.005","article-title":"Health literacy and ophthalmic patient education","volume":"55","author":"Muir","year":"2010","journal-title":"Surv Ophthalmol"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.survophthal.2022.08.007","article-title":"Health literacy and ophthalmology: a scoping review","volume":"68","author":"Iskander","year":"2023","journal-title":"Surv Ophthalmol"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.65658","article-title":"Assessing the accuracy, completeness, and reliability of artificial intelligence-generated responses in dentistry: a pilot study evaluating the ChatGPT model","volume":"16","author":"Molena","year":"2024","journal-title":"Cureus"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1089\/end.2023.0700","article-title":"ChatGPT in urology: bridging knowledge and practice for tomorrow's healthcare: a comprehensive review","volume":"38","author":"Solano","year":"2024","journal-title":"J Endourol"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1097\/PRS.0000000000011202","article-title":"Artificial intelligence in plastic surgery: ChatGPT as a tool to address disparities in health literacy","volume":"153","author":"Wang","year":"2024","journal-title":"Plast Reconstr Surg"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1001\/jamasurg.2023.6496","article-title":"Academic surgery in the era of large language models: a review","volume":"159","author":"Rengers","year":"2024","journal-title":"JAMA Surg"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000039120","article-title":"Evaluating accuracy and reproducibility of ChatGPT responses to patient-based questions in ophthalmology: an observational study","volume":"103","author":"Alqudah","year":"2024","journal-title":"Medicine (Baltimore)"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.2196\/60063","article-title":"EyeGPT for patient inquiries and medical education: development and validation of an ophthalmology large language model","volume":"26","author":"Chen","year":"2024","journal-title":"J Med Internet Res"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1097\/IOP.0000000000002567","article-title":"Evaluating the accuracy of ChatGPT and Google Bard in fielding oculoplastic patient queries: a comparative study on artificial versus human intelligence","volume":"40","author":"Al-Sharif","year":"2024","journal-title":"Ophthalmic Plast Reconstr Surg"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1097\/IOP.0000000000002552","article-title":"Evaluating ChatGPT on orbital and oculofacial disorders: accuracy and readability insights","volume":"40","author":"Balas","year":"2024","journal-title":"Ophthalmic Plast Reconstr Surg"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.2147\/OPTH.S480222","article-title":"Comparing the ability of Google and ChatGPT to accurately respond to oculoplastics-related patient questions and generate customized oculoplastics patient education materials","volume":"18","author":"Cohen","year":"2024","journal-title":"Clin Ophthalmol"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/s41433-025-03935-7","article-title":"Large language models in ophthalmology: a scoping review on their utility for clinicians, researchers, patients, and educators","volume":"39","author":"Artiaga","year":"2025","journal-title":"Eye"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2025.110301","article-title":"Multimodal large language models as assistance for evaluation of thyroid-associated ophthalmopathy","volume":"192","author":"Kim","year":"2025","journal-title":"Comput Biol Med"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01461-0","article-title":"Multimodal machine learning enables AI chatbot to diagnose ophthalmic diseases and provide high-quality medical responses","volume":"8","author":"Ma","year":"2025","journal-title":"NPJ Digit Med"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.survophthal.2025.07.003","article-title":"Multimodal artificial intelligence in ophthalmology: applications, challenges, and future directions","volume":"71","author":"Jin","year":"2026","journal-title":"Surv Ophthalmol"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/s44163-026-00980-3","article-title":"Advancements in ophthalmology healthcare using multimodal AI: a systematic review of methods, applications, and future directions","volume":"6","author":"Vamsidhar","year":"2026","journal-title":"Discov Artif Intell"},{"key":"B19","unstructured":"GPT-4o mini: Advancing cost-efficient intelligence\n          \n          \n          \n          2024"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1038\/s41391-024-00826-y","article-title":"Accuracy, readability, and understandability of large language models for prostate cancer information to the public","volume":"28","author":"Hershenhouse","year":"2025","journal-title":"Prostate Cancer Prostatic Dis"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1001\/jama.281.6.552","article-title":"Health literacy: report of the Council on Scientific Affairs","volume":"281","year":"1999","journal-title":"JAMA"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1001\/archopht.126.5.718","article-title":"Functional health literacy in patients with glaucoma in urban settings","volume":"126","author":"Juzych","year":"2008","journal-title":"Arch Ophthalmol"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1097\/IJG.0000000000002133","article-title":"Association of health literacy and health care utilization among glaucoma patients","volume":"32","author":"Cheng","year":"2023","journal-title":"J Glaucoma"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2025.111132","article-title":"Trust and accuracy in AI: optometrists favor multimodal AI systems over unimodal for glaucoma diagnosis in collaborative environments","volume":"198","author":"Ghaffar","year":"2025","journal-title":"Comput Biol Med"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1038\/s41433-025-03878-z","article-title":"The acceptance of ophthalmic artificial intelligence for eye diseases: a literature review and qualitative analysis","volume":"39","author":"Ran","year":"2025","journal-title":"Eye"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1111\/jocd.70241","article-title":"Artificial intelligence in aesthetic medicine: applications, challenges, and future directions","volume":"24","author":"Al-Dhubaibi","year":"2025","journal-title":"J Cosmet Dermatol"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1111\/jocd.13797","article-title":"The role of artificial intelligence in cosmetic dermatology\u2014current, upcoming, and future trends","volume":"20","author":"Elder","year":"2021","journal-title":"J Cosmet Dermatol"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1111\/jocd.16481","article-title":"AI assistance in aesthetic medicine\u2014a consensus on objective medical standards","volume":"23","author":"Frank","year":"2024","journal-title":"J Cosmet Dermatol"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00939-z","article-title":"Large language models propagate race-based medicine","volume":"6","author":"Omiye","year":"2023","journal-title":"NPJ Digit Med"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra2214964","article-title":"Considering biased data as informative artifacts in AI-assisted health care","volume":"389","author":"Ferryman","year":"2023","journal-title":"N Engl J Med"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2025-112695","article-title":"Generative artificial intelligence-driven chatbots and medical misinformation: an accuracy, referencing and readability audit","volume":"16","author":"Tiller","year":"2026","journal-title":"BMJ Open"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2025.103631","article-title":"EH-Benchmark: ophthalmic hallucination benchmark and agent-driven top-down traceable reasoning workflow","volume":"126","author":"Pan","year":"2026","journal-title":"Inf Fusion"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1136\/bjo-2024-325458","article-title":"Generative artificial intelligence in ophthalmology: current innovations, future applications and challenges","volume":"108","author":"Sonmez","year":"2024","journal-title":"Br J Ophthalmol"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0001199","article-title":"Awareness, trust, and expectations of AI for glaucoma care among Bulgarian ophthalmologists: role of demographic factors","volume":"5","author":"Radeva","year":"2026","journal-title":"PLoS Digit Health"},{"key":"B35","doi-asserted-by":"crossref","DOI":"10.1145\/3722212.3725640","article-title":"Data storage and management for image AI pipelines","author":"Sirin","year":"2025"},{"key":"B36","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-92087-6_5","article-title":"Data storage, cloud usage and artificial intelligence pipeline","volume-title":"Artificial Intelligence in Cardiothoracic Imaging","author":"van Ooijen","year":"2022"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1016\/j.xops.2022.100231","article-title":"Development of a cloud-based clinical decision support system for ophthalmology triage using decision tree artificial intelligence","volume":"3","author":"Tanya","year":"2023","journal-title":"Ophthalmol Sci"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1111\/bioe.13158","article-title":"Artificial intelligence and the doctor-patient relationship: expanding the paradigm of shared decision making","volume":"37","author":"Lorenzini","year":"2023","journal-title":"Bioethics"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.2196\/36199","article-title":"Application of artificial intelligence in shared decision making: scoping review","volume":"10","author":"Abbasgholizadeh Rahimi","year":"2022","journal-title":"JMIR Med Inform"}],"container-title":["Frontiers in Ophthalmology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fopht.2026.1718017\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T04:29:32Z","timestamp":1789619372000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fopht.2026.1718017\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,17]]},"references-count":39,"alternative-id":["10.3389\/fopht.2026.1718017"],"URL":"https:\/\/doi.org\/10.3389\/fopht.2026.1718017","relation":{},"ISSN":["2674-0826"],"issn-type":[{"value":"2674-0826","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,17]]},"article-number":"1718017"}}