{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T01:22:58Z","timestamp":1791249778298,"version":"4.1.0"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T00:00:00Z","timestamp":1787097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Physiol."],"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>This study aimed to compare the educational performance of six mainstream LLMs for neuromyelitis optica spectrum disorder (NMOSD) and evaluated patient satisfaction during real-world interactions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study was conducted from March to April 2026. In the first Phase, Twenty NMOSD-related questions derived from clinical guidelines and patient concerns were submitted to six LLMs (ChatGPT-5.4, Gemini-3.1-pro, Claude-4.6-Sonnet, DeepSeek-3.2, Kimi-2.5, and Qwen-3.5-plus). Responses were anonymized and independently evaluated by three neuro-ophthalmology specialists using Likert framework assessing accuracy, completeness, readability, safety, and humanity. Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC). In the second Phase, the three best-performing models were subsequently evaluated through real-world interactions with ten NMOSD patients, and satisfaction scores were analyzed using linear mixed-effects models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 120 chatbot responses were evaluated. With a comprehensive evaluation, significant differences were observed across all assessment domains. Gemini-3.1-pro achieved the highest scores for accuracy and safety, while Qwen-3.5-plus demonstrated superior completeness and humanity. DeepSeek-3.2 generated the most accessible responses, exhibiting the lowest reading difficulty score. However, its completeness advantage should be interpreted with caution, as it may be partially influenced by its longer response length. Inter-rater reliability was good, with single-measure ICC values ranging from 0.535 to 0.759, and average-measure ICC values ranging from 0.775 to 0.904. In patient interactions, Qwen-3.5-plus achieved the highest satisfaction score, significantly outperforming Gemini-3.1-pro and DeepSeek-3.2. Although all LLMs demonstrate superior performance in patient education, the real-world interaction with patient needs to pay attention.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>LLMs demonstrate considerable potential for NMOSD patient education but exhibit variability across educational dimensions, and require further validation in larger cohorts. These findings highlight the importance of selecting LLMs according to specific patient education goals and underscore the importance of clinicians in rare disease counseling.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fphys.2026.1923189","type":"journal-article","created":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T05:46:13Z","timestamp":1787118373000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Patient education for neuromyelitis optica spectrum disorder using large language models: combining expert assessment and real-world patient interaction"],"prefix":"10.3389","volume":"17","author":[{"given":"Chen","family":"Li","sequence":"first","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuting","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology and Optometry, Fujian Medical University","place":["Fuzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyan","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology and Optometry, Fujian Medical University","place":["Fuzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruoyi","family":"Yao","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiahao","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shanshan","family":"Diao","sequence":"additional","affiliation":[{"name":"Department of Neurology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanhui","family":"Xiao","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingming","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, The First Affiliated Hospital of Soochow University","place":["Suzhou, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingying","family":"Lai","sequence":"additional","affiliation":[{"name":"Shenzhen Eye Hospital, Shenzhen Eye Medical Center, Southern Medical University","place":["Shenzhen, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weihua","family":"Yang","sequence":"additional","affiliation":[{"name":"Shenzhen Eye Hospital, Shenzhen Eye Medical Center, Southern Medical University","place":["Shenzhen, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,19]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1097\/IOP.0000000000002567","article-title":"Evaluating the accuracy of ChatGPT and google BARD in fielding oculoplastic patient queries: A comparative study on artificial versus human intelligence","volume":"40","author":"Al-Sharif","year":"2024","journal-title":"Ophthalmic Plast. Reconstr Surg."},{"key":"B2","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum","volume":"183","author":"Ayers","year":"2023","journal-title":"JAMA Intern. Med."},{"key":"B3","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1007\/s00417-024-06625-4","article-title":"Gemini AI vs. ChatGPT: A comprehensive examination alongside ophthalmology residents in medical knowledge","volume":"263","author":"Bahir","year":"2025","journal-title":"Graefes Arch. Clin. Exp. Ophthalmol."},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(23)00201-7","article-title":"Large language models and their impact in ophthalmology","volume":"5","author":"Betzler","year":"2023","journal-title":"Lancet Digit Health"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1212\/NXI.0000000000200536","article-title":"Real-world efficacy and safety of neuromyelitis optica spectrum disorder disease-modifying treatments","volume":"13","author":"Bilodeau","year":"2026","journal-title":"Neurol. Neuroimmunol Neuroinflamm"},{"key":"B6","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1080\/01676830.2025.2559735","article-title":"Evaluating large language models in answering patient questions about eye removal surgeries","volume":"45","author":"Bineshfar","year":"2026","journal-title":"Orbit"},{"key":"B7","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1002\/mdc3.70339","article-title":"Movement disorders in neuromyelitis optica spectrum disorder: A systematic review","volume":"13","author":"Bringel","year":"2026","journal-title":"Mov Disord. Clin. Pract."},{"key":"B8","doi-asserted-by":"publisher","first-page":"e027","DOI":"10.48130\/vns-0025-0027","article-title":"Artificial intelligence in predicting anti-VEGF treatment response in diabetic macular edema: Current progress and future directions","volume":"42","author":"Cao","year":"2025","journal-title":"VNS"},{"key":"B9","unstructured":"Can artificial intelligence improve the readability of patient education information in gynecology"},{"key":"B10","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1038\/s43856-026-01576-9","article-title":"Multidisciplinary blinded randomized expert evaluation of large language models for clinical diagnosis and management","volume":"6","author":"Chen","year":"2026","journal-title":"Commun. Med. (Lond)"},{"key":"B11","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.ajo.2025.11.046","article-title":"ChatGPT-assisted glaucoma diagnosis: A health-equitable multi-ancestry analysis using visual field and optical coherence tomography data","volume":"283","author":"Huang","year":"2026","journal-title":"Am. J. Ophthalmol."},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2025.1673045","article-title":"Comparative performance of large language models for patient-initiated ophthalmology consultations","volume":"13","author":"Huang","year":"2025","journal-title":"Front. Public Health"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/j.xops.2025.101004","article-title":"Evolving consultation: Enhancing ophthalmic diagnostic performance using large language model","volume":"6","author":"Inooka","year":"2026","journal-title":"Ophthalmol. Sci."},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2021.103982","article-title":"AMMU: A survey of transformer-based biomedical pretrained language models","volume":"126","author":"Kalyan","year":"2022","journal-title":"J. Biomed. Inform"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2026.1805848","article-title":"Performance evaluation of mainstream large language models in autoimmune hepatitis patient education: A comparative study of readability, quality, and reliability","volume":"14","author":"Li","year":"2026","journal-title":"Front. Public Health"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.3389\/fcell.2025.1600202","article-title":"Large language model-based multimodal system for detecting and grading ocular surface diseases from smartphone images","volume":"13","author":"Li","year":"2025","journal-title":"Front. Cell Dev. Biol."},{"key":"B17","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1080\/10410236.2019.1582312","article-title":"By the mitigation one knows the doctor: Mitigation strategies by Chinese doctors in online medical consultation","volume":"35","author":"Mao","year":"2020","journal-title":"Health Commun."},{"key":"B18","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1007\/s10384-025-01286-0","article-title":"Differential diagnosis and clinical predictors in suspected optic neuritis","volume":"70","author":"Mori","year":"2026","journal-title":"Jpn. J. Ophthalmol."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1286","DOI":"10.3233\/SHTI251046","article-title":"Development of methods to assess readability in health and medical information: A scoping review","volume":"329","author":"Nattam","year":"2025","journal-title":"Stud. Health Technol. Inform"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1167\/tvst.14.7.9","article-title":"Evaluating large language models in ptosis-related inquiries: A cross-lingual study","volume":"14","author":"Niu","year":"2025","journal-title":"Transl. Vis. Sci. Technol."},{"key":"B21","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1111\/aos.15661","article-title":"Artificial intelligence-based chatbot patient information on common retinal diseases using ChatGPT","volume":"101","author":"Potapenko","year":"2023","journal-title":"Acta Ophthalmol."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.1186\/s12967-025-07227-2","article-title":"Temporal evolution of large language models (LLMs) in oncology","volume":"23","author":"Qiu","year":"2025","journal-title":"J. Transl. Med."},{"key":"B23","doi-asserted-by":"publisher","first-page":"3587","DOI":"10.1007\/s00417-025-06877-8","article-title":"Leveraging retrieval-augmented large language models for patient education in ophthalmology","volume":"263","author":"Reddy","year":"2025","journal-title":"Graefes Arch. Clin. Exp. Ophthalmol."},{"key":"B24","doi-asserted-by":"publisher","first-page":"e019","DOI":"10.48130\/vns-0025-0018","article-title":"Expert consensus on the application of artificial intelligence in neuro-ophthalmic diseases","volume":"42","author":"Shao","year":"2025","journal-title":"Visual Neuroscience"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230163","article-title":"ChatGPT and other large language models are double-edged swords","volume":"307","author":"Shen","year":"2023","journal-title":"Radiology"},{"key":"B26","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1186\/s12911-025-02954-4","article-title":"A systematic review of large language model (LLM) evaluations in clinical medicine","volume":"25","author":"Shool","year":"2025","journal-title":"BMC Med. Inform Decis Mak"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.2196\/52597","article-title":"Large language models and empathy: Systematic review","volume":"26","author":"Sorin","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"B28","doi-asserted-by":"publisher","first-page":"1751","DOI":"10.1002\/ohn.927","article-title":"Enhancing health literacy: Evaluating the readability of patient handouts revised by ChatGPT\u2019s large language model","volume":"171","author":"Swisher","year":"2024","journal-title":"Otolaryngol--head Neck Surg."},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1016\/j.xops.2024.100485","article-title":"A comparative study of responses to retina questions from either experts, expert-edited large language models, or expert-edited large language models alone","volume":"4","author":"Tailor","year":"2024","journal-title":"Ophthalmol. Sci."},{"key":"B30","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1136\/bjo-2024-325599","article-title":"Evaluating the effectiveness of large language models in patient education for conjunctivitis","volume":"109","author":"Wang","year":"2025","journal-title":"Br. J. Ophthalmol."},{"key":"B31","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1007\/s10916-025-02227-7","article-title":"Evaluating the performance of ChatGPT on board-style examination questions in ophthalmology: A meta-analysis","volume":"49","author":"Wei","year":"2025","journal-title":"J. Med. Syst."},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.2196\/67883","article-title":"Evaluating the effectiveness of large language models in providing patient education for Chinese patients with ocular myasthenia gravis: Mixed methods study","volume":"27","author":"Wei","year":"2025","journal-title":"J. Med. Internet Res."},{"key":"B33","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1136\/bjo-2023-324734","article-title":"Review of emerging trends and projection of future developments in large language models research in ophthalmology","volume":"108","author":"Wong","year":"2024","journal-title":"Br. J. Ophthalmol."},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.2196\/57674","article-title":"Data set and benchmark (MedGPTEval) to evaluate responses from large language models in medicine: Evaluation development and validation","volume":"12","author":"Xu","year":"2024","journal-title":"JMIR Med. Inform"},{"key":"B35","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1080\/08820538.2023.2300808","article-title":"Large language models in ophthalmology: Potential and pitfalls","volume":"39","author":"Yaghy","year":"2024","journal-title":"Semin. Ophthalmol."},{"key":"B36","doi-asserted-by":"publisher","first-page":"e026","DOI":"10.48130\/vns-0025-0025","article-title":"Artificial intelligence in clinical education in ophthalmology: A systematic review","volume":"42","author":"Yuan","year":"2025","journal-title":"VNS"},{"key":"B37","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1080\/10410236.2020.1712527","article-title":"How doctors do things with empathy in online medical consultations in China: A discourse-analytic approach","volume":"36","author":"Zhang","year":"2021","journal-title":"Health Commun."},{"key":"B38","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1016\/j.survophthal.2025.02.009","article-title":"Advancing ophthalmology with large language models: Applications, challenges, and future directions","volume":"70","author":"Zhang","year":"2025","journal-title":"Surv Ophthalmol."},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2026.1777577","article-title":"Decoupled quality and readability in skin cancer education from large language models","volume":"14","author":"Zhang","year":"2026","journal-title":"Front. Public Health"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.2196\/63731","article-title":"Qwen-2.5 outperforms other large language models in the Chinese national nursing licensing examination: Retrospective cross-sectional comparative study","volume":"13","author":"Zhu","year":"2025","journal-title":"JMIR Med. Inform"}],"container-title":["Frontiers in Physiology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2026.1923189\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T05:46:15Z","timestamp":1787118375000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2026.1923189\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,19]]},"references-count":40,"alternative-id":["10.3389\/fphys.2026.1923189"],"URL":"https:\/\/doi.org\/10.3389\/fphys.2026.1923189","relation":{},"ISSN":["1664-042X"],"issn-type":[{"value":"1664-042X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,19]]},"article-number":"1923189"}}