{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T17:45:26Z","timestamp":1793295926602,"version":"4.5.0"},"reference-count":59,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:00:00Z","timestamp":1750204800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>Ankylosing spondylitis (AS), which usually occurs in the second and third decades of life, is associated with chronic pain, limitation of mobility, and severe decreases in quality of life. This study aimed to make a comparative evaluation in terms of the readability, information accuracy and quality of the answers given by artificial intelligence (AI)-based chatbots such as ChatGPT, Perplexity and Gemini, which have become popular with the widespread access to medical information, to user questions about AS, a chronic inflammatory joint disease. In this study, the 25 most frequently queried keywords related to AS determined through Google Trends were directed to each 3 AI-based chatbots. The readability of the resulting responses was evaluated using readability indices such as Simple Gunning Fog (GFOG), Flesch Reading Ease Score (FRES) and Measure of Gobbledygook (SMOG). The quality of the responses was measured by Ensuring Quality Information for Patients (EQIP) and Global Quality Score (GQS) scores, and the reliability was measured using the modified DISCERN and Journal of American Medical Association (JAMA) scales. According to Google Trends data, the most frequently searched keywords related to AS are \u201cAnkylosing spondylitis pain\u201d, \u201cAnkylosing spondylitis symptoms\u201d and \u201cAnkylosing spondylitis disease\u201d, respectively. It was found that the readability levels of the answers produced by AI-based chatbots were above the 6th grade level and showed a statistically significant difference (p\u2009&lt;\u20090.001). In EQIP, JAMA, mDISCERN and GQS evaluations, Perplexity stood out in terms of information quality and reliability, receiving higher scores compared to other chat robots (p\u2009&lt;\u20090.05). It has been found that the answers given by AI chatbots to AS-related questions exceed the recommended readability level and the reliability and quality assessment raises concerns due to some low scores. It is possible for future AI chatbots to have sufficient quality, reliability and appropriate readability levels with an audit mechanism in place.<\/jats:p>","DOI":"10.1371\/journal.pone.0326351","type":"journal-article","created":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:53:35Z","timestamp":1750269215000},"page":"e0326351","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":68,"title":["Evaluating the readability, quality, and reliability of responses generated by ChatGPT, Gemini, and Perplexity on the most commonly asked questions about Ankylosing spondylitis"],"prefix":"10.1371","volume":"20","author":[{"given":"Mete","family":"Kara","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3425-313X","authenticated-orcid":true,"given":"Erkan","family":"Ozduran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M\u00fcge Mercan","family":"Kara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0508-8868","authenticated-orcid":true,"given":"\u0130lhan Celil","family":"\u00d6zbek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Volkan","family":"Hanc\u0131","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,6,18]]},"reference":[{"issue":"7","key":"pone.0326351.ref001","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1038\/s41584-021-00625-y","article-title":"Ankylosing spondylitis: an autoimmune or autoinflammatory disease?","volume":"17","author":"D Mauro","year":"2021","journal-title":"Nat Rev Rheumatol"},{"issue":"2","key":"pone.0326351.ref002","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1111\/imm.13242","article-title":"New developments in our understanding of Ankylosing spondylitis pathogenesis","volume":"161","author":"A Voruganti","year":"2020","journal-title":"Immunology"},{"issue":"3","key":"pone.0326351.ref003","doi-asserted-by":"crossref","first-page":"462","DOI":"10.18502\/jovr.v16i3.9440","article-title":"Ankylosing spondylitis","volume":"16","author":"N Ebrahimiadib","year":"2021","journal-title":"J Ophthalmic Vis Res"},{"issue":"4","key":"pone.0326351.ref004","doi-asserted-by":"crossref","first-page":"218","DOI":"10.4081\/reumatismo.2020.1325","article-title":"Top 100 cited articles on Ankylosing spondylitis","volume":"72","author":"F Bagcier","year":"2021","journal-title":"Reumatismo"},{"issue":"1","key":"pone.0326351.ref005","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1136\/ard-2022-223296","article-title":"ASAS-EULAR recommendations for the management of axial spondyloarthritis: 2022 update","volume":"82","author":"S Ramiro","year":"2023","journal-title":"Ann Rheum Dis"},{"key":"pone.0326351.ref006","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1136\/annrheumdis-2021-220249","article-title":"EULAR recommendations for the implementation of self-management strategies in patients with inflammatory arthritis","volume":"80","author":"E Nikiphorou","year":"2021","journal-title":"Ann Rheum Dis"},{"issue":"5","key":"pone.0326351.ref007","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1007\/s40744-023-00585-7","article-title":"Patients\u2019 needs concerning patient education in axial spondyloarthritis: a qualitative study","volume":"10","author":"YM van der Kraan","year":"2023","journal-title":"Rheumatol Ther"},{"issue":"1","key":"pone.0326351.ref008","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1186\/s12875-020-01274-y","article-title":"Primary care physician perspectives on barriers to diagnosing axial Spondyloarthritis: a qualitative study","volume":"21","author":"KL Lapane","year":"2020","journal-title":"BMC Fam Pract"},{"issue":"3","key":"pone.0326351.ref009","doi-asserted-by":"crossref","first-page":"124","DOI":"10.25259\/NMJI_327_2022","article-title":"Evaluating the readability, quality and reliability of online patient education materials on chronic low back pain","volume":"37","author":"E Ozduran","year":"2024","journal-title":"Natl Med J India"},{"key":"pone.0326351.ref010","first-page":"311","article-title":"A comparative analysis of generative artificial intelligence tools for natural language processing","volume":"1","author":"A Iorliam","year":"2024","journal-title":"JCTA"},{"key":"pone.0326351.ref011","author":"S Singh","year":"2025"},{"issue":"22","key":"pone.0326351.ref012","doi-asserted-by":"crossref","DOI":"10.1097\/MD.0000000000038352","article-title":"Assessing the readability, reliability, and quality of artificial intelligence chatbot responses to the 100 most searched queries about cardiopulmonary resuscitation: an observational study","volume":"103","author":"D \u00d6m\u00fcr Ar\u00e7a","year":"2024","journal-title":"Medicine (Baltimore)"},{"key":"pone.0326351.ref013","doi-asserted-by":"crossref","DOI":"10.7717\/peerj.18847","article-title":"Assessing the readability, quality and reliability of responses produced by ChatGPT, Gemini, and Perplexity regarding most frequently asked keywords about low back pain","volume":"13","author":"E Ozduran","year":"2025","journal-title":"PeerJ"},{"key":"pone.0326351.ref014","doi-asserted-by":"crossref","DOI":"10.7717\/peerj.17215","article-title":"Assessing the quality and reliability of YouTube videos as a source of information on inflammatory back pain","volume":"12","author":"M Kara","year":"2024","journal-title":"PeerJ"},{"issue":"5","key":"pone.0326351.ref015","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1007\/s40744-022-00475-4","article-title":"Artificial intelligence in rheumatoid arthritis: current status and future perspectives: a state-of-the-art review","volume":"9","author":"S Momtazmanesh","year":"2022","journal-title":"Rheumatol Ther"},{"issue":"4","key":"pone.0326351.ref016","doi-asserted-by":"crossref","first-page":"275","DOI":"10.4274\/imj.galenos.2020.38243","article-title":"What is the frequency of internet searches by patients with rheumatic diseases? To what degree are the websites they get information from reliable and what is the effect of these websites on their treatment?","volume":"21","author":"A G\u00fcrcan At\u00e7\u0131","year":"2020","journal-title":"Istanbul Med J"},{"key":"pone.0326351.ref017","doi-asserted-by":"crossref","first-page":"152575","DOI":"10.1016\/j.semarthrit.2024.152575","article-title":"Information and communication technology-based patient education for autoimmune inflammatory rheumatic diseases: a scoping review","volume":"69","author":"J Yoon","year":"2024","journal-title":"Semin Arthritis Rheum"},{"issue":"1","key":"pone.0326351.ref018","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1007\/s10238-024-01453-6","article-title":"Application of artificial intelligence in rheumatic disease: a bibliometric analysis","volume":"24","author":"J Zhao","year":"2024","journal-title":"Clin Exp Med"},{"issue":"5","key":"pone.0326351.ref019","article-title":"Role of artificial intelligence (AI) in patient education and communication in dentistry","volume":"16","author":"V Thorat","year":"2024","journal-title":"Cureus"},{"issue":"18","key":"pone.0326351.ref020","article-title":"How artificial intelligence can provide information about subdural hematoma: assessment of readability, reliability, and quality of ChatGPT, BARD, and perplexity responses","volume":"103","author":"\u015e G\u00fcl","year":"2024","journal-title":"Medicine"},{"issue":"33","key":"pone.0326351.ref021","doi-asserted-by":"crossref","DOI":"10.1097\/MD.0000000000039305","article-title":"Assessment of readability, reliability, and quality of ChatGPT\u00ae, BARD\u00ae, Gemini\u00ae, Copilot\u00ae, Perplexity\u00ae responses on palliative care","volume":"103","author":"V Hanc\u0131","year":"2024","journal-title":"Medicine (Baltimore)"},{"issue":"2","key":"pone.0326351.ref022","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2018-024582","article-title":"Assessing the readability and patient comprehension of rheumatology medicine information sheets: a cross-sectional Health Literacy Study","volume":"9","author":"M Oliffe","year":"2019","journal-title":"BMJ Open"},{"issue":"11","key":"pone.0326351.ref023","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1007\/s00296-016-3566-4","article-title":"Medication adherence in patients with rheumatoid arthritis: why do patients not take what we prescribe?","volume":"36","author":"PKK Wong","year":"2016","journal-title":"Rheumatol Int"},{"key":"pone.0326351.ref024","author":"S Noble"},{"key":"pone.0326351.ref025","author":"Statista"},{"issue":"10","key":"pone.0326351.ref026","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1001\/jamaoncol.2023.2947","article-title":"Assessment of artificial intelligence chatbot responses to top searched queries about cancer","volume":"9","author":"A Pan","year":"2023","journal-title":"JAMA Oncol"},{"issue":"10","key":"pone.0326351.ref027","doi-asserted-by":"crossref","DOI":"10.1016\/j.jvir.2023.05.037","article-title":"Evaluation of an artificial intelligence chatbot for delivery of IR patient education material: a comparison with societal website content","volume":"34","author":"CJ McCarthy","year":"2023","journal-title":"J Vasc Interv Radiol"},{"issue":"1","key":"pone.0326351.ref028","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/s40942-024-00579-9","article-title":"Evaluation of the accuracy and readability of ChatGPT-4 and Google Gemini in providing information on retinal detachment: a multicenter expert comparative study","volume":"10","author":"P Strzalkowski","year":"2024","journal-title":"Int J Retin Vitr"},{"issue":"12","key":"pone.0326351.ref029","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1007\/s11920-023-01477-x","article-title":"An introduction to generative artificial intelligence in mental health care: considerations and guidance","volume":"25","author":"DR King","year":"2023","journal-title":"Curr Psychiatry Rep"},{"key":"pone.0326351.ref030","doi-asserted-by":"crossref","first-page":"1226776","DOI":"10.3389\/fpubh.2023.1226776","article-title":"AI chatbots and (mis)information in public health: impact on vulnerable communities","volume":"11","author":"DW Meyrowitsch","year":"2023","journal-title":"Front Public Health"},{"key":"pone.0326351.ref031","author":"H Solanki"},{"issue":"2","key":"pone.0326351.ref032","doi-asserted-by":"crossref","DOI":"10.4081\/reumatismo.2022.1495","article-title":"Evaluating the readability, quality and reliability of online information on Beh\u00e7et\u2019s disease","volume":"74","author":"E \u00d6zduran","year":"2022","journal-title":"Reumatismo"},{"key":"pone.0326351.ref033","doi-asserted-by":"crossref","DOI":"10.7717\/peerj.15412","article-title":"Evaluation of the reliability and quality of YouTube videos as a source of information for transcutaneous electrical nerve stimulation","volume":"11","author":"Y Erkin","year":"2023","journal-title":"PeerJ"},{"issue":"16","key":"pone.0326351.ref034","doi-asserted-by":"crossref","DOI":"10.1097\/MD.0000000000033529","article-title":"Evaluating the readability, quality and reliability of online patient education materials on transcutaneuous electrical nerve stimulation (TENS)","volume":"102","author":"Y Erkin","year":"2023","journal-title":"Medicine (Baltimore)"},{"issue":"15","key":"pone.0326351.ref035","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling, and assuring the quality of medical information on the Internet: caveant lector et viewor--Let the reader and viewer beware","volume":"277","author":"WM Silberg","year":"1997","journal-title":"JAMA"},{"issue":"2","key":"pone.0326351.ref036","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"DISCERN: an instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"D Charnock","year":"1999","journal-title":"J Epidemiol Community Health"},{"issue":"4","key":"pone.0326351.ref037","doi-asserted-by":"crossref","first-page":"907","DOI":"10.54029\/2023kif","article-title":"Youtube as a source of information about stroke rehabilitation during the COVID-19 pandemic","volume":"28","author":"E \u00d6zduran","year":"2023","journal-title":"NeuroAsia"},{"issue":"4","key":"pone.0326351.ref038","first-page":"588","article-title":"Evaluating the readability, quality, and reliability of online patient education materials on spinal cord stimulation","volume":"34","author":"ME Gunduz","year":"2024","journal-title":"Turk Neurosurg"},{"issue":"1","key":"pone.0326351.ref039","doi-asserted-by":"crossref","first-page":"16","DOI":"10.4103\/injr.injr_56_22","article-title":"Evaluating the readability, quality, and reliability of online information on Sjogren\u2019s syndrome","volume":"18","author":"E Ozduran","year":"2023","journal-title":"Indian J Rheumatol"},{"key":"pone.0326351.ref040","doi-asserted-by":"crossref","DOI":"10.7717\/peerj.13686","article-title":"Evaluating the readability, quality and reliability of online patient education materials on post-covid pain","volume":"10","author":"E Ozduran","year":"2022","journal-title":"PeerJ"},{"issue":"9","key":"pone.0326351.ref041","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","article-title":"A systematic review of patient inflammatory bowel disease information resources on the World Wide Web","volume":"102","author":"A Bernard","year":"2007","journal-title":"Am J Gastroenterol"},{"issue":"10","key":"pone.0326351.ref042","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.cjco.2022.07.004","article-title":"Evaluation of online written medication educational resources for people living with heart failure","volume":"4","author":"S Ladhar","year":"2022","journal-title":"CJC Open"},{"key":"pone.0326351.ref043","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.urology.2023.05.040","article-title":"Can ChatGPT, an artificial intelligence language model, provide accurate and high-quality patient information on prostate cancer?","volume":"180","author":"B Coskun","year":"2023","journal-title":"Urology"},{"issue":"2","key":"pone.0326351.ref044","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1111\/j.1369-7625.2004.00273.x","article-title":"Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information","volume":"7","author":"B Moult","year":"2004","journal-title":"Health Expect"},{"issue":"1","key":"pone.0326351.ref045","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s40744-021-00393-x","article-title":"The association between TNF inhibitor therapy availability and hospital admission rates for patients with Ankylosing spondylitis. a longitudinal population-based study","volume":"9","author":"J Nossent","year":"2022","journal-title":"Rheumatol Ther"},{"issue":"1","key":"pone.0326351.ref046","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s13075-017-1246-8","article-title":"Rheumatology around the world: perspectives from Australia and New Zealand","volume":"19","author":"FMF McQueen","year":"2017","journal-title":"Arthritis Res Ther"},{"key":"pone.0326351.ref047","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1186\/s12889-020-09506-7","article-title":"Assessment of health-related quality of life and patient\u2019s knowledge in chronic non-specific low back pain","volume":"21","author":"M J\u00e1romi","year":"2021","journal-title":"BMC Public Health"},{"key":"pone.0326351.ref048","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.ijcard.2019.05.066","article-title":"New technologies, new disparities: the intersection of electronic health and digital health literacy","volume":"292","author":"B Smith","year":"2019","journal-title":"Int J Cardiol"},{"issue":"1","key":"pone.0326351.ref049","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.1619","article-title":"eHealth literacy: extending the digital divide to the realm of health information","volume":"14","author":"E Neter","year":"2012","journal-title":"J Med Internet Res"},{"key":"pone.0326351.ref050","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1136\/annrheumdis-2015-eular.6284","article-title":"THU0582 readability of online Ankylosing spondylitis patient education material","volume":"74","author":"A Omar","year":"2015","journal-title":"Ann Rheum Dis"},{"issue":"1","key":"pone.0326351.ref051","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/s12910-016-0126-0","article-title":"Readability of patient information and consent documents in rheumatological studies","volume":"17","author":"B Hamnes","year":"2016","journal-title":"BMC Med Ethics"},{"issue":"11","key":"pone.0326351.ref052","doi-asserted-by":"crossref","first-page":"3269","DOI":"10.1007\/s10067-019-04706-y","article-title":"Quality and readability of online information on Ankylosing spondylitis","volume":"38","author":"BF Kocyigit","year":"2019","journal-title":"Clin Rheumatol"},{"issue":"1","key":"pone.0326351.ref053","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1186\/s12911-023-02162-y","article-title":"The impact of artificial intelligence on the person-centred, doctor-patient relationship: some problems and solutions","volume":"23","author":"A Sauerbrei","year":"2023","journal-title":"BMC Med Inform Decis Mak"},{"key":"pone.0326351.ref054","doi-asserted-by":"crossref","first-page":"20552076231224603","DOI":"10.1177\/20552076231224603","article-title":"Evaluation of information provided to patients by ChatGPT about chronic diseases in Spanish language","volume":"10","author":"MJ Soto-Ch\u00e1vez","year":"2024","journal-title":"Digit Health"},{"issue":"3","key":"pone.0326351.ref055","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1002\/art.42737","article-title":"Doctor versus artificial intelligence: patient and physician evaluation of large language model responses to rheumatology patient questions in a cross-sectional study","volume":"76","author":"C Ye","year":"2024","journal-title":"Arthritis Rheumatol"},{"key":"pone.0326351.ref056","doi-asserted-by":"crossref","first-page":"105562","DOI":"10.1016\/j.ijmedinf.2024.105562","article-title":"Assessing the response quality and readability of chatbots in cardiovascular health, oncology, and psoriasis: a comparative study","volume":"190","author":"R Olszewski","year":"2024","journal-title":"Int J Med Inform"},{"issue":"1","key":"pone.0326351.ref057","doi-asserted-by":"crossref","DOI":"10.1186\/s12969-024-01011-0","article-title":"Reliability of a generative artificial intelligence tool for pediatric familial Mediterranean fever: insights from a multicentre expert survey","volume":"22","author":"S La Bella","year":"2024","journal-title":"Pediatr Rheumatol"},{"issue":"3","key":"pone.0326351.ref058","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s00393-024-01535-6","article-title":"Welches Potential hat ChatGPT 3.5 f\u00fcr eine qualifizierte Patienteninformation?: Versuch einer systematischen Analyse anhand einer Befragung zu komplement\u00e4rmedizinischen Verfahren in der Rheumatologie [What is the potential of ChatGPT for qualified patient information?: attempt of a structured analysis on the basis of a survey regarding complementary and alternative medicine (CAM) in rheumatology]","volume":"84","author":"G Key\u00dfer","year":"2025","journal-title":"Z Rheumatol"},{"issue":"3","key":"pone.0326351.ref059","doi-asserted-by":"crossref","first-page":"105651","DOI":"10.1016\/j.jbspin.2023.105651","article-title":"Artificial intelligence to analyze magnetic resonance imaging in rheumatology","volume":"91","author":"LC Adams","year":"2024","journal-title":"Joint Bone Spine"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0326351","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:53:45Z","timestamp":1750269225000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0326351"}},"subtitle":[],"editor":[{"given":"Mark","family":"Hwang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,6,18]]},"references-count":59,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6,18]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0326351","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,18]]}}}