{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T01:20:15Z","timestamp":1780449615398,"version":"3.54.1"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019863","name":"Tekirdag Nam\u0131k Kemal University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100019863","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The aim of the study is\u00a0to evaluate and compare the quality and readability of responses generated by five different artificial intelligence (AI) chatbots\u2014ChatGPT, Bard, Bing, Ernie, and Copilot\u2014to the top searched queries of erectile dysfunction (ED). Google Trends was used to identify ED-related relevant phrases. Each AI chatbot received a specific sequence of 25 frequently searched terms as input. Responses were evaluated using DISCERN, Ensuring Quality Information for Patients (EQIP), and Flesch-Kincaid Grade Level (FKGL) and Reading Ease (FKRE) metrics. The top three most frequently searched phrases were \u201cerectile dysfunction cause\u201d, \u201chow to erectile dysfunction,\u201d and \u201cerectile dysfunction treatment.\u201d Zimbabwe, Zambia, and Ghana exhibited the highest level of interest in ED. None of the AI chatbots achieved the necessary degree of readability. However, Bard exhibited significantly higher FKRE and FKGL ratings (<jats:italic>p<\/jats:italic>\u2009=\u20090.001), and Copilot achieved better EQIP and DISCERN ratings than the other chatbots (<jats:italic>p<\/jats:italic>\u2009=\u20090.001). Bard exhibited the simplest linguistic framework and posed the least challenge in terms of readability and comprehension, and Copilot\u2019s text quality on ED was superior to the other chatbots. As new chatbots are introduced, their understandability and text quality increase, providing better guidance to patients.<\/jats:p>","DOI":"10.1007\/s10916-024-02056-0","type":"journal-article","created":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T06:01:46Z","timestamp":1712124106000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis"],"prefix":"10.1007","volume":"48","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0926-3005","authenticated-orcid":false,"given":"Mehmet Fatih","family":"\u015eahin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"H\u00fcseyin","family":"Ate\u015f","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6522-0862","authenticated-orcid":false,"given":"An\u0131l","family":"Kele\u015f","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2083-3216","authenticated-orcid":false,"given":"R\u0131dvan","family":"\u00d6zcan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9681-2473","authenticated-orcid":false,"given":"\u00c7a\u011fr\u0131","family":"Do\u011fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6187-1940","authenticated-orcid":false,"given":"Murat","family":"Akg\u00fcl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6140-5181","authenticated-orcid":false,"given":"Cenk Murat","family":"Yaz\u0131c\u0131","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,3]]},"reference":[{"key":"2056_CR1","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.ucl.2008.08.004","volume":"36","author":"DC Miller","year":"2009","unstructured":"Miller DC, Saigal CS, Litwin MS, et al (2009). The demographic burden of urologic disease in America. Urol Clin North Am; 36:11\u201327.","journal-title":"Urol Clin North Am"},{"key":"2056_CR2","doi-asserted-by":"publisher","first-page":"S94","DOI":"10.1016\/S1875-6867(11)60033-X","volume":"8","author":"AA Ab Rahman","year":"2011","unstructured":"Ab Rahman AA, Al-Sadat N, Yun Low W. (2011) Help seeking behaviour among men with erectile dysfunction in primary care setting. J Mens Health.;8: S94\u20136.","journal-title":"J Mens Health"},{"key":"2056_CR3","unstructured":"Waling A, Fraser S, Fisher C. Young People and Sources of Sexual Health Information (ARCSHS Monograph Series No. 121). Bundoora, VIC: Australian Research Centre in Sex, Health and Society, La Trobe University 2020."},{"key":"2056_CR4","doi-asserted-by":"crossref","unstructured":"Russo, G.I., Asmundo, M.G., Durukan, E.\u00a0et al (2023).\u00a0Quality and benefits of the erectile dysfunction information on websites, social-media, and applications.\u00a0Int J Impot Res.","DOI":"10.1038\/s41443-023-00725-1"},{"key":"2056_CR5","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1109\/MS.2020.3030198","volume":"38","author":"S P\u00e9rez-Soler","year":"2021","unstructured":"P\u00e9rez-Soler S, Juarez-Puerta S, Guerra E, de Lara J (2021). Choosing a chatbot development tool. IEEE Software; 38:94\u2013103.","journal-title":"IEEE Software"},{"key":"2056_CR6","doi-asserted-by":"crossref","unstructured":"Skjuve M, Brandzaeg PB (2019). Measuring user experience in chatbots: An approach to interpersonal communication competence. Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24\u201326, 2018, Revised Selected Papers 5: Springer;113\u2013120.","DOI":"10.1007\/978-3-030-17705-8_10"},{"key":"2056_CR7","doi-asserted-by":"crossref","unstructured":"Christopherjames JE, Saravanan M, Thiyam DB, Sahib MYB, Ganapathi MV, Milton A. (2021) Natural language processing based human assistive health conversational agent for multi-users. 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC): IEEE;1414\u20131420.","DOI":"10.1109\/ICESC51422.2021.9532913"},{"key":"2056_CR8","doi-asserted-by":"crossref","unstructured":"Pan A, Musheyev D, Loeb S, Kabarriti AE (2023). Quality of erectile dysfunction information from ChatGPT and other artificial intelligence chatbots. BJU Int. 2024 Feb;133(2):152\u2013154. Epub Nov 24.","DOI":"10.1111\/bju.16209"},{"key":"2056_CR9","doi-asserted-by":"crossref","unstructured":"Temel MH, Erden Yakup, Ba\u011fc\u0131er Fatih (2023). Information Quality and Readability: ChatGPT\u2019s Responses to the Most Common Questions About Spinal Cord Injury.\u00a0World Neurosurgery.","DOI":"10.1016\/j.wneu.2023.11.062"},{"key":"2056_CR10","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1111\/j.1369-7625.2004.00273.x","volume":"7","author":"B Moult","year":"2004","unstructured":"Moult B, Franck LS, Brady H (2004). Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information.\u00a0Health expectations; 7:165\u2013175.","journal-title":"Health expectations"},{"key":"2056_CR11","doi-asserted-by":"crossref","unstructured":"Hain T (2002). Improving the quality of health information: the contribution of C\u2010H\u2010i\u2010Q.\u00a0Health Expectations; 5.","DOI":"10.1046\/j.1369-6513.2002.00189.x"},{"key":"2056_CR12","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1136\/jech.53.2.105","volume":"53","author":"D Charnock","year":"1999","unstructured":"Charnock D, Shepperd S, Needham G, et al (1999). DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health; 53:105\u201311.","journal-title":"J Epidemiol Community Health"},{"key":"2056_CR13","doi-asserted-by":"crossref","unstructured":"Brewer J (2018). Measuring Text Readability Using Reading Level: 1499\u20131507.","DOI":"10.4018\/978-1-5225-2255-3.ch129"},{"issue":"1","key":"2056_CR14","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1046\/j.1464-410x.1999.00142.x","volume":"84","author":"IA Ayta","year":"1999","unstructured":"Ayta IA, McKinlay JB, Krane RJ (1999) The likely worldwide increase in erectile dysfunction between 1995 and 2025 and some possible policy consequences. BJU Int. 84 (1): 50\u201356.","journal-title":"BJU Int"},{"issue":"2","key":"2056_CR15","doi-asserted-by":"publisher","first-page":"69","DOI":"10.21522\/TIJPH.2013.06.02.Art009","volume":"6","author":"VPI Machingura","year":"2018","unstructured":"Machingura, VPI (2018). Erectile dysfunction among diabetic patients at parirenyatwa group of hospitals in Zimbabwe.\u00a0Texila International Journal of Public Health,\u00a06(2), 69\u201373.","journal-title":"Texila International Journal of Public Health"},{"issue":"1","key":"2056_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4102\/phcfm.v7i1.766","volume":"7","author":"E Chinkoyo","year":"2015","unstructured":"Chinkoyo E, Chinkoyo E, Pather M. (2015). Erectile function in circumcised and uncircumcised men in Lusaka, Zambia: A cross-sectional study.\u00a0African Journal of Primary Health Care and Family Medicine,\u00a07(1), 1\u20137.","journal-title":"African Journal of Primary Health Care and Family Medicine"},{"issue":"Suppl 1","key":"2056_CR17","doi-asserted-by":"publisher","first-page":"S1","DOI":"10.1038\/sj.ijir.3900967","volume":"15","author":"I Khalaf","year":"2003","unstructured":"Khalaf I, Levinson I (2003). Erectile dysfunction in the Africa\/Middle East Region: epidemiology and experience with sildenafil citrate (Viagra\u00ae).\u00a0Int J Impot Res\u00a015\u00a0(Suppl 1), S1\u2013S2.","journal-title":"Int J Impot Res"},{"key":"2056_CR18","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1007\/s10916-018-1097-0","volume":"42","author":"J Gomes","year":"2018","unstructured":"Gomes J, Rom\u00e3o M (2018). Information system maturity models in healthcare. Journal of medical systems;42:235.","journal-title":"Journal of medical systems"},{"key":"2056_CR19","doi-asserted-by":"crossref","unstructured":"Cocci A, Pezzoli M, Lo Re M, et al (2023). Quality of information and appropriateness of ChatGPT outputs for urology patients. Prostate cancer and prostatic diseases:1\u20136.","DOI":"10.1038\/s41391-023-00705-y"},{"key":"2056_CR20","doi-asserted-by":"crossref","unstructured":"Howick J, Morley J, Floridi L (2021). An empathy imitation game: empathy turing test for care-and chat-bots. Minds and Machines.:1\u20135.","DOI":"10.1007\/s11023-021-09555-w"},{"key":"2056_CR21","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1177\/1062860617751639","volume":"33","author":"L Daraz","year":"2018","unstructured":"Daraz L, Morrow AS, Ponce OJ, et al (2018). Readability of online health information: a meta-narrative systematic review. American Journal of Medical Quality.;33:487\u2013492.","journal-title":"American Journal of Medical Quality"},{"key":"2056_CR22","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1016\/j.oret.2023.05.022","volume":"7","author":"B Momenaei","year":"2023","unstructured":"Momenaei B, Wakabayashi T, Shahlaee A, et al (2023). Appropriateness and Readability of ChatGPT-4-Generated Responses for Surgical Treatment of Retinal Diseases. Ophthalmology Retina;7:862\u2013868.","journal-title":"Ophthalmology Retina"},{"key":"2056_CR23","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1038\/s41598-023-50884-w","volume":"14","author":"CE Onder","year":"2024","unstructured":"Onder CE, Koc G, Gokbulut P, Taskaldiran I, Kuskonmaz SM (2024). Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy. Scientific Reports.;14:243.","journal-title":"Scientific Reports"},{"key":"2056_CR24","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1016\/S0002-9343(02)01473-0","volume":"113","author":"G Eysenbach","year":"2002","unstructured":"Eysenbach G (2002). Infodemiology: the epidemiology of (mis)information. The American Journal of Medicine; 113:763\u2013765.","journal-title":"The American Journal of Medicine"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02056-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-024-02056-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-024-02056-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T07:26:57Z","timestamp":1736839617000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-024-02056-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,3]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2056"],"URL":"https:\/\/doi.org\/10.1007\/s10916-024-02056-0","relation":{},"ISSN":["1573-689X"],"issn-type":[{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,3]]},"assertion":[{"value":"13 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"No ethical approval was needed because this is not a human study, but only online information was used.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"All procedures performed in this study were in accordance with the ethical stan-dards of the institutional and\/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. No animal or human studies were carried out by the authors for this article.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Animal and Human Rights"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"38"}}