{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T19:58:26Z","timestamp":1793044706356,"version":"4.5.0"},"reference-count":35,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2025,8,11]],"date-time":"2025-08-11T00:00:00Z","timestamp":1754870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background: Generative AI (GenAI) models like ChatGPT have gained significant attention in recent years for their potential applications in healthcare. This study evaluates the concordance of responses generated by ChatGPT (versions 3.5 and 4.0) with the key action statements from the American Academy of Otolaryngology\u2013Head and Neck Surgery (AAO-HNS) clinical practice guidelines (CPGs) for M\u00e9ni\u00e8re\u2019s disease translated into Chinese. Methods: Seventeen questions derived from the KAS were translated into Chinese and posed to ChatGPT versions 3.5 and 4.0. Responses were categorized as correct, partially correct, incorrect, or non-answers. Concordance with the guidelines was evaluated, and Fisher\u2019s exact test assessed statistical differences, with significance set at p &lt; 0.05. Comparative analysis between ChatGPT 3.5 and 4.0 was performed. Results: ChatGPT 3.5 demonstrated an 82.4% correctness rate (14 correct, 2 partially correct, 1 non-answer), while ChatGPT 4.0 achieved 94.1% (16 correct, 1 partially correct). Overall, 97.1% of responses were correct or partially correct. ChatGPT 4.0 offered enhanced citation accuracy and text clarity but occasionally included redundant details. No significant difference in correctness rates was observed between the models (p = 0.6012). Conclusions: Both ChatGPT models showed high concordance with the AAO-HNS CPG for MD, with ChatGPT 4.0 exhibiting superior text clarity and citation accuracy. These findings highlight ChatGPT\u2019s potential as a reliable assistant for better healthcare communication and clinical operations. Future research should validate these results across broader medical topics and languages to ensure robust integration of GenAI in healthcare.<\/jats:p>","DOI":"10.3390\/diagnostics15162006","type":"journal-article","created":{"date-parts":[[2025,8,11]],"date-time":"2025-08-11T11:02:09Z","timestamp":1754910129000},"page":"2006","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Evaluating ChatGPT\u2019s Concordance with Clinical Guidelines of M\u00e9ni\u00e8re\u2019s Disease in Chinese"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-0599-6349","authenticated-orcid":false,"given":"Mien-Jen","family":"Lin","sequence":"first","affiliation":[{"name":"Department of Medical Education, Chang Gung Memorial Hospital, Taoyuan 33305, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li-Chun","family":"Hsieh","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Mackay Memorial Hospital, Taipei City 10449, Taiwan"},{"name":"Department of Audiology and Speech Language Pathology, Mackay Medical University, New Taipei 25245, Taiwan"},{"name":"Department of Medicine, Mackay Medical University, New Taipei 25245, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8176-128X","authenticated-orcid":false,"given":"Chin-Kuo","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology-Head and Neck Surgery, Chang Gung Memorial Hospital, Keelung 20401, Taiwan"},{"name":"School of Traditional Chinese Medicine, College of Medicine, Chang Gung University, Taoyuan 33302, Taiwan"},{"name":"Department of Otolaryngology-Head and Neck Surgery, Chang Gung Memorial Hospital, Taoyuan 33305, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3233\/VES-150549","article-title":"Diagnostic criteria for Meni\u00e8re\u2019s disease","volume":"25","author":"Carey","year":"2015","journal-title":"J. Vestib. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"g6544","DOI":"10.1136\/bmj.g6544","article-title":"Meniere\u2019s disease","volume":"349","author":"Harcourt","year":"2014","journal-title":"BMJ"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1016\/j.otc.2010.05.001","article-title":"Current epidemiology of Meniere\u2019s syndrome","volume":"43","author":"Alexander","year":"2010","journal-title":"Otolaryngol. Clin. N. Am."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"S71","DOI":"10.1007\/s00415-015-7930-1","article-title":"What is Meni\u00e8re\u2019s disease? A contemporary re-evaluation of endolymphatic hydrops","volume":"263","author":"Zou","year":"2016","journal-title":"J. Neurol."},{"key":"ref_5","first-page":"S1","article-title":"Clinical Practice Guideline: M\u00e9ni\u00e8re\u2019s Disease","volume":"162","author":"Basura","year":"2020","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_6","first-page":"CD008234","article-title":"Intratympanic gentamicin for M\u00e9ni\u00e8re\u2019s disease or syndrome","volume":"3","author":"Pullens","year":"2011","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.anl.2016.07.020","article-title":"Vestibular neuritis: Involvement and clinical features of all three semicircular canals","volume":"44","author":"Buki","year":"2017","journal-title":"Auris Nasus Larynx"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"16028","DOI":"10.1038\/nrdp.2016.28","article-title":"Meniere\u2019s disease","volume":"2","author":"Nakashima","year":"2016","journal-title":"Nat. Rev. Dis. Primers"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1046\/j.1365-2273.2003.00740.x","article-title":"Factors associated with quality of life in Meniere\u2019s disease","volume":"28","author":"Yardley","year":"2003","journal-title":"Clin. Otolaryngol. Allied Sci."},{"key":"ref_10","unstructured":"Lawlor, P., and Chang, J. (2023, August 22). History of AI: How Generative AI Grew from Early Research. Available online: https:\/\/www.qualcomm.com\/news\/onq\/2023\/08\/history-of-ai-how-generative-ai-grew-from-early-research."},{"key":"ref_11","first-page":"7","article-title":"The dark side of generative artificial intelligence: A critical analysis of controversies and risks of ChatGPT","volume":"11","author":"Wach","year":"2023","journal-title":"Entrepr. Bus. Econ. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","article-title":"Artificial intelligence in radiology","volume":"18","author":"Hosny","year":"2018","journal-title":"Nat. Rev. Cancer"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1177\/2472630319890316","article-title":"CURATE.AI: Optimizing Personalized Medicine with Artificial Intelligence","volume":"25","author":"Blasiak","year":"2020","journal-title":"SLAS Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.drudis.2020.10.010","article-title":"Artificial intelligence in drug discovery and development","volume":"26","author":"Paul","year":"2021","journal-title":"Drug Discov. Today"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1001\/jama.2023.8288","article-title":"Accuracy of a Generative Artificial Intelligence Model in a Complex Diagnostic Challenge","volume":"330","author":"Kanjee","year":"2023","journal-title":"JAMA"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1002\/ohn.465","article-title":"Head\u2014to\u2014Head Comparison of ChatGPT Versus Google Search for Medical Knowledge Acquisition","volume":"170","author":"Ayoub","year":"2023","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1002\/ohn.816","article-title":"The Use of Artificial Intelligence to Improve Readability of Otolaryngology Patient Education Materials","volume":"171","author":"Patel","year":"2024","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lai, V.D., Ngo, N.T., Veyseh, A.P.B., Man, H., Dernoncourt, F., Bui, T., and Nguyen, T.H. (2023). Chatgpt beyond english: Towards a comprehensive evaluation of large language models in multilingual learning. arXiv.","DOI":"10.18653\/v1\/2023.findings-emnlp.878"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103565","DOI":"10.1016\/j.amjoto.2022.103565","article-title":"Prevalence of anxiety and depression in Meniere\u2019s disease; a comparative analytical study","volume":"43","author":"Lahiji","year":"2022","journal-title":"Am. J. Otolaryngol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1097\/WCO.0000000000000771","article-title":"\u2018Excess anxiety\u2019 and \u2018less anxiety\u2019: Both depend on vestibular function","volume":"33","author":"Brandt","year":"2020","journal-title":"Curr. Opin. Neurol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"84","DOI":"10.23736\/S0031-0808.21.04209-9","article-title":"Dizziness, psychological disorders and cognitive decline","volume":"65","author":"Borsetto","year":"2023","journal-title":"Panminerva Medica"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zou, W., Li, Q., Peng, F., and Huang, D. (2022). Worldwide Meniere\u2019s disease research: A bibliometric analysis of the published literature between 2002 and 2021. Front. Neurol., 13.","DOI":"10.3389\/fneur.2022.1030006"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.pec.2020.09.012","article-title":"Evaluation of the quality and readability of online information about breast cancer in China","volume":"104","author":"Li","year":"2021","journal-title":"Patient Educ. Couns."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Moise, A., Centomo-Bozzo, A., Orishchak, O., Alnoury, M.K., and Daniel, S.J. (2023). Can ChatGPT Guide Parents on Tympanostomy Tube Insertion?. Children, 10.","DOI":"10.3390\/children10101634"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e1193","DOI":"10.1002\/lio2.1193","article-title":"Can ChatGPT help patients answer their otolaryngology questions?","volume":"9","author":"Zalzal","year":"2023","journal-title":"Laryngoscope Investig. Otol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e94","DOI":"10.1002\/oto2.94","article-title":"Evaluating the Current Ability of ChatGPT to Assist in Professional Otolaryngology Educatidon","volume":"7","author":"Zalzal","year":"2023","journal-title":"OTO Open"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"19","DOI":"10.21037\/ajo-24-1","article-title":"Assessment of ChatGPT vs. Bard vs. guidelines in the artificial intelligence (AI) preclinical management of otorhinolaryngological (ENT) emergencies","volume":"7","author":"Chen","year":"2024","journal-title":"Aust. J. Otolaryngol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e163","DOI":"10.1002\/oto2.163","article-title":"ChatGPT Responses to Frequently Asked Questions on M\u00e9ni\u00e8re\u2019s Disease: A Comparison to Clinical Practice Guideline Answers","volume":"8","author":"Ho","year":"2024","journal-title":"OTO Open"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"74","DOI":"10.3342\/kjorl-hns.2023.00248","article-title":"Accuracy of the Information on Sudden Sensorineural Hearing Loss From Chat Generated Pre-Trained Transformer","volume":"67","author":"Lee","year":"2024","journal-title":"Korean J. Otorhinolaryngol.-Head Neck Surg."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4011","DOI":"10.1002\/lary.31410","article-title":"Does ChatGPT Answer Otolaryngology Questions Accurately?","volume":"134","author":"Maksimoski","year":"2024","journal-title":"Laryngoscope"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1002\/ohn.832","article-title":"Evaluating ChatGPT\u2019s Performance in Answering Questions About Allergic Rhinitis and Chronic Rhinosinusitis","volume":"171","author":"Ye","year":"2024","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e55595","DOI":"10.2196\/55595","article-title":"Exploring the Performance of ChatGPT-4 in the Taiwan Audiologist Qualification Examination: Preliminary Observational Study Highlighting the Potential of AI Chatbots in Hearing Care","volume":"10","author":"Wang","year":"2024","journal-title":"JMIR Med. Educ."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, J., Dada, A., Puladi, B., Kleesiek, J., and Egger, J. (2024). ChatGPT in healthcare: A taxonomy and systematic review. Comput. Meth. Programs Biomed., 245.","DOI":"10.1016\/j.cmpb.2024.108013"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1097\/PAP.0000000000000406","article-title":"Application of ChatGPT in Routine Diagnostic Pathology: Promises, Pitfalls, and Potential Future Directions","volume":"31","author":"Schukow","year":"2024","journal-title":"Adv. Anat. Pathol."},{"key":"ref_35","first-page":"1","article-title":"How is ChatGPT\u2019s behavior changing over Time?","volume":"6","author":"Chen","year":"2024","journal-title":"Harv. Data Sci. Rev."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/16\/2006\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:24:38Z","timestamp":1760034278000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/16\/2006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,11]]},"references-count":35,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["diagnostics15162006"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics15162006","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,11]]}}}