{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T19:42:30Z","timestamp":1775936550958,"version":"3.50.1"},"reference-count":34,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T00:00:00Z","timestamp":1760313600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["aao-hnsfjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Otolaryngol.--head neck surg."],"published-print":{"date-parts":[[2025,12]]},"abstract":"Abstract<\/jats:title>\n \n Objective<\/jats:title>\n Evaluate and compare artificial intelligence (AI) chatbot responses to queries extrapolated from statements by Dysphonia International (DI).<\/jats:p>\n <\/jats:sec>\n \n Study Design<\/jats:title>\n Cross\u2010sectional analysis.<\/jats:p>\n <\/jats:sec>\n \n Setting<\/jats:title>\n Online using ChatGPT, Google AI Overview (GAO), and DI.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n Two board\u2010certified otolaryngologists and an otolaryngology resident each blindly rated ChatGPT, GAO, and DI responses to spasmodic dysphonia, muscle tension dysphonia, and vocal tremor questions. Response comprehensiveness, accuracy, appropriateness to patients, and patient safety were graded on a 5\u2010point Likert scale. Flesch\u2010Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Gunning Fog Index (GFI), and average word count assessed readability. Analysis was performed with one\u2010way analysis of variance (ANOVA) and Tukey honestly significant difference (HSD); significance was set at\n P<\/jats:italic>\n \u2009<\u2009.05.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n ChatGPT was significantly more comprehensive than both GAO (\n P<\/jats:italic>\n \u2009<\u2009.01) and DI (\n P<\/jats:italic>\n \u2009=\u2009.0357). ChatGPT was significantly more accurate than both GAO (\n P<\/jats:italic>\n \u2009<\u2009.01) and DI (\n P<\/jats:italic>\n \u2009<\u2009.01), while GAO was more accurate than DI (\n P<\/jats:italic>\n \u2009<\u2009.01). ChatGPT was found to be significantly more patient\u2010friendly than both GAO (\n P<\/jats:italic>\n \u2009<\u2009.01) and DI (\n P<\/jats:italic>\n \u2009<\u2009.01). ChatGPT had significantly safer recommendations than GAO (\n P<\/jats:italic>\n \u2009<\u2009.01). ChatGPT had a significantly higher FKGL than GAO (\n P<\/jats:italic>\n \u2009<\u2009.01), and a lower FRES than both GAO (\n P<\/jats:italic>\n \u2009<\u2009.01) and DI (\n P<\/jats:italic>\n \u2009<\u2009.01), indicating a more difficult reading level. All resources exceeded the recommended FKGL and GFI scores as well as the FRES of 90 to 100. Interrater reliability was 0.8.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n ChatGPT performed significantly better than GAO and DI regarding comprehensiveness, accuracy, appropriateness, and was an overall safer AI resource to use than GAO. All resources were above the recommended reading grade level. AI models prove to be a formidable alternative resource for patient\u2010centered clinical information.<\/jats:p>\n <\/jats:sec>","DOI":"10.1002\/ohn.70030","type":"journal-article","created":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T06:25:16Z","timestamp":1760423116000},"page":"1455-1462","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Artificial Intelligence Models for Dysphonia Patient Education"],"prefix":"10.1002","volume":"173","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-2728-722X","authenticated-orcid":false,"given":"Rebecca An","family":"Ho","sequence":"first","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5319-7852","authenticated-orcid":false,"given":"Esha","family":"Shah","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6801-5012","authenticated-orcid":false,"given":"John Sebastian","family":"De Armas","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0601-8127","authenticated-orcid":false,"given":"Kenneth","family":"Yan","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9700-0132","authenticated-orcid":false,"given":"Rachel","family":"Kaye","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Head and Neck Surgery Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2025,10,13]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1097\/BPO.0000000000002923"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.23773"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijporl.2013.03.021"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/00016489.2023.2254809"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/01455613241230841"},{"key":"e_1_2_9_7_1","unstructured":"107+ ChatGPT statistics and user numbers (May 2025). NerdyNav. May 2 2025. Accessed June 8 2025.https:\/\/nerdynav.com\/chatgpt-statistics\/"},{"key":"e_1_2_9_8_1","unstructured":"AI overviews and your website | Google Search Central | Documentation. Google for Developers. Accessed June 8 2025.https:\/\/developers.google.com\/search\/docs\/appearance\/ai-overviews"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1136\/bjo-2023-325143"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjoto.2024.104502"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/00034894241249621"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/children10101634"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-023-08051-4"},{"key":"e_1_2_9_14_1","doi-asserted-by":"crossref","unstructured":"PatelJ RobinsonP IllingE AnthonyBIs ChatGPT 3.5 smarter than otolaryngology trainees? A comparison study of board style exam questions.PLoS ONE.2024;19(9):e0306233.doi:10.1371\/journal.pone.0306233","DOI":"10.1371\/journal.pone.0306233"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.526"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/oto2.163"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.31410"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-024-08634-9"},{"key":"e_1_2_9_19_1","unstructured":"Quick statistics about voice speech language. NIDCD. March 11 2025. Accessed March 22 2025.https:\/\/www.nidcd.nih.gov\/health\/statistics\/quick-statistics-voice-speech-language"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599817751137"},{"key":"e_1_2_9_21_1","unstructured":"Home\u2014Dysphonia International. Accessed June 82025.https:\/\/dysphonia.org\/"},{"key":"e_1_2_9_22_1","unstructured":"Gunning Fog Index calculator. Readability Tools by Gorby. Accessed June 8 2025.https:\/\/gorby.app\/readability\/gunning-fog\/"},{"key":"e_1_2_9_23_1","volume-title":"Health Literacy: A Manual for Clinicians: Part of an Educational Program About Health Literacy","author":"Weiss BD","year":"2003"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2024.106491"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/ptj\/pzaf010"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1089\/fpsam.2024.0206"},{"key":"e_1_2_9_27_1","article-title":"The impact of internet resources and artificial intelligence on information on myringotomy tubes","author":"Papuc M","year":"2024","journal-title":"Eur Arch Otorhinolaryngol"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcms.2024.10.002"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-024-08746-2"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/medicina60060957"},{"key":"e_1_2_9_31_1","first-page":"1","article-title":"Assessing the responses of large language models (ChatGPT\u20104, Claude 3, Gemini, and Microsoft Copilot) to frequently asked questions in retinopathy of prematurity: a study on readability and appropriateness","volume":"28","author":"Ermis S","year":"2024","journal-title":"J Pediatr Ophthalmol Strabismus"},{"issue":"6","key":"e_1_2_9_32_1","article-title":"Exploring the role of ChatGPT\u20104, BingAI, and Gemini as virtual consultants to educate families about retinopathy of prematurity","volume":"11","author":"Durmaz Engin C","year":"2024","journal-title":"Children (Basel)"},{"key":"e_1_2_9_33_1","article-title":"Evaluating the quality and readability of ChatGPT\u2010generated patient\u2010facing medical information in rhinology","author":"Fazilat AZ","year":"2024","journal-title":"Eur Arch Otorhinolaryngol"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1210\/jendso\/bvaf003"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.1097\/SCS.0000000000010678"}],"container-title":["Otolaryngology\u2013Head and Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.70030","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T09:31:23Z","timestamp":1764322283000},"score":1,"resource":{"primary":{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1002\/ohn.70030"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,13]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["10.1002\/ohn.70030"],"URL":"https:\/\/doi.org\/10.1002\/ohn.70030","archive":["Portico"],"relation":{},"ISSN":["0194-5998","1097-6817"],"issn-type":[{"value":"0194-5998","type":"print"},{"value":"1097-6817","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,13]]},"assertion":[{"value":"2025-06-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}