{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T16:50:17Z","timestamp":1788454217461,"version":"build-2803163510"},"reference-count":23,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2024,9,15]],"date-time":"2024-09-15T00:00:00Z","timestamp":1726358400000},"content-version":"vor","delay-in-days":76,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["aao-hnsfjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["OTO Open"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>While most patients with COVID\u201019\u2010induced olfactory dysfunction (OD) recover spontaneously, those with persistent OD face significant physical and psychological sequelae. ChatGPT, an artificial intelligence chatbot, has grown as a tool for patient education. This study seeks to evaluate the quality of ChatGPT\u2010generated responses for COVID\u201019 OD.<\/jats:p><\/jats:sec><jats:sec><jats:title>Study Design<\/jats:title><jats:p>Quantitative observational study.<\/jats:p><\/jats:sec><jats:sec><jats:title>Setting<\/jats:title><jats:p>Publicly available online website.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>ChatGPT (GPT\u20104) was queried 4 times with 30 identical questions. Prior to questioning, Chat\u2010GPT was \u201cprompted\u201d to respond (1) to a patient, (2) to an eighth grader, (3) with references, and (4) no prompt. Answer accuracy was independently scored by 4 rhinologists using the Global Quality Score (GCS, range: 1\u20105). Proportions of responses at incremental score thresholds were compared using <jats:italic>\u03c7<\/jats:italic><jats:sup>2<\/jats:sup> analysis. Flesch\u2010Kincaid grade level was calculated for each answer. Relationship between prompt type and grade level was assessed via analysis of variance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Across all graded responses (n\u2009=\u2009480), 364 responses (75.8%) were \u201cat least good\u201d (GCS\u2009\u2265\u20094). Proportions of responses that were \u201cat least good\u201d (<jats:italic>P<\/jats:italic>\u2009&lt;\u2009.0001) or \u201cexcellent\u201d (GCS\u2009=\u20095) (<jats:italic>P<\/jats:italic>\u2009&lt;\u2009.0001) differed by prompt; \u201cat least moderate\u201d (GCS\u2009\u2265\u20093) responses did not (<jats:italic>P<\/jats:italic>\u2009=\u2009.687). Eighth\u2010grade level (14.06\u2009\u00b1\u20092.3) and patient\u2010friendly (14.33\u2009\u00b1\u20092.0) responses were significantly lower mean grade level than no prompting (<jats:italic>P<\/jats:italic>\u2009&lt;\u2009.0001).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>ChatGPT provides appropriate answers to most questions on COVID\u201019 OD regardless of prompting. However, prompting influences response quality and grade level. ChatGPT responds at grade levels above accepted recommendations for presenting medical information to patients. Currently, ChatGPT offers significant potential for patient education as an adjunct to the conventional patient\u2010physician relationship.<\/jats:p><\/jats:sec>","DOI":"10.1002\/oto2.70011","type":"journal-article","created":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T01:38:05Z","timestamp":1726450685000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Evaluating ChatGPT as a Patient Education Tool for COVID\u201019\u2010Induced Olfactory Dysfunction"],"prefix":"10.1002","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8473-8965","authenticated-orcid":false,"given":"Elliott M.","family":"Sina","sequence":"first","affiliation":[{"name":"Sidney Kimmel Medical College Thomas Jefferson University Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel J.","family":"Campbell","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Duffy","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shreya","family":"Mandloi","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Benedict","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas","family":"Farquhar","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aykut","family":"Unsal","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gurston","family":"Nyquist","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology Thomas Jefferson University Hospital Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,9,15]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.30802"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-020-06120-6"},{"key":"e_1_2_7_4_1","article-title":"Prognosis and persistence of smell and taste dysfunction in patients with covid\u201019: meta\u2010analysis with parametric cure modelling of recovery curves","volume":"378","author":"Tan BKJ","year":"2022","journal-title":"BMJ"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.530"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12070-023-03938-4"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.30122"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0022215121002279"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0256998"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/0033354919874074"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajic.2020.11.023"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare11060887"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.5664\/jcsm.10728"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1089\/thy.2023.0491"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/2374373521998847"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.4103\/1357-6283.210517"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.3390\/jpm14010104"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1097\/UPJ.0000000000000490"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.oret.2023.05.022"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2022.04.096"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/hpm.3500"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.2196\/48659"},{"issue":"3","key":"e_1_2_7_23_1","first-page":"299","article-title":"Plastic surgery and artificial intelligence: how ChatGPT improved operation note accuracy, time, and education","volume":"1","author":"Abdelhady AM","year":"2023","journal-title":"J Med Case Rep Digit Innov"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.2147\/JMDH.S413470"}],"container-title":["OTO Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/oto2.70011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T09:20:46Z","timestamp":1760952046000},"score":1,"resource":{"primary":{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1002\/oto2.70011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7]]},"references-count":23,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["10.1002\/oto2.70011"],"URL":"https:\/\/doi.org\/10.1002\/oto2.70011","archive":["Portico"],"relation":{},"ISSN":["2473-974X","2473-974X"],"issn-type":[{"value":"2473-974X","type":"print"},{"value":"2473-974X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7]]},"assertion":[{"value":"2024-06-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70011"}}