{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T12:20:33Z","timestamp":1792153233454,"version":"4.4.0"},"reference-count":45,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T00:00:00Z","timestamp":1714089600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T00:00:00Z","timestamp":1714089600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["The Laryngoscope"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Understanding the strengths and weaknesses of chatbots as a source of patient information is critical for providers in the rising artificial intelligence landscape. This study is the first to quantitatively analyze and compare four of the most used chatbots available regarding treatments of common pathologies in rhinology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The treatment of epistaxis, chronic sinusitis, sinus infection, allergic rhinitis, allergies, and nasal polyps was asked to chatbots ChatGPT, ChatGPT Plus, Google Bard, and Microsoft Bing in May 2023. Individual responses were analyzed by reviewers for readability, quality, understandability, and actionability using validated scoring metrics. Accuracy and comprehensiveness were evaluated for each response by two experts in rhinology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      ChatGPT, Plus, Bard, and Bing had FRE readability scores of 33.17, 35.93, 46.50, and 46.32, respectively, indicating higher readability for Bard and Bing compared to ChatGPT (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.003,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.008) and Plus (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.025,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.048). ChatGPT, Plus, and Bard had mean DISCERN quality scores of 20.42, 20.89, and 20.61, respectively, which was higher than the score for Bing of 16.97 (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001). For understandability, ChatGPT and Bing had PEMAT scores of 76.67 and 66.61, respectively, which were lower than both Plus at 92.00 (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001) and Bard at 92.67 (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001). ChatGPT Plus had an accuracy score of 4.39 which was higher than ChatGPT (3.97,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.118), Bard (3.72,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.002), and Bing (3.19,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>On aggregate of the tested domains, our results suggest ChatGPT Plus and Google Bard are currently the most patient\u2010friendly chatbots for the treatment of common pathologies in rhinology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence<\/jats:title>\n                    <jats:p>\n                      N\/A\n                      <jats:italic>Laryngoscope<\/jats:italic>\n                      , 134:4225\u20134231, 2024\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/lary.31470","type":"journal-article","created":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T08:49:24Z","timestamp":1714121364000},"page":"4225-4231","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Quantitative Comparison of Chatbots on Common Rhinology Pathologies"],"prefix":"10.1002","volume":"134","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3470-0024","authenticated-orcid":false,"given":"Jeffrey R.","family":"Bellinger","sequence":"first","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Virginia School of Medicine  Charlottesville Virginia U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minhie W.","family":"Kwak","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Virginia School of Medicine  Charlottesville Virginia U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel A.","family":"Ramos","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Virginia School of Medicine  Charlottesville Virginia U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey S.","family":"Mella","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Virginia School of Medicine  Charlottesville Virginia U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jose L.","family":"Mattos","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Virginia School of Medicine  Charlottesville Virginia U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_7_2_1","unstructured":"OpenAI.https:\/\/openai.com\/blog\/openai-api\/"},{"key":"e_1_2_7_3_1","unstructured":"DhedaG OpenAI.Master. How does ChatGPT work?Published April 52023https:\/\/openaimaster.com\/how-does-chatgpt-work\/"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324920000601"},{"key":"e_1_2_7_5_1","unstructured":"GhahramaniZ.Google Blog. Introducing PaLM 2.https:\/\/blog.google\/technology\/ai\/google-palm-2-ai-large-language-model\/"},{"key":"e_1_2_7_6_1","unstructured":"OrtizS.ZDNet. What is Bing Chat? Here's everything you need to know."},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-04397-7"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/asj\/sjad130"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/ehjdh\/ztad029"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4335905"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinane.2023.111185"},{"key":"e_1_2_7_13_1","unstructured":"Gpt Generative Pretrained Transformer Almira Osmanovic Thunstr\u00f6m Steinn Steingrimsson.Can GPT\u20103 write an academic paper on itself with minimal human input?https:\/\/hal.science\/hal-03701250\/"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2023.02.008"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/08989621.2023.2179919"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/08989621.2023.2180359"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/08989621.2023.2177160"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-04383-z"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(23)00019-5"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00360-2"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpurol.2023.05.018"},{"key":"e_1_2_7_22_1","unstructured":"BianchiT.Worldwide desktop market share of leading search engines from January 2015 to January 2023. Statista. Published February 242023https:\/\/www.statista.com\/statistics\/216573\/worldwide\u2010market\u2010share\u2010of\u2010search\u2010engines\/#:~:text=Global%20desktop%20market%20share%20of%20search%20engines%202015%2D2023&text=As%20of%20January%202023%2C%20online market%20share%20was%202.59%20percent"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.23.29493"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/aos.15661"},{"key":"e_1_2_7_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaad.2023.05.024"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.3350\/cmh.2023.0089"},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.23.29622"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoto.2023.0704"},{"key":"e_1_2_7_30_1","unstructured":"Flesch Reading Ease and the Flesch Kincaid Grade Level. Readable."},{"key":"e_1_2_7_31_1","doi-asserted-by":"publisher","DOI":"10.1136\/jech.53.2.105"},{"key":"e_1_2_7_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2014.05.027"},{"key":"e_1_2_7_33_1","unstructured":"\u201caccuracy\u201d; \u201ccomprehensiveness.\u201d In:Vocabulary.Com.https:\/\/www.vocabulary.com\/dictionary\/accuracy https:\/\/www.vocabulary.com\/dictionary\/comprehensiveness"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-010-1380-y"},{"key":"e_1_2_7_35_1","volume-title":"Health Literacy: A Manual for Clinicians","author":"Weis B","year":"2003"},{"key":"e_1_2_7_36_1","unstructured":"National Institutes of Health.How to Write Easy to Read Health Materials.http:\/\/www.nlm.nih.gov.proxy1.library.virginia.edu\/medlineplus\/etr.html"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.1097\/JU.0000000000003615"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0022215121001559"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.23309"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2012.11.003"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5729"},{"key":"e_1_2_7_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.465"},{"key":"e_1_2_7_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.489"},{"key":"e_1_2_7_44_1","doi-asserted-by":"publisher","DOI":"10.5664\/jcsm.10728"},{"key":"e_1_2_7_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.506"},{"key":"e_1_2_7_46_1","volume-title":"Health Literacy: The Solid Facts","author":"Kickbusch I","year":"2013"}],"container-title":["The Laryngoscope"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.31470","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/lary.31470","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.31470","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T12:29:43Z","timestamp":1788611383000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lary.31470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,26]]},"references-count":45,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["10.1002\/lary.31470"],"URL":"https:\/\/doi.org\/10.1002\/lary.31470","archive":["Portico"],"relation":{},"ISSN":["0023-852X","1531-4995"],"issn-type":[{"value":"0023-852X","type":"print"},{"value":"1531-4995","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,26]]},"assertion":[{"value":"2023-12-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}