{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T11:46:27Z","timestamp":1785843987824,"version":"3.56.0"},"reference-count":37,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T00:00:00Z","timestamp":1785801600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T00:00:00Z","timestamp":1785801600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["aao-hnsfjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Otolaryngol.--head neck surg."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To evaluate the accuracy, completeness, clarity, source transparency, and readability of leading AI chatbot responses to patient questions about tracheostomy and to determine whether AI tools can reliably support patient education where high\u2010quality guidance is critical for safety.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Study Design<\/jats:title>\n                    <jats:p>Cross\u2010sectional content analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting<\/jats:title>\n                    <jats:p>Virtual study environment using publicly accessible AI platforms, with expert evaluation conducted via Qualtrics\u2010based distribution.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twelve frequently asked questions about tracheostomy care were identified using search\u2010listening tools and clinician input, then submitted to 5 AI chatbots \u2014 ChatGPT4, Google Gemini 2.0, Microsoft Copilot, DeepSeek V3, and Grok 3 \u2014 and to a senior laryngologist. Three blinded laryngologists independently evaluated each response using the Quality Analysis of Medical Artificial Intelligence instrument. Readability was assessed using nine metrics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Gemini 2.0 achieved significantly higher completeness scores than physician responses (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u2009.001), with DeepSeek and Grok 3 (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u2009.05) also outperforming (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u2009.05). Accuracy did not differ significantly between AI\u2010 and expert\u2010generated responses. On average, the AI models outperformed physician in clarity, completeness, and usefulness based on QAMAI scoring (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u2009.05). All AI and expert responses exceeded the NIH\u2010recommended 6th\u2010grade reading level, ranging from 10th\u221213th grade (\n                      <jats:italic>P<\/jats:italic>\n                      \u2009&lt;\u2009.001). Inter\u2010rater reliability was 78%.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>AI chatbots can generate accurate and comprehensive responses to common tracheostomy care questions, demonstrating potential to support patient education. However, they continue to lack guaranteed, verifiable sourcing, and this study did not assess actual patient comprehension of the AI\u2010generated responses. Future efforts should focus on adapting AI\u2010generated education materials to meet health literacy standards and evaluating their direct impact on patient understanding and outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/ohn.70359","type":"journal-article","created":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T11:24:26Z","timestamp":1785842666000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Quality of AI\u2010Generated Patient Education for Pre\u2010 and Post\u2010Operative Tracheostomy Care"],"prefix":"10.1002","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2117-1481","authenticated-orcid":false,"given":"Keer","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9860-5248","authenticated-orcid":false,"given":"Lauran K.","family":"Evans","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9259-6363","authenticated-orcid":false,"given":"Desiree","family":"Delavary","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0235-8711","authenticated-orcid":false,"given":"Christian","family":"Wooten","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minjae","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3786-5045","authenticated-orcid":false,"given":"Travis L.","family":"Shiba","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalie","family":"Kadin","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5996-7422","authenticated-orcid":false,"given":"Joshua D.","family":"Feintuch","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0228-6308","authenticated-orcid":false,"given":"Dinesh K.","family":"Chhetri","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery David Geffen School of Medicine at University of California Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,8,4]]},"reference":[{"issue":"1","key":"e_1_2_9_2_1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1177\/0194599812460376","article-title":"Clinical consensus statement","volume":"148","author":"Mitchell RB","year":"2013","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"10","key":"e_1_2_9_3_1","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1001\/jamaoto.2016.1803","article-title":"Preventing complications of pediatric tracheostomy through standardized wound care and parent education","volume":"142","author":"Gaudreau PA","year":"2016","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"key":"e_1_2_9_4_1","unstructured":"Evaluation of Individual Quality of Life (QOL) Among Patients with Tracheostomy Using WHO\u2010QOL BREF Questionnaire | Indian Journal of Otolaryngology and Head & Neck Surgery. Accessed October 17 2025.https:\/\/link.springer.com\/article\/10.1007\/s12070-020-02052-z"},{"key":"e_1_2_9_5_1","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.pedn.2020.09.014","article-title":"An evaluation of websites offering caregiver education for tracheostomy and home mechanical ventilation","volume":"56","author":"Misra AR","year":"2021","journal-title":"J Pediatr Nurs"},{"key":"e_1_2_9_6_1","unstructured":"Clinical Consensus Statement \u2010 Mitchell \u2212 2013 \u2010 Otolaryngology\u2010Head and Neck Surgery \u2010 Wiley Online Library. Accessed October 17 2025.https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1177\/0194599812460376"},{"issue":"13","key":"e_1_2_9_7_1","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1177\/0009922820941209","article-title":"Identifying caregiver needs for children with a tracheostomy living at home","volume":"59","author":"Mai K","year":"2020","journal-title":"Clin Pediatr"},{"issue":"3","key":"e_1_2_9_8_1","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.4124","article-title":"Health\u2010related internet use by informal caregivers of children and adolescents: an integrative literature review","volume":"18","author":"Park E","year":"2016","journal-title":"J Med Internet Res"},{"issue":"6","key":"e_1_2_9_9_1","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1177\/0194599815599525","article-title":"Life after tracheostomy","volume":"153","author":"McCormick ME","year":"2015","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"7","key":"e_1_2_9_10_1","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1002\/ppul.25355","article-title":"\u201cNew Trach Mom Here\u201d: a qualitative study of internet\u2010based resources by caregivers of children with tracheostomy","volume":"56","author":"Meyer\u2010Macaulay CB","year":"2021","journal-title":"Pediatr Pulmonol"},{"key":"e_1_2_9_11_1","unstructured":"Facebook Group Use among Parents of Children with Tracheostomy\u2014Huestis\u20142020\u2014Otolaryngology\u2010Head and Neck Surgery\u2014Wiley Online Library. Accessed October 17 2025.https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1177\/0194599820901528"},{"issue":"1","key":"e_1_2_9_12_1","article-title":"Evaluating the quality and readability of generative Artificial Intelligence (AI) Chatbot responses in the management of achilles tendon rupture","volume":"17","author":"Collins CE","journal-title":"Cureus"},{"issue":"2","key":"e_1_2_9_13_1","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1097\/PCC.0000000000002109","article-title":"Parental conflict, regret, and short\u2010term impact on quality of life in tracheostomy decision\u2010making","volume":"21","author":"October TW","year":"2020","journal-title":"Pediatric Crit Care Med"},{"key":"e_1_2_9_14_1","volume-title":"Chatbots in health care: connecting patients to information: emerging health technologies","author":"Authors CM","year":"2025"},{"issue":"6","key":"e_1_2_9_15_1","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1097\/JS9.0000000000000410","article-title":"Emergency surgery in the era of artificial intelligence: ChatGPT could be the doctor's right\u2010hand man","volume":"109","author":"Cheng K","year":"2023","journal-title":"Int J Surg"},{"issue":"1","key":"e_1_2_9_16_1","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1007\/s10916-024-02056-0","article-title":"Responses of five different artificial intelligence chatbots to the top searched queries about erectile dysfunction: a comparative analysis","volume":"48","author":"\u015eahin MF","year":"2024","journal-title":"J Med Syst"},{"key":"e_1_2_9_17_1","unstructured":"The 2025 AI Index Report | Stanford HAI. Accessed October 17 2025.https:\/\/hai.stanford.edu\/ai-index\/2025-ai-index-report"},{"key":"e_1_2_9_18_1","unstructured":"BilskiD. The State of Consumer AI. Menlo Ventures. June 26 2025. Accessed October 17 2025. 2025.https:\/\/menlovc.com\/perspective\/2025-the-state-of-consumer-ai\/"},{"key":"e_1_2_9_19_1","unstructured":"DipertB. Global AI Adoption to Surge 20% Exceeding 378 Million Users in 2025. Edge AI and Vision Alliance. 2025 Accessed October 17 2025.https:\/\/www.edge-ai-vision.com\/2025\/02\/global-ai-adoption-to-surge-20-exceeding-378-million-users-in-2025\/"},{"issue":"1","key":"e_1_2_9_20_1","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1093\/eurjcn\/zvad038","article-title":"What if your patient switches from Dr. Google to Dr. ChatGPT? A vignette\u2010based survey of the trustworthiness, value, and danger of ChatGPT\u2010generated responses to health questions","volume":"23","author":"Van Bulck L","year":"2024","journal-title":"Eur J Cardiovasc Nurs"},{"issue":"1","key":"e_1_2_9_21_1","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1002\/ohn.1225","article-title":"Comparative analysis of information quality in pediatric otorhinolaryngology: clinicians, residents, and large language models","volume":"173","author":"Trecca EMC","year":"2025","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"11","key":"e_1_2_9_22_1","article-title":"Pilot testing of a tool to standardize the assessment of the quality of health information generated by Artificial Intelligence\u2010based models","volume":"15","author":"Sallam M","journal-title":"Cureus"},{"issue":"1","key":"e_1_2_9_23_1","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s00590-025-04198-4","article-title":"Evaluation of the reliability, usefulness, quality and readability of ChatGPT's responses on Scoliosis","volume":"35","author":"\u00c7\u0131rac\u0131o\u011flu AM","year":"2025","journal-title":"Eur J Orthop Surg Traumatol"},{"key":"e_1_2_9_24_1","article-title":"Assessing the accuracy and reliability of AI\u2010generated medical responses: an evaluation of the Chat\u2010GPT model","author":"Johnson D","year":"2023","journal-title":"Res Square"},{"issue":"4","key":"e_1_2_9_25_1","doi-asserted-by":"crossref","DOI":"10.1002\/lio2.1300","article-title":"TrachGPT: appraisal of tracheostomy care recommendations from an artificial intelligent Chatbot","volume":"9","author":"Ayo\u2010Ajibola O","year":"2024","journal-title":"Laryngoscope Investig Otolaryngol"},{"key":"e_1_2_9_26_1","unstructured":"ZhuK. Ranked: most popular AI tools by monthly site visits. Visual Capitalist. March. Accessed October 17 2025;24:2025.https:\/\/www.visualcapitalist.com\/ranked-most-popular-ai-tools-by-monthly-site-visits\/"},{"key":"e_1_2_9_27_1","unstructured":"Humanity's Last Exam (Text Only). SEAL Leaderboard. Accessed October 17 2025.https:\/\/scale.com\/leaderboard"},{"key":"e_1_2_9_28_1","unstructured":"Overview Leaderboard | LMArenaAccessed October 17 2025.https:\/\/lmarena.ai\/leaderboard?utm_campaign=hf_banner"},{"issue":"1","key":"e_1_2_9_29_1","doi-asserted-by":"crossref","first-page":"8233","DOI":"10.1038\/s41598-024-58964-1","article-title":"Response accuracy of ChatGPT 3.5 Copilot and Gemini in interpreting biochemical laboratory data a pilot study","volume":"14","author":"Kaftan AN","year":"2024","journal-title":"Sci Rep"},{"issue":"4","key":"e_1_2_9_30_1","doi-asserted-by":"crossref","first-page":"3465","DOI":"10.1007\/s12070-024-04729-1","article-title":"Examining the performance of ChatGPT 3.5 and Microsoft Copilot in otolaryngology: a comparative study with otolaryngologists' evaluation","volume":"76","author":"Mayo\u2010Y\u00e1\u00f1ez M","year":"2024","journal-title":"Indian J Otolaryngol Head Neck Surg"},{"issue":"2","key":"e_1_2_9_31_1","article-title":"Readability of patient education materials on the American Association for Surgery of Trauma website","volume":"3","author":"Eltorai A","year":"2014","journal-title":"Arch Trauma Res"},{"key":"e_1_2_9_32_1","unstructured":"Health Literacy and Patient Safety: Help Patients Understand. Manual for Clinicians2nd ed. Published online November 26 2008. Accessed October 17 2025.https:\/\/psnet.ahrq.gov\/issue\/health-literacy-and-patient-safety-help-patients-understand-manual-clinicians-2nd-ed"},{"issue":"6","key":"e_1_2_9_33_1","doi-asserted-by":"crossref","first-page":"2341","DOI":"10.3390\/clinpract14060183","article-title":"Readability metrics in patient education: where do we innovate","volume":"14","author":"Singh S","year":"2024","journal-title":"Clin Pract"},{"issue":"4","key":"e_1_2_9_34_1","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1007\/s00405-023-08441-8","article-title":"Accuracy of ChatGPT\u20103.5 and \u22124 in providing scientific references in otolaryngology\u2010head and neck surgery","volume":"281","author":"Lechien JR","year":"2024","journal-title":"Eur Arch Otrhinolaryngol"},{"issue":"11","key":"e_1_2_9_35_1","doi-asserted-by":"crossref","first-page":"5129","DOI":"10.1007\/s00405-023-08205-4","article-title":"Assessing the accuracy of ChatGPT references in head and neck and ENT disciplines","volume":"280","author":"Frosolini A","year":"2023","journal-title":"Eur Arch Otrhinolaryngol"},{"key":"e_1_2_9_36_1","unstructured":"OpenEvidence API. OpenEvidence. Accessed October 17.https:\/\/www.openevidence.com"},{"key":"e_1_2_9_37_1","doi-asserted-by":"crossref","DOI":"10.1177\/21501319251332215","article-title":"The use of an artificial intelligence platform openevidence to augment clinical decision\u2010making for primary care physicians","volume":"16","author":"Hurt RT","year":"2025","journal-title":"J Prim Care Commun Health"},{"issue":"3","key":"e_1_2_9_38_1","doi-asserted-by":"crossref","first-page":"232","DOI":"10.22454\/FamMed.2024.587513","article-title":"OpenEvidence","volume":"57","author":"Wu V","year":"2025","journal-title":"Fam Med"}],"container-title":["Otolaryngology\u2013Head and Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.70359","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ohn.70359","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.70359","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T11:24:42Z","timestamp":1785842682000},"score":1,"resource":{"primary":{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1002\/ohn.70359"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,4]]},"references-count":37,"alternative-id":["10.1002\/ohn.70359"],"URL":"https:\/\/doi.org\/10.1002\/ohn.70359","archive":["Portico"],"relation":{},"ISSN":["0194-5998","1097-6817"],"issn-type":[{"value":"0194-5998","type":"print"},{"value":"1097-6817","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,4]]},"assertion":[{"value":"2025-12-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-05","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"ohn.70359"}}