{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T05:34:32Z","timestamp":1789796072042,"version":"4.0.1"},"reference-count":41,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2024,7,16]],"date-time":"2024-07-16T00:00:00Z","timestamp":1721088000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Laryngoscope Investig Oto"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Safe home tracheostomy care requires engagement and troubleshooting by patients, who may turn to online, AI\u2010generated information sources. This study assessed the quality of ChatGPT responses to such queries.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In this cross\u2010sectional study, ChatGPT was prompted with 10 hypothetical tracheostomy care questions in three domains (complication management, self\u2010care advice, and lifestyle adjustment). Responses were graded by four otolaryngologists for appropriateness, accuracy, and overall score. The readability of responses was evaluated using the Flesch Reading Ease (FRE) and Flesch\u2013Kincaid Reading Grade Level (FKRGL). Descriptive statistics and ANOVA testing were performed with statistical significance set to <jats:italic>p<\/jats:italic>\u2009&lt;\u2009.05.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>On a scale of 1\u20135, with 5 representing the greatest appropriateness or overall score and a 4\u2010point scale with 4 representing the highest accuracy, the responses exhibited moderately high appropriateness (mean\u2009=\u20094.10, SD\u2009=\u20090.90), high accuracy (mean\u2009=\u20093.55, SD\u2009=\u20090.50), and moderately high overall scores (mean\u2009=\u20094.02, SD\u2009=\u20090.86). Scoring between response categories (self\u2010care recommendations, complication recommendations, lifestyle adjustments, and special device considerations) revealed no significant scoring differences. Suboptimal responses lacked nuance and contained incorrect information and recommendations. Readability indicated college and advanced levels for FRE (Mean\u2009=\u200939.5, SD\u2009=\u20097.17) and FKRGL (Mean\u2009=\u200913.1, SD\u2009=\u20091.47), higher than the sixth\u2010grade level recommended for patient\u2010targeted resources by the NIH.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>While ChatGPT\u2010generated tracheostomy care responses may exhibit acceptable appropriateness, incomplete or misleading information may have dire clinical consequences. Further, inappropriately high reading levels may limit patient comprehension and accessibility. At this point in its technological infancy, AI\u2010generated information should not be solely relied upon as a direct patient care resource.<\/jats:p><\/jats:sec>","DOI":"10.1002\/lio2.1300","type":"journal-article","created":{"date-parts":[[2024,7,16]],"date-time":"2024-07-16T12:13:52Z","timestamp":1721132032000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["<scp>TrachGPT<\/scp>: Appraisal of tracheostomy care recommendations from an artificial intelligent Chatbot"],"prefix":"10.1002","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4824-7160","authenticated-orcid":false,"given":"Oluwatobiloba","family":"Ayo\u2010Ajibola","sequence":"first","affiliation":[{"name":"Keck School of Medicine of the University of Southern California  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0408-8380","authenticated-orcid":false,"given":"Ryan J.","family":"Davis","sequence":"additional","affiliation":[{"name":"Keck School of Medicine of the University of Southern California  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9914-9670","authenticated-orcid":false,"given":"Matthew E.","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery University of California Los Angeles  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neelaysh","family":"Vukkadala","sequence":"additional","affiliation":[{"name":"Department of Head and Neck Surgery University of California Los Angeles  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karla","family":"O'Dell","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Southern California Caruso  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark S.","family":"Swanson","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Southern California Caruso  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"III","given":"Michael M.","family":"Johns","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Southern California Caruso  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-0872-869X","authenticated-orcid":false,"given":"Elizabeth A.","family":"Shuman","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2010Head and Neck Surgery University of Southern California Caruso  Los Angeles California USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,7,16]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iccn.2009.09.004"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.12968\/bjon.2007.16.8.23418"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12070\u2010020\u201002052\u2010z"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40271\u2010017\u20100277\u20101"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12070\u2010023\u201003511\u2010z"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1001\/archotol.130.4.401"},{"key":"e_1_2_7_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/0266\u20104356(94)90162\u20107"},{"key":"e_1_2_7_9_1","doi-asserted-by":"publisher","DOI":"10.1054\/bjom.2000.0310"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0278\u20102391(96)90744\u20102"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.1067\/mhn.2000.105714"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405\u2010021\u201006707\u20107"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12875\u2010018\u20100805\u20107"},{"key":"e_1_2_7_14_1","unstructured":"GoldbergR.More than half of American households used the Internet for health\u2010related activities in 2019 NTIA Data Show|National Telecommunications and Information Administration. Accessed October 3 2023.https:\/\/www.ntia.gov\/blog\/2020\/more-half-american-households-used-internet-health-related-activities-2019-ntia-data-show"},{"issue":"2","key":"e_1_2_7_15_1","first-page":"A36","article-title":"Health\u2010related information on the web: results from the HealthStyles Survey, 2002\u20102003","volume":"3","author":"Bansil P","year":"2006","journal-title":"Prev Chronic Dis"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1475\u20106773.2006.00510.x"},{"key":"e_1_2_7_17_1","unstructured":"ChatGPT: optimizing language models for dialogue. Accessed April 15 2023.https:\/\/openai.com\/blog\/chatgpt"},{"key":"e_1_2_7_18_1","unstructured":"RubyD.59+ ChatGPT statistics\u2014users trends & more (July 2023).DemandSage.2023. Accessed July 6 2023.https:\/\/www.demandsage.com\/chatgpt-statistics\/"},{"key":"e_1_2_7_19_1","unstructured":"MarrB.Is Google's reign over? ChatGPT emerges as a serious competitor.Forbes. Accessed July 6 2023.https:\/\/www.forbes.com\/sites\/bernardmarr\/2023\/02\/20\/is-googles-reign-over-chatgpt-emerges-as-a-serious-competitor\/"},{"key":"e_1_2_7_20_1","doi-asserted-by":"crossref","unstructured":"JohnsonD GoodmanR PatrinelyJ et al.Assessing the accuracy and reliability of AI\u2010generated medical responses: an evaluation of the chat\u2010GPT model. In review;2023. doi:10.21203\/rs.3.rs\u20102566942\/v1","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1093\/eurjcn\/zvad038"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.37281"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjoto.2023.103873"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoto.2023.0704"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12967\u2010023\u201004123\u20105"},{"key":"e_1_2_7_26_1","unstructured":"Tracheostomy.Johns Hopkins Trach. Accessed July 6 2023.https:\/\/www.hopkinsmedicine.org\/tracheostomy"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamaophthalmol.2013.5521"},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.1353\/hpu.2010.0272"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.5812\/atr.18161"},{"key":"e_1_2_7_30_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365\u20102702.1999.00296.x"},{"key":"e_1_2_7_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/ecc.12619"},{"key":"e_1_2_7_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejon.2017.07.001"},{"key":"e_1_2_7_33_1","volume-title":"Manual for Clinicians","author":"Weiss B","year":"2010"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13187\u2010020\u201001719\u2010z"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11999\u2010008\u20100193\u20108"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599814560338"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.23.29622"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.328.7439.564"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.11604\/pamj.2022.42.124.33623"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.12669\/pjms.39.2.7653"},{"key":"e_1_2_7_41_1","unstructured":"BioMedLM: a domain\u2010specific large language model for biomedical text. Accessed July 10 2023.https:\/\/www.mosaicml.com\/blog\/introducing-pubmed-gpt"},{"key":"e_1_2_7_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/1090198105277329"}],"container-title":["Laryngoscope Investigative Otolaryngology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lio2.1300","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,27]],"date-time":"2024-08-27T05:56:54Z","timestamp":1724738214000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lio2.1300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,16]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["10.1002\/lio2.1300"],"URL":"https:\/\/doi.org\/10.1002\/lio2.1300","archive":["Portico"],"relation":{},"ISSN":["2378-8038","2378-8038"],"issn-type":[{"value":"2378-8038","type":"print"},{"value":"2378-8038","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,16]]},"assertion":[{"value":"2024-04-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-18","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e1300"}}