{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T08:15:37Z","timestamp":1776500137858,"version":"3.51.2"},"reference-count":15,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"3","license":[{"start":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T00:00:00Z","timestamp":1723420800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n            <jats:title>Background:<\/jats:title>\n            <jats:p>The incorporation of artificial intelligence (AI), especially large language models like Generative Pretrained Transformer 4 (GPT-4), into medical practice is a burgeoning field of interest. This research evaluates the applicability of GPT-4 in otology by analyzing its responses to queries based on otologic clinical practice guidelines.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods:<\/jats:title>\n            <jats:p>Key guidelines from otology were selected, and corresponding questions were formulated to examine GPT-4\u2019s interpretation and response accuracy. Two independent reviewers assessed the AI-generated answers for accuracy and completeness, using a structured Likert scale. A re-evaluation was conducted to evaluate the reproducibility of the results.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>The analysis showed a high accuracy level (mean score: 4.75 of 5) and completeness (mean score: 2.88 of 3) in GPT-4\u2019s responses. The interrater agreement, as indicated by Cohen \u03ba, was substantial. GPT-4 consistently advised on individualized treatment plans and professional consultation, particularly for guidelines with weaker evidence, demonstrating its cautious approach to handling medical information.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion:<\/jats:title>\n            <jats:p>GPT-4 exhibits promising potential as an auxiliary tool in otology, providing accurate and comprehensive information. However, its role should be viewed as supplementary, with emphasis on continual updates and careful monitoring to align with evolving medical knowledge. Future studies are recommended to further explore the depth of AI application in diverse clinical scenarios and its real-time impact on clinical outcomes.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/ono.0000000000000059","type":"journal-article","created":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T18:12:32Z","timestamp":1723486352000},"page":"e059","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":3,"title":["Evaluating the Accuracy and Completeness of Artificial Intelligence Responses Against Established Otology Guidelines"],"prefix":"10.1097","volume":"4","author":[{"given":"Nicholas A.","family":"Rossi","sequence":"first","affiliation":[{"name":"Department of Otolaryngology, University of Texas Medical Branch, Galveston, Texas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kassandra K.","family":"Corona","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Texas Medical Branch, Galveston, Texas."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"Yoshiyasu","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology, University of Texas Medical Branch, Galveston, Texas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dayton L.","family":"Young","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology, University of Texas Medical Branch, Galveston, Texas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian J.","family":"McKinnon","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology, University of Texas Medical Branch, Galveston, Texas"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2024,9]]},"reference":[{"key":"R1-20241014","doi-asserted-by":"crossref","first-page":"1322","DOI":"10.1093\/cid\/ciad407","article-title":"ChatGPT, GPT-4, and other large language models: the next revolution for clinical microbiology?","volume":"77","author":"Egli","year":"2023","journal-title":"Clin Infect Dis"},{"key":"R2-20241014","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","article-title":"Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine.","volume":"388","author":"Lee","year":"2023","journal-title":"N Engl J Med"},{"key":"R3-20241014","first-page":"1018","article-title":"Beyond ChatGPT: what does GPT-4 add to healthcare? The dawn of a new era.","volume":"30","author":"W\u00f3jcik","year":"2023","journal-title":"Cardiol J"},{"key":"R4-20241014","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1002\/alr.23201","article-title":"GPT-4 accuracy and completeness against international consensus statement on allergy and rhinology: Rhinosinusitis.","volume":"13","author":"Yoshiyasu","year":"2023","journal-title":"Int Forum Allergy Rhinol"},{"key":"R5-20241014","doi-asserted-by":"crossref","first-page":"e160","DOI":"10.1016\/j.wneu.2023.08.042","article-title":"GPT-4 artificial intelligence model outperforms ChatGPT, medical students, and neurosurgery residents on neurosurgery written board-like questions.","volume":"179","author":"Guerra","year":"2023","journal-title":"World Neurosurg"},{"key":"R6-20241014","doi-asserted-by":"crossref","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","article-title":"Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models.","volume":"2","author":"Kung","year":"2023","journal-title":"PLOS Digit Health"},{"issue":"2_suppl","key":"R7-20241014","first-page":"S1","article-title":"Clinical practice guideline: M\u00e9ni\u00e8re\u2019s disease.","volume":"162","author":"Basura","year":"2020","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"3 Suppl","key":"R8-20241014","first-page":"S1","article-title":"Clinical practice guideline: Bell\u2019s palsy.","volume":"149","author":"Baugh","year":"2013","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"3_suppl","key":"R9-20241014","first-page":"S1","article-title":"Clinical practice guideline: benign paroxysmal positional vertigo (update).","volume":"156","author":"Bhattacharyya","year":"2017","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"1_suppl","key":"R10-20241014","first-page":"S1","article-title":"Clinical practice guideline: sudden hearing loss (update).","volume":"161","author":"Chandrasekhar","year":"2019","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"1 Suppl","key":"R11-20241014","first-page":"S1","article-title":"Clinical practice guideline: acute otitis externa.","volume":"150","author":"Rosenfeld","year":"2014","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"1 Suppl","key":"R12-20241014","first-page":"S1","article-title":"Clinical practice guideline: otitis media with effusion (update).","volume":"154","author":"Rosenfeld","year":"2016","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"1_suppl","key":"R13-20241014","first-page":"S1","article-title":"Clinical practice guideline (update): earwax (cerumen impaction).","volume":"156","author":"Schwartz","year":"2017","journal-title":"Otolaryngol Head Neck Surg"},{"issue":"2 Suppl","key":"R14-20241014","first-page":"S1","article-title":"Clinical practice guideline: tinnitus.","volume":"151","author":"Tunkel","year":"2014","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R15-20241014","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.otohns.2009.09.013","article-title":"Postmaneuver restrictions in benign paroxysmal positional vertigo: an individual patient data meta-analysis.","volume":"142","author":"Devaiah","year":"2010","journal-title":"Otolaryngol Head Neck Surg"}],"container-title":["Otology &amp; Neurotology Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/ONO.0000000000000059","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T00:10:41Z","timestamp":1728951041000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/ONO.0000000000000059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,12]]},"references-count":15,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024]]}},"URL":"https:\/\/doi.org\/10.1097\/ono.0000000000000059","relation":{},"ISSN":["2766-3604"],"issn-type":[{"value":"2766-3604","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,12]]}}}