{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T17:02:45Z","timestamp":1789578165665,"version":"build-2803163510"},"reference-count":19,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T00:00:00Z","timestamp":1712620800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["aao-hnsfjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Otolaryngol.--head neck surg."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To study the performance of Chatbot Generative Pretrained Transformer\u20104 (ChatGPT\u20104) in the management of cases in otolaryngology\u2013head and neck surgery.<\/jats:p><\/jats:sec><jats:sec><jats:title>Study Design<\/jats:title><jats:p>Prospective case series.<\/jats:p><\/jats:sec><jats:sec><jats:title>Setting<\/jats:title><jats:p>Multicenter University Hospitals.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>History, clinical, physical, and additional examinations of adult outpatients consulting in otolaryngology departments of CHU Saint\u2010Pierre and Dour Medical Center were presented to ChatGPT\u20104, which was interrogated for differential diagnoses, management, and treatment(s). According to specialty, the ChatGPT\u20104 responses were assessed by 2\u00a0distinct, blinded board\u2010certified otolaryngologists with the Artificial Intelligence Performance Instrument.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>One hundred cases were presented to ChatGPT\u20104. ChaGPT\u20104 indicated a mean of 3.34 (95% confidence interval [CI]: 3.09, 3.59) additional examinations per patient versus 2.10 (95% CI: 1.76, 2.34; <jats:italic>P<\/jats:italic>\u2009=\u2009.001) for the practitioners. There was strong consistency (<jats:italic>k<\/jats:italic>\u2009&gt;\u20090.600) between otolaryngologists and ChatGPT\u20104 for the indication of upper aerodigestive tract endoscopy, positron emission tomography and computed tomography, audiometry, tympanometry, and psychophysical evaluations. Primary diagnosis was correctly performed by ChatGPT\u20104 in 38% to 86% of cases depending on subspecialty. Additional examinations indicated by ChatGPT\u20104 were pertinent and necessary in 8% to 31% of cases, while the treatment regimen was pertinent in 12% to 44% of cases. The performance of ChatGPT\u20104 was not influenced by the human\u2010reported level of difficulty of clinical cases.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>ChatGPT\u20104 may be a promising adjunctive tool in otolaryngology, providing extensive documentation about additional examinations, primary and differential diagnoses, and treatments. The ChatGPT\u20104 is more effective in providing a primary diagnosis, and less effective in the selection of additional examinations and treatments.<\/jats:p><\/jats:sec>","DOI":"10.1002\/ohn.759","type":"journal-article","created":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T07:20:00Z","timestamp":1712647200000},"page":"1519-1526","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Performance and Consistency of ChatGPT\u20104 Versus Otolaryngologists: A Clinical Case\u00a0Series"],"prefix":"10.1002","volume":"170","author":[{"given":"J\u00e9r\u00f4me R.","family":"Lechien","sequence":"first","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Division of Laryngology and Broncho\u2010Esophagology, Department of Otolaryngology\u2013Head Neck Surgery, EpiCURA Hospital, UMONS Research Institute for Health Sciences and Technology University of Mons (UMons) Mons Belgium"},{"name":"Department of Otorhinolaryngology and Head and Neck Surgery, Foch Hospital, Phonetics and Phonology Laboratory (UMR 7018 CNRS, Universit\u00e9 Sorbonne Nouvelle\/Paris 3) Paris Saclay University Paris France"},{"name":"Department of Otorhinolaryngology and Head and Neck Surgery CHU Saint\u2010Pierre Brussels Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mattheuw R.","family":"Naunheim","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Department of Otolaryngology, Massachusetts Eye and Ear Harvard Medical School Boston Massachusetts USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonino","family":"Maniaci","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Department of medicine and surgery, Faculty of Medicine and Surgery University of Enna \u201cKore\u201d Enna Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Radulesco","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"ENT\u2010HNS Department, APHM, CNRS, IUSTI, La Conception University Hospital Aix Marseille Univ Marseille France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alberto M.","family":"Saibene","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Otolaryngology Unit, Department of Health Sciences, ASST Santi Paolo E Carlo Universit\u00e0 Degli Studi Di Milano Milan Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos M.","family":"Chiesa\u2010Estomba","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Department of Otorhinolaryngology\u2013Head and Neck Surgery Hospital Universitario Donostia San Sebastian Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luigi A.","family":"Vaira","sequence":"additional","affiliation":[{"name":"Research Committee of Young Otolaryngologists of the International Federation of Otorhinolaryngological Societies (IFOS) Paris France"},{"name":"Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy University of Sassari Sassari Italy"},{"name":"Department of Biomedical Sciences, PhD School of Biomedical Sciences University of Sassari Sassari Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,4,9]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.489"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-023-08219-y"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.526"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-023-08282-5"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2007.11.008"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599817751030"},{"issue":"1","key":"e_1_2_8_8_1","first-page":"85","article-title":"The EUFOREA pocket guide for chronic rhinosinusitis","volume":"61","author":"Hellings PW","year":"2023","journal-title":"Rhinology"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599816689667"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.31134"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/all.13162"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599819859885"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599819890327"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599817722550"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/0194599814561600"},{"issue":"1","key":"e_1_2_8_16_1","first-page":"S1","article-title":"Clinical practice guideline: acute otitis externa","volume":"150","author":"Rosenfeld RM","year":"2014","journal-title":"Otolaryngol Head Neck Surg"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2000.00663.x"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.465"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405-023-08321-1"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jns.2023.120804"}],"container-title":["Otolaryngology\u2013Head and Neck Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ohn.759","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T11:03:18Z","timestamp":1760958198000},"score":1,"resource":{"primary":{"URL":"https:\/\/aao-hnsfjournals.onlinelibrary.wiley.com\/doi\/10.1002\/ohn.759"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,9]]},"references-count":19,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1002\/ohn.759"],"URL":"https:\/\/doi.org\/10.1002\/ohn.759","archive":["Portico"],"relation":{},"ISSN":["0194-5998","1097-6817"],"issn-type":[{"value":"0194-5998","type":"print"},{"value":"1097-6817","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,9]]},"assertion":[{"value":"2023-11-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}