{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T18:12:52Z","timestamp":1790878372237,"version":"4.1.0"},"reference-count":37,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T00:00:00Z","timestamp":1738022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background: Despite the growing popularity of artificial intelligence (AI)-based systems such as ChatGPT, there is still little evidence of their effectiveness in audiology, particularly in pediatric audiology. The present study aimed to verify the performance of ChatGPT in this field, as assessed by both students and professionals, and to compare its Polish and English versions. Methods: ChatGPT was presented with 20 questions, which were posed twice, first in Polish and then in English. A group of 20 students and 16 professionals in the field of audiology and otolaryngology rated the answers on a Likert scale of 1 to 5 in terms of correctness, relevance, completeness, and linguistic accuracy. Both groups were also asked to assess the usefulness of ChatGPT as a source of information for patients, in educational settings for students, and in professional work. Results: Both students and professionals generally rated ChatGPT\u2019s responses to be satisfactory. For most of the questions, ChatGPT\u2019s responses were rated somewhat higher by the students than the professionals, although statistically significant differences were only evident for completeness and linguistic accuracy. Those who rated ChatGPT\u2019s responses more highly also rated its usefulness more highly. Conclusions: ChatGPT can possibly be used for quick information retrieval, especially by non-experts, but it lacks the depth and reliability required by professionals. The different ratings given by students and professionals, and its language dependency, indicate it works best as a supplementary tool, not as a replacement for verifiable sources, particularly in a healthcare setting.<\/jats:p>","DOI":"10.3390\/jcm14030875","type":"journal-article","created":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T10:44:30Z","timestamp":1738061070000},"page":"875","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Performance of ChatGPT in Pediatric Audiology as Rated by Students and Experts"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6925-0460","authenticated-orcid":false,"given":"Anna","family":"Ratuszniak","sequence":"first","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elzbieta","family":"Gos","sequence":"additional","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8618-7651","authenticated-orcid":false,"given":"Artur","family":"Lorens","sequence":"additional","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4978-1915","authenticated-orcid":false,"given":"Piotr Henryk","family":"Skarzynski","sequence":"additional","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"},{"name":"Heart Failure and Cardiac Rehabilitation Department, Faculty of Medicine, Medical University of Warsaw, Banacha 1a Street, 02-097 Warsaw, Poland"},{"name":"Institute of Sensory Organs, Mokra 1 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7141-9851","authenticated-orcid":false,"given":"Henryk","family":"Skarzynski","sequence":"additional","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8404-0672","authenticated-orcid":false,"given":"W. Wiktor","family":"Jedrzejczak","sequence":"additional","affiliation":[{"name":"Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland"},{"name":"World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1111\/j.1475-6773.2006.00510.x","article-title":"Who Searches the Internet for Health Information?","volume":"41","author":"Bundorf","year":"2006","journal-title":"Health Serv. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"10582","DOI":"10.1166\/asl.2017.10107","article-title":"Online Health Information Seeking Behavior Pattern","volume":"23","author":"Maon","year":"2017","journal-title":"Adv. Sci. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e1600","DOI":"10.2196\/jmir.1600","article-title":"The Characteristics and Motivations of Online Health Information Seekers: Cross-Sectional Survey and Qualitative Interview Study","volume":"13","author":"Powell","year":"2011","journal-title":"J. Med. Internet Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1016\/j.chb.2015.06.003","article-title":"Health Anxiety in the Digital Age: An Exploration of Psychological Determinants of Online Health Information Seeking","volume":"52","author":"Lagoe","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1007\/s10796-019-09931-z","article-title":"Impact of Smartphones on Quality of Life: A Health Information Behavior Perspective","volume":"22","author":"Ghahramani","year":"2020","journal-title":"Inf. Syst. Front."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1080\/00016489.2023.2254809","article-title":"Validity of the Large Language Model ChatGPT (GPT4) as a Patient Information Source in Otolaryngology by a Variety of Doctors in a Tertiary Otorhinolaryngology Department","volume":"143","author":"Nielsen","year":"2023","journal-title":"Acta Oto-Laryngol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e45312","DOI":"10.2196\/45312","article-title":"How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment","volume":"9","author":"Gilson","year":"2023","journal-title":"JMIR Med. Educ."},{"key":"ref_8","unstructured":"Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2024, November 01). Improving Language Understanding by Generative Pre-Training. Available online: https:\/\/cdn.openai.com\/research-covers\/language-unsupervised\/language_understanding_paper.pdf."},{"key":"ref_9","unstructured":"(2024, April 04). Number of ChatGPT Users (Apr 2024). Available online: https:\/\/explodingtopics.com\/blog\/chatgpt-users."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1007\/s10439-023-03172-7","article-title":"Role of Chat GPT in Public Health","volume":"51","author":"Biswas","year":"2023","journal-title":"Ann. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"106682","DOI":"10.1016\/j.oraloncology.2023.106682","article-title":"Ethical Consideration for Implementing AI in Healthcare: A Chat GPT Perspective","volume":"149","author":"Pawar","year":"2024","journal-title":"Oral. Oncol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1002\/wps.21145","article-title":"The Performance of ChatGPT in Generating Answers to Clinical Questions in Psychiatry: A Two-Layer Assessment","volume":"22","author":"Luykx","year":"2023","journal-title":"World Psychiatry"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1093\/ced\/llad255","article-title":"ChatGPT-3.5 and ChatGPT-4 Dermatological Knowledge Level Based on the Specialty Certificate Examination in Dermatology","volume":"49","author":"Lewandowski","year":"2024","journal-title":"Clin. Exp. Dermatol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1987","DOI":"10.1007\/s11695-024-07212-6","article-title":"ChatGPT as a Source of Information for Bariatric Surgery Patients: A Comparative Analysis of Accuracy and Comprehensiveness Between GPT-4 and GPT-3.5","volume":"34","author":"Samaan","year":"2024","journal-title":"Obes. Surg."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"128","DOI":"10.14245\/ns.2347310.655","article-title":"Performance of a Large Language Model in the Generation of Clinical Guidelines for Antibiotic Prophylaxis in Spine Surgery","volume":"21","author":"Zaidat","year":"2024","journal-title":"Neurospine"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1016\/j.surg.2023.06.005","article-title":"How Appropriate Are Answers of Online Chat-Based Artificial Intelligence (ChatGPT) to Common Questions on Colon Cancer?","volume":"174","author":"Emile","year":"2023","journal-title":"Surgery"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4057","DOI":"10.1007\/s00415-024-12328-x","article-title":"ChatGPT vs. Neurologists: A Cross-Sectional Study Investigating Preference, Satisfaction Ratings and Perceived Empathy in Responses among People Living with Multiple Sclerosis","volume":"271","author":"Maida","year":"2024","journal-title":"J. Neurol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e13680","DOI":"10.1111\/srt.13680","article-title":"ChatGPT in Medicine: Evaluating Psoriasis Patient Concerns","volume":"30","author":"Huang","year":"2024","journal-title":"Ski. Res. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Topsakal, O., Akinci, T.C., and Celikoyar, M. (2023). Evaluating Patient and Otolaryngologist Dialogues Generated by ChatGPT, Are They Adequate?. Res. Sq.","DOI":"10.21203\/rs.3.rs-2719379\/v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"01455613241230841","DOI":"10.1177\/01455613241230841","article-title":"Can ChatGPT Replace an Otolaryngologist in Guiding Parents on Tonsillectomy?","volume":"4556","author":"Moise","year":"2024","journal-title":"Ear Nose Throat J."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jedrzejczak, W.W., Skarzynski, P.H., Raj-Koziak, D., Sanfins, M.D., Hatzopoulos, S., and Kochanek, K. (2023). ChatGPT for Tinnitus Information and Support: Response Accuracy and Retest after Three Months. medRxiv.","DOI":"10.1101\/2023.12.19.23300189"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jedrzejczak, W.W., and Kochanek, K. (2023). Comparison of the Audiological Knowledge of Three Chatbots\u2013ChatGPT, Bing Chat, and Bard. medRxiv.","DOI":"10.1101\/2023.11.22.23298893"},{"key":"ref_23","first-page":"e59857","article-title":"Accuracy and Repeatability of ChatGPT Based on a Set of Multiple-Choice Questions on Objective Tests of Hearing","volume":"16","author":"Kochanek","year":"2024","journal-title":"Cureus"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e55595","DOI":"10.2196\/55595","article-title":"Exploring the Performance of ChatGPT-4 in the Taiwan Audiologist Qualification Examination: Preliminary Observational Study Highlighting the Potential of AI Chatbots in Hearing Care","volume":"10","author":"Wang","year":"2024","journal-title":"JMIR Med. Educ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"9","DOI":"10.17430\/jhs\/192556","article-title":"Do chatbots provide reliable information about mobile apps in audiology?","volume":"14","author":"Pastucha","year":"2024","journal-title":"J. Hear. Sci."},{"key":"ref_26","unstructured":"(2024, October 16). Introduction|DeepL API Documentation. Available online: https:\/\/developers.deepl.com\/docs\/."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kur, M. (2019). Method of Measuring the Effort Related to Post-Editing Machine Translated Outputs Produced in the English>Polish Language Pair by Google, Microsoft and DeepL MT Engines: A Pilot Study. Beyond Philol. Int. J. Linguist. Lit. Stud. Engl. Lang. Teach., 69\u201399.","DOI":"10.26881\/bp.2019.4.03"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond Accuracy: What Data Quality Means to Data Consumers","volume":"12","author":"Wang","year":"1996","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.1097\/DBP.0000000000001255","article-title":"Challenging the Chatbot: An Assessment of ChatGPT\u2019s Diagnoses and Recommendations for DBP Case Studies","volume":"45","author":"Kim","year":"2024","journal-title":"J. Dev. Behav. Pediatr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e54706","DOI":"10.2196\/54706","article-title":"Physician Versus Large Language Model Chatbot Responses to Web-Based Questions From Autistic Patients in Chinese: Cross-Sectional Comparative Analysis","volume":"26","author":"He","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4019","DOI":"10.1016\/j.csbj.2024.10.050","article-title":"Assessment of Large Language Models (LLMs) in Decision-Making Support for Gynecologic Oncology","volume":"23","author":"Gumilar","year":"2024","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"111582","DOI":"10.1016\/j.jclinane.2024.111582","article-title":"The Evaluation of the Performance of ChatGPT in the Management of Labor Analgesia","volume":"98","author":"Ismaiel","year":"2024","journal-title":"J. Clin. Anesth."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5129","DOI":"10.1007\/s00405-023-08205-4","article-title":"Assessing the Accuracy of ChatGPT References in Head and Neck and ENT Disciplines","volume":"280","author":"Frosolini","year":"2023","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11.","DOI":"10.3390\/healthcare11060887"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"949","DOI":"10.3390\/ai4040048","article-title":"Chatbots Put to the Test in Math and Logic Problems: A Comparison and Assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard","volume":"4","author":"Plevris","year":"2023","journal-title":"AI"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"J\u0119drzejczak, W.W., Pastucha, M., Skar\u017cy\u0144ski, H., and Kochanek, K. (2024). Comparison of ChatGPT and Gemini as Sources of References in Otorhinolaryngology. medRxiv.","DOI":"10.1101\/2024.08.12.24311896"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"e53164","DOI":"10.2196\/53164","article-title":"Hallucination Rates and Reference Accuracy of ChatGPT and Bard for Systematic Reviews: Comparative Analysis","volume":"26","author":"Chelli","year":"2024","journal-title":"J. Med. Internet Res."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/14\/3\/875\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:37:55Z","timestamp":1759919875000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/14\/3\/875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,28]]},"references-count":37,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["jcm14030875"],"URL":"https:\/\/doi.org\/10.3390\/jcm14030875","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.10.24.24316037","asserted-by":"object"}]},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,28]]}}}