{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T15:04:20Z","timestamp":1790262260486,"version":"4.1.0"},"reference-count":61,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T00:00:00Z","timestamp":1744329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Brain Sciences"],"abstract":"<jats:p>Purpose: This study examines GPT-4o\u2019s ability to communicate effectively with relatives of patients undergoing decompressive hemicraniectomy (DHC) after malignant middle cerebral artery infarction (MMCAI). Methods: GPT-4o was asked 25 common questions from patients\u2019 relatives about DHC for MMCAI, twice over a 7-day interval. Responses were rated for accuracy, clarity, relevance, completeness, sourcing, and usefulness by board-certified intensivist* (one), neurologists, and neurosurgeons using the Quality Analysis of Medical AI (QAMAI) tool. Interrater reliability and stability were measured using ICC and Pearson\u2019s correlation. Results: The total QAMAI scores were 22.32 \u00b1 3.08 for the intensivist, 24.68 \u00b1 2.8 for the neurologist, 23.36 \u00b1 2.86 and 26.32 \u00b1 2.91 for the neurosurgeons, representing moderate-to-high accuracy. The evaluators reported moderate ICC (0.631, 95% CI: 0.321\u20130.821). The highest subscores were for the categories of accuracy, clarity, and relevance while the poorest were associated with completeness, usefulness, and sourcing. GPT-4o did not systematically provide references for their responses. The stability analysis reported moderate-to-high stability. The readability assessment revealed an FRE score of 7.23, an FKG score of 15.87 and a GF index of 18.15. Conclusions: GPT-4o provides moderate-to-high quality information related to DHC for MMCAI, with strengths in accuracy, clarity, and relevance. However, limitations in completeness, sourcing, and readability may impact its effectiveness in patient or their relatives\u2019 education.<\/jats:p>","DOI":"10.3390\/brainsci15040391","type":"journal-article","created":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T06:18:36Z","timestamp":1744611516000},"page":"391","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["AI-Driven Information for Relatives of Patients with Malignant Middle Cerebral Artery Infarction: A Preliminary Validation Study Using GPT-4o"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9619-7324","authenticated-orcid":false,"given":"Mejdeddine","family":"Al Barajraji","sequence":"first","affiliation":[{"name":"Department of Neurosurgery, University Hospital of Lausanne and University of Lausanne, 1005 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9073-4504","authenticated-orcid":false,"given":"Sami","family":"Barrit","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, CHU Tivoli, 7110 La Louvi\u00e8re, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4428-5223","authenticated-orcid":false,"given":"Nawfel","family":"Ben-Hamouda","sequence":"additional","affiliation":[{"name":"Department of Adult Intensive Care, University Hospital of Lausanne (CHUV), University of Lausanne, 1005 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2559-3360","authenticated-orcid":false,"given":"Ethan","family":"Harel","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, University Hospital of Lausanne and University of Lausanne, 1005 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6208-5035","authenticated-orcid":false,"given":"Nathan","family":"Torcida","sequence":"additional","affiliation":[{"name":"Department of Neurology, H\u00f4pital Universitaire de Bruxelles (HUB), 1070 Brussels, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1574-8807","authenticated-orcid":false,"given":"Beatrice","family":"Pizzarotti","sequence":"additional","affiliation":[{"name":"Department of Neurology, University Hospital of Lausanne (CHUV), University of Lausanne, 1011 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas","family":"Massager","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, CHU Tivoli, 7110 La Louvi\u00e8re, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0845-0845","authenticated-orcid":false,"given":"Jerome R.","family":"Lechien","sequence":"additional","affiliation":[{"name":"Department of Surgery, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), 7000 Mons, Belgium"},{"name":"Department of Otolaryngology, Elsan Polyclinic of Poitiers, 86000 Poitiers, France"},{"name":"Department of Otolaryngology-Head Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Universit\u00e9 Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), 78035 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wei, Q., Yao, Z., Cui, Y., Wei, B., Jin, Z., and Xu, X. (2024). Evaluation of ChatGPT-generated medical responses: A systematic review and meta-analysis. J. Biomed. Inform., 151.","DOI":"10.1016\/j.jbi.2024.104620"},{"key":"ref_2","first-page":"24306390","article-title":"A Systematic Review of ChatGPT and Other Conversational Large Language Models in Healthcare","volume":"2024","author":"Wang","year":"2024","journal-title":"medRxiv"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e53019","DOI":"10.2196\/53019","article-title":"Assessing the Quality of ChatGPT Responses to Dementia Caregivers\u2019 Questions: Qualitative Analysis","volume":"7","author":"Aguirre","year":"2024","journal-title":"JMIR Aging"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109645","DOI":"10.1016\/j.yebeh.2024.109645","article-title":"Evaluating the performance of the language model ChatGPT in responding to common questions of people with epilepsy","volume":"151","author":"Wu","year":"2024","journal-title":"Epilepsy Behav. EB"},{"key":"ref_5","first-page":"euad369","article-title":"Accuracy and comprehensibility of chat-based artificial intelligence for patient information on atrial fibrillation and cardiac implantable electronic devices","volume":"26","author":"Hillmann","year":"2023","journal-title":"EP Eur."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"33197241238403","DOI":"10.1177\/00033197241238403","article-title":"ChatGPT and Patients With Heart Failure","volume":"7","author":"Dimitriadis","year":"2024","journal-title":"Angiology"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.36519\/idcm.2024.286","article-title":"How Reliable is ChatGPT as a Novel Consultant in Infectious Diseases and Clinical Microbiology?","volume":"6","year":"2024","journal-title":"Infect Dis. Clin. Microbiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1136\/sextrans-2024-056217","article-title":"ChatGPT as a tool to improve access to knowledge on sexually transmitted infections","volume":"100","author":"Koh","year":"2024","journal-title":"Sex. Transm. Infect."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1097\/COC.0000000000001050","article-title":"Physician Assessment of ChatGPT and Bing Answers to American Cancer Society\u2019s Questions to Ask About Your Cancer","volume":"47","author":"Koo","year":"2024","journal-title":"Am. J. Clin. Oncol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.ygyno.2024.04.006","article-title":"ChatGPT accurately performs genetic counseling for gynecologic cancers","volume":"183","author":"Patel","year":"2024","journal-title":"Gynecol. Oncol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Choi, J., Kim, J.W., Lee, Y.S., Tae, J.H., Choi, S.Y., Chang, I.H., and Kim, J.H. (2024). Availability of ChatGPT to provide medical information for patients with kidney cancer. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-51531-8"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gencer, A. (2024). Readability analysis of ChatGPT\u2019s responses on lung cancer. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-67293-2"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e54758","DOI":"10.2196\/54758","article-title":"Utility of Large Language Models for Health Care Professionals and Patients in Navigating Hematopoietic Stem Cell Transplantation: Comparison of the Performance of ChatGPT-3.5, ChatGPT-4, and Bard","volume":"26","author":"Xue","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pugliese, N., Polverini, D., Lombardi, R., Pennisi, G., Ravaioli, F., Armandi, A., Buzzetti, E., Dalbeni, A., Liguori, A., and Mantovani, A. (2024). Evaluation of ChatGPT as a Counselling Tool for Italian-Speaking MASLD Patients: Assessment of Accuracy, Completeness and Comprehensibility. J. Pers. Med., 14.","DOI":"10.3390\/jpm14060568"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1111\/apt.18058","article-title":"Systematic review: The use of large language models as medical chatbots in digestive diseases","volume":"60","author":"Kresevic","year":"2024","journal-title":"Aliment. Pharmacol. Ther."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1038\/s41443-023-00797-z","article-title":"Assessing ChatGPT\u2019s ability to answer questions pertaining to erectile dysfunction: Can our patients trust it?","volume":"36","author":"Razdan","year":"2023","journal-title":"Int. J. Impot. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1097\/JU.0000000000003615","article-title":"Evaluating the Effectiveness of Artificial Intelligence-powered Large Language Models Application in Disseminating Appropriate and Readable Health Information in Urology","volume":"210","author":"Davis","year":"2023","journal-title":"J. Urol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1002\/ijgo.15309","article-title":"Accuracy and reproducibility of ChatGPT\u2019s free version answers about endometriosis","volume":"165","author":"Ozgor","year":"2024","journal-title":"Int. J. Gynaecol. Obstet. Off. Organ Int. Fed. Gynaecol. Obstet."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1002\/ijgo.15501","article-title":"Evaluating the validity of ChatGPT responses on common obstetric issues: Potential clinical applications and implications","volume":"166","author":"Peled","year":"2024","journal-title":"Int. J. Gynaecol. Obstet. Off. Organ Int. Fed. Gynaecol. Obstet."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"110404","DOI":"10.1016\/j.resuscitation.2024.110404","article-title":"Suitability of GPT-4o as an Evaluator of Cardiopulmonary Resuscitation Skills Examinations","volume":"204","author":"Wang","year":"2024","journal-title":"Resuscitation"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gajjar, A.A., Kumar, R.P., Paliwoda, E.D., Kuo, C.C., Adida, S., Legarreta, A.D., Deng, H., Anand, S.K., Hamilton, D.K., and Buell, T.J. (2024). Usefulness and Accuracy of Artificial Intelligence Chatbot Responses to Patient Questions for Neurosurgical Procedures. Neurosurgery.","DOI":"10.1227\/neu.0000000000002856"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6167","DOI":"10.1007\/s00405-024-08859-8","article-title":"Accuracy of ChatGPT responses on tracheotomy for patient education","volume":"281","author":"Khaldi","year":"2024","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"104410","DOI":"10.1016\/j.amjoto.2024.104410","article-title":"Assessment of ChatGPT generated educational material for head and neck surgery counseling","volume":"45","author":"Mnajjed","year":"2024","journal-title":"Am. J. Otolaryngol."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jia, X., Pang, Y., and Liu, L.S. (2021). Online Health Information Seeking Behavior: A Systematic Review. Healthcare, 9.","DOI":"10.3390\/healthcare9121740"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum","volume":"183","author":"Ayers","year":"2023","journal-title":"JAMA Int. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.wneu.2018.11.176","article-title":"Decompressive Hemicraniectomy in the Treatment of Malignant Middle Cerebral Artery Infarction: A Meta-Analysis","volume":"123","author":"Das","year":"2019","journal-title":"World Neurosurg."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"6123","DOI":"10.1007\/s00405-024-08710-0","article-title":"Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: A new tool to assess the quality of health information provided by AI platforms","volume":"281","author":"Vaira","year":"2024","journal-title":"Eur. Arch. Otorhinolaryngol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1136\/jech.53.2.105","article-title":"Discern: An instrument for judging the quality of written consumer health information on treatment choices","volume":"53","author":"Charnock","year":"1999","journal-title":"J. Epidemiol. Community Health."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/s10897-008-9181-0","article-title":"Tools for Assessing Readability and Quality of Health-Related Web Sites","volume":"18","author":"Sturm","year":"2009","journal-title":"J. Genet Couns."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1177\/17474930211065917","article-title":"World Stroke Organization (WSO): Global Stroke Fact Sheet 2022","volume":"17","author":"Feigin","year":"2022","journal-title":"Int. J. Stroke Off J. Int. Stroke Soc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1001\/jamaneurol.2020.3745","article-title":"Surgical Decompression for Space-Occupying Hemispheric Infarction: A Systematic Review and Individual Patient Meta-analysis of Randomized Clinical Trials","volume":"78","author":"Reinink","year":"2021","journal-title":"JAMA Neurol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3147","DOI":"10.1007\/s00701-019-04180-0","article-title":"Decompressive craniectomy in malignant MCA infarction in times of mechanical thrombectomy","volume":"162","author":"Flottmann","year":"2020","journal-title":"Acta Neurochir."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1001\/archneur.1996.00550040037012","article-title":"\u201cMalignant\u201d middle cerebral artery territory infarction: Clinical course and prognostic signs","volume":"53","author":"Hacke","year":"1996","journal-title":"Arch. Neurol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"E14","DOI":"10.3171\/foc.2007.22.5.15","article-title":"Surgery for brain edema","volume":"22","author":"Hutchinson","year":"2007","journal-title":"Neurosurg. Focus."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"e2336483","DOI":"10.1001\/jamanetworkopen.2023.36483","article-title":"Accuracy and Reliability of Chatbot Responses to Physician Questions","volume":"6","author":"Goodman","year":"2023","journal-title":"JAMA Netw. Open."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e60807","DOI":"10.2196\/60807","article-title":"Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis","volume":"26","author":"Liu","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1001\/jamainternmed.2024.0295","article-title":"Clinical Reasoning of a Generative Artificial Intelligence Model Compared with Physicians","volume":"184","author":"Cabral","year":"2024","journal-title":"JAMA Intern. Med."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Barrit, S., Torcida, N., Mazeraud, A., Boulogne, S., Benoit, J., Carette, T., Carron, T., Delsaut, B., Diab, E., and Kermorvant, H. (2025). Specialized Large Language Model Outperforms Neurologists at Complex Diagnosis in Blinded Case-Based Evaluation. Brain Sci., 15.","DOI":"10.3390\/brainsci15040347"},{"key":"ref_39","unstructured":"Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., and Zhou, D. (2022). Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. arXiv, Available online: https:\/\/arxiv.org\/abs\/2201.11903v6."},{"key":"ref_40","unstructured":"Learning to Reason with LLMS (2024, September 12). OpenAI. Available online: https:\/\/openai.com\/index\/learning-to-reason-with-llms."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.bbi.2023.02.022","article-title":"A Chat(GPT) about the future of scientific publishing","volume":"110","author":"Hutchinson","year":"2023","journal-title":"Brain Behav. Immun."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1007\/s10143-023-01998-2","article-title":"The role of an open artificial intelligence platform in modern neurosurgical education: A preliminary study","volume":"46","author":"Sevgi","year":"2023","journal-title":"Neurosurg. Rev."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1177\/08465371231171125","article-title":"Accuracy of Information and References Using ChatGPT-3 for Retrieval of Clinical Radiological Information","volume":"75","author":"Wagner","year":"2024","journal-title":"Can. Assoc. Radiol. J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1366","DOI":"10.1227\/neu.0000000000002598","article-title":"Exploring the Intersection of Artificial Intelligence and Neurosurgery: Let us be Cautious With ChatGPT","volume":"93","author":"Mishra","year":"2023","journal-title":"Neurosurgery"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1492","DOI":"10.1002\/ohn.489","article-title":"Accuracy of ChatGPT-Generated Information on Head and Neck and Oromaxillofacial Surgery: A Multicenter Collaborative Analysis","volume":"170","author":"Vaira","year":"2024","journal-title":"Otolaryngol.-Head Neck Surg."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2120","DOI":"10.1007\/s10439-023-03248-4","article-title":"In Reference to \u201cRole of Chat GPT in Public Health\u201d, to Highlight the AI\u2019s Incorrect Reference Generation","volume":"51","author":"Frosolini","year":"2023","journal-title":"Ann. Biomed. Eng."},{"key":"ref_47","unstructured":"Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., K\u00fcttler, H., Lewis, M., Yih, W.-T., and Rockt\u00e4schel, T. (2021). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1016\/j.oret.2023.05.022","article-title":"Appropriateness and Readability of ChatGPT-4-Generated Responses for Surgical Treatment of Retinal Diseases","volume":"7","author":"Momenaei","year":"2023","journal-title":"Ophthalmol. Retina."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Onder, C.E., Koc, G., Gokbulut, P., Taskaldiran, I., and Kuskonmaz, S.M. (2024). Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy. Sci. Rep., 14.","DOI":"10.1038\/s41598-023-50884-w"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.arthro.2024.05.009","article-title":"Chat Generative Pre-Trained Transformer (ChatGPT)\u20143.5 Responses Require Advanced Readability for the General Population and May Not Effectively Supplement Patient-Related Information Provided by the Treating Surgeon Regarding Common Questions About Rotator Cuff Repair","volume":"41","author":"Eng","year":"2025","journal-title":"Arthroscopy"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"e1138","DOI":"10.1016\/j.wneu.2023.11.062","article-title":"Information Quality and Readability: ChatGPT\u2019s Responses to the Most Common Questions About Spinal Cord Injury","volume":"181","author":"Temel","year":"2024","journal-title":"World Neurosurg."},{"key":"ref_52","unstructured":"Clear & Simple (2024, October 03). National Institutes of Health (NIH). 8 May 2015, Available online: https:\/\/www.nih.gov\/institutes-nih\/nih-office-director\/office-communications-public-liaison\/clear-communication\/clear-simple."},{"key":"ref_53","first-page":"S81","article-title":"Library outreach: Overcoming health literacy challenges","volume":"93","author":"Parker","year":"2005","journal-title":"J. Med. Libr. Assoc. JMLA."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2260","DOI":"10.1097\/CORR.0000000000002668","article-title":"Can Artificial Intelligence Improve the Readability of Patient Education Materials?","volume":"481","author":"Kirchner","year":"2023","journal-title":"Clin. Orthop."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1002\/ohn.807","article-title":"Applications of ChatGPT in Otolaryngology-Head Neck Surgery: A State of the Art Review","volume":"171","author":"Lechien","year":"2024","journal-title":"Otolaryngol. Head Neck Surg. Off. J. Am. Acad. Otolaryngol. Head Neck Surg."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1790","DOI":"10.1007\/s11695-023-06603-5","article-title":"Assessing the Accuracy of Responses by the Language Model ChatGPT to Questions Regarding Bariatric Surgery","volume":"33","author":"Samaan","year":"2023","journal-title":"Obes Surg."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1256459","DOI":"10.3389\/fonc.2023.1256459","article-title":"Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer?","volume":"13","author":"Pamuk","year":"2023","journal-title":"Front Oncol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"721","DOI":"10.3350\/cmh.2023.0089","article-title":"Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma","volume":"29","author":"Yeo","year":"2023","journal-title":"Clin. Mol. Hepatol."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Heya, T.A., Ineza, Y., Arefin, S.E., Uzor, G., and Serwadda, A. (February, January 29). Stable or Shaky? The Semantics of ChatGPT\u2019s Behavior Under Repeated Queries. Proceedings of the 2024 IEEE 18th International Conference on Semantic Computing (ICSC), Laguna Hills, CA, USA.","DOI":"10.1109\/ICSC59802.2024.00023"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"878","DOI":"10.3171\/2024.3.JNS24610","article-title":"Letter to the Editor. Rise of large language models in neurosurgery","volume":"141","author":"Barrit","year":"2024","journal-title":"J. Neurosurg."}],"container-title":["Brain Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3425\/15\/4\/391\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:13:10Z","timestamp":1760029990000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3425\/15\/4\/391"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,11]]},"references-count":61,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["brainsci15040391"],"URL":"https:\/\/doi.org\/10.3390\/brainsci15040391","relation":{},"ISSN":["2076-3425"],"issn-type":[{"value":"2076-3425","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,11]]}}}