{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T07:18:05Z","timestamp":1790666285037,"version":"4.1.0"},"reference-count":24,"publisher":"Georg Thieme Verlag KG","issue":"02","license":[{"start":{"date-parts":[[2024,11,4]],"date-time":"2024-11-04T00:00:00Z","timestamp":1730678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Indian J Radiol Imaging"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Radiology is critical for diagnosis and patient care, relying heavily on accurate image interpretation. Recent advancements in artificial intelligence (AI) and natural language processing (NLP) have raised interest in the potential of AI models to support radiologists, although robust research on AI performance in this field is still emerging.<\/jats:p><jats:p>\n          Objective\u2003This study aimed to assess the efficacy of ChatGPT-4 in answering radiological anatomy questions similar to those in the Fellowship of the Royal College of Radiologists (FRCR) Part 1 Anatomy examination.<\/jats:p><jats:p>\n          Materials and Methods\u2003We used 100 mock radiological anatomy questions from a free Web site patterned after the FRCR Part 1 Anatomy examination. ChatGPT-4 was tested under two conditions: with and without context regarding the examination instructions and question format. The main query posed was: \u201cIdentify the structure indicated by the arrow(s).\u201d Responses were evaluated against correct answers, and two expert radiologists (&gt;5 and 30 years of experience in radiology diagnostics and academics) rated the explanation of the answers. We calculated four scores: correctness, sidedness, modality identification, and approximation. The latter considers partial correctness if the identified structure is present but not the focus of the question.<\/jats:p><jats:p>\n          Results\u2003Both testing conditions saw ChatGPT-4 underperform, with correctness scores of 4 and 7.5% for no context and with context, respectively. However, it identified the imaging modality with 100% accuracy. The model scored over 50% on the approximation metric, where it identified present structures not indicated by the arrow. However, it struggled with identifying the correct side of the structure, scoring approximately 42 and 40% in the no context and with context settings, respectively. Only 32% of the responses were similar across the two settings.<\/jats:p><jats:p>\n          Conclusion\u2003Despite its ability to correctly recognize the imaging modality, ChatGPT-4 has significant limitations in interpreting normal radiological anatomy. This indicates the necessity for enhanced training in normal anatomy to better interpret abnormal radiological images. Identifying the correct side of structures in radiological images also remains a challenge for ChatGPT-4.<\/jats:p>","DOI":"10.1055\/s-0044-1792040","type":"journal-article","created":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T01:10:21Z","timestamp":1730769021000},"page":"287-294","source":"Crossref","is-referenced-by-count":23,"title":["Evaluating ChatGPT-4's Performance in Identifying Radiological Anatomy in FRCR Part 1 Examination Questions"],"prefix":"10.1055","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9434-946X","authenticated-orcid":false,"given":"Pradosh Kumar","family":"Sarangi","sequence":"additional","affiliation":[{"name":"Department of Radiodiagnosis, All India Institute of Medical Sciences, Deoghar, Jharkhand, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suvrankar","family":"Datta","sequence":"additional","affiliation":[{"name":"Department of Radiodiagnosis, All India Institute of Medical Sciences, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Braja Behari","family":"Panda","sequence":"additional","affiliation":[{"name":"Department of Radiodiagnosis, Veer Surendra Sai Institute of Medical Sciences and Research, Burla, Odisha, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9657-8672","authenticated-orcid":false,"given":"Swaha","family":"Panda","sequence":"additional","affiliation":[{"name":"Department of Otorhinolaryngology and Head and Neck Surgery, All India Institute of Medical Sciences, Deoghar, Jharkhand, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6950-5857","authenticated-orcid":false,"given":"Himel","family":"Mondal","sequence":"additional","affiliation":[{"name":"Department of Physiology, All India Institute of Medical Sciences, Deoghar, Jharkhand, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2024,11,4]]},"reference":[{"issue":"01","key":"ref1","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1186\/s12909-022-03784-y","article-title":"Implications of introducing case based radiological images in anatomy on teaching, learning and assessment of medical students: a mixed-methods study","volume":"22","author":"R Rathan","year":"2022","journal-title":"BMC Med Educ"},{"issue":"05","key":"ref2","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1016\/j.crad.2014.01.014","article-title":"Are radiologists the contemporary anatomists?","volume":"69","author":"F Pathiraja","year":"2014","journal-title":"Clin Radiol"},{"issue":"13","key":"ref4","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","article-title":"Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine","volume":"388","author":"P Lee","year":"2023","journal-title":"N Engl J Med"},{"issue":"06","key":"ref5","first-page":"1018","article-title":"Beyond ChatGPT: what does GPT-4 add to healthcare? The dawn of a new era","volume":"30","author":"S W\u00f3jcik","year":"2023","journal-title":"Cardiol J"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"817","DOI":"10.2147\/IJGM.S456659","article-title":"The potential applications and challenges of ChatGPT in the medical field","volume":"17","author":"Y Mu","year":"2024","journal-title":"Int J Gen Med"},{"issue":"02","key":"ref7","doi-asserted-by":"crossref","first-page":"e1878","DOI":"10.1002\/hsr2.1878","article-title":"What are the applications of ChatGPT in healthcare: gain or loss?","volume":"7","author":"M Montazeri","year":"2024","journal-title":"Health Sci Rep"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"e48291","DOI":"10.2196\/48291","article-title":"Large language models in medical education: opportunities, challenges, and future directions","volume":"9","author":"A Abd-Alrazaq","year":"2023","journal-title":"JMIR Med Educ"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"e48568","DOI":"10.2196\/48568","article-title":"Utility of ChatGPT in clinical practice","volume":"25","author":"J Liu","year":"2023","journal-title":"J Med Internet Res"},{"issue":"04","key":"ref10","doi-asserted-by":"crossref","first-page":"482","DOI":"10.4103\/idoj.idoj_72_23","article-title":"Using ChatGPT for writing articles for patients' education for dermatological diseases: a pilot study","volume":"14","author":"H Mondal","year":"2023","journal-title":"Indian Dermatol Online J"},{"issue":"08","key":"ref11","first-page":"e43292","article-title":"ChatGPT and artificial intelligence in medical writing: concerns and ethical considerations","volume":"15","author":"A S Doyal","year":"2023","journal-title":"Cureus"},{"issue":"04","key":"ref12","doi-asserted-by":"crossref","first-page":"165","DOI":"10.4103\/picr.picr_167_23","article-title":"ChatGPT in medical writing: a game-changer or a gimmick?","volume":"15","author":"S S Ahaley","year":"2024","journal-title":"Perspect Clin Res"},{"issue":"02","key":"ref13","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1067\/j.cpradiol.2023.10.013","article-title":"Analysis of ChatGPT publications in radiology: literature so far","volume":"53","author":"K Bera","year":"2024","journal-title":"Curr Probl Diagn Radiol"},{"issue":"05","key":"ref14","doi-asserted-by":"crossref","first-page":"2817","DOI":"10.1007\/s00330-023-10213-1","article-title":"ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports","volume":"34","author":"K Jeblick","year":"2024","journal-title":"Eur Radiol"},{"issue":"12","key":"ref15","first-page":"e50881","article-title":"Assessing ChatGPT's proficiency in simplifying radiological reports for healthcare professionals and patients","volume":"15","author":"P K Sarangi","year":"2023","journal-title":"Cureus"},{"issue":"02","key":"ref16","first-page":"276","article-title":"Assessing the capability of ChatGPT, Google Bard, and Microsoft Bing in solving radiology case vignettes","volume":"34","author":"P K Sarangi","year":"2023","journal-title":"Indian J Radiol Imaging"},{"issue":"05","key":"ref17","doi-asserted-by":"crossref","first-page":"701","DOI":"10.2214\/AJR.23.29622","article-title":"Use of ChatGPT, GPT-4, and Bard to improve readability of ChatGPT's answers to common questions about lung cancer and lung cancer screening","volume":"221","author":"H L Haver","year":"2023","journal-title":"AJR Am J Roentgenol"},{"issue":"02","key":"ref18","first-page":"269","article-title":"Radiological differential diagnoses based on cardiovascular and thoracic imaging patterns: perspectives of four large language models","volume":"34","author":"P K Sarangi","year":"2023","journal-title":"Indian J Radiol Imaging"},{"issue":"04","key":"ref19","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1055\/s-0044-1787974","article-title":"Radiologic decision-making for imaging in pulmonary embolism: accuracy and reliability of large language models: Bing, Claude, ChatGPT, and Perplexity","volume":"34","author":"P K Sarangi","year":"2024","journal-title":"Indian J Radiol Imaging"},{"issue":"02","key":"ref24","doi-asserted-by":"crossref","first-page":"e233270","DOI":"10.1148\/radiol.233270","article-title":"Evaluating GPT-V4 (GPT-4 with vision) on detection of radiologic findings on chest radiographs","volume":"311","author":"Y Zhou","year":"2024","journal-title":"Radiology"},{"issue":"08","key":"ref26","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1007\/s11604-024-01561-z","article-title":"GPT-4 Turbo with Vision fails to outperform text-only GPT-4 Turbo in the Japan Diagnostic Radiology Board Examination","volume":"42","author":"Y Hirano","year":"2024","journal-title":"Jpn J Radiol"},{"issue":"01","key":"ref28","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1093\/radadv\/umae006","article-title":"ChatGPT-4: a breakthrough in ultrasound image analysis","volume":"1","author":"L R Sultan","year":"2024","journal-title":"Radiol Adv"},{"issue":"03","key":"ref31","doi-asserted-by":"crossref","first-page":"e232255","DOI":"10.1148\/radiol.232255","article-title":"Collaborative enhancement of consistency and accuracy in US diagnosis of thyroid nodules using large language models","volume":"310","author":"S H Wu","year":"2024","journal-title":"Radiology"},{"issue":"01","key":"ref32","doi-asserted-by":"crossref","first-page":"e232756","DOI":"10.1148\/radiol.232756","article-title":"Chatbots and large language models in radiology: a practical primer for clinical and research applications","volume":"310","author":"R Bhayana","year":"2024","journal-title":"Radiology"},{"issue":"02","key":"ref33","doi-asserted-by":"crossref","first-page":"e240935","DOI":"10.1148\/radiol.240935","article-title":"Seeing the unseen: advancing generative AI research in radiology","volume":"311","author":"W Kim","year":"2024","journal-title":"Radiology"}],"container-title":["Indian Journal of Radiology and Imaging"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0044-1792040.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,27]],"date-time":"2025-04-27T22:31:10Z","timestamp":1745793070000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0044-1792040"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,4]]},"references-count":24,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2025,4,27]]},"published-print":{"date-parts":[[2025,4]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0044-1792040","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["0971-3026","1998-3808"],"issn-type":[{"value":"0971-3026","type":"print"},{"value":"1998-3808","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,4]]}}}