{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,4]],"date-time":"2026-10-04T20:51:58Z","timestamp":1791147118749,"version":"4.1.0"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T00:00:00Z","timestamp":1790985600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T00:00:00Z","timestamp":1790985600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"JST PRESTO","award":["JPMJPR2521"],"award-info":[{"award-number":["JPMJPR2521"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Jpn J Radiol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Generative artificial intelligence (AI) models are increasingly evaluated for diagnostic tasks in radiology, yet accuracy, study designs, endpoints, and comparators vary widely. The purpose was to synthesize diagnostic accuracy of generative AI for radiology and compare performance with physicians.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>A systematic review and meta-analysis was prospectively registered in PROSPERO (CRD420251040000) and conducted in accordance with PRISMA-DTA guidance. Searches of Medline, Scopus, Web of Science, Cochrane Central, and medRxiv (June 2018\u2013March 2025) identified studies validating generative AI on diagnostic tasks in radiology. Two reviewers independently screened, extracted data, and assessed risk of bias with PROBAST+AI, with disagreements resolved by a third reviewer. Multilevel random-effects meta-regression was performed to compare AI performance with physician performance and identify sources of heterogeneity, with study-clustered robust inference to account for multiple estimates per study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      In total, 48 studies met inclusion criteria. Pooled diagnostic accuracy of generative AI was 42.9% (95% CI, 35.8\u201350.1%) for free-text tasks and 58.1% (95% CI, 50.0\u201366.2%) for choice tasks. Generative AI overall showed significantly lower accuracy than expert physicians (difference in accuracy [physicians minus AI], +13.0 percentage points [95% CI, 0.9\u201325.2];\n                      <jats:italic>P<\/jats:italic>\n                      = .038). Text-only input was associated with higher accuracy than image-only input (difference in accuracy [image-only minus text-only], \u221225.9 percentage points [95% CI, \u221239.1 to \u221212.8];\n                      <jats:italic>P<\/jats:italic>\n                      = .001) and text-and-image input (\u2212\u200910.6 percentage points [95% CI, \u221220.8 to \u22120.3];\n                      <jats:italic>P<\/jats:italic>\n                      = .046).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Generative AI remained less accurate than expert physicians on diagnostic tasks in radiology. Text-oriented assistive use warrants further evaluation, but the observed accuracy difference may reflect task difficulty and information content rather than the input modality itself. Standardized, transparently reported, adequately powered evaluations are warranted before clinical deployment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11604-026-02090-7","type":"journal-article","created":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T04:06:17Z","timestamp":1791000377000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Generative AI versus physicians in diagnostic radiology: a systematic review and meta-analysis"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2860-4503","authenticated-orcid":false,"given":"Hirotaka","family":"Takita","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1243-4928","authenticated-orcid":false,"given":"Daijiro","family":"Kabata","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7268-8313","authenticated-orcid":false,"given":"Shannon L.","family":"Walston","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7979-2300","authenticated-orcid":false,"given":"Yasuhito","family":"Mitsuyama","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8050-4895","authenticated-orcid":false,"given":"Hiroyuki","family":"Tatekawa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2301-706X","authenticated-orcid":false,"given":"Kenichi","family":"Saito","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0621-0044","authenticated-orcid":false,"given":"Yukio","family":"Miki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3878-3616","authenticated-orcid":false,"given":"Daiju","family":"Ueda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,10,3]]},"reference":[{"key":"2090_CR1","doi-asserted-by":"publisher","first-page":"e231040","DOI":"10.1148\/radiol.231040","volume":"308","author":"D Ueda","year":"2023","unstructured":"Ueda D, Mitsuyama Y, Takita H, Horiuchi D, Walston SL, Tatekawa H, et al. ChatGPT\u2019s diagnostic performance from patient history and imaging findings on the diagnosis please quizzes. Radiology. 2023;308:e231040.","journal-title":"Radiology"},{"key":"2090_CR2","doi-asserted-by":"publisher","first-page":"e240273","DOI":"10.1148\/radiol.240273","volume":"312","author":"PS Suh","year":"2024","unstructured":"Suh PS, Shim WH, Suh CH, Heo H, Park CR, Eom HJ, et al. Comparing diagnostic accuracy of radiologists versus GPT-4V and Gemini Pro Vision using image inputs from diagnosis please cases. Radiology. 2024;312:e240273.","journal-title":"Radiology"},{"key":"2090_CR3","doi-asserted-by":"publisher","first-page":"6652","DOI":"10.1007\/s00330-024-10727-2","volume":"34","author":"R Siepmann","year":"2024","unstructured":"Siepmann R, Huppertz M, Rastkhiz A, Reen M, Corban E, Schmidt C, et al. The virtual reference radiologist: comprehensive AI assistance for clinical image reading and interpretation. Eur Radiol. 2024;34:6652\u201366.","journal-title":"Eur Radiol"},{"key":"2090_CR4","first-page":"e230513","volume":"6","author":"AP Brady","year":"2024","unstructured":"Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, et al. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A multi-society statement from the ACR, CAR, ESR. RANZCR and RSNA Radiol Artif Intell. 2024;6:e230513.","journal-title":"RANZCR and RSNA. Radiol Artif Intell"},{"key":"2090_CR5","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1038\/s41591-024-03425-5","volume":"31","author":"J Gallifant","year":"2025","unstructured":"Gallifant J, Afshar M, Ameen S, Aphinyanaphongs Y, Chen S, Cacciamani G, et al. The TRIPOD-LLM reporting guideline for studies using large language models. Nat Med. 2025;31:60\u20139.","journal-title":"Nat Med"},{"key":"2090_CR6","doi-asserted-by":"publisher","first-page":"e232756","DOI":"10.1148\/radiol.232756","volume":"310","author":"R Bhayana","year":"2024","unstructured":"Bhayana R. Chatbots and large language models in radiology: a practical primer for clinical and research applications. Radiology. 2024;310:e232756.","journal-title":"Radiology"},{"key":"2090_CR7","doi-asserted-by":"publisher","first-page":"1959","DOI":"10.1007\/s00330-024-11035-5","volume":"35","author":"D Brin","year":"2025","unstructured":"Brin D, Sorin V, Barash Y, Konen E, Glicksberg BS, Nadkarni GN, et al. Assessing GPT-4 multimodal performance in radiological image analysis. Eur Radiol. 2025;35:1959\u201365.","journal-title":"Eur Radiol"},{"key":"2090_CR8","doi-asserted-by":"publisher","first-page":"e074821","DOI":"10.1136\/bmj-2023-074821","volume":"384","author":"RD Riley","year":"2024","unstructured":"Riley RD, Snell KIE, Archer L, Ensor J, Debray TPA, van Calster B, et al. Evaluation of clinical prediction models (part 3): calculating the sample size required for an external validation study. BMJ. 2024;384:e074821.","journal-title":"BMJ"},{"key":"2090_CR9","doi-asserted-by":"publisher","unstructured":"Sounderajah V, Guni A, Liu X, Collins GS, Karthikesalingam A, Markar SR, et al. The STARD-AI reporting guideline for diagnostic accuracy studies using artificial intelligence. Nat Med [Internet]. 2025; Available from: https:\/\/doi.org\/10.1038\/s41591-025-03953-8","DOI":"10.1038\/s41591-025-03953-8"},{"key":"2090_CR10","doi-asserted-by":"publisher","first-page":"m2632","DOI":"10.1136\/bmj.m2632","volume":"370","author":"J-P Salameh","year":"2020","unstructured":"Salameh J-P, Bossuyt PM, McGrath TA, Thombs BD, Hyde CJ, Macaskill P, et al. Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist. BMJ. 2020;370:m2632.","journal-title":"BMJ"},{"key":"2090_CR11","doi-asserted-by":"crossref","unstructured":"McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, and the PRISMA-DTA Group, et al. Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA. 2018;319:388\u201396.","DOI":"10.1001\/jama.2017.19163"},{"key":"2090_CR12","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1038\/s41746-025-01543-z","volume":"8","author":"H Takita","year":"2025","unstructured":"Takita H, Kabata D, Walston SL, Tatekawa H, Saito K, Tsujimoto Y, et al. A systematic review and meta-analysis of diagnostic performance comparison between generative AI and physicians. NPJ Digit Med. 2025;8:175.","journal-title":"NPJ Digit Med"},{"key":"2090_CR13","unstructured":"Radford, A., Narasimhan, K., Salimans, T. & Sutskever, I. Improving language understanding by generative pre-training [Internet]. [cited 2025 Oct 10]. Available from: https:\/\/www.mikecaptain.com\/resources\/pdf\/GPT-1.pdf"},{"key":"2090_CR14","unstructured":"Mehdi Y. Reinventing search with a new AI-powered Microsoft Bing and Edge, your copilot for the web [Internet]. The Official Microsoft Blog. 2023 [cited 2025 Oct 12]. Available from: https:\/\/blogs.microsoft.com\/blog\/2023\/02\/07\/reinventing-search-with-a-new-ai-powered-microsoft-bing-and-edge-your-copilot-for-the-web\/"},{"key":"2090_CR15","doi-asserted-by":"publisher","unstructured":"Chowdhery A, Narang S, Devlin J, Bosma M, Mishra G, Roberts A, et al. PaLM: Scaling language modeling with Pathways [Internet]. arXiv [cs.CL]. 2022. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2204.02311","DOI":"10.48550\/ARXIV.2204.02311"},{"key":"2090_CR16","doi-asserted-by":"publisher","unstructured":"Anil R, Dai AM, Firat O, Johnson M, Lepikhin D, Passos A, et al. PaLM 2 Technical Report [Internet]. arXiv [cs.CL]. 2023. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2305.10403","DOI":"10.48550\/ARXIV.2305.10403"},{"key":"2090_CR17","doi-asserted-by":"publisher","unstructured":"Thoppilan R, De Freitas D, Hall J, Shazeer N, Kulshreshtha A, Cheng H-T, et al. LaMDA: Language models for Dialog Applications [Internet]. arXiv [cs.CL]. 2022. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2201.08239","DOI":"10.48550\/ARXIV.2201.08239"},{"key":"2090_CR18","doi-asserted-by":"publisher","unstructured":"Touvron H, Lavril T, Izacard G, Martinet X, Lachaux M-A, Lacroix T, et al. LLaMA: Open and efficient foundation language models [Internet]. arXiv [cs.CL]. 2023. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2302.13971","DOI":"10.48550\/ARXIV.2302.13971"},{"key":"2090_CR19","doi-asserted-by":"publisher","unstructured":"Touvron H, Martin L, Stone K, Albert P, Almahairi A, Babaei Y, et al. Llama 2: Open foundation and fine-tuned chat models [Internet]. arXiv [cs.CL]. 2023. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2307.09288","DOI":"10.48550\/ARXIV.2307.09288"},{"key":"2090_CR20","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1007\/s11604-024-01608-1","volume":"42","author":"SL Walston","year":"2024","unstructured":"Walston SL, Seki H, Takita H, Mitsuyama Y, Sato S, Hagiwara A, et al. Data set terminology of deep learning in medicine: a historical review and recommendation. Jpn J Radiol. 2024;42:1100\u20139.","journal-title":"Jpn J Radiol"},{"key":"2090_CR21","doi-asserted-by":"publisher","first-page":"e082505","DOI":"10.1136\/bmj-2024-082505","volume":"388","author":"KGM Moons","year":"2025","unstructured":"Moons KGM, Damen JAA, Kaul T, Hooft L, Andaur Navarro C, Dhiman P, et al. PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods. BMJ. 2025;388:e082505.","journal-title":"BMJ"},{"key":"2090_CR22","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1007\/s11604-023-01487-y","volume":"42","author":"T Nakaura","year":"2024","unstructured":"Nakaura T, Yoshida N, Kobayashi N, Shiraishi K, Nagayama Y, Uetani H, et al. Preliminary assessment of automated radiology report generation with generative pre-trained transformers: comparing results to radiologist-generated reports. Jpn J Radiol. 2024;42:190\u2013200.","journal-title":"Jpn J Radiol"},{"key":"2090_CR23","first-page":"e43958","volume":"15","author":"PP Suthar","year":"2023","unstructured":"Suthar PP, Kounsal A, Chhetri L, Saini D, Dua SG. Artificial intelligence (AI) in radiology: a deep dive into ChatGPT 4.0\u2019s accuracy with the American Journal of Neuroradiology\u2019s (AJNR) \u201cCase of the Month.\u201d Cureus. 2023;15:e43958.","journal-title":"Cureus"},{"key":"2090_CR24","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s00234-023-03252-4","volume":"66","author":"D Horiuchi","year":"2024","unstructured":"Horiuchi D, Tatekawa H, Shimono T, Walston SL, Takita H, Matsushita S, et al. Accuracy of ChatGPT generated diagnosis from patient\u2019s medical history and imaging findings in neuroradiology cases. Neuroradiology. 2024;66:73\u20139.","journal-title":"Neuroradiology"},{"key":"2090_CR25","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1093\/mr\/road115","volume":"34","author":"Y Mori","year":"2024","unstructured":"Mori Y, Izumiyama T, Kanabuchi R, Mori N, Aizawa T. Large language model may assist diagnosis of SAPHO syndrome by bone scintigraphy. Mod Rheumatol. 2024;34:1043\u20136.","journal-title":"Mod Rheumatol"},{"key":"2090_CR26","doi-asserted-by":"publisher","unstructured":"Hua Y, Xu J, Wang S, Yin C, He K. The potential of ChatGPT as clinical diagnostician for aortic dissection. In: Baloch Z, Piccaluga PP, editors. Third International Conference on Biomedical and Intelligent Systems (IC-BIS 2024) [Internet]. SPIE; 2024. Available from: https:\/\/www.spiedigitallibrary.org\/conference-proceedings-of-spie\/13208\/3036650\/The-potential-of-ChatGPT-as-clinical-diagnostician-for-aortic-dissection\/https:\/\/doi.org\/10.1117\/12.3036650.full","DOI":"10.1117\/12.3036650.full"},{"key":"2090_CR27","doi-asserted-by":"publisher","first-page":"100525","DOI":"10.1016\/j.jbo.2024.100525","volume":"44","author":"F Yang","year":"2024","unstructured":"Yang F, Yan D, Wang Z. Large-Scale assessment of ChatGPT\u2019s performance in benign and malignant bone tumors imaging report diagnosis and its potential for clinical applications. J Bone Oncol. 2024;44:100525.","journal-title":"J Bone Oncol"},{"key":"2090_CR28","doi-asserted-by":"publisher","first-page":"e232255","DOI":"10.1148\/radiol.232255","volume":"310","author":"S-H Wu","year":"2024","unstructured":"Wu S-H, Tong W-J, Li M-D, Hu H-T, Lu X-Z, Huang Z-R, et al. Collaborative enhancement of consistency and accuracy in US diagnosis of thyroid nodules using large language models. Radiology. 2024;310:e232255.","journal-title":"Radiology"},{"key":"2090_CR29","doi-asserted-by":"publisher","first-page":"e54948","DOI":"10.2196\/54948","volume":"26","author":"F Busch","year":"2024","unstructured":"Busch F, Han T, Makowski MR, Truhn D, Bressem KK, Adams L. Integrating text and image analysis: exploring GPT-4V\u2019s capabilities in advanced radiological applications across subspecialties. J Med Internet Res. 2024;26:e54948.","journal-title":"J Med Internet Res"},{"key":"2090_CR30","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/s41747-024-00457-x","volume":"8","author":"S Rau","year":"2024","unstructured":"Rau S, Rau A, Nattenm\u00fcller J, Fink A, Bamberg F, Reisert M, et al. A retrieval-augmented chatbot based on GPT-4 provides appropriate differential diagnosis in gastrointestinal radiology: a proof of concept study. Eur Radiol Exp. 2024;8:60.","journal-title":"Eur Radiol Exp"},{"key":"2090_CR31","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1007\/s00062-024-01426-y","volume":"34","author":"D Horiuchi","year":"2024","unstructured":"Horiuchi D, Tatekawa H, Oura T, Oue S, Walston SL, Takita H, et al. Comparing the diagnostic performance of GPT-4-based ChatGPT, GPT-4V-based ChatGPT, and radiologists in challenging neuroradiology cases. Clin Neuroradiol. 2024;34:779\u201387.","journal-title":"Clin Neuroradiol"},{"key":"2090_CR32","doi-asserted-by":"publisher","unstructured":"Olshaker H, Brin D, Kalderon E, Kraus M, Konen E, Klang E. Evaluating the diagnostic performance of large language models in identifying complex multisystemic syndromes: A comparative study with radiology residents [Internet]. medRxiv. 2024. Available from: http:\/\/medrxiv.org\/lookup\/doi\/https:\/\/doi.org\/10.1101\/2024.06.05.24308335","DOI":"10.1101\/2024.06.05.24308335"},{"key":"2090_CR33","first-page":"e60009","volume":"16","author":"T Cesur","year":"2024","unstructured":"Cesur T, G\u00fcne\u015f YC. Optimizing diagnostic performance of ChatGPT: the impact of prompt engineering on thoracic radiology cases. Cureus. 2024;16:e60009.","journal-title":"Cureus"},{"key":"2090_CR34","doi-asserted-by":"publisher","unstructured":"Cesur T, Gunes YC, Camur E, Da\u011fl\u0131 M. Empowering radiologists with ChatGPT-4o: Comparative evaluation of Large Language Models and radiologists in cardiac cases [Internet]. medRxiv. 2024. Available from: http:\/\/medrxiv.org\/lookup\/doi\/https:\/\/doi.org\/10.1101\/2024.06.25.24309247","DOI":"10.1101\/2024.06.25.24309247"},{"key":"2090_CR35","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1007\/s11604-024-01619-y","volume":"42","author":"Y Sonoda","year":"2024","unstructured":"Sonoda Y, Kurokawa R, Nakamura Y, Kanzawa J, Kurokawa M, Ohizumi Y, et al. Diagnostic performances of GPT-4o, Claude 3 Opus, and Gemini 1.5 Pro in \u201cDiagnosis Please\u201d cases. Jpn J Radiol. 2024;42:1231\u20135.","journal-title":"Jpn J Radiol"},{"key":"2090_CR36","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1007\/s00330-024-10902-5","volume":"35","author":"D Horiuchi","year":"2025","unstructured":"Horiuchi D, Tatekawa H, Oura T, Shimono T, Walston SL, Takita H, et al. ChatGPT\u2019s diagnostic performance based on textual vs. visual information compared to radiologists\u2019 diagnostic performance in musculoskeletal radiology. Eur Radiol. 2025;35:506\u201316.","journal-title":"Eur Radiol"},{"key":"2090_CR37","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1186\/s40164-024-00537-z","volume":"13","author":"Y Ren","year":"2024","unstructured":"Ren Y, Guo Y, He Q, Cheng Z, Huang Q, Yang L. Exploring whether ChatGPT-4 with image analysis capabilities can diagnose osteosarcoma from X-ray images. Exp Hematol Oncol. 2024;13:71.","journal-title":"Exp Hematol Oncol"},{"key":"2090_CR38","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics14141541","author":"A Wada","year":"2024","unstructured":"Wada A, Akashi T, Shih G, Hagiwara A, Nishizawa M, Hayakawa Y, et al. Optimizing GPT-4 Turbo diagnostic accuracy in neuroradiology through prompt engineering and confidence thresholds. Diagnostics (Basel). 2024. https:\/\/doi.org\/10.3390\/diagnostics14141541.","journal-title":"Diagnostics (Basel)"},{"key":"2090_CR39","doi-asserted-by":"publisher","first-page":"1399","DOI":"10.1007\/s11604-024-01634-z","volume":"42","author":"R Kurokawa","year":"2024","unstructured":"Kurokawa R, Ohizumi Y, Kanzawa J, Kurokawa M, Sonoda Y, Nakamura Y, et al. Diagnostic performances of Claude 3 Opus and Claude 3.5 Sonnet from patient history and key images in Radiology\u2019s \u201cDiagnosis Please\u201d cases. Jpn J Radiol. 2024;42:1399\u2013402.","journal-title":"Jpn J Radiol"},{"key":"2090_CR40","doi-asserted-by":"publisher","first-page":"1938","DOI":"10.1007\/s00330-024-11032-8","volume":"35","author":"Y Mitsuyama","year":"2025","unstructured":"Mitsuyama Y, Tatekawa H, Takita H, Sasaki F, Tashiro A, Oue S, et al. Comparative analysis of GPT-4-based ChatGPT\u2019s diagnostic performance with radiologists using real-world radiology reports of brain tumors. Eur Radiol. 2025;35:1938\u201347.","journal-title":"Eur Radiol"},{"key":"2090_CR41","first-page":"111","volume":"31","author":"YC G\u00fcne\u015f","year":"2025","unstructured":"G\u00fcne\u015f YC, Cesur T, \u00c7amur E, G\u00fcnbey KL. Evaluating text and visual diagnostic capabilities of large language models on questions related to the breast imaging reporting and data system atlas 5 edition. Diagn Interv Radiol. 2025;31:111\u201329.","journal-title":"Diagn Interv Radiol"},{"key":"2090_CR42","doi-asserted-by":"publisher","first-page":"e240609","DOI":"10.1148\/radiol.240609","volume":"313","author":"P Mukherjee","year":"2024","unstructured":"Mukherjee P, Hou B, Suri A, Zhuang Y, Parnell C, Lee N, et al. Evaluation of GPT large language model performance on RSNA 2023 case of the day questions. Radiology. 2024;313:e240609.","journal-title":"Radiology"},{"key":"2090_CR43","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1007\/s12020-024-04066-x","volume":"87","author":"Z Chen","year":"2025","unstructured":"Chen Z, Chambara N, Wu C, Lo X, Liu SYW, Gunda ST, et al. Assessing the feasibility of ChatGPT-4o and Claude 3-Opus in thyroid nodule classification based on ultrasound images. Endocrine. 2025;87:1041\u20139.","journal-title":"Endocrine"},{"key":"2090_CR44","doi-asserted-by":"publisher","first-page":"e232346","DOI":"10.1148\/radiol.232346","volume":"313","author":"SH Sun","year":"2024","unstructured":"Sun SH, Huynh K, Cortes G, Hill R, Tran J, Yeh L, et al. Testing the ability and limitations of ChatGPT to generate differential diagnoses from transcribed radiologic findings. Radiology. 2024;313:e232346.","journal-title":"Radiology"},{"key":"2090_CR45","doi-asserted-by":"publisher","first-page":"1111","DOI":"10.1007\/s00330-024-11115-6","volume":"35","author":"MS Huppertz","year":"2025","unstructured":"Huppertz MS, Siepmann R, Topp D, Nikoubashman O, Y\u00fcksel C, Kuhl CK, et al. Revolution or risk?-Assessing the potential and challenges of GPT-4V in radiologic image interpretation. Eur Radiol. 2025;35:1111\u201321.","journal-title":"Eur Radiol"},{"key":"2090_CR46","doi-asserted-by":"publisher","first-page":"7551","DOI":"10.21037\/qims-24-200","volume":"14","author":"V Sorin","year":"2024","unstructured":"Sorin V, Klang E, Sobeh T, Konen E, Shrot S, Livne A, et al. Generative pre-trained transformer (GPT)-4 support for differential diagnosis in neuroradiology. Quant Imaging Med Surg. 2024;14:7551\u201360.","journal-title":"Quant Imaging Med Surg"},{"key":"2090_CR47","doi-asserted-by":"publisher","first-page":"110335","DOI":"10.1016\/j.clinimag.2024.110335","volume":"117","author":"D Nguyen","year":"2025","unstructured":"Nguyen D, Rao A, Mazumder A, Succi MD. Exploring the accuracy of embedded ChatGPT-4 and ChatGPT-4o in generating BI-RADS scores: a pilot study in radiologic clinical support. Clin Imaging. 2025;117:110335.","journal-title":"Clin Imaging"},{"key":"2090_CR48","first-page":"e72383","volume":"16","author":"Y Asari","year":"2024","unstructured":"Asari Y, Kurokawa R, Sonoda Y, Hagiwara A, Kamohara J, Fukushima T, et al. \u201cThis is a quiz\u201d premise input: a key to unlocking higher diagnostic accuracy in large language models. Cureus. 2024;16:e72383.","journal-title":"Cureus"},{"key":"2090_CR49","doi-asserted-by":"publisher","first-page":"e240955","DOI":"10.1148\/radiol.240955","volume":"313","author":"QD Strotzer","year":"2024","unstructured":"Strotzer QD, Nieberle F, Kupke LS, Napodano G, Muertz AK, Meiler S, et al. Toward foundation models in radiology? Quantitative assessment of GPT-4V\u2019s multimodal and multianatomic region capabilities. Radiology. 2024;313:e240955.","journal-title":"Radiology"},{"key":"2090_CR50","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.urology.2024.11.036","volume":"196","author":"MW Cole","year":"2025","unstructured":"Cole MW, Assani KD, Robinson HS, Wimbiscus M, Launer BM, Chew RJ, et al. Accuracy of a ChatGPT in diagnosing urologic conditions from cross-sectional imaging. Urology. 2025;196:27\u201331.","journal-title":"Urology"},{"key":"2090_CR51","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/s10140-024-02298-y","volume":"32","author":"M Mohammadi","year":"2025","unstructured":"Mohammadi M, Parviz S, Parvaz P, Pirmoradi MM, Afzalimoghaddam M, Mirfazaelian H. Diagnostic performance of ChatGPT in tibial plateau fracture in knee X-ray. Emerg Radiol. 2025;32:59\u201364.","journal-title":"Emerg Radiol"},{"key":"2090_CR52","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1007\/s11604-024-01712-2","volume":"43","author":"Y Sonoda","year":"2025","unstructured":"Sonoda Y, Kurokawa R, Hagiwara A, Asari Y, Fukushima T, Kanzawa J, et al. Structured clinical reasoning prompt enhances LLM\u2019s diagnostic capabilities in diagnosis please quiz cases. Jpn J Radiol. 2025;43:586\u201392.","journal-title":"Jpn J Radiol"},{"key":"2090_CR53","doi-asserted-by":"crossref","unstructured":"Hiredesai AN, Martinez CJ, Anderson ML, Howlett CP, Unadkat KD, Noland SS. Is Artificial Intelligence the Future of Radiology? Accuracy of ChatGPT in Radiologic Diagnosis of Upper Extremity Bony Pathology. Hand (N Y). 2024;15589447241298982.","DOI":"10.1177\/15589447241298982"},{"key":"2090_CR54","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/s12672-025-02005-4","volume":"16","author":"F Pesapane","year":"2025","unstructured":"Pesapane F, Nicosia L, Rotili A, Penco S, Dominelli V, Trentin C, et al. A preliminary investigation into the potential, pitfalls, and limitations of large language models for mammography interpretation. Discov Oncol. 2025;16:233.","journal-title":"Discov Oncol"},{"key":"2090_CR55","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.knee.2025.04.008","volume":"55","author":"MH Temel","year":"2025","unstructured":"Temel MH, Erden Y, Ba\u011fc\u0131er F. Evaluating artificial intelligence performance in medical image analysis: sensitivity, specificity, accuracy, and precision of ChatGPT-4o on Kellgren-Lawrence grading of knee X-ray radiographs. Knee. 2025;55:79\u201384.","journal-title":"Knee"},{"key":"2090_CR56","doi-asserted-by":"publisher","first-page":"1196","DOI":"10.1016\/j.spinee.2024.12.035","volume":"25","author":"X Hu","year":"2025","unstructured":"Hu X, Xu D, Zhang H, Tang M, Gao Q. Comparative diagnostic accuracy of ChatGPT-4 and machine learning in differentiating spinal tuberculosis and spinal tumors. Spine J. 2025;25:1196\u2013205.","journal-title":"Spine J"},{"key":"2090_CR57","doi-asserted-by":"publisher","first-page":"e240689","DOI":"10.1148\/radiol.240689","volume":"314","author":"S Schramm","year":"2025","unstructured":"Schramm S, Preis S, Metz M-C, Jung K, Schmitz-Koep B, Zimmer C, et al. Impact of multimodal prompt elements on diagnostic performance of GPT-4V in challenging brain MRI cases. Radiology. 2025;314:e240689.","journal-title":"Radiology"},{"key":"2090_CR58","doi-asserted-by":"publisher","DOI":"10.3390\/jcm14020571","author":"M Koyun","year":"2025","unstructured":"Koyun M, Taskent I. Evaluation of advanced artificial intelligence algorithms\u2019 diagnostic efficacy in acute ischemic stroke: a comparative analysis of ChatGPT-4o and Claude 3.5 Sonnet models. J Clin Med. 2025. https:\/\/doi.org\/10.3390\/jcm14020571.","journal-title":"J Clin Med"},{"key":"2090_CR59","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics15020143","author":"M Koyun","year":"2025","unstructured":"Koyun M, Cevval ZK, Reis B, Ece B. Detection of intracranial hemorrhage from computed tomography images: diagnostic role and efficacy of ChatGPT-4o. Diagnostics (Basel). 2025. https:\/\/doi.org\/10.3390\/diagnostics15020143.","journal-title":"Diagnostics (Basel)"},{"key":"2090_CR60","doi-asserted-by":"publisher","first-page":"934","DOI":"10.1007\/s11604-025-01743-3","volume":"43","author":"T Fukushima","year":"2025","unstructured":"Fukushima T, Kurokawa R, Hagiwara A, Sonoda Y, Asari Y, Kurokawa M, et al. Influence of prior probability information on large language model performance in radiological diagnosis. Jpn J Radiol. 2025;43:934\u20139.","journal-title":"Jpn J Radiol"},{"key":"2090_CR61","doi-asserted-by":"publisher","first-page":"3608","DOI":"10.1016\/j.acra.2025.01.033","volume":"32","author":"C Ozenbas","year":"2025","unstructured":"Ozenbas C, Engin D, Altinok T, Akcay E, Aktas U, Tabanli A. ChatGPT-4o\u2019s performance in brain tumor diagnosis and MRI findings: a comparative analysis with radiologists. Acad Radiol. 2025;32:3608\u201317.","journal-title":"Acad Radiol"},{"key":"2090_CR62","doi-asserted-by":"publisher","first-page":"1512438","DOI":"10.3389\/frai.2025.1512438","volume":"8","author":"B Wei","year":"2025","unstructured":"Wei B, Zhang X, Shao Y, Sun X, Chen L. Comparison of the accuracy of GPT-4 and resident physicians in differentiating benign and malignant thyroid nodules. Front Artif Intell. 2025;8:1512438.","journal-title":"Front Artif Intell"},{"key":"2090_CR63","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.ajem.2025.03.060","volume":"93","author":"AM Ostrovsky","year":"2025","unstructured":"Ostrovsky AM. Evaluating a large language model\u2019s accuracy in chest X-ray interpretation for acute thoracic conditions. Am J Emerg Med. 2025;93:99\u2013102.","journal-title":"Am J Emerg Med"},{"key":"2090_CR64","doi-asserted-by":"publisher","first-page":"220","DOI":"10.14366\/usg.25012","volume":"44","author":"T Han","year":"2025","unstructured":"Han T, Jeong WK, Shin J. Diagnostic performance of multimodal large language models in radiological quiz cases: the effects of prompt engineering and input conditions. Ultrasonography. 2025;44:220\u201331.","journal-title":"Ultrasonography"},{"key":"2090_CR65","doi-asserted-by":"publisher","unstructured":"Gunes YC, Cesur T. The Diagnostic Performance of Large Language Models and General Radiologists in Thoracic Radiology Cases: A Comparative Study. J Thorac Imaging [Internet]. 2025;40. Available from: https:\/\/doi.org\/10.1097\/RTI.0000000000000805","DOI":"10.1097\/RTI.0000000000000805"},{"key":"2090_CR66","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1016\/j.ajodo.2025.02.017","volume":"168","author":"F Salmanpour","year":"2025","unstructured":"Salmanpour F, Akp\u0131nar M. Performance of Chat Generative Pretrained Transformer-4.0 in determining labiolingual localization of maxillary impacted canine and presence of resorption in incisors through panoramic radiographs: a retrospective study. Am J Orthod Dentofacial Orthop. 2025;168:220\u201331.","journal-title":"Am J Orthod Dentofacial Orthop"},{"key":"2090_CR67","doi-asserted-by":"publisher","unstructured":"OpenAI, Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, et al. GPT-4 Technical Report [Internet]. arXiv [cs.CL]. 2023. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2303.08774","DOI":"10.48550\/ARXIV.2303.08774"},{"key":"2090_CR68","unstructured":"OpenAI. GPT-4V System Card [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/cdn.openai.com\/papers\/GPTV_System_Card.pdf"},{"key":"2090_CR69","unstructured":"OpenAI. GPT-4o System Card [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/cdn.openai.com\/gpt-4o-system-card.pdf"},{"key":"2090_CR70","doi-asserted-by":"publisher","unstructured":"Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, et al. Language Models are Few-Shot Learners [Internet]. arXiv [cs.CL]. 2020. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2005.14165","DOI":"10.48550\/ARXIV.2005.14165"},{"key":"2090_CR71","unstructured":"Model Card Claude 3.5 Sonnet [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/www-cdn.anthropic.com\/fed9cc193a14b84131812372d8d5857f8f304c52\/Model_Card_Claude_3_Addendum.pdf"},{"key":"2090_CR72","unstructured":"The Claude 3 Model Family: Opus, Sonnet, Haiku [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/www-cdn.anthropic.com\/de8ba9b01c9ab7cbabf5c33b80b7bbc618857627\/Model_Card_Claude_3.pdf"},{"key":"2090_CR73","doi-asserted-by":"publisher","unstructured":"Gemini Team, Georgiev P, Lei VI, Burnell R, Bai L, Gulati A, et al. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context [Internet]. arXiv [cs.CL]. 2024. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2403.05530","DOI":"10.48550\/ARXIV.2403.05530"},{"key":"2090_CR74","doi-asserted-by":"publisher","unstructured":"Gemini Team, Anil R, Borgeaud S, Alayrac J-B, Yu J, Soricut R, et al. Gemini: A family of highly capable multimodal models [Internet]. arXiv [cs.CL]. 2023. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2312.11805","DOI":"10.48550\/ARXIV.2312.11805"},{"key":"2090_CR75","doi-asserted-by":"publisher","unstructured":"Grattafiori A, Dubey A, Jauhri A, Pandey A, Kadian A, Al-Dahle A, et al. The Llama 3 herd of models [Internet]. arXiv [cs.AI]. 2024. Available from: https:\/\/doi.org\/10.48550\/ARXIV.2407.21783","DOI":"10.48550\/ARXIV.2407.21783"},{"key":"2090_CR76","unstructured":"Perplexity Models [Internet]. Perplexity. [cited 2025 Oct 12]. Available from: https:\/\/docs.perplexity.ai\/getting-started\/models"},{"key":"2090_CR77","unstructured":"Language Models are Unsupervised Multitask Learners (GPT-2) [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/cdn.openai.com\/better-language-models\/language_models_are_unsupervised_multitask_learners.pdf"},{"key":"2090_CR78","unstructured":"mistralai\/Mistral-Large-Instruct-2407 \u00b7 Hugging Face [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/huggingface.co\/mistralai\/Mistral-Large-Instruct-2407"},{"key":"2090_CR79","unstructured":"Transparency Note for Microsoft Copilot [Internet]. [cited 2025 Oct 12]. Available from: https:\/\/support.microsoft.com\/en-us\/topic\/transparency-note-for-microsoft-copilot-c1541cad-8bb4-410a-954c-07225892dbc2"},{"key":"2090_CR80","doi-asserted-by":"publisher","first-page":"e240528","DOI":"10.1148\/radiol.240528","volume":"315","author":"C Bluethgen","year":"2025","unstructured":"Bluethgen C, Van Veen D, Zakka C, Link KE, Fanous AH, Daneshjou R, et al. Best practices for large language models in radiology. Radiology. 2025;315:e240528.","journal-title":"Radiology"},{"key":"2090_CR81","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1038\/s41591-024-03302-1","volume":"31","author":"R Tanno","year":"2025","unstructured":"Tanno R, Barrett DGT, Sellergren A, Ghaisas S, Dathathri S, See A, et al. Collaboration between clinicians and vision-language models in radiology report generation. Nat Med. 2025;31:599\u2013608.","journal-title":"Nat Med"},{"key":"2090_CR82","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/s42256-024-00807-9","volume":"6","author":"S Pai","year":"2024","unstructured":"Pai S, Bontempi D, Hadzic I, Prudente V, Soka\u010d M, Chaunzwa TL, et al. Foundation model for cancer imaging biomarkers. Nat Mach Intell. 2024;6:354\u201367.","journal-title":"Nat Mach Intell"},{"key":"2090_CR83","doi-asserted-by":"publisher","first-page":"n2281","DOI":"10.1136\/bmj.n2281","volume":"375","author":"CL Andaur Navarro","year":"2021","unstructured":"Andaur Navarro CL, Damen JAA, Takada T, Nijman SWJ, Dhiman P, Ma J, et al. Risk of bias in studies on prediction models developed using supervised machine learning techniques: systematic review. BMJ. 2021;375:n2281.","journal-title":"BMJ"}],"container-title":["Japanese Journal of Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11604-026-02090-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11604-026-02090-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11604-026-02090-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,4]],"date-time":"2026-10-04T20:01:51Z","timestamp":1791144111000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11604-026-02090-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,3]]},"references-count":83,"alternative-id":["2090"],"URL":"https:\/\/doi.org\/10.1007\/s11604-026-02090-7","relation":{},"ISSN":["1867-1071","1867-108X"],"issn-type":[{"value":"1867-1071","type":"print"},{"value":"1867-108X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,3]]},"assertion":[{"value":"11 June 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":1,"name":"Ethics","label":"Conflict of interest","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Ethics approval was not required for this study because it was a systematic review and meta-analysis of previously published data and did not involve any new studies with human participants, human data, or biological material performed by the authors.","order":2,"name":"Ethics","label":"Ethical approval","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Informed consent was not required for this study because it was a systematic review and meta-analysis of previously published data.","order":3,"name":"Ethics","label":"Informed consent","group":{"name":"EthicsHeading","label":"Declarations"}}]}}