{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T09:45:16Z","timestamp":1778060716179,"version":"3.51.4"},"reference-count":24,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T00:00:00Z","timestamp":1773014400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Large language models (LLMs) have shown growing potential for medical education and assessment, but evidence on their performance in specialty certification exams in China\u2014particularly in ultrasound medicine\u2014remains limited.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To compare the performance of ChatGPT-5 and DeepSeek on the Chinese Ultrasound Medicine Senior Professional Title Examination, overall and by item type.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      Between August and September 2025, we randomly selected 100 multiple-choice questions from the official Chinese Ultrasound Medicine Senior Professional Title Examination bank (60 image-based interpretation items and 40 text-based items). We evaluated ChatGPT-5 and DeepSeek using identical prompts through their public web interfaces. The primary outcome was overall accuracy; secondary outcomes were accuracy by item type and subspecialty. Between-model differences were assessed using two-proportion\n                      <jats:italic>z<\/jats:italic>\n                      -tests (\n                      <jats:italic>\u03b1<\/jats:italic>\n                      \u2009=\u20090.05) in Python 3.12.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Overall accuracy was higher for ChatGPT-5 than for DeepSeek [74.0% (74\/100) vs. 60.0% (60\/100);\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.035]. Accuracy on image-based items was also higher for ChatGPT-5 (61.7% vs. 40.0%;\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.018). Performance on text-based items was similar for both models (92.5% vs. 90.0%). Subspecialty patterns varied across domains; however, no between-model differences reached statistical significance.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT-5 outperformed DeepSeek on image-based items (61.7% vs. 40.0%), while both models performed similarly on text-based knowledge items (92.5% vs. 90.0%). Overall, both LLMs showed strong performance on Chinese ultrasound senior-title examination questions, with complementary strengths across content areas. They may be useful as supplementary educational tools, but further advances in multimodal reasoning are needed to support more reliable image interpretation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fdgth.2026.1783347","type":"journal-article","created":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T06:46:54Z","timestamp":1773038814000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Comparative performance of ChatGPT-5 and DeepSeek on the Chinese ultrasound medicine senior professional title examination"],"prefix":"10.3389","volume":"8","author":[{"given":"Dao-Rong","family":"Hong","sequence":"first","affiliation":[{"name":"Department of Ultrasonography, The Second Affiliated Hospital of Fujian Medical University","place":["Quanzhou, Fujian, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chun-Yan","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of General Practice, The Second Affiliated Hospital of Fujian Medical University","place":["Quanzhou, Fujian, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiu","family":"Gao","sequence":"additional","affiliation":[{"name":"Department of General Practice, The Second Affiliated Hospital of Fujian Medical University","place":["Quanzhou, Fujian, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"e271","DOI":"10.1016\/S2589-7500(19)30123-2","article-title":"A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis","volume":"1","author":"Liu","year":"2019","journal-title":"Lancet Digit Health"},{"key":"B2","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41746-021-00438-z","article-title":"Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis","volume":"4","author":"Aggarwal","year":"2021","journal-title":"NPJ Digit Med"},{"key":"B3","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1109\/JPROC.2021.3054390","article-title":"A review of deep learning in medical imaging: imaging traits, technology trends, case studies with progress highlights, and future promises","volume":"109","author":"Zhou","year":"2021","journal-title":"Proc IEEE Inst Electr Electron Eng"},{"key":"B4","doi-asserted-by":"publisher","first-page":"344","DOI":"10.3348\/kjr.2019.0851","article-title":"Development of a malignancy potential binary prediction model based on deep learning for the mitotic count of local primary gastrointestinal stromal tumors","volume":"22","author":"Yang","year":"2021","journal-title":"Korean J Radiol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"401","DOI":"10.3343\/alm.2023.43.5.401","article-title":"Artificial intelligence in point-of-care testing","volume":"43","author":"Khan","year":"2023","journal-title":"Ann Lab Med"},{"key":"B6","doi-asserted-by":"publisher","first-page":"108793","DOI":"10.1016\/j.surg.2024.08.026","article-title":"Performance of trauma-trained large language models on surgical assessment questions: a new approach in resource identification","volume":"179","author":"Mahajan","year":"2025","journal-title":"Surgery"},{"key":"B7","doi-asserted-by":"publisher","first-page":"17562848231218618","DOI":"10.1177\/17562848231218618","article-title":"Evaluating the role of ChatGPT in gastroenterology: a comprehensive systematic review of applications, benefits, and limitations","volume":"16","author":"Klang","year":"2023","journal-title":"Therap Adv Gastroenterol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"e55991","DOI":"10.7759\/cureus.55991","article-title":"Comparing the performance of popular large language models on the national board of medical examiners sample questions","volume":"16","author":"Abbas","year":"2024","journal-title":"Cureus"},{"key":"B9","doi-asserted-by":"publisher","first-page":"105673","DOI":"10.1016\/j.ijmedinf.2024.105673","article-title":"Evaluating the effectiveness of advanced large language models in medical knowledge: a comparative study using Japanese national medical examination","volume":"193","author":"Liu","year":"2025","journal-title":"Int J Med Inform"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1296615","DOI":"10.3389\/fmed.2023.1296615","article-title":"ChatGPT\u2019s performance in German OB\/GYN exams\u2014paving the way for AI-enhanced medical education and clinical practice","volume":"10","author":"Riedel","year":"2023","journal-title":"Front Med (Lausanne)"},{"key":"B11","doi-asserted-by":"publisher","first-page":"e48659","DOI":"10.2196\/48659","article-title":"Assessing the utility of ChatGPT throughout the entire clinical workflow: development and usability study","volume":"25","author":"Rao","year":"2023","journal-title":"J Med Internet Res"},{"key":"B12","doi-asserted-by":"publisher","first-page":"e0324841","DOI":"10.1371\/journal.pone.0324841","article-title":"Advancing medical AI: gPT-4 and GPT-4o surpass GPT-3.5 in Taiwanese medical licensing exams","volume":"20","author":"Wu","year":"2025","journal-title":"PLoS One"},{"key":"B13","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1007\/s00417-024-06625-4","article-title":"Gemini AI vs. ChatGPT: a comprehensive examination alongside ophthalmology residents in medical knowledge","volume":"263","author":"Bahir","year":"2025","journal-title":"Graefes Arch Clin Exp Ophthalmol"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e46482","DOI":"10.2196\/46482","article-title":"Artificial intelligence in medical education: comparative analysis of ChatGPT, bing, and medical students in Germany","volume":"9","author":"Roos","year":"2023","journal-title":"JMIR Med Educ"},{"key":"B15","doi-asserted-by":"publisher","first-page":"e90212","DOI":"10.7759\/cureus.90212","article-title":"Comparing artificial intelligence large language models in medical training: a performance analysis of ChatGPT and DeepSeek on United States medical licensing examination (USMLE) style questions","volume":"17","author":"Zhang","year":"2025","journal-title":"Cureus"},{"key":"B16","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1186\/s12909-023-04752-w","article-title":"Advantages and pitfalls in utilizing artificial intelligence for crafting medical examinations: a medical education pilot study with GPT-4","volume":"23","author":"E","year":"2023","journal-title":"BMC Med Educ"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1192","DOI":"10.1186\/s12909-025-07752-0","article-title":"The performance of ChatGPT on medical image-based assessments and implications for medical education","volume":"25","author":"Yang","year":"2025","journal-title":"BMC Med Educ"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2895","DOI":"10.1007\/s13555-023-01031-w","article-title":"Public perceptions, factors, and incentives influencing patient willingness to share clinical images for artificial intelligence-based healthcare tools","volume":"13","author":"Ly","year":"2023","journal-title":"Dermatol Ther (Heidelb)"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1645","DOI":"10.1016\/j.jsurg.2024.08.002","article-title":"Artificial intelligence in orthopaedics: performance of ChatGPT on text and image questions on a complete AAOS orthopaedic in-training examination (OITE)","volume":"81","author":"Hayes","year":"2024","journal-title":"J Surg Educ"},{"key":"B20","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1016\/j.acra.2024.08.009","article-title":"Evaluating artificial intelligence competency in education: performance of ChatGPT-4 in the American registry of radiologic technologists (ARRT) radiography certification exam","volume":"32","author":"Al-Naser","year":"2025","journal-title":"Acad Radiol"},{"key":"B21","doi-asserted-by":"publisher","first-page":"e69313","DOI":"10.2196\/69313","article-title":"Role of artificial intelligence in surgical training by assessing GPT-4 and GPT-4o on the Japan surgical board examination with text-only and image-accompanied questions: performance evaluation study","volume":"11","author":"Maruyama","year":"2025","journal-title":"JMIR Med Educ"},{"key":"B22","doi-asserted-by":"publisher","first-page":"531","DOI":"10.15537\/smj.2024.45.5.20240141","article-title":"Role of artificial intelligence (google bard) in morphological, histopathological, and radiological image identifications: objective structured practical examination (OSPE) type-based performance","volume":"45","author":"Meo","year":"2024","journal-title":"Saudi Med J"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e23287","DOI":"10.2196\/23287","article-title":"Current implementation outcomes of digital surgical simulation in low- and middle-income countries: scoping review","volume":"9","author":"Mahajan","year":"2023","journal-title":"JMIR Med Educ"},{"key":"B24","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1016\/S1474-4422(25)00266-2","article-title":"Rethinking AI trials in brain health","volume":"24","author":"Mahajan","year":"2025","journal-title":"Lancet Neurol"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2026.1783347\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T06:46:55Z","timestamp":1773038815000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2026.1783347\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,9]]},"references-count":24,"alternative-id":["10.3389\/fdgth.2026.1783347"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2026.1783347","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,9]]},"article-number":"1783347"}}