{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T16:14:43Z","timestamp":1792512883473,"version":"4.5.0"},"reference-count":18,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T00:00:00Z","timestamp":1766534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background\/Objectives: Large Language Models (LLMs), including ChatGPT-4 and Gemini, are increasingly incorporated into clinical care; however, their reliability within maternal\u2013fetal medicine (MFM), a high-risk field in which diagnostic and management errors may affect both the pregnant patient and the fetus, remains uncertain. Evaluating the alignment of AI-generated case management recommendations with those of MFM specialists, emphasizing accuracy, agreement, and clinical relevancy. Study Design and Setting: Cross-sectional study with blinded online evaluation (November\u2013December 2024); evaluators were blinded to responder identity (AI vs. human), and case order and response labels were randomized for each evaluator using a computer-generated sequence to reduce order and identification bias. Methods: Twenty hypothetical MFM cases were constructed, allowing standardized presentation of complex scenarios without patient-identifiable data and enabling consistent comparison of AI-generated and human specialist recommendations. Responses were generated by ChatGPT-4, Gemini, and three MFM specialists, then assessed by 22 blinded board-certified MFM evaluators using a 10-point Likert scale. Agreement was measured with Spearman\u2019s rho (\u03c1) and Cohen\u2019s (\u03ba); accuracy differences were measured with Wilcoxon signed-rank tests. Results: ChatGPT-4 exhibited moderate alignment (mean 6.6 \u00b1 2.95; \u03c1 = 0.408; \u03ba = 0.232, p &lt; 0.001), performing well in routine, guideline-driven scenarios (e.g., term oligohydramnios, well-controlled gestational hypertension, GDMA1). Gemini scored 7.0 \u00b1 2.64, demonstrating effectively no consistent inter-rater agreement (\u03ba = \u22120.024, p = 0.352), indicating that although mean scores were slightly higher, evaluators varied widely in how they judged individual Gemini responses. No significant difference was found between ChatGPT-4 and clinicians in median accuracy scores (Wilcoxon p = 0.18), while Gemini showed significantly lower accuracy (p &lt; 0.01). Model performance varied primarily by case complexity: agreement was higher in straightforward, guideline-based scenarios and more variable in complex cases, whereas no consistent pattern was observed by gestational age or specific clinical domain across the 20 cases. Conclusions: AI shows promise in routine MFM decision-making but remains constrained in complex cases, where models sometimes under-prioritize maternal\u2013fetal risk trade-offs or incompletely address alternative management pathways, warranting cautious integration into clinical practice. Generalizability is limited by the small number of simulated cases and the use of hypothetical vignettes rather than real-world clinical encounters.<\/jats:p>","DOI":"10.3390\/jcm15010117","type":"journal-article","created":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T09:58:34Z","timestamp":1766570314000},"page":"117","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["AI Decision-Making Performance in Maternal\u2013Fetal Medicine: Comparison of ChatGPT-4, Gemini, and Human Specialists in a Cross-Sectional Case-Based Study"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7627-0410","authenticated-orcid":false,"given":"Matan","family":"Friedman","sequence":"first","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8929-9419","authenticated-orcid":false,"given":"Amit","family":"Slouk","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Noa","family":"Gonen","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Guzy","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4275-1780","authenticated-orcid":false,"given":"Yael","family":"Ganor Paz","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kira","family":"Nahum Sacks","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5261-9277","authenticated-orcid":false,"given":"Amihai","family":"Rottenstreich","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eran","family":"Weiner","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2731-6553","authenticated-orcid":false,"given":"Ohad","family":"Gluck","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0784-3388","authenticated-orcid":false,"given":"Ilia","family":"Kleiner","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, E. Wolfson Medical Center, Holon 5822012, Israel"},{"name":"Gray Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv 6997801, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1308\/147870804290","article-title":"Artificial intelligence in medicine","volume":"86","author":"Holmes","year":"2004","journal-title":"Ann. R. Coll. Surg. Engl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e50442","DOI":"10.2196\/50442","article-title":"Assessment of ChatGPT-3.5\u2019s Knowledge in Oncology: Comparative Study with ASCO-SEP Benchmarks","volume":"3","author":"Odabashian","year":"2024","journal-title":"JMIR AI"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e45312","DOI":"10.2196\/45312","article-title":"How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment","volume":"9","author":"Gilson","year":"2023","journal-title":"JMIR Med. Educ."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lytinen, S.L. (2005). Artificial intelligence: Natural language processing. Van Nostrand\u2019s Sci. Encycl.","DOI":"10.1002\/0471743984.vse0672"},{"key":"ref_5","unstructured":"Topol, E. (2019). Deep Medicine: How Artificial Intelligence can Make Healthcare Human Again, Hachette."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"101477","DOI":"10.1016\/j.gore.2024.101477","article-title":"The doc versus the bot: A pilot study to assess the quality and accuracy of physician and chatbot responses to clinical questions in gynecologic oncology","volume":"55","author":"Anastasio","year":"2024","journal-title":"Gynecol. Oncol. Rep."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.ajog.2023.03.009","article-title":"The exciting potential for ChatGPT in obstetrics and gynecology","volume":"228","author":"Chervenak","year":"2023","journal-title":"Am. J. Obstet. Gynecol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.53430\/ijbpru.2024.3.2.0024","article-title":"Harnessing big data for tailored health communication: A systematic review of impact and techniques","volume":"3","author":"Adegoke","year":"2024","journal-title":"Int. J. Biol. Pharm. Res. Updates"},{"key":"ref_9","first-page":"19","article-title":"Applications of artificial intelligence for health informatics: A systematic review","volume":"4","author":"Hasan","year":"2023","journal-title":"J. Artif. Intell. Med. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.63593\/JIMR.2788-7022.2025.06.001","article-title":"Artificial Intelligence in Clinical Medicine: A SWOT Analysis of AI Progress in Diagnostics, Therapeutics, and Safety","volume":"4","author":"Sallam","year":"2025","journal-title":"J. Innov. Med. Res."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11.","DOI":"10.3390\/healthcare11060887"},{"key":"ref_12","first-page":"e230163","article-title":"ChatGPT and other large language models are double-edged swords","volume":"307","author":"Shen","year":"2023","journal-title":"Radiol. Soc. North Am."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e2336483","DOI":"10.1001\/jamanetworkopen.2023.36483","article-title":"Accuracy and reliability of chatbot responses to physician questions","volume":"6","author":"Goodman","year":"2023","journal-title":"JAMA Netw. Open"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum","volume":"183","author":"Ayers","year":"2023","journal-title":"JAMA Intern. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1038\/s41591-024-03423-7","article-title":"Toward expert-level medical question answering with large language models","volume":"31","author":"Singhal","year":"2025","journal-title":"Nat. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1038\/s41746-024-01079-8","article-title":"A critical assessment of using ChatGPT for extracting structured data from clinical notes","volume":"7","author":"Huang","year":"2024","journal-title":"npj Digit. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"9330","DOI":"10.1038\/s41598-024-58760-x","article-title":"Assessing ChatGPT 4.0\u2019s test performance and clinical diagnostic accuracy on USMLE STEP 2 CK and clinical case reports","volume":"14","author":"Shieh","year":"2024","journal-title":"Sci. Rep."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/1\/117\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T10:18:05Z","timestamp":1766571485000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/1\/117"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,24]]},"references-count":18,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["jcm15010117"],"URL":"https:\/\/doi.org\/10.3390\/jcm15010117","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,24]]}}}