{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T22:45:09Z","timestamp":1790117109001,"version":"4.0.1"},"reference-count":21,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T00:00:00Z","timestamp":1747180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008233","name":"School of Medicine, Shanghai Jiao Tong University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100008233","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012543","name":"Shanghai Science and Technology Development Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100012543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014137","name":"Shanghai Shenkang Hospital Development Center","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100014137","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Med."],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>As medical technology advances, physicians' responsibilities in clinical practice continue to increase, with medical history documentation becoming an essential component. Artificial Intelligence (AI) technologies, particularly advances in Natural Language Processing (NLP), have introduced new possibilities for medical documentation. This study aims to evaluate the efficiency and quality of medical history documentation by ChatGPT-4o compared to resident physicians and explore the potential applications of AI in clinical documentation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Using a non-inferiority design, this study compared the documentation time and quality scores between 5 resident physicians from the hematology department (with an average of 2.4 years of clinical experience) and ChatGPT-4o based on identical case materials. Medical history quality was evaluated by two attending physicians with over 10 years of clinical experience using ten case content criteria. Data were analyzed using paired <jats:italic>t-<\/jats:italic>tests and Wilcoxon signed-rank tests, with Kappa coefficients used to assess scoring consistency. Detailed scoring criteria included completeness (coverage of history elements), accuracy (correctness of information), logic (organization and coherence of content), and professionalism (appropriate use of medical terminology and format), each rated on a 10-point scale.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>In terms of medical history quality, ChatGPT-4o achieved an average score of 88.9, while resident physicians scored 89.6, with no statistically significant difference between the two (<jats:italic>p<\/jats:italic> = 0.25). The Kappa coefficient between the two evaluators was 0.82, indicating good consistency in scoring. Non-inferiority testing showed that ChatGPT-4o's quality scores fell within the preset non-inferiority margin (5 points), indicating that its documentation quality was not inferior to that of resident physicians. ChatGPT-4o's average documentation time was 40.1 s, significantly shorter than the resident physicians' average of 14.9 min (<jats:italic>p<\/jats:italic> &amp;lt; 0.001).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>While maintaining quality comparable to resident physicians, ChatGPT-4o significantly reduced the time required for medical history documentation. Despite these positive results, practical considerations such as data preprocessing, data security, and privacy protection must be addressed in real-world applications. Future research should further explore ChatGPT-4o's capabilities in handling complex cases and its applicability across different clinical settings.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fmed.2025.1545730","type":"journal-article","created":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T05:40:25Z","timestamp":1747201225000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Comparison of medical history documentation efficiency and quality based on GPT-4o: a study on the comparison between residents and artificial intelligence"],"prefix":"10.3389","volume":"12","author":[{"given":"Xiaojing","family":"Lu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinqi","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyi","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenye","family":"Gong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiguo","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaun","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyang","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,5,14]]},"reference":[{"key":"B1","first-page":"1877","article-title":"Language models are few-shot learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv Neural Inf Process Sys"},{"key":"B2","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1055\/s-0038-1638592","article-title":"Extracting information from textual documents in the electronic health record: a review of recent research","volume":"2008","author":"Meystre","year":"","journal-title":"Yearb Med Inform"},{"key":"B3","doi-asserted-by":"publisher","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1131","DOI":"10.1001\/jama.2018.12777","article-title":"Prevalence of burnout among physicians: a systematic review","volume":"320","author":"Rotenstein","year":"2018","journal-title":"JAMA."},{"key":"B5","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1136\/svn-2017-000101","article-title":"Artificial intelligence in healthcare: past, present and future","volume":"2","author":"Jiang","year":"2017","journal-title":"Stroke Vasc Neurol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1007\/s10916-023-01961-0","article-title":"ChatGPT Performs on the Chinese National Medical Licensing Examination","volume":"47","author":"Wang","year":"2023","journal-title":"J Med Syst."},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1053\/j.jrn.2024.04.001","article-title":"Evaluating the effectiveness of a generative pretrained transformer-based dietary recommendation system in managing potassium intake for hemodialysis patients","author":"Jin","year":"2024","journal-title":"J Ren Nutr."},{"key":"B8","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","article-title":"AI in health and medicine","volume":"28","author":"Rajpurkar","year":"2022","journal-title":"Nat Med."},{"key":"B9","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"guide to deep learning in healthcare","volume":"25","author":"Esteva","year":"2019","journal-title":"Nat Med."},{"key":"B10","unstructured":"OpenAI\n            \n            \n              \u201cHello\n              GPT-4o\n            \n          \n          \n          2024"},{"key":"B11","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1007\/s00467-024-06486-3","article-title":"Basal knowledge in the field of pediatric nephrology and its enhancement following specific training of ChatGPT-4 \u201comni\u201d and Gemini 1.5 Flash","volume":"40","author":"Mondillo","year":"2024","journal-title":"Pediatr Nephrol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","article-title":"Artificial intelligence in healthcare","volume":"2","author":"Yu","year":"2018","journal-title":"Nat Biomed Eng."},{"key":"B13","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s40290-020-00334-z","article-title":"Optimal use of the non-inferiority trial design","volume":"34","author":"Angeli","year":"2020","journal-title":"Pharmaceut Med."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1357","DOI":"10.1056\/NEJMra1510063","article-title":"Challenges in the design and interpretation of noninferiority trials","volume":"377","author":"Mauri","year":"2017","journal-title":"N Engl J Med."},{"key":"B15","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1186\/1745-6215-12-106","article-title":"Through the looking glass: understanding non-inferiority","volume":"12","author":"Schumi","year":"2011","journal-title":"Trials."},{"key":"B16","doi-asserted-by":"publisher","first-page":"e537","DOI":"10.1136\/bmj.m3164","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension Lancet Digit Health","volume":"2","year":"2020"},{"key":"B17","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.artmed.2008.07.017","article-title":"The coming of age of artificial intelligence in medicine","volume":"46","author":"Patel","year":"2009","journal-title":"Artif Intell Med."},{"key":"B18","doi-asserted-by":"publisher","first-page":"e36671","DOI":"10.1097\/MD.0000000000036671","article-title":"Ethical implications of AI and robotics in healthcare: a review","volume":"102","author":"Elendu","year":"2023","journal-title":"Medicine."},{"key":"B19","doi-asserted-by":"crossref","first-page":"4221","DOI":"10.1007\/s10639-022-11316-w","article-title":"Ethical principles for artificial intelligence in education","volume":"28","author":"Nguyen","year":"2023","journal-title":"Educ Inf Technol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00146-022-01578-w","article-title":"AI ethics with Chinese characteristics? Concerns and preferred solutions in Chinese academia","volume":"17","author":"Zhu","year":"2022","journal-title":"AI Soc."},{"key":"B21","doi-asserted-by":"publisher","first-page":"e047709","DOI":"10.1136\/bmjopen-2020-047709","article-title":"Developing a reporting guideline for artificial intelligence-centred diagnostic test accuracy studies: the STARD-AI protocol","volume":"11","author":"Sounderajah","year":"2021","journal-title":"BMJ Open."}],"container-title":["Frontiers in Medicine"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2025.1545730\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T05:40:27Z","timestamp":1747201227000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2025.1545730\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,14]]},"references-count":21,"alternative-id":["10.3389\/fmed.2025.1545730"],"URL":"https:\/\/doi.org\/10.3389\/fmed.2025.1545730","relation":{},"ISSN":["2296-858X"],"issn-type":[{"value":"2296-858X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,14]]},"article-number":"1545730"}}