{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T20:11:21Z","timestamp":1792267881801,"version":"4.4.0"},"reference-count":21,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Recent advances in large language models (LLMs) such as GPT-3\/4 have spurred the development of artificial intelligence (AI) chatbots and advisory tools in medicine. These systems are posited to assist or augment physician-patient communication, potentially improving empathy, clarity, and responsiveness. However, their actual impact on communication outcomes remains uncertain.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to systematically review and meta-analyze peer-reviewed studies (2020\u20102025) evaluating how LLM-based interventions affect physician-patient communication, including empathy, clarity, trust, and patient understanding.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines, we searched PubMed\/MEDLINE, Embase, Scopus, and Web of Science for studies published from 2020 to 2025 examining LLM or chatbot applications in clinical communication contexts. Eligible designs included randomized, observational, cross-sectional, and qualitative studies. Two reviewers (WHP and SR) independently screened titles or abstracts, assessed full texts, and extracted data on study design, population, LLM type, communication measures, and outcomes. We conducted a qualitative synthesis and random-effects meta-analysis, reporting pooled standardized mean differences or odds ratios with 95% CIs.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n From 312 records, 10 studies were included, all quantitative and predominantly cross-sectional. Populations ranged from patients with chronic conditions to health care professionals and laypersons. Outcomes assessed included empathy (8 studies), clarity or information quality (6 studies), satisfaction or usefulness (4 studies), and trust perceptions (2 studies). In 6 direct comparisons of AI- versus physician-generated responses, LLMs were rated significantly higher in empathy in 5 studies. One large study found that chatbot replies were judged empathetic in 45.1% of cases versus 4.6% for physician replies (odds ratio approximately 9.8,\n P<\/jats:italic>\n <.001). Similarly, ChatGPT-4 answers scored higher in empathy on a 5-point scale than human-written responses (mean 4.18 vs 2.70,\n P<\/jats:italic>\n <.001). One neurology study showed higher empathy scores (Consultation and Relational Empathy Scale +1.38,\n P<\/jats:italic>\n <.01) for ChatGPT answers. Only 1 study found no significant empathy difference. LLM content was also longer and more information-rich, improving patient-perceived clarity and understanding. On the other hand, GPT-4 simplified pathology reports, increasing patient comprehension scores (7.98 vs 5.23\/10,\n P<\/jats:italic>\n <.001) and reducing consultation time by 70%. However, AI replies were sometimes less concise or less readable for low-literacy patients. In pooled analyses (\n k<\/jats:italic>\n =4 studies; total evaluations N=2604), LLM assistance showed a large positive effect on empathy (standardized mean difference 1.02, 95% CI 0.44\u20101.60; random-effects model). Patient satisfaction results were mixed. No study directly assessed long-term trust.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Current evidence suggests that LLM-based chatbots can enhance physician-patient communication by producing more empathetic, detailed, and understandable responses. These improvements may positively influence patient experience and engagement. However, LLMs may also generate overly lengthy or occasionally inaccurate advice, emphasizing the need for physician oversight. While meta-analytic findings are promising, robust randomized controlled trials, real-world and longitudinal studies are needed to confirm benefits, assess trust outcomes, and define optimal clinical integration strategies.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/77307","type":"journal-article","created":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:50:07Z","timestamp":1772045407000},"page":"e77307-e77307","source":"Crossref","is-referenced-by-count":2,"title":["Impact of Large Language Model\u2013Based AI Tools on Physician-Patient Communication: Systematic Review and Meta-Analysis"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1648-5754","authenticated-orcid":false,"given":"Sven","family":"Richter","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8230-1064","authenticated-orcid":false,"given":"Clara Helene","family":"Buszello","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9888-1380","authenticated-orcid":false,"given":"Markus","family":"Prem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8993-7720","authenticated-orcid":false,"given":"Sophia","family":"Willkommen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0560-6741","authenticated-orcid":false,"given":"Elida","family":"Hasani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8196-604X","authenticated-orcid":false,"given":"Ortrud","family":"Uckermann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2236-6719","authenticated-orcid":false,"given":"Tareq A","family":"Juratli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8185-7764","authenticated-orcid":false,"given":"Ilker Y","family":"Ey\u00fcpoglu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9214-150X","authenticated-orcid":false,"given":"Witold H","family":"Polanski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,7,31]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.pec.2008.11.015","article-title":"How does communication heal? pathways linking clinician-patient communication to health outcomes","volume":"74","author":"Street","journal-title":"Patient Educ Couns"},{"issue":"606","key":"R2","doi-asserted-by":"publisher","first-page":"e76","DOI":"10.3399\/bjgp13X660814","article-title":"Effectiveness of empathy in general practice: a systematic review","volume":"63","author":"Derksen","journal-title":"Br J Gen Pract"},{"issue":"7","key":"R3","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1016\/j.mayocp.2016.05.007","article-title":"Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction","volume":"91","author":"Shanafelt","journal-title":"Mayo Clin Proc"},{"issue":"3","key":"R4","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1093\/jamia\/ocab268","article-title":"Assessing the impact of the COVID-19 pandemic on clinician ambulatory electronic health record use","volume":"29","author":"Holmgren","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"R5","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.12638","article-title":"An exploration of barriers, facilitators, and suggestions for improving electronic health record inbox-related usability: a qualitative analysis","volume":"2","author":"Murphy","journal-title":"JAMA Netw Open"},{"issue":"3","key":"R6","doi-asserted-by":"publisher","first-page":"e107","DOI":"10.1016\/S2589-7500(23)00021-3","article-title":"ChatGPT: the future of discharge summaries","volume":"5","author":"Patel","journal-title":"Lancet Digit Health"},{"key":"R7","unstructured":"GPT-4 technical report. OpenAI. 2023. URL: https:\/\/openai.com\/research\/gpt-4 [Accessed 07-05-2026]"},{"issue":"6","key":"R8","doi-asserted-by":"publisher","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"The utility of ChatGPT as an example of large language models in healthcare education, research and practice: systematic review on the future perspectives and challenges","volume":"11","author":"Sallam","journal-title":"Healthcare (Basel)"},{"issue":"6","key":"R9","doi-asserted-by":"publisher","first-page":"2534","DOI":"10.1016\/j.jseint.2023.07.018","article-title":"Breaking barriers: can ChatGPT compete with a shoulder and elbow specialist in diagnosis and management?","volume":"7","author":"Daher","journal-title":"JSES Int"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/58831","article-title":"\u201cDoctor ChatGPT, Can You Help Me?\u201d the patient\u2019s perspective: cross-sectional study","volume":"26","author":"Armbruster","journal-title":"J Med Internet Res"},{"issue":"6","key":"R11","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum","volume":"183","author":"Ayers","journal-title":"JAMA Intern Med"},{"issue":"10","key":"R12","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.22399","article-title":"Large language model\u2013based responses to patients\u2019 in-basket messages: a cross-sectional quality improvement study","volume":"7","author":"Small","journal-title":"JAMA Netw Open"},{"issue":"2","key":"R13","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.57879","article-title":"Large language models for chatbot health advice studies: a systematic review","volume":"8","author":"Huo","journal-title":"JAMA Netw Open"},{"issue":"7","key":"R14","doi-asserted-by":"publisher","first-page":"4057","DOI":"10.1007\/s00415-024-12328-x","article-title":"ChatGPT vs. neurologists: a cross-sectional study investigating preference, satisfaction ratings and perceived empathy in responses among people living with multiple sclerosis","volume":"271","author":"Maida","journal-title":"J Neurol"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/54706","article-title":"Physician versus large language model chatbot responses to web-based questions from autistic patients in Chinese: cross-sectional comparative analysis","volume":"26","author":"He","journal-title":"J Med Internet Res"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1002\/capr.12832","article-title":"Comparing perceived empathy and intervention strategies of an AI chatbot and human psychotherapists in online mental health support","volume":"25","author":"Yonatan\u2010Leus","journal-title":"Couns and Psychother Res"},{"issue":"10","key":"R17","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.38535","article-title":"Perspectives on artificial intelligence\u2013generated responses to patient messages: cross-sectional study of satisfaction and quality","volume":"7","author":"Kim","journal-title":"JAMA Netw Open"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/46879","article-title":"Ability of ChatGPT to replace doctors in patient education: cross-sectional comparative analysis of inflammatory bowel disease","volume":"27","author":"Yan","journal-title":"J Med Internet Res"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","DOI":"10.1038\/s44271-024-00182-6","article-title":"Third-party evaluators perceive AI as more compassionate than expert humans","volume":"3","author":"Ovsyannikova","journal-title":"Commun Psychol"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-024-02838-z","article-title":"Enhancing doctor-patient communication using large language models for pathology report interpretation","volume":"25","author":"Yang","journal-title":"BMC Med Inform Decis Mak"},{"issue":"15","key":"R21","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare12151548","article-title":"The potential impact of large language models on doctor-patient communication: a case study in prostate cancer","volume":"12","author":"Geant\u0103","journal-title":"Healthcare (Basel)"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T19:48:49Z","timestamp":1785527329000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e77307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,31]]},"references-count":21,"URL":"https:\/\/doi.org\/10.2196\/77307","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,31]]},"article-number":"v28i3e77307"}}