{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T03:03:48Z","timestamp":1793156628021,"version":"4.5.0"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Med"],"published-print":{"date-parts":[[2025,1]]},"DOI":"10.1038\/s41591-024-03328-5","type":"journal-article","created":{"date-parts":[[2025,1,2]],"date-time":"2025-01-02T05:01:39Z","timestamp":1735794099000},"page":"77-86","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":217,"title":["An evaluation framework for clinical use of large language models in patient interaction tasks"],"prefix":"10.1038","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2388-3913","authenticated-orcid":false,"given":"Shreya","family":"Johri","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaehwan","family":"Jeong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin A.","family":"Tran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5736-8891","authenticated-orcid":false,"given":"Daniel I.","family":"Schlessinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shannon","family":"Wongvibulsin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leandra A.","family":"Barnes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1256-7050","authenticated-orcid":false,"given":"Hong-Yu","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhuo Ran","family":"Cai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0201-4444","authenticated-orcid":false,"given":"Eliezer M.","family":"Van Allen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0151-5121","authenticated-orcid":false,"given":"David","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7988-9356","authenticated-orcid":false,"given":"Roxana","family":"Daneshjou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8030-3727","authenticated-orcid":false,"given":"Pranav","family":"Rajpurkar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,1,2]]},"reference":[{"key":"3328_CR1","doi-asserted-by":"publisher","first-page":"1300","DOI":"10.2105\/AJPH.2004.059402","volume":"96","author":"KE Lasser","year":"2011","unstructured":"Lasser, K. E., Himmelstein, D. U. & Woolhandler, S. Access to care, health status, and health disparities in the United States and Canada: results of a cross-national population-based survey. Am. J. Public Health 96, 1300\u20131307 (2011).","journal-title":"Am. J. Public Health"},{"key":"3328_CR2","doi-asserted-by":"publisher","first-page":"e017902","DOI":"10.1136\/bmjopen-2017-017902","volume":"7","author":"G Irving","year":"2017","unstructured":"Irving, G. et al. International variations in primary care physician consultation time: a systematic review of 67 countries. BMJ Open 7, e017902 (2017).","journal-title":"BMJ Open"},{"key":"3328_CR3","doi-asserted-by":"publisher","first-page":"23","DOI":"10.7861\/futurehosp.4-1-23","volume":"4","author":"JLC Wong","year":"2017","unstructured":"Wong, J. L. C., Vincent, R. C. & Al-Sharqi, A. Dermatology consultations: how long do they take? Future Hosp. J. 4, 23\u201326 (2017).","journal-title":"Future Hosp. J."},{"key":"3328_CR4","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1016\/j.pop.2022.04.002","volume":"49","author":"J Shaver","year":"2022","unstructured":"Shaver, J. The state of telehealth before and after the COVID-19 pandemic. Prim. Care 49, 517\u2013530 (2022).","journal-title":"Prim. Care"},{"key":"3328_CR5","doi-asserted-by":"publisher","unstructured":"Bubeck, S. et al. Sparks of artificial general intelligence: early experiments with GPT-4. https:\/\/doi.org\/10.48550\/arXiv.2303.12712 (2023).","DOI":"10.48550\/arXiv.2303.12712"},{"key":"3328_CR6","doi-asserted-by":"publisher","unstructured":"Nori, H., King, N., McKinney, S. M., Carignan, D. & Horvitz, E. Capabilities of GPT-4 on medical challenge problems. https:\/\/doi.org\/10.48550\/arXiv.2303.13375 (2023).","DOI":"10.48550\/arXiv.2303.13375"},{"key":"3328_CR7","doi-asserted-by":"crossref","unstructured":"Singhal, K. et al. Large language models encode clinical knowledge. Nature 620, 172\u2013180 (2023).","DOI":"10.1038\/s41586-023-06291-2"},{"key":"3328_CR8","doi-asserted-by":"publisher","first-page":"842","DOI":"10.1001\/jama.2023.1044","volume":"329","author":"A Sarraju","year":"2023","unstructured":"Sarraju, A. et al. Appropriateness of cardiovascular disease prevention recommendations obtained from a popular online chat-based artificial intelligence model. JAMA 329, 842\u2013844 (2023).","journal-title":"JAMA"},{"key":"3328_CR9","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"3328_CR10","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","volume":"388","author":"P Lee","year":"2023","unstructured":"Lee, P., Bubeck, S. & Petro, J. Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine. N. Engl. J. Med. 388, 1233\u20131239 (2023).","journal-title":"N. Engl. J. Med."},{"key":"3328_CR11","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","volume":"616","author":"M Moor","year":"2023","unstructured":"Moor, M. et al. Foundation models for generalist medical artificial intelligence. Nature 616, 259\u2013265 (2023).","journal-title":"Nature"},{"key":"3328_CR12","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","volume":"183","author":"JW Ayers","year":"2023","unstructured":"Ayers, J. W. et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. 183, 589\u2013596 (2023).","journal-title":"JAMA Intern. Med."},{"key":"3328_CR13","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2023.1161098","volume":"5","author":"J Au Yeung","year":"2023","unstructured":"Au Yeung, J. et al. AI chatbots not yet ready for clinical use. Front. Digit. Health 5, 1161098 (2023).","journal-title":"Front. Digit. Health"},{"key":"3328_CR14","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1038\/s41746-023-00879-8","volume":"6","author":"M Wornow","year":"2023","unstructured":"Wornow, M. et al. The shaky foundations of large language models and foundation models for electronic health records. NPJ Digit. Med. 6, 135 (2023).","journal-title":"NPJ Digit. Med."},{"key":"3328_CR15","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1001\/jama.2023.14217","volume":"330","author":"NH Shah","year":"2023","unstructured":"Shah, N. H., Entwistle, D. & Pfeffer, M. A. Creation and adoption of large language models in medicine. JAMA 330, 866\u2013869 (2023).","journal-title":"JAMA"},{"key":"3328_CR16","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.1227\/neu.0000000000002551","volume":"93","author":"R Ali","year":"2023","unstructured":"Ali, R. et al. Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank. Neurosurgery 93, 1090\u20131098 (2023).","journal-title":"Neurosurgery"},{"key":"3328_CR17","doi-asserted-by":"publisher","first-page":"109732","DOI":"10.1016\/j.resuscitation.2023.109732","volume":"185","author":"N Fija\u010dko","year":"2023","unstructured":"Fija\u010dko, N., Gosak, L., \u0160tiglic, G., Picard, C. T. & John Douma, M. Can ChatGPT pass the life support exams without entering the American Heart Association course? Resuscitation 185, 109732 (2023).","journal-title":"Resuscitation"},{"key":"3328_CR18","doi-asserted-by":"publisher","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","volume":"2","author":"TH Kung","year":"2023","unstructured":"Kung, T. H. et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS Digit. Health 2, e0000198 (2023).","journal-title":"PLoS Digit. Health"},{"key":"3328_CR19","doi-asserted-by":"publisher","unstructured":"Han, T. et al. MedAlpaca\u2014an open-source collection of medical conversational AI models and training data. https:\/\/doi.org\/10.48550\/arXiv.2304.08247 (2023).","DOI":"10.48550\/arXiv.2304.08247"},{"key":"3328_CR20","doi-asserted-by":"publisher","first-page":"1028","DOI":"10.1001\/jamainternmed.2023.2909","volume":"183","author":"E Strong","year":"2023","unstructured":"Strong, E. et al. Chatbot vs medical student performance on free-response clinical reasoning examinations. JAMA Intern. Med. 183, 1028\u20131030 (2023).","journal-title":"JAMA Intern. Med."},{"key":"3328_CR21","doi-asserted-by":"publisher","unstructured":"Nair, V., Schumacher, E., Tso, G. & Kannan, A. DERA: enhancing large language model completions with dialog-enabled resolving agents. https:\/\/doi.org\/10.48550\/arXiv.2303.17071 (2023).","DOI":"10.48550\/arXiv.2303.17071"},{"key":"3328_CR22","doi-asserted-by":"publisher","unstructured":"OpenAI et al. GPT-4 technical report. https:\/\/doi.org\/10.48550\/arXiv.2303.08774 (2023).","DOI":"10.48550\/arXiv.2303.08774"},{"key":"3328_CR23","doi-asserted-by":"publisher","unstructured":"Brown, T. B. et al. Language models are few-shot learners. https:\/\/doi.org\/10.48550\/arXiv.2005.14165 (2020).","DOI":"10.48550\/arXiv.2005.14165"},{"key":"3328_CR24","doi-asserted-by":"publisher","unstructured":"Jiang, A. Q. et al. Mistral 7B. https:\/\/doi.org\/10.48550\/arXiv.2310.06825 (2023).","DOI":"10.48550\/arXiv.2310.06825"},{"key":"3328_CR25","doi-asserted-by":"publisher","unstructured":"Touvron, H. et al. Llama 2: open foundation and fine-tuned chat models. https:\/\/doi.org\/10.48550\/arXiv.2307.09288 (2023).","DOI":"10.48550\/arXiv.2307.09288"},{"key":"3328_CR26","unstructured":"GPT-4V(ision) System Card. https:\/\/cdn.openai.com\/papers\/GPTV_System_Card.pdf (2023)."},{"key":"3328_CR27","doi-asserted-by":"publisher","unstructured":"Yang, Z. et al. The dawn of LMMs: preliminary explorations with GPT-4V(ision). https:\/\/doi.org\/10.48550\/arXiv.2309.17421 (2023).","DOI":"10.48550\/arXiv.2309.17421"},{"key":"3328_CR28","doi-asserted-by":"publisher","first-page":"6421","DOI":"10.3390\/app11146421","volume":"11","author":"D Jin","year":"2021","unstructured":"Jin, D. et al. What disease does this patient have? A large-scale open domain question answering dataset from medical exams. Appl. Sci. 11, 6421 (2021).","journal-title":"Appl. Sci."},{"key":"3328_CR29","unstructured":"Martinez, V., Schleicher, S., Falci, M. & Rau, J. PA & NP medical guidance. Clinical Advisor. https:\/\/www.clinicaladvisor.com\/ (2019)."},{"key":"3328_CR30","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1067\/mjd.2001.114598","volume":"45","author":"BA Lowell","year":"2001","unstructured":"Lowell, B. A., Froelich, C. W., Federman, D. G. & Kirsner, R. S. Dermatology in primary care: prevalence and patient disposition. J. Am. Acad. Dermatol. 45, 250\u2013255 (2001).","journal-title":"J. Am. Acad. Dermatol."},{"key":"3328_CR31","doi-asserted-by":"publisher","unstructured":"Buckley, T., Diao, J. A., Rodman, A. & Manrai, A. K. Accuracy of a vision-language model on challenging medical cases. https:\/\/doi.org\/10.48550\/arXiv.2311.05591 (2023).","DOI":"10.48550\/arXiv.2311.05591"},{"key":"3328_CR32","unstructured":"Image Challenge. N. Engl. J. Med. https:\/\/www.nejm.org\/image-challenge (2024)."},{"key":"3328_CR33","doi-asserted-by":"publisher","first-page":"e48002","DOI":"10.2196\/48002","volume":"9","author":"S Takagi","year":"2023","unstructured":"Takagi, S., Watari, T., Erabi, A. & Sakaguchi, K. Performance of GPT-3.5 and GPT-4 on the Japanese Medical Licensing Examination: comparison study. JMIR Med. Educ. 9, e48002 (2023).","journal-title":"JMIR Med. Educ."},{"key":"3328_CR34","doi-asserted-by":"publisher","first-page":"3694","DOI":"10.1038\/s41433-023-02564-2","volume":"37","author":"JC Lin","year":"2023","unstructured":"Lin, J. C., Younessi, D. N., Kurapati, S. S., Tang, O. Y. & Scott, I. U. Comparison of GPT-3.5, GPT-4, and human user performance on a practice ophthalmology written examination. Eye 37, 3694\u20133695 (2023).","journal-title":"Eye"},{"key":"3328_CR35","doi-asserted-by":"publisher","first-page":"e000451","DOI":"10.1136\/bmjno-2023-000451","volume":"5","author":"P Giannos","year":"2023","unstructured":"Giannos, P. Evaluating the limits of AI in medical specialisation: ChatGPT\u2019s performance on the UK Neurology Specialty Certificate Examination. BMJ Neurol. Open 5, e000451 (2023).","journal-title":"BMJ Neurol. Open"},{"key":"3328_CR36","first-page":"e40822","volume":"15","author":"M Moshirfar","year":"2023","unstructured":"Moshirfar, M., Altaf, A. W., Stoakes, I. M., Tuttle, J. J. & Hoopes, P. C. Artificial intelligence in ophthalmology: a comparative analysis of GPT-3.5, GPT-4, and human expertise in answering StatPearls questions. Cureus 15, e40822 (2023).","journal-title":"Cureus"},{"key":"3328_CR37","doi-asserted-by":"publisher","first-page":"1240915","DOI":"10.3389\/fmed.2023.1240915","volume":"10","author":"UH Lai","year":"2023","unstructured":"Lai, U. H. et al. Evaluating the performance of ChatGPT-4 on the United Kingdom medical licensing assessment. Front. Med. 10, 1240915 (2023).","journal-title":"Front. Med."},{"key":"3328_CR38","doi-asserted-by":"publisher","first-page":"e0301702","DOI":"10.1371\/journal.pone.0301702","volume":"19","author":"K-C Liu","year":"2024","unstructured":"Liu, K.-C. et al. Performance of ChatGPT on Chinese Master\u2019s Degree Entrance Examination in Clinical Medicine. PLoS One 19, e0301702 (2024).","journal-title":"PLoS One"},{"key":"3328_CR39","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s44247-023-00058-5","volume":"2","author":"D Ueda","year":"2023","unstructured":"Ueda, D. et al. Evaluating GPT-4-based ChatGPT\u2019s clinical potential on the NEJM quiz. BMC Digit. Health 2, 4 (2023).","journal-title":"BMC Digit. Health"},{"key":"3328_CR40","doi-asserted-by":"publisher","unstructured":"Tu, T. et al. Towards conversational diagnostic AI. https:\/\/doi.org\/10.48550\/arXiv.2401.05654 (2024).","DOI":"10.48550\/arXiv.2401.05654"},{"key":"3328_CR41","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1162\/tacl_a_00638","volume":"12","author":"NF Liu","year":"2024","unstructured":"Liu, N. F. et al. Lost in the middle: how language models use long contexts. Trans. Assoc. Comput. Linguist. 12, 157\u2013173 (2024).","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"3328_CR42","unstructured":"Introducing OpenAI o1-preview. https:\/\/openai.com\/index\/introducing-openai-o1-preview\/ (2024)."},{"key":"3328_CR43","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.1056\/NEJMra2301725","volume":"388","author":"P Rajpurkar","year":"2023","unstructured":"Rajpurkar, P. & Lungren, M. P. The current and future state of AI interpretation of medical images. N. Engl. J. Med. 388, 1981\u20131990 (2023).","journal-title":"N. Engl. J. Med."},{"key":"3328_CR44","doi-asserted-by":"crossref","unstructured":"Agarwal, N., Moehring, A., Rajpurkar, P. & Salz, T. Combining human expertise with artificial intelligence: experimental evidence from radiology. http:\/\/www.nber.org\/papers\/w31422.pdf (2023).","DOI":"10.3386\/w31422"},{"key":"3328_CR45","doi-asserted-by":"publisher","unstructured":"Chiang, C.-H. & Lee, H.-Y. Can large language models be an alternative to human evaluations? In Proc. of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). https:\/\/doi.org\/10.18653\/v1\/2023.acl-long.870 (Association for Computational Linguistics, 2023).","DOI":"10.18653\/v1\/2023.acl-long.870"},{"key":"3328_CR46","doi-asserted-by":"crossref","unstructured":"Shanahan, M., McDonell, K. & Reynolds, L. Role play with large language models. Nature 623, 493\u2013498 (2023).","DOI":"10.1038\/s41586-023-06647-8"},{"key":"3328_CR47","doi-asserted-by":"publisher","first-page":"2722","DOI":"10.3390\/electronics12122722","volume":"12","author":"I de Zarz\u00e0","year":"2023","unstructured":"de Zarz\u00e0, I., de Curt\u00f2, J., Roig, G., Manzoni, P. & Calafate, C. T. Emergent cooperation and strategy adaptation in multi-agent systems: an extended coevolutionary theory with LLMs. Electronics 12, 2722 (2023).","journal-title":"Electronics"},{"key":"3328_CR48","unstructured":"OpenAI. GPT-4 Technical Report. https:\/\/cdn.openai.com\/papers\/gpt-4.pdf (2023)."},{"key":"3328_CR49","doi-asserted-by":"publisher","first-page":"e68","DOI":"10.1056\/NEJMicm2210388","volume":"388","author":"T Goldberger","year":"2023","unstructured":"Goldberger, T. & Armoni-Weiss, G. Miliaria crystallina. N. Engl. J. Med. 388, e68 (2023).","journal-title":"N. Engl. J. Med."}],"container-title":["Nature Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03328-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03328-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03328-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T18:05:31Z","timestamp":1737482731000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41591-024-03328-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["3328"],"URL":"https:\/\/doi.org\/10.1038\/s41591-024-03328-5","relation":{},"ISSN":["1078-8956","1546-170X"],"issn-type":[{"value":"1078-8956","type":"print"},{"value":"1546-170X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"8 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 October 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"R.D. reports receiving personal fees from DWA, personal fees from Pfizer, personal fees from L\u2019Oreal, personal fees from VisualDx and stock options from MDAlgorithms and Revea outside the submitted work and has a patent for TrueImage pending. D.I.S. is the co-founder of FixMySkin Healing Balms, a shareholder in Appiell Inc. and K-Health, a consultant for Appiell Inc. and LuminDx and an investigator for AbbVie and Sanofi. E.M.V.A. serves as an advisor to Enara Bio, Manifold Bio, Monte Rosa, Novartis Institute for Biomedical Research and Serinus Bio. E.M.V.A provides research support to Novartis, Bristol Myers Squibb, Sanofi and NextPoint. E.M.V.A. holds equity in Tango Therapeutics, Genome Medical, Genomic Life, Enara Bio, Manifold Bio, Microsoft, Monte Rosa, Riva Therapeutics, Serinus Bio and Syapse. E.M.V.A. has filed for institutional patents on chromatin mutations and immunotherapy response and methods for clinical interpretation and provides intermittent legal consulting on patents to Foaley & Hoag. E.M.V.A. also serves on the editorial board of\n                      Science Advances\n                      . The other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"The CRAFT-MD framework is designed to enable faster evaluation of LLMs for leading clinical conversations and to uncover limitations to guide future model development. These LLMs could enhance clinical workflows by engaging in preliminary conversations with patients, collecting and summarizing relevant medical information and presenting these data to doctors before patient visits, potentially improving the effectiveness of doctor\u2013patient interactions. These LLMs could be more effective than the pre-visit questionnaires, given their ability to lead dynamic conversations. However, this will require not only developing more capable LLMs but also making them more fault tolerant and cognizant of appropriate empathetic behavior.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Declaration"}}]}}