{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T06:31:11Z","timestamp":1786516271617,"version":"build-2736575974"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T00:00:00Z","timestamp":1786492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Med."],"abstract":"<jats:sec>\n                    <jats:title>Background and aims<\/jats:title>\n                    <jats:p>Costs associated with total knee arthroplasty (TKA) may affect treatment preparation, expectation management, and postoperative care planning. Previous large language model (LLM) studies have focused mainly on medical question answering, patient education, and clinical decision support, whereas their performance in clinician-facing preoperative cost-communication preparation remains unclear. This study evaluated an LLM using real-world clinical records from two hospitals in an expert-referenced offline evaluation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Preoperative medical records of 80 patients who underwent primary unilateral TKA at two hospitals in China from January to May 2026 were included. A structured expert-panel process was used to develop a preoperative cost-communication framework comprising 4 dimensions and 17 clinical cues and to establish case-level minimum necessary communication items (CL-MNCIs) for each case. Task 1 assessed identification of the 17 cues. Task 2 assessed CL-MNCI coverage and classified all generated items according to case relevance, medical-record support, redundancy, and safety. Twenty-four cases were non-randomly selected by CL-MNCI count for three repeated-generation runs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Task 1 comprised 1,360 case\u2013label classification units. Micro-precision, micro-recall, micro-F1, accuracy, MCC, and macro-F1 were 0.901, 0.888, 0.894, 0.948, 0.860, and 0.840, respectively. Experts established 569 CL-MNCIs, of which 483 were covered, yielding an overall coverage rate of 84.9%; complete coverage was achieved in 17 cases. The LLM generated 716 items, including 12 safety events across 9 cases, 483 items matching CL-MNCIs, 132 record-supported supplementary items, 50 redundant items, and 39 items with insufficient record support. Overall, 665 items (92.9%) were case-relevant and record-supported, although this proportion included redundant content. Pairwise Jaccard similarity for covered CL-MNCI sets ranged from 0.813 to 0.823. Of 180 CL-MNCIs, 126 (70.0%) were covered in all three runs, and case-level agreement in safety classification ranged from 87.5 to 95.8%.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The LLM showed offline potential for identifying cost-communication cues and generating clinician-facing preparation checklists for TKA, but content omissions, quality variation, safety risks, and substantive cross-run variability remained. Its use should be limited to clinician-reviewed communication preparation and should not replace direct patient cost disclosure or professional judgment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fmed.2026.1899060","type":"journal-article","created":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T05:57:00Z","timestamp":1786514220000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of a large language model for clinician-facing preoperative cost-communication preparation in total knee arthroplasty"],"prefix":"10.3389","volume":"13","author":[{"given":"Zebing","family":"Ma","sequence":"first","affiliation":[{"name":"Hunan University of Chinese Medicine","place":["Changsha, Hunan, China"]},{"name":"The First Affiliated Hospital of Hunan University of Chinese Medicine","place":["Changsha, Hunan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liping","family":"Xue","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gonghui","family":"Jian","sequence":"additional","affiliation":[{"name":"Hunan University of Chinese Medicine","place":["Changsha, Hunan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Kong","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huayu","family":"Fan","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaofan","family":"Yang","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Wu","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rui","family":"Chen","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangyang","family":"Cao","sequence":"additional","affiliation":[{"name":"Luoyang Orthopedic Hospital of Henan Province (Orthopedic Hospital of Henan Province)","place":["Zhengzhou, Henan, China"]},{"name":"Institute of Intelligent Medical and Bioengineering Henan Academy of Traditional Chinese Medicine Sciences","place":["Zhengzhou, Henan, China"]},{"name":"Henan Province Artificial Intelligence Engineering Research Center for Bone Injury Rehabilitation","place":["Zhengzhou, Henan, China"]},{"name":"Henan University of Chinese Medicine","place":["Zhengzhou, Henan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,12]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.5435\/JAAOS-D-23-00338","article-title":"American academy of orthopaedic surgeons clinical practice guideline summary of surgical management of osteoarthritis of the knee","volume":"31","author":"Srivastava","year":"2023","journal-title":"J Am Acad Orthop Sur."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1637","DOI":"10.1016\/j.arth.2025.10.005","article-title":"Total knee arthroplasty out-of-pocket costs on the rise: a nationwide analysis of financial burden and regional disparities","volume":"41","author":"Singh","year":"2026","journal-title":"J Arthroplasty."},{"key":"B3","doi-asserted-by":"publisher","first-page":"S142","DOI":"10.1016\/j.arth.2025.04.087","article-title":"Low-level evidence used to substantiate insurance coverage policies for knee and hip arthroplasty","volume":"40","author":"Telang","year":"2025","journal-title":"J Arthroplasty."},{"key":"B4","doi-asserted-by":"publisher","first-page":"23814683221148651","DOI":"10.1177\/23814683221148651","article-title":"Discussing cost and value in patient decision aids and shared decision making: a call to action","volume":"8","author":"Politi","year":"2023","journal-title":"MDM Policy Pract."},{"key":"B5","doi-asserted-by":"publisher","first-page":"30028","DOI":"10.1038\/s41598-024-81852-7","article-title":"Factors influencing the decision to receive total knee replacement among patients with severe knee osteoarthritis under universal health insurance coverage","volume":"14","author":"Wang","year":"2024","journal-title":"Sci Rep."},{"key":"B6","doi-asserted-by":"publisher","first-page":"2275","DOI":"10.1016\/j.arth.2025.02.040","article-title":"Associated risk of medicaid and medicare payer status on outcomes following total joint arthroplasty: a 10-year report","volume":"40","author":"DeClercq","year":"2025","journal-title":"J Arthroplasty."},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1186\/s12962-026-00763-8","article-title":"Economic burden of knee replacement, a case of Bushehr, Iran in 2023\u20132024","author":"Ravangard","year":"2026","journal-title":"Cost Effect Resour A."},{"key":"B8","doi-asserted-by":"publisher","first-page":"2050","DOI":"10.1097\/CM9.0000000000002220","article-title":"Length of stay and inpatient charges of total knee arthroplasty in China: analysis of a national database","volume":"136","author":"Long","year":"2023","journal-title":"Chin Med J."},{"key":"B9","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1186\/s13561-019-0231-0","article-title":"Cost-utility analysis of total knee arthroplasty for osteoarthritis in a regional medical center in China","volume":"9","author":"Gui","year":"2019","journal-title":"Health Econ Rev."},{"key":"B10","doi-asserted-by":"publisher","first-page":"e243201","DOI":"10.1001\/jamanetworkopen.2024.3201","article-title":"Artificial intelligence-generated draft replies to patient inbox messages","volume":"7","author":"Garcia","year":"2024","journal-title":"JAMA Netw Open."},{"key":"B11","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1609\/aaaiss.v4i1.31785","article-title":"Talk2Care: facilitating asynchronous patient-provider communication with large-language-model","volume":"4","author":"Xu","year":"2024","journal-title":"Proc AAAI Symp Ser."},{"key":"B12","doi-asserted-by":"publisher","first-page":"415","DOI":"10.5152\/j.aott.2025.25428","article-title":"Comparative evaluation of large language model-based chatbots in a septic arthritis scenario: ChatGPT, Claude, and Perplexity","volume":"59","author":"Bayrak","year":"2025","journal-title":"Acta Orthop Traumato."},{"key":"B13","doi-asserted-by":"publisher","first-page":"116","DOI":"10.3390\/japma116030033","article-title":"Comparison of ChatGPT-5 and DeepSeek V3 for artificial intelligence-assisted patient education in foot and ankle disorders","volume":"33","author":"Karagoz","year":"2026","journal-title":"J Am Podlat Med Assn."},{"key":"B14","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1186\/s12911-025-03202-5","article-title":"Can large language models follow guidelines? A comparative study of ChatGPT-4o and DeepSeek AI in clavicle fracture management based on AAOS recommendations","volume":"25","author":"Ke\u00e7eci","year":"2025","journal-title":"BMC Med Inform Decis."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1670824","DOI":"10.3389\/fmed.2025.1670824","article-title":"Clinical applications of large language models in knee osteoarthritis: a systematic review","volume":"12","author":"Ma","year":"2025","journal-title":"Front Med-Lausanne."},{"key":"B16","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature."},{"key":"B17","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1038\/s43856-026-01653-z","article-title":"Evaluating large language models for diagnostic reasoning from unstructured clinical narratives in epilepsy","volume":"303","author":"Dani","year":"2026","journal-title":"Commun Med."},{"key":"B18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.15557\/JoU.2024.0015","article-title":"Overview for developing Delphi-based interdisciplinary consensus statements on imaging: pros and cons","volume":"24","author":"Dietrich","year":"2024","journal-title":"J Ultrason."},{"key":"B19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.5334\/ijic.6984","article-title":"Establishing internationally accepted conceptual and operational definitions of social prescribing through expert consensus: a Delphi study protocol","volume":"23","author":"Muhl","year":"2023","journal-title":"Int J Integr Care."},{"key":"B20","doi-asserted-by":"publisher","first-page":"4208","DOI":"10.1016\/j.arthro.2025.03.038","article-title":"Guidelines for designing and conducting Delphi consensus studies: an expert consensus Delphi study","volume":"41","author":"Hohmann","year":"2025","journal-title":"Arthroscopy."},{"key":"B21","doi-asserted-by":"publisher","first-page":"e0241983","DOI":"10.1371\/journal.pone.0241983","article-title":"Evaluating the content validity of two versions of an instrument used in measuring pediatric pain knowledge and attitudes in the Ghanaian context","volume":"15","author":"Kusi Amponsah","year":"2020","journal-title":"PLoS One."},{"key":"B22","unstructured":"ChatGPT (GPT-5.5)\n          \n          2026"},{"key":"B23","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12864-019-6413-7","article-title":"The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation","volume":"21","author":"Chicco","year":"2020","journal-title":"BMC Genomics."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1101\/2025.08.06.25333170","article-title":"A statistical framework for evaluating the repeatability and reproducibility of large language models","author":"Shyr","year":"2025","journal-title":"medRxiv."},{"key":"B25","doi-asserted-by":"publisher","first-page":"135","DOI":"10.18653\/v1\/2025.eval4nlp-1.1210.18653\/v1\/2025.eval4nlp-1.12","article-title":"Non-determinism of \u201cdeterministic\u201d LLM system settings in hosted environments","author":"Atil","year":"2025","journal-title":"Proceedings of the 5th workshop on evaluation and comparison of NLP systems."},{"key":"B26","doi-asserted-by":"publisher","first-page":"e52","DOI":"10.22037\/emergency.v5i1.15215","article-title":"Sampling methods in clinical research; an educational review","volume":"5","author":"Elfil","year":"2017","journal-title":"Emerg."},{"key":"B27","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1186\/s12962-024-00583-8","article-title":"Economic burden of knee joint replacement in Iran","volume":"22","author":"Rajabi","year":"2024","journal-title":"Cost Effect Resout A."},{"key":"B28","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1002\/ksa.12547","article-title":"Predictive analysis of economic and clinical outcomes in total knee arthroplasty: identifying high-risk patients for increased costs and length of stay","volume":"33","author":"Maman","year":"2025","journal-title":"Knee Surg Sport Traumatol Arthrosc."},{"key":"B29","doi-asserted-by":"publisher","first-page":"3617","DOI":"10.1016\/j.arth.2018.08.028","article-title":"Machine learning and primary total knee arthroplasty: patient forecasting for a patient-specific payment model","volume":"33","author":"Navarro","year":"2018","journal-title":"J Arthroplasty."},{"key":"B30","doi-asserted-by":"publisher","first-page":"1637","DOI":"10.1016\/j.jval.2025.05.008","article-title":"Use of large language models to extract cost-effectiveness analysis data: a case study","volume":"28","author":"Gu","year":"2025","journal-title":"Value Health."},{"key":"B31","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1038\/s41746-024-01315-1","article-title":"A strategy for cost-effective large language model use at health system-scale","volume":"7","author":"Klang","year":"2024","journal-title":"Npj Dight Med."},{"key":"B32","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1186\/s12911-025-03024-5","article-title":"Enhancing responses from large language models with role-playing prompts: a comparative study on answering frequently asked questions about total knee arthroplasty","volume":"25","author":"Chen","year":"2025","journal-title":"BMC Med Inform Decis."},{"key":"B33","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1177\/15563316211030923","article-title":"Preoperative patient optimization in total joint arthroplasty-the paradigm shift from preoperative clearance: a narrative review","volume":"18","author":"MacMahon","year":"2022","journal-title":"HSS J."},{"key":"B34","doi-asserted-by":"publisher","first-page":"20","DOI":"10.2106\/JBJS.M.00018","article-title":"Thirty-day postoperative complications and mortality following total knee arthroplasty: incidence and risk factors among a national sample of 15,321 patients","volume":"96","author":"Belmont","year":"2014","journal-title":"J Bone Joint Surg Am."},{"key":"B35","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1186\/s12891-025-09060-6","article-title":"Previous knee surgery increases risks of revision, infection, pain and stiffness after knee replacement arthroplasty: a systematic review and meta-analysis","volume":"26","author":"Li","year":"2025","journal-title":"BMC Musculoskel Dis."},{"key":"B36","doi-asserted-by":"publisher","first-page":"65","DOI":"10.21037\/atm.2018.12.62","article-title":"Discharge to the skilled nursing facility: patient risk factors and perioperative outcomes after total knee arthroplasty","volume":"7","author":"Ramkumar","year":"2019","journal-title":"Ann Transl Med."},{"key":"B37","volume-title":"Ethics and Governance of Artificial Intelligence for Health: Guidance on Large Multi-Modal Models","year":"2024"},{"key":"B38","doi-asserted-by":"publisher","first-page":"657","DOI":"10.3390\/ejihpe14030043","article-title":"ChatGPT's response consistency: a study on repeated queries of medical examination questions","volume":"14","author":"Funk","year":"2024","journal-title":"Eur J Invest Health."},{"key":"B39","doi-asserted-by":"publisher","first-page":"e0347539","DOI":"10.1371\/journal.pone.0347539","article-title":"Evaluation of large language models in medical examinations: A scoping review protocol","volume":"21","author":"Wang","year":"2026","journal-title":"PLoS One."},{"key":"B40","doi-asserted-by":"publisher","first-page":"1514896","DOI":"10.3389\/frai.2024.1514896","article-title":"Evaluating accuracy and reproducibility of large language model performance on critical care assessments in pharmacy education","volume":"7","author":"Yang","year":"2024","journal-title":"Front Artif Intell."}],"container-title":["Frontiers in Medicine"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2026.1899060\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T05:57:01Z","timestamp":1786514221000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmed.2026.1899060\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,12]]},"references-count":40,"alternative-id":["10.3389\/fmed.2026.1899060"],"URL":"https:\/\/doi.org\/10.3389\/fmed.2026.1899060","relation":{},"ISSN":["2296-858X"],"issn-type":[{"value":"2296-858X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,12]]},"article-number":"1899060"}}