{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T11:58:36Z","timestamp":1780487916874,"version":"3.54.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T00:00:00Z","timestamp":1747958400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"},{"start":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T00:00:00Z","timestamp":1747958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"DOI":"10.1186\/s12911-025-03024-5","type":"journal-article","created":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T16:34:24Z","timestamp":1748018064000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Enhancing responses from large language models with role-playing prompts: a comparative study on answering frequently asked questions about total knee arthroplasty"],"prefix":"10.1186","volume":"25","author":[{"given":"Yi-Chen","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng-Hsun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huan","family":"Sheu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng-Hsuan","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chih-Chien","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shih-Chen","family":"Fu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cheng-Pang","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Chih","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,5,23]]},"reference":[{"key":"3024_CR1","unstructured":"OpenAI. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt. Accessed April 06, 2024."},{"key":"3024_CR2","unstructured":"Pichai S, Hassabis D. Introducing Gemini: our largest and most capable AI model. https:\/\/blog.google\/technology\/ai\/google-gemini-ai\/#sundar-note. Accessed April 6, 2024."},{"key":"3024_CR3","unstructured":"Anthropic. Introducing Claude. https:\/\/www.anthropic.com\/news\/introducing-claude. Accessed April 06, 2024."},{"issue":"8","key":"3024_CR4","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","volume":"29","author":"AJ Thirunavukarasu","year":"2023","unstructured":"Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large Language models in medicine. Nat Med. 2023;29(8):1930\u201340.","journal-title":"Nat Med"},{"issue":"6","key":"3024_CR5","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1177\/0033354919874074","volume":"134","author":"LJ Finney Rutten","year":"2019","unstructured":"Finney Rutten LJ, Blake KD, Greenberg-Worisek AJ, Allen SV, Moser RP, Hesse BW. Online health information seeking among US adults: measuring progress toward a healthy people 2020 objective. Public Health Rep. 2019;134(6):617\u201325.","journal-title":"Public Health Rep"},{"key":"3024_CR6","doi-asserted-by":"crossref","unstructured":"Calixte R, Rivera A, Oridota O, Beauchamp W, Camacho-Rivera M. Social and demographic patterns of health-related internet use among adults in the united States: a secondary data analysis of the health information National trends survey. Int J Environ Res Public Health. 2020;17(18).","DOI":"10.3390\/ijerph17186856"},{"issue":"9","key":"3024_CR7","doi-asserted-by":"publisher","first-page":"1134","DOI":"10.3899\/jrheum.170990","volume":"46","author":"JA Singh","year":"2019","unstructured":"Singh JA, Yu S, Chen L, Cleveland JD. Rates of total joint replacement in the united States: future projections to 2020\u20132040 using the National inpatient sample. J Rheumatol. 2019;46(9):1134\u201340.","journal-title":"J Rheumatol"},{"key":"3024_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.arth.2024.03.017","author":"SS Bains","year":"2024","unstructured":"Bains SS, Dubin JA, Hameed D, Sax OC, Douglas S, Mont M, et al. Use and application of large Language models for patient questions following total knee arthroplasty. J Arthroplasty. 2024. https:\/\/doi.org\/10.1016\/j.arth.2024.03.017.","journal-title":"J Arthroplasty"},{"key":"3024_CR9","doi-asserted-by":"crossref","unstructured":"Kienzle A, Niemann M, Meller S, Gwinner C. ChatGPT May offer an adequate substitute for informed consent to patients prior to total knee arthroplasty-yet caution is needed. J Pers Med. 2024;14(1).","DOI":"10.3390\/jpm14010069"},{"key":"3024_CR10","doi-asserted-by":"publisher","DOI":"10.1016\/j.arth.2024.02.023","author":"ML Magruder","year":"2024","unstructured":"Magruder ML, Rodriguez AN, Wong JCJ, Erez O, Piuzzi NS, Scuderi GR, et al. Assessing ability for ChatGPT to answer total knee arthroplasty-related questions. J Arthroplasty. 2024. https:\/\/doi.org\/10.1016\/j.arth.2024.02.023.","journal-title":"J Arthroplasty"},{"issue":"2","key":"3024_CR11","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1302\/2633-1462.52.BJO-2023-0113.R1","volume":"5","author":"BM Wright","year":"2024","unstructured":"Wright BM, Bodnar MS, Moore AD, Maseda MC, Kucharik MP, Diaz CC, et al. Is ChatGPT a trusted source of information for total hip and knee arthroplasty patients? Bone Jt Open. 2024;5(2):139\u201346.","journal-title":"Bone Jt Open"},{"issue":"5","key":"3024_CR12","doi-asserted-by":"publisher","first-page":"1184","DOI":"10.1016\/j.arth.2024.01.029","volume":"39","author":"J Yang","year":"2024","unstructured":"Yang J, Ardavanis KS, Slack KE, Fernando ND, Della Valle CJ, Hernandez NM. Chat generative pretrained transformer (ChatGPT) and Bard: artificial intelligence does not yet provide clinically supported answers for hip and knee osteoarthritis. J Arthroplasty. 2024;39(5):1184\u201390.","journal-title":"J Arthroplasty"},{"issue":"1","key":"3024_CR13","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1186\/s43019-024-00218-5","volume":"36","author":"S Zhang","year":"2024","unstructured":"Zhang S, Liau ZQG, Tan KLM, Chua WL. Evaluating the accuracy and relevance of ChatGPT responses to frequently asked questions regarding total knee replacement. Knee Surg Relat Res. 2024;36(1):15.","journal-title":"Knee Surg Relat Res"},{"key":"3024_CR14","doi-asserted-by":"crossref","unstructured":"Takagi S, Watari T, Erabi A, Sakaguchi K. Performance of GPT-3.5 and GPT-4 on the Japanese medical licensing examination: comparison study. JMIR Med Educ. 2023;9e48002.","DOI":"10.2196\/48002"},{"issue":"1","key":"3024_CR15","doi-asserted-by":"publisher","first-page":"18562","DOI":"10.1038\/s41598-023-45837-2","volume":"13","author":"A Taloni","year":"2023","unstructured":"Taloni A, Borselli M, Scarsi V, Rossi C, Coco G, Scorcia V, et al. Comparative performance of humans versus GPT-4.0 and GPT-3.5 in the self-assessment program of American academy of ophthalmology. Sci Rep. 2023;13(1):18562.","journal-title":"Sci Rep"},{"issue":"1","key":"3024_CR16","doi-asserted-by":"publisher","first-page":"20512","DOI":"10.1038\/s41598-023-46995-z","volume":"13","author":"M Rosol","year":"2023","unstructured":"Rosol M, Gasior JS, Laba J, Korzeniewski K, Mlynczak M. Evaluation of the performance of GPT-3.5 and GPT-4 on the Polish medical final examination. Sci Rep. 2023;13(1):20512.","journal-title":"Sci Rep"},{"issue":"1","key":"3024_CR17","doi-asserted-by":"publisher","first-page":"e232411","DOI":"10.1148\/radiol.232411","volume":"310","author":"D Li","year":"2024","unstructured":"Li D, Gupta K, Bhaduri M, Sathiadoss P, Bhatnagar S, Chong J, Comparing. GPT-3.5 and GPT-4 accuracy and drift in radiology diagnosis please cases. Radiology. 2024;310(1):e232411.","journal-title":"Radiology"},{"key":"3024_CR18","doi-asserted-by":"crossref","unstructured":"Lim ZW, Pushpanathan K, Yew SME, Lai Y, Sun CH, Lam JSH et al. Benchmarking large language models\u2019 performances for myopia care: a comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Google Bard. EBioMedicine. 2023;95104770.","DOI":"10.1016\/j.ebiom.2023.104770"},{"key":"3024_CR19","doi-asserted-by":"crossref","unstructured":"Giannakopoulos K, Kavadella A, Aaqel Salim A, Stamatopoulos V, Kaklamanos EG. Evaluation of the performance of generative AI large Language models chatGPT, Google bard, and Microsoft Bing chat in supporting evidence-based dentistry: comparative mixed methods study. J Med Internet Res. 2023;25e51580.","DOI":"10.2196\/51580"},{"issue":"1","key":"3024_CR20","doi-asserted-by":"publisher","first-page":"2050","DOI":"10.1038\/s41467-024-46411-8","volume":"15","author":"S Sandmann","year":"2024","unstructured":"Sandmann S, Riepenhausen S, Plagwitz L, Varghese J. Systematic analysis of ChatGPT, Google search and Llama 2 for clinical decision support tasks. Nat Commun. 2024;15(1):2050.","journal-title":"Nat Commun"},{"key":"3024_CR21","doi-asserted-by":"publisher","DOI":"10.1136\/bjo-2023-325143","author":"MM Carla","year":"2024","unstructured":"Carla MM, Gambini G, Baldascino A, Giannuzzi F, Boselli F, Crincoli E, et al. Exploring AI-chatbots\u2019 capability to suggest surgical planning in ophthalmology: ChatGPT versus Google gemini analysis of retinal detachment cases. Br J Ophthalmol. 2024. https:\/\/doi.org\/10.1136\/bjo-2023-325143.","journal-title":"Br J Ophthalmol"},{"issue":"3","key":"3024_CR22","first-page":"e55991","volume":"16","author":"A Abbas","year":"2024","unstructured":"Abbas A, Rehman MS, Rehman SS. Comparing the performance of popular large Language models on the National board of medical examiners sample questions. Cureus. 2024;16(3):e55991.","journal-title":"Cureus"},{"issue":"3","key":"3024_CR23","doi-asserted-by":"publisher","first-page":"198","DOI":"10.3390\/ime2030019","volume":"2","author":"T Heston","year":"2023","unstructured":"Heston T, Khun C. Prompt engineering in medical education. Int Med Educ. 2023;2(3):198\u2013205.","journal-title":"Int Med Educ"},{"key":"3024_CR24","doi-asserted-by":"crossref","unstructured":"Poonprasartporn A, Uttaranakorn P, Chuaybamroong R. Comparing the accuracy and referencing of ChatGPT\u2019s responses to herbal medicine queries: A zero-shot versus roleplay prompting approach. Thai J Pharm Sci. 2023;47(4).","DOI":"10.56808\/3027-7922.2838"},{"key":"3024_CR25","unstructured":"Chang Gung Memorial Hospital. Frequently asked questions about joint replacement. https:\/\/www1.cgmh.org.tw\/intr\/intr2\/c3270\/faq_joint.html. Accessed 20 March 2024."},{"issue":"9","key":"3024_CR26","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1016\/j.jhsa.2012.05.021","volume":"37","author":"CJ Dy","year":"2012","unstructured":"Dy CJ, Taylor SA, Patel RM, Kitay A, Roberts TR, Daluiski A. The effect of search term on the quality and accuracy of online information regarding distal radius fractures. J Hand Surg Am. 2012;37(9):1881\u20137.","journal-title":"J Hand Surg Am"},{"issue":"20","key":"3024_CR27","doi-asserted-by":"publisher","first-page":"e177","DOI":"10.2106\/JBJS.M.01228","volume":"96","author":"GH Garcia","year":"2014","unstructured":"Garcia GH, Taylor SA, Dy CJ, Christ A, Patel RM, Dines JS. Online resources for shoulder instability: what are patients reading? J Bone Joint Surg Am. 2014;96(20):e177.","journal-title":"J Bone Joint Surg Am"},{"issue":"23","key":"3024_CR28","doi-asserted-by":"publisher","first-page":"2695","DOI":"10.1097\/01.brs.0000188266.22041.c2","volume":"30","author":"S Mathur","year":"2005","unstructured":"Mathur S, Shanti N, Brkaric M, Sood V, Kubeck J, Paulino C, et al. Surfing for scoliosis: the quality of information available on the internet. Spine. 2005;30(23):2695\u2013700.","journal-title":"Spine"},{"issue":"2","key":"3024_CR29","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1177\/1947603516648737","volume":"8","author":"D Wang","year":"2017","unstructured":"Wang D, Jayakar RG, Leong NL, Leathers MP, Williams RJ, Jones KJ. Evaluation of the quality, accuracy, and readability of online patient resources for the management of articular cartilage defects. Cartilage. 2017;8(2):112\u20138.","journal-title":"Cartilage"},{"issue":"1","key":"3024_CR30","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1186\/s12913-017-2031-8","volume":"17","author":"M Sekhon","year":"2017","unstructured":"Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.","journal-title":"BMC Health Serv Res"},{"issue":"2","key":"3024_CR31","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","volume":"15","author":"TK Koo","year":"2016","unstructured":"Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155\u201363.","journal-title":"J Chiropr Med"},{"key":"3024_CR32","unstructured":"OpenAI. Prompt engineering. https:\/\/platform.openai.com\/docs\/guides\/prompt-engineering. Accessed 12 May 2024."},{"key":"3024_CR33","doi-asserted-by":"crossref","unstructured":"Kong A, Zhao S, Chen H, Li Q, Qin Y, Sun R et al. Better zero-shot reasoning with role-play prompting. ArXiv, abs\/230807702. 2023.","DOI":"10.18653\/v1\/2024.naacl-long.228"},{"key":"3024_CR34","doi-asserted-by":"crossref","unstructured":"De Angelis L, Baglivo F, Arzilli G, Privitera GP, Ferragina P, Tozzi AE et al. ChatGPT and the rise of large Language models: the new AI-driven infodemic threat in public health. Front Public Health. 2023;111166120.","DOI":"10.2139\/ssrn.4352931"},{"key":"3024_CR35","unstructured":"Zhao J, Qian Z, Cao J, Wang Y, Ding Y. Role-play paradox in large Language models: reasoning performance gains and ethical dilemmas. ArXiv Preprint arXiv:240913979. 2024."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-025-03024-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-025-03024-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-025-03024-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,23]],"date-time":"2025-05-23T16:34:28Z","timestamp":1748018068000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-025-03024-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,23]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["3024"],"URL":"https:\/\/doi.org\/10.1186\/s12911-025-03024-5","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,23]]},"assertion":[{"value":"8 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by the Institutional Review Board (IRB) of Chang Gung Medical Foundation (IRB No.: 202500062B0, Additional file ). The study adhered to the ethical principles outlined in the Declaration of Helsinki. As this study evaluated large language model responses without involving human participants, patient data, or identifiable information, the Institutional Review Board of Chang Gung Medical Foundation (IRB No.: 202500062B0) waived the requirement for patient consent. However, the IRB approved and obtained informed consent for the orthopedic surgeons\u2019 evaluation of the responses.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable. This study did not involve human participants or data requiring consent for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"During the preparation of this work, the authors used ChatGPT in order to improve readability of the manuscript. After using this tool, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration of Generative AI and AI-assisted technologies in the writing process"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"196"}}