{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T18:54:16Z","timestamp":1790189656735,"version":"4.1.0"},"reference-count":18,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T00:00:00Z","timestamp":1759708800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T00:00:00Z","timestamp":1759708800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Shoulder &amp; Elbow"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:sec>\n                    <jats:title>Hypothesis<\/jats:title>\n                    <jats:p>Large language models (LLMs) like ChatGPT have increasingly been used as online resources for patients with orthopedic conditions. Yet there is a paucity of information assessing the ability of LLMs to accurately and completely answer patient questions. The present study comparatively assessed both ChatGPT 3.5 and GPT-4 responses to frequently asked questions on common elbow pathologies, scoring for accuracy and completeness. It was hypothesized that ChatGPT 3.5 and GPT-4 would demonstrate high levels of accuracy for the specific query asked, but some responses would lack completeness, and GPT-4 would yield more accurate and complete responses than ChatGPT 3.5.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      ChatGPT was queried to identify five most common elbow pathologies (lateral epicondylitis, medial epicondylitis, cubital tunnel syndrome, distal biceps rupture, elbow arthritis). ChatGPT was then queried on the five most frequently asked questions for each elbow pathology. These 25 total questions were then individually asked of ChatGPT 3.5 and GPT-4. Responses were recorded and scored on 6-point Likert scale for accuracy and 3-point Likert scale for completeness by three fellowship-trained upper extremity orthopedic surgeons. ChatGPT 3.5 and GPT-4 responses were compared for each pathology using two-tailed\n                      <jats:italic toggle=\"yes\">t<\/jats:italic>\n                      -tests.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Average accuracy scores for ChatGPT 3.5 ranged from 4.80 to 4.87. Average GPT-4 accuracy scores ranged from 4.80 to 5.13. Average completeness scores for ChatGPT 3.5 ranged from 2.13 to 2.47, and average completeness scores for GPT-4 ranged from 2.47 to 2.80. Total average accuracy for ChatGPT 3.5 was 4.83, and total average accuracy for GPT-4 was 5.0 (\n                      <jats:italic toggle=\"yes\">p<\/jats:italic>\n                      \u2009=\u20090.05). Total average completeness for ChatGPT 3.5 was 2.35, and total average completeness for GPT-4 was 2.66 (\n                      <jats:italic toggle=\"yes\">p<\/jats:italic>\n                      \u2009=\u20090.01).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>ChatGPT 3.5 and GPT-4 are capable of providing accurate and complete responses to frequently asked patient questions, with GPT-4 providing superior responses. Large language models like ChatGPT have potential to serve as a reliable online resource for patients with elbow conditions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/17585732251365178","type":"journal-article","created":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T17:35:31Z","timestamp":1759772131000},"page":"379-385","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["A supplement, not a substitute: Accuracy and completeness of ChatGPT responses for common elbow pathology"],"prefix":"10.1177","volume":"18","author":[{"given":"Benjamin","family":"Fiedler","sequence":"first","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2207-074X","authenticated-orcid":false,"given":"Umar","family":"Ghilzai","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abdullah","family":"Ghali","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2140-6321","authenticated-orcid":false,"given":"Phillip","family":"Goldman","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo","family":"Coello","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael B.","family":"Gottschalk","sequence":"additional","affiliation":[{"name":"Emory University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5044-7084","authenticated-orcid":false,"given":"Eric R","family":"Wagner","sequence":"additional","affiliation":[{"name":"Emory University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adil Shahzad","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Baylor College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,10,6]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00667-w"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.2196\/22637"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2023.1199060"},{"key":"e_1_3_2_5_2","article-title":"Situating Wikipedia as a health information resource in various contexts: a scoping review","volume":"15","author":"Smith DA","year":"2020","unstructured":"Smith DA. Situating Wikipedia as a health information resource in various contexts: a scoping review. PLoS One 2020; 15: e0228786.","journal-title":"PLoS One"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-022-03446-z"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002792"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230163"},{"key":"e_1_3_2_9_2","unstructured":"ChatGPT loses users for the first time shaking faith in AI revolution."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_2_11_2","article-title":"Evaluating ChatGPT performance on the orthopaedic in-training examination","volume":"8","author":"Kung JE","year":"2023","unstructured":"Kung JE, Marshall C, Gauthier C, et al. Evaluating ChatGPT performance on the orthopaedic in-training examination. JB & JS Open Access 2023; 8: e23.00056.","journal-title":"JB & JS Open Access"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jse.2024.02.029"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2566942\/v1"},{"key":"e_1_3_2_14_2","article-title":"The potential of ChatGPT for high-quality information in patient education for sports surgery","volume":"16","author":"Y\u00fcce A","year":"2024","unstructured":"Y\u00fcce A, Erkurt N, Yerli M, et al. The potential of ChatGPT for high-quality information in patient education for sports surgery. Cureus 2024; 16: e58874.","journal-title":"Cureus"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1097\/BSD.0000000000001600"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/24730114231209919"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/15589447241247246"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjmed.2023.06.012"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41537-023-00379-4"}],"container-title":["Shoulder &amp; Elbow"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/17585732251365178","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/17585732251365178","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/17585732251365178","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T22:19:08Z","timestamp":1777587548000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/17585732251365178"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,6]]},"references-count":18,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["10.1177\/17585732251365178"],"URL":"https:\/\/doi.org\/10.1177\/17585732251365178","relation":{},"ISSN":["1758-5732","1758-5740"],"issn-type":[{"value":"1758-5732","type":"print"},{"value":"1758-5740","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,6]]}}}