{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T16:12:00Z","timestamp":1788797520961,"version":"build-2803163510"},"reference-count":39,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["esskajournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Knee surg. sports traumatol. arthrosc."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Artificial intelligence (AI) is increasingly utilized in medical education and clinical contexts, yet few studies compare the performance of large language models (LLMs) to subspecialized experts in providing guideline\u2010based medical information on hip preservation. The purpose of this study was to evaluate the performance of three LLMs compared to a panel of international hip preservation experts in answering guideline\u2010based questions related to femoroacetabular impingement syndrome, hip dysplasia and microinstability of the hip.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      A 21\u2010item questionnaire was developed based on published consensus guidelines. The survey was distributed to a panel of hip preservation specialists identified through the professional network of the senior author. Ten experts responded and were included in the analysis. Three LLMs (ChatGPT 5.2, Gemini 3 and Claude 4.5 Sonnet) were prompted using the same questionnaire, with each LLM performing three runs per item. Outcomes included overall accuracy, percent agreement, Fleiss'\n                      <jats:italic>\u03ba<\/jats:italic>\n                      , generalized linear mixed\u2010effects modelling and qualitative assessment of AI answer justifications.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Expert accuracy was 90.5% (95% confidence interval [CI] 87.1\u201393.9), compared to 100% (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.004) for Gemini, 98.4% (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.016) for ChatGPT and 96.8% (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.053) for Claude. Expert percent agreement was 42.9% and Fleiss'\n                      <jats:italic>\u03ba<\/jats:italic>\n                      was 0.769; alternatively, AI intra\u2010item percent agreement was 100% (Gemini) and 95.2% (ChatGPT and Claude). ChatGPT and Claude provided thorough justifications for even incorrect responses, and Gemini demonstrated formatting deviations despite 100% accuracy.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The three LLMs demonstrated high accuracy and consistency when answering the hip preservation questionnaire, with two of the LLMs statistically outperforming the expert panel. In structured, verifiable question sets, the ability of newer LLMs to accurately and consistently respond to consensus\u2010based questions is improving compared to prior reports. LLMs are likely to serve as an adjunct in orthopaedic education and practice, and limitations to AI's implementation into practice should be continuously and rigorously explored.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence<\/jats:title>\n                    <jats:p>Level V.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/ksa.70581","type":"journal-article","created":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T15:58:21Z","timestamp":1788796701000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Select large language models outperform hip preservation experts on consensus\u2010based hip preservation questionnaire"],"prefix":"10.1002","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-7282-1455","authenticated-orcid":false,"given":"Karter","family":"Morris","sequence":"first","affiliation":[{"name":"School of Medicine Texas Tech University Health Sciences Center Lubbock Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"\u00d6ttl","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Balgrist University Hospital Z\u00fcrich Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James A.","family":"Pruneski","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Tripler Army Medical Center Honolulu Hawaii USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"B\u00e1lint","family":"Zsidai","sequence":"additional","affiliation":[{"name":"Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy University of Gothenburg Gothenburg Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael T.","family":"Hirschmann","sequence":"additional","affiliation":[{"name":"University Department of Orthopaedic Surgery and Traumatology Kantonsspital Baselland Bruderholz Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristian","family":"Samuelsson","sequence":"additional","affiliation":[{"name":"Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy University of Gothenburg Gothenburg Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2276-7814","authenticated-orcid":false,"given":"Matthew J.","family":"Kraeutler","sequence":"additional","affiliation":[{"name":"Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy University of Gothenburg Gothenburg Sweden"},{"name":"Department of Orthopaedic Surgery and Rehabilitation Texas Tech University Health Sciences Center Lubbock Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,7]]},"reference":[{"issue":"1","key":"e_1_2_13_2_1","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1186\/s12909-025-06731-9","article-title":"Medical students and ChatGPT: analyzing attitudes, practices, and academic perceptions","volume":"25","author":"Abdelhafiz AS","year":"2025","journal-title":"BMC Med Educ"},{"issue":"11","key":"e_1_2_13_3_1","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.5312\/wjo.v15.i11.1023","article-title":"Artificial intelligence awareness and perceptions among pediatric orthopedic surgeons: a cross\u2010sectional observational study","volume":"15","author":"Alomran AK","year":"2024","journal-title":"World J Orthop"},{"issue":"1","key":"e_1_2_13_4_1","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1186\/s12873-025-01396-5","article-title":"Evaluation of ChatGPT\u20105 responses in obstetric and gynecological emergencies: concordance, readability, and clinical reliability","volume":"25","author":"Arslan H\u00c7","year":"2025","journal-title":"BMC Emerg Med"},{"key":"e_1_2_13_5_1","doi-asserted-by":"crossref","DOI":"10.2196\/53616","article-title":"Benefits and risks of AI in health care: narrative review","volume":"13","author":"Chustecki M","year":"2024","journal-title":"Interact J Med Res"},{"issue":"9","key":"e_1_2_13_6_1","doi-asserted-by":"crossref","first-page":"1888","DOI":"10.1016\/j.jse.2024.02.029","article-title":"ChatGPT performance on the American Shoulder and Elbow Surgeons maintenance of certification exam","volume":"33","author":"Fiedler B","year":"2024","journal-title":"J Shoulder Elbow Surg"},{"key":"e_1_2_13_7_1","doi-asserted-by":"crossref","DOI":"10.2196\/84120","article-title":"Knowledge\u2010practice performance gap in clinical large language models: systematic review of 39 benchmarks","volume":"27","author":"Gong EJ","year":"2025","journal-title":"J Med Internet Res"},{"issue":"19","key":"e_1_2_13_8_1","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1136\/bjsports-2016-096743","article-title":"The Warwick Agreement on femoroacetabular impingement syndrome (FAI syndrome): an international consensus statement","volume":"50","author":"Griffin DR","year":"2016","journal-title":"Br J Sports Med"},{"issue":"11","key":"e_1_2_13_9_1","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1016\/j.jsurg.2024.08.002","article-title":"Artificial intelligence in orthopaedics: performance of ChatGPT on text and image questions on a complete AAOS orthopaedic in\u2010training examination (OITE)","volume":"81","author":"Hayes DS","year":"2024","journal-title":"J Surg Educ"},{"issue":"1","key":"e_1_2_13_10_1","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1186\/s12909-025-07438-7","article-title":"Status and perceptions of ChatGPT utilization among medical students: a survey\u2010based study","volume":"25","author":"Hu N","year":"2025","journal-title":"BMC Med Educ"},{"key":"e_1_2_13_11_1","doi-asserted-by":"crossref","DOI":"10.1177\/20552076241233144","article-title":"Performance of ChatGPT on Stage 1 of the Taiwanese medical licensing exam","volume":"10","author":"Huang CH","year":"2024","journal-title":"Digit Health"},{"issue":"1","key":"e_1_2_13_12_1","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1186\/s13018-023-04467-0","article-title":"Assessing ChatGPT's orthopedic in\u2010service training exam performance and applicability in the field","volume":"19","author":"Jain N","year":"2024","journal-title":"J Orthop Surg Res"},{"issue":"1","key":"e_1_2_13_13_1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1007\/s00167-022-06933-4","article-title":"Diagnosing hip microinstability: an international consensus study using the Delphi methodology","volume":"31","author":"Khanduja V","year":"2023","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"issue":"1","key":"e_1_2_13_14_1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1111\/aej.70046","article-title":"Large language models for endodontic diagnosis: a comparative study against an expert reference standard","volume":"52","author":"Kumar V","year":"2026","journal-title":"Aust Endod J"},{"issue":"3","key":"e_1_2_13_15_1","article-title":"Evaluating ChatGPT performance on the orthopaedic in\u2010training examination","volume":"8","author":"Kung JE","year":"2023","journal-title":"JB JS Open Access"},{"issue":"4","key":"e_1_2_13_16_1","doi-asserted-by":"crossref","DOI":"10.1016\/j.injury.2025.112297","article-title":"Artificial intelligence versus orthopedic surgeons as an orthopedic consultant in the emergency department","volume":"56","author":"Liu J","year":"2025","journal-title":"Injury"},{"issue":"3","key":"e_1_2_13_17_1","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.surge.2025.04.004","article-title":"Comparison of ChatGPT plus (version 4.0) and pretrained AI model (Orthopod) on orthopaedic in\u2010training exam (OITE)","volume":"23","author":"Magruder ML","year":"2025","journal-title":"Surgeon"},{"issue":"4","key":"e_1_2_13_18_1","doi-asserted-by":"crossref","DOI":"10.1177\/2325967121991213","article-title":"Standardizing the diagnostic evaluation of nonarthritic hip pain through the Delphi method","volume":"9","author":"McClincy MP","year":"2021","journal-title":"Orthop J Sports Med"},{"issue":"10","key":"e_1_2_13_19_1","doi-asserted-by":"crossref","DOI":"10.1056\/AIdbp2500120","article-title":"Assessment of large language models in clinical reasoning: a novel benchmarking study","volume":"2","author":"McCoy LG","year":"2025","journal-title":"NEJM AI"},{"key":"e_1_2_13_20_1","doi-asserted-by":"crossref","DOI":"10.1016\/j.ijmedinf.2024.105780","article-title":"Towards secure and trusted AI in healthcare: a systematic review of emerging innovations and ethical challenges","volume":"195","author":"Mohsin Khan M","year":"2025","journal-title":"Int J Med Inform"},{"key":"e_1_2_13_21_1","doi-asserted-by":"crossref","first-page":"20","DOI":"10.21037\/jhmhp-24-138","article-title":"Integrating artificial intelligence in clinical practice, hospital management, and health policy: literature review","volume":"9","author":"Nasef D","year":"2025","journal-title":"J Hosp Manag Health Policy"},{"key":"e_1_2_13_22_1","doi-asserted-by":"crossref","DOI":"10.1016\/j.artd.2025.101772","article-title":"Exploring ChatGPT's Efficacy in orthopaedic arthroplasty questions compared to adult reconstruction surgeons","volume":"34","author":"Nieves\u2010Lopez B","year":"2025","journal-title":"Arthroplast Today"},{"issue":"2","key":"e_1_2_13_23_1","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.arthro.2024.07.040","article-title":"Currently available large language models do not provide musculoskeletal treatment recommendations that are concordant with evidence\u2010based clinical practice guidelines","volume":"41","author":"Nwachukwu BU","year":"2025","journal-title":"Arthroscopy"},{"issue":"5","key":"e_1_2_13_24_1","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1007\/s00167-023-07338-7","article-title":"A practical guide to the development and deployment of deep learning models for the orthopedic surgeon: part II","volume":"31","author":"Oeding JF","year":"2023","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"issue":"1","key":"e_1_2_13_25_1","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1002\/ksa.70145","article-title":"Is orthopaedics entering the age of generative AI?\u2014A narrative review of current applications challenges and future directions","volume":"34","author":"Oettl FC","year":"2026","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"issue":"2","key":"e_1_2_13_26_1","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.surg.2024.04.003","article-title":"AI versus MD: evaluating the surgical decision\u2010making accuracy of ChatGPT\u20104","volume":"176","author":"Palenzuela DL","year":"2024","journal-title":"Surgery"},{"issue":"4","key":"e_1_2_13_27_1","doi-asserted-by":"crossref","DOI":"10.1002\/jeo2.70481","article-title":"A practical guide to the implementation of artificial intelligence in orthopaedic research\u2014part 3: how orthopaedic research benefits from the implementation of artificial intelligence","volume":"12","author":"Pruneski JA","year":"2025","journal-title":"J Exp Orthop"},{"issue":"4","key":"e_1_2_13_28_1","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1093\/jhps\/hnz055","article-title":"Best practice guidelines for arthroscopic intervention in femoroacetabular impingement syndrome: results from an International Delphi Consensus Project\u2010Phase 1","volume":"6","author":"Radha S","year":"2019","journal-title":"J Hip Preserv Surg"},{"issue":"1","key":"e_1_2_13_29_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","article-title":"AI in health and medicine","volume":"28","author":"Rajpurkar P","year":"2022","journal-title":"Nat Med"},{"key":"e_1_2_13_30_1","doi-asserted-by":"crossref","DOI":"10.2196\/66552","article-title":"Comparative performance of medical students, ChatGPT\u20103.5 and ChatGPT\u20104.0 in answering questions from a Brazilian National Medical Exam: cross\u2010sectional questionnaire study","volume":"4","author":"Rodrigues Alessi M","year":"2025","journal-title":"JMIR AI"},{"key":"e_1_2_13_31_1","doi-asserted-by":"crossref","DOI":"10.2196\/59823","article-title":"The clinicians' guide to large language models: a general perspective with a focus on hallucinations","volume":"14","author":"Roustan D","year":"2025","journal-title":"Interact J Med Res"},{"issue":"3","key":"e_1_2_13_32_1","doi-asserted-by":"crossref","DOI":"10.1002\/jeo2.12080","article-title":"Orthopaedic surgeons display a positive outlook towards artificial intelligence: a survey among members of the AGA Society for Arthroscopy and Joint Surgery","volume":"11","author":"Rupp MC","year":"2024","journal-title":"J Exp Orthop"},{"issue":"4","key":"e_1_2_13_33_1","doi-asserted-by":"crossref","DOI":"10.1002\/jeo2.70548","article-title":"Artificial intelligence fails to outperform orthopaedic surgeons: a systematic review","volume":"12","author":"Russell J","year":"2025","journal-title":"J Exp Orthop"},{"issue":"4","key":"e_1_2_13_34_1","article-title":"Comparing ChatGPT and medical student performance in a real image\u2010based radiology and applied physics in medicine exam","volume":"67","author":"Salvador R","year":"2025","journal-title":"Radiologia"},{"key":"e_1_2_13_35_1","article-title":"Advances in large language model performance: a comparative study of ChatGPT\u20104 and ChatGPT\u20105 on ABSITE questions","author":"Sanli AN","year":"2025","journal-title":"Am Surg"},{"issue":"1","key":"e_1_2_13_36_1","article-title":"Global perspectives on artificial intelligence in orthopaedic surgery: findings from the 2025 ABC travelling fellowship survey","volume":"11","author":"Schneider PS","year":"2026","journal-title":"JB JS Open Access"},{"issue":"6","key":"e_1_2_13_37_1","article-title":"Inadequate performance of ChatGPT on orthopedic board\u2010style written exams","volume":"16","author":"Sparks CA","year":"2024","journal-title":"Cureus"},{"issue":"5","key":"e_1_2_13_38_1","doi-asserted-by":"crossref","first-page":"1557","DOI":"10.1002\/ksa.12653","article-title":"Transforming orthopaedics with AI: insights from a custom ChatGPT on ESSKA osteotomy consensus","volume":"33","author":"Sweed T","year":"2025","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"issue":"3","key":"e_1_2_13_39_1","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1227\/neu.0000000000003878","article-title":"Evaluating the performance and fragility of large language models on the self\u2010assessment for neurological surgeons","volume":"99","author":"Vishwanath K","year":"2026","journal-title":"Neurosurgery"},{"issue":"1","key":"e_1_2_13_40_1","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1186\/s40634-023-00683-z","article-title":"A practical guide to the implementation of AI in orthopaedic research\u2014part 1: opportunities in clinical application and overcoming existing challenges","volume":"10","author":"Zsidai B","year":"2023","journal-title":"J Exp Orthop"}],"container-title":["Knee Surgery, Sports Traumatology, Arthroscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ksa.70581","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ksa.70581","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ksa.70581","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T15:58:25Z","timestamp":1788796705000},"score":1,"resource":{"primary":{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/10.1002\/ksa.70581"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,7]]},"references-count":39,"alternative-id":["10.1002\/ksa.70581"],"URL":"https:\/\/doi.org\/10.1002\/ksa.70581","archive":["Portico"],"relation":{},"ISSN":["0942-2056","1433-7347"],"issn-type":[{"value":"0942-2056","type":"print"},{"value":"1433-7347","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,7]]},"assertion":[{"value":"2026-02-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"ksa.70581"}}