{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T18:48:19Z","timestamp":1791571699725,"version":"4.3.4"},"reference-count":28,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"16","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":["J Am Acad Orthop Surg","JAAOS"],"published-print":{"date-parts":[[2025,8,15]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction:<\/jats:title>\n                    <jats:p>The steep rise in utilization of large language model chatbots, such as ChatGPT, has spilled into medicine in recent years. The newest version of ChatGPT, ChatGPT-4, has passed medical licensure examinations and, specifically in orthopaedics, has performed at the level of a postgraduate level three orthopaedic surgery resident on the Orthopaedic In-Service Training Examination question bank sets. The purpose of this study was to evaluate ChatGPT-4's diagnostic and decision-making capacity in the clinical management of bone-related injuries of the foot and ankle.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>Eight bone-related foot and ankle orthopaedic cases were presented to ChatGPT-4 and subsequently evaluated by three fellowship-trained foot and ankle orthopaedic surgeons. Cases were scored using criteria on a Likert scale, graded from a total score of 5 (lowest) to 25 (highest) across five criteria. ChatGPT-4 was referred to as \u201cDr. GPT,\u201d establishing a peer dynamic so that the role of an orthopaedic surgeon was emulated by the chatbot.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>The average score across all criteria for each case was 4.53 of 5, noting an overall average sum score of 22.7 of 25 for all cases. The pathology with the highest score was the second metatarsal stress fracture (24.3), whereas the case with the lowest score was hallux rigidus (21.3). Kendall correlation analysis of interrater reliability showed variable correlation among surgeons, without statistical significance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>ChatGPT-4 effectively diagnosed and provided appropriate treatment options for simple bone-related foot and ankle cases. Importantly, ChatGPT did not fabricate treatment options (ie, hallucination phenomenon), which has been previously well-documented in the literature, notably receiving its second-highest overall average score in this criterion. ChatGPT struggled to provide comprehensive information beyond standard treatment options. Overall, ChatGPT has the potential to serve as a widely accessible resource for patients and nonorthopaedic clinicians, although limitations may exist in the delivery of comprehensive information.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.5435\/jaaos-d-24-01049","type":"journal-article","created":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T17:00:52Z","timestamp":1744736452000},"page":"e949-e955","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":3,"title":["Comparison of ChatGPT's Diagnostic and Management Accuracy of Foot and Ankle Bone\u2013Related Pathologies to Orthopaedic Surgeons"],"prefix":"10.5435","volume":"33","author":[{"given":"Maritza Diane","family":"Essis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hayden","family":"Hartman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei Shao","family":"Tung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irvin","family":"Oh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Peden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arianna L.","family":"Gianakos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2025,4,10]]},"reference":[{"key":"R1-20250801","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.ajem.2024.02.008","article-title":"Human intelligence versus Chat-GPT: Who performs better in correctly classifying patients in triage?","volume":"79","author":"Zaboli","year":"2024","journal-title":"Am J Emerg Med"},{"key":"R2-20250801","doi-asserted-by":"crossref","first-page":"e31965","DOI":"10.1016\/j.heliyon.2024.e31965","article-title":"The memory systems of the human brain and generative artificial intelligence","volume":"10","author":"Rolls","year":"2024","journal-title":"Heliyon"},{"key":"R4-20250801","doi-asserted-by":"crossref","first-page":"100280","DOI":"10.1016\/j.bjao.2024.100280","article-title":"Comparison of artificial intelligence large language model chatbots in answering frequently asked questions in anaesthesia","volume":"10","author":"Nguyen","year":"2024","journal-title":"BJA Open"},{"key":"R5-20250801","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.ajem.2024.03.017","article-title":"Comparison of emergency medicine specialist, cardiologist, and chat-GPT in electrocardiography assessment","volume":"80","author":"Gunay","year":"2024","journal-title":"Am J Emerg Med"},{"key":"R6-20250801","doi-asserted-by":"crossref","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","article-title":"Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models","volume":"2","author":"Kung","year":"2023","journal-title":"PLoS Digit Health"},{"key":"R7-20250801","doi-asserted-by":"crossref","first-page":"e85","DOI":"10.3928\/01477447-20230922-05","article-title":"The rapid development of artificial intelligence: GPT-4's performance on orthopedic surgery board questions","volume":"47","author":"Hofmann","year":"2024","journal-title":"Orthopedics"},{"key":"R8-20250801","first-page":"e23.00056","article-title":"Evaluating ChatGPT performance on the orthopaedic in-training examination","volume":"8","author":"Kung","year":"2023","journal-title":"JB JS Open Access"},{"key":"R9-20250801","doi-asserted-by":"crossref","first-page":"1888","DOI":"10.1016\/j.jse.2024.02.029","article-title":"ChatGPT performance on the American Shoulder and Elbow Surgeons maintenance of certification exam","volume":"33","author":"Fiedler","year":"2024","journal-title":"J Shoulder Elbow Surg"},{"key":"R10-20250801","first-page":"e35179","article-title":"Artificial hallucinations in ChatGPT: Implications in scientific writing","volume":"15","author":"Alkaissi","year":"2023","journal-title":"Cureus"},{"key":"R11-20250801","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.diii.2024.04.003","article-title":"ChatGPT in radiology: A systematic review of performance, pitfalls, and future perspectives","volume":"105","author":"Keshavarz","year":"2024","journal-title":"Diagn Interv Imaging"},{"key":"R12-20250801","doi-asserted-by":"crossref","first-page":"e5471","DOI":"10.1097\/GOX.0000000000005471","article-title":"Can AI think like a plastic surgeon? Evaluating GPT-4's clinical judgment in reconstructive procedures of the upper extremity","volume":"11","author":"Leypold","year":"2023","journal-title":"Plast Reconstr Surg Glob Open"},{"key":"R13-20250801","doi-asserted-by":"crossref","first-page":"e50638","DOI":"10.2196\/50638","article-title":"Prompt engineering as an important emerging skill for medical professionals: Tutorial","volume":"25","author":"Mesko","year":"2023","journal-title":"J Med Internet Res"},{"key":"R14-20250801","first-page":"646","article-title":"Integrating AI in lipedema management: Assessing the efficacy of GPT-4 as a consultation assistant","volume":"14","author":"Leypold","year":"2024","journal-title":"Life (Basel)"},{"key":"R15-20250801","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1016\/j.jhsa.2024.06.002","article-title":"Artificial intelligence-powered hand surgery consultation: GPT-4 as an assistant in a hand surgery outpatient clinic","volume":"49","author":"Leypold","year":"2024","journal-title":"J Hand Surg Am"},{"key":"R16-20250801","first-page":"e37432","article-title":"Exploring the boundaries of reality: Investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references","volume":"15","author":"Athaluri","year":"2023","journal-title":"Cureus"},{"key":"R17-20250801","doi-asserted-by":"crossref","first-page":"e46924","DOI":"10.2196\/46924","article-title":"Artificial intelligence can generate fraudulent but authentic-looking scientific medical articles: Pandora's box has been opened","volume":"25","author":"Majovsky","year":"2023","journal-title":"J Med Internet Res"},{"key":"R18-20250801","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.14309\/ajg.0000000000002320","article-title":"Chat generative pretrained transformer fails the multiple-choice American College of Gastroenterology Self-Assessment Test","volume":"118","author":"Suchman","year":"2023","journal-title":"Am J Gastroenterol"},{"key":"R19-20250801","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.athoracsur.2024.03.023","article-title":"Chatbot reliability in managing thoracic surgical clinical scenarios","volume":"118","author":"Platz","year":"2024","journal-title":"Ann Thorac Surg"},{"key":"R20-20250801","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.1097\/CORR.0000000000002131","article-title":"What is the interrater and intrarater reliability of the Lawrence and botte classification system of fifth metatarsal base fractures?","volume":"480","author":"Noori","year":"2022","journal-title":"Clin Orthop Relat Res"},{"key":"R21-20250801","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1097\/01241398-200101000-00007","article-title":"Reliability of a modified Gartland classification of supracondylar humerus fractures","volume":"21","author":"Barton","year":"2001","journal-title":"J Pediatr Orthop"},{"key":"R22-20250801","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.foot.2010.06.002","article-title":"Interobserver and intraobserver variations in tibial pilon fracture classification systems","volume":"20","author":"Ramappa","year":"2010","journal-title":"Foot (Edinb)"},{"key":"R24-20250801","first-page":"e56402","article-title":"A comparison between GPT-3.5, GPT-4, and GPT-4V: Can the large language model (ChatGPT) pass the Japanese Board of Orthopaedic Surgery Examination?","volume":"16","author":"Nakajima","year":"2024","journal-title":"Cureus"},{"key":"R25-20250801","doi-asserted-by":"crossref","first-page":"4096","DOI":"10.1097\/JS9.0000000000001359","article-title":"Step into the era of large multimodal models: A pilot study on ChatGPT-4V(ision)'s ability to interpret radiological images","volume":"110","author":"Zhu","year":"2024","journal-title":"Int J Surg"},{"key":"R26-20250801","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1007\/s00062-024-01426-y","article-title":"Comparing the diagnostic performance of GPT-4-based ChatGPT, GPT-4V-based ChatGPT, and radiologists in challenging neuroradiology cases","volume":"34","author":"Horiuchi","year":"2024","journal-title":"Clin Neuroradiol"},{"key":"R27-20250801","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1007\/s00330-024-10902-5","article-title":"ChatGPT's diagnostic performance based on textual vs. visual information compared to radiologists' diagnostic performance in musculoskeletal radiology","volume":"35","author":"Horiuchi","year":"2025","journal-title":"Eur Radiol"},{"key":"R28-20250801","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s00234-023-03252-4","article-title":"Accuracy of ChatGPT generated diagnosis from patient's medical history and imaging findings in neuroradiology cases","volume":"66","author":"Horiuchi","year":"2024","journal-title":"Neuroradiology"},{"key":"R29-20250801","doi-asserted-by":"crossref","first-page":"e56110","DOI":"10.2196\/56110","article-title":"ChatGPT with GPT-4 outperforms emergency department physicians in diagnostic accuracy: Retrospective analysis","volume":"26","author":"Hoppe","year":"2024","journal-title":"J Med Internet Res"},{"key":"R30-20250801","doi-asserted-by":"crossref","first-page":"e51127","DOI":"10.2196\/51127","article-title":"Perceptions of health misinformation on social media: Cross-sectional survey study","volume":"4","author":"Gaysynsky","year":"2024","journal-title":"JMIR Infodemiology"}],"container-title":["Journal of the American Academy of Orthopaedic Surgeons"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-01049","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T14:45:52Z","timestamp":1787669152000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-01049"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,10]]},"references-count":28,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.5435\/jaaos-d-24-01049","relation":{},"ISSN":["1067-151X","1940-5480"],"issn-type":[{"value":"1067-151X","type":"print"},{"value":"1940-5480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,10]]},"assertion":[{"value":"2024-09-12","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-21","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}