{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T15:28:52Z","timestamp":1787671732832,"version":"build-2736575974"},"reference-count":16,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"16","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":["J Am Acad Orthop Surg","JAAOS"],"published-print":{"date-parts":[[2025,8,15]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction:<\/jats:title>\n                    <jats:p>ChatGPT-4, a chatbot with an ability to carry human-like conversation, has attracted attention after demonstrating aptitude to pass professional licensure examinations. The purpose of this study was to explore the diagnostic and decision-making capacities of ChatGPT-4 in clinical management specifically assessing for accuracy in the identification and treatment of soft-tissue foot and ankle pathologies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>This study presented eight soft-tissue\u2013related foot and ankle cases to ChatGPT-4, with each case assessed by three fellowship-trained foot and ankle orthopaedic surgeons. The evaluation system included five criteria within a Likert scale, scoring from 5 (lowest) to 25 (highest possible).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      The average sum score of all cases was 22.0. The Morton neuroma case received the highest score (24.7), and the peroneal tendon tear case received the lowest score (16.3). Subgroup analyses of each of the 5 criterion using showed no notable differences in surgeon grading. Criteria 3 (provide alternative treatments) and 4 (provide comprehensive information) were graded markedly lower than criteria 1 (diagnose), 2 (treat), and 5 (provide accurate information) (for both criteria 3 and 4:\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.007;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.032;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; 0.0001). Criteria 5 was graded markedly higher than criteria 2, 3, and 4 (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.02;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; 0.0001;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; 0.0001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>This study demonstrates that ChatGPT-4 effectively diagnosed and provided reliable treatment options for most soft-tissue foot and ankle cases presented, noting consistency among surgeon evaluators. Individual criterion assessment revealed that ChatGPT-4 was most effective in diagnosing and suggesting appropriate treatment, but limitations were seen in the chatbot's ability to provide comprehensive information and alternative treatment options. In addition, the chatbot successfully did not suggest fabricated treatment options, a common concern in prior literature. This resource could be useful for clinicians seeking reliable patient education materials without the fear of inconsistencies, although comprehensive information beyond treatment may be limited.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.5435\/jaaos-d-24-00595","type":"journal-article","created":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T16:01:00Z","timestamp":1729699260000},"page":"917-923","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":7,"title":["Can ChatGPT-4 Diagnose and Treat Like an Orthopaedic Surgeon? Testing Clinical Decision Making and Diagnostic Ability in Soft-Tissue Pathologies of the Foot and Ankle"],"prefix":"10.5435","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2213-8652","authenticated-orcid":false,"given":"Hayden","family":"Hartman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maritza Diane","family":"Essis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei Shao","family":"Tung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irvin","family":"Oh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Peden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8362-0752","authenticated-orcid":false,"given":"Arianna L.","family":"Gianakos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2024,10,15]]},"reference":[{"key":"R1-20250801","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s11019-021-10049-w","article-title":"Chatbot breakthrough in the 2020s? An ethical reflection on the trend of automated consultations in health care","volume":"25","author":"Parviainen","year":"2022","journal-title":"Med Health Care Philos"},{"key":"R2-20250801","doi-asserted-by":"crossref","first-page":"562","DOI":"10.3390\/bios12080562","article-title":"Artificial intelligence (AI) and internet of medical things (IoMT) assisted biomedical systems for intelligent healthcare","volume":"12","author":"Manickam","year":"2022","journal-title":"Biosensors (Basel)"},{"key":"R3-20250801","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.csbj.2023.11.058","article-title":"Beyond the Scalpel: Assessing ChatGPT's potential as an auxiliary intelligent virtual assistant in oral surgery","volume":"24","author":"Suarez","year":"2024","journal-title":"Comput Struct Biotechnol J"},{"key":"R5-20250801","doi-asserted-by":"crossref","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","article-title":"Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models","volume":"2","author":"Kung","year":"2023","journal-title":"PLOS Digit Health"},{"key":"R6-20250801","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.5435\/JAAOS-D-23-00396","article-title":"Comparison of ChatGPT-3.5, ChatGPT-4, and orthopaedic resident performance on orthopaedic assessment examinations","volume":"31","author":"Massey","year":"2023","journal-title":"J Am Acad Orthop Surg"},{"key":"R7-20250801","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3928\/01477447-20230922-05","article-title":"The rapid development of artificial intelligence: GPT-4's performance on orthopedic surgery board questions","volume":"47","author":"Hofmann","year":"2024","journal-title":"Orthopedics"},{"key":"R8-20250801","doi-asserted-by":"crossref","first-page":"NP670","DOI":"10.1093\/asj\/sjad134","article-title":"GPT-4: The future of cosmetic procedure consultation?","volume":"43","author":"Sun","year":"2023","journal-title":"Aesthet Surg J"},{"key":"R9-20250801","doi-asserted-by":"crossref","first-page":"e5471","DOI":"10.1097\/GOX.0000000000005471","article-title":"Can AI think like a plastic surgeon? Evaluating GPT-4's clinical judgment in reconstructive procedures of the upper extremity","volume":"11","author":"Leypold","year":"2023","journal-title":"Plast Reconstr Surg Glob Open"},{"key":"R10-20250801","doi-asserted-by":"crossref","first-page":"24730114231195342","DOI":"10.1177\/24730114231195342","article-title":"Republication of \u201ctreatment of hallux valgus deformity using a suture button device: A preliminary report.\u201d","volume":"8","author":"Gonzalez","year":"2023","journal-title":"Foot Ankle Orthop"},{"key":"R11-20250801","doi-asserted-by":"crossref","first-page":"2181052","DOI":"10.1080\/10872981.2023.2181052","article-title":"The future of medical education and research: Is ChatGPT a blessing or blight in disguise?","volume":"28","author":"Arif","year":"2023","journal-title":"Med Educ Online"},{"key":"R12-20250801","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput Surv"},{"key":"R13-20250801","doi-asserted-by":"crossref","first-page":"btae075","DOI":"10.1093\/bioinformatics\/btae075","article-title":"GeneGPT: Augmenting large language models with domain tools for improved access to biomedical information","volume":"40","author":"Jin","year":"2024","journal-title":"Bioinformatics"},{"key":"R14-20250801","doi-asserted-by":"crossref","first-page":"106121","DOI":"10.1016\/j.nedt.2024.106121","article-title":"A scoping review of ChatGPT's role in healthcare education and research","volume":"135","author":"Shorey","year":"2024","journal-title":"Nurse Educ Today"},{"key":"R15-20250801","first-page":"e37432","article-title":"Exploring the boundaries of reality: Investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references","volume":"15","author":"Athaluri","year":"2023","journal-title":"Cureus"},{"key":"R16-20250801","doi-asserted-by":"crossref","first-page":"e9","DOI":"10.2196\/jmir.5729","article-title":"Internet health information seeking and the patient-physician relationship: A systematic review","volume":"19","author":"Tan","year":"2017","journal-title":"J Med Internet Res"},{"key":"R17-20250801","doi-asserted-by":"crossref","first-page":"e19","DOI":"10.2196\/jmir.3588","article-title":"Patient perspectives on online health information and communication with doctors: A qualitative study of patients 50 years old and over","volume":"17","author":"Silver","year":"2015","journal-title":"J Med Internet Res"}],"container-title":["Journal of the American Academy of Orthopaedic Surgeons"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-00595","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T14:49:32Z","timestamp":1787669372000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-00595"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,15]]},"references-count":16,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.5435\/jaaos-d-24-00595","relation":{},"ISSN":["1067-151X","1940-5480"],"issn-type":[{"value":"1067-151X","type":"print"},{"value":"1940-5480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,15]]},"assertion":[{"value":"2024-05-22","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-28","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}