{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T02:07:22Z","timestamp":1780366042146,"version":"3.54.1"},"reference-count":26,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T00:00:00Z","timestamp":1780358400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Artificial intelligence is gaining significant traction, particularly in the orthopedic literature. To date, there has been no published literature on the use of specific military AI tools such as NIPR-GPT. The accuracy, reliability, and clinical validity of these systems in answering common patient questions about orthopedic pathology remains unknown. The primary objective of this study was to evaluate the reliability of a military-specific AI chatbot (i.e., NIPR-GPT) as sources of patient education for anterior cruciate ligament (ACL) tears. No prior studies have evaluated military-specific generative AI platforms for orthopedic patient education.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>A list of 12 frequently asked ACL related questions was compiled from the top orthopedic institutes in the United States. The questions were then subcategorized into 6 themes (2 questions per theme): \u201cunderstanding the diagnosis,\u201d \u201cnonsurgical treatment options,\u201d \u201csurgical indications,\u201d \u201csurgical techniques,\u201d \u201cpotential complications,\u201d and \u201cpostoperative recovery and outcomes.\u201d Each question was input into NIPR-GPT. The exact responses were recorded and then subsequently transcribed and formatted for review. A panel of 5 subspecialty trained orthopedic surgeons evaluated the responses based on the level of clarification needed to adequately answer the question. A rating of excellent was given if no clarification was required, satisfactory with minimal clarification (1-2 clarifications needed), satisfactory with moderate clarification (3-4 clarifications needed), or unsatisfactory (&amp;gt;4 clarifications required or inclusion of notable false\/misleading information). The Interclass Correlation Coefficient (ICC) was calculated for inter-rater reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Of the 60 total ratings, the surgeons graded 27 (45%) responses as excellent, 28 (47%) as satisfactory with minimal clarification, 2 (3%) as satisfactory with moderate clarification, and 3 (5%) as unsatisfactory. Among answers requiring clarification, 75% contained inaccurate or misleading content, 32% omitted critical information, 18% were overly general, and 7% were outdated (non-exclusive categories). When sub-analyzing each theme, the highest average scores were seen in \u201csurgical indications\u201d (3.7\/4) and \u201cdiagnosis\u201d (3.6\/4), while \u201csurgical techniques\u201d scored the lowest (2.7\/4). The ICC for surgeon responses was 0.52, indicating moderate inter-rater reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>NIPR-GPT provides good to excellent responses to frequently asked questions about ACL tears. It was particularly strong in \u201csurgical indications\u201d and \u201cunderstanding the diagnosis\u201d of ACL tears. This AI chatbot was weakest in explaining \u201csurgical techniques.\u201d There was moderate agreement amongst clinicians regarding these responses which may be limited to complexity and nuance of the questions along with personal or training biases. NIPR-GPT provides a starting point for patient education in ACL tears.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/milmed\/usag261","type":"journal-article","created":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T11:45:36Z","timestamp":1779277536000},"source":"Crossref","is-referenced-by-count":0,"title":["Assessing Military Artificial Intelligence Responses to Anterior Cruciate Ligament Injury Frequently Asked Questions"],"prefix":"10.1093","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7580-8906","authenticated-orcid":false,"given":"Andrew J","family":"Rosso","sequence":"first","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harrison","family":"Diaz","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Baglien","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery, Massachusetts General Hospital , Boston, MA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Putko","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Perry","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gregory \u201cJake\u201d","family":"Hall","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Smith","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucas S","family":"McDonald","sequence":"additional","affiliation":[{"name":"Deptartment of Orthopaedic Surgery, Naval Medical Center San Diego , San Diego, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,6,2]]},"reference":[{"key":"2026060121550945400_usag261-B1","doi-asserted-by":"publisher","first-page":"2328","DOI":"10.4103\/jfmpc.jfmpc_440_19","article-title":"Overview of artificial intelligence in medicine","volume":"8","author":"Malik","year":"2019","journal-title":"J Fam Med Prim Care"},{"key":"2026060121550945400_usag261-B2","doi-asserted-by":"publisher","first-page":"374","author":"Amirian","DOI":"10.1109\/CSCE60160.2023.00230"},{"key":"2026060121550945400_usag261-B3","doi-asserted-by":"publisher","first-page":"926","DOI":"10.1002\/ase.2270","article-title":"The rise of ChatGPT: Exploring its potential in medical education","volume":"17","author":"Lee","year":"2024","journal-title":"Anat Sci Educ"},{"key":"2026060121550945400_usag261-B4","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1109\/SIEDS58326.2023.10137850","volume-title":"2023 Systems and Information Engineering Design Symposium (SIEDS)","author":"Bahrini","year":"2023"},{"key":"2026060121550945400_usag261-B5","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1302\/2046-3758.127.BJR-2023-0111.R1","article-title":"Artificial intelligence in orthopaedic surgery","volume":"12","author":"Lisacek-Kiosoglous","year":"2023","journal-title":"Bone Joint Res"},{"key":"2026060121550945400_usag261-B6","doi-asserted-by":"publisher","first-page":"347","DOI":"10.4055\/cios23181","article-title":"Application of ChatGPT for orthopedic surgeries and patient care","volume":"16","author":"Morya","year":"2024","journal-title":"Clin Orthop Surg"},{"key":"2026060121550945400_usag261-B7","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1097\/CORR.0000000000002704","article-title":"Can artificial intelligence pass the American board of orthopaedic surgery examination? Orthopaedic residents versus ChatGPT","volume":"481","author":"Lum","year":"2023","journal-title":"Clin Orthop Relat Res"},{"key":"2026060121550945400_usag261-B8","doi-asserted-by":"publisher","first-page":"e0000205","DOI":"10.1371\/journal.pdig.0000205","article-title":"ChatGPT passing USMLE shines a spotlight on the flaws of medical education","volume":"2","author":"Mbakwe","year":"2023","journal-title":"PLOS Digit Health"},{"key":"2026060121550945400_usag261-B9","doi-asserted-by":"publisher","first-page":"2260","DOI":"10.1097\/CORR.0000000000002668","article-title":"Can artificial intelligence improve the readability of patient education materials?","volume":"481","author":"Kirchner","year":"2023","journal-title":"Clin Orthop Relat Res"},{"key":"2026060121550945400_usag261-B10","year":"2025"},{"key":"2026060121550945400_usag261-B11"},{"key":"2026060121550945400_usag261-B12"},{"key":"2026060121550945400_usag261-B13"},{"key":"2026060121550945400_usag261-B14"},{"key":"2026060121550945400_usag261-B15"},{"key":"2026060121550945400_usag261-B16"},{"key":"2026060121550945400_usag261-B17"},{"key":"2026060121550945400_usag261-B18"},{"key":"2026060121550945400_usag261-B19","author":"Administrator"},{"key":"2026060121550945400_usag261-B20"},{"key":"2026060121550945400_usag261-B21","author":"American Academy of Orthopaedic Surgeons","year":"2023"},{"key":"2026060121550945400_usag261-B22"},{"key":"2026060121550945400_usag261-B23","year":"2025"},{"key":"2026060121550945400_usag261-B24","doi-asserted-by":"publisher","first-page":"1519","DOI":"10.2106\/JBJS.23.00209","article-title":"Assessing ChatGPT responses to common patient questions regarding total hip arthroplasty","volume":"105","author":"Mika","year":"2023","journal-title":"J Bone Joint Surg Am"},{"key":"2026060121550945400_usag261-B25","doi-asserted-by":"publisher","first-page":"2058","DOI":"10.1016\/j.arthro.2023.12.009","article-title":"ChatGPT responses to common questions about anterior cruciate ligament reconstruction are frequently satisfactory","volume":"40","author":"Li","year":"2024","journal-title":"Arthroscopy"},{"key":"2026060121550945400_usag261-B26","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1001\/jamainternmed.2023.1838","article-title":"Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum","volume":"183","author":"Ayers","year":"2023","journal-title":"JAMA Intern Med"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/milmed\/advance-article-pdf\/doi\/10.1093\/milmed\/usag261\/68445850\/usag261.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/milmed\/advance-article-pdf\/doi\/10.1093\/milmed\/usag261\/68445850\/usag261.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T01:55:14Z","timestamp":1780365314000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/advance-article\/doi\/10.1093\/milmed\/usag261\/8699573"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,2]]},"references-count":26,"URL":"https:\/\/doi.org\/10.1093\/milmed\/usag261","relation":{},"ISSN":["0026-4075","1930-613X"],"issn-type":[{"value":"0026-4075","type":"print"},{"value":"1930-613X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,2]]},"article-number":"usag261"}}