{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T14:09:38Z","timestamp":1788703778806,"version":"build-2803163510"},"reference-count":24,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T00:00:00Z","timestamp":1788652800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T00:00:00Z","timestamp":1788652800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["arthroscopyjournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Arthroscopy"],"abstract":"\n Purpose<\/jats:title>\n To elucidate Mistral\u2010NeMo's proficiency as a novel artificial intelligence assistant to verify coding accuracy and improve efficiency in manual medical coding practices in orthopaedic surgery.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This study tested Mistral\u2010NeMo on 1000 operative notes labeled with the Current Procedural Terminology (CPT) codes from 177 providers. In total, there were 46 unique CPT codes; the most common were 29881 (knee arthroscopy with meniscectomy for both medial and lateral menisci), 29880 (knee arthroscopy with meniscectomy for 1 meniscus), and 29888 (ACL repair\/reconstruction). Each model prompt included an operative note with either the true CPT code associated with the note or a randomly selected incorrect CPT code to serve as positive or negative controls. Trials asked the model for either a binary \u201cYes\/No\u201d response or a confidence score (0\u2010100).<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The results from the binary\u2010response trials showed that the Mistral\u2010NeMo model correctly identified 90% (n\u2009=\u20091000) of the correct CPT codes for each operative note and rejected 99.80% (n\u2009=\u20091000) of incorrect codes (\n P<\/jats:italic>\n \u2009<\u2009.001). The model achieved a precision of 99.80% and a recall of 90% under the testing framework. The model's performance was subanalyzed for the most common CPT codes, 29881, 29880, and 29888, accounting for 747 of the total operative notes. The model labeled the notes with these CPT codes with accuracy of 95.60% (n\u2009=\u2009430), 95.50% (n\u2009=\u2009160), and 82.50% (n\u2009=\u2009157), respectively (\n P<\/jats:italic>\n \u2009<\u2009.001). Among the confidence score trials, Mistral\u2010NeMo showed an area under the operating curve of 0.96 and 0.97, indicating high classification ability.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The Mistral\u2010NeMo language model showed high accuracy in classifying CPT codes for femur\u2010 and knee\u2010related surgical operative notes when CPT billing descriptions were provided. In contrast, model performance was insignificant in the absence of billing descriptions, indicating dependence on contextual information for accurate classification.<\/jats:p>\n <\/jats:sec>\n \n Clinical Relevance<\/jats:title>\n This study assesses the performance of artificial intelligence, specifically the Mistral\u2010NeMo language model, in the role of assisting in automating the billing process. Incidental coding error, along with the overall demands of billing, place a significant burden on both clinicians and administrative staff that divert their attention away from patient care. Investigation of artificial intelligence\u2010based techniques enables automated validation of billing codes. Reducing coding errors has the potential to enhance clinical workflow and decrease the administrative burden on surgical practices.<\/jats:p>\n <\/jats:sec>","DOI":"10.1002\/arj.70480","type":"journal-article","created":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T13:34:02Z","timestamp":1788701642000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Artificial Intelligence Accurately Assists in Billing for Orthopaedic Lower Extremity Surgery: Performance of the Mistral\u2010NeMo Language Model"],"prefix":"10.1002","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0153-8518","authenticated-orcid":false,"given":"Michael","family":"Li","sequence":"first","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1704-0431","authenticated-orcid":false,"given":"Sri","family":"Guttikonda","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yash","family":"Lahoti","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7111-3948","authenticated-orcid":false,"given":"Miriam","family":"Sheetz","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery SUNY Downstate Health Sciences University Brooklyn New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ula","family":"Isleem","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7511-2486","authenticated-orcid":false,"given":"Samuel K.","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6114-2673","authenticated-orcid":false,"given":"Jun S.","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery Icahn School of Medicine at Mount Sinai New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,6]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1136\/neurintsurg-2014-011156","article-title":"Current procedural terminology; A primer","volume":"7","author":"Hirsch JA","year":"2015","journal-title":"J Neurointerv Surg."},{"key":"e_1_2_7_3_1","first-page":"8","article-title":"Physician coding and reimbursement","volume":"7","author":"Beck DE","year":"2007","journal-title":"Ochsner J."},{"key":"e_1_2_7_4_1","first-page":"28","article-title":"Stealth downcoding and what you can do about it","volume":"20","author":"McKinnon P","year":"2004","journal-title":"J Med Pract Manage."},{"key":"e_1_2_7_5_1","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1056\/NEJMp058011","article-title":"Overbilling vs. downcoding\u2014The battle between physicians and insurers","volume":"352","author":"Kesselheim AS","year":"2005","journal-title":"N Engl J Med."},{"key":"e_1_2_7_6_1","first-page":"2023","volume-title":"U.S. Medical Coding Market Size, Share & Trends Analysis Report By Classification System (ICD, HCPCS, CPT), By Component, By Medical Specialty, And Segment Forecasts","author":"Grand View Research","year":"2023"},{"key":"e_1_2_7_7_1","first-page":"184","article-title":"Accuracy of CPT evaluation and management coding by family physicians","volume":"14","author":"King MS","year":"2001","journal-title":"J Am Board Fam Pract."},{"key":"e_1_2_7_8_1","doi-asserted-by":"crossref","first-page":"102720","DOI":"10.1016\/j.amjoto.2020.102720","article-title":"Impact of a specialty trained billing team on an academic otolaryngology practice","volume":"41","author":"Plawecki AM","year":"2020","journal-title":"Am J Otolaryngol."},{"key":"e_1_2_7_9_1","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1016\/j.jvs.2016.02.052","article-title":"A multidisciplinary approach to vascular surgery procedure coding improves coding accuracy, work relative value unit assignment, and reimbursement","volume":"64","author":"Aiello FA","year":"2016","journal-title":"J Vasc Surg."},{"key":"e_1_2_7_10_1","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.jamcollsurg.2016.11.010","article-title":"Implementation of a Clinical Documentation Improvement Curriculum improves quality metrics and hospital charges in an academic surgery department","volume":"224","author":"Reyes C","year":"2017","journal-title":"J Am Coll Surg."},{"key":"e_1_2_7_11_1","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1038\/s41746-023-00768-0","article-title":"Automating the overburdened clinical coding system: Challenges and next steps","volume":"6","author":"Venkatesh KP","year":"2023","journal-title":"NPJ Digit Med."},{"key":"e_1_2_7_12_1","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1177\/21925682211062831","article-title":"Can natural language processing and artificial intelligence automate the generation of billing codes from operative note dictations?","volume":"13","author":"Kim JS","year":"2023","journal-title":"Global Spine J."},{"key":"e_1_2_7_13_1","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1177\/21925682231224753","article-title":"Artificially intelligent billing in spine surgery: An analysis of a large language model","volume":"15","author":"Zaidat B","year":"2025","journal-title":"Global Spine J."},{"key":"e_1_2_7_14_1","doi-asserted-by":"crossref","first-page":"e5939","DOI":"10.1097\/GOX.0000000000005939","article-title":"Current applications of artificial intelligence in billing practices and clinical plastic surgery","volume":"12","author":"Zhu C","year":"2024","journal-title":"Plast Reconstr Surg Glob Open."},{"key":"e_1_2_7_15_1","unstructured":"MistralAI.Mistral NeMo: Our new best small model. Published online2024.https:\/\/mistral.ai\/news\/mistral\u2010nemo. Accessed on December 28 2025."},{"key":"e_1_2_7_16_1","unstructured":"RadfordA NarasimhanK SalimansT SutskeverI. Improving language understanding by generative pre\u2010training. OpenAI Technical Report.2018.https:\/\/cdn.openai.com\/research\u2010covers\/language\u2010unsupervised\/language_understanding_paper.pdf. Accessed December 30 2025."},{"key":"e_1_2_7_17_1","unstructured":"Artificial Analysis.GPT\u20105 benchmarks and analysis. Artificial analysis articles. Published August 7 2025.https:\/\/artificialanalysis.ai\/articles\/gpt\u20105\u2010benchmarks\u2010and\u2010analysis. Accessed December 30 2025."},{"key":"e_1_2_7_18_1","doi-asserted-by":"crossref","first-page":"1622292","DOI":"10.3389\/frai.2025.1622292","article-title":"Survey and analysis of hallucinations in large language models: Attribution to prompting strategies or model behavior","volume":"8","author":"Anh\u2010Hoang D","year":"2025","journal-title":"Front Artif Intell."},{"key":"e_1_2_7_19_1","doi-asserted-by":"crossref","first-page":"7346","DOI":"10.18653\/v1\/2024.findings-emnlp.432","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2024","author":"Renze M","year":"2024"},{"key":"e_1_2_7_20_1","doi-asserted-by":"crossref","unstructured":"TianK MitchellE ZhouA et al.Just ask for calibration: Strategies for eliciting calibrated confidence scores from language models fine\u2010tuned with human feedback. arXiv preprint.2023.https:\/\/arxiv.org\/abs\/2302.13419.","DOI":"10.18653\/v1\/2023.emnlp-main.330"},{"key":"e_1_2_7_21_1","unstructured":"YangD TsaiY\u2010HH YamadaM.On verbalized confidence scores for LLMs. arXiv preprint.2024.https:\/\/arxiv.org\/abs\/2412.14737."},{"key":"e_1_2_7_22_1","doi-asserted-by":"crossref","first-page":"E617","DOI":"10.9778\/cmajo.20170036","article-title":"Coder perspectives on physician\u2010related barriers to producing high\u2010quality administrative data: A qualitative study","volume":"5","author":"Tang KL","year":"2017","journal-title":"CMAJ Open"},{"key":"e_1_2_7_23_1","first-page":"e37432","article-title":"Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references","volume":"15","author":"Athaluri SA","year":"2023","journal-title":"Cureus"},{"key":"e_1_2_7_24_1","doi-asserted-by":"crossref","first-page":"w533","DOI":"10.1377\/hlthaff.28.4.w533","article-title":"What does it cost physician practices to interact with health insurance plans?","volume":"28","author":"Casalino LP","year":"2009","journal-title":"Health Aff (Millwood)"},{"key":"e_1_2_7_25_1","volume-title":"Case Log Guidelines for Orthopaedic Trauma","author":"Accreditation Council for Graduate Medical Education (ACGME)","year":"2015"}],"container-title":["Arthroscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/arj.70480","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/arj.70480","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/arj.70480","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,6]],"date-time":"2026-09-06T13:34:06Z","timestamp":1788701646000},"score":1,"resource":{"primary":{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/10.1002\/arj.70480"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,6]]},"references-count":24,"alternative-id":["10.1002\/arj.70480"],"URL":"https:\/\/doi.org\/10.1002\/arj.70480","archive":["Portico"],"relation":{},"ISSN":["0749-8063","1526-3231"],"issn-type":[{"value":"0749-8063","type":"print"},{"value":"1526-3231","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,6]]},"assertion":[{"value":"2025-09-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-06","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"arj.70480"}}