{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T10:26:34Z","timestamp":1784888794399,"version":"3.55.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T00:00:00Z","timestamp":1753920000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T00:00:00Z","timestamp":1753920000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universit\u00e4tsklinikum Leipzig"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Acta Neurochir"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>In the German medical billing system, surgical departments encode their procedures in OPS-codes. These OPS-codes have major impact on DRG grouping and thus mainly determine each case\u00b4s revenue. In our study, we investigate the ability of the Large Language Model (LLM) GPT to derive correct OPS codes from the surgical report.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>For our study, 100 patients who underwent meningioma surgery at our clinic between 2023 and 2024 were examined. We recorded the OPS codes assigned by the surgeon after the procedure, as well as the final coding by the hospital\u00b4s coders before case closure. In addition, the surgical report was extracted and anonymously provided to GPT-4o and GPT CodeMedic together with the current OPS-catalogue. The coding of each group was analyzed descriptively and compared using the Chi-Square test. Additionally, errors and deviations were assessed and analyzed.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>In our analyses, coders (100%) and surgeons (99%) demonstrated to significantly perform higher than LLMs in <jats:italic>sufficient coding<\/jats:italic>, for which the basic coding must be correct and unquestionable (GPT-4o 78%, GPT CodeMedic 89%; <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.01). For <jats:italic>optimal coding<\/jats:italic>, where every code potentially contributing to increase the revenue must be included, only the coders (94%) achieved superiority (GPT-4o <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.01; GPT CodeMedic <jats:italic>p<\/jats:italic>\u2009=\u20090.02), whereas GPT CodeMedic (83%) even outperformed surgeons (69%) (<jats:italic>p<\/jats:italic>\u2009=\u20090.03). The specialized GPT CodeMedic tends to show fewer hallucinations compared to GPT-4o (7% vs. 15%).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>GPT is capable of extracting OPS codes from surgical reports. The most frequent errors made by LLMs can be attributed to a lack of specialized training. Currently, professional coders still significantly outperform LLMs in <jats:italic>sufficient<\/jats:italic> and <jats:italic>optimal<\/jats:italic> coding. For <jats:italic>optimal<\/jats:italic> coding however, GPT shows to perform comparably to surgeon\u00b4s coding skills. This indicates, that in near future after further training, LLMs may take over this task from surgeons without loss in quality.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Graphical abstract<\/jats:title>\n            <jats:p>Large language models for extraction of OPS-codes from operative reports in meningioma surgery<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s00701-025-06631-3","type":"journal-article","created":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T07:38:13Z","timestamp":1753947493000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Large language models for extraction of OPS-codes from operative reports in meningioma surgery"],"prefix":"10.1007","volume":"167","author":[{"given":"Sebastian","family":"Lehmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"Wilhelmy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikolaus","family":"von Dercks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erdem","family":"G\u00fcresir","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes","family":"Wach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,31]]},"reference":[{"key":"6631_CR1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2024.1457586","author":"Y Abdelgadir","year":"2024","unstructured":"Abdelgadir Y, Thongprayoon C, Miao J et al (2024) AI integration in nephrology: evaluating ChatGPT for accurate ICD-10 documentation and coding. Front Artif Intell. https:\/\/doi.org\/10.3389\/frai.2024.1457586","journal-title":"Front Artif Intell"},{"key":"6631_CR2","doi-asserted-by":"publisher","unstructured":"Al Kuwaiti A, Nazer K, Al-Reedy A et al (2013) A Review of the Role of Artificial Intelligence in Healthcare. J Pers Med\u00a013(6). https:\/\/doi.org\/10.3390\/jpm13060951","DOI":"10.3390\/jpm13060951"},{"issue":"5","key":"6631_CR3","doi-asserted-by":"publisher","first-page":"77","DOI":"10.14797\/mdcvj.1290","volume":"19","author":"HB Arshad","year":"2023","unstructured":"Arshad HB, Butt SA, Khan SU, Javed Z, Nasir K (2023) ChatGPT and artificial intelligence in hospital level research: potential, precautions, and prospects. Methodist Debakey Cardiovasc J 19(5):77\u201384. https:\/\/doi.org\/10.14797\/mdcvj.1290","journal-title":"Methodist Debakey Cardiovasc J"},{"issue":"4","key":"6631_CR4","doi-asserted-by":"publisher","first-page":"e37432","DOI":"10.7759\/cureus.37432","volume":"15","author":"SA Athaluri","year":"2023","unstructured":"Athaluri SA, Manthena SV, Kesapragada VSRKM, Yarlagadda V, Dave T, Duddumpudi RTS (2023) Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus 15(4):e37432. https:\/\/doi.org\/10.7759\/cureus.37432","journal-title":"Cureus"},{"issue":"6","key":"6631_CR5","doi-asserted-by":"publisher","first-page":"1346","DOI":"10.1007\/s12262-023-03727-x","volume":"85","author":"K Bhattacharya","year":"2023","unstructured":"Bhattacharya K, Bhattacharya AS, Bhattacharya N, Yagnik VD, Garg P, Kumar S (2023) ChatGPT in surgical practice\u2014a new kid on the block. Indian J Surg 85(6):1346\u20131349. https:\/\/doi.org\/10.1007\/s12262-023-03727-x","journal-title":"Indian J Surg"},{"key":"6631_CR6","unstructured":"BfArM. OPS Version 2025 Systematisches Verzeichnis. Accessed March 31, 2025. https:\/\/www.dkgev.de\/fileadmin\/default\/BfArM_-_OPS_Version_2025.pdf"},{"key":"6631_CR7","unstructured":"Bundesinstitut f\u00fcr Arzneimittel und Medizinprodukte. (2024) Operationen- und Prozedurenschl\u00fcssel: internationale Klassifikation der Prozeduren in der Medizin. [(OPS)Systematisches Verzeichnis];18. Oktober"},{"key":"6631_CR8","unstructured":"ChatGPT. Published March 4, 2025. Accessed March 4, 2025. https:\/\/chatgpt.com\/g\/g-E3rN5KmCT-codemedic"},{"key":"6631_CR9","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00705-7","author":"H Dong","year":"2022","unstructured":"Dong H, Falis M, Whiteley W et al (2022) Automated clinical coding: what, why, and where we are? NPJ Digit Med. https:\/\/doi.org\/10.1038\/s41746-022-00705-7","journal-title":"NPJ Digit Med"},{"issue":"1","key":"6631_CR10","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1007\/s00701-024-05908-3","volume":"166","author":"D Dubinski","year":"2024","unstructured":"Dubinski D, Won S-Y, Trnovec S et al (2024) Leveraging artificial intelligence in neurosurgery-unveiling ChatGPT for neurosurgical discharge summaries and operative reports. Acta Neurochir 166(1):38. https:\/\/doi.org\/10.1007\/s00701-024-05908-3","journal-title":"Acta Neurochir"},{"issue":"08\/09","key":"6631_CR11","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1055\/s-0034-1398553","volume":"77","author":"T Gaertner","year":"2015","unstructured":"Gaertner T, Lehr F, Blum B, van Essen J (2015) Einheitlichkeit der richtlinienkonformen Begutachtung durch den Medizinischen Dienst der Krankenversicherung bei der Pr\u00fcfung der Kodierung im G-DRG-System. Gesundheitswesen 77:559\u2013564. https:\/\/doi.org\/10.1055\/s-0034-1398553","journal-title":"Gesundheitswesen"},{"issue":"1","key":"6631_CR12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1097\/QMH.0b013e3181ccbcc3","volume":"19","author":"N Goldfield","year":"2010","unstructured":"Goldfield N (2010) The evolution of diagnosis-related groups (DRGs): from its beginnings in case-mix and resource use theory, to its implementation for payment and now for its current utilization for quality within and outside the hospital. Qual Manag Health Care 19(1):3\u201316. https:\/\/doi.org\/10.1097\/QMH.0b013e3181ccbcc3","journal-title":"Qual Manag Health Care"},{"issue":"7","key":"6631_CR13","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1007\/s00103-007-0283-x","volume":"50","author":"B Graubner","year":"2007","unstructured":"Graubner B (2007) ICD und OPS. Historische Entwicklung und aktueller Stand. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz 50(7):932\u2013943. https:\/\/doi.org\/10.1007\/s00103-007-0283-x","journal-title":"Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz"},{"key":"6631_CR14","unstructured":"ICD-10 | CMS. Published July 16, 2025. Accessed July 16, 2025. https:\/\/www.cms.gov\/medicare\/coding-billing\/icd-10-codes"},{"key":"6631_CR15","unstructured":"Klang E, Tessler I, Apakama DU, et al. Assessing Retrieval-Augmented Large Language Model Performance in Emergency Department ICD-10-CM Coding Compared to Human Coders"},{"issue":"1","key":"6631_CR16","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.232741","volume":"311","author":"NC Lehnen","year":"2024","unstructured":"Lehnen NC, Dorn F, Wiest IC et al (2024) Data extraction from free-text reports on mechanical thrombectomy in acute ischemic stroke using ChatGPT: a retrospective analysis. Radiology 311(1):e232741. https:\/\/doi.org\/10.1148\/radiol.232741","journal-title":"Radiology"},{"key":"6631_CR17","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.232741","author":"NC Lehnen","year":"2024","unstructured":"Lehnen NC, Dorn F, Wiest IC et al (2024) Data extraction from free-text reports on mechanical thrombectomy in acute ischemic stroke using ChatGPT: a retrospective analysis. Radiology. https:\/\/doi.org\/10.1148\/radiol.232741","journal-title":"Radiology"},{"issue":"08","key":"6631_CR18","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1055\/a-1219-8245","volume":"58","author":"MM Lerch","year":"2020","unstructured":"Lerch MM, Rathmayer M, Siegmund B et al (2020) Die Grenzen des G-DRG-Systems bei der Abbildung von Komplexit\u00e4t in der Universit\u00e4tsmedizin. Z Gastroenterol 58:747\u2013753. https:\/\/doi.org\/10.1055\/a-1219-8245","journal-title":"Z Gastroenterol"},{"key":"6631_CR19","unstructured":"Mag. Stefan Eichwalder, Leistungskatalog BMSGPK 2025, Bundesministerium f\u00fcr Soziales, Gesundheit, Pflege und Konsumentenschutz (BMSGPK), Stubenring 1, 1010 Wien, 1. J\u00e4nner 2025, OID 1.2.40.0.34.5.229"},{"key":"6631_CR20","unstructured":"Medizinische Klassifikationen zum Download \u2013 bifg. Published July 16, 2025. Accessed July 16, 2025. https:\/\/www.bifg.de\/daten-und-analysen\/klassifikationen"},{"issue":"1","key":"6631_CR21","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1097\/00006123-199001000-00027","volume":"26","author":"E Munoz","year":"1990","unstructured":"Munoz E, Boiardo R, Mulloy K, Goldstein J, Tenenbaum N, Wise L (1990) Economies of scale, physician volume for neurosurgery patients, and the diagnosis-related group prospective hospital payment system. Neurosurgery 26(1):156\u201360. https:\/\/doi.org\/10.1097\/00006123-199001000-00027","journal-title":"Neurosurgery"},{"key":"6631_CR22","doi-asserted-by":"publisher","DOI":"10.3390\/informatics11040084","author":"B Nascimento Teixeira","year":"2024","unstructured":"Nascimento Teixeira B, Leit\u00e3o A, Nascimento G, Campos-Fernandes A, Cercas F (2024) Can ChatGPT support clinical coding using the ICD-10-CM\/PCS? Informatics. https:\/\/doi.org\/10.3390\/informatics11040084","journal-title":"Informatics"},{"key":"6631_CR23","unstructured":"OpenAI, Achiam J, Adler S et al (2023)\u00a0GPT-4 Technical Report. http:\/\/arxiv.org\/pdf\/2303.08774"},{"key":"6631_CR24","unstructured":"Puts S, Zegers CML, Dekker A, Bermejo I. Developing an ICD-10 Coding Assistant: Pilot Study Using RoBERTa and GPT-4 for Term Extraction and Description-Based Code Selection"},{"issue":"1","key":"6631_CR25","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1007\/s10916-025-02149-4","volume":"49","author":"JM Roy","year":"2025","unstructured":"Roy JM, Self DM, Isch E et al (2025) Evaluating large language models for automated CPT code prediction in endovascular neurosurgery. J Med Syst 49(1):15. https:\/\/doi.org\/10.1007\/s10916-025-02149-4","journal-title":"J Med Syst"},{"key":"6631_CR26","unstructured":"Schweizerische Eidgenossenschaft, Schweizerische Operationsklassifikation (CHOP), Systematisches Verzeichnis, Bundesamt f\u00fcr Statistik BFS, Eidgen\u00f6ssisches Departement des Innern EDI, Version 2025, BFS-Nummer 659-2400. Accessed 15, July 2025"},{"key":"6631_CR27","unstructured":"Soroush A, Glicksberg BS, Zimlichman E, et al. Large Language Models Are Poor Medical Coders \u2014 Benchmarking of Medical Code Querying"},{"issue":"8","key":"6631_CR28","doi-asserted-by":"publisher","first-page":"1535","DOI":"10.1111\/jgh.16561","volume":"39","author":"Y Wang","year":"2024","unstructured":"Wang Y, Huang Y, Nimma IR et al (2024) Validation of GPT-4 for clinical event classification: a comparative analysis with ICD codes and human reviewers. J Gastroenterol Hepatol 39(8):1535\u20131543. https:\/\/doi.org\/10.1111\/jgh.16561","journal-title":"J Gastroenterol Hepatol"},{"issue":"6","key":"6631_CR29","doi-asserted-by":"publisher","first-page":"1018","DOI":"10.5603\/cj.97515","volume":"30","author":"S W\u00f3jcik","year":"2023","unstructured":"W\u00f3jcik S, Rulkiewicz A, Pruszczyk P, Lisik W, Pobo\u017cy M, Domienik-Kar\u0142owicz J (2023) Beyond ChatGPT: What does GPT-4 add to healthcare? The dawn of a new era. Cardiol J 30(6):1018\u20131025. https:\/\/doi.org\/10.5603\/cj.97515","journal-title":"Cardiol J"},{"issue":"3","key":"6631_CR30","doi-asserted-by":"publisher","DOI":"10.1002\/ctm2.1216","volume":"13","author":"VW Xue","year":"2023","unstructured":"Xue VW, Lei P, Cho WC (2023) The potential impact of ChatGPT in clinical and translational medicine. Clin Transl Med 13(3):e1216. https:\/\/doi.org\/10.1002\/ctm2.1216","journal-title":"Clin Transl Med"}],"container-title":["Acta Neurochirurgica"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00701-025-06631-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00701-025-06631-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00701-025-06631-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T07:38:17Z","timestamp":1753947497000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00701-025-06631-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,31]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["6631"],"URL":"https:\/\/doi.org\/10.1007\/s00701-025-06631-3","relation":{},"ISSN":["0942-0940"],"issn-type":[{"value":"0942-0940","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,31]]},"assertion":[{"value":"7 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The manuscript has been prepared in accordance with the instructions provided by the authors and has been approved by all of them. All of the requirements set out by the authors have been met and approved by all of them. The authors have no conflicts of interest to declare. All co-authors have seen and agree with the content of the manuscript and there is no financial interest to report. We certify that the submission is original work and is not under review at any other publication.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"Not applicable, as this is a retrospective study and no additional patient data was raised.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human ethics and consent to participate declarations"}},{"value":"The study was conducted in accordance with the Declaration of Helsinki. IRB approval was obtained by the local ethics committee of the University of Leipzig, medical faculty under the chairmanship of Prof. Dr. Dr. Ortrun Riha (No.: 055\/25-ek).","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Institutional review board statement"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"209"}}