{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T06:15:42Z","timestamp":1788934542736,"version":"build-2803163510"},"reference-count":19,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T00:00:00Z","timestamp":1712620800000},"content-version":"vor","delay-in-days":39,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009708","name":"Novo Nordisk Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100009708","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Postoperative complication rates are often assessed through administrative data, although this method has proven to be imprecise. Recently, new developments in natural language processing have shown promise in detecting specific phenotypes from free medical text. Using the clinical challenge of extracting four specific and frequently undercoded postoperative complications (pneumonia, urinary tract infection, sepsis, and septic shock), it was hypothesized that natural language processing would capture postoperative complications on a par with human-level curation from electronic health record free medical text.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Electronic health record data were extracted for surgical cases (across 11 surgical sub-specialties) from 18 hospitals in the Capital and Zealand regions of Denmark that were performed between May 2016 and November 2021. The data set was split into training\/validation\/test sets (30.0%\/48.0%\/22.0%). Model performance was compared with administrative data and manual extraction of the test data set.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Data were obtained for 17 486 surgical cases. Natural language processing achieved a receiver operating characteristic area under the curve of 0.989 for urinary tract infection, 0.993 for pneumonia, 0.992 for sepsis, and 0.998 for septic shock, whereas administrative data achieved a receiver operating characteristic area under the curve of 0.595 for urinary tract infection, 0.624 for pneumonia, 0.571 for sepsis, and 0.625 for septic shock.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>The natural language processing approach was able to capture complications with acceptable performance, which was superior to administrative data. In addition, the model performance approached that of manual curation and thereby offers a potential pathway for complete real-time coverage of postoperative complications across surgical procedures based on natural language processing assessment of electronic health record free medical text.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bjsopen\/zrae020","type":"journal-article","created":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T22:00:50Z","timestamp":1712700050000},"source":"Crossref","is-referenced-by-count":14,"title":["Assessing the utility of natural language processing for detecting postoperative complications from free medical text"],"prefix":"10.1093","volume":"8","author":[{"given":"Emilie Even","family":"Dencker","sequence":"first","affiliation":[{"name":"Department of Organ Surgery and Transplantation, Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"},{"name":"Center for Surgical Translational and Artificial Intelligence Research (CSTAR), Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Bonde","sequence":"additional","affiliation":[{"name":"Department of Organ Surgery and Transplantation, Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"},{"name":"Center for Surgical Translational and Artificial Intelligence Research (CSTAR), Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"},{"name":"Aiomic Aps , Copenhagen , Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anders","family":"Troelsen","sequence":"additional","affiliation":[{"name":"Department of Orthopaedics, Copenhagen University Hospital , Hvidovre, Hvidovre , Denmark"},{"name":"Institute of Clinical Medicine, University of Copenhagen Medical School, Copenhagen, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9494-5475","authenticated-orcid":false,"given":"Martin","family":"Sillesen","sequence":"additional","affiliation":[{"name":"Department of Organ Surgery and Transplantation, Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"},{"name":"Center for Surgical Translational and Artificial Intelligence Research (CSTAR), Copenhagen University Hospital , Rigshospitalet, Copenhagen , Denmark"},{"name":"Institute of Clinical Medicine, University of Copenhagen Medical School, Copenhagen, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,4,9]]},"reference":[{"key":"2024043010015193200_zrae020-B1","first-page":"199","article-title":"The American College of Surgeons National Surgical Quality Improvement Program: achieving better and safer surgery","volume":"41","author":"Ko","year":"2015","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2024043010015193200_zrae020-B2","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1097\/SLA.0000000000004354","article-title":"Accelerating surgical site infection abstraction with a semi-automated machine-learning approach","volume":"276","author":"Skube","year":"2022","journal-title":"Ann Surg"},{"key":"2024043010015193200_zrae020-B3","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1016\/j.surg.2005.08.015","article-title":"Surgeon compensation: \u201cpay for performance,\u201d the American College of Surgeons National Surgical Quality Improvement Program, the Surgical Care Improvement Program, and other considerations","volume":"138","author":"Jones","year":"2005","journal-title":"Surgery"},{"key":"2024043010015193200_zrae020-B4","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1016\/j.jamcollsurg.2007.01.013","article-title":"The American College of Surgeons\u2019 closed claims study: new insights for improving care","volume":"204","author":"Griffen","year":"2007","journal-title":"J Am Coll Surg"},{"key":"2024043010015193200_zrae020-B5","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.yasu.2010.05.003","article-title":"Quality improvement in surgery: the American College of Surgeons National Surgical Quality Improvement Program approach","volume":"44","author":"Ingraham","year":"2010","journal-title":"Adv Surg"},{"key":"2024043010015193200_zrae020-B6","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.ijsu.2020.07.017","article-title":"Trauma of major surgery: a global problem that is not going away","volume":"81","author":"Dobson","year":"2020","journal-title":"Int J Surg"},{"key":"2024043010015193200_zrae020-B7","doi-asserted-by":"crossref","first-page":"S11","DOI":"10.1016\/S0140-6736(15)60806-6","article-title":"Estimate of the global volume of surgery in 2012: an assessment supporting improved health outcomes","volume":"385","author":"Weiser","year":"2015","journal-title":"Lancet"},{"key":"2024043010015193200_zrae020-B8","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.amjsurg.2012.11.009","article-title":"Surgical adverse events: a systematic review","volume":"206","author":"Anderson","year":"2013","journal-title":"Am J Surg"},{"key":"2024043010015193200_zrae020-B9","doi-asserted-by":"crossref","first-page":"1422","DOI":"10.1177\/000313481808400943","article-title":"Preventable complications and deaths after emergency nontrauma surgery","volume":"84","author":"Linnebur","year":"2018","journal-title":"Am Surg"},{"key":"2024043010015193200_zrae020-B10","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1097\/00005650-200210000-00004","article-title":"Can administrative data be used to compare postoperative complication rates across hospitals?","volume":"40","author":"Romano","year":"2002","journal-title":"Med Care"},{"key":"2024043010015193200_zrae020-B11","doi-asserted-by":"crossref","first-page":"105718","DOI":"10.1016\/j.clineuro.2020.105718","article-title":"Using artificial intelligence (AI) to predict postoperative surgical site infection: a retrospective cohort of 4046 posterior spinal fusions","volume":"192","author":"Hopkins","year":"2020","journal-title":"Clin Neurol Neurosurg"},{"key":"2024043010015193200_zrae020-B12","doi-asserted-by":"crossref","first-page":"1249835","DOI":"10.3389\/fdgth.2023.1249835","article-title":"Assessing the utility of deep neural networks in detecting superficial surgical site infections from free text electronic health record data","volume":"5","author":"Bonde","year":"2023","journal-title":"Front Digit Health"},{"key":"2024043010015193200_zrae020-B13","author":"Ke"},{"key":"2024043010015193200_zrae020-B14","doi-asserted-by":"crossref","first-page":"1072273","DOI":"10.3389\/fphys.2023.1072273","article-title":"Blood pressure stratification using photoplethysmography and light gradient boosting machine","volume":"14","author":"Hu","year":"2023","journal-title":"Front Physiol"},{"key":"2024043010015193200_zrae020-B15","first-page":"130","article-title":"Decision tree methods: applications for classification and prediction","volume":"27","author":"Song","year":"2015","journal-title":"Shanghai Arch Psychiatry"},{"key":"2024043010015193200_zrae020-B16","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1109\/TNNLS.2020.2979670","article-title":"A survey of the usages of deep learning in natural language processing","volume":"32","author":"Otter","year":"2018","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"2024043010015193200_zrae020-B17","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1055\/s-0038-1626725","article-title":"Development and validation of a natural language processing tool to identify patients treated for pneumonia across VA emergency departments","volume":"9","author":"Jones","year":"2018","journal-title":"Appl Clin Inform"},{"key":"2024043010015193200_zrae020-B18","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1097\/SLA.0000000000004419","article-title":"Natural language processing in surgery: a systematic review and meta-analysis","volume":"273","author":"Mellia","year":"2021","journal-title":"Ann Surg"},{"key":"2024043010015193200_zrae020-B19","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1097\/SLA.0b013e318230010a","article-title":"Cost-effectiveness of the National Surgical Quality Improvement Program","volume":"254","author":"Hollenbeak","year":"2011","journal-title":"Ann Surg"}],"container-title":["BJS Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bjsopen\/article-pdf\/8\/2\/zrae020\/57339677\/zrae020.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjsopen\/article-pdf\/8\/2\/zrae020\/57339677\/zrae020.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,30]],"date-time":"2024-04-30T10:04:24Z","timestamp":1714471464000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bjsopen\/article\/doi\/10.1093\/bjsopen\/zrae020\/7642781"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":19,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bjsopen\/zrae020","relation":{},"ISSN":["2474-9842"],"issn-type":[{"value":"2474-9842","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,4]]},"published":{"date-parts":[[2024,3,1]]},"article-number":"zrae020"}}