{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:25:06Z","timestamp":1772252706545,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,10]],"date-time":"2019-01-10T00:00:00Z","timestamp":1547078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Text fields in electronic medical records (EMR) contain information on important factors that influence health outcomes, however, they are underutilized in clinical decision making due to their unstructured nature. We analyzed 6497 inpatient surgical cases with 719,308 free text notes from Le Bonheur Children\u2019s Hospital EMR. We used a text mining approach on preoperative notes to obtain a text-based risk score to predict death within 30 days of surgery. In addition, we evaluated the performance of a hybrid model that included the text-based risk score along with structured data pertaining to clinical risk factors. The C-statistic of a logistic regression model with five-fold cross-validation significantly improved from 0.76 to 0.92 when text-based risk scores were included in addition to structured data. We conclude that preoperative free text notes in EMR include significant information that can predict adverse surgery outcomes.<\/jats:p>","DOI":"10.3390\/informatics6010004","type":"journal-article","created":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T04:10:16Z","timestamp":1547179816000},"page":"4","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Unstructured Text in EMR Improves Prediction of Death after Surgery in Children"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0313-9254","authenticated-orcid":false,"given":"Oguz","family":"Akbilgic","sequence":"first","affiliation":[{"name":"UTSHC-ORNL Center for Biomedical Informatics, Department of Pediatrics, Memphis, TN 38103, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0186-5076","authenticated-orcid":false,"given":"Ramin","family":"Homayouni","sequence":"additional","affiliation":[{"name":"Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, MI 48309, USA"},{"name":"Quire Inc., Memphis, TN 38103, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin","family":"Heinrich","sequence":"additional","affiliation":[{"name":"Quire Inc., Memphis, TN 38103, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3195-4857","authenticated-orcid":false,"given":"Max","family":"Langham","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Tennessee Health Science Center, Memphis, TN 38103, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Davis","sequence":"additional","affiliation":[{"name":"UTSHC-ORNL Center for Biomedical Informatics, Department of Pediatrics, Memphis, TN 38103, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,10]]},"reference":[{"key":"ref_1","unstructured":"BS Systems (2011). Health IT and Patient Safety: Building Safer Systems for Better Care, BS Systems."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1440","DOI":"10.1213\/ANE.0b013e318213be52","article-title":"Postoperative mortality in children after 101,885 anesthetics at a tertiary pediatric hospital","volume":"112","author":"Lister","year":"2011","journal-title":"Anesth. Analg."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Akbilgic, O., Langham, M.R., Walter, A.I., Jones, T.L., Huang, E.Y., and Davis, R.L. (2018). A novel risk classification system for 30-day mortality in children undergoing surgery. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0191176"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1097\/ALN.0000000000001343","article-title":"Unplanned, Postoperative Intubation in Pediatric Surgical Patients: Development and Validation of a Multivariable Prediction Model","volume":"125","author":"Cheon","year":"2016","journal-title":"Anesthesiology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1111\/trf.13479","article-title":"Variation in intraoperative and postoperative red blood cell transfusion in pediatric surgery","volume":"56","author":"Stey","year":"2016","journal-title":"Transfusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.jpedsurg.2016.10.037","article-title":"Pediatric surgical readmissions: Are they truly preventable?","volume":"52","author":"Brown","year":"2017","journal-title":"J. Pediatr. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1016\/j.jpedsurg.2014.02.046","article-title":"Optimal Resources for Children\u2019s Surgical Care","volume":"49","author":"Oldham","year":"2015","journal-title":"J. Pediatric Surg."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1016\/j.surg.2015.04.026","article-title":"Identifying children at risk of death within 30 days of surgery at an NSQIP pediatric hospital","volume":"158","author":"Langham","year":"2015","journal-title":"Surgery"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e20172221","DOI":"10.1542\/peds.2017-2221","article-title":"Race, Preoperative Risk Factors, and Death after Surgery","volume":"141","author":"Akbilgic","year":"2018","journal-title":"Pediatrics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1097\/SLA.0000000000002023","article-title":"Path from predictive analytics to improved patient outcomes","volume":"265","author":"Harris","year":"2017","journal-title":"Ann. Surg."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.jamcollsurg.2013.07.385","article-title":"Development and evaluation of the universal ACS NSQIP surgical risk calculator: A decision aid and informed consent tool for patients and surgeons","volume":"217","author":"Bilimoria","year":"2013","journal-title":"J. Am. Coll. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1001\/jama.2015.19417","article-title":"Integrating Predictive Analytics into High-Value Care","volume":"315","author":"Parikh","year":"2016","journal-title":"JAMA"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.13063\/2327-9214.1163","article-title":"Consensus Statement on Electronic Health Predictive Analytics: A Guiding Framework to Address Challenges","volume":"4","author":"Amarasingham","year":"2016","journal-title":"eGEMs"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46226","DOI":"10.1038\/srep46226","article-title":"Analysis of free text in electronic health records for identification of cancer patient trajectories","volume":"7","author":"Jensen","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1586\/erp.13.7","article-title":"Application of electronic medical record data for health outcomes research: A review of recent literature","volume":"13","author":"Lin","year":"2013","journal-title":"Expert Rev. Pharmacoecon. Outcomes Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1197\/jamia.M1552","article-title":"Automated encoding of clinical documents based on natural language processing","volume":"11","author":"Friedman","year":"2004","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zeng, Q.T., Goryachev, S., Weiss, S., Sordo, M., Murphy, S.N., and Lazarus, R. (2006). Extracting principal diagnosis, co-morbidity and smoking status for asthma research: Evaluation of a natural language processing system. BMC Med. Inform. Decis. Mak., 6.","DOI":"10.1186\/1472-6947-6-30"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): Architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6918","DOI":"10.1038\/s41598-017-07111-0","article-title":"TEPAPA: A novel in silico feature learning pipeline for mining prognostic and associative factors from text-based electronic medical records","volume":"7","author":"Lin","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1093\/jamia\/ocv180","article-title":"Extracting information from the text of electronic medical records to improve case detection: A systematic review","volume":"23","author":"Ford","year":"2016","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kim, Y.S., Yoon, D., Byun, J., Park, H., Lee, A., Kim, I.H., Lee, S., Lim, H.S., and Park, R.W. (2017). Extracting information from free-text electronic patient records to identify practice-based evidence of the performance of coronary stents. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0182889"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s00345-013-1040-4","article-title":"Extracting data from electronic medical records: Validation of a natural language processing program to assess prostate biopsy results","volume":"32","author":"Thomas","year":"2014","journal-title":"World J. Urol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"601.e17","DOI":"10.1016\/j.amjmed.2016.12.008","article-title":"Using the Electronic Medical Record to Identify Patients at High Risk for Frequent Emergency Department Visits and High System Costs","volume":"130","author":"Frost","year":"2017","journal-title":"Am. J. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1097\/CCM.0000000000003148","article-title":"Inclusion of Unstructured Clinical Text Improves Early Prediction of Death or Prolonged ICU Stay","volume":"46","author":"Weissman","year":"2018","journal-title":"Crit. Care Med."},{"key":"ref_25","first-page":"848","article-title":"Automated identification of postoperative complications within an electronic medical record using natural language processing","volume":"306","author":"Murff","year":"2011","journal-title":"JAMA"},{"key":"ref_26","unstructured":"(2013). American College of Surgeons National Surgical Quality Improvement Program-Pediatrics User Guide for the ACS NSQIP Pediatric Participant Use File, American College of Surgeons."},{"key":"ref_27","unstructured":"Berry, M., and Browne, M. (1999). Understanding Search Engines: Mathematical Modeling and Text Retrieval, SIAM. [1st ed.]."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics"},{"key":"ref_29","first-page":"26","article-title":"ASA Relative Value Guide (RVG): A Defining Moment in Fair Pricing of Medical Services","volume":"78","author":"Merrick","year":"2014","journal-title":"ASA Monit."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.jamcollsurg.2016.08.542","article-title":"Development and Evaluation of the American College of Surgeons NSQIP Pediatric Surgical Risk Calculator","volume":"223","author":"Kraemer","year":"2016","journal-title":"J. Am. Coll. Surg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1947","DOI":"10.1001\/jama.2013.281425","article-title":"The anatomy of health care in the United States","volume":"310","author":"Moses","year":"2013","journal-title":"JAMA"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/6\/1\/4\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:24:56Z","timestamp":1760185496000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/6\/1\/4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,10]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["informatics6010004"],"URL":"https:\/\/doi.org\/10.3390\/informatics6010004","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201810.0678.v1","asserted-by":"object"}]},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,10]]}}}