{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,19]],"date-time":"2026-04-19T22:24:19Z","timestamp":1776637459613,"version":"3.51.2"},"reference-count":61,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T00:00:00Z","timestamp":1635379200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background: Lactic acidosis is the most common cause of anion gap metabolic acidosis in the intensive care unit (ICU), associated with poor outcomes including mortality. We sought to compare machine learning (ML) approaches versus logistic regression analysis for prediction of mortality in lactic acidosis patients admitted to the ICU. Methods: We used the Medical Information Mart for Intensive Care (MIMIC-III) database to identify ICU adult patients with lactic acidosis (serum lactate \u22654 mmol\/L). The outcome of interest was hospital mortality. We developed prediction models using four ML approaches consisting of random forest (RF), decision tree (DT), extreme gradient boosting (XGBoost), artificial neural network (ANN), and statistical modeling with forward stepwise logistic regression using the testing dataset. We then assessed model performance using area under the receiver operating characteristic curve (AUROC), accuracy, precision, error rate, Matthews correlation coefficient (MCC), F1 score, and assessed model calibration using the Brier score, in the independent testing dataset. Results: Of 1919 lactic acidosis ICU patients, 1535 and 384 were included in the training and testing dataset, respectively. Hospital mortality was 30%. RF had the highest AUROC at 0.83, followed by logistic regression 0.81, XGBoost 0.81, ANN 0.79, and DT 0.71. In addition, RF also had the highest accuracy (0.79), MCC (0.45), F1 score (0.56), and lowest error rate (21.4%). The RF model was the most well-calibrated. The Brier score for RF, DT, XGBoost, ANN, and multivariable logistic regression was 0.15, 0.19, 0.18, 0.19, and 0.16, respectively. The RF model outperformed multivariable logistic regression model, SOFA score (AUROC 0.74), SAP II score (AUROC 0.77), and Charlson score (AUROC 0.69). Conclusion: The ML prediction model using RF algorithm provided the highest predictive performance for hospital mortality among ICU patient with lactic acidosis.<\/jats:p>","DOI":"10.3390\/jcm10215021","type":"journal-article","created":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T23:51:36Z","timestamp":1635465096000},"page":"5021","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Machine Learning Prediction Models for Mortality in Intensive Care Unit Patients with Lactic Acidosis"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6010-0033","authenticated-orcid":false,"given":"Pattharawin","family":"Pattharanitima","sequence":"first","affiliation":[{"name":"Department of Internal Medicine, Faculty of Medicine, Thammasat University, Pathum Thani 12121, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charat","family":"Thongprayoon","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2920-7235","authenticated-orcid":false,"given":"Wisit","family":"Kaewput","sequence":"additional","affiliation":[{"name":"Department of Military and Community Medicine, Phramongkutklao College of Medicine, Bangkok 10400, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fawad","family":"Qureshi","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1117-1350","authenticated-orcid":false,"given":"Fahad","family":"Qureshi","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Missouri-Kansas City, Kansas City, MO 64110, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7633-4029","authenticated-orcid":false,"given":"Tananchai","family":"Petnak","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Pulmonary Critical Care Medicine, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok 10400, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6945-329X","authenticated-orcid":false,"given":"Narat","family":"Srivali","sequence":"additional","affiliation":[{"name":"Division of Pulmonary Medicine, St. Agnes Hospital, Baltimore, MD 21229, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4823-9910","authenticated-orcid":false,"given":"Guido","family":"Gembillo","sequence":"additional","affiliation":[{"name":"Unit of Nephrology and Dialysis, Department of Clinical and Experimental Medicine, University of Messina, 98125 Messina, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oisin A.","family":"O\u2019Corragain","sequence":"additional","affiliation":[{"name":"Department of Thoracic Medicine and Surgery, Temple University Hospital, Philadelphia, PA 19140, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Supavit","family":"Chesdachai","sequence":"additional","affiliation":[{"name":"Division of Infectious Disease, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1631-8238","authenticated-orcid":false,"given":"Saraschandra","family":"Vallabhajosyula","sequence":"additional","affiliation":[{"name":"Section of Cardiovascular Medicine, Department of Medicine, Wake Forest University School of Medicine, Winston-Salem, NC 27101, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pramod K.","family":"Guru","sequence":"additional","affiliation":[{"name":"Critical Care Medicine, Mayo Clinic, Jacksonville, FL 32224, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1814-7003","authenticated-orcid":false,"given":"Michael A.","family":"Mao","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Jacksonville, FL 32224, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vesna D.","family":"Garovic","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John J.","family":"Dillon","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9954-9711","authenticated-orcid":false,"given":"Wisit","family":"Cheungpasitporn","sequence":"additional","affiliation":[{"name":"Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.ccc.2009.12.007","article-title":"Lactic Acidosis: Recognition, Kinetics, and Associated Prognosis","volume":"26","author":"Vernon","year":"2010","journal-title":"Crit. Care Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1097\/01.ccx.0000235208.77450.15","article-title":"Lactate and shock state: The metabolic view","volume":"12","author":"Levy","year":"2006","journal-title":"Curr. Opin. Crit. Care"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1007\/s00134-007-0563-9","article-title":"Serum lactate as a predictor of mortality in patients with infection","volume":"33","author":"Trzeciak","year":"2007","journal-title":"Intensiv. Care Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2369","DOI":"10.1097\/CCM.0b013e3181a0f919","article-title":"Association between blood lactate levels, Sequential Organ Failure Assessment subscores, and 28-day mortality during early and late intensive care unit stay: A retrospective observational study","volume":"37","author":"Jansen","year":"2009","journal-title":"Crit. Care Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1164\/ajrccm.157.4.9705037","article-title":"Mild Hyperlactatemia in Stable Septic Patients Is Due to Impaired Lactate Clearance Rather Than Overproduction","volume":"157","author":"Levraut","year":"1998","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1097\/SHK.0000000000000667","article-title":"Blood Lactate Levels Cutoff and Mortality Prediction in Sepsis\u2014Time for a Reappraisal? A Retrospective Cohort Study","volume":"46","author":"Filho","year":"2016","journal-title":"Shock"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1093\/ckj\/sfv045","article-title":"Lactate clearance and metabolic aspects of continuous high-volume hemofiltration","volume":"8","author":"Cheungpasitporn","year":"2015","journal-title":"Clin Kidney J"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"227","DOI":"10.7326\/0003-4819-92-2-227","article-title":"Lactate Homeostasis and Lactic Acidosis","volume":"92","author":"Kreisberg","year":"1980","journal-title":"Ann. Intern. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0002-9610(97)89552-9","article-title":"Serial blood lactate levels can predict the development of multiple organ failure following septic shock","volume":"171","author":"Bakker","year":"1996","journal-title":"Am. J. Surg."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.injury.2008.07.032","article-title":"Venous glucose and arterial lactate as biochemical predictors of mortality in clinically severely injured trauma patients\u2014A comparison with ISS and TRISS","volume":"40","author":"Sammour","year":"2009","journal-title":"Injury"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1016\/S1072-7515(00)00271-4","article-title":"The utility of venous lactate to triage injured patients in the trauma center","volume":"190","author":"Lavery","year":"2000","journal-title":"J. Am. Coll. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1177\/0310057X1204000404","article-title":"The Interpretation of Perioperative Lactate Abnormalities in Patients Undergoing Cardiac Surgery","volume":"40","author":"Fraser","year":"2012","journal-title":"Anaesth. Intensiv. Care"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"R167","DOI":"10.1186\/cc5113","article-title":"Hyperlactatemia during cardiopulmonary bypass: Determinants and impact on postoperative outcome","volume":"10","author":"Ranucci","year":"2006","journal-title":"Crit. Care"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"E155","DOI":"10.1532\/HSF98.20041002","article-title":"Lactic Acidosis after Cardiac Surgery Is Associated with Adverse Outcome","volume":"7","author":"Toraman","year":"2004","journal-title":"Hear. Surg. Forum"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1016\/j.jtcvs.2015.10.063","article-title":"Frequency and outcomes of severe hyperlactatemia after elective cardiac surgery","volume":"151","author":"Renew","year":"2016","journal-title":"J. Thorac. Cardiovasc. Surg."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1378\/chest.123.5.1361","article-title":"Frequency, Risk Factors, and Outcome of Hyperlactatemia After Cardiac Surgery","volume":"123","author":"Maillet","year":"2003","journal-title":"Chest"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.1016\/S0003-4975(00)02160-3","article-title":"Outcome with high blood lactate levels during cardiopulmonary bypass in adult cardiac operation","volume":"70","author":"Demers","year":"2000","journal-title":"Ann. Thorac. Surg."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ranucci, M., Ballotta, A., Castelvecchio, S., Baryshnikova, E., Brozzi, S., and Boncilli, A. (2010). Intensive Care Unit Admission Parameters Improve the Accuracy of Operative Mortality Predictive Models in Cardiac Surgery. PLoS ONE, 5.","DOI":"10.1371\/journal.pone.0013551"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"R149","DOI":"10.1186\/cc7137","article-title":"Metformin-associated lactic acidosis in an intensive care unit","volume":"12","author":"Peters","year":"2008","journal-title":"Crit. Care"},{"key":"ref_20","first-page":"191","article-title":"Metformin-associated lactic acidosis (MALA): Clinical profile and outcomes in patients admitted to the intensive care unit","volume":"12","author":"Biradar","year":"2010","journal-title":"Crit. Care Resusc."},{"key":"ref_21","first-page":"296","article-title":"Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008","volume":"36","author":"Dellinger","year":"2008","journal-title":"Intensive Care Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1161\/01.CIR.41.6.989","article-title":"Experimental and Clinical Studies on Lactate and Pyruvate as Indicators of the Severity of Acute Circulatory Failure (Shock)","volume":"41","author":"Weil","year":"1970","journal-title":"Circulation"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e0087","DOI":"10.1097\/CCE.0000000000000087","article-title":"The Added Value of Lactate and Lactate Clearance in Prediction of In-Hospital Mortality in Critically Ill Patients With Sepsis","volume":"2","author":"Baysan","year":"2020","journal-title":"Crit. Care Explor."},{"key":"ref_24","first-page":"995","article-title":"Predictive value of lactate in unselected critically ill patients: An analysis using fractional polynomials","volume":"6","author":"Zhang","year":"2014","journal-title":"J. Thorac. Dis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"35368","DOI":"10.1038\/srep35368","article-title":"Prognosis of alcohol-associated lactic acidosis in critically ill patients: An 8-year study","volume":"6","author":"Yang","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1002\/hep.30151","article-title":"Lactate Improves Prediction of Short-Term Mortality in Critically Ill Patients With Cirrhosis: A Multinational Study","volume":"69","author":"Drolz","year":"2019","journal-title":"Hepatology"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hayashi, Y., Endoh, H., Kamimura, N., Tamakawa, T., and Nitta, M. (2020). Lactate indices as predictors of in-hospital mortality or 90-day survival after admission to an intensive care unit in unselected critically ill patients. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0229135"},{"key":"ref_28","first-page":"1","article-title":"From hype to reality: Data science enabling personalized medicine","volume":"16","author":"Balling","year":"2018","journal-title":"BMC Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.pbiomolbio.2019.11.012","article-title":"Supervised and unsupervised algorithms for bioinformatics and data science","volume":"151","author":"Sohail","year":"2020","journal-title":"Prog. Biophys. Mol. Biol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.ijmedinf.2019.02.002","article-title":"Predicting in-hospital mortality of patients with acute kidney injury in the ICU using random forest model","volume":"125","author":"Lin","year":"2019","journal-title":"Int. J. Med. Inform."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1186\/s13054-019-2351-7","article-title":"Emergency department triage prediction of clinical outcomes using machine learning models","volume":"23","author":"Raita","year":"2019","journal-title":"Crit. Care"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1109\/JPROC.2015.2501978","article-title":"Machine Learning and Decision Support in Critical Care","volume":"104","author":"Johnson","year":"2016","journal-title":"Proc. IEEE"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e78","DOI":"10.1016\/S2589-7500(19)30024-X","article-title":"Survival prediction in intensive-care units based on aggregation of long-term disease history and acute physiology: A retrospective study of the Danish National Patient Registry and electronic patient records","volume":"1","author":"Nielsen","year":"2019","journal-title":"Lancet Digit. Health"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"17116","DOI":"10.1038\/s41598-018-35582-2","article-title":"Comparison of machine learning models for the prediction of mortality of patients with unplanned extubation in intensive care units","volume":"8","author":"Hsieh","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1001\/jamaoncol.2020.4331","article-title":"Validation of a Machine Learning Algorithm to Predict 180-Day Mortality for Outpatients With Cancer","volume":"6","author":"Manz","year":"2020","journal-title":"JAMA Oncol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci. Data"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/bjs.9736","article-title":"Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement","volume":"102","author":"Collins","year":"2015","journal-title":"J. Br. Surg."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"105524","DOI":"10.1016\/j.asoc.2019.105524","article-title":"Investigating the impact of data normalization on classification performance","volume":"97","author":"Singh","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1016\/j.jacr.2018.02.026","article-title":"The Pareto Principle","volume":"15","author":"Harvey","year":"2018","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"105536","DOI":"10.1016\/j.cmpb.2020.105536","article-title":"Predictive modeling of blood pressure during hemodialysis: A comparison of linear model, random forest, support vector regression, XGBoost, LASSO regression and ensemble method","volume":"195","author":"Huang","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1093\/pan\/mpv024","article-title":"Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data","volume":"24","author":"Muchlinski","year":"2016","journal-title":"Political Anal."},{"key":"ref_43","first-page":"2546","article-title":"Algorithms for hyper-parameter optimization","volume":"24","author":"Bergstra","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1046\/j.1525-1497.2002.10750.x","article-title":"Simplifying likelihood ratios","volume":"17","author":"McGee","year":"2002","journal-title":"J. Gen. Intern. Med."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1161\/CIRCULATIONAHA.105.594929","article-title":"Receiver-Operating Characteristic Analysis for Evaluating Diagnostic Tests and Predictive Models","volume":"115","author":"Zou","year":"2007","journal-title":"Circulation"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1093\/jamia\/ocz228","article-title":"A tutorial on calibration measurements and calibration models for clinical prediction models","volume":"27","author":"Huang","year":"2020","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","article-title":"MissForest\u2014Non-parametric missing value imputation for mixed-type data","volume":"28","author":"Stekhoven","year":"2012","journal-title":"Bioinformatics"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1007\/s00134-005-2763-5","article-title":"SAPS 3\u2014From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission","volume":"31","author":"Moreno","year":"2005","journal-title":"Intensive Care Med."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e041421","DOI":"10.1136\/bmjopen-2020-041421","article-title":"Variation in model performance by data cleanliness and classification methods in the prediction of 30-day ICU mortality, a US nationwide retrospective cohort and simulation study","volume":"10","author":"Iwashyna","year":"2020","journal-title":"BMJ Open"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.hrtlng.2017.10.009","article-title":"A novel mortality prediction model for the current population in an adult intensive care unit","volume":"47","author":"Fika","year":"2018","journal-title":"Heart Lung"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"103636","DOI":"10.1016\/j.compbiomed.2020.103636","article-title":"Early prediction of ICU readmissions using classification algorithms","volume":"118","author":"Loreto","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1111\/joim.12822","article-title":"eDoctor: Machine learning and the future of medicine","volume":"284","author":"Handelman","year":"2018","journal-title":"J. Intern. Med."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Chik, C., Hayes, G.M., and Menard, J. (2021). Development of a veterinary trauma score (VetCOT) in canine trauma patients with per-formance evaluation and comparison to the animal trauma triage score: A VetCOT registry study. J. Vet. Emerg. Crit. Care.","DOI":"10.1111\/vec.13135"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Kasapo\u011flu, U.S., Ka\u00e7maz, O., G\u00f6k, A., Yildiz Eglen, M., \u015eayan, H., and \u00c7olak, F. (2021). Prognostic factors for 30-days mortality in eighty years aged and older critically ill patients: A single center retrospec-tive cohort study. Turk. J. Med. Sci.","DOI":"10.3906\/sag-2104-359"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Lim, J.-H., Jeon, Y., Ahn, J.-S., Kim, S., Kim, D.K., Lee, J.P., Ryu, D.-R., Seong, E.Y., Ahn, S.Y., and Baek, S.H. (2021). GDF-15 Predicts In-Hospital Mortality of Critically Ill Patients with Acute Kidney Injury Requiring Continuous Renal Replacement Therapy: A Multicenter Prospective Study. J. Clin. Med., 10.","DOI":"10.3390\/jcm10163660"},{"key":"ref_57","first-page":"50","article-title":"Before you make that big decision","volume":"89","author":"Kahneman","year":"2011","journal-title":"Harv. Bus. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1111\/j.1466-8238.2007.00358.x","article-title":"AUC: A misleading measure of the performance of predictive distribution models","volume":"17","author":"Lobo","year":"2008","journal-title":"Glob. Ecol. Biogeogr."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2374289519873088","DOI":"10.1177\/2374289519873088","article-title":"Artificial Intelligence and Machine Learning in Pathology: The Present Landscape of Supervised Methods","volume":"6","author":"Rashidi","year":"2019","journal-title":"Acad. Pathol."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1214\/08-AOS646","article-title":"High-dimensional variable selection","volume":"37","author":"Wasserman","year":"2009","journal-title":"Ann. Stat."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","article-title":"Explainable machine-learning predictions for the prevention of hypoxaemia during surgery","volume":"2","author":"Lundberg","year":"2018","journal-title":"Nat. Biomed. Eng."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/21\/5021\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:21:53Z","timestamp":1760167313000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/21\/5021"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,28]]},"references-count":61,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["jcm10215021"],"URL":"https:\/\/doi.org\/10.3390\/jcm10215021","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,28]]}}}