{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T09:00:29Z","timestamp":1770973229053,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T00:00:00Z","timestamp":1600646400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T00:00:00Z","timestamp":1600646400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Acute Kidney Injury (AKI) is a shared complication among Intensive Care Unit (ICU), marked by high cost, high morbidity and high mortality. As the early prediction of AKI is critical for patients\u2019 outcomes and data mining is such a powerful prediction tool, many AKI prediction models based on machine learning methods have been proposed. Our motivation is inspired by the fact that the incidence of AKI is a changing temporal sequence affected by the joint action of patients\u2019 daily drug combinations and their physiological indexes. However, most existing models have not considered such a temporal correlation. Besides, due to great challenges caused by sparse, high-dimensional and highly imbalanced clinical data, it is hard to achieve ideal performance.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>We develop a fast, simple and less-costly model based on an ensemble learning algorithm, named Ensemble Time Series Model (ETSM). Besides benefiting from vital signs and laboratory results as explicit indicators, ETSM explores the effect of drug combinations as possible implicit indicators for the AKI prediction. The model transforms temporal medication information into a multidimensional vector to consider and measure drug cumulative effects that may cause AKI.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>We compare ETSM with state-of-the-art models on ICUC and MIMIC III datasets. On the basis of the experimental results, our model obtains satisfactory performance (ICUC: AUC 24 hours ahead: 0.81, 48 hours ahead: 0.78; MIMIC III: AUC 24 hours ahead: 0.95, 48 hours ahead: 0.95). Meanwhile, we compare the effects of different sampling and feature generation methods on the model performance. In the ablation study, we validate that medication information improves model performance (24 hours ahead: AUC increased from 0.74 to 0.81). We also find that the model\u2019s performance is closely related to the balanced level of the derivation dataset. The optimal ratio of major class size to minor class size for the model is found for AKI prediction.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>ETSM is an effective method for the early prediction of AKI. The model verifies that AKI incidence is related to the clinical medication. In comparison with other prediction methods, ETSM provides comparable performance results and better interpretability.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12911-020-01245-4","type":"journal-article","created":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T12:03:26Z","timestamp":1600689806000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Utilizing imbalanced electronic health records to predict acute kidney injury by ensemble learning and time series model"],"prefix":"10.1186","volume":"20","author":[{"given":"Yuan","family":"Wang","sequence":"first","affiliation":[]},{"given":"Yake","family":"Wei","sequence":"additional","affiliation":[]},{"given":"Hao","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Jingwei","family":"Li","sequence":"additional","affiliation":[]},{"given":"Yubo","family":"Zhou","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7470-8429","authenticated-orcid":false,"given":"Qin","family":"Wu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,21]]},"reference":[{"issue":"9","key":"1245_CR1","doi-asserted-by":"publisher","first-page":"1421","DOI":"10.1007\/s00134-017-4874-1","volume":"43","author":"M Schetz","year":"2017","unstructured":"Schetz M, Schneider A. Focus on acute kidney injury. Intensive Care Med. 2017; 43(9):1421\u20133.","journal-title":"Intensive Care Med"},{"issue":"7","key":"1245_CR2","doi-asserted-by":"publisher","first-page":"813","DOI":"10.1001\/jama.294.7.813","volume":"294","author":"S Uchino","year":"2005","unstructured":"Uchino S, Kellum J, Bellomo R, Doig G, Morimatsu H, Morgera S, Schetz M, Tan I, Bouman C, Macedo E, et al. Acute renal failure in critically ill patients: a multinational, multicenter study. Jama. 2005; 294(7):813\u20138.","journal-title":"Jama"},{"key":"1245_CR3","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.jbi.2018.09.009","volume":"86","author":"Y Xue","year":"2018","unstructured":"Xue Y, Liang H, Norbury J, Gillis R, Killingworth B. Predicting the risk of acute care readmissions among rehabilitation inpatients: A machine learning approach. J Biomed Inform. 2018; 86:143\u20138.","journal-title":"J Biomed Inform"},{"issue":"7","key":"1245_CR4","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1513\/AnnalsATS.201710-787OC","volume":"15","author":"J Rojas","year":"2018","unstructured":"Rojas J, Carey K, Edelson D, Venable L, Howell M, Churpek M. Predicting intensive care unit readmission with machine learning using electronic health record data. Ann Am Thorac Soc. 2018; 15(7):846\u201353.","journal-title":"Ann Am Thorac Soc"},{"issue":"2","key":"1245_CR5","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1097\/CCM.0000000000001571","volume":"44","author":"M Churpek","year":"2016","unstructured":"Churpek M, Yuen T, Winslow C, Meltzer D, Kattan M, Edelson D. Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards. Crit Care Med. 2016; 44(2):368.","journal-title":"Crit Care Med"},{"key":"1245_CR6","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.csbj.2014.11.005","volume":"13","author":"K Kourou","year":"2015","unstructured":"Kourou K, Exarchos T, Exarchos K, Karamouzis M, Fotiadis D. Machine learning applications in cancer prognosis and prediction. Comput Struct Biotechnol J. 2015; 13:8\u201317.","journal-title":"Comput Struct Biotechnol J"},{"issue":"7","key":"1245_CR7","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1097\/CCM.0000000000003123","volume":"46","author":"J Koyner","year":"2018","unstructured":"Koyner J, Carey K, Edelson D, Churpek M. The development of a machine learning inpatient acute kidney injury prediction model. Crit Care Med. 2018; 46(7):1070\u20137.","journal-title":"Crit Care Med"},{"issue":"2","key":"1245_CR8","first-page":"24","volume":"5","author":"M Kumar","year":"2016","unstructured":"Kumar M. Prediction of chronic kidney disease using random forest machine learning algorithm. Int J Comput Sci Mob Comput. 2016; 5(2):24\u201333.","journal-title":"Int J Comput Sci Mob Comput"},{"issue":"1","key":"1245_CR9","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s12911-016-0277-4","volume":"16","author":"R Kate","year":"2016","unstructured":"Kate R, Perez R, Mazumdar D, Pasupathy K, Nilakantan V. Prediction and detection models for acute kidney injury in hospitalized older adults. BMC Med Inform Decis Making. 2016; 16(1):39.","journal-title":"BMC Med Inform Decis Making"},{"issue":"7767","key":"1245_CR10","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1038\/s41586-019-1390-1","volume":"572","author":"N Toma\u0161ev","year":"2019","unstructured":"Toma\u0161ev N, Glorot X, Rae J, Zielinski M, Askham H, Saraiva A, Mottram A, Meyer C, Ravuri S, Protsyuk I, et al.A clinically applicable approach to continuous prediction of future acute kidney injury. Nature. 2019; 572(7767):116\u20139.","journal-title":"Nature"},{"key":"1245_CR11","first-page":"1","volume":"abs\/1712.01880","author":"S Weisenthal","year":"2016","unstructured":"Weisenthal S, Liao H, Ng P, Zand M. Sum of previous inpatient serum creatinine measurements predicts acute kidney injury in rehospitalized patients. ArXiv. 2016; abs\/1712.01880:1\u20139.","journal-title":"ArXiv"},{"issue":"6","key":"1245_CR12","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1007\/s00134-017-4678-3","volume":"43","author":"M Flechet","year":"2017","unstructured":"Flechet M, G\u00fciza F, Schetz M, Wouters P, Vanhorebeek I, Derese I, Gunst J, Spriet I, Casaer M, Van den Berghe G, et al.Akipredictor, an online prognostic calculator for acute kidney injury in adult critically ill patients: development, validation and comparison to serum neutrophil gelatinase-associated lipocalin. Intensive Care Med. 2017; 43(6):764\u201373.","journal-title":"Intensive Care Med"},{"key":"1245_CR13","doi-asserted-by":"crossref","unstructured":"Wang Y, Wei Y, Wu Q, Yang H, Li J. An acute kidney injury prediction model based on ensemble learning algorithm. In: 2019 10th International Conference on Information Technology in Medicine and Education (ITME). IEEE: 2019. p. 18\u201322.","DOI":"10.1109\/ITME.2019.00015"},{"issue":"1","key":"1245_CR14","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1186\/s13054-017-1899-3","volume":"21","author":"G Hundeshagen","year":"2017","unstructured":"Hundeshagen G, Herndon D, Capek K, Branski L, Voigt C, Killion E, Cambiaso-Daniel J, Sljivich M, De Crescenzo A, Mlcak R, et al.Co-administration of vancomycin and piperacillin-tazobactam is associated with increased renal dysfunction in adult and pediatric burn patients. Crit Care. 2017; 21(1):318.","journal-title":"Crit Care"},{"key":"1245_CR15","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining. ACM: 2016. p. 785\u201394.","DOI":"10.1145\/2939672.2939785"},{"issue":"2","key":"1245_CR16","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1007\/s11600-019-00268-4","volume":"67","author":"H Nguyen","year":"2019","unstructured":"Nguyen H, Bui X-N, Bui H-B, Cuong D. Developing an xgboost model to predict blast-induced peak particle velocity in an open-pit mine: a case study. Acta Geophysica. 2019; 67(2):477\u201390.","journal-title":"Acta Geophysica"},{"key":"1245_CR17","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.elerap.2018.08.002","volume":"31","author":"X Ma","year":"2018","unstructured":"Ma X, Sha J, Wang D, Yu Y, Yang Q, Niu X. Study on a prediction of p2p network loan default based on the machine learning lightgbm and xgboost algorithms according to different high dimensional data cleaning. Electron Commer Res Appl. 2018; 31:24\u201339.","journal-title":"Electron Commer Res Appl"},{"key":"1245_CR18","first-page":"1","volume":"abs\/305.1707","author":"R Longadge","year":"2013","unstructured":"Longadge R, Dongre S. Class imbalance problem in data mining review. ArXiv. 2013; abs\/305.1707:1\u20136.","journal-title":"ArXiv"},{"key":"1245_CR19","doi-asserted-by":"publisher","first-page":"160035","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"A Johnson","year":"2016","unstructured":"Johnson A, Pollard T, Shen L, Li-wei H, Feng M, Ghassemi M, Moody B, Szolovits P, Celi L, Mark R. Mimic-iii, a freely accessible critical care database. Sci Data. 2016; 3:160035.","journal-title":"Sci Data"},{"issue":"6","key":"1245_CR20","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1016\/j.kint.2020.02.010","volume":"97","author":"A Levey","year":"2020","unstructured":"Levey A, Eckardt K-U, Dorman N, Christiansen S, Hoorn E, Ingelfinger J, Inker L, Levin A, Mehrotra R, Palevsky P, et al.Nomenclature for kidney function and disease: Report of a kidney disease: Improving global outcomes (kdigo) consensus conference. Kidney Int. 2020; 97(6):1117\u201329.","journal-title":"Kidney Int"},{"issue":"1","key":"1245_CR21","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1111\/j.0824-7935.2004.t01-1-00228.x","volume":"20","author":"A Estabrooks","year":"2004","unstructured":"Estabrooks A, Jo T, Japkowicz N. A multiple resampling method for learning from imbalanced data sets. Comput Intell. 2004; 20(1):18\u201336.","journal-title":"Comput Intell"},{"issue":"9","key":"1245_CR22","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","volume":"21","author":"H He","year":"2009","unstructured":"He H, Garcia E. Learning from imbalanced data. IEEE Trans Knowl Data Eng. 2009; 21(9):1263\u201384.","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"3","key":"1245_CR23","first-page":"57","volume":"4","author":"F Shahrbaf","year":"2015","unstructured":"Shahrbaf F, Assadi F. Drug-induced renal disorders. J Ren Inj Prev. 2015; 4(3):57.","journal-title":"J Ren Inj Prev"},{"issue":"2","key":"1245_CR24","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1016\/j.ccc.2006.02.003","volume":"22","author":"S Taber","year":"2006","unstructured":"Taber S, Mueller B. Drug-associated renal dysfunction. Crit Care Clin. 2006; 22(2):357\u201374.","journal-title":"Crit Care Clin"},{"issue":"11","key":"1245_CR25","doi-asserted-by":"publisher","first-page":"1002703","DOI":"10.1371\/journal.pmed.1002703","volume":"15","author":"C Huang","year":"2018","unstructured":"Huang C, Murugiah K, Mahajan S, Li S-X, Dhruva S, Haimovich J, Wang Y, Schulz W, Testani J, Wilson F, et al.Enhancing the prediction of acute kidney injury risk after percutaneous coronary intervention using machine learning techniques: A retrospective cohort study. PLoS Med. 2018; 15(11):1002703.","journal-title":"PLoS Med"},{"key":"1245_CR26","doi-asserted-by":"publisher","first-page":"205435811877632","DOI":"10.1177\/2054358118776326","volume":"5","author":"H Mohamadlou","year":"2018","unstructured":"Mohamadlou H, Lynng-Palevsky A, Barton C, Chettipally U, Shieh L, Calvert J, Saber N, Das R. Prediction of acute kidney injury with a machine learning algorithm using electronic health record data. Can J Kidney Health Dis. 2018; 5:2054358118776326.","journal-title":"Can J Kidney Health Dis"},{"key":"1245_CR27","first-page":"1","volume":"abs\/1806.08049","author":"D Alvarez-Melis","year":"2018","unstructured":"Alvarez-Melis D, Jaakkola T. On the robustness of interpretability methods. ArXiv. 2018; abs\/1806.08049:1\u20136.","journal-title":"ArXiv"},{"key":"1245_CR28","unstructured":"Vedder K. An overview of shap-based feature importance measures and their applications to classification. 2020. http:\/\/vedder.io\/misc\/shap_for_classification.pdf."},{"key":"1245_CR29","first-page":"1","volume":"abs\/1702.08608","author":"F Doshi-Velez","year":"2017","unstructured":"Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. ArXiv. 2017; abs\/1702.08608:1\u201313.","journal-title":"ArXiv"},{"issue":"4","key":"1245_CR30","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1097\/CCM.0b013e318168e375","volume":"36","author":"N Pannu","year":"2008","unstructured":"Pannu N, Nadim M. An overview of drug-induced acute kidney injury. Crit Care Med. 2008; 36(4):216\u201323.","journal-title":"Crit Care Med"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01245-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-020-01245-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01245-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T23:06:26Z","timestamp":1632179186000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-020-01245-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,21]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1245"],"URL":"https:\/\/doi.org\/10.1186\/s12911-020-01245-4","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,21]]},"assertion":[{"value":"30 April 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was approved by the institutional review boards at West China hospital and was granted a waiver of informed consent (2019-S-361). Since this work is a retrospective study, the ethics committee did not require each patient to sign the informed consent.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"238"}}