{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T17:26:36Z","timestamp":1783013196236,"version":"3.54.6"},"reference-count":42,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T00:00:00Z","timestamp":1666742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81871456"],"award-info":[{"award-number":["81871456"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,12,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Acute kidney injury (AKI) is a common complication after pediatric cardiac surgery, and the early detection of AKI may allow for timely preventive or therapeutic measures. However, current AKI prediction researches pay less attention to time information among time-series clinical data and model building strategies that meet complex clinical application scenario. This study aims to develop and validate a model for predicting postoperative AKI that operates sequentially over individual time-series clinical data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>A retrospective cohort of 3386 pediatric patients extracted from PIC database was used for training, calibrating, and testing purposes. A time-aware deep learning model was developed and evaluated from 3 clinical perspectives that use different data collection windows and prediction windows to answer different AKI prediction questions encountered in clinical practice. We compared our model with existing state-of-the-art models from 3 clinical perspectives using the area under the receiver operating characteristic curve (ROC AUC) and the area under the precision-recall curve (PR AUC).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Our proposed model significantly outperformed the existing state-of-the-art models with an improved average performance for any AKI prediction from the 3 evaluation perspectives. This model predicted 91% of all AKI episodes using data collected at 24\u00a0h after surgery, resulting in a ROC AUC of 0.908 and a PR AUC of 0.898. On average, our model predicted 83% of all AKI episodes that occurred within the different time windows in the 3 evaluation perspectives. The calibration performance of the proposed model was substantially higher than the existing state-of-the-art models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>This study showed that a deep learning model can accurately predict postoperative AKI using perioperative time-series data. It has the potential to be integrated into real-time clinical decision support systems to support postoperative care planning.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocac202","type":"journal-article","created":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T16:16:54Z","timestamp":1666801014000},"page":"94-102","source":"Crossref","is-referenced-by-count":22,"title":["A time-aware attention model for prediction of acute kidney injury after pediatric cardiac surgery"],"prefix":"10.1093","volume":"30","author":[{"given":"Xian","family":"Zeng","sequence":"first","affiliation":[{"name":"Clinical Data Center, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"},{"name":"The College of Biomedical Engineering and Instrument Science, Zhejiang University , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shanshan","family":"Shi","sequence":"additional","affiliation":[{"name":"CICU, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuhan","family":"Sun","sequence":"additional","affiliation":[{"name":"The College of Biomedical Engineering and Instrument Science, Zhejiang University , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuqing","family":"Feng","sequence":"additional","affiliation":[{"name":"Clinical Data Center, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linhua","family":"Tan","sequence":"additional","affiliation":[{"name":"CICU, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ru","family":"Lin","sequence":"additional","affiliation":[{"name":"CICU, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"},{"name":"Cardiac Surgery, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianhua","family":"Li","sequence":"additional","affiliation":[{"name":"Cardiac Surgery, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huilong","family":"Duan","sequence":"additional","affiliation":[{"name":"The College of Biomedical Engineering and Instrument Science, Zhejiang University , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiang","family":"Shu","sequence":"additional","affiliation":[{"name":"Cardiac Surgery, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6420-7719","authenticated-orcid":false,"given":"Haomin","family":"Li","sequence":"additional","affiliation":[{"name":"Clinical Data Center, The Children\u2019s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health , Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,10,26]]},"reference":[{"issue":"25","key":"2022121408274688700_ocac202-B1","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.1161\/CIRCULATIONAHA.116.023544","article-title":"Trends in congenital heart disease","volume":"133","author":"Triedman","year":"2016","journal-title":"Circulation"},{"issue":"13","key":"2022121408274688700_ocac202-B2","doi-asserted-by":"crossref","first-page":"E754","DOI":"10.1016\/S0735-1097(12)60755-4","article-title":"Early postoperative acute kidney injury and outcomes following surgery for congenital heart disease","volume":"59","author":"Taylor","year":"2012","journal-title":"J Am Coll Cardiol"},{"issue":"6","key":"2022121408274688700_ocac202-B3","doi-asserted-by":"crossref","first-page":"1984","DOI":"10.1016\/j.athoracsur.2011.10.046","article-title":"Acute kidney injury is associated with higher morbidity and resource utilization in pediatric patients undergoing heart surgery","volume":"93","author":"T\u00f3th","year":"2012","journal-title":"Ann Thorac Surg"},{"issue":"2","key":"2022121408274688700_ocac202-B4","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.jtcvs.2011.06.021","article-title":"Congenital heart surgery in infants: effects of acute kidney injury on outcomes","volume":"143","author":"Blinder","year":"2012","journal-title":"J Thorac Cardiovasc Surg"},{"issue":"1","key":"2022121408274688700_ocac202-B5","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.jtcvs.2012.09.008","article-title":"Mild postoperative acute kidney injury and outcomes after surgery for congenital heart disease","volume":"146","author":"Taylor","year":"2013","journal-title":"J Thorac Cardiovasc Surg"},{"issue":"1","key":"2022121408274688700_ocac202-B6","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.jpeds.2012.06.054","article-title":"Risk factors for and outcomes of acute kidney injury in neonates undergoing complex cardiac surgery","volume":"162","author":"Morgan","year":"2013","journal-title":"J. Pediatr"},{"issue":"1","key":"2022121408274688700_ocac202-B7","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1056\/NEJMra1214243","article-title":"Acute kidney injury and chronic kidney disease as interconnected syndromes","volume":"371","author":"Chawla","year":"2014","journal-title":"N Engl J Med"},{"key":"2022121408274688700_ocac202-B8","first-page":"1","article-title":"Acute kidney injury","volume":"7","author":"Kellum","year":"2021","journal-title":"Nat Rev Dis Prim"},{"key":"2022121408274688700_ocac202-B9","first-page":"1","article-title":"KDIGO clinical practice guideline for acute kidney injury","volume":"2","author":"Walther","year":"2012","journal-title":"Kidney Int Suppl"},{"issue":"10","key":"2022121408274688700_ocac202-B10","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1038\/sj.ki.5002231","article-title":"Modified RIFLE criteria in critically ill children with acute kidney injury","volume":"71","author":"Akcan-Arikan","year":"2007","journal-title":"Kidney Int"},{"issue":"9","key":"2022121408274688700_ocac202-B11","doi-asserted-by":"crossref","first-page":"2432","DOI":"10.1681\/ASN.2018010090","article-title":"A new criterion for pediatric AKI based on the reference change value of serum creatinine","volume":"29","author":"Xu","year":"2018","journal-title":"J Am Soc Nephrol"},{"issue":"2","key":"2022121408274688700_ocac202-B12","first-page":"265","article-title":"Association between e-alert implementation for detection of acute kidney injury and outcomes: a systematic review","volume":"32","author":"Lachance","year":"2017","journal-title":"Nephrol Dial Transplant"},{"issue":"5","key":"2022121408274688700_ocac202-B13","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1016\/j.semnephrol.2019.06.002","article-title":"The role of risk prediction models in prevention and management of AKI","volume":"39","author":"Hodgson","year":"2019","journal-title":"Semin Nephrol"},{"issue":"1","key":"2022121408274688700_ocac202-B14","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1056\/NEJMoa1611391","article-title":"Epidemiology of acute kidney injury in critically ill children and young adults","volume":"376","author":"Kaddourah","year":"2017","journal-title":"N Engl J Med"},{"issue":"2","key":"2022121408274688700_ocac202-B15","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1681\/ASN.2017070765","article-title":"Clinical decision support for in-hospital AKI","volume":"29","author":"Al-Jaghbeer","year":"2018","journal-title":"J Am Soc Nephrol"},{"issue":"1","key":"2022121408274688700_ocac202-B16","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.kint.2016.03.031","article-title":"A sustained quality improvement program reduces nephrotoxic medication-associated acute kidney injury","volume":"90","author":"Goldstein","year":"2016","journal-title":"Kidney Int"},{"issue":"11","key":"2022121408274688700_ocac202-B17","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1007\/s00134-016-4670-3","article-title":"Prevention of cardiac surgery-associated AKI by implementing the KDIGO guidelines in high risk patients identified by biomarkers: the PrevAKI randomized controlled trial","volume":"43","author":"Meersch","year":"2017","journal-title":"Intensive Care Med"},{"issue":"7","key":"2022121408274688700_ocac202-B18","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1097\/CCM.0000000000003123","article-title":"The development of a machine learning inpatient acute kidney injury prediction model","volume":"46","author":"Koyner","year":"2018","journal-title":"Crit Care Med"},{"issue":"7767","key":"2022121408274688700_ocac202-B19","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1038\/s41586-019-1390-1","article-title":"A clinically applicable approach to continuous prediction of future acute kidney injury","volume":"572","author":"Toma\u0161ev","year":"2019","journal-title":"Nature"},{"key":"2022121408274688700_ocac202-B20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13054-020-03179-9","article-title":"Prediction of the development of acute kidney injury following cardiac surgery by machine learning","volume":"24","author":"Tseng","year":"2020","journal-title":"Crit Care"},{"issue":"1","key":"2022121408274688700_ocac202-B21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13054-021-03724-0","article-title":"Machine learning model for early prediction of acute kidney injury (AKI) in pediatric critical care","volume":"25","author":"Dong","year":"2021","journal-title":"Crit Care"},{"issue":"6","key":"2022121408274688700_ocac202-B22","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1093\/bib\/bbx044","article-title":"Deep learning for healthcare: review, opportunities and challenges","volume":"19","author":"Miotto","year":"2018","journal-title":"Brief Bioinform"},{"issue":"2","key":"2022121408274688700_ocac202-B23","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1093\/jamia\/ocw112","article-title":"Using recurrent neural network models for early detection of heart failure onset","volume":"24","author":"Choi","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2022121408274688700_ocac202-B24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-24271-9","article-title":"Recurrent neural networks for multivariate time series with missing values","volume":"8","author":"Che","year":"2018","journal-title":"Sci Rep"},{"issue":"1","key":"2022121408274688700_ocac202-B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-020-00346-8","article-title":"Deep-learning-based real-time prediction of acute kidney injury outperforms human predictive performance","volume":"3","author":"Rank","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2022121408274688700_ocac202-B26","first-page":"3504","article-title":"RETAIN: an interpretable predictive model for healthcare using reverse time attention mechanism","author":"Choi","year":"2016","journal-title":"Adv Neural Inf Process Syst"},{"key":"2022121408274688700_ocac202-B27","first-page":"1903","article-title":"Dipole: diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks","author":"Ma","year":"2017","journal-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"},{"key":"2022121408274688700_ocac202-B28","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.cmpb.2021.106129","article-title":"Prediction and visualization of acute kidney injury in intensive care unit using one-dimensional convolutional neural networks based on routinely collected data","volume":"206","author":"Sato","year":"2021","journal-title":"Comput Methods Programs Biomed"},{"key":"2022121408274688700_ocac202-B29","first-page":"11","article-title":"Utilizing electronic health records to predict acute kidney injury risk and outcomes: workgroup statements from the 15(th) ADQI Consensus Conference","volume":"3","author":"Sutherland","year":"2016","journal-title":"Can J Kidney Heal Dis"},{"key":"2022121408274688700_ocac202-B30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41597-020-0355-4","article-title":"PIC, a paediatric-specific intensive care database","volume":"7","author":"Zeng","year":"2020","journal-title":"Sci Data"},{"key":"2022121408274688700_ocac202-B31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12916-014-0241-z","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement","volume":"13","author":"Collins","year":"2015","journal-title":"BMC Med"},{"key":"2022121408274688700_ocac202-B32","volume-title":"31st conference on Neural Information Processing Systems (NIPS 2017)","author":"Vaswani","year":"2017"},{"key":"2022121408274688700_ocac202-B33","first-page":"4765","article-title":"A unified approach to interpreting model predictions","author":"Lundberg","year":"2017","journal-title":"NIPS 2017"},{"key":"2022121408274688700_ocac202-B34","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"JAIR"},{"key":"2022121408274688700_ocac202-B35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-021-20910-4","article-title":"Artificial intelligence in sepsis early prediction and diagnosis using unstructured data in healthcare","volume":"12","author":"Goh","year":"2021","journal-title":"Nat. Commun"},{"key":"2022121408274688700_ocac202-B36","first-page":"1321","article-title":"On calibration of modern neural networks","author":"Guo","year":"2017","journal-title":"Proceedings of the International Conference on Machine Learning"},{"issue":"4","key":"2022121408274688700_ocac202-B37","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1093\/jamia\/ocz228","article-title":"A tutorial on calibration measurements and calibration models for clinical prediction models","volume":"27","author":"Huang","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2022121408274688700_ocac202-B38","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1097\/CCM.0b013e31821201d3","article-title":"Incidence, risk factors, and outcomes of acute kidney injury after pediatric cardiac surgery: a prospective multicenter study","volume":"39","author":"Li","year":"2011","journal-title":"Crit Care Med"},{"key":"2022121408274688700_ocac202-B39","first-page":"1","article-title":"Prediction of acute kidney injury with a machine learning algorithm using electronic health record data","volume":"5","author":"Mohamadlou","year":"2018","journal-title":"Can J Kidney Heal Dis"},{"issue":"2","key":"2022121408274688700_ocac202-B40","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1053\/j.ajkd.2010.08.026","article-title":"Early nephrologist involvement in hospital-acquired acute kidney injury: a pilot study","volume":"57","author":"Balasubramanian","year":"2011","journal-title":"Am J Kidney Dis"},{"issue":"14","key":"2022121408274688700_ocac202-B41","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1001\/jama.2017.12126","article-title":"Discrimination and calibration of clinical prediction models: users\u2019 guides to the medical literature","volume":"318","author":"Alba","year":"2017","journal-title":"JAMA"},{"issue":"1","key":"2022121408274688700_ocac202-B42","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.athoracsur.2011.09.010","article-title":"Predicting acute kidney injury after cardiac surgery: a systematic review","volume":"93","author":"Huen","year":"2012","journal-title":"Ann Thorac Surg"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/1\/94\/47829527\/ocac202.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/1\/94\/47829527\/ocac202.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,14]],"date-time":"2022-12-14T11:50:52Z","timestamp":1671018652000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/1\/94\/6775039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,26]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,10,26]]},"published-print":{"date-parts":[[2022,12,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac202","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,1,1]]},"published":{"date-parts":[[2022,10,26]]}}}