{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T21:06:38Z","timestamp":1781211998286,"version":"3.54.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"S8","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,17]],"date-time":"2019-12-17T00:00:00Z","timestamp":1576540800000},"content-version":"vor","delay-in-days":16,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Electronic health records (EHRs) provide possibilities to improve patient care and facilitate clinical research. However, there are many challenges faced by the applications of EHRs, such as temporality, high dimensionality, sparseness, noise, random error and systematic bias. In particular, temporal information is difficult to effectively use by traditional machine learning methods while the sequential information of EHRs is very useful.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Method<\/jats:title>\n<jats:p>In this paper, we propose a general-purpose patient representation learning approach to summarize sequential EHRs. Specifically, a recurrent neural network based denoising autoencoder (RNN-DAE) is employed to encode inhospital records of each patient into a low dimensional dense vector.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>Based on EHR data collected from Shuguang Hospital affiliated to Shanghai University of Traditional Chinese Medicine, we experimentally evaluate our proposed RNN-DAE method on both mortality prediction task and comorbidity prediction task. Extensive experimental results show that our proposed RNN-DAE method outperforms existing methods. In addition, we apply the \u201cDeep Feature\u201d represented by our proposed RNN-DAE method to track similar patients with t-SNE, which also achieves some interesting observations.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusion<\/jats:title>\n<jats:p>We propose an effective unsupervised RNN-DAE method to summarize patient sequential information in EHR data. Our proposed RNN-DAE method is useful on both mortality prediction task and comorbidity prediction task.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12911-019-0985-7","type":"journal-article","created":{"date-parts":[[2019,12,17]],"date-time":"2019-12-17T02:03:04Z","timestamp":1576548184000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Representation learning for clinical time series prediction tasks in electronic health records"],"prefix":"10.1186","volume":"19","author":[{"given":"Tong","family":"Ruan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liqi","family":"Lei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yangming","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Zhai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Le","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ping","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ju","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,17]]},"reference":[{"key":"985_CR1","doi-asserted-by":"publisher","unstructured":"Wang Q, Qiu J, Zhou Y, Ruan T, Gao D, Gao J. Automatic severity classification of coronary artery disease via recurrent capsule network. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE: 2018. p. 1587\u201394. https:\/\/doi.org\/10.1109\/bibm.2018.8621136.","DOI":"10.1109\/bibm.2018.8621136"},{"issue":"1","key":"985_CR2","doi-asserted-by":"publisher","first-page":"0169772","DOI":"10.1371\/journal.pone.0169772","volume":"12","author":"J Allyn","year":"2017","unstructured":"Allyn J, Allou N, Augustin P, Philip I, Martinet O, Belghiti M, Provenchere S, Montravers P, Ferdynus C. A comparison of a machine learning model with euroscore II in predicting mortality after elective cardiac surgery: a decision curve analysis. PLoS ONE. 2017; 12(1):0169772.","journal-title":"PLoS ONE"},{"issue":"1","key":"985_CR3","doi-asserted-by":"publisher","first-page":"e7","DOI":"10.2196\/medinform.6730","volume":"5","author":"Anis Sharafoddini","year":"2017","unstructured":"Sharafoddini A, Dubin JA, Lee J. Patient similarity in prediction models based on health data: a scoping review. JMIR Med Inform. 2017; 5(1). https:\/\/doi.org\/10.2196\/medinform.6730.","journal-title":"JMIR Medical Informatics"},{"key":"985_CR4","doi-asserted-by":"publisher","unstructured":"Cheng Y, Wang F, Zhang P, Hu J. Risk prediction with electronic health records: A deep learning approach. In: Proceedings of the 2016 SIAM International Conference on Data Mining. SIAM: 2016. p. 432\u201340. https:\/\/doi.org\/10.1137\/1.9781611974348.49.","DOI":"10.1137\/1.9781611974348.49"},{"key":"985_CR5","doi-asserted-by":"publisher","unstructured":"Zhang J, Wang Q, Zhang Z, Zhou Y, Ye Q, Zhang H, Qiu J, He P. An effective standardization method for the lab indicators in regional medical health platform using n-grams and stacking. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE: 2018. p. 1602\u20139. https:\/\/doi.org\/10.1109\/bibm.2018.8621274.","DOI":"10.1109\/bibm.2018.8621274"},{"key":"985_CR6","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems. Curran Associates, Inc.: 2013. p. 3111\u20139. http:\/\/papers.nips.cc\/paper\/5021-distributedrepresentations-of-words-and-phrases-andtheir-compositionality."},{"key":"985_CR7","unstructured":"Le Q, Mikolov T. Distributed representations of sentences and documents. In: International Conference on Machine Learning. JMLR.org: 2014. p. 1188\u201396. http:\/\/proceedings.mlr.press\/v32\/le14.html."},{"key":"985_CR8","doi-asserted-by":"crossref","unstructured":"Peters M, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). Association for Computational Linguistics: 2018. p. 2227\u201337. https:\/\/www.aclweb.org\/anthology\/N18-1202\/.","DOI":"10.18653\/v1\/N18-1202"},{"key":"985_CR9","unstructured":"Devlin J, Chang M. -W., Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. 2018. arXiv preprint arXiv:1810.04805."},{"key":"985_CR10","doi-asserted-by":"publisher","unstructured":"Choi E, Bahadori MT, Searles E, Coffey C, Thompson M, Bost J, Tejedor-Sojo J, Sun J. Multi-layer representation learning for medical concepts. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM: 2016. p. 1495\u2013504. https:\/\/doi.org\/10.1145\/2939672.2939823.","DOI":"10.1145\/2939672.2939823"},{"issue":"1","key":"985_CR11","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/JBHI.2016.2633963","volume":"21","author":"P Nguyen","year":"2017","unstructured":"Nguyen P, Tran T, Wickramasinghe N, Venkatesh S. Deepr: A convolutional net for medical records. IEEE J Biomed Health Inform. 2017; 21(1):22\u201330.","journal-title":"IEEE J Biomed Health Inform"},{"key":"985_CR12","doi-asserted-by":"publisher","unstructured":"Zhou C, Jia Y, Motani M, Chew J. Learning deep representations from heterogeneous patient data for predictive diagnosis. In: Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. ACM: 2017. p. 115\u201323. https:\/\/doi.org\/10.1145\/3107411.3107433.","DOI":"10.1145\/3107411.3107433"},{"key":"985_CR13","doi-asserted-by":"publisher","unstructured":"Vincent P, Larochelle H, Bengio Y, Manzagol P-A. Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th International Conference on Machine Learning. ACM: 2008. p. 1096\u2013103. https:\/\/doi.org\/10.1145\/1390156.1390294.","DOI":"10.1145\/1390156.1390294"},{"key":"985_CR14","doi-asserted-by":"publisher","unstructured":"Lei L, Zhou Y, Zhai J, Zhang L, Fang Z, He P, Gao J. An effective patient representation learning for time-series prediction tasks based on EHRs. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE: 2018. p. 885\u201392. https:\/\/doi.org\/10.1109\/bibm.2018.8621542.","DOI":"10.1109\/bibm.2018.8621542"},{"key":"985_CR15","doi-asserted-by":"publisher","unstructured":"Purusothaman G, Krishnakumari P. A survey of data mining techniques on risk prediction: Heart disease. Indian J Sci Technol. 2015; 8(12). https:\/\/doi.org\/10.17485\/ijst\/2015\/v8i12\/58385.","DOI":"10.17485\/ijst\/2015\/v8i12\/58385"},{"issue":"5","key":"985_CR16","first-page":"0127428","volume":"10","author":"J Lee","year":"2015","unstructured":"Lee J, Maslove DM, Dubin JA. Personalized mortality prediction driven by electronic medical data and a patient similarity metric. PLoS ONE. 2015; 10(5):0127428.","journal-title":"PLoS ONE"},{"key":"985_CR17","first-page":"40","volume":"216","author":"M Panahiazar","year":"2015","unstructured":"Panahiazar M, Taslimitehrani V, Pereira N, Pathak J. Using ehrs and machine learning for heart failure survival analysis. Stud Health Technol Inform. 2015; 216:40\u201344.","journal-title":"Stud Health Technol Inform"},{"key":"985_CR18","doi-asserted-by":"publisher","first-page":"S106","DOI":"10.1097\/MLR.0b013e3181de9e17","volume":"48","author":"Jionglin Wu","year":"2010","unstructured":"Wu J, Roy J, Stewart WF. Prediction modeling using ehr data: challenges, strategies, and a comparison of machine learning approaches. Med Care. 2010:106\u201313. https:\/\/doi.org\/10.1097\/mlr.0b013e3181de9e17.","journal-title":"Medical Care"},{"issue":"2","key":"985_CR19","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1093\/jamia\/ocw112","volume":"24","author":"E Choi","year":"2016","unstructured":"Choi E, Schuetz A, Stewart WF, Sun J. Using recurrent neural network models for early detection of heart failure onset. J Am Med Inform Assoc. 2016; 24(2):361\u201370.","journal-title":"J Am Med Inform Assoc"},{"key":"985_CR20","unstructured":"Lipton ZC, Kale DC, Elkan C, Wetzel R. Learning to diagnose with lstm recurrent neural networks. 2015. arXiv preprint arXiv:1511.03677."},{"key":"985_CR21","first-page":"584","volume":"205","author":"JA Minarro-Gim\u00e9nez","year":"2014","unstructured":"Minarro-Gim\u00e9nez JA, Marin-Alonso O, Samwald M. Exploring the application of deep learning techniques on medical text corpora. Stud Health Technol Inform. 2014; 205:584\u20138.","journal-title":"Stud Health Technol Inform"},{"key":"985_CR22","unstructured":"Choi E, Schuetz A, Stewart WF, Sun J. Medical concept representation learning from electronic health records and its application on heart failure prediction. 2016. arXiv preprint arXiv:1602.03686."},{"key":"985_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jbi.2018.06.013","volume":"84","author":"L Cui","year":"2018","unstructured":"Cui L, Xie X, Shen Z. Prediction task guided representation learning of medical codes in ehr. J Biomed Inform. 2018; 84:1\u201310.","journal-title":"J Biomed Inform"},{"key":"985_CR24","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1016\/j.jbi.2018.06.015","volume":"84","author":"S Deepika","year":"2018","unstructured":"Deepika S, Geetha T. A meta-learning framework using representation learning to predict drug-drug interaction. J Biomed Inform. 2018; 84:136\u201347.","journal-title":"J Biomed Inform"},{"key":"985_CR25","doi-asserted-by":"publisher","first-page":"26094","DOI":"10.1038\/srep26094","volume":"6","author":"R Miotto","year":"2016","unstructured":"Miotto R, Li L, Kidd BA, Dudley JT. Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Sci Rep. 2016; 6:26094.","journal-title":"Sci Rep"},{"key":"985_CR26","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jbi.2018.06.016","volume":"84","author":"M Sushil","year":"2018","unstructured":"Sushil M, \u0160uster S, Luyckx K, Daelemans W. Patient representation learning and interpretable evaluation using clinical notes. J Biomed Inform. 2018; 84:103\u201313.","journal-title":"J Biomed Inform"},{"key":"985_CR27","doi-asserted-by":"publisher","first-page":"65333","DOI":"10.1109\/ACCESS.2018.2875677","volume":"6","author":"J Zhang","year":"2018","unstructured":"Zhang J, Kowsari K, Harrison JH, Lobo JM, Barnes LE. Patient2vec: A personalized interpretable deep representation of the longitudinal electronic health record. IEEE Access. 2018; 6:65333\u201346.","journal-title":"IEEE Access"},{"issue":"10","key":"985_CR28","doi-asserted-by":"publisher","first-page":"1550","DOI":"10.1109\/5.58337","volume":"78","author":"PJ Werbos","year":"1990","unstructured":"Werbos PJ. Backpropagation through time: what it does and how to do it. Proc IEEE. 1990; 78(10):1550\u201360.","journal-title":"Proc IEEE"},{"issue":"6088","key":"985_CR29","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1038\/323533a0","volume":"323","author":"DE Rumelhart","year":"1986","unstructured":"Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature. 1986; 323(6088):533\u20136.","journal-title":"Nature"},{"issue":"8","key":"985_CR30","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997; 9(8):1735\u201380.","journal-title":"Neural Comput"},{"issue":"2","key":"985_CR31","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","volume":"5","author":"Y Bengio","year":"1994","unstructured":"Bengio Y, Simard P, Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw. 1994; 5(2):157\u201366.","journal-title":"IEEE Trans Neural Netw"},{"key":"985_CR32","unstructured":"Pascanu R, Mikolov T, Bengio Y. On the difficulty of training recurrent neural networks. In: International Conference on Machine Learning. JMLR.org: 2013. p. 1310\u20138. http:\/\/proceedings.mlr.press\/v28\/pascanu13.html."},{"key":"985_CR33","unstructured":"Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. In: NIPS 2014 Workshop on Deep Learning, December 2014: 2014. CoRR abs\/1412.3555. http:\/\/arxiv.org\/abs\/1412.3555."},{"key":"985_CR34","doi-asserted-by":"publisher","first-page":"9256","DOI":"10.1109\/ACCESS.2017.2789324","volume":"6","author":"B Jin","year":"2018","unstructured":"Jin B, Che C, Liu Z, Zhang S, Yin X, Wei X. Predicting the risk of heart failure with EHR sequential data modeling. IEEE Access. 2018; 6:9256\u201361.","journal-title":"IEEE Access"},{"key":"985_CR35","unstructured":"Dai AM, Le QV. Semi-supervised sequence learning. In: Advances in Neural Information Processing Systems. Curran Associates, Inc.: 2015. p. 3079\u20133087. http:\/\/papers.nips.cc\/paper\/5949-semisupervised-sequence-learning."},{"key":"985_CR36","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/j.knosys.2014.08.029","volume":"72","author":"Y Zhou","year":"2014","unstructured":"Zhou Y, Liu Y, Gao X-Z, Qiu G. A label ranking method based on gaussian mixture model. Knowl-Based Syst. 2014; 72:108\u201313.","journal-title":"Knowl-Based Syst"},{"issue":"4","key":"985_CR37","doi-asserted-by":"publisher","first-page":"20","DOI":"10.4018\/IJMCMC.2014100102","volume":"6","author":"Y Liu","year":"2014","unstructured":"Liu Y, Zhou Y, Wen S, Tang C. A strategy on selecting performance metrics for classifier evaluation. International Journal of Mobile Computing and Multimedia Communications (IJMCMC). 2014; 6(4):20\u201335.","journal-title":"International Journal of Mobile Computing and Multimedia Communications (IJMCMC)"},{"key":"985_CR38","doi-asserted-by":"publisher","unstructured":"Zhou Y, Liu Y. Correlation analysis of performance metrics for classifier. In: Decision Making and Soft Computing: Proceedings of the 11th International FLINS Conference: 2014. p. 487\u201392. World Scientific. https:\/\/doi.org\/10.1142\/9789814619998_0081.","DOI":"10.1142\/9789814619998_0081"},{"key":"985_CR39","unstructured":"More A. Survey of resampling techniques for improving classification performance in unbalanced datasets. 2016. arXiv preprint arXiv:1608.06048."},{"issue":"1","key":"985_CR40","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/2408736.2408740","volume":"14","author":"J Sun","year":"2012","unstructured":"Sun J, Wang F, Hu J, Edabollahi S. Supervised patient similarity measure of heterogeneous patient records. ACM SIGKDD Explor Newsl. 2012; 14(1):16\u201324.","journal-title":"ACM SIGKDD Explor Newsl"},{"key":"985_CR41","doi-asserted-by":"publisher","unstructured":"Chan L, Chan T, Cheng L, Mak W. Machine learning of patient similarity: A case study on predicting survival in cancer patient after locoregional chemotherapy. In: 2010 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW). IEEE: 2010. p. 467\u201370. https:\/\/doi.org\/10.1109\/bibmw.2010.5703846.","DOI":"10.1109\/bibmw.2010.5703846"},{"key":"985_CR42","first-page":"132","volume":"2014","author":"P Zhang","year":"2014","unstructured":"Zhang P, Wang F, Hu J, Sorrentino R. Towards personalized medicine: leveraging patient similarity and drug similarity analytics. AMIA Summits Transl Sci Proc. 2014; 2014:132\u20136.","journal-title":"AMIA Summits Transl Sci Proc"},{"issue":"Nov","key":"985_CR43","first-page":"2579","volume":"9","author":"Lvd Maaten","year":"2008","unstructured":"Maaten Lvd, Hinton G. Visualizing data using t-sne. J Mach Learn Res. 2008; 9(Nov):2579\u2013605.","journal-title":"J Mach Learn Res"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0985-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-019-0985-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0985-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,16]],"date-time":"2020-12-16T00:14:10Z","timestamp":1608077650000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-019-0985-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":43,"journal-issue":{"issue":"S8","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["985"],"URL":"https:\/\/doi.org\/10.1186\/s12911-019-0985-7","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"17 December 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"We obtained the consent to publish their clinical data from the patients in this study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"259"}}