{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T15:07:03Z","timestamp":1782486423942,"version":"3.54.5"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T00:00:00Z","timestamp":1706745600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T00:00:00Z","timestamp":1706745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann Oper Res"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Decision support systems are being developed to assist clinicians in complex decision-making processes by leveraging information from clinical knowledge and electronic health records (EHRs). One typical application is disease risk prediction, which can be challenging due to the complexity of modelling longitudinal EHR data, including unstructured medical notes. To address this challenge, we propose a deep state-space model (DSSM) that simulates the patient\u2019s state transition process and formally integrates latent states with risk observations. A typical DSSM consists of three parts: a prior module that generates the distribution of the current latent state based on previous states; a posterior module that approximates the latent states using up-to-date medical notes; and a likelihood module that predicts disease risks using latent states. To efficiently and effectively encode raw medical notes, our posterior module uses an attentive encoder to better extract information from unstructured high-dimensional medical notes. Additionally, we couple a predictive clustering algorithm into our DSSM to learn clinically useful representations of patients\u2019 latent states. The latent states are clustered into multiple groups, and the weighted average of the cluster centres is used for prediction. We demonstrate the effectiveness of our deep clustering-based state-space model using two real-world EHR datasets, showing that it not only generates better risk prediction results than other baseline methods but also clusters similar patient health states into groups.<\/jats:p>","DOI":"10.1007\/s10479-023-05817-1","type":"journal-article","created":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T15:02:19Z","timestamp":1706799739000},"page":"647-672","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A deep clustering-based state-space model for improved disease risk prediction in personalized healthcare"],"prefix":"10.1007","volume":"341","author":[{"given":"Shuai","family":"Niu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Bai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1496-8923","authenticated-orcid":false,"given":"Xian","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,1]]},"reference":[{"key":"5817_CR1","unstructured":"Aguiar, H., Santos, M., Watkinson, P., & Zhu, T. (2022). Learning of cluster-based feature importance for electronic health record time-series. In International conference on machine learning (pp. 161\u2013179). PMLR."},{"key":"5817_CR2","unstructured":"Alaa, A., & van\u00a0der Schaar, M. (2019). Attentive state-space modeling of disease progression."},{"key":"5817_CR3","doi-asserted-by":"crossref","unstructured":"Alsentzer, E., Murphy, J.R., Boag, W., Weng, W.-H., Jin, D., Naumann, T., & McDermott, M. (2019). Publicly available clinical bert embeddings. arXiv preprint arXiv:1904.03323","DOI":"10.18653\/v1\/W19-1909"},{"issue":"1","key":"5817_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/03610927408827101","volume":"3","author":"T Cali\u0144ski","year":"1974","unstructured":"Cali\u0144ski, T., & Harabasz, J. (1974). A dendrite method for cluster analysis. Communications in Statistics-Theory and Methods, 3(1), 1\u201327.","journal-title":"Communications in Statistics-Theory and Methods"},{"key":"5817_CR5","unstructured":"Che, Z., Cheng, Y., Sun, Z., & Liu, Y. (2017). Exploiting convolutional neural network for risk prediction with medical feature embedding. arXiv preprint arXiv:1701.07474"},{"key":"5817_CR6","unstructured":"Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F., & Sun, J. (2016). Doctor ai: Predicting clinical events via recurrent neural networks. In Machine learning for healthcare conference (pp. 301\u2013318). PMLR"},{"key":"5817_CR7","doi-asserted-by":"crossref","unstructured":"Choi, E., Bahadori, M.T., Song, L., Stewart, W.F., & Sun, J. (2017). Gram: graph-based attention model for healthcare representation learning. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 787\u2013795).","DOI":"10.1145\/3097983.3098126"},{"key":"5817_CR8","unstructured":"Choi, E., Bahadori, M. T., Sun, J., Kulas, J., Schuetz, A., & Stewart, W. (2016). Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. Advances in neural information processing systems, Vol. 29."},{"key":"5817_CR9","unstructured":"Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555"},{"key":"5817_CR10","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","volume":"2","author":"DL Davies","year":"1979","unstructured":"Davies, D. L., & Bouldin, D. W. (1979). A cluster separation measure. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2, 224\u2013227.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"5817_CR11","doi-asserted-by":"crossref","unstructured":"Esteban, C., Staeck, O., Baier, S., Yang, Y., & Tresp, V. (2016). Predicting clinical events by combining static and dynamic information using recurrent neural networks. In 2016 IEEE international conference on healthcare informatics (ICHI) (pp. 93\u2013101). IEEE.","DOI":"10.1109\/ICHI.2016.16"},{"key":"5817_CR12","doi-asserted-by":"crossref","unstructured":"Ghosh, S., Cheng, Y., & Sun, Z. (2016). Deep state space models for computational phenotyping. In 2016 IEEE international conference on healthcare informatics (ICHI) (pp. 399\u2013402). IEEE.","DOI":"10.1109\/ICHI.2016.71"},{"issue":"1","key":"5817_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-22578-1","volume":"8","author":"A Giannoula","year":"2018","unstructured":"Giannoula, A., Gutierrez-Sacrist\u00e1n, A., Bravo, \u00c1., Sanz, F., & Furlong, L. I. (2018). Identifying temporal patterns in patient disease trajectories using dynamic time warping: A population-based study. Scientific Reports, 8(1), 1\u201314.","journal-title":"Scientific Reports"},{"issue":"1","key":"5817_CR14","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1038\/s41597-019-0103-9","volume":"6","author":"H Harutyunyan","year":"2019","unstructured":"Harutyunyan, H., Khachatrian, H., Kale, D. C., Ver Steeg, G., & Galstyan, A. (2019). Multitask learning and benchmarking with clinical time series data. Scientific Data, 6(1), 96.","journal-title":"Scientific Data"},{"issue":"8","key":"5817_CR15","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735\u20131780.","journal-title":"Neural Computation"},{"issue":"1","key":"5817_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AE Johnson","year":"2016","unstructured":"Johnson, A. E., Pollard, T. J., Shen, L., Li-Wei, H. L., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Celi, L. A., & Mark, R. G. (2016). Mimic-iii, a freely accessible critical care database. Scientific Data, 3(1), 1\u20139.","journal-title":"Scientific Data"},{"key":"5817_CR17","unstructured":"Kingma, D.P., & Welling, M. (2013). Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114"},{"key":"5817_CR18","doi-asserted-by":"crossref","unstructured":"Krishnan, R., Shalit, U., & Sontag, D. (2017). Structured inference networks for nonlinear state space models. In Proceedings of the AAAI conference on artificial intelligence, Vol. 31.","DOI":"10.1609\/aaai.v31i1.10779"},{"key":"5817_CR19","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1016\/j.jbi.2015.09.018","volume":"58","author":"V Kumar","year":"2015","unstructured":"Kumar, V., Stubbs, A., Shaw, S., & Uzuner, \u00d6. (2015). Creation of a new longitudinal corpus of clinical narratives. Journal of Biomedical Informatics, 58, 6\u201310.","journal-title":"Journal of Biomedical Informatics"},{"key":"5817_CR20","unstructured":"Lee, C., & Van Der\u00a0Schaar, M. (2020). Temporal phenotyping using deep predictive clustering of disease progression. In International conference on machine learning (pp. 5767\u20135777). PMLR."},{"key":"5817_CR21","doi-asserted-by":"crossref","unstructured":"Li, J., Wu, B., Sun, X., & Wang, Y. (2021). Causal hidden Markov model for time series disease forecasting. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 12105\u201312114).","DOI":"10.1109\/CVPR46437.2021.01193"},{"key":"5817_CR22","unstructured":"Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015). Learning to diagnose with lstm recurrent neural networks. arXiv preprint arXiv:1511.03677"},{"key":"5817_CR23","doi-asserted-by":"crossref","unstructured":"Luo, J., Ye, M., Xiao, C., & Ma, F. (2020). Hitanet: Hierarchical time-aware attention networks for risk prediction on electronic health records. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining (pp. 647\u2013656).","DOI":"10.1145\/3394486.3403107"},{"key":"5817_CR24","doi-asserted-by":"crossref","unstructured":"Ma, F., Chitta, R., Zhou, J., You, Q., Sun, T., & Gao, J. (2017). Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1903\u20131911).","DOI":"10.1145\/3097983.3098088"},{"key":"5817_CR25","doi-asserted-by":"crossref","unstructured":"Ma, F., You, Q., Xiao, H., Chitta, R., Zhou, J., & Gao, J. (2018). Kame: Knowledge-based attention model for diagnosis prediction in healthcare. In Proceedings of the 27th ACM international conference on information and knowledge management (pp. 743\u2013752).","DOI":"10.1145\/3269206.3271701"},{"key":"5817_CR26","doi-asserted-by":"crossref","unstructured":"Ma, L., Zhang, C., Wang, Y., Ruan, W., Wang, J., Tang, W., Ma, X., Gao, X., & Gao, J. (2020). Concare: Personalized clinical feature embedding via capturing the healthcare context. In Proceedings of the AAAI conference on artificial intelligence (Vol. 34, pp. 833\u2013840).","DOI":"10.1609\/aaai.v34i01.5428"},{"key":"5817_CR27","doi-asserted-by":"crossref","unstructured":"Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., & Eisenstein, J. (2018). Explainable prediction of medical codes from clinical text. arXiv preprint arXiv:1802.05695","DOI":"10.18653\/v1\/N18-1100"},{"key":"5817_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2021.103889","volume":"122","author":"S Mullin","year":"2021","unstructured":"Mullin, S., Zola, J., Lee, R., Hu, J., MacKenzie, B., Brickman, A., Anaya, G., Sinha, S., Li, A., & Elkin, P. L. (2021). Longitudinal k-means approaches to clustering and analyzing ehr opioid use trajectories for clinical subtypes. Journal of Biomedical Informatics, 122, 103889.","journal-title":"Journal of Biomedical Informatics"},{"key":"5817_CR29","doi-asserted-by":"crossref","unstructured":"Niu, S., Qin, Y., Song, Y., Guo, Y., & Yang, X. (2021). Label dependent attention model for disease risk prediction using multimodal electronic health records. In Proceedings of the IEEE conference on data mining (pp. 455\u2013464).","DOI":"10.1109\/ICDM51629.2021.00056"},{"key":"5817_CR30","doi-asserted-by":"crossref","unstructured":"Niu, S., Song, Y., Qin, Y., Guo, Y., & Yang, X. (2021). Label-dependent and event-guided interpretable disease risk prediction using ehrs. In Proceedings of the IEEE international conference on bioinformatics and biomedicine (BIBM)","DOI":"10.1109\/BIBM52615.2021.9669675"},{"key":"5817_CR31","doi-asserted-by":"crossref","unstructured":"Oezyurt, Y., Kraus, M., Hatt, T., & Feuerriegel, S. (2021). Attdmm: An attentive deep markov model for risk scoring in intensive care units. arXiv preprint arXiv:2102.04702","DOI":"10.1145\/3447548.3467143"},{"key":"5817_CR32","first-page":"1","volume":"1","author":"Z Qiao","year":"2019","unstructured":"Qiao, Z., Wu, X., Ge, S., & Fan, W. (2019). Mnn: Multimodal attentional neural networks for diagnosis prediction. Extraction, 1, 1.","journal-title":"Extraction"},{"key":"5817_CR33","first-page":"7785","volume":"31","author":"SS Rangapuram","year":"2018","unstructured":"Rangapuram, S. S., Seeger, M. W., Gasthaus, J., Stella, L., Wang, Y., & Januschowski, T. (2018). Deep state space models for time series forecasting. Advances in Neural Information Processing Systems, 31, 7785\u20137794.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"5817_CR34","unstructured":"Razavian, N., & Sontag, D. (2015). Temporal convolutional neural networks for diagnosis from lab tests. arXiv preprint arXiv:1511.07938"},{"key":"5817_CR35","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","volume":"20","author":"PJ Rousseeuw","year":"1987","unstructured":"Rousseeuw, P. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20, 53\u201365.","journal-title":"Journal of Computational and Applied Mathematics"},{"issue":"11","key":"5817_CR36","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster, M., & Paliwal, K. K. (1997). Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11), 2673\u20132681.","journal-title":"IEEE Transactions on Signal Processing"},{"key":"5817_CR37","doi-asserted-by":"crossref","unstructured":"Shang, J., Xiao, C., Ma, T., Li, H., & Sun, J. (2019). Gamenet: Graph augmented memory networks for recommending medication combination. In Proceedings of the AAAI conference on artificial intelligence (Vol. 33, pp. 1126\u20131133).","DOI":"10.1609\/aaai.v33i01.33011126"},{"key":"5817_CR38","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1200\/CCI.19.00105","volume":"4","author":"S Tang","year":"2020","unstructured":"Tang, S., Chappell, G. T., Mazzoli, A., Tewari, M., Choi, S. W., & Wiens, J. (2020). Predicting acute graft-versus-host disease using machine learning and longitudinal vital sign data from electronic health records. JCO Clinical Cancer Informatics, 4, 128\u2013135.","journal-title":"JCO Clinical Cancer Informatics"},{"key":"5817_CR39","doi-asserted-by":"crossref","unstructured":"Tzirakis, P., Nicolaou, M.A., Schuller, B., & Zafeiriou, S. (2019). Time-series clustering with jointly learning deep representations, clusters and temporal boundaries. In 2019 14th IEEE international conference on automatic face & gesture recognition (FG 2019) (pp. 1\u20135). IEEE.","DOI":"10.1109\/FG.2019.8756618"},{"key":"5817_CR40","unstructured":"Van\u00a0der Maaten, L., & Hinton, G. (2008). Visualizing data using t-sne. Journal of Machine Learning Research, 9(11)."},{"key":"5817_CR41","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., & Polosukhin, I. (2017). Attention is all you need. In Advances in neural information processing systems (pp. 5998\u20136008)."},{"key":"5817_CR42","doi-asserted-by":"crossref","unstructured":"Wang, G., Li, C., Wang, W., Zhang, Y., Shen, D., Zhang, X., Henao, R., & Carin, L. (2018). Joint embedding of words and labels for text classification. In Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: Long papers) (pp. 2321\u20132331). Association for Computational Linguistics, Melbourne, Australia. https:\/\/aclanthology.org\/P18-1216","DOI":"10.18653\/v1\/P18-1216"},{"key":"5817_CR43","unstructured":"Xie, J., Girshick, R., & Farhadi, A. (2016). Unsupervised deep embedding for clustering analysis. In International conference on machine learning (pp. 478\u2013487). PMLR."},{"key":"5817_CR44","doi-asserted-by":"crossref","unstructured":"Xu, Y., Biswal, S., Deshpande, S. R., Maher, K. O., & Sun, J. (2018). Raim: Recurrent attentive and intensive model of multimodal patient monitoring data. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining (pp. 2565\u20132573).","DOI":"10.1145\/3219819.3220051"},{"key":"5817_CR45","doi-asserted-by":"crossref","unstructured":"Zhang, D., Nan, F., Wei, X., Li, S., Zhu, H., McKeown, K., Nallapati, R., Arnold, A., & Xiang, B. (2021). Supporting clustering with contrastive learning. arXiv preprint arXiv:2103.12953","DOI":"10.18653\/v1\/2021.naacl-main.427"},{"issue":"1","key":"5817_CR46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"X Zhang","year":"2019","unstructured":"Zhang, X., Chou, J., Liang, J., Xiao, C., Zhao, Y., Sarva, H., Henchcliffe, C., & Wang, F. (2019). Data-driven subtyping of Parkinson\u2019s disease using longitudinal clinical records: A cohort study. Scientific Reports, 9(1), 1\u201312.","journal-title":"Scientific Reports"}],"container-title":["Annals of Operations Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-023-05817-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10479-023-05817-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-023-05817-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T11:21:32Z","timestamp":1727695292000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10479-023-05817-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,1]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["5817"],"URL":"https:\/\/doi.org\/10.1007\/s10479-023-05817-1","relation":{},"ISSN":["0254-5330","1572-9338"],"issn-type":[{"value":"0254-5330","type":"print"},{"value":"1572-9338","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,1]]},"assertion":[{"value":"26 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 December 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article. This article does not contain any studies with human participants or animals performed by any of the authors.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}