{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T11:06:38Z","timestamp":1772017598371,"version":"3.50.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["Discovery Grant"],"award-info":[{"award-number":["Discovery Grant"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We consider the modeling of data generated by a latent continuous-time Markov jump process with a state space of finite but unknown dimensions. Typically in such models, the number of states has to be pre-specified, and Bayesian inference for a fixed number of states has not been studied until recently. In addition, although approaches to address the problem for discrete-time models have been developed, no method has been successfully implemented for the continuous-time case. We focus on reversible jump Markov chain Monte Carlo which allows the trans-dimensional move among different numbers of states in order to perform Bayesian inference for the unknown number of states. Specifically, we propose an efficient split-combine move which can facilitate the exploration of the parameter space, and demonstrate that it can be implemented effectively at scale. Subsequently, we extend this algorithm to the context of model-based clustering, allowing numbers of states and clusters both determined during the analysis. The model formulation, inference methodology, and associated algorithm are illustrated by simulation studies. Finally, we apply this method to real data from a Canadian healthcare system in Quebec.<\/jats:p>","DOI":"10.1007\/s11222-021-10032-8","type":"journal-article","created":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T06:02:49Z","timestamp":1628575369000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Bayesian inference for continuous-time hidden Markov models with an unknown number of states"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0434-2916","authenticated-orcid":false,"given":"Yu","family":"Luo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David A.","family":"Stephens","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,8,10]]},"reference":[{"issue":"1","key":"10032_CR1","first-page":"108","volume":"19","author":"AM Alaa","year":"2018","unstructured":"Alaa, A.M., Van Der Schaar, M.: A hidden absorbing semi-Markov model for informatively censored temporal data: learning and inference. J. Mach. Learn. Res. 19(1), 108\u2013169 (2018)","journal-title":"J. Mach. Learn. Res."},{"issue":"3","key":"10032_CR2","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1111\/j.1467-9868.2005.00508.x","volume":"67","author":"M Bladt","year":"2005","unstructured":"Bladt, M., S\u00f8rensen, M.: Statistical inference for discretely observed Markov jump processes. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 67(3), 395\u2013410 (2005)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"1","key":"10032_CR3","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/1467-9868.03711","volume":"65","author":"SP Brooks","year":"2003","unstructured":"Brooks, S.P., Giudici, P., Roberts, G.O.: Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions (with discussion). J. R. Stat. Soc. Ser. B (Stat. Methodol.) 65(1), 3\u201355 (2003)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"3","key":"10032_CR4","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1111\/1467-9868.00409","volume":"65","author":"O Capp\u00e9","year":"2003","unstructured":"Capp\u00e9, O., Robert, C.P., Ryd\u00e9n, T.: Reversible jump, birth-and-death and more general continuous time Markov chain Monte Carlo samplers. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 65(3), 679\u2013700 (2003)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"3","key":"10032_CR5","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1111\/j.2517-6161.1995.tb02042.x","volume":"57","author":"BP Carlin","year":"1995","unstructured":"Carlin, B.P., Chib, S.: Bayesian model choice via Markov chain Monte Carlo methods. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 57(3), 473\u2013484 (1995)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"4","key":"10032_CR6","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1007\/s00180-007-0097-1","volume":"23","author":"G Celeux","year":"2008","unstructured":"Celeux, G., Durand, J.-B.: Selecting hidden Markov model state number with cross-validated likelihood. Comput. Stat. 23(4), 541\u2013564 (2008)","journal-title":"Comput. Stat."},{"issue":"441","key":"10032_CR7","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1080\/01621459.1998.10474110","volume":"93","author":"A Dasgupta","year":"1998","unstructured":"Dasgupta, A., Raftery, A.E.: Detecting features in spatial point processes with clutter via model-based clustering. J. Am. Stat. Assoc. 93(441), 294\u2013302 (1998)","journal-title":"J. Am. Stat. Assoc."},{"issue":"1","key":"10032_CR8","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1007\/s11222-006-5338-6","volume":"16","author":"P Dellaportas","year":"2006","unstructured":"Dellaportas, P., Papageorgiou, I.: Multivariate mixtures of normals with unknown number of components. Stat. Comput. 16(1), 57\u201368 (2006)","journal-title":"Stat. Comput."},{"issue":"8","key":"10032_CR9","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1093\/comjnl\/41.8.578","volume":"41","author":"C Fraley","year":"1998","unstructured":"Fraley, C., Raftery, A.E.: How many clusters? Which clustering method? Answers via model-based cluster analysis. Comput. J. 41(8), 578\u2013588 (1998)","journal-title":"Comput. J."},{"key":"10032_CR10","unstructured":"Fr\u00fchwirth-Schnatter, S., Malsiner-Walli G., Gr\u00fcn, B.: Generalized mixtures of finite mixtures and telescoping sampling. (2020) arXiv preprint arXiv:2005.09918"},{"issue":"2","key":"10032_CR11","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1198\/10618600152627924","volume":"10","author":"SJ Godsill","year":"2001","unstructured":"Godsill, S.J.: On the relationship between Markov chain Monte Carlo methods for model uncertainty. J. Comput. Graph. Stat. 10(2), 230\u2013248 (2001)","journal-title":"J. Comput. Graph. Stat."},{"key":"10032_CR12","unstructured":"GOLD Executive Committee (2017) Pocket guide to COPD diagnosis, management and prevention: a guide for health care professionals 2017 report"},{"issue":"4","key":"10032_CR13","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1093\/biomet\/82.4.711","volume":"82","author":"PJ Green","year":"1995","unstructured":"Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82(4), 711\u2013732 (1995)","journal-title":"Biometrika"},{"issue":"3","key":"10032_CR14","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1214\/09-AOAS247","volume":"3","author":"A Hobolth","year":"2009","unstructured":"Hobolth, A., Stone, E.A.: Simulation from endpoint-conditioned, continuous-time Markov chains on a finite state space, with applications to molecular evolution. Ann. Appl. Stat. 3(3), 1204\u20131231 (2009)","journal-title":"Ann. Appl. Stat."},{"issue":"2","key":"10032_CR15","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1111\/1467-9884.00351","volume":"52","author":"CH Jackson","year":"2003","unstructured":"Jackson, C.H., Sharples, L.D., Thompson, S.G., Duffy, S.W., Couto, E.: Multistate Markov models for disease progression with classification error. J. R. Stat. Soc. Ser. D (Stat.) 52(2), 193\u2013209 (2003)","journal-title":"J. R. Stat. Soc. Ser. D (Stat.)"},{"key":"10032_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4684-6275-3","volume-title":"Statistical analysis of counting processes","author":"M Jacobsen","year":"1982","unstructured":"Jacobsen, M.: Statistical analysis of counting processes, vol. 12. Springer, Berlin (1982)"},{"issue":"1","key":"10032_CR17","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1214\/088342305000000016","volume":"20","author":"A Jasra","year":"2005","unstructured":"Jasra, A., Holmes, C.C., Stephens, D.A.: Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling. Stat. Sci. 20(1), 50\u201367 (2005)","journal-title":"Stat. Sci."},{"issue":"3","key":"10032_CR18","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.1214\/17-AOAS1130","volume":"12","author":"JM Lange","year":"2018","unstructured":"Lange, J.M., Gulati, R., Leonardson, A.S., Lin, D.W., Newcomb, L.F., Trock, B.J., Carter, H.B., Cooperberg, M.R., Cowan, J.E., Klotz, L.H.: Estimating and comparing cancer progression risks under varying surveillance protocols. Ann. Appl. Stat. 12(3), 1773\u20131795 (2018)","journal-title":"Ann. Appl. Stat."},{"issue":"1","key":"10032_CR19","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1111\/biom.12252","volume":"71","author":"JM Lange","year":"2015","unstructured":"Lange, J.M., Hubbard, R.A., Inoue, L.Y., Minin, V.N.: A joint model for multistate disease processes and random informative observation times, with applications to electronic medical records data. Biometrics 71(1), 90\u2013101 (2015)","journal-title":"Biometrics"},{"issue":"3","key":"10032_CR20","first-page":"1","volume":"3","author":"L Lix","year":"2018","unstructured":"Lix, L., Ayles, J., Bartholomew, S., Cooke, C., Ellison, J., Emond, V., Hamm, N., Hannah, H., Jean, S., LeBlanc, S., et al.: The Canadian chronic disease surveillance system: a model for collaborative surveillance. Int. J. Popul. Data Sci.. 3(3), 1\u201311 (2018)","journal-title":"Int. J. Popul. Data Sci.."},{"key":"10032_CR21","unstructured":"Luo, Y., Stephens, D.A., Buckeridge, D.L.: Bayesian clustering for continuous-time hidden Markov models. (2021) arXiv preprint arXiv:1906.10252"},{"issue":"1","key":"10032_CR22","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1111\/biom.13261","volume":"77","author":"Y Luo","year":"2021","unstructured":"Luo, Y., Stephens, D.A., Verma, A., Buckeridge, D.L.: Bayesian latent multi-state modeling for non-equidistant longitudinal electronic health records. Biometrics 77(1), 78\u201390 (2021)","journal-title":"Biometrics"},{"key":"10032_CR23","unstructured":"Mews, S., Langrock, R., King, R., Quick, N.: Continuous-time multi-state capture-recapture models. (2020) arXiv preprint arXiv:2002.10997"},{"issue":"521","key":"10032_CR24","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1080\/01621459.2016.1255636","volume":"113","author":"JW Miller","year":"2018","unstructured":"Miller, J.W., Harrison, M.T.: Mixture models with a prior on the number of components. J. Am. Stat. Assoc. 113(521), 340\u2013356 (2018)","journal-title":"J. Am. Stat. Assoc."},{"issue":"2","key":"10032_CR25","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1080\/10618600.2000.10474879","volume":"9","author":"RM Neal","year":"2000","unstructured":"Neal, R.M.: Markov chain sampling methods for Dirichlet process mixture models. J. Comput. Graph. Stat. 9(2), 249\u2013265 (2000)","journal-title":"J. Comput. Graph. Stat."},{"issue":"3","key":"10032_CR26","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1007\/s13253-017-0283-8","volume":"22","author":"J Pohle","year":"2017","unstructured":"Pohle, J., Langrock, R., van Beest, F.M., Schmidt, N.M.: Selecting the number of states in hidden Markov models: pragmatic solutions illustrated using animal movement. J. Agric. Biol. Environ. Stat. 22(3), 270\u2013293 (2017)","journal-title":"J. Agric. Biol. Environ. Stat."},{"issue":"4","key":"10032_CR27","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1111\/1467-9868.00095","volume":"59","author":"S Richardson","year":"1997","unstructured":"Richardson, S., Green, P.J.: On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. R. Stat. Soc. Ser. B (Stat. Methodol.) 59(4), 731\u2013792 (1997)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"1","key":"10032_CR28","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1111\/1467-9868.00219","volume":"62","author":"CP Robert","year":"2000","unstructured":"Robert, C.P., Ryden, T., Titterington, D.M.: Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 62(1), 57\u201375 (2000)","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"issue":"1","key":"10032_CR29","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1214\/aos\/1016120364","volume":"28","author":"M Stephens","year":"2000","unstructured":"Stephens, M.: Bayesian analysis of mixture models with an unknown number of components-an alternative to reversible jump methods. Ann. Stat. 28(1), 40\u201374 (2000)","journal-title":"Ann. Stat."},{"issue":"3","key":"10032_CR30","doi-asserted-by":"publisher","first-page":"966","DOI":"10.1111\/biom.13019","volume":"75","author":"A Tancredi","year":"2019","unstructured":"Tancredi, A.: Approximate Bayesian inference for discretely observed continuous-time multi-state models. Biometrics 75(3), 966\u2013977 (2019)","journal-title":"Biometrics"},{"issue":"529","key":"10032_CR31","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1080\/01621459.2019.1594831","volume":"115","author":"JP Williams","year":"2020","unstructured":"Williams, J.P., Storlie, C.B., Therneau, T.M., Jack, C.R., Jr., Hannig, J.: A Bayesian approach to multistate hidden Markov models: application to dementia progression. J. Am. Stat. Assoc. 115(529), 16\u201331 (2020)","journal-title":"J. Am. Stat. Assoc."}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10032-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-021-10032-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10032-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T04:58:59Z","timestamp":1725598739000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-021-10032-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,10]]},"references-count":31,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["10032"],"URL":"https:\/\/doi.org\/10.1007\/s11222-021-10032-8","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,10]]},"assertion":[{"value":"9 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"57"}}