{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T05:14:46Z","timestamp":1783574086905,"version":"3.55.0"},"reference-count":29,"publisher":"MIT Press","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2000,4,1]]},"abstract":"<jats:p>We introduce a new statistical model for time series that iteratively segments data into regimes with approximately linear dynamics and learns the parameters of each of these linear regimes. This model combines and generalizes two of the most widely used stochastic time-series models\u2014hidden Markov models and linear dynamical systems\u2014and is closely related to models that are widely used in the control and econometrics literatures. It can also be derived by extending the mixture of experts neural network (Jacobs, Jordan, Nowlan, &amp; Hinton, 1991) to its fully dynamical version, in which both expert and gating networks are recurrent. Inferring the posterior probabilities of the hidden states of this model is computationally intractable, and therefore the exact expectation maximization (EM) algorithm cannot be applied. However, we present a variational approximation that maximizes a lower bound on the log-likelihood and makes use of both the forward and backward recursions for hidden Markov models and the Kalman filter recursions for linear dynamical systems. We tested the algorithm on artificial data sets and a natural data set of respiration force from a patient with sleep apnea. The results suggest that variational approximations are a viable method for inference and learning in switching state-space models.<\/jats:p>","DOI":"10.1162\/089976600300015619","type":"journal-article","created":{"date-parts":[[2002,7,27]],"date-time":"2002-07-27T11:57:56Z","timestamp":1027771076000},"page":"831-864","source":"Crossref","is-referenced-by-count":244,"title":["Variational Learning for Switching State-Space Models"],"prefix":"10.1162","volume":"12","author":[{"given":"Zoubin","family":"Ghahramani","sequence":"first","affiliation":[{"name":"Gatsby Computational Neuroscience Unit, University College London, London WC1N 3AR, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geoffrey E.","family":"Hinton","sequence":"additional","affiliation":[{"name":"Gatsby Computational Neuroscience Unit, University College London, London WC1N 3AR, U.K."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"p_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1970.1099359"},{"key":"p_4","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.91.3.1059"},{"key":"p_6","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177697196"},{"key":"p_9","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/81.3.541"},{"key":"p_10","doi-asserted-by":"publisher","DOI":"10.1109\/3477.584952"},{"key":"p_11","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.1978.308603"},{"key":"p_13","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.1989.tb00324.x"},{"key":"p_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","volume":"39","author":"Dempster A.","year":"1977","journal-title":"J. Royal Statistical Society Series B"},{"key":"p_15","doi-asserted-by":"publisher","DOI":"10.1109\/89.242494"},{"key":"p_16","doi-asserted-by":"publisher","DOI":"10.1109\/89.242489"},{"key":"p_22","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007425814087"},{"key":"p_24","doi-asserted-by":"publisher","DOI":"10.2307\/1912559"},{"key":"p_26","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1111\/j.2517-6161.1976.tb01586.x","volume":"38","author":"Harrison P. J.","year":"1976","journal-title":"J. Royal Statistical Society B"},{"key":"p_27","doi-asserted-by":"publisher","DOI":"10.1109\/72.554192"},{"key":"p_28","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1991.3.1.79"},{"key":"p_30","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1994.6.2.181"},{"key":"p_31","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1991.10484833"},{"key":"p_33","doi-asserted-by":"publisher","DOI":"10.1115\/1.3658902"},{"key":"p_35","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1691"},{"key":"p_36","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4076(94)90036-1"},{"key":"p_37","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1111\/j.2517-6161.1988.tb01721.x","author":"Lauritzen S. L.","year":"1988","journal-title":"J. Royal Statistical Society B"},{"key":"p_42","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1996.8.2.340"},{"key":"p_44","first-page":"4","volume":"3","author":"Rabiner L. R.","year":"1986","journal-title":"IEEE Acoustics, Speech & Signal Processing Magazine"},{"key":"p_45","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1963.1105600"},{"key":"p_47","doi-asserted-by":"publisher","DOI":"10.1162\/089976699300016674"},{"key":"p_49","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9892.1982.tb00349.x"},{"key":"p_50","doi-asserted-by":"publisher","DOI":"10.2307\/2290410"},{"key":"p_51","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(94)90024-8"},{"key":"p_52","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.2.227"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/089976600300015619","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,8]],"date-time":"2024-12-08T23:49:33Z","timestamp":1733701773000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/12\/4\/831-864\/6358"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2000,4,1]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2000,4,1]]}},"alternative-id":["10.1162\/089976600300015619"],"URL":"https:\/\/doi.org\/10.1162\/089976600300015619","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2000,4,1]]}}}