{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T05:19:10Z","timestamp":1794979150795,"version":"4.9.1"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2009,2,20]],"date-time":"2009-02-20T00:00:00Z","timestamp":1235088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,6,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>We propose a generic on-line (also sometimes called adaptive or recursive) version of the expectation\u2013maximization (EM) algorithm applicable to latent variable models of independent observations. Compared with the algorithm of Titterington, this approach is more directly connected to the usual EM algorithm and does not rely on integration with respect to the complete-data distribution. The resulting algorithm is usually simpler and is shown to achieve convergence to the stationary points of the Kullback\u2013Leibler divergence between the marginal distribution of the observation and the model distribution at the optimal rate, i.e. that of the maximum likelihood estimator. In addition, the approach proposed is also suitable for conditional (or regression) models, as illustrated in the case of the mixture of linear regressions model.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2009.00698.x","type":"journal-article","created":{"date-parts":[[2009,2,20]],"date-time":"2009-02-20T04:39:50Z","timestamp":1235104790000},"page":"593-613","source":"Crossref","is-referenced-by-count":358,"title":["On-Line Expectation\u2013Maximization Algorithm for latent Data Models"],"prefix":"10.1093","volume":"71","author":[{"given":"Olivier","family":"Capp\u00e9","sequence":"first","affiliation":[{"name":"TELECOM ParisTech and Centre National de la Recherche Scientifique , Paris , France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Moulines","sequence":"additional","affiliation":[{"name":"TELECOM ParisTech and Centre National de la Recherche Scientifique , Paris , France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2009,2,20]]},"reference":[{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1137\/S0363012902417267","article-title":"Stability of stochastic approximation under verifiable conditions","volume":"44","author":"Andrieu","year":"2005","journal-title":"SIAM J. Control Optimizn"},{"key":"2023032921204793100_","doi-asserted-by":"publisher","DOI":"10.1109\/icASSP.2006.1660741","volume-title":"Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Toulouse","author":"Capp\u00e9","year":"2006"},{"key":"2023032921204793100_","volume-title":"Stochastic Approximation and Its Applications","author":"Chen","year":"2002"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"2664","DOI":"10.1109\/TSP.2005.850339","article-title":"Recursive EM and SAGE-inspired algorithms with application to DOA estimation","volume":"53","author":"Chung","year":"2005","journal-title":"IEEE Trans. Signal Process."},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm (with discussion)","volume":"39","author":"Dempster","year":"1977","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"5247","DOI":"10.1016\/j.csda.2006.08.014","article-title":"Fitting finite mixtures of generalized linear regressions in R","volume":"51","author":"Gr\u00fcn","year":"2007","journal-title":"Comput. Statist. Data Anal."},{"key":"2023032921204793100_","first-page":"55","article-title":"Estimating mixtures of regressions","volume":"12","author":"Hurn","year":"2003","journal-title":"Comput. Statist. Data Anal."},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1162\/neco.1994.6.2.181","article-title":"Hierarchical mixtures of experts and the EM algorithm","volume":"6","author":"Jordan","year":"1994","journal-title":"Neur. Computn"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-2696-8","volume-title":"Stochastic Approximation Algorithms and Applications","author":"Kushner","year":"1997"},{"key":"2023032921204793100_","volume-title":"Stochastic Approximation and Recursive Algorithm and Applications","author":"Kushner","year":"2003"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/j.2517-6161.1995.tb02037.x","article-title":"A gradient algorithm locally equivalent to the EM algorithm","volume":"57","author":"Lange","year":"1995","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921204793100_","first-page":"1","article-title":"FlexMix: a general framework for finite mixture models and latent class regression in R","volume":"11","author":"Leisch","year":"2004","journal-title":"J. Statist. Softwr."},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1016\/j.csda.2004.11.002","article-title":"Online EM algorithm for mixture with application to internet traffic modeling","volume":"50","author":"Liu","year":"2006","journal-title":"Comput. Statist. Data. Anal."},{"key":"2023032921204793100_","volume-title":"The EM Algorithm and Extensions","author":"McLachlan","year":"1997"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1214\/105051606000000448","article-title":"Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithms","volume":"16","author":"Mokkadem","year":"2006","journal-title":"Ann. Appl. Probab."},{"key":"2023032921204793100_","first-page":"355","volume-title":"Learning in Graphical Models","author":"Neal","year":"1999"},{"key":"2023032921204793100_","volume-title":"Soft competitive adaptation: neural network learning algorithms based on fitting statistical mixtures","author":"Nowlan","year":"1991"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1214\/aoap\/1027961032","article-title":"Weak convergence rates for stochastic approximation with application to multiple targets and simulated annealing","volume":"8","author":"Pelletier","year":"1998","journal-title":"Ann. Appl. Probab."},{"key":"2023032921204793100_","first-page":"98","article-title":"A new method of stochastic approximation type","volume":"51","author":"Polyak","year":"1990","journal-title":"Autom. Remote Control"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1137\/0330046","article-title":"Acceleration of stochastic approximation by averaging","volume":"30","author":"Polyak","year":"1992","journal-title":"SIAM J. Control Optimizn"},{"key":"2023032921204793100_","volume-title":"Efficient estimation from a slowly convergent Robbins-Monro process","author":"Ruppert","year":"1988"},{"key":"2023032921204793100_","first-page":"476","volume-title":"Proc. Int. Conf. Neural Information Processing","author":"Sato","year":"2000"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1162\/089976600300015853","article-title":"On-line EM algorithm for the normalized Gaussian network","volume":"12","author":"Sato","year":"2000","journal-title":"Neur. Computn"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4684-0192-9","volume-title":"Tools for Statistical Inference","author":"Tanner","year":"1993"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1111\/j.2517-6161.1984.tb01296.x","article-title":"Recursive parameter estimation using incomplete data","volume":"46","author":"Titterington","year":"1984","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921204793100_","volume-title":"Statistical Analysis of Finite Mixture Distributions","author":"Titterington","year":"1985"},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"2001","DOI":"10.1016\/j.spl.2006.05.017","article-title":"Almost sure convergence of Titterington\u2019s recursive estimator for mixture models","volume":"76","author":"Wang","year":"2006","journal-title":"Statist. Probab. Lett."},{"key":"2023032921204793100_","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1214\/aos\/1176346060","article-title":"On the convergence properties of the EM algorithm","volume":"11","author":"Wu","year":"1983","journal-title":"Ann. Statist."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2009.00698.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/3\/593\/49686526\/jrsssb_71_3_593.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/3\/593\/49686526\/jrsssb_71_3_593.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T15:47:13Z","timestamp":1738943233000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/71\/3\/593\/7092936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2,20]]},"references-count":28,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2009,2,20]]},"published-print":{"date-parts":[[2009,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2009.00698.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2009,6]]},"published":{"date-parts":[[2009,2,20]]}}}