{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:27:28Z","timestamp":1787322448853,"version":"build-2736575974"},"reference-count":34,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Control Optim."],"published-print":{"date-parts":[[2015,1]]},"abstract":"<jats:p>This paper considers consensus problems with random networks. A key object of our analysis is a sequence of stochastic matrices which involve Markovian switches and decreasing step sizes. We establish ergodicity of the backward products of these stochastic matrices. The basic technique is to consider the second moment dynamics of an associated Markovian jump linear system and exploit its two-scale interaction property resulting from the decreasing step sizes. The mean square convergence rate of the backward products is also obtained. The ergodicity results are used to prove mean square consensus of stochastic approximation algorithms where agents collect noisy information. The approach is further applied to a token scheduled averaging model.<\/jats:p>","DOI":"10.1137\/140984348","type":"journal-article","created":{"date-parts":[[2015,11,12]],"date-time":"2015-11-12T12:18:46Z","timestamp":1447330726000},"page":"3339-3363","source":"Crossref","is-referenced-by-count":13,"title":["Stochastic Approximation Based Consensus Dynamics over Markovian Networks"],"prefix":"10.1137","volume":"53","author":[{"given":"Minyi","family":"Huang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji-Feng","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2015,11,12]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2010.2050940"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.2307\/3213262"},{"key":"atypb3","doi-asserted-by":"crossref","unstructured":"K. L. Chung,\n                      Markov Chains with Stationary Transition Probabilities\n                      , Springer-Verlag, Berlin, 1960.","DOI":"10.1007\/978-3-642-49686-8"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4149(86)90008-6"},{"key":"atypb5","doi-asserted-by":"crossref","unstructured":"O. L. V. Costa, M. D. Fragoso, and R. P. Marques,\n                      Discrete-Time Markov Jump Linear Systems\n                      , Springer-Verlag, London, 2005.","DOI":"10.1007\/b138575"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1016\/j.matpur.2007.12.002"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/0024-3795(90)90206-R"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2008.080506"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2012.2199149"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2010.06.016"},{"key":"atypb11","first-page":"306","author":"Huang M.","year":"2007","journal-title":"LA"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2009.2036291"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2008.2007111"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1137\/110848396"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2007.01.002"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1137\/080743652"},{"key":"atypb17","unstructured":"H. J. Kushner and G. G. Yin,\n                      Stochastic Approximation and Recursive Algorithms and Applications\n                      , 2nd ed., Springer-Verlag, New York, 2003."},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2009.04.017"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2010.2042982"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1137\/100816870"},{"key":"atypb21","first-page":"3535","author":"Matei I.","year":"2008","journal-title":"Mexico"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2012.2195797"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2010.2077282"},{"key":"atypb24","first-page":"1865","author":"Ren W.","year":"2005","journal-title":"OR"},{"key":"atypb25","unstructured":"E. Seneta,\n                      Non-negative Matrices and Markov Chains\n                      , 2nd ed., Springer, New York, 2006."},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2010.2076530"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2010.2091174"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1986.1104412"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9939-1963-0154756-3"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2006.08.010"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2012.2199175"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2013.2243816"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2011.02.028"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1137\/120871614"}],"container-title":["SIAM Journal on Control and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/140984348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:22:02Z","timestamp":1787318522000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/140984348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2015,1]]}},"alternative-id":["10.1137\/140984348"],"URL":"https:\/\/doi.org\/10.1137\/140984348","relation":{},"ISSN":["0363-0129","1095-7138"],"issn-type":[{"value":"0363-0129","type":"print"},{"value":"1095-7138","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,1]]}}}