{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:33:20Z","timestamp":1787319200593,"version":"build-2736575974"},"reference-count":30,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Control Optim."],"published-print":{"date-parts":[[2010,1]]},"abstract":"This paper studies a class of non-Markovian and nonhomogeneous stochastic processes on a finite state space. Relying on a recent paper by Bena\u00efm, Hofbauer, and Sorin [SIAM J. Control Optim., 44 (2005), pp. 328\u2013348] it is shown that, under certain assumptions, the asymptotic behavior of occupation measures can be described in terms of a certain set-valued deterministic dynamical system. This provides a unified approach to simulated annealing type processes and permits the study of new models of vertex reinforced random walks and new models of learning in games such as Markovian fictitious play.<\/jats:p>","DOI":"10.1137\/080721091","type":"journal-article","created":{"date-parts":[[2010,8,24]],"date-time":"2010-08-24T18:11:23Z","timestamp":1282673483000},"page":"4707-4730","source":"Crossref","is-referenced-by-count":4,"title":["A Class of Self-Interacting Processes with Applications to Games and Reinforced Random Walks"],"prefix":"10.1137","volume":"48","author":[{"given":"Michel","family":"Bena\u00efm","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivier","family":"Raimond","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2010,8,24]]},"reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1214\/aop\/1024404292"},{"key":"R2","doi-asserted-by":"crossref","unstructured":"M. Bena\u00efm,\n Dynamics of stochastic approximation algorithms\n , in S\u00e9minaire de Probabilit\u00e9s XXXIII, Lecture Notes in Math. 1709, Springer, 1999, pp. 1\u201368.","DOI":"10.1007\/BFb0096509"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1007\/BF02218617"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1006\/game.1999.0717"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012904439301"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1060.0213"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1007\/s004400100161"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1016\/S0246-0203(03)00028-1"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1214\/009117905000000251"},{"key":"R10","doi-asserted-by":"crossref","unstructured":"A. Benveniste, M. M\u00e9tivier, and P. Priouret,\n Stochastic Approximation and Adaptive Algorithms\n , Springer, Berlin, 1990.","DOI":"10.1007\/978-3-642-75894-2_2"},{"key":"R11","unstructured":"G. Brown,\n Iterative solution of games by fictitious play\n , in Activity Analysis of Production and Allocation, T.C. Koopmans, ed., Wiley, 1951, pp. 374\u2013376."},{"key":"R12","unstructured":"M. Duflo,\n Algorithmes stochastiques\n , Math. Appl. (Berlin) 23, Springer, Berlin, 1966."},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1006\/game.1993.1021"},{"key":"R14","unstructured":"D. Fudenberg and D.K. Levine,\n The Theory of Learning in Games\n , MIT Press, Cambridge, MA, 1998."},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1287\/moor.13.2.311"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0262.00376"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.1007\/BF01224127"},{"key":"R18","doi-asserted-by":"crossref","unstructured":"H.J. Kushner and C.C. Clarck,\n Stochastic Approximation for Constrained and Unconstrained Systems\n , Springer, Berlin, 1978.","DOI":"10.1007\/978-1-4684-9352-8"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1977.1101561"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1007\/BF00699098"},{"key":"R21","doi-asserted-by":"crossref","unstructured":"L. Miclo,\n Recuit simul\u00e9 sans potentiel sur un ensemble fini\n , in S\u00e9minare de probabilit\u00e9s XXVI, Springer, Berlin, 1992, pp. 47\u201360.","DOI":"10.1007\/BFb0084309"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1006\/jeth.1996.0014"},{"key":"R23","unstructured":"R. Pemantle,\n Random Processes with Reinforcement\n , Ph. Dissertation, Massachusetts Institute of Technology, Cambridge, MA, 1988."},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1007\/BF01205239"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1214\/07-PS094"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1214\/aop\/1022677452"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1007\/s00440-008-0147-9"},{"key":"R28","doi-asserted-by":"crossref","unstructured":"L. Saloff-Coste,\n Lectures on finite Markov chains\n , in Lectures on Probability Theory and Statistics 1996, Lecture Notes in Math. 1665, Springer, Berlin, 1997, pp. 201\u2013413.","DOI":"10.1007\/BFb0092621"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1214\/009117907000000694"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1214\/aop\/1008956322"}],"container-title":["SIAM Journal on Control and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/080721091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T12:46:19Z","timestamp":1787316379000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/080721091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,1]]},"references-count":30,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2010,1]]}},"alternative-id":["10.1137\/080721091"],"URL":"https:\/\/doi.org\/10.1137\/080721091","relation":{},"ISSN":["0363-0129","1095-7138"],"issn-type":[{"value":"0363-0129","type":"print"},{"value":"1095-7138","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,1]]}}}