{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,6]],"date-time":"2024-04-06T00:33:08Z","timestamp":1712363588963},"reference-count":12,"publisher":"World Scientific Pub Co Pte Lt","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. Game Theory Rev."],"published-print":{"date-parts":[[1999,3]]},"abstract":"<jats:p> We examine the use of stationary and Markov strategies in zero-sum stochastic games with finite state and action spaces. It is natural to evaluate a strategy for the maximising player, player\u20091, by the highest reward guaranteed to him against any strategy of the opponent. The highest rewards guaranteed by stationary strategies or by Markov strategies are called the stationary utility or the Markov utility, respectively. Since all stationary strategies are Markov strategies, the Markov utility is always larger or equal to the stationary utility. However, in all presently known subclasses of stochastic games, these utilities turn out to be equal. In this paper, we provide a colourful example in which the Markov utility is strictly larger than the stationary utility and we present several conditions under which the utilities are equal. We also show that each stochastic game has at least one initial state for which the two utilities are equal. Several examples clarify these issues. <\/jats:p>","DOI":"10.1142\/s0219198999000037","type":"journal-article","created":{"date-parts":[[2002,8,30]],"date-time":"2002-08-30T03:23:23Z","timestamp":1030677803000},"page":"9-31","source":"Crossref","is-referenced-by-count":2,"title":["MARKOV STRATEGIES ARE BETTER THAN STATIONARY STRATEGIES"],"prefix":"10.1142","volume":"01","author":[{"given":"J.","family":"FLESCH","sequence":"first","affiliation":[{"name":"Department of Mathematics, Maastricht University, P.O.\u2009Box\u2009616, NL-6200 MD Maastricht, The Netherlands"}]},{"given":"F.","family":"THUIJSMAN","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Maastricht University, P.O.\u2009Box\u2009616, NL-6200 MD Maastricht, The Netherlands"}]},{"given":"O. J.","family":"VRIEZE","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Maastricht University, P.O.\u2009Box\u2009616, NL-6200 MD Maastricht, The Netherlands"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"key":"p_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177698513"},{"key":"p_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01245459"},{"key":"p_4","doi-asserted-by":"publisher","DOI":"10.1007\/BF00935890"},{"key":"p_5","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012996311940"},{"key":"p_8","doi-asserted-by":"publisher","DOI":"10.1007\/BF01774298"},{"key":"p_9","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176342760"},{"key":"p_11","doi-asserted-by":"publisher","DOI":"10.1137\/1011093"},{"key":"p_12","doi-asserted-by":"publisher","DOI":"10.1007\/BF01769259"},{"key":"p_14","first-page":"262","author":"Parthasarathy T.","year":"1984","journal-title":"Springer Verlag"},{"key":"p_15","doi-asserted-by":"publisher","DOI":"10.1007\/BF00942191"},{"key":"p_17","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177693059"},{"key":"p_20","doi-asserted-by":"publisher","DOI":"10.1007\/BF01783412"}],"container-title":["International Game Theory Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219198999000037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T13:26:26Z","timestamp":1565184386000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219198999000037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1999,3]]},"references-count":12,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[1999,3]]}},"alternative-id":["10.1142\/S0219198999000037"],"URL":"https:\/\/doi.org\/10.1142\/s0219198999000037","relation":{},"ISSN":["0219-1989","1793-6675"],"issn-type":[{"value":"0219-1989","type":"print"},{"value":"1793-6675","type":"electronic"}],"subject":[],"published":{"date-parts":[[1999,3]]}}}