{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T05:16:28Z","timestamp":1672290988805},"reference-count":22,"publisher":"Association for Computing Machinery (ACM)","issue":"2","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2005,4]]},"abstract":"<jats:p>Simulating continuous-time Markov reward processes containing rarely visited, but economically important states requires long simulation times unless special measures are taken. In this article, we consider Markov reward processes in equilibrium, and we use the equilibrium equations to reallocate rewards. The effect of this reallocation is determined analytically for a number of small examples. In these examples, significant savings in run lengths were possible, especially in the case where the expected rewards are strongly influenced by low-probability boundary states. The emphasis of the article is on exploration; no large simulation problems have been considered.<\/jats:p>","DOI":"10.1145\/1060576.1060578","type":"journal-article","created":{"date-parts":[[2005,8,3]],"date-time":"2005-08-03T08:30:55Z","timestamp":1123057855000},"page":"138-154","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Simulating markov-reward processes with rare events"],"prefix":"10.1145","volume":"15","author":[{"given":"Winfried K.","family":"Grassmann","sequence":"first","affiliation":[{"name":"University of Saskatchewan, Saskatoon, SK, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingxiang","family":"Luo","sequence":"additional","affiliation":[{"name":"University of Saskatchewan, Saskatoon, SK, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2005,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-5316(98)00010-8"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.47.4.585"},{"key":"e_1_2_1_3_1","volume-title":"Eds. Annals of Operations Research","volume":"8","author":"Grassmann W. K.","year":"1987"},{"key":"e_1_2_1_4_1","volume-title":"Eds. The IMA Volumes in Mathematics and Its Applications","volume":"48","author":"Grassmann W. K.","year":"1993"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6377(01)00084-0"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"557","DOI":"10.2307\/3214541","article-title":"Equilibrium distribution of block-structured Markov chains with repeating rows","volume":"27","author":"Grassmann W. K.","year":"1990","journal-title":"J. Appl. Prob."},{"key":"e_1_2_1_7_1","volume-title":"Ed. International Series in Operations Research and Management Science","volume":"24","author":"Grassmann W. K."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1287\/opre.33.5.1107","article-title":"Regenerative analysis and steady state distributions for Markov chains","volume":"33","author":"Grassmann W. K.","year":"1993","journal-title":"Oper. Res."},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Greenbaum A. 1997. Iterative methods for solving linear systems. Frontiers in applied mathematics. SIAM Philadelphia PA.   Greenbaum A. 1997. Iterative methods for solving linear systems. Frontiers in applied mathematics. SIAM Philadelphia PA.","DOI":"10.1137\/1.9781611970937"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-5316(99)00067-X"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/203091.203094"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","first-page":"772","DOI":"10.2307\/1425933","article-title":"Discrete methods for simulating continuous time Markov chains","volume":"13","author":"Hordiijk A.","year":"1976","journal-title":"Adv. Appl. Prob."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","first-page":"396","DOI":"10.2307\/3212807","article-title":"The relative efficiency of direct and maximum likelihood estimates of the mean waiting time in the simple queue, M\/M\/1","volume":"9","author":"Jenkins J. H.","year":"1972","journal-title":"J. Appl. Prob."},{"key":"e_1_2_1_14_1","volume-title":"Winter Simulation Conference, S. D. Roberts, J. Banks, and B. Schmeiser, Eds. Society for Computer Simulation, IEEE, La Jolla, Ca 92038","author":"Kioussis L. C."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1287\/opre.24.3.572","article-title":"Optimal conditions for a simulation problem","volume":"24","author":"Madansky A.","year":"1976","journal-title":"Oper. Res."},{"key":"e_1_2_1_16_1","unstructured":"Neuts M. F. 1981. Matrix-Geometric Solutions in Stochastic Models An Algorithmic Approach. Johns Hopkins University Press Baltimore.  Neuts M. F. 1981. Matrix-Geometric Solutions in Stochastic Models An Algorithmic Approach. Johns Hopkins University Press Baltimore."},{"key":"e_1_2_1_17_1","unstructured":"Neuts M. F. 1989. Structured Stochastic Matrices of M\/G\/1 Type and Their Applications. Marcel Dekker New York.  Neuts M. F. 1989. Structured Stochastic Matrices of M\/G\/1 Type and Their Applications. Marcel Dekker New York."},{"key":"e_1_2_1_18_1","unstructured":"Parzen E. 1962. Stochastic Processes. Holden Day San Francisco.   Parzen E. 1962. Stochastic Processes. Holden Day San Francisco."},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","first-page":"214","DOI":"10.2307\/3212652","article-title":"Some theorems on the covariance structure of markov chains","volume":"9","author":"Reynolds J. F.","year":"1972","journal-title":"J. Appl. Prob."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Stewart W. 1994. An Introduction to the Numerical Solution of Markov Chains. Princeton University Press New Jersey.  Stewart W. 1994. An Introduction to the Numerical Solution of Markov Chains. Princeton University Press New Jersey.","DOI":"10.1515\/9780691223384"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/S0377-2217(98)00266-5","article-title":"Variance of the output as a function of time: Production line dynamics","volume":"117","author":"Tan B.","year":"1999","journal-title":"EJOR"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 29th Simulation Symposium, T. F. Znati and P. A. Wilsey, Eds. IEEE","author":"van Moorsel A. P. A."}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1060576.1060578","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T14:29:48Z","timestamp":1672237788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1060576.1060578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,4]]},"references-count":22,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2005,4]]}},"alternative-id":["10.1145\/1060576.1060578"],"URL":"https:\/\/doi.org\/10.1145\/1060576.1060578","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,4]]},"assertion":[{"value":"2005-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}