{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T04:41:09Z","timestamp":1774672869659,"version":"3.50.1"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2010,1,1]],"date-time":"2010-01-01T00:00:00Z","timestamp":1262304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2010,1]]},"abstract":"<jats:p>In simulation of complex stochastic systems, such as Discrete-Event Systems (DES), statistical distributions are used to model the underlying randomness in the system. A sensitivity analysis of the simulation output with respect to parameters of the input distributions, such as the mean and the variance, is therefore of great value. The focus of this article is to provide a practical guide for robust sensitivity, respectively, gradient estimation that can be easily implemented along the simulation of a DES. We study the Measure-Valued Differentiation (MVD) approach to sensitivity estimation. Specifically, we will exploit the \u201cmodular\u201d structure of the MVD approach, by firstly providing measure-valued derivatives for input distributions that are of importance in practice, and subsequently, by showing that if an input distribution possesses a measure-valued derivative, then so does the overall Markov kernel modeling the system transitions. This simplifies the complexity of applying MVD drastically: one only has to study the measure-valued derivative of the input distribution, a measure-valued derivative of the associated Markov kernel is then given through a simple formula in canonical form. The derivative representations of the underlying simple distributions derived in this article can be stored in a computer library. Combined with the generic MVD estimator, this yields an automated gradient estimation procedure. The challenge in automating MVD so that it can be included into a simulation package is the verification of the integrability condition to guarantee that the estimators are unbiased. The key contribution of the article is that we establish a general condition for unbiasedness which is easily checked in applications. Gradient estimators obtained by MVD are typically phantom estimators and we discuss the numerical efficiency of phantom estimators with the example of waiting times in the G\/G\/1 queue.<\/jats:p>","DOI":"10.1145\/1667072.1667077","type":"journal-article","created":{"date-parts":[[2010,8,24]],"date-time":"2010-08-24T13:16:40Z","timestamp":1282655800000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Gradient estimation for discrete-event systems by measure-valued differentiation"],"prefix":"10.1145","volume":"20","author":[{"given":"Bernd","family":"Heidergott","sequence":"first","affiliation":[{"name":"Vrije Universiteit Amsterdam and Tinbergen Institute, HV Amsterdam, the Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felisa J.","family":"V\u00e1zquez--Abad","sequence":"additional","affiliation":[{"name":"The City University of New York, New York, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georg","family":"Pflug","sequence":"additional","affiliation":[{"name":"University Vienna, Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taoying","family":"Farenhorst-Yuan","sequence":"additional","affiliation":[{"name":"Vrije Universiteit Amsterdam, HV Amsterdam, the Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,2,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01163859"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01159209"},{"key":"e_1_2_2_3_1","unstructured":"Cao X. 2007. Stochastic Learning and Optimization : A Sensitivity-Based Approach. Springer Berlin.   Cao X. 2007. Stochastic Learning and Optimization : A Sensitivity-Based Approach. Springer Berlin."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/9.633827"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01158437"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/9.847099"},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Fu M. and Hu J. Q. 1997. Conditional Monte Carlo: Gradient Estimation and Optimization Applications. Kluwer Academic Publishers Boston MA.  Fu M. and Hu J. Q. 1997. Conditional Monte Carlo: Gradient Estimation and Optimization Applications. Kluwer Academic Publishers Boston MA.","DOI":"10.1007\/978-1-4615-6293-1_3"},{"key":"e_1_2_2_8_1","volume-title":"Handbook on Operations Research and Management Science: Simulation","author":"Fu M. C."},{"key":"e_1_2_2_9_1","unstructured":"Glasserman P. 1991. Gradient Estimation via Perturbation Analysis. Kluwer Academic Publishers Boston MA.  Glasserman P. 1991. Gradient Estimation via Perturbation Analysis. Kluwer Academic Publishers Boston MA."},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Glasserman P. and Yao D. 1994. Monotone Structure in Discrete-Event Systems. Wiley New York.   Glasserman P. and Yao D. 1994. Monotone Structure in Discrete-Event Systems. Wiley New York.","DOI":"10.2307\/2533035"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.38.6.884"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.40.3.505"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Haas P. J. 2002. Stochastic Petri Nets: Modelling Stability Simulation. Springer Berlin.  Haas P. J. 2002. Stochastic Petri Nets: Modelling Stability Simulation. Springer Berlin.","DOI":"10.1007\/b97265"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2002.800648"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1239\/aap\/1067436334"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2004.835588"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1050.0171"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1515\/JAA.2008.13"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1090.0422"},{"key":"e_1_2_2_20_1","first-page":"509","article-title":"Measure-Valued differentiation for random horizon problems","volume":"12","author":"Heidergott B.","year":"2006","journal-title":"Markov Process. Relat. Fields"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10957-007-9297-7"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2007.04.004"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Ho Y. C. and Cao X. 1991. Perturbation Analysis of Discrete Event Dynamic Systems. Kluwer Academic Publishers Boston MA.  Ho Y. C. and Cao X. 1991. Perturbation Analysis of Discrete Event Dynamic Systems. Kluwer Academic Publishers Boston MA.","DOI":"10.1007\/978-1-4615-4024-3"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/9.1221"},{"key":"e_1_2_2_25_1","unstructured":"Krishnamurthy V. and V\u00e1zquez-Abad F. 2008. Stochastic approximation for on-line optimization of constrained MDP's. (To appear).  Krishnamurthy V. and V\u00e1zquez-Abad F. 2008. Stochastic approximation for on-line optimization of constrained MDP's. (To appear)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Kushner H. and Yin G. 1997. Stochastic Approximation and Applications. Springer Verlag Berlin.  Kushner H. and Yin G. 1997. Stochastic Approximation and Applications. Springer Verlag Berlin.","DOI":"10.1007\/978-1-4899-2696-8"},{"key":"e_1_2_2_27_1","volume-title":"The Proceedings of Workshop on Discrete Event Systems. B. Lennartson, M. Fabian, K. Akesson, A. Guia, and R. Kumar Eds. 168--172","author":"Li Y."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1239\/jap\/1208358959"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.camwa.2006.12.032"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Pflug G. 1996. Optimization of Stochastic Models. Kluwer Academic Publishers Boston MA.  Pflug G. 1996. Optimization of Stochastic Models. Kluwer Academic Publishers Boston MA.","DOI":"10.1007\/978-1-4613-1449-3"},{"key":"e_1_2_2_31_1","unstructured":"Rubinstein R. and Shapiro A. 1993. Discrete Event Systems: Sensitivity Analysis and Optimization by the Score Function Method. Wiley Chichester UK.  Rubinstein R. and Shapiro A. 1993. Discrete Event Systems: Sensitivity Analysis and Optimization by the Score Function Method. Wiley Chichester UK."},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Spall J. 2003. Introduction to Stochastic Search and Optimization: Estimation Simulation and Control. Wiley.   Spall J. 2003. Introduction to Stochastic Search and Optimization: Estimation Simulation and Control. Wiley.","DOI":"10.1002\/0471722138"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-1098(99)00034-5"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6687(99)00022-0"},{"key":"e_1_2_2_35_1","unstructured":"V\u00e1zquez-Abad F. and Davis K. 1995. Efficient implementation of the phantom RPA method with an application to a priority queueing system. Tech. rep. Universite de Montreal.  V\u00e1zquez-Abad F. and Davis K. 1995. Efficient implementation of the phantom RPA method with an application to a priority queueing system. Tech. rep. Universite de Montreal."}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1667072.1667077","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1667072.1667077","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:41:30Z","timestamp":1750250490000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1667072.1667077"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,1]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,1]]}},"alternative-id":["10.1145\/1667072.1667077"],"URL":"https:\/\/doi.org\/10.1145\/1667072.1667077","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,1]]},"assertion":[{"value":"2007-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-02-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}