{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T10:03:54Z","timestamp":1779357834340,"version":"3.51.4"},"reference-count":12,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2004,10,1]],"date-time":"2004-10-01T00:00:00Z","timestamp":1096588800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2004,10]]},"abstract":"<jats:p>This article is concerned with the calculation of confidence intervals for simulation output that is dependent on two sources of variability. One, referred to as &lt;i&gt;simulation variability&lt;\/i&gt;, arises from the use of random numbers in the simulation itself; and the other, referred to as &lt;i&gt;parameter variability&lt;\/i&gt;, arises when the input parameters are unknown and have to be estimated from observed data. Three approaches to the calculation of confidence intervals are presented--the traditional asymptotic normality theory approach, a bootstrap approach and a new method which produces a conservative approximation based on performing just two simulation runs at carefully selected parameter settings. It is demonstrated that the traditional and bootstrap approaches provide similar degrees of accuracy and that whilst the new method may sometimes be very conservative, it can be calculated in a small fraction of the computational time of the exact methods.<\/jats:p>","DOI":"10.1145\/1029174.1029176","type":"journal-article","created":{"date-parts":[[2005,1,26]],"date-time":"2005-01-26T16:35:53Z","timestamp":1106757353000},"page":"344-362","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Calculation of confidence intervals for simulation output"],"prefix":"10.1145","volume":"14","author":[{"given":"R. C. H.","family":"Cheng","sequence":"first","affiliation":[{"name":"University of Southampton, Southampton, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"W.","family":"Holland","sequence":"additional","affiliation":[{"name":"Cass Business School, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2004,10]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Mathematical Analysis","author":"Apostol T. M.","unstructured":"Apostol , T. M. 1974. Mathematical Analysis . Addison-Wesley , Reading, Mass . Apostol, T. M. 1974. Mathematical Analysis. Addison-Wesley, Reading, Mass."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/226275.226277"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/00949659708811809","article-title":"Sensitivity of computer simulation experiments to errors in input data","volume":"57","author":"Cheng R. C. H.","year":"1997","unstructured":"Cheng , R. C. H. and Holland , W. 1997 . Sensitivity of computer simulation experiments to errors in input data . J. Statist. Comput. Simul. 57 , 219 -- 241 . Cheng, R. C. H. and Holland, W. 1997. Sensitivity of computer simulation experiments to errors in input data. J. Statist. Comput. Simul. 57, 219--241.","journal-title":"J. Statist. Comput. Simul."},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1080\/00949659808811887","article-title":"Two-point methods for assessing variability in simulation output","volume":"60","author":"Cheng R. C. H.","year":"1998","unstructured":"Cheng , R. C. H. and Holland , W. 1998 . Two-point methods for assessing variability in simulation output . J. Statist. Comput. Simul. 60 , 183 -- 205 . Cheng, R. C. H. and Holland, W. 1998. Two-point methods for assessing variability in simulation output. J. Statist. Comput. Simul. 60, 183--205.","journal-title":"J. Statist. Comput. Simul."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Cox D. R. and Hinkley D. V. 1974. Theoretical Statistics. Chapman and Hall London England.  Cox D. R. and Hinkley D. V. 1974. Theoretical Statistics. Chapman and Hall London England.","DOI":"10.1007\/978-1-4899-2887-0"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Davison A. C. and Hinkley D. V. 1997. Bootstrap Methods and Their Application. Cambridge University Press Cambridge England.  Davison A. C. and Hinkley D. V. 1997. Bootstrap Methods and Their Application. Cambridge University Press Cambridge England.","DOI":"10.1017\/CBO9780511802843"},{"key":"e_1_2_1_7_1","volume-title":"CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM.","author":"Efron B.","year":"1982","unstructured":"Efron , B. 1982 . The Jacknife, the Bootstrap and Other Resampling Plans . CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM. Efron, B. 1982. The Jacknife, the Bootstrap and Other Resampling Plans. CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Efron B. and Tibshirani R. J. 1993. An Introduction to the Bootstrap. Chapman & Hall New York.  Efron B. and Tibshirani R. J. 1993. An Introduction to the Bootstrap. Chapman & Hall New York.","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"e_1_2_1_9_1","volume-title":"Queueing Systems","author":"Kleinrock L.","unstructured":"Kleinrock , L. 1976. Queueing Systems : Volume 2 . Computer Applications. Wiley , New York. Kleinrock, L. 1976. Queueing Systems : Volume 2. Computer Applications. Wiley, New York."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1287\/opre.42.4.643","article-title":"On the convergence rates of IPA and FDC derivative estimators","volume":"42","author":"L'Ecuyer P.","year":"1994","unstructured":"L'Ecuyer , P. and Perron , G. 1994 . On the convergence rates of IPA and FDC derivative estimators . Oper. Res. 42 , 463 -- 656 . L'Ecuyer, P. and Perron, G. 1994. On the convergence rates of IPA and FDC derivative estimators. Oper. Res. 42, 463--656.","journal-title":"Oper. Res."},{"key":"e_1_2_1_11_1","volume-title":"Introduction to Multiple Time Series Analysis","author":"L\u00fctkepohl H.","unstructured":"L\u00fctkepohl , H. 1993. Introduction to Multiple Time Series Analysis . Springer-Verlag , Berlin, Germany . L\u00fctkepohl, H. 1993. Introduction to Multiple Time Series Analysis. Springer-Verlag, Berlin, Germany."},{"key":"e_1_2_1_12_1","volume-title":"Linear Statistical Inference and Its Applications","author":"Rao C. R.","unstructured":"Rao , C. R. 1973. Linear Statistical Inference and Its Applications . Wiley , New York . Rao, C. R. 1973. Linear Statistical Inference and Its Applications. Wiley, New York."}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1029174.1029176","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1029174.1029176","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:31:07Z","timestamp":1750264267000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1029174.1029176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,10]]},"references-count":12,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2004,10]]}},"alternative-id":["10.1145\/1029174.1029176"],"URL":"https:\/\/doi.org\/10.1145\/1029174.1029176","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,10]]},"assertion":[{"value":"2004-10-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}