{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:16:48Z","timestamp":1750306608068,"version":"3.41.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2015,4,16]],"date-time":"2015-04-16T00:00:00Z","timestamp":1429142400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2015,5,7]]},"abstract":"<jats:p>\n            Predictions from simulations have entered the mainstream of public policy and decision-making practices. Unfortunately, methods for gaining insight into faulty simulations outputs have not kept pace. Ideally, an insight gathering method would automatically identify the cause of a faulty output and explain to the simulation developer how to correct it. In the field of software engineering, this challenge has been addressed for general-purpose software through statistical debuggers. We present two research contributions,\n            <jats:italic>elastic predicates<\/jats:italic>\n            and\n            <jats:italic>many-valued labeling functions<\/jats:italic>\n            , that enable debuggers designed for general-purpose software to become more effective for simulations employing random variates and continuous numbers. Elastic predicates address deficiencies of existing debuggers related to continuous numbers, whereas many-valued labeling functions support the use of random variates. When used in combinations, these contributions allow a simulation developer tasked with localizing the program statement causing the faulty simulation output to examine 40% fewer statements than the leading alternatives. Our evaluation shows that elastic predicates and many-valued labeling functions maintain their ability to reduce the number of program statements that need to be examined under the imperfect conditions that developers experience in practice.\n          <\/jats:p>","DOI":"10.1145\/2699722","type":"journal-article","created":{"date-parts":[[2015,4,17]],"date-time":"2015-04-17T22:12:01Z","timestamp":1429308721000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Statistical Debugging for Simulations"],"prefix":"10.1145","volume":"25","author":[{"given":"Ross","family":"Gore","sequence":"first","affiliation":[{"name":"Old Dominion University, Suffolk, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul F.","family":"Reynolds Jr.","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Kamensky","sequence":"additional","affiliation":[{"name":"University of Texas at Austin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saikou","family":"Diallo","sequence":"additional","affiliation":[{"name":"Old Dominion University, Suffolk, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jose","family":"Padilla","sequence":"additional","affiliation":[{"name":"Old Dominion University, Suffolk, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025136"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/643120.643122"},{"volume-title":"Systems and Software Verification: Model-Checking Techniques and Tools","author":"B\u00e9rard B\u00e9atrice","key":"e_1_2_1_3_1","unstructured":"B\u00e9atrice B\u00e9rard , Michel Bidoit , Alain Finkel , Fran\u00e7ois Laroussinie , Antoine Petit , Laure Petrucci , and Philippe Schnoebelen . 2010. Systems and Software Verification: Model-Checking Techniques and Tools . Springer . B\u00e9atrice B\u00e9rard, Michel Bidoit, Alain Finkel, Fran\u00e7ois Laroussinie, Antoine Petit, Laure Petrucci, and Philippe Schnoebelen. 2010. Systems and Software Verification: Model-Checking Techniques and Tools. Springer."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/229493.229511"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3905\/jod.1994.407891"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the IEEE International Conference on Automated Software Engineering (ASE). 3--12","author":"Brat Guillaume","year":"2000","unstructured":"Guillaume Brat , Klaus Havelund , SeungJoon Park , and Willem Visser . 2000 . Model checking programs . In Proceedings of the IEEE International Conference on Automated Software Engineering (ASE). 3--12 . Guillaume Brat, Klaus Havelund, SeungJoon Park, and Willem Visser. 2000. Model checking programs. In Proceedings of the IEEE International Conference on Automated Software Engineering (ASE). 3--12."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.39.883"},{"volume-title":"The Normal Distribution: Characterizations with Applications","author":"Bryc Wlodzimierz","key":"e_1_2_1_8_1","unstructured":"Wlodzimierz Bryc . 1995. The Normal Distribution: Characterizations with Applications . Springer-Verlag . http:\/\/books.google.com\/books&quest;id&equals;BQ7vAAAAMAAJ. Wlodzimierz Bryc. 1995. The Normal Distribution: Characterizations with Applications. Springer-Verlag. http:\/\/books.google.com\/books&quest;id&equals;BQ7vAAAAMAAJ."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070506"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1062455.1062522"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(72)90049-5"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3905\/jod.2007.686422"},{"volume-title":"A Discipline of Programming","author":"Dijkstra Edsger W.","key":"e_1_2_1_13_1","unstructured":"Edsger W. Dijkstra . 1976. A Discipline of Programming . Vol. 1 . Prentice Hall , Englewood Cliffs, NJ . Edsger W. Dijkstra. 1976. A Discipline of Programming. Vol. 1. Prentice Hall, Englewood Cliffs, NJ."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.908957"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0040-1625(02)00323-2"},{"key":"e_1_2_1_17_1","volume-title":"Harris","author":"Gross Donald","year":"2011","unstructured":"Donald Gross , John F. Shortle , James M. Thompson , and Carl M . Harris . 2011 . Fundamentals of Queueing Theory. John Wiley and Sons . http:\/\/books.google.com\/books&quest;id&equals;K3lQGeCtAJgC. Donald Gross, John F. Shortle, James M. Thompson, and Carl M. Harris. 2011. Fundamentals of Queueing Theory. John Wiley and Sons. http:\/\/books.google.com\/books&quest;id&equals;K3lQGeCtAJgC."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0036144500378302"},{"volume-title":"Introduction to Network Simulator NS2","author":"Issariyakul Teerawat","key":"e_1_2_1_19_1","unstructured":"Teerawat Issariyakul and Ekram Hossain . 2011. Introduction to Network Simulator NS2 . Springer . Teerawat Issariyakul and Ekram Hossain. 2011. Introduction to Network Simulator NS2. Springer."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390630.1390652"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101908.1101949"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 39th Conference on Winter Simulation: 40 years&excl; The Best Is Yet to Come (WSC\u201907)","author":"Kelton W. David","year":"2007","unstructured":"W. David Kelton . 2007 . Representing and generating uncertainty effectively . In Proceedings of the 39th Conference on Winter Simulation: 40 years&excl; The Best Is Yet to Come (WSC\u201907) . IEEE, Los Alamitos, CA, 38--42. http:\/\/dl.acm.org\/citation.cfm&quest;id&equals;1351542.1351552 W. David Kelton. 2007. Representing and generating uncertainty effectively. In Proceedings of the 39th Conference on Winter Simulation: 40 years&excl; The Best Is Yet to Come (WSC\u201907). IEEE, Los Alamitos, CA, 38--42. http:\/\/dl.acm.org\/citation.cfm&quest;id&equals;1351542.1351552"},{"key":"e_1_2_1_23_1","volume-title":"The Art of Computer Programming: Seminumerical Algorithms","author":"Knuth Donald E.","unstructured":"Donald E. Knuth . 1997. The Art of Computer Programming: Seminumerical Algorithms . Vol. 2 ( 3 rd ed.). Addison Wesley Longman , Boston, MA . Donald E. Knuth. 1997. The Art of Computer Programming: Seminumerical Algorithms. Vol. 2 (3rd ed.). Addison Wesley Longman, Boston, MA.","edition":"3"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1162708.1162724"},{"volume-title":"Simulation Modeling and Analysis","author":"Law Averill M.","key":"e_1_2_1_25_1","unstructured":"Averill M. Law and W. David Kelton . 1991. Simulation Modeling and Analysis . Vol. 2 . McGraw-Hill , New York, NY . Averill M. Law and W. David Kelton. 1991. Simulation Modeling and Analysis. Vol. 2. McGraw-Hill, New York, NY."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390630.1390632"},{"key":"e_1_2_1_27_1","first-page":"74","article-title":"Heston\u2019s stochastic volatility model: Implementation, calibration, and some extensions","volume":"4","author":"Mikhailov Sergei","year":"2003","unstructured":"Sergei Mikhailov and Ulrich N\u00f6gel . 2003 . Heston\u2019s stochastic volatility model: Implementation, calibration, and some extensions . Wilmott Magazine 4 , 74 -- 79 . Sergei Mikhailov and Ulrich N\u00f6gel. 2003. Heston\u2019s stochastic volatility model: Implementation, calibration, and some extensions. Wilmott Magazine 4, 74--79.","journal-title":"Wilmott Magazine"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/375360.375365"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/510378.510552"},{"key":"e_1_2_1_30_1","volume-title":"an implementation of the OLSR (Optimized Link State Routing) protocol for the ns-2 network simulator. Retrieved","author":"Ros Francisco J.","year":"2015","unstructured":"Francisco J. Ros . 2007. UM-OLSR , an implementation of the OLSR (Optimized Link State Routing) protocol for the ns-2 network simulator. Retrieved March 6, 2015 , from http:\/\/masimum.inf.um.es\/fjrm\/development\/um-olsr\/. Francisco J. Ros. 2007. UM-OLSR, an implementation of the OLSR (Optimized Link State Routing) protocol for the ns-2 network simulator. Retrieved March 6, 2015, from http:\/\/masimum.inf.um.es\/fjrm\/development\/um-olsr\/."},{"volume-title":"Sensitivity Analysis","author":"Saltelli Andrea","key":"e_1_2_1_31_1","unstructured":"Andrea Saltelli , Karen Chan , and E. Marian Scott . 2000. Sensitivity Analysis . Vol. 134 . Wiley, New York , NY. Andrea Saltelli, Karen Chan, and E. Marian Scott. 2000. Sensitivity Analysis. Vol. 134. Wiley, New York, NY."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1057\/jos.2012.20"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1006\/jtbi.2002.3078"}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699722","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2699722","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:59Z","timestamp":1750227419000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699722"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,16]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,5,7]]}},"alternative-id":["10.1145\/2699722"],"URL":"https:\/\/doi.org\/10.1145\/2699722","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"type":"print","value":"1049-3301"},{"type":"electronic","value":"1558-1195"}],"subject":[],"published":{"date-parts":[[2015,4,16]]},"assertion":[{"value":"2013-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}