{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T10:43:54Z","timestamp":1766486634368},"reference-count":23,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2006,10]]},"abstract":"<jats:p>We develop a new approach to the validation of simulation models by exploiting elements from fuzzy set theory and machine learning. A fuzzy resemblance relation concept is used to set up a mathematical framework for measuring the degree of similarity between the input-output behavior of a simulation model and the corresponding behavior of the real system. A neuro-fuzzy inference algorithm is employed to automatically learn the required resemblance relation from real and simulated data. Ultimately, defuzzification strategies are applied to obtain a coefficient on the unit interval that characterizes the degree of model validity. An example in the airline industry illustrates the practical application of this methodology.<\/jats:p>","DOI":"10.1145\/1176249.1176253","type":"journal-article","created":{"date-parts":[[2007,1,16]],"date-time":"2007-01-16T19:38:29Z","timestamp":1168976309000},"page":"375-398","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["A fuzzy set theoretic approach to validate simulation models"],"prefix":"10.1145","volume":"16","author":[{"given":"Jurgen","family":"Martens","sequence":"first","affiliation":[{"name":"Catholic University of Leuven, Leuven, Belgium"}]},{"given":"Ferdi","family":"Put","sequence":"additional","affiliation":[{"name":"Catholic University of Leuven, Leuven, Belgium"}]},{"given":"Etienne","family":"Kerre","sequence":"additional","affiliation":[{"name":"Ghent University, Ghent, Belgium"}]}],"member":"320","published-online":{"date-parts":[[2006,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Adem J. and Martens J. 2001. Analyzing and improving network punctuality at a Belgian airline company using simulation. DTEW Research Report 0140 K.U. Leuven.  Adem J. and Martens J. 2001. Analyzing and improving network punctuality at a Belgian airline company using simulation. DTEW Research Report 0140 K.U. Leuven."},{"key":"e_1_2_1_2_1","volume-title":"Handbook of Simulation","author":"Balci O.","unstructured":"Balci , O. 1998. Verification , validation and testing . In Handbook of Simulation , J. Banks, Ed. Wiley, New York , 335--393. Balci, O. 1998. Verification, validation and testing. In Handbook of Simulation, J. Banks, Ed. Wiley, New York, 335--393."},{"key":"e_1_2_1_3_1","first-page":"3","article-title":"Validation of simulation models via simultaneous confidence intervals","volume":"4","author":"Balci O.","year":"1984","unstructured":"Balci , O. and Sargent , R. 1984 . Validation of simulation models via simultaneous confidence intervals . Amer. J. Math. Manage. Sci. 4 , 3 - 4 , 375--406. Balci, O. and Sargent, R. 1984. Validation of simulation models via simultaneous confidence intervals. Amer. J. Math. Manage. Sci. 4, 3-4, 375--406.","journal-title":"Amer. J. Math. Manage. Sci."},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/sdr.4260060203","article-title":"Philosophical roots of model validation: Two paradigms","volume":"6","author":"Barlas Y.","year":"1990","unstructured":"Barlas , Y. and Carpenter , S. 1990 . Philosophical roots of model validation: Two paradigms . Syst. Dynam. Rev. 6 , 2, 148 -- 166 . Barlas, Y. and Carpenter, S. 1990. Philosophical roots of model validation: Two paradigms. Syst. Dynam. Rev. 6, 2, 148--166.","journal-title":"Syst. Dynam. Rev."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0114(02)00239-7"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/0377-2217(93)90311-A","article-title":"Revisiting the issue of model validation in or: an epistemological view","volume":"66","author":"D\u00e9ry R.","year":"1993","unstructured":"D\u00e9ry , R. , Landry , M. , and Banville , C. 1993 . Revisiting the issue of model validation in or: an epistemological view . Europ. J. Oper. Res. 66 , 2, 168 -- 183 . D\u00e9ry, R., Landry, M., and Banville, C. 1993. Revisiting the issue of model validation in or: an epistemological view. Europ. J. Oper. Res. 66, 2, 168--183.","journal-title":"Europ. J. Oper. Res."},{"key":"e_1_2_1_7_1","unstructured":"Dubois D. and Prade H. 1980. Fuzzy Sets and Systems: Theory and Applications. Academic Press New York.   Dubois D. and Prade H. 1980. Fuzzy Sets and Systems: Theory and Applications. Academic Press New York."},{"key":"e_1_2_1_8_1","first-page":"525","article-title":"The analysis of simulation-generated time series. Manage","volume":"13","author":"Fishman G.","year":"1967","unstructured":"Fishman , G. and Kiviat , P. 1967 . The analysis of simulation-generated time series. Manage . Sci. 13 , 7, 525 -- 557 . Fishman, G. and Kiviat, P. 1967. The analysis of simulation-generated time series. Manage. Sci. 13, 7, 525--557.","journal-title":"Sci."},{"key":"e_1_2_1_9_1","volume-title":"Neural Fuzzy Systems","author":"Full\u00e9r R.","unstructured":"Full\u00e9r , R. 1995. Neural Fuzzy Systems . Institute for Advanced Management Systems Research , \u00c5bo. Full\u00e9r, R. 1995. Neural Fuzzy Systems. Institute for Advanced Management Systems Research, \u00c5bo."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0114(91)90171-L"},{"key":"e_1_2_1_11_1","first-page":"181","article-title":"Analysis of simulation-generated responses using autoregressive models. Manage","volume":"24","author":"Hsu D.","year":"1977","unstructured":"Hsu , D. and Hunter , J. 1977 . Analysis of simulation-generated responses using autoregressive models. Manage . Sci. 24 , 2, 181 -- 190 . Hsu, D. and Hunter, J. 1977. Analysis of simulation-generated responses using autoregressive models. Manage. Sci. 24, 2, 181--190.","journal-title":"Sci."},{"key":"e_1_2_1_12_1","unstructured":"Kerre E. 1993. Introduction to the Basic Principles of Fuzzy Set Theory and Some of Its Applications. Communication and Cognition Ghent.  Kerre E. 1993. Introduction to the Basic Principles of Fuzzy Set Theory and Some of Its Applications. Communication and Cognition Ghent."},{"key":"e_1_2_1_13_1","first-page":"14","article-title":"A methodology for the fitting and validation of metamodels in simulation","volume":"120","author":"Kleijnen J.","year":"2000","unstructured":"Kleijnen , J. and Sargent , R. 2000 . A methodology for the fitting and validation of metamodels in simulation . Europ. J. Oper. Res. 120 , 1, 14 -- 29 . Kleijnen, J. and Sargent, R. 2000. A methodology for the fitting and validation of metamodels in simulation. Europ. J. Oper. Res. 120, 1, 14--29.","journal-title":"Europ. J. Oper. Res."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.44.8.1087"},{"key":"e_1_2_1_15_1","unstructured":"Law A. and Kelton W. 2000. Simulation Modeling and Analysis. McGraw-Hill New York.   Law A. and Kelton W. 2000. Simulation Modeling and Analysis. McGraw-Hill New York."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1002\/1098-111X(200008)15:8<785::AID-INT6>3.0.CO;2-L","article-title":"Improving a neuro-fuzzy classifier using exploratory factor analysis","volume":"15","author":"Martens J.","year":"2000","unstructured":"Martens , J. , Wets , G. , Vanthienen , J. , and Mues , C. 2000 . Improving a neuro-fuzzy classifier using exploratory factor analysis . Int. J. Intell. Syst. 15 , 8, 785 -- 800 . Martens, J., Wets, G., Vanthienen, J., and Mues, C. 2000. Improving a neuro-fuzzy classifier using exploratory factor analysis. Int. J. Intell. Syst. 15, 8, 785--800.","journal-title":"Int. J. Intell. Syst."},{"key":"e_1_2_1_18_1","unstructured":"Nauck D. Klawonn F. and Kruse R. 1997. Neuro-Fuzzy Systems. Wiley Chichester.   Nauck D. Klawonn F. and Kruse R. 1997. Neuro-Fuzzy Systems. Wiley Chichester."},{"key":"e_1_2_1_19_1","first-page":"92","article-title":"Verification of computer simulation models. Manage","volume":"14","author":"Naylor T.","year":"1967","unstructured":"Naylor , T. and Finger , J. 1967 . Verification of computer simulation models. Manage . Sci. 14 , 2, 92 -- 101 . Naylor, T. and Finger, J. 1967. Verification of computer simulation models. Manage. Sci. 14, 2, 92--101.","journal-title":"Sci."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 1994 Winter Simulation Conference. IEEE Press","author":"Sargent R.","year":"1994","unstructured":"Sargent , R. 1994 . Verification and validation of simulation models . In Proceedings of the 1994 Winter Simulation Conference. IEEE Press , Piscataway, NJ, 77--87. Sargent, R. 1994. Verification and validation of simulation models. In Proceedings of the 1994 Winter Simulation Conference. IEEE Press, Piscataway, NJ, 77--87."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh L.","year":"1965","unstructured":"Zadeh , L. 1965 . Fuzzy sets . Inf. Control 8 , 3, 338 -- 353 . Zadeh, L. 1965. Fuzzy sets. Inf. Control 8, 3, 338--353.","journal-title":"Inf. Control"},{"key":"e_1_2_1_22_1","volume-title":"A theory of approximate reasoning","author":"Zadeh L.","unstructured":"Zadeh , L. 1979. A theory of approximate reasoning . In Machine Intelligence, J. Hayes, D. Michie, and L. Mikulich, Eds. Elsevier, Amsterdam , 149--194. Zadeh, L. 1979. A theory of approximate reasoning. In Machine Intelligence, J. Hayes, D. Michie, and L. Mikulich, Eds. Elsevier, Amsterdam, 149--194."},{"key":"e_1_2_1_23_1","volume-title":"Theory of Modeling and Simulation","author":"Zeigler B.","unstructured":"Zeigler , B. 1976. Theory of Modeling and Simulation . Wiley , New York . Zeigler, B. 1976. Theory of Modeling and Simulation. Wiley, New York."},{"key":"e_1_2_1_24_1","volume-title":"Fuzzy Set Theory and its Applications","author":"Zimmermann J.","unstructured":"Zimmermann , J. 1991. Fuzzy Set Theory and its Applications . Kluwer Academic Publishers , Boston, MA . Zimmermann, J. 1991. Fuzzy Set Theory and its Applications. Kluwer Academic Publishers, Boston, MA."}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1176249.1176253","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T20:10:14Z","timestamp":1672258214000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1176249.1176253"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,10]]},"references-count":23,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2006,10]]}},"alternative-id":["10.1145\/1176249.1176253"],"URL":"https:\/\/doi.org\/10.1145\/1176249.1176253","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,10]]},"assertion":[{"value":"2006-10-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}