{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T22:50:43Z","timestamp":1776725443787,"version":"3.51.2"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,10,31]],"date-time":"2020-10-31T00:00:00Z","timestamp":1604102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2020,10,31]]},"abstract":"<jats:p>This article provides a comprehensive and in-depth overview of our work on knowledge discovery in simulations. Application-wise, we focus on manufacturing simulations. Specifically, we propose and discuss a methodology for designing, executing, and analyzing large-scale simulation experiments with a broad coverage of possible system behavior targeted at generating knowledge about the system. Based on the concept of data farming, we suggest a two-phase process which starts with a data generation phase, in which a smart experiment design is used to set up and efficiently execute a large number of simulation experiments. In the second phase, the knowledge discovery phase, data mining and visually aided analysis methods are applied on the gathered simulation input and output data. This article gives insights into this knowledge discovery phase by discussing different machine learning approaches and their suitability for different manufacturing simulation problems. With this, we provide guidelines on how to conduct knowledge discovery studies within the manufacturing simulation context. We also introduce different case studies, both academic and applied, and use them to validate our methodology.<\/jats:p>","DOI":"10.1145\/3391299","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T12:34:43Z","timestamp":1594125283000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Knowledge Discovery in Simulation Data"],"prefix":"10.1145","volume":"30","author":[{"given":"Niclas","family":"Feldkamp","sequence":"first","affiliation":[{"name":"Information Technology in Production and Logistics, Technische Universit\u00e4t Ilmenau, Ilmenau, Germany"}]},{"given":"Soeren","family":"Bergmann","sequence":"additional","affiliation":[{"name":"Information Technology in Production and Logistics, Technische Universit\u00e4t Ilmenau, Ilmenau, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0702-9127","authenticated-orcid":false,"given":"Steffen","family":"Strassburger","sequence":"additional","affiliation":[{"name":"Information Technology in Production and Logistics, Technische Universit\u00e4t Ilmenau, Ilmenau, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,11,25]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 44th Hawaii International Conference on System Sciences. IEEE, Washington DC, 1\u201310","author":"Arias-Hernandez R.","year":"2011"},{"key":"e_1_2_1_2_1","first-page":"2859973","article-title":"Commercial visual analytics systems - Advances in the big data analytics field","volume":"2018","author":"Behrisch Michael","year":"2018","journal-title":"IEEE Transactions on Visualization and Computer Graphics. DOI:https:\/\/doi.org\/10.1109\/TVCG."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656280"},{"key":"e_1_2_1_4_1","volume-title":"Pattern recognition and machine learning (8th). Information Science and Statistics","author":"Bishop Christopher M."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1198\/004017006000000453"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the DSIA Workshop at IEEE VIS.","author":"Demiralp \u00c7a\u011fatay","year":"2017"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.23919\/MIPRO.2018.8400040"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70535"},{"key":"e_1_2_1_9_1","first-page":"37","article-title":"From data mining to knowledge discovery in databases","volume":"17","author":"Fayyad Usama M.","year":"1996","journal-title":"AI Magazine"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2769458.2769468"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2888619.2888708"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064911.3064915"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3320516.3320694"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3242181.3242526"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2017.8248162"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2016.7822210"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MGRS.2015.2496160"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 2010 IEEE Globecom Workshops \/\/ 2010 IEEE Globecom Workshops (GC'10). Workshops","author":"Giabbanelli Philippe J.","year":"2010"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 2001 Winter Simulation Conference. IEEE, Piscataway, N.J., 780--788","author":"Hill R. R.","year":"2001"},{"key":"e_1_2_1_20_1","volume-title":"Data farming in support of NATO","author":"Horne Gary"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 2005 Winter Simulation Conference. IEEE, Piscataway, N.J., 1082--1087","author":"Gary"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 2012 Winter Simulation Conference (WSC 2012","author":"Kallfass D.","year":"2012"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981847"},{"key":"e_1_2_1_24_1","volume-title":"Visual Data Mining: Theory, Techniques and Tools for Visual Analytics, Simeon Simoff, Michael H","author":"Keim Daniel A."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.1050.0136"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2017.6"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2003.1261409"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 2012 Winter Simulation Conference. WSC \u201912","author":"Luboschik Martin"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of SIGRAD","author":"Luboschik Martin","year":"2012"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2888619.2888677"},{"key":"e_1_2_1_31_1","volume-title":"Social Media. In Proceedings of the 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE, 1464--1468","author":"Minanovic Ana","year":"2014"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1287\/inte.2017.0900"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/1548512913477258"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2014.7019942"},{"key":"e_1_2_1_35_1","volume-title":"Design and Analysis of Experiments: Special Designs and Applications","author":"Sanchez Susan M."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 2009 Winter Simulation Conference (WSC 2009","author":"Susan","year":"2009"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 9th Operations Research and Analysis Conference.","author":"Schubert Johan","year":"2015"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2016.10.056"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICEMI.2009.5274185"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.06.006"},{"key":"e_1_2_1_41_1","volume-title":"Urs Eppelt, Christian B\u00fcscher, Tobias Meisen, and Sabina Jeschke.","author":"Tercan Hasan","year":"2016"},{"key":"e_1_2_1_42_1","volume-title":"Cook","author":"Thomas J. J.","year":"2005"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICICICT.2014.6781260"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 2003 Winter Simulation Conference. IEEE., Piscataway, N.J.","author":"Wenzel Sigrid","year":"2003"},{"key":"e_1_2_1_45_1","volume-title":"Beyond Sparsity: Tree Regularization of Deep Models for Interpretability. AAAI.","author":"Wu Mike","year":"2018"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3064019"}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3391299","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3391299","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:37Z","timestamp":1750199917000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3391299"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,31]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,10,31]]}},"alternative-id":["10.1145\/3391299"],"URL":"https:\/\/doi.org\/10.1145\/3391299","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,31]]},"assertion":[{"value":"2018-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}