{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T19:29:50Z","timestamp":1769282990649,"version":"3.49.0"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"1-2","license":[{"start":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T00:00:00Z","timestamp":1677542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"German Research Foundation","doi-asserted-by":"crossref","award":["320435134 (P.W.), 258560741 (P.W.) and SFB 1270\/1\u2013299150580 (F.H.)"],"award-info":[{"award-number":["320435134 (P.W.), 258560741 (P.W.) and SFB 1270\/1\u2013299150580 (F.H.)"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]},{"name":"European Research Council","award":["CoG-2016-725232 (J.H.)"],"award-info":[{"award-number":["CoG-2016-725232 (J.H.)"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Model. Comput. Simul."],"published-print":{"date-parts":[[2023,4,30]]},"abstract":"<jats:p>Simulation experiments are typically conducted repeatedly during the model development process, for example, to revalidate if a behavioral property still holds after several model changes. Approaches for automatically reusing and generating simulation experiments can support modelers in conducting simulation studies in a more systematic and effective manner. They rely on explicit experiment specifications and, so far, on user interaction for initiating the reuse. Thereby, they are constrained to support the reuse of simulation experiments in a specific setting. Our approach now goes one step further by automatically identifying and adapting the experiments to be reused for a variety of scenarios. To achieve this, we exploit provenance graphs of simulation studies, which provide valuable information about the previous modeling and experimenting activities, and contain meta-information about the different entities that were used or produced during the simulation study. We define provenance patterns and associate them with a semantics, which allows us to interpret the different activities and construct transformation rules for provenance graphs. Our approach is implemented in a Reuse and Adapt framework for Simulation Experiments (RASE), which can interface with various modeling and simulation tools. In the case studies, we demonstrate the utility of our framework for (1) the repeated sensitivity analysis of an agent-based model of migration routes and (2) the cross-validation of two models of a cell signaling pathway.<\/jats:p>","DOI":"10.1145\/3564928","type":"journal-article","created":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T11:26:26Z","timestamp":1664277986000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Automatic Reuse, Adaption, and Execution of Simulation Experiments via Provenance Patterns"],"prefix":"10.1145","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7447-6667","authenticated-orcid":false,"given":"Pia","family":"Wilsdorf","sequence":"first","affiliation":[{"name":"University of Rostock, Rostock, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6908-1257","authenticated-orcid":false,"given":"Anja","family":"Wolpers","sequence":"additional","affiliation":[{"name":"University of Rostock, Rostock, Rostock, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9473-757X","authenticated-orcid":false,"given":"Jason","family":"Hilton","sequence":"additional","affiliation":[{"name":"University of Southampton, Southampton, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3713-8313","authenticated-orcid":false,"given":"Fiete","family":"Haack","sequence":"additional","affiliation":[{"name":"University of Rostock, Rostock, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5256-4682","authenticated-orcid":false,"given":"Adelinde","family":"Uhrmacher","sequence":"additional","affiliation":[{"name":"University of Rostock, Rostock, Germany"}]}],"member":"320","published-online":{"date-parts":[[2023,2,28]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3158668"},{"key":"e_1_3_2_3_2","volume-title":"Provenance Capture and Use: A Practical Guide","author":"Allen M. David","year":"2010","unstructured":"M. David Allen, Len Seligman, Barbara Blaustein, and Adriane Chapman. 2010. Provenance Capture and Use: A Practical Guide. Technical Report. Mitre Corp., McLean, VA."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01299065"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.envsoft.2020.104932"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1177\/0037549712438469"},{"key":"e_1_3_2_7_2","article-title":"PROV-DM: The PROV data model","author":"Belhajjame Khalid","year":"2013","unstructured":"Khalid Belhajjame, Reza B\u2019Far, James Cheney, Sam Coppens, Stephen Cresswell, Yolanda Gil, Paul Groth, Graham Klyne, Timothy Lebo, Jim McCusker, et\u00a0al. 2013. PROV-DM: The PROV data model. W3C Recommendation (2013). https:\/\/www.w3.org\/TR\/2013\/REC-prov-dm-20130430\/.","journal-title":"W3C Recommendation"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-014-0369-z"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1137\/141000671"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btn051"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1009227"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2012.05.012"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gky1049"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bpj.2015.12.012"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/msb.2011.77"},{"key":"e_1_3_2_16_2","article-title":"Reliability and reproducibility in computational science: Implementing validation, verification and uncertainty quantification in silico","volume":"379","author":"Coveney Peter V.","year":"2021","unstructured":"Peter V. Coveney, Derek Groen, and Alfons G. Hoekstra. 2021. Reliability and reproducibility in computational science: Implementing validation, verification and uncertainty quantification in silico. Philosophical Transactions of the Royal Society A 379 (2021), 20200409.","journal-title":"Philosophical Transactions of the Royal Society A"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/17477778.2017.1418638"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2567895"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3391299"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3129130"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190657"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3179993"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2014.01.018"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.4259"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004106"},{"issue":"4","key":"e_1_3_2_26_2","article-title":"Model-to-model analysis","volume":"6","author":"Hales David","year":"2003","unstructured":"David Hales, Juliette Rouchier, and Bruce Edmonds. 2003. Model-to-model analysis. Journal of Artificial Societies and Social Simulation 6, 4 (2003), 1\u20135.","journal-title":"Journal of Artificial Societies and Social Simulation"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998499"},{"key":"e_1_3_2_28_2","volume-title":"2019 International Workshop on Agent-based Modelling of Human Behaviour (ABMHuB\u201919), Artificial Life Conference, ALife","author":"Hinsch Martin","year":"2019","unstructured":"Martin Hinsch and Jakub Bijak. 2019. Rumours lead to self-organized migration routes. In 2019 International Workshop on Agent-based Modelling of Human Behaviour (ABMHuB\u201919), Artificial Life Conference, ALife. http:\/\/abmhub.cs.ucl.ac.uk\/2019\/papers\/Hinsch_Bijak.pdf."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-83039-7_8"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13194-021-00362-9"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btl485"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg015"},{"issue":"2","key":"e_1_3_2_33_2","first-page":"6","article-title":"Towards a community framework for agent-based modelling","volume":"11","author":"Janssen Marco A.","year":"2008","unstructured":"Marco A. Janssen, Lilian Na\u2019ia Alessa, Michael Barton, Sean Bergin, and Allen Lee. 2008. Towards a community framework for agent-based modelling. Journal of Artificial Societies and Social Simulation 11, 2 (2008), 6.","journal-title":"Journal of Artificial Societies and Social Simulation"},{"key":"e_1_3_2_34_2","unstructured":"JSON. 2017. ECMA-404 The JSON Data Interchange Standard 2nd Edition. Retrieved August 5 2021 from https:\/\/www.json.org\/."},{"key":"e_1_3_2_35_2","unstructured":"JSON Schema. 2018. JSON Schema Draft-07 Release Notes. Retrieved August 5 2021 from https:\/\/json-schema.org\/draft-07\/json-schema-release-notes.html."},{"key":"e_1_3_2_36_2","first-page":"87","volume-title":"Positioning and Power in Academic Publishing: Players, Agents and Agendas","author":"Kluyver Thomas","year":"2016","unstructured":"Thomas Kluyver, Benjamin Ragan-Kelley, Fernando P\u00e9rez, Brian Granger, Matthias Bussonnier, Jonathan Frederic, Kyle Kelley, Jessica Hamrick, Jason Grout, Sylvain Corlay, Paul Ivanov, Dami\u00e1n Avila, Safia Abdalla, Carol Willing, and Jupyter Development Team. 2016. Jupyter notebooks - A publishing format for reproducible computational workflows. In Positioning and Power in Academic Publishing: Players, Agents and Agendas. IOS Press, 87\u201390. https:\/\/eprints.soton.ac.uk\/403913\/."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2019.2943847"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0000010"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33469-6_85"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-658-27588-4_5"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1007\/978-3-540-30206-3_12","volume-title":"Formal Techniques, Modelling and Analysis of Timed and Fault-Tolerant Systems","author":"Maler Oded","year":"2004","unstructured":"Oded Maler and Dejan Nickovic. 2004. Monitoring temporal properties of continuous signals. In Formal Techniques, Modelling and Analysis of Timed and Fault-Tolerant Systems, Yassine Lakhnech and Sergio Yovine (Eds.). Springer, Berlin, 152\u2013166."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkz1055"},{"key":"e_1_3_2_43_2","volume-title":"Proceedings of the Southern Association for Information Systems Conference,","volume":"2324","author":"Miller Justin J.","year":"2013","unstructured":"Justin J. Miller. 2013. Graph database applications and concepts with Neo4j. In Proceedings of the Southern Association for Information Systems Conference, Vol. 2324."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/WORKS.2010.5671861"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1080\/17477778.2018.1442155"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.2200\/S00528ED1V01Y201308WBE007"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/978-3-319-16462-5_6","volume-title":"Provenance and Annotation of Data and Processes","author":"Murta Leonardo","year":"2015","unstructured":"Leonardo Murta, Vanessa Braganholo, Fernando Chirigati, David Koop, and Juliana Freire. 2015. noWorkflow: Capturing and analyzing provenance of scripts. In Provenance and Annotation of Data and Processes. Springer International Publishing, Cham, 71\u201383."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2015.7381799"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1038\/cr.2008.47"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591129"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/35.978060"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1177\/0037549717704314"},{"key":"e_1_3_2_53_2","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2019","unstructured":"R Core Team. 2019. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2008.64"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70766-2_25"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-83039-7_7"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2015.7408386"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2017.8247839"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2899840"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3316480.3325514"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/WSC48552.2020.9384057"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1057\/jos.2012.20"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btv484"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1515\/jib-2020-0022"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.4126\/FRL01-006423288"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1177\/0037549710386843"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2015.7408371"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gky1055"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.15252\/msb.20209982"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2017.51"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2005.11.031"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1001122"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1186\/1752-0509-5-198"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12167977"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2016.7822160"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.430"}],"container-title":["ACM Transactions on Modeling and Computer Simulation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564928","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3564928","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:23Z","timestamp":1750182683000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564928"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,28]]},"references-count":76,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2023,4,30]]}},"alternative-id":["10.1145\/3564928"],"URL":"https:\/\/doi.org\/10.1145\/3564928","relation":{},"ISSN":["1049-3301","1558-1195"],"issn-type":[{"value":"1049-3301","type":"print"},{"value":"1558-1195","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,28]]},"assertion":[{"value":"2021-08-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-05","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}