{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T08:57:14Z","timestamp":1770281834459,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":72,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,11,7]],"date-time":"2020-11-07T00:00:00Z","timestamp":1604707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,11,8]]},"DOI":"10.1145\/3368089.3409685","type":"proceedings-article","created":{"date-parts":[[2020,12,11]],"date-time":"2020-12-11T00:43:06Z","timestamp":1607647386000},"page":"1002-1014","source":"Crossref","is-referenced-by-count":10,"title":["Testing self-adaptive software with probabilistic guarantees on performance metrics"],"prefix":"10.1145","author":[{"given":"Claudio","family":"Mandrioli","sequence":"first","affiliation":[{"name":"Lund University, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martina","family":"Maggio","sequence":"additional","affiliation":[{"name":"Saarland University, Germany \/ Lund University, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,11,7]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Yaser S. Abu-Mostafa Malik Magdon-Ismail and Hsuan-Tien Lin. 2012. Learning From Data. AMLBook.  Yaser S. Abu-Mostafa Malik Magdon-Ismail and Hsuan-Tien Lin. 2012. Learning From Data. AMLBook."},{"key":"e_1_3_2_2_2_1","unstructured":"D.L. Applegate R.E. Bixby V. Chv\u00e1tal and W.J. Cook. 2011. The Traveling Salesman Problem: A Computational Study. Princeton University Press. https: \/\/books.google.se\/books?id=zfIm94nNqPoC  D.L. Applegate R.E. Bixby V. Chv\u00e1tal and W.J. Cook. 2011. The Traveling Salesman Problem: A Computational Study. Princeton University Press. https: \/\/books.google.se\/books?id=zfIm94nNqPoC"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001420.2001452"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642986"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/VTS.2019.8758649"},{"key":"e_1_3_2_2_6_1","unstructured":"L. Baresi D. Bianculli C. Ghezzi S. Guinea and P. Spoletini. 2007. Validation of web service compositions. IET Software 1 6 ( December 2007 ) 219-232. https: \/\/doi.org\/10.1049\/iet-sen: 20070027 10.1049\/iet-sen:20070027  L. Baresi D. Bianculli C. Ghezzi S. Guinea and P. Spoletini. 2007. Validation of web service compositions. IET Software 1 6 ( December 2007 ) 219-232. https: \/\/doi.org\/10.1049\/iet-sen: 20070027 10.1049\/iet-sen:20070027"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30985-5_5"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39800-4_7"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-NIER.2019.00010"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2889212"},{"key":"e_1_3_2_2_11_1","unstructured":"Giuseppe Carlo Calafiore. 2013. Direct data-driven portfolio optimization with guaranteed shortfall probability. Automatica 49 2 ( 2013 ) 370-380. https: \/\/doi.org\/10.1016\/j.automatica. 2012. 11.012 10.1016\/j.automatica.2012.11.012  Giuseppe Carlo Calafiore. 2013. Direct data-driven portfolio optimization with guaranteed shortfall probability. Automatica 49 2 ( 2013 ) 370-380. https: \/\/doi.org\/10.1016\/j.automatica. 2012. 11.012 10.1016\/j.automatica.2012.11.012"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2006.875041"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2006.51"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2502"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.4230\/OASIcs.WCET.2013.64"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.02.022"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08915-7_4"},{"key":"e_1_3_2_2_18_1","unstructured":"Laurens de Haan and Ana Ferreira. 2010. Extreme Value Theory: An Introduction (Springer Series in Operations Research and Financial Engineering) (1st edition. ed.). Springer.  Laurens de Haan and Ana Ferreira. 2010. Extreme Value Theory: An Introduction (Springer Series in Operations Research and Financial Engineering) (1st edition. ed.). Springer."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194754.3194758"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236057"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Saikat Dutta Wenxian Zhang Zixin Huang and Sasa Misailovic. 2019. Storm: Program Reduction for Testing and Debugging Probabilistic Programming Systems. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Tallinn Estonia) (ESEC\/FSE 2019 ). Association for Computing Machinery New York NY USA 729-739. https:\/\/doi.org\/10.1145\/3338906.3338972 10.1145\/3338906.3338972  Saikat Dutta Wenxian Zhang Zixin Huang and Sasa Misailovic. 2019. Storm: Program Reduction for Testing and Debugging Probabilistic Programming Systems. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Tallinn Estonia) (ESEC\/FSE 2019 ). Association for Computing Machinery New York NY USA 729-739. https:\/\/doi.org\/10.1145\/3338906.3338972 10.1145\/3338906.3338972","DOI":"10.1145\/3338906.3338972"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568264"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194133.3194142"},{"key":"e_1_3_2_2_24_1","unstructured":"Paul Embrechts. 2000. Extreme Value Theory: Potential And Limitations As An Integrated Risk Management Tool. Derivatives Use Trading and Regulation 6 ( 02 2000 ).  Paul Embrechts. 2000. Extreme Value Theory: Potential And Limitations As An Integrated Risk Management Tool. Derivatives Use Trading and Regulation 6 ( 02 2000 )."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Paul Embrechts Thomas Mikosch and Claudia Kl\u00fcppelberg. 1997. Modelling Extremal Events: For Insurance and Finance. Springer-Verlag Berlin Heidelberg.  Paul Embrechts Thomas Mikosch and Claudia Kl\u00fcppelberg. 1997. Modelling Extremal Events: For Insurance and Finance. Springer-Verlag Berlin Heidelberg.","DOI":"10.1007\/978-3-642-33483-2"},{"key":"e_1_3_2_2_26_1","unstructured":"Fabiano Cutigi Ferrari Joost Noppen Ruzanna Chitchyan and Awais Rashid Lancaster. 2011. Investigating Testing Approaches for Dynamically Adaptive Systems Work in Progress.  Fabiano Cutigi Ferrari Joost Noppen Ruzanna Chitchyan and Awais Rashid Lancaster. 2011. Investigating Testing Approaches for Dynamically Adaptive Systems Work in Progress."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100064"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568272"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"crossref","unstructured":"R.A. Fisher. 1930. The Genetical Theory of Natural Selection. OUP Oxford.  R.A. Fisher. 1930. The Genetical Theory of Natural Selection. OUP Oxford.","DOI":"10.5962\/bhl.title.27468"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"crossref","unstructured":"B.A. Francis and P. Khargonekar. 1995. Robust control theory. Springer-Verlag. https:\/\/books.google.se\/books?id=81vvAAAAMAAJ  B.A. Francis and P. Khargonekar. 1995. Robust control theory. Springer-Verlag. https:\/\/books.google.se\/books?id=81vvAAAAMAAJ","DOI":"10.1007\/978-1-4613-8451-9"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-1098(89)90002-2"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239372.3239409"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3093742.3093923"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34691-0_4"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.06.030"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2007.07.011"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/SASOW.2015.27"},{"key":"e_1_3_2_2_38_1","unstructured":"Antonio Jim\u00e9nez-Mart\u00edn Alfonso Mateos and Sixto R\u00edos-Insua. 2005. Monte Carlo Simulation Techniques in a Decision Support System for Group Decision Making. Group Decision and Negotiation 14 (01 2005 ) 109-130. https:\/\/doi.org\/ 10.1007\/s10726-005-2406-9 10.1007\/s10726-005-2406-9  Antonio Jim\u00e9nez-Mart\u00edn Alfonso Mateos and Sixto R\u00edos-Insua. 2005. Monte Carlo Simulation Techniques in a Decision Support System for Group Decision Making. Group Decision and Negotiation 14 (01 2005 ) 109-130. https:\/\/doi.org\/ 10.1007\/s10726-005-2406-9 10.1007\/s10726-005-2406-9"},{"key":"e_1_3_2_2_39_1","unstructured":"O. Johnson. 2004. Information Theory and the Central Limit Theorem. Imperial College Press. https:\/\/books.google.se\/books?id=r5XI8a0lYykC  O. Johnson. 2004. Information Theory and the Central Limit Theorem. Imperial College Press. https:\/\/books.google.se\/books?id=r5XI8a0lYykC"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00071"},{"key":"e_1_3_2_2_41_1","unstructured":"Brian Korver. 1994. The Monte Carlo Method and Software Reliability Theory.  Brian Korver. 1994. The Monte Carlo Method and Software Reliability Theory."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106247"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2017.16"},{"key":"e_1_3_2_2_44_1","unstructured":"Claudio Mandrioli Martina Maggio. 2020. Artifact ESEC \/FSE 2020. https: \/\/doi.org\/10.5281\/ZENODO.3896795 10.5281\/ZENODO.3896795  Claudio Mandrioli Martina Maggio. 2020. Artifact ESEC \/FSE 2020. https: \/\/doi.org\/10.5281\/ZENODO.3896795 10.5281\/ZENODO.3896795"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSESS.2018.8663920"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786853"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2017.2"},{"key":"e_1_3_2_2_48_1","unstructured":"Freddy Munoz and Benoit Baudry. 2009. Artificial table testing dynamically adaptive systems. CoRR abs\/0903.0914 ( 2009 ). arXiv: 0903.0914 http:\/\/arxiv.org\/ abs\/0903.0914  Freddy Munoz and Benoit Baudry. 2009. Artificial table testing dynamically adaptive systems. CoRR abs\/0903.0914 ( 2009 ). arXiv: 0903.0914 http:\/\/arxiv.org\/ abs\/0903.0914"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.07.002"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2017.11.022"},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/SASO.2018.00019"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"crossref","unstructured":"Christian P. Robert and George Casella. 2005. Monte Carlo Statistical Methods (Springer Texts in Statistics). Springer-Verlag Berlin Heidelberg.  Christian P. Robert and George Casella. 2005. Monte Carlo Statistical Methods (Springer Texts in Statistics). Springer-Verlag Berlin Heidelberg.","DOI":"10.1007\/978-1-4757-4145-2"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-1576-4_5"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2008.17"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1516533.1516538"},{"key":"e_1_3_2_2_56_1","unstructured":"L. Santinelli J\u00e9r\u00f4me Morio Guillaume Dufour and Damien Jacquemart. 2014. On the Sustainability of the Extreme Value Theory for WCET Estimation. OpenAccess Series in Informatics 39. https:\/\/doi.org\/10.4230\/OASIcs.WCET. 2014.21 10.4230\/OASIcs.WCET.2014.21  L. Santinelli J\u00e9r\u00f4me Morio Guillaume Dufour and Damien Jacquemart. 2014. On the Sustainability of the Extreme Value Theory for WCET Estimation. OpenAccess Series in Informatics 39. https:\/\/doi.org\/10.4230\/OASIcs.WCET. 2014.21 10.4230\/OASIcs.WCET.2014.21"},{"key":"e_1_3_2_2_57_1","unstructured":"Ismayle de Sousa Santos. 2017. TESTDAS: Testing MEthod for Dynamically Adaptive Systems. Ph.D. Dissertation. Fortaleza Brazil. Advisor(s) Castro Andrade Rossana Mariade.  Ismayle de Sousa Santos. 2017. TESTDAS: Testing MEthod for Dynamically Adaptive Systems. Ph.D. Dissertation. Fortaleza Brazil. Advisor(s) Castro Andrade Rossana Mariade."},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950301"},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.5120\/11834-7554"},{"key":"e_1_3_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993288.2993294"},{"key":"e_1_3_2_2_61_1","unstructured":"Richard S. Sutton and Andrew G. Barto. 1998. Introduction to Reinforcement Learning (1st ed.). MIT Press Cambridge MA USA.  Richard S. Sutton and Andrew G. Barto. 1998. Introduction to Reinforcement Learning (1st ed.). MIT Press Cambridge MA USA."},{"key":"e_1_3_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3339836"},{"key":"e_1_3_2_2_63_1","first-page":"458","volume-title":"Proceedings-International Computer Software and Applications Conference","volume":"1","author":"Tse T. H."},{"key":"e_1_3_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2620000"},{"key":"e_1_3_2_2_65_1","doi-asserted-by":"crossref","unstructured":"Yilin Wang Sasi Inguva and Balu Adsumilli. 2019. YouTube UGC Dataset for Video Compression Research. arXiv: 1904. 06457 [cs.MM] https:\/\/media. withyoutube.com\/  Yilin Wang Sasi Inguva and Balu Adsumilli. 2019. YouTube UGC Dataset for Video Compression Research. arXiv: 1904. 06457 [cs.MM] https:\/\/media. withyoutube.com\/","DOI":"10.1109\/MMSP.2019.8901772"},{"key":"e_1_3_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2010.57"},{"key":"e_1_3_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338966.2336803"},{"key":"e_1_3_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2015.27"},{"key":"e_1_3_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771805"},{"key":"e_1_3_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/SERE.2014.27"},{"key":"e_1_3_2_2_71_1","volume-title":"The Fuzzing Book","author":"Zeller Andreas","year":"2019"},{"key":"e_1_3_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"}],"event":{"name":"ESEC\/FSE '20: 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","location":"Virtual Event USA","acronym":"ESEC\/FSE '20","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3368089.3409685","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3368089.3409685","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:39Z","timestamp":1750203879000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3368089.3409685"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,7]]},"references-count":72,"alternative-id":["10.1145\/3368089.3409685","10.1145\/3368089"],"URL":"https:\/\/doi.org\/10.1145\/3368089.3409685","relation":{},"subject":[],"published":{"date-parts":[[2020,11,7]]}}}