{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T09:03:54Z","timestamp":1774602234191,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":71,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Agence Nationale de la Recherche","award":["ANR-17-CE25-0010-01"],"award-info":[{"award-number":["ANR-17-CE25-0010-01"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3358960.3379137","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T07:48:26Z","timestamp":1588578506000},"page":"277-288","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":43,"title":["Sampling Effect on Performance Prediction of Configurable Systems"],"prefix":"10.1145","author":[{"given":"Juliana","family":"Alves Pereira","sequence":"first","affiliation":[{"name":"Univ Rennes Inria, CNRS, IRISA, Rennes, France"}]},{"given":"Mathieu","family":"Acher","sequence":"additional","affiliation":[{"name":"Univ Rennes Inria, CNRS, IRISA, Rennes, France"}]},{"given":"Hugo","family":"Martin","sequence":"additional","affiliation":[{"name":"Univ Rennes Inria, CNRS, IRISA, Rennes, France"}]},{"given":"Jean-Marc","family":"J\u00e9z\u00e9quel","sequence":"additional","affiliation":[{"name":"Univ Rennes Inria, CNRS, IRISA, Rennes, France"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Arnaud Blouin, Jean-Marc J\u00e9z\u00e9quel, Djamel Eddine Khelladi, Luc Lesoil, and Olivier Barais.","author":"Acher Mathieu","year":"2019","unstructured":"Mathieu Acher , Hugo Martin , Juliana Alves Pereira , Arnaud Blouin, Jean-Marc J\u00e9z\u00e9quel, Djamel Eddine Khelladi, Luc Lesoil, and Olivier Barais. 2019 . Learning Very Large Configuration Spaces: What Matters for Linux Kernel Sizes. Research Report. Inria Rennes - Bretagne Atlantique . https:\/\/hal.inria.fr\/hal-02314830 Mathieu Acher, Hugo Martin, Juliana Alves Pereira, Arnaud Blouin, Jean-Marc J\u00e9z\u00e9quel, Djamel Eddine Khelladi, Luc Lesoil, and Olivier Barais. 2019. Learning Very Large Configuration Spaces: What Matters for Linux Kernel Sizes. Research Report. Inria Rennes - Bretagne Atlantique. https:\/\/hal.inria.fr\/hal-02314830"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3168365.3168372"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302333.3302338"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.85"},{"key":"e_1_3_2_1_6_1","volume-title":"AutoConfig: Automatic Configuration Tuning for Distributed Message Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 29--40","author":"Bao Liang","year":"2018","unstructured":"Liang Bao , Xin Liu , Ziheng Xu , and Baoyin Fang . 2018 . AutoConfig: Automatic Configuration Tuning for Distributed Message Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 29--40 . Liang Bao, Xin Liu, Ziheng Xu, and Baoyin Fang. 2018. AutoConfig: Automatic Configuration Tuning for Distributed Message Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 29--40."},{"key":"e_1_3_2_1_7_1","volume-title":"Random forests. Machine learning 45, 1","author":"Breiman Leo","year":"2001","unstructured":"Leo Breiman . 2001. Random forests. Machine learning 45, 1 ( 2001 ), 5--32. Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5--32."},{"key":"e_1_3_2_1_8_1","volume-title":"On Parallel Scalable Uniform SAT Witness Generation. In Tools and Algorithms for the Construction and Analysis of Systems TACAS'15 2015, London, UK, April 11--18, 2015. Proceedings. 304--319","author":"Chakraborty Supratik","unstructured":"Supratik Chakraborty , Daniel J. Fremont , Kuldeep S. Meel , Sanjit A. Seshia , and Moshe Y. Vardi . 2015 . On Parallel Scalable Uniform SAT Witness Generation. In Tools and Algorithms for the Construction and Analysis of Systems TACAS'15 2015, London, UK, April 11--18, 2015. Proceedings. 304--319 . Supratik Chakraborty, Daniel J. Fremont, Kuldeep S. Meel, Sanjit A. Seshia, and Moshe Y. Vardi. 2015. On Parallel Scalable Uniform SAT Witness Generation. In Tools and Algorithms for the Construction and Analysis of Systems TACAS'15 2015, London, UK, April 11--18, 2015. Proceedings. 304--319."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39799-8_40"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2003.05.005"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.50"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792734.1792766"},{"key":"e_1_3_2_1_13_1","unstructured":"Aaron Fisher Cynthia Rudin and Francesca Dominici. 2018. All Models are Wrong but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously. arXiv:arXiv:1801.01489  Aaron Fisher Cynthia Rudin and Francesca Dominici. 2018. All Models are Wrong but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously. arXiv:arXiv:1801.01489"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.4057"},{"key":"e_1_3_2_1_15_1","volume-title":"Automated Software Engineering (ASE)","author":"Guo Jianmei","unstructured":"Jianmei Guo , Krzysztof Czarnecki , Sven Apel , Norbert Siegmund , and Andrzej Wasowski . 2013. Variability-Aware Performance Prediction: A Statistical Learning Approach . In Automated Software Engineering (ASE) . IEEE , 301--311. Jianmei Guo, Krzysztof Czarnecki, Sven Apel, Norbert Siegmund, and Andrzej Wasowski. 2013. Variability-Aware Performance Prediction: A Statistical Learning Approach. In Automated Software Engineering (ASE). IEEE, 301--311."},{"key":"e_1_3_2_1_16_1","volume-title":"Kai Shi, Dingyu Yang, Jingsong Zhang, Krzysztof Czarnecki, Vijay Ganesh, and Huiqun Yu.","author":"Guo Jianmei","year":"2017","unstructured":"Jianmei Guo , Jia Hui Liang , Kai Shi, Dingyu Yang, Jingsong Zhang, Krzysztof Czarnecki, Vijay Ganesh, and Huiqun Yu. 2017 . SMTIBEA : A Hybrid MultiObjective Optimization Algorithm for Configuring Large Constrained Software Product Lines. In Software & Systems Modeling . Jianmei Guo, Jia Hui Liang, Kai Shi, Dingyu Yang, Jingsong Zhang, Krzysztof Czarnecki, Vijay Ganesh, and Huiqun Yu. 2017. SMTIBEA: A Hybrid MultiObjective Optimization Algorithm for Configuring Large Constrained Software Product Lines. In Software & Systems Modeling."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Axel Halin Alexandre Nuttinck Mathieu Acher Xavier Devroey Gilles Perrouin and Benoit Baudry. 2018. Test them All Is It Worth It? Assessing Configuration Sampling on the JHipster Web Development Stack. Empirical Software Engineering.  Axel Halin Alexandre Nuttinck Mathieu Acher Xavier Devroey Gilles Perrouin and Benoit Baudry. 2018. Test them All Is It Worth It? Assessing Configuration Sampling on the JHipster Web Development Stack. Empirical Software Engineering.","DOI":"10.1007\/s10664-018-9635-4"},{"key":"e_1_3_2_1_18_1","volume-title":"Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines","author":"Henard Christopher","year":"2014","unstructured":"Christopher Henard , Mike Papadakis , Gilles Perrouin , Jacques Klein , Patrick Heymans , and Yves Le Traon . 2014. Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines . IEEE Trans. Software Eng . ( 2014 ). Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, Patrick Heymans, and Yves Le Traon. 2014. Bypassing the Combinatorial Explosion: Using Similarity to Generate and Prioritize T-Wise Test Configurations for Software Product Lines. IEEE Trans. Software Eng. (2014)."},{"key":"e_1_3_2_1_19_1","volume-title":"Supporting the Statistical Analysis of Variability Models. In 41st International Conference on Software Engineering, ICSE. 843--853","author":"Heradio Ruben","year":"2019","unstructured":"Ruben Heradio , David Fern\u00e1ndez-Amor\u00f3s , Christoph Mayr-Dorn , and Alexander Egyed . 2019 . Supporting the Statistical Analysis of Variability Models. In 41st International Conference on Software Engineering, ICSE. 843--853 . Ruben Heradio, David Fern\u00e1ndez-Amor\u00f3s, Christoph Mayr-Dorn, and Alexander Egyed. 2019. Supporting the Statistical Analysis of Variability Models. In 41st International Conference on Software Engineering, ICSE. 843--853."},{"key":"e_1_3_2_1_20_1","volume-title":"Machine Learning Meets Quantitative Planning: Enabling SelfAdaptation in Autonomous Robots. arXiv preprint arXiv:1903.03920","author":"Jamshidi Pooyan","year":"2019","unstructured":"Pooyan Jamshidi , Javier C\u00e1mara , Bradley Schmerl , Christian K\u00e4stner , and David Garlan . 2019. Machine Learning Meets Quantitative Planning: Enabling SelfAdaptation in Autonomous Robots. arXiv preprint arXiv:1903.03920 ( 2019 ). Pooyan Jamshidi, Javier C\u00e1mara, Bradley Schmerl, Christian K\u00e4stner, and David Garlan. 2019. Machine Learning Meets Quantitative Planning: Enabling SelfAdaptation in Autonomous Robots. arXiv preprint arXiv:1903.03920 (2019)."},{"key":"e_1_3_2_1_21_1","volume-title":"Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis. In In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 497--508","author":"Jamshidi Pooyan","year":"2017","unstructured":"Pooyan Jamshidi , Norbert Siegmund , Miguel Velez , Akshay Patel , and Yuvraj Agarwal . 2017 . Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis. In In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 497--508 . Pooyan Jamshidi, Norbert Siegmund, Miguel Velez, Akshay Patel, and Yuvraj Agarwal. 2017. Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis. In In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 497--508."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236074"},{"key":"e_1_3_2_1_23_1","volume-title":"Transfer Learning for Improving Model Predictions in Highly Configurable Software. In International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 31--41","author":"Jamshidi Pooyan","year":"2017","unstructured":"Pooyan Jamshidi , Miguel Velez , Christian K\u00e4stner , Norbert Siegmund , and Prasad Kawthekar . 2017 . Transfer Learning for Improving Model Predictions in Highly Configurable Software. In International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 31--41 . Pooyan Jamshidi, Miguel Velez, Christian K\u00e4stner, Norbert Siegmund, and Prasad Kawthekar. 2017. Transfer Learning for Improving Model Predictions in Highly Configurable Software. In International Symposium on Software Engineering for Adaptive and Self-Managing Systems. ACM, 31--41."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2362536.2362547"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00112"},{"key":"e_1_3_2_1_26_1","volume-title":"On the Relation of External and Internal Feature Interactions: A Case Study. arXiv preprint arXiv:1712.07440","author":"Kolesnikov Sergiy","year":"2017","unstructured":"Sergiy Kolesnikov , Norbert Siegmund , Christian K\u00e4stner , and Sven Apel . 2017. On the Relation of External and Internal Feature Interactions: A Case Study. arXiv preprint arXiv:1712.07440 ( 2017 ). Sergiy Kolesnikov, Norbert Siegmund, Christian K\u00e4stner, and Sven Apel. 2017. On the Relation of External and Internal Feature Interactions: A Case Study. arXiv preprint arXiv:1712.07440 (2017)."},{"key":"e_1_3_2_1_27_1","volume-title":"Tradeoffs in Modeling Performance of Highly Configurable Software Systems. Software & Systems Modeling 18, 3 (01","author":"Kolesnikov Sergiy","year":"2019","unstructured":"Sergiy Kolesnikov , Norbert Siegmund , Christian K\u00e4stner , Alexander Grebhahn , and Sven Apel . 2019. Tradeoffs in Modeling Performance of Highly Configurable Software Systems. Software & Systems Modeling 18, 3 (01 Jun 2019 ), 2265--2283. https:\/\/doi.org\/10.1007\/s10270-018-0662--9 10.1007\/s10270-018-0662--9 Sergiy Kolesnikov, Norbert Siegmund, Christian K\u00e4stner, Alexander Grebhahn, and Sven Apel. 2019. Tradeoffs in Modeling Performance of Highly Configurable Software Systems. Software & Systems Modeling 18, 3 (01 Jun 2019), 2265--2283. https:\/\/doi.org\/10.1007\/s10270-018-0662--9"},{"key":"e_1_3_2_1_28_1","volume-title":"Mining Constraints for Event-Based Monitoring in Systems of Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 826--831","author":"Krismayer Thomas","year":"2017","unstructured":"Thomas Krismayer , Rick Rabiser , and Paul Gr\u00fcnbacher . 2017 . Mining Constraints for Event-Based Monitoring in Systems of Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 826--831 . Thomas Krismayer, Rick Rabiser, and Paul Gr\u00fcnbacher. 2017. Mining Constraints for Event-Based Monitoring in Systems of Systems. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Press, 826--831."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483441"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.24"},{"key":"e_1_3_2_1_31_1","volume-title":"Release 2.2, System Description. Journal on Satisfiability, Boolean Modeling and Computation 7","author":"Berre Daniel Le","year":"2010","unstructured":"Daniel Le Berre and Anne Parrain . 2010. The SAT4J library , Release 2.2, System Description. Journal on Satisfiability, Boolean Modeling and Computation 7 ( 2010 ), 59--64. https:\/\/hal.archives-ouvertes.fr\/hal-00868136 Daniel Le Berre and Anne Parrain. 2010. The SAT4J library, Release 2.2, System Description. Journal on Satisfiability, Boolean Modeling and Computation 7 (2010), 59--64. https:\/\/hal.archives-ouvertes.fr\/hal-00868136"},{"key":"e_1_3_2_1_32_1","volume-title":"Robust Tests for Equality of Variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling","author":"Levene Howard","year":"1961","unstructured":"Howard Levene . 1961. Robust Tests for Equality of Variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling ( 1961 ), 279--292. Howard Levene. 1961. Robust Tests for Equality of Variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling (1961), 279--292."},{"key":"e_1_3_2_1_33_1","volume-title":"Improved Prediction of Non-Functional Properties in Software Product Lines with Domain Context. Software Engineering 2013","author":"Lillack Max","year":"2013","unstructured":"Max Lillack , Johannes M\u00fcller , and Ulrich W Eisenecker . 2013. Improved Prediction of Non-Functional Properties in Software Product Lines with Domain Context. Software Engineering 2013 ( 2013 ). Max Lillack, Johannes M\u00fcller, and Ulrich W Eisenecker. 2013. Improved Prediction of Non-Functional Properties in Software Product Lines with Domain Context. Software Engineering 2013 (2013)."},{"key":"e_1_3_2_1_34_1","volume-title":"On a Test of Whether One of Two Random Variables is Stochastically Larger than the Other. The annals of mathematical statistics","author":"Mann Henry B","year":"1947","unstructured":"Henry B Mann and Donald R Whitney . 1947. On a Test of Whether One of Two Random Variables is Stochastically Larger than the Other. The annals of mathematical statistics ( 1947 ), 50--60. Henry B Mann and Donald R Whitney. 1947. On a Test of Whether One of Two Random Variables is Stochastically Larger than the Other. The annals of mathematical statistics (1947), 50--60."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884793"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Marcilio Mendonca Andrzej Wasowski Krzysztof Czarnecki and Donald Cowan. 2008. Efficient Compilation Techniques for Large Scale Feature Models. In Int'l Conference on Generative programming and component engineering. 13--22.  Marcilio Mendonca Andrzej Wasowski Krzysztof Czarnecki and Donald Cowan. 2008. Efficient Compilation Techniques for Large Scale Feature Models. In Int'l Conference on Generative programming and component engineering. 13--22.","DOI":"10.1145\/1449913.1449918"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Christoph Molnar. 2019. Interpretable Machine Learning. https:\/\/christophm.github.io\/interpretable-ml-book\/.  Christoph Molnar. 2019. Interpretable Machine Learning. https:\/\/christophm.github.io\/interpretable-ml-book\/.","DOI":"10.21105\/joss.00786"},{"key":"e_1_3_2_1_38_1","first-page":"1","article-title":"Uniform Random Sampling Product Configurations of Feature Models that Have Numerical Features","volume":"39","author":"Munoz Daniel-Jesus","year":"2019","unstructured":"Daniel-Jesus Munoz , Jeho Oh , M\u00f3nica Pinto , Lidia Fuentes , and Don S. Batory . 2019 . Uniform Random Sampling Product Configurations of Feature Models that Have Numerical Features . In International Systems and Software Product Line Conference (SPLC). 39 : 1 -- 39 :13. Daniel-Jesus Munoz, Jeho Oh, M\u00f3nica Pinto, Lidia Fuentes, and Don S. Batory. 2019. Uniform Random Sampling Product Configurations of Feature Models that Have Numerical Features. In International Systems and Software Product Line Conference (SPLC). 39:1--39:13.","journal-title":"International Systems and Software Product Line Conference (SPLC)."},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS). ACM","author":"Murwantara I Made","unstructured":"I Made Murwantara , Behzad Bordbar , and Leandro L. Minku . 2014. Measuring Energy Consumption for Web Service Product Configuration . In Proceedings of the 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS). ACM , New York, NY, USA, 224--228. I Made Murwantara, Behzad Bordbar, and Leandro L. Minku. 2014. Measuring Energy Consumption for Web Service Product Configuration. In Proceedings of the 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS). ACM, New York, NY, USA, 224--228."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106238"},{"key":"e_1_3_2_1_41_1","volume-title":"Faster Discovery of Faster System Configurations with Spectral Learning. Automated Software Engineering","author":"Nair Vivek","year":"2018","unstructured":"Vivek Nair , Tim Menzies , Norbert Siegmund , and Sven Apel . 2018. Faster Discovery of Faster System Configurations with Spectral Learning. Automated Software Engineering ( 2018 ), 1--31. Vivek Nair, Tim Menzies, Norbert Siegmund, and Sven Apel. 2018. Faster Discovery of Faster System Configurations with Spectral Learning. Automated Software Engineering (2018), 1--31."},{"key":"e_1_3_2_1_42_1","volume-title":"Finding Faster Configurations Using Flash","author":"Nair Vivek","year":"2018","unstructured":"Vivek Nair , Zhe Yu , Tim Menzies , Norbert Siegmund , and Sven Apel . 2018. Finding Faster Configurations Using Flash . IEEE Transact. on Software Engineering ( 2018 ). Vivek Nair, Zhe Yu, Tim Menzies, Norbert Siegmund, and Sven Apel. 2018. Finding Faster Configurations Using Flash. IEEE Transact. on Software Engineering (2018)."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106273"},{"key":"e_1_3_2_1_44_1","volume-title":"Proceedings of the 23rd International Systems and Software Product Line Conference, SPLC 2019","volume":"4","author":"Oh Jeho","unstructured":"Jeho Oh , Paul Gazzillo , and Don S. Batory . 2019. t-Wise Coverage by Uniform Sampling . In Proceedings of the 23rd International Systems and Software Product Line Conference, SPLC 2019 , Volume A, Paris, France. 15:1--15: 4 . Jeho Oh, Paul Gazzillo, and Don S. Batory. 2019. t-Wise Coverage by Uniform Sampling. In Proceedings of the 23rd International Systems and Software Product Line Conference, SPLC 2019, Volume A, Paris, France. 15:1--15:4."},{"key":"e_1_3_2_1_45_1","volume-title":"Beware Default Random Forest Importances. last access: july","author":"Parr Terence","year":"2019","unstructured":"Terence Parr , Kerem Turgutlu , Christopher Csiszar , and Jeremy Howard . 2018. Beware Default Random Forest Importances. last access: july 2019 . Terence Parr, Kerem Turgutlu, Christopher Csiszar, and Jeremy Howard. 2018. Beware Default Random Forest Importances. last access: july 2019."},{"key":"e_1_3_2_1_46_1","unstructured":"Juliana Alves Pereira Hugo Martin Mathieu Acher Jean-Marc J\u00e9z\u00e9quel Goetz Botterweck and Anthony Ventresque. 2019. Learning Software Configuration Spaces: A Systematic Literature Review. arXiv:arXiv:1906.03018  Juliana Alves Pereira Hugo Martin Mathieu Acher Jean-Marc J\u00e9z\u00e9quel Goetz Botterweck and Anthony Ventresque. 2019. Learning Software Configuration Spaces: A Systematic Literature Review. arXiv:arXiv:1906.03018"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2019.00032"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.70719"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3001867.3001874"},{"key":"e_1_3_2_1_50_1","volume-title":"Daleel: Simplifying Cloud Instance Selection Using Machine Learning. In NOMS 2016- 2016 IEEE\/IFIP Network Operations and Management Symposium. IEEE, 557--563","author":"Samreen Faiza","year":"2016","unstructured":"Faiza Samreen , Yehia Elkhatib , Matthew Rowe , and Gordon S Blair . 2016 . Daleel: Simplifying Cloud Instance Selection Using Machine Learning. In NOMS 2016- 2016 IEEE\/IFIP Network Operations and Management Symposium. IEEE, 557--563 . Faiza Samreen, Yehia Elkhatib, Matthew Rowe, and Gordon S Blair. 2016. Daleel: Simplifying Cloud Instance Selection Using Machine Learning. In NOMS 2016- 2016 IEEE\/IFIP Network Operations and Management Symposium. IEEE, 557--563."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.45"},{"key":"e_1_3_2_1_52_1","volume-title":"Performance-Influence Models for Highly Configurable Systems. In 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). 284--294","author":"Siegmund Norbert","year":"2015","unstructured":"Norbert Siegmund , Alexander Grebhahn , Sven Apel , and Christian Kastner . 2015 . Performance-Influence Models for Highly Configurable Systems. In 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). 284--294 . Norbert Siegmund, Alexander Grebhahn, Sven Apel, and Christian Kastner. 2015. Performance-Influence Models for Highly Configurable Systems. In 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). 284--294."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227196"},{"key":"e_1_3_2_1_54_1","volume-title":"Measuring Non-Functional Properties in Software Product Line for Product Derivation. In 2008 15th Asia-Pacific Software Engineering Conference. IEEE, 187--194","author":"Siegmund Norbert","year":"2008","unstructured":"Norbert Siegmund , Marko Rosenm\u00fcller , Martin Kuhlemann , Christian K\u00e4stner , and Gunter Saake . 2008 . Measuring Non-Functional Properties in Software Product Line for Product Derivation. In 2008 15th Asia-Pacific Software Engineering Conference. IEEE, 187--194 . Norbert Siegmund, Marko Rosenm\u00fcller, Martin Kuhlemann, Christian K\u00e4stner, and Gunter Saake. 2008. Measuring Non-Functional Properties in Software Product Line for Product Derivation. In 2008 15th Asia-Pacific Software Engineering Conference. IEEE, 187--194."},{"key":"e_1_3_2_1_55_1","volume-title":"8thEdn. Ames: Iowa State Univ","author":"Snedecor George W","year":"1989","unstructured":"George W Snedecor and Witiiam G Cochran . 1989. Statistical Methods , 8thEdn. Ames: Iowa State Univ . Press Iowa ( 1989 ). George W Snedecor and Witiiam G Cochran. 1989. Statistical Methods, 8thEdn. Ames: Iowa State Univ. Press Iowa (1989)."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.55"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241743"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.4121211"},{"key":"e_1_3_2_1_59_1","first-page":"1","article-title":"Towards quality assurance of software product lines with adversarial configurations. In 23rd International Systems and Software Product Line Conference","volume":"38","author":"Temple Paul","year":"2019","unstructured":"Paul Temple , Mathieu Acher , Gilles Perrouin , Battista Biggio , Jean-Marc J\u00e9z\u00e9quel , and Fabio Roli . 2019 . Towards quality assurance of software product lines with adversarial configurations. In 23rd International Systems and Software Product Line Conference , SPLC. ACM , 38 : 1 -- 38 :12. Paul Temple, Mathieu Acher, Gilles Perrouin, Battista Biggio, Jean-Marc J\u00e9z\u00e9quel, and Fabio Roli. 2019. Towards quality assurance of software product lines with adversarial configurations. In 23rd International Systems and Software Product Line Conference, SPLC. ACM, 38:1--38:12.","journal-title":"SPLC. ACM"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934466.2934472"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487629"},{"key":"e_1_3_2_1_62_1","volume-title":"A Classification and Survey of Analysis Strategies for Software Product Lines. Comput. Surveys","author":"Th\u00fcm Thomas","year":"2014","unstructured":"Thomas Th\u00fcm , Sven Apel , Christian K\u00e4stner , Ina Schaefer , and Gunter Saake . 2014. A Classification and Survey of Analysis Strategies for Software Product Lines. Comput. Surveys ( 2014 ). Thomas Th\u00fcm, Sven Apel, Christian K\u00e4stner, Ina Schaefer, and Gunter Saake. 2014. A Classification and Survey of Analysis Strategies for Software Product Lines. Comput. Surveys (2014)."},{"key":"e_1_3_2_1_63_1","volume-title":"Empirical Comparison of Regression Methods for Variability-Aware Performance Prediction. In SPLC'15","author":"Valov Pavel","year":"2015","unstructured":"Pavel Valov , Jianmei Guo , and Krzysztof Czarnecki . 2015 . Empirical Comparison of Regression Methods for Variability-Aware Performance Prediction. In SPLC'15 . Pavel Valov, Jianmei Guo, and Krzysztof Czarnecki. 2015. Empirical Comparison of Regression Methods for Variability-Aware Performance Prediction. In SPLC'15."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3030207.3030216"},{"key":"e_1_3_2_1_65_1","first-page":"101","article-title":"A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong","volume":"25","author":"Vargha Andr\u00e1s","year":"2000","unstructured":"Andr\u00e1s Vargha and Harold D Delaney . 2000 . A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong . Journal of Educational and Behavioral Statistics 25 , 2 (2000), 101 -- 132 . Andr\u00e1s Vargha and Harold D Delaney. 2000. A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101--132.","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3233027.3233035"},{"key":"e_1_3_2_1_67_1","volume-title":"Optimal Reconfiguration of Dynamic Software Product Lines Based on Performance-Influence Models. In International Systems and Software Product Line Conference (SPLC). ACM, 98--109","author":"Weckesser Markus","year":"2018","unstructured":"Markus Weckesser , Roland Kluge , Martin Pfannem\u00fcller , Michael Matth\u00e9 , Andy Sch\u00fcrr , and Christian Becker . 2018 . Optimal Reconfiguration of Dynamic Software Product Lines Based on Performance-Influence Models. In International Systems and Software Product Line Conference (SPLC). ACM, 98--109 . Markus Weckesser, Roland Kluge, Martin Pfannem\u00fcller, Michael Matth\u00e9, Andy Sch\u00fcrr, and Christian Becker. 2018. Optimal Reconfiguration of Dynamic Software Product Lines Based on Performance-Influence Models. In International Systems and Software Product Line Conference (SPLC). ACM, 98--109."},{"key":"e_1_3_2_1_68_1","volume-title":"Automated Inference of Goal-Oriented Performance Prediction Functions. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 190--199","author":"Westermann Dennis","year":"2012","unstructured":"Dennis Westermann , Jens Happe , Rouven Krebs , and Roozbeh Farahbod . 2012 . Automated Inference of Goal-Oriented Performance Prediction Functions. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 190--199 . Dennis Westermann, Jens Happe, Rouven Krebs, and Roozbeh Farahbod. 2012. Automated Inference of Goal-Oriented Performance Prediction Functions. In IEEE\/ACM International Conference on Automated Software Engineering (ASE). ACM, 190--199."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2006.8"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934466.2934469"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272998.1273020"}],"event":{"name":"ICPE '20: ACM\/SPEC International Conference on Performance Engineering","location":"Edmonton AB Canada","acronym":"ICPE '20","sponsor":["SIGMETRICS ACM Special Interest Group on Measurement and Evaluation","SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the ACM\/SPEC International Conference on Performance Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358960.3379137","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3358960.3379137","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:13:26Z","timestamp":1750202006000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358960.3379137"}},"subtitle":["A Case Study"],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":71,"alternative-id":["10.1145\/3358960.3379137","10.1145\/3358960"],"URL":"https:\/\/doi.org\/10.1145\/3358960.3379137","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}