{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T03:57:23Z","timestamp":1760587043958,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T00:00:00Z","timestamp":1603152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,20]]},"DOI":"10.1145\/3425174.3425211","type":"proceedings-article","created":{"date-parts":[[2020,10,23]],"date-time":"2020-10-23T00:01:25Z","timestamp":1603411285000},"page":"11-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Applying Many-objective Algorithms to the Variability Test of Software Product Lines"],"prefix":"10.1145","author":[{"given":"Thiago do Nascimento","family":"Ferreira","sequence":"first","affiliation":[{"name":"University of Michigan, Dearborn, USA"}]},{"given":"Silvia Regina","family":"Vergilio","sequence":"additional","affiliation":[{"name":"DInf, Federal University of Paran\u00e1, Curitiba, Brazil"}]},{"given":"Marouane","family":"Kessentini","sequence":"additional","affiliation":[{"name":"University of Michigan, Dearborn, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"volume-title":"Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation (ICST '15)","author":"Arcaini P.","key":"e_1_3_2_1_1_1","unstructured":"P. Arcaini , A. Gargantini , and P. Vavassori . 2015. Generating tests for detecting faults in feature models . In Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation (ICST '15) . IEEE, Graz, Austria, 1--10. P. Arcaini, A. Gargantini, and P. Vavassori. 2015. Generating tests for detecting faults in feature models. In Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation (ICST '15). IEEE, Graz, Austria, 1--10."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.536462"},{"volume-title":"Proceedings of the 2006 International Symposium on Software Testing and Analysis (ISSTA' 06)","author":"Cohen M. B.","key":"e_1_3_2_1_3_1","unstructured":"M. B. Cohen , M. B. Dwyer , and J. Shi . 2006. Coverage and adequacy in software product line testing . In Proceedings of the 2006 International Symposium on Software Testing and Analysis (ISSTA' 06) . ACM, Portland, USA, 53--63. M. B. Cohen, M. B. Dwyer, and J. Shi. 2006. Coverage and adequacy in software product line testing. In Proceedings of the 2006 International Symposium on Software Testing and Analysis (ISSTA' 06). ACM, Portland, USA, 53--63."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"K. Czarnecki S. Helsen and U. Eisenecker. 2005. Formalizing cardinality-based feature models and their specialization. Software process: Improvement and practice 10 1 (March 2005) 7--29.  K. Czarnecki S. Helsen and U. Eisenecker. 2005. Formalizing cardinality-based feature models and their specialization. Software process: Improvement and practice 10 1 (March 2005) 7--29.","DOI":"10.1002\/spip.213"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47106-8_26"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281535"},{"volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC '06)","author":"Deb K.","key":"e_1_3_2_1_8_1","unstructured":"K. Deb and D. Saxena . 2006. Searching for Pareto-optimal solutions through dimensionality reduction for certain large-dimensional multi-objective optimization problems . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC '06) . Vancouver, Canada, 3352--3360. K. Deb and D. Saxena. 2006. Searching for Pareto-optimal solutions through dimensionality reduction for certain large-dimensional multi-objective optimization problems. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC '06). Vancouver, Canada, 3352--3360."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.advengsoft.2011.05.014"},{"volume-title":"Proceedings of the 25th International Conference on Advanced Information Systems Engineering (CAiSE '13)","author":"Ensan F.","key":"e_1_3_2_1_10_1","unstructured":"F. Ensan , E. Bagheri , and D. Ga\u0161evi\u0107 . 2012. Evolutionary search-based test generation for software product line feature models . In Proceedings of the 25th International Conference on Advanced Information Systems Engineering (CAiSE '13) . Springer, Valencia, Spain, 613--628. F. Ensan, E. Bagheri, and D. Ga\u0161evi\u0107. 2012. Evolutionary search-based test generation for software product line feature models. In Proceedings of the 25th International Conference on Advanced Information Systems Engineering (CAiSE '13). Springer, Valencia, Spain, 613--628."},{"key":"e_1_3_2_1_11_1","unstructured":"James D Evans. 1996. Straightforward statistics for the behavioral sciences. Thomson Brooks\/Cole Publishing Co.  James D Evans. 1996. Straightforward statistics for the behavioral sciences. Thomson Brooks\/Cole Publishing Co."},{"volume-title":"Proceedings of the 25th International Conference on Software Engineering and Knowledge Engineering (SEKE'13)","author":"Ferreira J. M.","key":"e_1_3_2_1_12_1","unstructured":"J. M. Ferreira , S. R. Vergilio , and M. A. Quin\u00e1ia . 2013. A Mutation Approach to Feature Testing of Software Product Lines . In Proceedings of the 25th International Conference on Software Engineering and Knowledge Engineering (SEKE'13) . Knowledge Systems Institute Graduate School, Boston, USA, 232--237. J. M. Ferreira, S. R. Vergilio, and M. A. Quin\u00e1ia. 2013. A Mutation Approach to Feature Testing of Software Product Lines. In Proceedings of the 25th International Conference on Software Engineering and Knowledge Engineering (SEKE'13). Knowledge Systems Institute Graduate School, Boston, USA, 232--237."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194017500309"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2017.2670461"},{"volume-title":"Proceedings of the 6th International Symposium on Search Based Software Engineering (SSBSE '14)","author":"Henard C.","key":"e_1_3_2_1_15_1","unstructured":"C. Henard , M. Papadakis , and Y. Le Traon . 2014. Mutation-based generation of software product line test configurations . In Proceedings of the 6th International Symposium on Search Based Software Engineering (SSBSE '14) . Springer, Fortaleza, Brazil, 92--106. C. Henard, M. Papadakis, and Y. Le Traon. 2014. Mutation-based generation of software product line test configurations. In Proceedings of the 6th International Symposium on Search Based Software Engineering (SSBSE '14). Springer, Fortaleza, Brazil, 92--106."},{"volume-title":"Proceedings of the 6th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW '13)","author":"Henard C.","key":"e_1_3_2_1_16_1","unstructured":"C. Henard , M. Papadakis , G. Perrouin , J. Klein , and Y. Le Traon . 2013. Assessing software product line testing via model-based mutation: An application to similarity testing . In Proceedings of the 6th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW '13) . IEEE, Luxembourg, 188--197. C. Henard, M. Papadakis, G. Perrouin, J. Klein, and Y. Le Traon. 2013. Assessing software product line testing via model-based mutation: An application to similarity testing. In Proceedings of the 6th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW '13). IEEE, Luxembourg, 188--197."},{"key":"e_1_3_2_1_17_1","volume-title":"International Software Product Line Conference (SPEC '13)","author":"Henard C.","year":"2013","unstructured":"C. Henard , M. Papadakis , G. Perrouin , J. Klein , and Y Le Traon . 2013 . Multi-objective test generation for software product lines . In International Software Product Line Conference (SPEC '13) . ACM, Tokyo, Japan, 62--71. C. Henard, M. Papadakis, G. Perrouin, J. Klein, and Y Le Traon. 2013. Multi-objective test generation for software product lines. In International Software Product Line Conference (SPEC '13). ACM, Tokyo, Japan, 62--71."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281534"},{"volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC '18)","author":"Jakubovski Filho H. L.","key":"e_1_3_2_1_19_1","unstructured":"H. L. Jakubovski Filho , T. N. Ferreira , and S. R. Vergilio . 2018. Incorporating User Preferences in a Software Product Line Testing Hyper-Heuristic Approach . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC '18) . IEEE, Rio de Janeiro, Brazil, 1--8. H. L. Jakubovski Filho, T. N. Ferreira, and S. R. Vergilio. 2018. Incorporating User Preferences in a Software Product Line Testing Hyper-Heuristic Approach. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC '18). IEEE, Rio de Janeiro, Brazil, 1--8."},{"volume-title":"Proceedings of the XXXII Brazilian Symposium on Software Engineering (SBES '18)","author":"Jakubovski Filho H. L.","key":"e_1_3_2_1_20_1","unstructured":"H. L. Jakubovski Filho , T. N. Ferreira , and S. R. Vergilio . 2018. Multiple Objective Test Set Selection for Software Product Line Testing: Evaluating Different Preference-based Algorithms . In Proceedings of the XXXII Brazilian Symposium on Software Engineering (SBES '18) . ACM, Sao Carlos, Brazil, 162--171. H. L. Jakubovski Filho, T. N. Ferreira, and S. R. Vergilio. 2018. Multiple Objective Test Set Selection for Software Product Line Testing: Evaluating Different Preference-based Algorithms. In Proceedings of the XXXII Brazilian Symposium on Software Engineering (SBES '18). ACM, Sao Carlos, Brazil, 162--171."},{"key":"e_1_3_2_1_21_1","article-title":"Preference Based Multi-Objective Algorithms Applied to the Variability Testing of Software Product Lines","author":"Jakubovski Filho H. L.","year":"2018","unstructured":"H. L. Jakubovski Filho , T N. Ferreira , and S. R. Vergilio . 2018 . Preference Based Multi-Objective Algorithms Applied to the Variability Testing of Software Product Lines . Journal of Systems and Software 151 ( May 2018), 194--209. H. L. Jakubovski Filho, T N. Ferreira, and S. R. Vergilio. 2018. Preference Based Multi-Objective Algorithms Applied to the Variability Testing of Software Product Lines. Journal of Systems and Software 151 (May 2018), 194--209.","journal-title":"Journal of Systems and Software 151"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2002.1020288"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MC.2009.253","article-title":"Combinatorial software testing","volume":"42","author":"Kuhn R.","year":"2009","unstructured":"R. Kuhn , R. Kacker , Y. Lei , and J. Hunter . 2009 . Combinatorial software testing . Computer 42 , 8 (Aug. 2009), 94--96. R. Kuhn, R. Kacker, Y. Lei, and J. Hunter. 2009. Combinatorial software testing. Computer 42, 8 (Aug. 2009), 94--96.","journal-title":"Computer"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792984"},{"key":"e_1_3_2_1_25_1","first-page":"6","article-title":"R-metric: Evaluating the performance of preference-based evolutionary multiobjective optimization using reference points","volume":"22","author":"Li K.","year":"2017","unstructured":"K. Li , K. Deb , and X. Yao . 2017 . R-metric: Evaluating the performance of preference-based evolutionary multiobjective optimization using reference points . IEEE Transactions on Evolutionary Computation 22 , 6 (Sept. 2017), 821--835. K. Li, K. Deb, and X. Yao. 2017. R-metric: Evaluating the performance of preference-based evolutionary multiobjective optimization using reference points. IEEE Transactions on Evolutionary Computation 22, 6 (Sept. 2017), 821--835.","journal-title":"IEEE Transactions on Evolutionary Computation"},{"volume-title":"Proceedings of the 2013 IEEE International Conference on Software Maintenance (ICSM '13)","author":"Lopez-Herrejon R. E","key":"e_1_3_2_1_26_1","unstructured":"R. E Lopez-Herrejon , F. Chicano , J. Ferrer , A. Egyed , and E. Alba . 2013. Multi-objective optimal test suite computation for software product line pairwise testing . In Proceedings of the 2013 IEEE International Conference on Software Maintenance (ICSM '13) . IEEE, Eindhoven, The Netherlands, 404--407. R. E Lopez-Herrejon, F. Chicano, J. Ferrer, A. Egyed, and E. Alba. 2013. Multi-objective optimal test suite computation for software product line pairwise testing. In Proceedings of the 2013 IEEE International Conference on Software Maintenance (ICSM '13). IEEE, Eindhoven, The Netherlands, 404--407."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40411-016-0030-9"},{"volume-title":"Proceedings of the 24th ACM Conference Companion on Object Oriented Programming Systems Languages and Applications (OOPSLA '09)","author":"Mendon\u00e7a M.","key":"e_1_3_2_1_28_1","unstructured":"M. Mendon\u00e7a , M. Branco , and D. Cowan . 2009. SPLOT: software product lines online tools . In Proceedings of the 24th ACM Conference Companion on Object Oriented Programming Systems Languages and Applications (OOPSLA '09) . Orlando, USA, 761--762. M. Mendon\u00e7a, M. Branco, and D. Cowan. 2009. SPLOT: software product lines online tools. In Proceedings of the 24th ACM Conference Companion on Object Oriented Programming Systems Languages and Applications (OOPSLA '09). Orlando, USA, 761--762."},{"key":"e_1_3_2_1_29_1","article-title":"Multi-objective test case prioritization in highly configurable systems: A case study","author":"Parejo J.A.","year":"2016","unstructured":"J.A. Parejo , A.B. S\u00e1nchez , S. Segura , A. Ruiz-Cort\u00e9s , R. Lopez-Herrejon , and A. Egyed . 2016 . Multi-objective test case prioritization in highly configurable systems: A case study . Journal of Systems and Software 122 ( September 2016), 287--310. J.A. Parejo, A.B. S\u00e1nchez, S. Segura, A. Ruiz-Cort\u00e9s, R. Lopez-Herrejon, and A. Egyed. 2016. Multi-objective test case prioritization in highly configurable systems: A case study. Journal of Systems and Software 122 (September 2016), 287--310.","journal-title":"Journal of Systems and Software 122"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12414"},{"volume-title":"Proceedings of the 19th International Software Product Line Conference (SPLC '15)","author":"Reuling D.","key":"e_1_3_2_1_31_1","unstructured":"D. Reuling , J. B\u00fcrdek , S. Rot\u00e4rmel , M. Lochau , and U. Kelter . 2015. Fault-based product-line testing: Effective sample generation based on feature-diagram mutation . In Proceedings of the 19th International Software Product Line Conference (SPLC '15) . ACM, Nashville, Tennessee, 131--140. D. Reuling, J. B\u00fcrdek, S. Rot\u00e4rmel, M. Lochau, and U. Kelter. 2015. Fault-based product-line testing: Effective sample generation based on feature-diagram mutation. In Proceedings of the 19th International Software Product Line Conference (SPLC '15). ACM, Nashville, Tennessee, 131--140."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"A. Strickler J. A Prado Lima S. R. Vergilio and A. Pozo. 2016. Deriving products for variability test of feature models with a hyper-heuristic approach. Applied Soft Computing 49 (Dec. 2016) 1232--1242.  A. Strickler J. A Prado Lima S. R. Vergilio and A. Pozo. 2016. Deriving products for variability test of feature models with a hyper-heuristic approach. Applied Soft Computing 49 (Dec. 2016) 1232--1242.","DOI":"10.1016\/j.asoc.2016.07.059"},{"volume-title":"Proceedings of the 12th International Software Product Line Conference (SPLC '08)","author":"Trinidad P.","key":"e_1_3_2_1_33_1","unstructured":"P. Trinidad , D. Benavides , A. Ruiz-Cort\u00e9s , S. Segura , and A. Jimenez . 2008. FaMa framework . In Proceedings of the 12th International Software Product Line Conference (SPLC '08) . IEEE, Limerick, Ireland, 359--359. P. Trinidad, D. Benavides, A. Ruiz-Cort\u00e9s, S. Segura, and A. Jimenez. 2008. FaMa framework. In Proceedings of the 12th International Software Product Line Conference (SPLC '08). IEEE, Limerick, Ireland, 359--359."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"F. J. Van der Linden K. Schmid and E. Rommes. 2007. Software product lines in action: The best industrial practice in product line engineering. Springer Science & Business Media.  F. J. Van der Linden K. Schmid and E. Rommes. 2007. Software product lines in action: The best industrial practice in product line engineering. Springer Science & Business Media.","DOI":"10.1007\/978-3-540-71437-8"},{"key":"e_1_3_2_1_35_1","first-page":"101","article-title":"A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong","volume":"25","author":"Vargha Andras","year":"2000","unstructured":"Andras Vargha and Harold D. Delaney . 2000 . A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong . Journal of Educational and Behavioral Statistics 25 , 2 (2000), 101 -- 132 . Andras Vargha and Harold D. Delaney. 2000. A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101--132.","journal-title":"Journal of Educational and Behavioral Statistics"},{"volume-title":"Improving Web Services Design Quality Using Dimensionality Reduction Techniques. In International Conference on Service-Oriented Computing (ICSOC '17)","author":"Wang H.","key":"e_1_3_2_1_36_1","unstructured":"H. Wang and M. Kessentini . 2017 . Improving Web Services Design Quality Using Dimensionality Reduction Techniques. In International Conference on Service-Oriented Computing (ICSOC '17) . Springer, Malaga, Spain, 499--507. H. Wang and M. Kessentini. 2017. Improving Web Services Design Quality Using Dimensionality Reduction Techniques. In International Conference on Service-Oriented Computing (ICSOC '17). Springer, Malaga, Spain, 499--507."},{"volume-title":"Proceedings of the 15th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO '13)","author":"Wang S.","key":"e_1_3_2_1_37_1","unstructured":"S. Wang , S. Ali , and A. Gotlieb . 2013. Minimizing test suites in software product lines using weight-based genetic algorithms . In Proceedings of the 15th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO '13) . ACM, Amsterdam, The Netherlands, 1493--1500. S. Wang, S. Ali, and A. Gotlieb. 2013. Minimizing test suites in software product lines using weight-based genetic algorithms. In Proceedings of the 15th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO '13). ACM, Amsterdam, The Netherlands, 1493--1500."},{"volume-title":"Proceedings of the 18th International Software Product Line Conference (SPLC '14)","author":"Wang S.","key":"e_1_3_2_1_38_1","unstructured":"S. Wang , D. Buchmann , S. Ali , A. Gotlieb , D. Pradhan , and M. Liaaen . 2014. Multi-objective test prioritization in software product line testing: An industrial case study . In Proceedings of the 18th International Software Product Line Conference (SPLC '14) . ACM, Florence, Italy, 32--41. S. Wang, D. Buchmann, S. Ali, A. Gotlieb, D. Pradhan, and M. Liaaen. 2014. Multi-objective test prioritization in software product line testing: An industrial case study. In Proceedings of the 18th International Software Product Line Conference (SPLC '14). ACM, Florence, Italy, 32--41."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/tevc.2003.810758"}],"event":{"name":"SAST 20: 5th Brazilian Symposium on Systematic and Automated Software Testing","sponsor":["SBC Brazilian Computer Society"],"location":"Natal Brazil","acronym":"SAST 20"},"container-title":["Proceedings of the 5th Brazilian Symposium on Systematic and Automated Software Testing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3425174.3425211","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3425174.3425211","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:54Z","timestamp":1750195914000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3425174.3425211"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,20]]},"references-count":38,"alternative-id":["10.1145\/3425174.3425211","10.1145\/3425174"],"URL":"https:\/\/doi.org\/10.1145\/3425174.3425211","relation":{},"subject":[],"published":{"date-parts":[[2020,10,20]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}