{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T03:18:35Z","timestamp":1768101515243,"version":"3.49.0"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,1,30]],"date-time":"2020-01-30T00:00:00Z","timestamp":1580342400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/P005578\/1, EP\/J017515\/1"],"award-info":[{"award-number":["EP\/P005578\/1, EP\/J017515\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100011103","name":"European Commission","doi-asserted-by":"publisher","award":["TIN2015-70560-R, RTI2018-101204-B-C21"],"award-info":[{"award-number":["TIN2015-70560-R, RTI2018-101204-B-C21"]}],"id":[{"id":"10.13039\/100011103","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Program for Guangdong Introducing Innovative and Enterpreneurial Teams","award":["2017ZT07X386"],"award-info":[{"award-number":["2017ZT07X386"]}]},{"DOI":"10.13039\/501100012234","name":"Shenzhen Peacock Plan","doi-asserted-by":"crossref","award":["KQTD2016112514355531"],"award-info":[{"award-number":["KQTD2016112514355531"]}],"id":[{"id":"10.13039\/501100012234","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Innovation Committee Foundation of Shenzhen","award":["ZDSYS201703031748284"],"award-info":[{"award-number":["ZDSYS201703031748284"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2020,1,31]]},"abstract":"<jats:p>A Software Product Line (SPL) is a set of products built from a number of features, the set of valid products being defined by a feature model. Typically, it does not make sense to test all products defined by an SPL and one instead chooses a set of products to test (test selection) and, ideally, derives a good order in which to test them (test prioritisation). Since one cannot know in advance which products will reveal faults, test selection and prioritisation are normally based on objective functions that are known to relate to likely effectiveness or cost. This article introduces a new technique, the grid-based evolution strategy (GrES), which considers several objective functions that assess a selection or prioritisation and aims to optimise on all of these. The problem is thus a many-objective optimisation problem. We use a new approach, in which all of the objective functions are considered but one (pairwise coverage) is seen as the most important. We also derive a novel evolution strategy based on domain knowledge. The results of the evaluation, on randomly generated and realistic feature models, were promising, with GrES outperforming previously proposed techniques and a range of many-objective optimisation algorithms.<\/jats:p>","DOI":"10.1145\/3361146","type":"journal-article","created":{"date-parts":[[2020,1,30]],"date-time":"2020-01-30T22:27:53Z","timestamp":1580423273000},"page":"1-46","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Many-Objective Test Suite Generation for Software Product Lines"],"prefix":"10.1145","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4771-1446","authenticated-orcid":false,"given":"Robert M.","family":"Hierons","sequence":"first","affiliation":[{"name":"The University of Sheffield"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8607-9607","authenticated-orcid":false,"given":"Miqing","family":"Li","sequence":"additional","affiliation":[{"name":"The University of Birmingham"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1589-1267","authenticated-orcid":false,"given":"Xiaohui","family":"Liu","sequence":"additional","affiliation":[{"name":"Brunel University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4708-4606","authenticated-orcid":false,"given":"Jose Antonio","family":"Parejo","sequence":"additional","affiliation":[{"name":"Universidad de Sevilla"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8816-6213","authenticated-orcid":false,"given":"Sergio","family":"Segura","sequence":"additional","affiliation":[{"name":"Universidad de Sevilla"}]},{"given":"Xin","family":"Yao","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology and The University of Birmingham"}]}],"member":"320","published-online":{"date-parts":[[2020,1,30]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/AST.2017.7"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 2nd International Workshop on Variability and Complexity in Software Design (VACE\u201917)","author":"Al-Hajjaji M.","year":"2017","unstructured":"M. Al-Hajjaji , S. Lity , R. Lachmann , T. Th\u00fcm , I. Schaefer , and G. Saake . 2017. Delta-oriented product prioritization for similarity-based product-line testing . In Proceedings of the 2nd International Workshop on Variability and Complexity in Software Design (VACE\u201917) . IEEE Press, Piscataway, N.J. 34--40. DOI:https:\/\/doi.org\/10.1109\/VACE. 2017 ..8 10.1109\/VACE.2017..8 M. Al-Hajjaji, S. Lity, R. Lachmann, T. Th\u00fcm, I. Schaefer, and G. Saake. 2017. Delta-oriented product prioritization for similarity-based product-line testing. In Proceedings of the 2nd International Workshop on Variability and Complexity in Software Design (VACE\u201917). IEEE Press, Piscataway, N.J. 34--40. DOI:https:\/\/doi.org\/10.1109\/VACE.2017..8"},{"key":"#cr-split#-e_1_2_1_3_1.1","doi-asserted-by":"crossref","unstructured":"M. Al-Hajjaji T. Th\u00fcm M. Lochau J. Meinicke and G. Saake. 2016. Effective product-line testing using similarity-based product prioritization. Software 8 Systems Modeling (2016) 1--23. DOI:https:\/\/doi.org\/10.1007\/s10270-016-0569-2 10.1007\/s10270-016-0569-2","DOI":"10.1007\/s10270-016-0569-2"},{"key":"#cr-split#-e_1_2_1_3_1.2","doi-asserted-by":"crossref","unstructured":"M. Al-Hajjaji T. Th\u00fcm M. Lochau J. Meinicke and G. Saake. 2016. Effective product-line testing using similarity-based product prioritization. Software 8 Systems Modeling (2016) 1--23. DOI:https:\/\/doi.org\/10.1007\/s10270-016-0569-2","DOI":"10.1007\/s10270-016-0569-2"},{"key":"e_1_2_1_4_1","volume-title":"Evolutionary Programming, Genetic Algorithms","author":"Back T.","unstructured":"T. Back . 1996. Evolutionary Algorithms in Theory and Practice: Evolution Strategies , Evolutionary Programming, Genetic Algorithms . Oxford University Press . T. Back. 1996. Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford University Press."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00009"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 2012 Conference of the Center for Advanced Studies on Collaborative Research (CASCON\u201912)","author":"Bagheri E.","unstructured":"E. Bagheri , F. Ensan , and D. Gasevic . 2012. Grammar-based test generation for software product line feature models . In Proceedings of the 2012 Conference of the Center for Advanced Studies on Collaborative Research (CASCON\u201912) . IBM Corp., Riverton, N.J. 87--101. http:\/\/dl.acm.org\/citation.cfm?id&equals;2399776.2399785. E. Bagheri, F. Ensan, and D. Gasevic. 2012. Grammar-based test generation for software product line feature models. In Proceedings of the 2012 Conference of the Center for Advanced Studies on Collaborative Research (CASCON\u201912). IBM Corp., Riverton, N.J. 87--101. http:\/\/dl.acm.org\/citation.cfm?id&equals;2399776.2399785."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-010-9127-2"},{"key":"e_1_2_1_8_1","volume-title":"Clafer: Unifying class and feature modeling. Software 8 Systems Modeling 15, 3 (1","author":"Bak K.","year":"2016","unstructured":"K. Bak , Z. Diskin , M. Antkiewicz , K. Czarnecki , and A. Wasowski . 2016 . Clafer: Unifying class and feature modeling. Software 8 Systems Modeling 15, 3 (1 Jul 2016), 811--845. DOI:https:\/\/doi.org\/10.1007\/s10270-014-0441-1 10.1007\/s10270-014-0441-1 K. Bak, Z. Diskin, M. Antkiewicz, K. Czarnecki, and A. Wasowski. 2016. Clafer: Unifying class and feature modeling. Software 8 Systems Modeling 15, 3 (1 Jul 2016), 811--845. DOI:https:\/\/doi.org\/10.1007\/s10270-014-0441-1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2010.01.001"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of Genetic and Evolutionary Computation Conference (GECCO). ACM press, 511--518","author":"Bringmann K.","unstructured":"K. Bringmann and T. Friedrich . 2010. The maximum hypervolume set yields near-optimal approximation . In Proceedings of Genetic and Evolutionary Computation Conference (GECCO). ACM press, 511--518 . K. Bringmann and T. Friedrich. 2010. The maximum hypervolume set yields near-optimal approximation. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO). ACM press, 511--518."},{"key":"e_1_2_1_11_1","unstructured":"P. Clements and L. Northrop. 2001. Software Product Lines: Practices and Patterns. Addison--Wesley.  P. Clements and L. Northrop. 2001. Software Product Lines: Practices and Patterns. Addison--Wesley."},{"key":"e_1_2_1_12_1","unstructured":"C. A. Coello D. A. Van Veldhuizen and G. B. Lamont. 2007. Evolutionary Algorithms for Solving Multi-Objective Problems (2 ed.). Springer Munich.  C. A. Coello D. A. Van Veldhuizen and G. B. Lamont. 2007. Evolutionary Algorithms for Solving Multi-Objective Problems (2 ed.). Springer Munich."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 3rd Annual Genetic and Evolutionary Computation Conference (GECCO\u201901)","author":"Corne D. W.","unstructured":"D. W. Corne , N. R. Jerram , J. D. Knowles , and M. J. Oates . 2001. PESA-II: Region-based selection in evolutionary multiobjective optimization . In Proceedings of the 3rd Annual Genetic and Evolutionary Computation Conference (GECCO\u201901) . 283--290. D. W. Corne, N. R. Jerram, J. D. Knowles, and M. J. Oates. 2001. PESA-II: Region-based selection in evolutionary multiobjective optimization. In Proceedings of the 3rd Annual Genetic and Evolutionary Computation Conference (GECCO\u201901). 283--290."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 9th Annual Genetic and Evolutionary Computation Conference (GECCO). 773--780","author":"Corne D. W.","unstructured":"D. W. Corne and J. D. Knowles . 2007. Techniques for highly multiobjective optimisation: Some nondominated points are better than others . In Proceedings of the 9th Annual Genetic and Evolutionary Computation Conference (GECCO). 773--780 . D. W. Corne and J. D. Knowles. 2007. Techniques for highly multiobjective optimisation: Some nondominated points are better than others. In Proceedings of the 9th Annual Genetic and Evolutionary Computation Conference (GECCO). 773--780."},{"key":"e_1_2_1_15_1","volume-title":"Romero de Lemos Meira","author":"da Mota Silveira Neto P. A.","year":"2011","unstructured":"P. A. da Mota Silveira Neto , I. do Carmo Machado , J. D. McGregor , E. Santana de Almeida , and S. Romero de Lemos Meira . 2011 . A systematic mapping study of software product lines testing. Information 8 Software Technology 53, 5 (2011), 407--423. P. A. da Mota Silveira Neto, I. do Carmo Machado, J. D. McGregor, E. Santana de Almeida, and S. Romero de Lemos Meira. 2011. A systematic mapping study of software product lines testing. Information 8 Software Technology 53, 5 (2011), 407--423."},{"key":"e_1_2_1_16_1","volume-title":"Multi-Objective Optimization Using Evolutionary Algorithms","author":"Deb K.","unstructured":"K. Deb . 2001. Multi-Objective Optimization Using Evolutionary Algorithms . Wiley , New York . K. Deb. 2001. Multi-Objective Optimization Using Evolutionary Algorithms. Wiley, New York."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 8th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201914)","author":"Devroey X.","unstructured":"X. Devroey , G. Perrouin , M. Cordy , P.-Y. Schobbens , A. Legay , and P. Heymans . 2013. Towards statistical prioritization for software product lines testing . In Proceedings of the 8th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201914) . ACM, New York, Article 10, 7 pages. DOI:https:\/\/doi.org\/10.1145\/2556624.2556635 10.1145\/2556624.2556635 X. Devroey, G. Perrouin, M. Cordy, P.-Y. Schobbens, A. Legay, and P. Heymans. 2013. Towards statistical prioritization for software product lines testing. In Proceedings of the 8th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201914). ACM, New York, Article 10, 7 pages. DOI:https:\/\/doi.org\/10.1145\/2556624.2556635"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 10th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201916)","author":"Devroey X.","unstructured":"X. Devroey , G. Perrouin , A. Legay , P.-Y. Schobbens , and P. Heymans . 2016. Search-based similarity-driven behavioural SPL testing . In Proceedings of the 10th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201916) . ACM, New York, 89--96. DOI:https:\/\/doi.org\/10.1145\/2866614.2866627 10.1145\/2866614.2866627 X. Devroey, G. Perrouin, A. Legay, P.-Y. Schobbens, and P. Heymans. 2016. Search-based similarity-driven behavioural SPL testing. In Proceedings of the 10th International Workshop on Variability Modelling of Software-Intensive Systems (VaMoS\u201916). ACM, New York, 89--96. DOI:https:\/\/doi.org\/10.1145\/2866614.2866627"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.04.002"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.05.011"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 24th International Conference on Advanced Information Systems Engineering. (CAiSE 2012), Gdansk, Poland, June 25--29, 2012. Proceedings. Springer","author":"Ensan F.","unstructured":"F. Ensan , E. Bagheri , and D. Ga\u0161evi\u0107 . 2012. Evolutionary search-based test generation for software product line feature models . In Proceedings of the 24th International Conference on Advanced Information Systems Engineering. (CAiSE 2012), Gdansk, Poland, June 25--29, 2012. Proceedings. Springer , Berlin, 613--628. DOI:https:\/\/doi.org\/10.1007\/978-3-642-31095-9_40 10.1007\/978-3-642-31095-9_40 F. Ensan, E. Bagheri, and D. Ga\u0161evi\u0107. 2012. Evolutionary search-based test generation for software product line feature models. In Proceedings of the 24th International Conference on Advanced Information Systems Engineering. (CAiSE 2012), Gdansk, Poland, June 25--29, 2012. Proceedings. Springer, Berlin, 613--628. DOI:https:\/\/doi.org\/10.1007\/978-3-642-31095-9_40"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2017.2670461"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 20th European Conference on Applications of Evolutionary Computation Part II, (EvoApplications 2017","author":"Ferrer J.","year":"2017","unstructured":"J. Ferrer , F. Chicano , and E. Alba . 2017. Hybrid algorithms based on integer programming for the search of prioritized test data in software product lines . In Proceedings of the 20th European Conference on Applications of Evolutionary Computation Part II, (EvoApplications 2017 ), (Amsterdam, The Netherlands, April 19--21 , 2017 ). Giovanni Squillero and Kevin Sim (Eds.). Springer International Publishing, Cham, 3--19. DOI:https:\/\/doi.org\/10.1007\/978-3-319-55792-2_1 10.1007\/978-3-319-55792-2_1 J. Ferrer, F. Chicano, and E. Alba. 2017. Hybrid algorithms based on integer programming for the search of prioritized test data in software product lines. In Proceedings of the 20th European Conference on Applications of Evolutionary Computation Part II, (EvoApplications 2017), (Amsterdam, The Netherlands, April 19--21, 2017). Giovanni Squillero and Kevin Sim (Eds.). Springer International Publishing, Cham, 3--19. DOI:https:\/\/doi.org\/10.1007\/978-3-319-55792-2_1"},{"key":"#cr-split#-e_1_2_1_25_1.1","doi-asserted-by":"crossref","unstructured":"B. J. Garvin M. B. Cohen and M. B. Dwyer. 2011. Evaluating improvements to a meta-heuristic search for constrained interaction testing. Empirical Software Engineering 16 1 (1 Feb 2011) 61--102. DOI:https:\/\/doi.org\/10.1007\/s10664-010-9135-7 10.1007\/s10664-010-9135-7","DOI":"10.1007\/s10664-010-9135-7"},{"key":"#cr-split#-e_1_2_1_25_1.2","doi-asserted-by":"crossref","unstructured":"B. J. Garvin M. B. Cohen and M. B. Dwyer. 2011. Evaluating improvements to a meta-heuristic search for constrained interaction testing. Empirical Software Engineering 16 1 (1 Feb 2011) 61--102. DOI:https:\/\/doi.org\/10.1007\/s10664-010-9135-7","DOI":"10.1007\/s10664-010-9135-7"},{"key":"e_1_2_1_26_1","volume-title":"SMTIBEA: A hybrid multi-objective optimization algorithm for configuring large constrained software product lines. Software 8 Systems Modeling 18, 2 (1","author":"Guo J.","year":"2019","unstructured":"J. Guo , Jia H. Liang , K. Shi , D. Yang , J. Zhang , K. Czarnecki , V. Ganesh , and H. Yu . 2019 . SMTIBEA: A hybrid multi-objective optimization algorithm for configuring large constrained software product lines. Software 8 Systems Modeling 18, 2 (1 Apr 2019), 1447--1466. DOI:https:\/\/doi.org\/10.1007\/s10270-017-0610-0 10.1007\/s10270-017-0610-0 J. Guo, Jia H. Liang, K. Shi, D. Yang, J. Zhang, K. Czarnecki, V. Ganesh, and H. Yu. 2019. SMTIBEA: A hybrid multi-objective optimization algorithm for configuring large constrained software product lines. Software 8 Systems Modeling 18, 2 (1 Apr 2019), 1447--1466. DOI:https:\/\/doi.org\/10.1007\/s10270-017-0610-0"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 29th ACM\/IEEE International Conference on Automated Software Engineering (ASE\u201914)","author":"Guo J.","unstructured":"J. Guo , E. Zulkoski , R. Olaechea , D. Rayside , K. Czarnecki , S. Apel , and J. M. Atlee . 2014. Scaling exact multi-objective combinatorial optimization by parallelization . In Proceedings of the 29th ACM\/IEEE International Conference on Automated Software Engineering (ASE\u201914) . ACM, New York, 409--420. DOI:https:\/\/doi.org\/10.1145\/2642937.2642971 10.1145\/2642937.2642971 J. Guo, E. Zulkoski, R. Olaechea, D. Rayside, K. Czarnecki, S. Apel, and J. M. Atlee. 2014. Scaling exact multi-objective combinatorial optimization by parallelization. In Proceedings of the 29th ACM\/IEEE International Conference on Automated Software Engineering (ASE\u201914). ACM, New York, 409--420. DOI:https:\/\/doi.org\/10.1145\/2642937.2642971"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 18th International Software Product Line Conference -","volume":"1","author":"Harman M.","unstructured":"M. Harman , Y. Jia , J. Krinke , W. B. Langdon , J. Petke , and Y. Zhang . 2014. Search based software engineering for software product line engineering: A survey and directions for future work . In Proceedings of the 18th International Software Product Line Conference - Volume 1 (SPLC\u201914). ACM, New York, 5--18. DOI:https:\/\/doi.org\/10.1145\/2648511.2648513 10.1145\/2648511.2648513 M. Harman, Y. Jia, J. Krinke, W. B. Langdon, J. Petke, and Y. Zhang. 2014. Search based software engineering for software product line engineering: A survey and directions for future work. In Proceedings of the 18th International Software Product Line Conference - Volume 1 (SPLC\u201914). ACM, New York, 5--18. DOI:https:\/\/doi.org\/10.1145\/2648511.2648513"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2327020"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 17th International Software Product Line Conference Co-located Workshops (SPLC\u201913 Workshops). ACM","author":"Henard C.","unstructured":"C. Henard , M. Papadakis , G. Perrouin , J. Klein , and Y. Le Traon . 2013. PLEDGE: A Product Line Editor and Test Generation Tool . In Proceedings of the 17th International Software Product Line Conference Co-located Workshops (SPLC\u201913 Workshops). ACM , New York, 126--129. DOI:https:\/\/doi.org\/10.1145\/2499777.2499778 10.1145\/2499777.2499778 C. Henard, M. Papadakis, G. Perrouin, J. Klein, and Y. Le Traon. 2013. PLEDGE: A Product Line Editor and Test Generation Tool. In Proceedings of the 17th International Software Product Line Conference Co-located Workshops (SPLC\u201913 Workshops). ACM, New York, 126--129. DOI:https:\/\/doi.org\/10.1145\/2499777.2499778"},{"key":"e_1_2_1_31_1","volume-title":"International Software Product Line Conference (SPLC).","author":"Henard C.","unstructured":"C. Henard , M. Papadakis , G. Perrouin , J. Klein , and Y. Le Traon . 2013. Multi-objective test generation for software product lines . In International Software Product Line Conference (SPLC). C. Henard, M. Papadakis, G. Perrouin, J. Klein, and Y. Le Traon. 2013. Multi-objective test generation for software product lines. In International Software Product Line Conference (SPLC)."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the6th International Symposium on Search-Based Software Engineering: , (SSBSE 2014","author":"Henard C.","year":"2014","unstructured":"C. Henard , M. Papadakis , and Y. Le Traon . 2014. Mutation-based generation of software product line test configurations . In Proceedings of the6th International Symposium on Search-Based Software Engineering: , (SSBSE 2014 ), (Fortaleza, Brazil, August 26--29 , 2014 ). Springer International Publishing, Cham, 92--106. DOI:https:\/\/doi.org\/10.1007\/978-3-319-09940-8_7 10.1007\/978-3-319-09940-8_7 C. Henard, M. Papadakis, and Y. Le Traon. 2014. Mutation-based generation of software product line test configurations. In Proceedings of the6th International Symposium on Search-Based Software Engineering: , (SSBSE 2014), (Fortaleza, Brazil, August 26--29, 2014). Springer International Publishing, Cham, 92--106. DOI:https:\/\/doi.org\/10.1007\/978-3-319-09940-8_7"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2015 International Conference on Software Engineering (ICSE\u201915)","author":"Henard C.","unstructured":"C. Henard , M. Papdakis , M. Harman , and Y. Le Traon . 2015. Combining multi-objective search and constraint solving for configuring large software product lines . In Proceedings of the 2015 International Conference on Software Engineering (ICSE\u201915) . IEEE Press. C. Henard, M. Papdakis, M. Harman, and Y. Le Traon. 2015. Combining multi-objective search and constraint solving for configuring large software product lines. In Proceedings of the 2015 International Conference on Software Engineering (ICSE\u201915). IEEE Press."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897760"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 16th International Software Product Line Conference -","volume":"1","author":"Hofman P.","unstructured":"P. Hofman , T. Stenzel , T. Pohley , M. Kircher , and A. Bermann . 2012. Domain specific feature modeling for software product lines . In Proceedings of the 16th International Software Product Line Conference - Volume 1 (SPLC\u201912). ACM, New York, 229--238. DOI:https:\/\/doi.org\/10.1145\/2362536.2362568 10.1145\/2362536.2362568 P. Hofman, T. Stenzel, T. Pohley, M. Kircher, and A. Bermann. 2012. Domain specific feature modeling for software product lines. In Proceedings of the 16th International Software Product Line Conference - Volume 1 (SPLC\u201912). ACM, New York, 229--238. DOI:https:\/\/doi.org\/10.1145\/2362536.2362568"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 16th International Software Product Line Conference -","volume":"1","author":"Johansen M. F.","unstructured":"M. F. Johansen , O. Haugen , and F. Fleurey . 2012. An algorithm for generating T-wise covering arrays from large feature models . In Proceedings of the 16th International Software Product Line Conference - Volume 1 (SPLC\u201912). ACM, New York, 46--55. DOI:https:\/\/doi.org\/10.1145\/2362536.2362547 10.1145\/2362536.2362547 M. F. Johansen, O. Haugen, and F. Fleurey. 2012. An algorithm for generating T-wise covering arrays from large feature models. In Proceedings of the 16th International Software Product Line Conference - Volume 1 (SPLC\u201912). ACM, New York, 46--55. DOI:https:\/\/doi.org\/10.1145\/2362536.2362547"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"K. Kang S. Cohen J. Hess W. Novak and S. Peterson. 1990. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical Report CMU\/SEI-90-TR-21. SEI.  K. Kang S. Cohen J. Hess W. Novak and S. Peterson. 1990. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical Report CMU\/SEI-90-TR-21. SEI.","DOI":"10.21236\/ADA235785"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the Congress on Evolutionary Computation (CEC\u201999)","volume":"1","author":"Knowles J. D.","unstructured":"J. D. Knowles and D. W. Corne . 1999. The pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation . In Proceedings of the Congress on Evolutionary Computation (CEC\u201999) , Vol. 1 . J. D. Knowles and D. W. Corne. 1999. The pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation. In Proceedings of the Congress on Evolutionary Computation (CEC\u201999), Vol. 1."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365600568167"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792984"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2832181"},{"key":"e_1_2_1_42_1","volume-title":"SBSE. In Proceedings of the 40th International Conference on Software Engineering (ICSE): New Ideas and Emerging Results Track. 17--20","author":"Li M.","unstructured":"M. Li , T. Chen , and X. Yao . 2018. A critical review of \u201cA Practical Guide to Select Quality Indicators for Assessing Pareto-Based Search Algorithms in Search-Based Software Engineering\u201d: Essay on quality indicator selection for SBSE. In Proceedings of the 40th International Conference on Software Engineering (ICSE): New Ideas and Emerging Results Track. 17--20 . M. Li, T. Chen, and X. Yao. 2018. A critical review of \u201cA Practical Guide to Select Quality Indicators for Assessing Pareto-Based Search Algorithms in Search-Based Software Engineering\u201d: Essay on quality indicator selection for SBSE. In Proceedings of the 40th International Conference on Software Engineering (ICSE): New Ideas and Emerging Results Track. 17--20."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2655451"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2262178"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300148"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2017.2742869"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 29th IEEE International Conference on Software Maintenance.","author":"Lopez-Herrejon R. E.","unstructured":"R. E. Lopez-Herrejon , F. Chicano , J. Ferrer , A. Egyed , and E. Alba . 2013. Multi-objective optimal test suite computation for software product line pairwise testing . In Proceedings of the 29th IEEE International Conference on Software Maintenance. R. E. Lopez-Herrejon, F. Chicano, J. Ferrer, A. Egyed, and E. Alba. 2013. Multi-objective optimal test suite computation for software product line pairwise testing. In Proceedings of the 29th IEEE International Conference on Software Maintenance."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2014.6900473"},{"key":"#cr-split#-e_1_2_1_49_1.1","doi-asserted-by":"crossref","unstructured":"R. E. Lopez-Herrejon J. Ferrer F. Chicano A. Egyed and E. Alba. 2016. Evolutionary computation for software product line testing: An overview and open challenges Computational Intelligence and Quantitative Software Engineering. Springer International Publishing Cham 59--87. DOI:https:\/\/doi.org\/10.1007\/978-3-319-25964-2_4 10.1007\/978-3-319-25964-2_4","DOI":"10.1007\/978-3-319-25964-2_4"},{"key":"#cr-split#-e_1_2_1_49_1.2","doi-asserted-by":"crossref","unstructured":"R. E. Lopez-Herrejon J. Ferrer F. Chicano A. Egyed and E. Alba. 2016. Evolutionary computation for software product line testing: An overview and open challenges Computational Intelligence and Quantitative Software Engineering. Springer International Publishing Cham 59--87. DOI:https:\/\/doi.org\/10.1007\/978-3-319-25964-2_4","DOI":"10.1007\/978-3-319-25964-2_4"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO\u201914)","author":"Lopez-Herrejon R. E.","unstructured":"R. E. Lopez-Herrejon , J. Ferrer , F. Chicano , E. N. Haslinger , A. Egyed , and E. Alba . 2014. A parallel evolutionary algorithm for prioritized pairwise testing of software product lines . In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO\u201914) . ACM, New York, 1255--1262. DOI:https:\/\/doi.org\/10.1145\/2576768.2598305 10.1145\/2576768.2598305 R. E. Lopez-Herrejon, J. Ferrer, F. Chicano, E. N. Haslinger, A. Egyed, and E. Alba. 2014. A parallel evolutionary algorithm for prioritized pairwise testing of software product lines. In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO\u201914). ACM, New York, 1255--1262. DOI:https:\/\/doi.org\/10.1145\/2576768.2598305"},{"key":"e_1_2_1_51_1","unstructured":"R. E. Lopez-Herrejon J. Ferrer F. Chicano E. N. Haslinger A. Egyed and E. Alba. 2014. Towards a benchmark and a comparison framework for combinatorial interaction testing of software product lines. CoRR abs\/1401.5367 (2014). http:\/\/arxiv.org\/abs\/1401.5367.  R. E. Lopez-Herrejon J. Ferrer F. Chicano E. N. Haslinger A. Egyed and E. Alba. 2014. Towards a benchmark and a comparison framework for combinatorial interaction testing of software product lines. CoRR abs\/1401.5367 (2014). http:\/\/arxiv.org\/abs\/1401.5367."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation, (ICST 2015 Workshops)","author":"Lopez-Herrejon R. E.","year":"2015","unstructured":"R. E. Lopez-Herrejon , S. Fischer , R. Ramler , and A. Egyed . 2015. A first systematic mapping study on combinatorial interaction testing for software product lines . In Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation, (ICST 2015 Workshops) , ( Graz, Austria, April 13--17 , 2015 ). 1--10. DOI:https:\/\/doi.org\/10.1109\/ICSTW.2015.7107435 10.1109\/ICSTW.2015.7107435 R. E. Lopez-Herrejon, S. Fischer, R. Ramler, and A. Egyed. 2015. A first systematic mapping study on combinatorial interaction testing for software product lines. In Proceedings of the 8th IEEE International Conference on Software Testing, Verification and Validation, (ICST 2015 Workshops), (Graz, Austria, April 13--17, 2015). 1--10. DOI:https:\/\/doi.org\/10.1109\/ICSTW.2015.7107435"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.01.008"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 21st International Systems and Software Product Line Conference -","volume":"132","author":"Markiegi U.","unstructured":"U. Markiegi , A. Arrieta , G. Sagardui , and L. Etxeberria . 2017. Search-based product line fault detection allocating test cases iteratively . In Proceedings of the 21st International Systems and Software Product Line Conference - Volume A (SPLC\u201917). ACM, New York, 123-- 132 . DOI:https:\/\/doi.org\/10.1145\/3106195.3106210 10.1145\/3106195.3106210 U. Markiegi, A. Arrieta, G. Sagardui, and L. Etxeberria. 2017. Search-based product line fault detection allocating test cases iteratively. In Proceedings of the 21st International Systems and Software Product Line Conference - Volume A (SPLC\u201917). ACM, New York, 123--132. DOI:https:\/\/doi.org\/10.1145\/3106195.3106210"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.5555\/1308171.1308198"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 18th International Software Product Line Conference -","volume":"1","author":"Olaechea R.","unstructured":"R. Olaechea , D. Rayside , J. Guo , and K. Czarnecki . 2014. Comparison of exact and approximate multi-objective optimization for software product lines . In Proceedings of the 18th International Software Product Line Conference - Volume 1 (SPLC\u201914). ACM, New York, 92--101. DOI:https:\/\/doi.org\/10.1145\/2648511.2648521 10.1145\/2648511.2648521 R. Olaechea, D. Rayside, J. Guo, and K. Czarnecki. 2014. Comparison of exact and approximate multi-objective optimization for software product lines. In Proceedings of the 18th International Software Product Line Conference - Volume 1 (SPLC\u201914). ACM, New York, 92--101. DOI:https:\/\/doi.org\/10.1145\/2648511.2648521"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.09.045"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2017.01.038"},{"key":"#cr-split#-e_1_2_1_59_1.1","doi-asserted-by":"crossref","unstructured":"A. B. S\u00e1nchez S. Segura J. A. Parejo and A. Ruiz-Cort\u00e9s. 2015. Variability testing in the wild: The Drupal case study. Software and Systems Modeling (2015) 1--22. DOI:https:\/\/doi.org\/10.1007\/s10270-015-0459-z 10.1007\/s10270-015-0459-z","DOI":"10.1007\/s10270-015-0459-z"},{"key":"#cr-split#-e_1_2_1_59_1.2","doi-asserted-by":"crossref","unstructured":"A. B. S\u00e1nchez S. Segura J. A. Parejo and A. Ruiz-Cort\u00e9s. 2015. Variability testing in the wild: The Drupal case study. Software and Systems Modeling (2015) 1--22. DOI:https:\/\/doi.org\/10.1007\/s10270-015-0459-z","DOI":"10.1007\/s10270-015-0459-z"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.15"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 2013 International Conference on Software Engineering (ICSE\u201913)","author":"Sayyad A. S.","unstructured":"A. S. Sayyad , T. Menzies , and H. Ammar . 2013. On the value of user preferences in search-based software engineering: A case study in software product lines . In Proceedings of the 2013 International Conference on Software Engineering (ICSE\u201913) . IEEE Press, Piscataway, N.J. 492--501. http:\/\/dl.acm.org\/citation.cfm?id&equals;2486788.2486853. A. S. Sayyad, T. Menzies, and H. Ammar. 2013. On the value of user preferences in search-based software engineering: A case study in software product lines. In Proceedings of the 2013 International Conference on Software Engineering (ICSE\u201913). IEEE Press, Piscataway, N.J. 492--501. http:\/\/dl.acm.org\/citation.cfm?id&equals;2486788.2486853."},{"key":"e_1_2_1_62_1","volume-title":"Evolution and Optimum Seeking: The Sixth Generation","author":"Schwefel H.-P.","unstructured":"H.-P. Schwefel . 1993. Evolution and Optimum Seeking: The Sixth Generation . John Wiley 8 Sons, Inc. H.-P. Schwefel. 1993. Evolution and Optimum Seeking: The Sixth Generation. John Wiley 8 Sons, Inc."},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 6th International Workshop on Variability Modeling of Software-Intensive Systems (VaMoS\u201912)","author":"Segura S.","unstructured":"S. Segura , J. A. Galindo , D. Benavides , J. A. Parejo , and A. Ruiz-Cort\u00e9s . 2012. BeTTy: Benchmarking and testing on the automated analysis of feature models . In Proceedings of the 6th International Workshop on Variability Modeling of Software-Intensive Systems (VaMoS\u201912) . ACM, New York, 63--71. DOI:https:\/\/doi.org\/10.1145\/2110147.2110155 10.1145\/2110147.2110155 S. Segura, J. A. Galindo, D. Benavides, J. A. Parejo, and A. Ruiz-Cort\u00e9s. 2012. BeTTy: Benchmarking and testing on the automated analysis of feature models. In Proceedings of the 6th International Workshop on Variability Modeling of Software-Intensive Systems (VaMoS\u201912). ACM, New York, 63--71. DOI:https:\/\/doi.org\/10.1145\/2110147.2110155"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/DASC.1998.739846"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2016.07.059"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909)","author":"Th\u00fcm T.","year":"2009","unstructured":"T. Th\u00fcm , D. Batory , and C. Kastner . 2009. Reasoning about edits to feature models . In Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909) . IEEE Computer Society, Washington, DC, 254--264. DOI:https:\/\/doi.org\/10.1109\/ICSE. 2009 .5070526 10.1109\/ICSE.2009.5070526 T. Th\u00fcm, D. Batory, and C. Kastner. 2009. Reasoning about edits to feature models. In Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909). IEEE Computer Society, Washington, DC, 254--264. DOI:https:\/\/doi.org\/10.1109\/ICSE.2009.5070526"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2012.06.002"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the 12th Software Product Lines Conference (SPLC). 359","author":"Trinidad P.","year":"2008","unstructured":"P. Trinidad , D. Benavides , A. Ruiz-Cort\u00e9s , S. Segura , and A. Jimenez . 2008. FAMA framework . In Proceedings of the 12th Software Product Lines Conference (SPLC). 359 . DOI:https:\/\/doi.org\/10.1109\/SPLC. 2008 .50 10.1109\/SPLC.2008.50 P. Trinidad, D. Benavides, A. Ruiz-Cort\u00e9s, S. Segura, and A. Jimenez. 2008. FAMA framework. In Proceedings of the 12th Software Product Lines Conference (SPLC). 359. DOI:https:\/\/doi.org\/10.1109\/SPLC.2008.50"},{"key":"e_1_2_1_69_1","first-page":"101","article-title":"A critique and improvement of the CL common language effect size statistics of McGraw and Wong","volume":"25","author":"Vargha A.","year":"2000","unstructured":"A. Vargha and H. D. Delaney . 2000 . A critique and improvement of the CL common language effect size statistics of McGraw and Wong . Journal of Educational and Behavioral Statistics 25 , 2 (2000), 101 -- 132 . A. Vargha and H. D. Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101--132.","journal-title":"Journal of Educational and Behavioral Statistics"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).","author":"Wang S.","unstructured":"S. Wang , S. Ali , and A. Gotlieb . 2013. Minimizing test suites in software product lines using weight-based genetic algorithms . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). S. Wang, S. Ali, and A. Gotlieb. 2013. Minimizing test suites in software product lines using weight-based genetic algorithms. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.08.024"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the 38th International Conference on Software Engineering (ICSE). 631--642","author":"Wang S.","unstructured":"S. Wang , S. Ali , T. Yue , Y. Li , and M. Liaaen . 2016. A practical guide to select quality indicators for assessing Pareto-based search algorithms in search-based software engineering . In Proceedings of the 38th International Conference on Software Engineering (ICSE). 631--642 . S. Wang, S. Ali, T. Yue, Y. Li, and M. Liaaen. 2016. A practical guide to select quality indicators for assessing Pareto-based search algorithms in search-based software engineering. In Proceedings of the 38th International Conference on Software Engineering (ICSE). 631--642."},{"key":"e_1_2_1_73_1","volume-title":"Software Product Line Conference. 32--41","author":"Wang S.","unstructured":"S. Wang , D. Buchmann , S. Ali , A. Gotlieb , D. Pradhan , and M. Liaaen . 2014. Multi-objective test prioritization in software product line testing: An industrial case study . In Software Product Line Conference. 32--41 . S. Wang, D. Buchmann, S. Ali, A. Gotlieb, D. Pradhan, and M. Liaaen. 2014. Multi-objective test prioritization in software product line testing: An industrial case study. In Software Product Line Conference. 32--41."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2016.1180986"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 17th International Software Product Line Conference (SPLC\u201913)","author":"Xu Z.","unstructured":"Z. Xu , M. B. Cohen , W. Motycka , and G. Rothermel . 2013. Continuous test suite augmentation in software product lines . In Proceedings of the 17th International Software Product Line Conference (SPLC\u201913) . ACM, New York, 52--61. DOI:https:\/\/doi.org\/10.1145\/2491627.2491650 10.1145\/2491627.2491650 Z. Xu, M. B. Cohen, W. Motycka, and G. Rothermel. 2013. Continuous test suite augmentation in software product lines. In Proceedings of the 17th International Software Product Line Conference (SPLC\u201913). ACM, New York, 52--61. DOI:https:\/\/doi.org\/10.1145\/2491627.2491650"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2012.2227145"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1002\/stv.430"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.892759"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2011.03.001"},{"key":"e_1_2_1_80_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN). 832--842","author":"Zitzler E.","unstructured":"E. Zitzler and S. K\u00fcnzli . 2004. Indicator-based selection in multiobjective search . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN). 832--842 . E. Zitzler and S. K\u00fcnzli. 2004. Indicator-based selection in multiobjective search. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN). 832--842."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.797969"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3361146","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3361146","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:51Z","timestamp":1750201971000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3361146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,30]]},"references-count":85,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,1,31]]}},"alternative-id":["10.1145\/3361146"],"URL":"https:\/\/doi.org\/10.1145\/3361146","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,30]]},"assertion":[{"value":"2018-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-01-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}