{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T22:08:09Z","timestamp":1769724489989,"version":"3.49.0"},"reference-count":110,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,6,1]],"date-time":"2020-06-01T00:00:00Z","timestamp":1590969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["71731008"],"award-info":[{"award-number":["71731008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2020,7,31]]},"abstract":"<jats:p>\n            Test-suite minimization is one key technique for optimizing the software testing process. Due to the need to balance multiple factors, multi-criteria test-suite minimization (MCTSM) becomes a popular research topic in the recent decade. The MCTSM problem is typically modeled as integer linear programming (ILP) problem and solved with weighted-sum single objective approach. However, there is no existing approach that can generate sound (i.e., being Pareto-optimal) and complete (i.e., covering the entire Pareto front) Pareto-optimal solution set, to the knowledge of the authors. In this work, we first prove that the ILP formulation can accurately model the MCTSM problem and then propose the multi-objective integer programming (MOIP) approaches to solve it. We apply our MOIP approaches on three specific MCTSM problems and compare the results with those of the cutting-edge methods, namely,\n            <jats:italic>NonlinearFormulation_LinearSolver<\/jats:italic>\n            (NF_LS) and two Multi-Objective Evolutionary Algorithms (MOEAs). The results show that our MOIP approaches can always find sound and complete solutions on five subject programs, using similar or significantly less time than NF_LS and two MOEAs do. The current experimental results are quite promising, and our approaches have the potential to be applied for other similar search-based software engineering problems.\n          <\/jats:p>","DOI":"10.1145\/3392031","type":"journal-article","created":{"date-parts":[[2020,6,1]],"date-time":"2020-06-01T16:19:41Z","timestamp":1591028381000},"page":"1-50","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Multi-objective Integer Programming Approaches for Solving the Multi-criteria Test-suite Minimization Problem"],"prefix":"10.1145","volume":"29","author":[{"given":"Yinxing","family":"Xue","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5755-7115","authenticated-orcid":false,"given":"Yan-Fu","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,6]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Radio Technical Commission for Aeronautics (RTCA). 1992. DO-178B: Software Considerations in Airborne Systems and Equipment Certification. https:\/\/en.wikipedia.org\/wiki\/DO-178B.  Radio Technical Commission for Aeronautics (RTCA). 1992. DO-178B: Software Considerations in Airborne Systems and Equipment Certification. https:\/\/en.wikipedia.org\/wiki\/DO-178B."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2009.8.5.c5"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2610391"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2019.06.009"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.43"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/11554844_3"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134299"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201916)","author":"Behrouz Reyhaneh Jabbarvand","year":"2016","unstructured":"Reyhaneh Jabbarvand Behrouz , Alireza Sadeghi , Hamid Bagheri , and Sam Malek . 2016 . Energy-aware test-suite minimization for Android apps . In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201916) . ACM, 425--436. Reyhaneh Jabbarvand Behrouz, Alireza Sadeghi, Hamid Bagheri, and Sam Malek. 2016. Energy-aware test-suite minimization for Android apps. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201916). ACM, 425--436."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2004.1317433"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628058"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2693208.2693226"},{"key":"e_1_2_1_12_1","volume-title":"Convex Optimization","author":"Boyd Stephen","unstructured":"Stephen Boyd and Lieven Vandenberghe . 2004. Convex Optimization . Cambridge University Press , New York, NY . Stephen Boyd and Lieven Vandenberghe. 2004. Convex Optimization. Cambridge University Press, New York, NY."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2009.06.006"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201908)","author":"Cadar Cristian","unstructured":"Cristian Cadar , Daniel Dunbar , and Dawson R. Engler . 2008. KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs . In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201908) . 209--224. Retrieved from http:\/\/www.usenix.org\/events\/osdi08\/tech\/full_papers\/cadar\/cadar.pdf. Cristian Cadar, Daniel Dunbar, and Dawson R. Engler. 2008. KLEE: Unassisted and automatic generation of high-coverage tests for complex systems programs. In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201908). 209--224. Retrieved from http:\/\/www.usenix.org\/events\/osdi08\/tech\/full_papers\/cadar\/cadar.pdf."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007660200010"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2011.6080805"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0190(96)00135-4"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-0346(02)00011-3"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606560"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00055"},{"key":"e_1_2_1_21_1","volume-title":"Test suite reduction in conformance testing. Acta Cybern. 14 (1","author":"Cs\u00f6ndes Tibor","year":"1999","unstructured":"Tibor Cs\u00f6ndes , Sarolta Dibuz , and Bal\u00e1zs Kotnyek . 1999. Test suite reduction in conformance testing. Acta Cybern. 14 (1 1999 ), 229--238. Tibor Cs\u00f6ndes, Sarolta Dibuz, and Bal\u00e1zs Kotnyek. 1999. Test suite reduction in conformance testing. Acta Cybern. 14 (1 1999), 229--238."},{"key":"e_1_2_1_22_1","unstructured":"Dario Izzo and Francesco Biscani. 2019. Pagmo (C++) or Pygmo (Python): A scientific library for massively parallel optimization. Retrieved from https:\/\/esa.github.io\/pagmo2\/.  Dario Izzo and Francesco Biscani. 2019. Pagmo (C++) or Pygmo (Python): A scientific library for massively parallel optimization. Retrieved from https:\/\/esa.github.io\/pagmo2\/."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.654"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988497"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2009.07.001"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2009.27"},{"key":"e_1_2_1_28_1","volume-title":"Johnson","author":"Garey Michael R.","year":"1990","unstructured":"Michael R. Garey and David S . Johnson . 1990 . Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman 8 Co., New York, NY. Michael R. Garey and David S. Johnson. 1990. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman 8 Co., New York, NY."},{"key":"e_1_2_1_29_1","unstructured":"GCC 2018. gcov\u2014A Test Coverage Program. Retrieved from https:\/\/gcc.gnu.org\/onlinedocs\/gcc\/Gcov.html.  GCC 2018. gcov\u2014A Test Coverage Program. Retrieved from https:\/\/gcc.gnu.org\/onlinedocs\/gcc\/Gcov.html."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47106-8_3"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPA.2010.62"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOCC.2011.6085105"},{"key":"e_1_2_1_34_1","article-title":"On a bicriterion formulation of the problems of integrated system identification and system optimization","author":"Haimes Yacov Y.","year":"1971","unstructured":"Yacov Y. Haimes , Leon S. Lasdon , and David A. Wismer . 1971 . On a bicriterion formulation of the problems of integrated system identification and system optimization . IEEE Trans. Syst. Man Cybern. SMC-1, 3 ( July 1971), 296--297. DOI:https:\/\/doi.org\/10.1109\/TSMC.1971.4308298 10.1109\/TSMC.1971.4308298 Yacov Y. Haimes, Leon S. Lasdon, and David A. Wismer. 1971. On a bicriterion formulation of the problems of integrated system identification and system optimization. IEEE Trans. Syst. Man Cybern. SMC-1, 3 (July 1971), 296--297. DOI:https:\/\/doi.org\/10.1109\/TSMC.1971.4308298","journal-title":"IEEE Trans. Syst. Man Cybern. SMC-1, 3"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/2337223.2337310"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/152388.152391"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884791"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 20th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201905)","author":"Hennessy Mark","year":"1908","unstructured":"Mark Hennessy and James F. Power . 2005. An analysis of rule coverage as a criterion in generating minimal test suites for grammar-based software . In Proceedings of the 20th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201905) . 104--113. DOI:https:\/\/doi.org\/10.1145\/110 1908 .1101926 10.1145\/1101908.1101926 Mark Hennessy and James F. Power. 2005. An analysis of rule coverage as a criterion in generating minimal test suites for grammar-based software. In Proceedings of the 20th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201905). 104--113. DOI:https:\/\/doi.org\/10.1145\/1101908.1101926"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070541"},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"I. Griva S. G. Nash and A. Sofer. 2009. Linear and Nonlinear Optimization (2nd. ed.). Society for Industrial Mathematics.  I. Griva S. G. Nash and A. Sofer. 2009. Linear and Nonlinear Optimization (2nd. ed.). Society for Industrial Mathematics.","DOI":"10.1137\/1.9780898717730"},{"key":"e_1_2_1_41_1","unstructured":"IBM Inc. 2019. CPLEX Optimizer. Retrieved from https:\/\/www.ibm.com\/analytics\/cplex-optimizer  IBM Inc. 2019. CPLEX Optimizer. Retrieved from https:\/\/www.ibm.com\/analytics\/cplex-optimizer"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568271"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606738"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the Central and East European Conference on Software Engineering Techniques (CEE-SET\u201909)","author":"Khalilian Alireza","year":"2009","unstructured":"Alireza Khalilian and Saeed Parsa . 2009 . Bi-criteria test suite reduction by cluster analysis of execution profiles . In Proceedings of the Central and East European Conference on Software Engineering Techniques (CEE-SET\u201909) . 243--256. DOI:https:\/\/doi.org\/10.1007\/978-3-642-28038-2_19 10.1007\/978-3-642-28038-2_19 Alireza Khalilian and Saeed Parsa. 2009. Bi-criteria test suite reduction by cluster analysis of execution profiles. In Proceedings of the Central and East European Conference on Software Engineering Techniques (CEE-SET\u201909). 243--256. DOI:https:\/\/doi.org\/10.1007\/978-3-642-28038-2_19"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2809600"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2017.08.014"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106288"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3071178.3071189"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321631.1321698"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the International Conference on Software Maintenance. 201--208","author":"Hareton K.","year":"1991","unstructured":"Hareton K. N. Leung and Lee White. 1991. A cost model to compare regression test strategies . In Proceedings of the International Conference on Software Maintenance. 201--208 . DOI:https:\/\/doi.org\/10.1109\/ICSM. 1991 .160330 10.1109\/ICSM.1991.160330 Hareton K. N. Leung and Lee White. 1991. A cost model to compare regression test strategies. In Proceedings of the International Conference on Software Maintenance. 201--208. DOI:https:\/\/doi.org\/10.1109\/ICSM.1991.160330"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-010-0104-x"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201914)","author":"Li Ding","unstructured":"Ding Li , Yuchen Jin , Cagri Sahin , James Clause , and William G. J. Halfond . 2014. Integrated energy-directed test suite optimization . In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201914) . ACM, 339--350. Ding Li, Yuchen Jin, Cagri Sahin, James Clause, and William G. J. Halfond. 2014. Integrated energy-directed test suite optimization. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201914). ACM, 339--350."},{"key":"e_1_2_1_53_1","volume-title":"RAMS optimization principles. Handbook of Safety Principles","author":"Li Yan-Fu","unstructured":"Yan-Fu Li and Enrico Zio . 2017. RAMS optimization principles. Handbook of Safety Principles . Wiley , 514--539. Yan-Fu Li and Enrico Zio. 2017. RAMS optimization principles. Handbook of Safety Principles. Wiley, 514--539."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.11.004"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180174"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/iThings\/CPSCom.2011.135"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177730491"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2510633"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the 8th International Conference on Software Engineering Advances (ICSEA\u201913)","author":"Marchetto Alessandro","year":"2013","unstructured":"Alessandro Marchetto , Md. Mahfuzul Islam , Angelo Susi , and Giuseppe Scanniello . 2013 . A multi-objective technique for test suite reduction . In Proceedings of the 8th International Conference on Software Engineering Advances (ICSEA\u201913) . 18--24. Alessandro Marchetto, Md. Mahfuzul Islam, Angelo Susi, and Giuseppe Scanniello. 2013. A multi-objective technique for test suite reduction. In Proceedings of the 8th International Conference on Software Engineering Advances (ICSEA\u201913). 18--24."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2003.1245299"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1363686.1363715"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180210"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.56"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2729974"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007520"},{"key":"e_1_2_1_66_1","volume-title":"Wolsey","author":"Nemhauser George L.","year":"1988","unstructured":"George L. Nemhauser and Laurence A . Wolsey . 1988 . Integer and Combinatorial Optimization. Wiley-Interscience , New York, NY. George L. Nemhauser and Laurence A. Wolsey. 1988. Integer and Combinatorial Optimization. Wiley-Interscience, New York, NY."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the 12th International Conference on Testing Computer Software. 111--123","author":"Offutt Jefferson","unstructured":"Jefferson Offutt , Jie Pan , and Jeffrey M. Voas . 1995. Procedures for reducing the size of coverage-based test sets . In Proceedings of the 12th International Conference on Testing Computer Software. 111--123 . Jefferson Offutt, Jie Pan, and Jeffrey M. Voas. 1995. Procedures for reducing the size of coverage-based test sets. In Proceedings of the 12th International Conference on Testing Computer Software. 111--123."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2008.10.023"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/PRDC.2005.22"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2485"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2364175"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.103"},{"key":"e_1_2_1_73_1","first-page":"15","article-title":"On the optimization approach towards test suite minimization","volume":"4","author":"Parsa Saeed","year":"2010","unstructured":"Saeed Parsa and Alireza Khalilian . 2010 . On the optimization approach towards test suite minimization . Int. J. Softw. Eng. Appl. 4 , 1 (2010), 15 -- 28 . Saeed Parsa and Alireza Khalilian. 2010. On the optimization approach towards test suite minimization. Int. J. Softw. Eng. Appl. 4, 1 (2010), 15--28.","journal-title":"Int. J. Softw. Eng. Appl."},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 2nd IEEE International Conference on Computer Science and Information Technology. 189--193","author":"Parsa Saeed","year":"2009","unstructured":"Saeed Parsa , Alireza Khalilian , and Y. Fazlalizadeh . 2009. A new algorithm to test suite reduction based on cluster analysis . In Proceedings of the 2nd IEEE International Conference on Computer Science and Information Technology. 189--193 . DOI:https:\/\/doi.org\/10.1109\/ICCSIT. 2009 .5234742 10.1109\/ICCSIT.2009.5234742 Saeed Parsa, Alireza Khalilian, and Y. Fazlalizadeh. 2009. A new algorithm to test suite reduction based on cluster analysis. In Proceedings of the 2nd IEEE International Conference on Computer Science and Information Technology. 189--193. DOI:https:\/\/doi.org\/10.1109\/ICCSIT.2009.5234742"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2554850.2555004"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00054"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLEI.2015.7360024"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.1993.366926"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2018.8477875"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.16"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/1082983.1083255"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486853"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2006.23"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635921"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786878"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the ACM Symposium on Applied Computing (SAC\u201909)","author":"Adam","unstructured":"Adam M. Smith and Gregory M. Kapfhammer. 2009. An empirical study of incorporating cost into test suite reduction and prioritization . In Proceedings of the ACM Symposium on Applied Computing (SAC\u201909) . 461--467. DOI:https:\/\/doi.org\/10.1145\/1529282.1529382 10.1145\/1529282.1529382 Adam M. Smith and Gregory M. Kapfhammer. 2009. An empirical study of incorporating cost into test suite reduction and prioritization. In Proceedings of the ACM Symposium on Applied Computing (SAC\u201909). 461--467. DOI:https:\/\/doi.org\/10.1145\/1529282.1529382"},{"key":"e_1_2_1_87_1","volume-title":"Andreou","author":"Stylianou Constantinos","year":"2014","unstructured":"Constantinos Stylianou and Andreas S . Andreou . 2014 . Human Resource Allocation and Scheduling for Software Project Management. Springer Berlin , 73--106. DOI:https:\/\/doi.org\/10.1007\/978-3-642-55035-5_4 10.1007\/978-3-642-55035-5_4 Constantinos Stylianou and Andreas S. Andreou. 2014. Human Resource Allocation and Scheduling for Software Project Management. Springer Berlin, 73--106. DOI:https:\/\/doi.org\/10.1007\/978-3-642-55035-5_4"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/1108792.1108802"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2007.10.017"},{"key":"e_1_2_1_90_1","volume-title":"Proceedings of the Software Product Lines Conference Workshops (SPLC\u201910)","author":"van den Broek Pim","year":"2010","unstructured":"Pim van den Broek . 2010 . Optimization of product instantiation using integer programming . In Proceedings of the Software Product Lines Conference Workshops (SPLC\u201910) . Lancaster University, 107--112. Pim van den Broek. 2010. Optimization of product instantiation using integer programming. In Proceedings of the Software Product Lines Conference Workshops (SPLC\u201910). Lancaster University, 107--112."},{"key":"e_1_2_1_91_1","volume-title":"Proceedings of the International Conference of Electronics, Communication and Aerospace Technology (ICECA\u201917)","volume":"1","author":"Ajmer Singh Vandana","year":"2017","unstructured":"Vandana and Ajmer Singh . 2017 . Multi-objective test case minimization using evolutionary algorithms: A review . In Proceedings of the International Conference of Electronics, Communication and Aerospace Technology (ICECA\u201917) , Vol. 1 . 329--334. DOI:https:\/\/doi.org\/10.1109\/ICECA.2017.8203698 10.1109\/ICECA.2017.8203698 Vandana and Ajmer Singh. 2017. Multi-objective test case minimization using evolutionary algorithms: A review. In Proceedings of the International Conference of Electronics, Communication and Aerospace Technology (ICECA\u201917), Vol. 1. 329--334. DOI:https:\/\/doi.org\/10.1109\/ICECA.2017.8203698"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.03.008"},{"key":"e_1_2_1_93_1","volume-title":"Proceedings of the 25th International Computer Software and Applications Conference (COMPSAC\u201901)","author":"Sergiy","year":"2001","unstructured":"Sergiy A. Vilkomir and Jonathan P. Bowen. 2001. Formalization of software testing criteria using the Z notation . In Proceedings of the 25th International Computer Software and Applications Conference (COMPSAC\u201901) . 351--356. DOI:https:\/\/doi.org\/10.1109\/CMPSAC. 2001 .960638 10.1109\/CMPSAC.2001.960638 Sergiy A. Vilkomir and Jonathan P. Bowen. 2001. Formalization of software testing criteria using the Z notation. In Proceedings of the 25th International Computer Software and Applications Conference (COMPSAC\u201901). 351--356. DOI:https:\/\/doi.org\/10.1109\/CMPSAC.2001.960638"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884880"},{"key":"e_1_2_1_95_1","volume-title":"Integer Programming","author":"Wolsey Laurence A.","unstructured":"Laurence A. Wolsey . 1998. Integer Programming . Wiley-Interscience , New York, NY . Laurence A. Wolsey. 1998. Integer Programming. Wiley-Interscience, New York, NY."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.1997.630875"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(99)00048-5"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180257"},{"key":"e_1_2_1_99_1","unstructured":"Yinxing Xue 2018. IP-Method for Multi-objective Optimization in SPL. Retrieved from https:\/\/sites.google.com\/view\/ip-method-repsol\/.  Yinxing Xue 2018. IP-Method for Multi-objective Optimization in SPL. Retrieved from https:\/\/sites.google.com\/view\/ip-method-repsol\/."},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.11.706"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1002\/stv.430"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23716-4_20"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2610392"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/1572272.1572297"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.892759"},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201907)","author":"Zhang Yuanyuan","unstructured":"Yuanyuan Zhang , Mark Harman , and S. Afshin Mansouri . 2007. The multi-objective next release problem . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201907) . 1129--1137. DOI:https:\/\/doi.org\/10.1145\/1276958.1277179 10.1145\/1276958.1277179 Yuanyuan Zhang, Mark Harman, and S. Afshin Mansouri. 2007. The multi-objective next release problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201907). 1129--1137. DOI:https:\/\/doi.org\/10.1145\/1276958.1277179"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196831"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSAE.2011.5952443"},{"key":"e_1_2_1_109_1","volume-title":"Multi-objective optimisation for regression testing. Inf. Sci. 334\u2013335","author":"Zheng Wei","year":"2016","unstructured":"Wei Zheng , Robert M. Hierons , Miqing Li , Xiaohui Liu , and Veronica Vinciotti . 2016. Multi-objective optimisation for regression testing. Inf. Sci. 334\u2013335 ( 2016 ), 1--16. DOI:https:\/\/doi.org\/10.1016\/j.ins.2015.11.027 10.1016\/j.ins.2015.11.027 Wei Zheng, Robert M. Hierons, Miqing Li, Xiaohui Liu, and Veronica Vinciotti. 2016. Multi-objective optimisation for regression testing. Inf. Sci. 334\u2013335 (2016), 1--16. DOI:https:\/\/doi.org\/10.1016\/j.ins.2015.11.027"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-sen.2018.5133"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.797969"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3392031","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3392031","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:48Z","timestamp":1750199928000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3392031"}},"subtitle":["Towards Sound and Complete Solutions of a Particular Search-based Software-engineering Problem"],"short-title":[],"issued":{"date-parts":[[2020,6]]},"references-count":110,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,7,31]]}},"alternative-id":["10.1145\/3392031"],"URL":"https:\/\/doi.org\/10.1145\/3392031","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6]]},"assertion":[{"value":"2019-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}