{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T03:50:37Z","timestamp":1760586637422,"version":"3.41.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2012,11,27]],"date-time":"2012-11-27T00:00:00Z","timestamp":1353974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2012,11,27]]},"abstract":"<jats:p>The software product line engineering strategy enables the achievement of significant improvements in quality through reuse of carefully crafted software assets across multiple products. However, high levels of quality in the software product line assets, which are used to create products, must be accompanied by effective and efficient test strategies for the products in the software product line. The goal of this study is to understand which strategies for testing products in software product lines have been reported in the literature, enabling discussions on the significant issues, and also pointing out further research directions. A systematic literature review was carried out that identified two hundred seventy-three papers, published from the years 1998 and early in 2012. From such a set of papers, a systematic selection resulted in forty-one relevant papers. The analysis of the reported strategies comprised two important aspects: the selection of products for testing, and the actual test of products. The findings showed a range of strategies, dealing with both aspects, but few empirical evaluations of their effectiveness have been performed, which limits the inferences that can be drawn.<\/jats:p>","DOI":"10.1145\/2382756.2382783","type":"journal-article","created":{"date-parts":[[2012,11,29]],"date-time":"2012-11-29T15:02:27Z","timestamp":1354201347000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Strategies for testing products in software product lines"],"prefix":"10.1145","volume":"37","author":[{"given":"Ivan","family":"do Carmo Machado","sequence":"first","affiliation":[{"name":"Federal University of Bahia, Salvador, BA, Brazil"}]},{"given":"John D.","family":"McGregor","sequence":"additional","affiliation":[{"name":"School of Computing Clemson University, Clemson, SC, USA"}]},{"given":"Eduardo","family":"Santana de Almeida","sequence":"additional","affiliation":[{"name":"Federal University of Bahia, Salvador, BA, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2012,11,27]]},"reference":[{"issue":"5","key":"e_1_2_1_1_1","first-page":"11","article-title":"Testing software assets of framework-based product families during application engineering stage","volume":"3","author":"Al-Dallal J.","year":"2008","unstructured":"J. Al-Dallal and P. G. Sorenson . Testing software assets of framework-based product families during application engineering stage . Journal of Software , 3 ( 5 ): 11 -- 25 , 2008 . J. Al-Dallal and P. G. Sorenson. Testing software assets of framework-based product families during application engineering stage. Journal of Software, 3(5):11--25, 2008.","journal-title":"Journal of Software"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-33253-4_11"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2012.146"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1885639.1885662"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2050655.2050698"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bushor.2011.12.001"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.05.011"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1414004.1414011"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITNG.2011.58"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-27799-6_4"},{"key":"e_1_2_1_11_1","first-page":"81","volume-title":"11th International Conference on Software Product Lines, SPLC","author":"Gustafsson T.","year":"2007","unstructured":"T. Gustafsson . An approach for selecting software product line instances for testing . In 11th International Conference on Software Product Lines, SPLC , pages 81 -- 86 , Tokyo, Japan , 2007 . T. Gustafsson. An approach for selecting software product line instances for testing. In 11th International Conference on Software Product Lines, SPLC, pages 81--86, Tokyo, Japan, 2007."},{"key":"e_1_2_1_12_1","first-page":"58","volume-title":"Proc. of the Intl. Workshop on Software Product Line Testing, SPLiT","author":"Hartmann J.","year":"2004","unstructured":"J. Hartmann , M. Vieira , and A. Ruder . A UML-based approach for validating product lines . In Proc. of the Intl. Workshop on Software Product Line Testing, SPLiT , pages 58 -- 65 , Boston, MA, USA , 2004 . J. Hartmann, M. Vieira, and A. Ruder. A UML-based approach for validating product lines. In Proc. of the Intl. Workshop on Software Product Line Testing, SPLiT, pages 58--65, Boston, MA, USA, 2004."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2011.31"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2050655.2050721"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEFM.2008.38"},{"key":"e_1_2_1_16_1","first-page":"6","volume-title":"Proc. of 5th Intl. Workshop Software Product-Family Engineering, PFE","author":"Kamsties E.","year":"2003","unstructured":"E. Kamsties , K. Pohl , S. Reis , and A. Reuys . Testing variabilities in use case models . In Proc. of 5th Intl. Workshop Software Product-Family Engineering, PFE , pages 6 -- 18 , Siena, Italy , 2003 . Springer. E. Kamsties, K. Pohl, S. Reis, and A. Reuys. Testing variabilities in use case models. In Proc. of 5th Intl. Workshop Software Product-Family Engineering, PFE, pages 6--18, Siena, Italy, 2003. Springer."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1960275.1960284"},{"key":"e_1_2_1_19_1","first-page":"81","volume-title":"Proceedings of the 7th Conference on Quality Engineering in Software Technology, CONQUEST","author":"Kolb R.","year":"2003","unstructured":"R. Kolb and D. Muthig . Challenges in testing software product lines . In Proceedings of the 7th Conference on Quality Engineering in Software Technology, CONQUEST , pages 81 -- 95 . Fraunhofer Publica , 2003 . R. Kolb and D. Muthig. Challenges in testing software product lines. In Proceedings of the 7th Conference on Quality Engineering in Software Technology, CONQUEST, pages 81--95. Fraunhofer Publica, 2003."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2009.5306324"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1928028.1928037"},{"key":"e_1_2_1_22_1","first-page":"23","volume-title":"Proc. of the 4th International Conference on Software and Data Technologies, ICSOFT","author":"Lamancha B. P.","year":"2009","unstructured":"B. P. Lamancha , M. P. Usaola , and M. P. Velthius . Software product line testing - a systematic review . In Proc. of the 4th International Conference on Software and Data Technologies, ICSOFT , pages 23 -- 30 , Soa, Bulgaria , 2009 . INSTICC Press. B. P. Lamancha, M. P. Usaola, and M. P. Velthius. Software product line testing - a systematic review. In Proc. of the 4th International Conference on Software and Data Technologies, ICSOFT, pages 23--30, Soa, Bulgaria, 2009. INSTICC Press."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/645547.658853"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-011-9165-4"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5220\/0001983101240130"},{"key":"e_1_2_1_26_1","volume-title":"Technical Report TR-022","author":"McGregor J. D.","year":"2001","unstructured":"J. D. McGregor . Testing a software product line. Technical Report TR-022 , CMU Software Engineering Institute , 2001 . J. D. McGregor. Testing a software product line. Technical Report TR-022, CMU Software Engineering Institute, 2001."},{"key":"e_1_2_1_27_1","first-page":"243","volume-title":"15th International Workshop on Concurrency, Specification and Programming, CS&P","author":"Mishra S.","year":"2006","unstructured":"S. Mishra . Specification based software product line testing: A case study . In 15th International Workshop on Concurrency, Specification and Programming, CS&P , pages 243 -- 254 , Wandlitz, Germany , 2006 . S. Mishra. Specification based software product line testing: A case study. In 15th International Workshop on Concurrency, Specification and Programming, CS&P, pages 243--254, Wandlitz, Germany, 2006."},{"key":"e_1_2_1_28_1","first-page":"1","volume-title":"7th International Conference on Informatics and Systems, INFOS","author":"Mohamed Ali M.","year":"2010","unstructured":"M. Mohamed Ali and R. Moawad . An approach for requirements based software product line testing . In 7th International Conference on Informatics and Systems, INFOS , pages 1 -- 10 , Cairo, Egypt , 2010 . M. Mohamed Ali and R. Moawad. An approach for requirements based software product line testing. In 7th International Conference on Informatics and Systems, INFOS, pages 1--10, Cairo, Egypt, 2010."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2003.1240317"},{"key":"e_1_2_1_30_1","first-page":"51","volume-title":"Proceedings of the Workshop on Requirements Engineering for Product Lines, REPL","author":"Nebut C.","year":"2002","unstructured":"C. Nebut , S. Pickin , Y. L. Traon , and J. M. J\u00e9z\u00e9quel . Reusable test requirements for uml-modeled product lines . In Proceedings of the Workshop on Requirements Engineering for Product Lines, REPL , pages 51 -- 56 , Essen, Germany , 2002 . Avaya Labs. C. Nebut, S. Pickin, Y. L. Traon, and J. M. J\u00e9z\u00e9quel. Reusable test requirements for uml-modeled product lines. In Proceedings of the Workshop on Requirements Engineering for Product Lines, REPL, pages 51--56, Essen, Germany, 2002. Avaya Labs."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-33253-4_12"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.12.003"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083274.1083279"},{"key":"e_1_2_1_34_1","first-page":"17","volume-title":"Proc. of the 3rd International Workshop on Software Product Line Testing, SPLiT","author":"Olimpiew E. M.","year":"2006","unstructured":"E. M. Olimpiew and H. Gomaa . Customizable requirements-based test models for software product lines . In Proc. of the 3rd International Workshop on Software Product Line Testing, SPLiT , pages 17 -- 22 , Baltimore, USA , 2006 . E. M. Olimpiew and H. Gomaa. Customizable requirements-based test models for software product lines. In Proc. of the 3rd International Workshop on Software Product Line Testing, SPLiT, pages 17--22, Baltimore, USA, 2006."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04211-9_8"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/1885639.1885658"},{"key":"e_1_2_1_37_1","first-page":"48","volume-title":"Fakult\u00e4t Informatik","author":"Oster S.","year":"2008","unstructured":"S. Oster , A. Sch\u00fcrr , and I. Weisem\u00f6ller . Towards software product line testing using story driven modeling . Fakult\u00e4t Informatik , pages 48 -- 51 , 2008 . S. Oster, A. Sch\u00fcrr, and I. Weisem\u00f6ller. Towards software product line testing using story driven modeling. Fakult\u00e4t Informatik, pages 48--51, 2008."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019136.2019143"},{"key":"e_1_2_1_39_1","first-page":"193","volume-title":"Proc. of the 5th Intl. Conference on Evaluation of Novel Approaches to Software Engineering","author":"Lamancha B. Perez","year":"2010","unstructured":"B. Perez Lamancha , M. Polo Usaola , and M. Piattini Velthius . A model based testing approach for model-driven development and software product lines . In Proc. of the 5th Intl. Conference on Evaluation of Novel Approaches to Software Engineering , pages 193 -- 208 , Athens, Greece , 2010 . B. Perez Lamancha, M. Polo Usaola, and M. Piattini Velthius. A model based testing approach for model-driven development and software product lines. In Proc. of the 5th Intl. Conference on Evaluation of Novel Approaches to Software Engineering, pages 193--208, Athens, Greece, 2010."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2010.43"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/2227115.2227123"},{"key":"e_1_2_1_42_1","first-page":"5","volume-title":"Proc. of the 3rd Intl. Workshop on Software Product Line Testing, SPLiT","author":"Reis A. P. K.","year":"2006","unstructured":"A. P. K. Reis , S.; Metzger. A reuse technique for performance testing of software product lines . In Proc. of the 3rd Intl. Workshop on Software Product Line Testing, SPLiT , pages 5 -- 10 , Baltimore, USA , 2006 . A. P. K. Reis, S.; Metzger. A reuse technique for performance testing of software product lines. In Proc. of the 3rd Intl. Workshop on Software Product Line Testing, SPLiT, pages 5--10, Baltimore, USA, 2006."},{"key":"e_1_2_1_43_1","first-page":"35","volume-title":"Proc. of the International Workshop on Product Line Engineering, PLEES","author":"Reuys A.","year":"2003","unstructured":"A. Reuys , S. Reis , E. Kamsties , and K. Pohl . Derivation of domain test scenarios from activity diagrams . In Proc. of the International Workshop on Product Line Engineering, PLEES , pages 35 -- 42 , Erfut, Germany , 2003 . Fraunhofer IESE. A. Reuys, S. Reis, E. Kamsties, and K. Pohl. Derivation of domain test scenarios from activity diagrams. In Proc. of the International Workshop on Product Line Engineering, PLEES, pages 35--42, Erfut, Germany, 2003. Fraunhofer IESE."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-33253-4_13"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2010.65"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/1158337.1158681"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2110147.2110155"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2010.11.002"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28872-2_19"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1885639.1885661"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/979743.979766"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.30"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2382756.2382783","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2382756.2382783","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:34:54Z","timestamp":1750239294000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2382756.2382783"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,11,27]]},"references-count":51,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2012,11,27]]}},"alternative-id":["10.1145\/2382756.2382783"],"URL":"https:\/\/doi.org\/10.1145\/2382756.2382783","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2012,11,27]]},"assertion":[{"value":"2012-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}