{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T02:54:00Z","timestamp":1777949640805,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Autom Softw Eng"],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Testing software product lines represents a challenging task mainly because there are many derivable products. To facilitate this issue, multiple solutions were developed to reduce the number of products that are tested while maintaining a good percentage of coverage. However, the order of testing products has received little consideration. The purpose of this research is twofold: first, to replicate the results of a previous study (which uses two specific metrics for prioritization, namely, Variability Coverage &amp; Cyclomatic Complexity - VC&amp;CC, and Coefficient of Connectivity-Density - CoC), and second, to investigate two new metrics to be used as prioritization criteria (Ratio of Variability - RoV, and Flexibility of Configuration - FoC). The APFD (Average Percentage of Faults Detected) metric is used to evaluate the results obtained. In the investigation, a set of 9 feature models with various numbers of features, grouped in three intervals, was used. The results show that the original findings are confirmed for all feature models used. Regarding the new criteria used, FoC and RoV outperformed the CoC metric in 6 out of 9 cases, and also obtained the best results in 3 out of 9 cases. In the other 6 out of 9 cases the VC&amp;CC criterion obtained the best results.<\/jats:p>","DOI":"10.1007\/s10515-026-00619-8","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T03:28:12Z","timestamp":1777865292000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["New criteria for test case prioritization for software product lines. A replication and extension study"],"prefix":"10.1007","volume":"33","author":[{"given":"Andrada Georgia","family":"Tiutin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreea","family":"Vescan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,5,4]]},"reference":[{"key":"619_CR1","unstructured":"Andreea\u00a0Vescan, A.G.T.: New Criteria for Test Case Prioritization for Software Product Lines. A Replication and Extension Study. https:\/\/figshare.com\/s\/6410b7346d0566d31b39. Accessed October 2025"},{"issue":"3","key":"619_CR2","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1007\/s11219-010-9127-2","volume":"19","author":"E Bagheri","year":"2011","unstructured":"Bagheri, E., Gasevic, D.: Assessing the maintainability of software product line feature models using structural metrics. Software Qual. J. 19(3), 579\u2013612 (2011). https:\/\/doi.org\/10.1007\/s11219-010-9127-2","journal-title":"Software Qual. J."},{"issue":"6","key":"619_CR3","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1109\/32.6156","volume":"14","author":"VR Basili","year":"1988","unstructured":"Basili, V.R., Rombach, H.D.: The tame project: towards improvement-oriented software environments. IEEE Trans. Software Eng. 14(6), 758\u2013773 (1988). https:\/\/doi.org\/10.1109\/32.6156","journal-title":"IEEE Trans. Software Eng."},{"key":"619_CR4","doi-asserted-by":"publisher","unstructured":"Berger, T., Guo, J.: Towards system analysis with variability model metrics. In: Proceedings of the 8th International Workshop on Variability Modelling of Software-Intensive Systems. VaMoS \u201914. Association for Computing Machinery, New York, NY, USA (2014). https:\/\/doi.org\/10.1145\/2556624.2556641","DOI":"10.1145\/2556624.2556641"},{"key":"619_CR5","doi-asserted-by":"publisher","unstructured":"Biletskiy, Y., Gasevic, D., Asadi, M., Bagheri, E., Ensan, A.: Goal-oriented test case selection and prioritization for product line feature models. In: 2011 8th International Conference on Information Technology: New Generations, pp. 291\u2013298 (2011). https:\/\/doi.org\/10.1109\/ITNG.2011.58","DOI":"10.1109\/ITNG.2011.58"},{"key":"619_CR6","unstructured":"Carver, J.C.: Towards reporting guidelines for experimental replications: A proposal. In: The International Workshop on Replication in Empirical Software Engineering, pp. 2\u20135 (2010)"},{"issue":"2","key":"619_CR7","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1007\/s10664-013-9290-8","volume":"19","author":"JC Carver","year":"2014","unstructured":"Carver, J.C., Juristo, N., Baldassarre, M.T., Vegas, S.: Replications of software engineering experiments. Empir. Softw. Eng. 19(2), 267\u2013276 (2014). https:\/\/doi.org\/10.1007\/s10664-013-9290-8","journal-title":"Empir. Softw. Eng."},{"key":"619_CR8","unstructured":"Cohen, J.: Statistical Power Analyses for the Behavioral Sciences. Lawrence Erlbaum Associates, New York (1988)"},{"key":"619_CR9","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.swevo.2011.02.002","volume":"1","author":"J Derrac","year":"2011","unstructured":"Derrac, J., Garcia, S., Molina, D., Herrera, F.: A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 1, 3\u201318 (2011)","journal-title":"Swarm Evol. Comput."},{"issue":"1","key":"619_CR10","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/MS.2005.6","volume":"22","author":"T Dyba","year":"2005","unstructured":"Dyba, T., Kitchenham, B.A., Jorgensen, M.: Evidence-based software engineering for practitioners. IEEE Softw. 22(1), 58\u201365 (2005). https:\/\/doi.org\/10.1109\/MS.2005.6","journal-title":"IEEE Softw."},{"key":"619_CR11","doi-asserted-by":"publisher","unstructured":"Elbaum, S., Rothermel, G., Penix, J.: Techniques for improving regression testing in continuous integration development environments. In: Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. FSE 2014, pp. 235\u2013245. Association for Computing Machinery, New York, NY, USA (2014). https:\/\/doi.org\/10.1145\/2635868.2635910","DOI":"10.1145\/2635868.2635910"},{"key":"619_CR12","unstructured":"El-Sharkawy, S., Yamagishi-Eichler, N., Schmid, K.: Implementation metrics for software product lines a systematic literature review. Technical Report Report No. 1\/2017, SSE 1\/17\/E ISSN 0941-3014, Software Systems Engineering,Institut f\u00fcr Informatik, Universit\u00e4t Hildesheim (2017)"},{"key":"619_CR13","first-page":"613","volume-title":"Advanced Information Systems Engineering","author":"F Ensan","year":"2012","unstructured":"Ensan, F., Bagheri, E., Ga\u0161evi\u0107, D.: Evolutionary search-based test generation for software product line feature models. In: Ralyt\u00e9, J., Franch, X., Brinkkemper, S., Wrycza, S. (eds.) Advanced Information Systems Engineering, pp. 613\u2013628. Springer, Berlin, Heidelberg (2012)"},{"key":"619_CR14","doi-asserted-by":"publisher","unstructured":"Fagerholm, F., Becker, C., Chatzigeorgiou, A., Betz, S., Duboc, L., Penzenstadler, B., Mohanani, R., Venters, C.C.: Temporal discounting in software engineering: A replication study. In: 13th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 1\u201312. IEEE, (2019). https:\/\/doi.org\/10.1109\/ESEM.2019.8870161","DOI":"10.1109\/ESEM.2019.8870161"},{"issue":"8","key":"619_CR15","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1016\/j.infsof.2014.04.004","volume":"56","author":"OS G\u00f3mez","year":"2014","unstructured":"G\u00f3mez, O.S., Juristo, N., Vegas, S.: Understanding replication of experiments in software engineering: A classification. Inf. Softw. Technol. 56(8), 1033\u20131048 (2014). https:\/\/doi.org\/10.1016\/j.infsof.2014.04.004","journal-title":"Inf. Softw. Technol."},{"issue":"2","key":"619_CR16","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1145\/367008.367020","volume":"10","author":"TL Graves","year":"2001","unstructured":"Graves, T.L., Harrold, M.J., Kim, J.-M., Porter, A., Rothermel, G.: An empirical study of regression test selection techniques. ACM Trans. Softw. Eng. Methodol. 10(2), 184\u2013208 (2001). https:\/\/doi.org\/10.1145\/367008.367020","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"issue":"7","key":"619_CR17","doi-asserted-by":"publisher","first-page":"650","DOI":"10.1109\/TSE.2014.2327020","volume":"40","author":"C Henard","year":"2014","unstructured":"Henard, C., Papadakis, M., Perrouin, G., Klein, J., Heymans, P., Le Traon, Y.: Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans. Software Eng. 40(7), 650\u2013670 (2014). https:\/\/doi.org\/10.1109\/TSE.2014.2327020","journal-title":"IEEE Trans. Software Eng."},{"key":"619_CR18","doi-asserted-by":"publisher","unstructured":"Hierons, R.M., Li, M., Liu, X., Parejo, J.A., Segura, S., Yao, X.: Many-objective test suite generation for software product lines. 29(1) (2020) https:\/\/doi.org\/10.1145\/3361146","DOI":"10.1145\/3361146"},{"key":"619_CR19","unstructured":"Kitchenham, B.: Procedures for performing systematic reviews. Keele, UK, Keele Univ. 33 (2004)"},{"issue":"6","key":"619_CR20","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1109\/TSE.2004.24","volume":"30","author":"DR Kuhn","year":"2004","unstructured":"Kuhn, D.R., Wallace, D.R., Gallo, A.M.: Software fault interactions and implications for software testing. IEEE Trans. Software Eng. 30(6), 418\u2013421 (2004). https:\/\/doi.org\/10.1109\/TSE.2004.24","journal-title":"IEEE Trans. Software Eng."},{"key":"619_CR21","doi-asserted-by":"publisher","unstructured":"Kwon, J.-H., Ko, I.-Y., Rothermel, G., Staats, M.: Test case prioritization based on information retrieval concepts. In: 2014 21st Asia-Pacific Software Engineering Conference, vol. 1, pp. 19\u201326 (2014). https:\/\/doi.org\/10.1109\/APSEC.2014.12","DOI":"10.1109\/APSEC.2014.12"},{"key":"619_CR22","doi-asserted-by":"publisher","unstructured":"Lopez-Herrejon, R.E., Chicano, F., Ferrer, J., Egyed, A., Alba, E.: Multi-objective optimal test suite computation for software product line pairwise testing. In: 2013 IEEE International Conference on Software Maintenance, pp. 404\u2013407 (2013). https:\/\/doi.org\/10.1109\/ICSM.2013.58","DOI":"10.1109\/ICSM.2013.58"},{"key":"619_CR23","doi-asserted-by":"publisher","unstructured":"Ma\u00e2zoun, J., Bouassida, N., Ben-Abdallah, H.: Change impact analysis for software product lines. Journal of King Saud University - Computer and Information Sciences. 28(4), 364\u2013380 (2016). https:\/\/doi.org\/10.1016\/j.jksuci.2016.01.005","DOI":"10.1016\/j.jksuci.2016.01.005"},{"key":"619_CR24","doi-asserted-by":"publisher","unstructured":"Mefteh, M., Bouassida, N., Ben-Abdallah, H.: Implementation and evaluation of an approach for extracting feature models from documented uml use case diagrams. In: Proceedings of the 30th Annual ACM Symposium on Applied Computing. SAC \u201915, pp. 1602\u20131609. Association for Computing Machinery, New York, NY, USA (2015). https:\/\/doi.org\/10.1145\/2695664.2695907","DOI":"10.1145\/2695664.2695907"},{"key":"619_CR25","doi-asserted-by":"publisher","unstructured":"Mendon\u00e7a, W.D.F., Assun\u00e7\u00e3o, W.K.G., Vergilio, S.R.: Feature-oriented test case selection and prioritization during the evolution of highly-configurable systems. J. Syst. Softw. 217, 112157 (2024). https:\/\/doi.org\/10.1016\/j.jss.2024.112157","DOI":"10.1016\/j.jss.2024.112157"},{"key":"619_CR26","doi-asserted-by":"publisher","unstructured":"Mendonca, M., Branco, M., Cowan, D.: S.p.l.o.t.: software product lines online tools. In: Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications. OOPSLA \u201909, pp. 761\u2013762. Association for Computing Machinery, New York, NY, USA (2009). https:\/\/doi.org\/10.1145\/1639950.1640002","DOI":"10.1145\/1639950.1640002"},{"issue":"4","key":"619_CR27","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1007\/s11219-023-09650-4","volume":"31","author":"NM Minhas","year":"2023","unstructured":"Minhas, N.M., Irshad, M., Petersen, K., B\u00f6rstler, J.: Lessons learned from replicating a study on information-retrieval-based test case prioritization. Software Qual. J. 31(4), 1527\u20131559 (2023). https:\/\/doi.org\/10.1007\/s11219-023-09650-4","journal-title":"Software Qual. J."},{"key":"619_CR28","doi-asserted-by":"publisher","unstructured":"Ne\u0161i\u0107, D., Kr\u00fcger, J., St\u0103nciulescu, u., Berger, T.: Principles of feature modeling. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC\/FSE 2019, pp. 62\u201373. Association for Computing Machinery, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3338906.3338974","DOI":"10.1145\/3338906.3338974"},{"issue":"1","key":"619_CR29","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1109\/62.653787","volume":"13","author":"AJ Offutt","year":"1998","unstructured":"Offutt, A.J.: Software testing: from theory to practice. IEEE Aerosp. Electron. Syst. Mag. 13(1), 3\u20136 (1998). https:\/\/doi.org\/10.1109\/62.653787","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"619_CR30","unstructured":"Pradeepa, R., Devi, K.V.: Effectiveness of testcase prioritization using apfd metric: Survey. In: International Conference on Research Trends in Computer Technologies 2013, pp. 1\u20134 (2013). https:\/\/www.ijcaonline.org\/proceedings\/icrtct\/number1\/10799-1001\/"},{"key":"619_CR31","doi-asserted-by":"publisher","unstructured":"S\u00e1nchez, A.B., Ruiz-Cort\u00e9s, A., Segura, S.: A comparison of test case prioritization criteria for software product lines. In: 2014 IEEE 7th International Conference on Software Testing, Verification and Validation, pp. 41\u201350 (2014). https:\/\/doi.org\/10.1109\/ICST.2014.15","DOI":"10.1109\/ICST.2014.15"},{"key":"619_CR32","unstructured":"Schmid, K., Yamagishi-Eichler, N., El-Sharkawy, S.: Implementation Metrics for Software Product Lines: A Systematic Literature Review. Report No. 1\/2017, SSE 1\/17\/E ISSN 0941-3014 (2018). https:\/\/sse.uni-hildesheim.de\/media\/fb4\/informatik\/AG_SSE\/PDFs\/publications\/SPL-Metrics\/TR-SPL-Metrics_V1.pdf"},{"key":"619_CR33","doi-asserted-by":"publisher","unstructured":"Segura, S., Galindo, J.A., Benavides, D., Parejo, J.A., Ruiz-Cort\u00e9s, A.: Betty: benchmarking and testing on the automated analysis of feature models. In: Proceedings of the 6th International Workshop on Variability Modeling of Software-Intensive Systems. VaMoS \u201912, pp. 63\u201371. Association for Computing Machinery, New York, NY, USA (2012). https:\/\/doi.org\/10.1145\/2110147.2110155","DOI":"10.1145\/2110147.2110155"},{"key":"619_CR34","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.infsof.2018.03.007","volume":"99","author":"M Shepperd","year":"2018","unstructured":"Shepperd, M., Ajienka, N., Counsell, S.: The role and value of replication in empirical software engineering results. Inf. Softw. Technol. 99, 164\u2013176 (2018). https:\/\/doi.org\/10.1016\/j.infsof.2018.03.007","journal-title":"Inf. Softw. Technol."},{"key":"619_CR35","unstructured":"Tiutin, A.: Test case prioritization in software product lines. Master\u2019s thesis, Babes-Bolyai University, Dept. of Computer Science (2024). https:\/\/www.bcucluj.ro\/en"},{"key":"619_CR36","doi-asserted-by":"publisher","unstructured":"Xiang, Y., Huang, H., Li, S., Li, M., Luo, C., Yang, X.: Automated test suite generation for software product lines based on quality-diversity optimization. ACM Trans. Softw. Eng. Methodol. 33(2) (2023) https:\/\/doi.org\/10.1145\/3628158","DOI":"10.1145\/3628158"},{"key":"619_CR37","doi-asserted-by":"publisher","unstructured":"Xiang, Y., Huang, H., Li, S., Li, M., Luo, C., Yang, X.: Automated test suite generation for software product lines based on quality-diversity optimization. ACM Trans. Softw. Eng. Methodol. 33(2) (2023) https:\/\/doi.org\/10.1145\/3628158","DOI":"10.1145\/3628158"},{"key":"619_CR38","unstructured":"Yin, R.K.: Case Study Research: Design and Methods, p. 282. Thousand Oaks, CA, SAGE (2008)"}],"container-title":["Automated Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00619-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10515-026-00619-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00619-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T03:28:13Z","timestamp":1777865293000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10515-026-00619-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,4]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,11]]}},"alternative-id":["619"],"URL":"https:\/\/doi.org\/10.1007\/s10515-026-00619-8","relation":{},"ISSN":["0928-8910","1573-7535"],"issn-type":[{"value":"0928-8910","type":"print"},{"value":"1573-7535","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,4]]},"assertion":[{"value":"10 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Author Andreea Vescan declares that she has no conflict of interest. Author Andrada Tiutin declares that she has no conflict of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"71"}}