{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T03:12:03Z","timestamp":1779333123620,"version":"3.51.4"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T00:00:00Z","timestamp":1779321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universidad de Cadiz"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Autom Softw Eng"],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Predictive Mutation Testing (PMT) has emerged as a promising technique for reducing the high computational cost of traditional mutation testing. This is achieved by using predictive models to estimate mutant behavior without actually requiring their execution. However, despite its growing interest, PMT is still a young and evolving field and, therefore, its experimental studies remain particularly vulnerable to various methodological threats that may compromise the validity, comparability, and reproducibility of results. This paper aims to identify and examine key methodological threats in prior PMT studies that not only affect their validity, but may also limit the technique\u2019s ability to reach its full predictive potential. For each of the eight identified threats, spanning the main stages of the PMT workflow, we describe its nature, analyze how it has been addressed (or overlooked) in previous work, and offer a validation list of recommended practices. We further conduct an empirical validation to substantiate the impact of these threats. In addition, based on the gaps identified in this analysis, we outline several open challenges that remain unexplored in the field, such as the lack of standardization in dataset sharing, the prevalence of Java-centric studies with method-level operators, and the challenges posed by class imbalance and project heterogeneity. This work contributes to strengthening the methodological soundness of PMT research, promoting more meaningful cross-study comparisons, and encouraging the adoption of practices that foster reproducibility, scalability, and real-world applicability.<\/jats:p>","DOI":"10.1007\/s10515-026-00626-9","type":"journal-article","created":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T02:14:45Z","timestamp":1779329685000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Methodological pitfalls in predictive mutation testing: threats, impact and open challenges"],"prefix":"10.1007","volume":"33","author":[{"given":"Pedro","family":"Delgado-P\u00e9rez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sara","family":"Balderas-D\u00edaz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inmaculada","family":"Medina-Bulo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel","family":"Guerrero-Contreras","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,5,21]]},"reference":[{"issue":"7","key":"626_CR1","doi-asserted-by":"publisher","first-page":"e1784","DOI":"10.1002\/stvr.1784","volume":"31","author":"A Aghamohammadi","year":"2021","unstructured":"Aghamohammadi, A., Mirian-Hosseinabadi, S.H.: An ensemble-based predictive mutation testing approach that considers impact of unreached mutants. Softw. Test. Verif. Reliab. 31(7), e1784 (2021). https:\/\/doi.org\/10.1002\/stvr.1784","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"1","key":"626_CR2","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s10515-025-00551-3","volume":"33","author":"M Alharbi","year":"2026","unstructured":"Alharbi, M., Alshayeb, M.: Automatic code generation techniques: A systematic literature review. Autom. Softw. Eng. 33(1), 4 (2026). https:\/\/doi.org\/10.1007\/s10515-025-00551-3","journal-title":"Autom. Softw. Eng."},{"key":"626_CR3","doi-asserted-by":"crossref","unstructured":"Balderas-D\u00edaz, S., Guerrero-Contreras, G., Delgado-P\u00e9rez, P., Medina-Bulo, I.: An analysis of class imbalance challenges in Predictive Mutation Testing. In: Nguyen, N.T., Matsuo, T., Gaol, F.L., Manolopoulos, Y., Fujita, H., Hong, T.P., et\u00a0al. (eds.) Intelligent Information and Database Systems Singapore, pp. 319\u2013331. Springer Nature Singapore (2025)","DOI":"10.1007\/978-981-96-6005-6_23"},{"key":"626_CR4","doi-asserted-by":"crossref","unstructured":"Beller, M., Wong, C., Bader, J., Scott, A., Machalica, M., Chandra, S., et\u00a0al.: What it would take to use mutation testing in industry \u2013 a study at Facebook. In: 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Los Alamitos, CA, USA: IEEE Computer Society, pp. 268\u2013277 (2021)","DOI":"10.1109\/ICSE-SEIP52600.2021.00036"},{"key":"626_CR5","doi-asserted-by":"crossref","unstructured":"Boczar, B., Pytka, M., Madeyski, L.: In: Kryvinska, N., Poniszewska-Mara\u0144da, A. (eds.) Which static code metrics can help to predict test case effectiveness?, pp. 201\u2013215. Springer International Publishing, New metrics and their empirical evaluation on projects assessed for industrial relevance Cham (2022)","DOI":"10.1007\/978-3-030-77916-0_8"},{"key":"626_CR6","doi-asserted-by":"publisher","first-page":"107593","DOI":"10.1016\/j.anucene.2020.107593","volume":"145","author":"Y Cai","year":"2020","unstructured":"Cai, Y., Wu, Y., Zhou, J., Liu, M., Zhang, Q.: Quantitative software reliability assessment methodology based on Bayesian belief networks and statistical testing for safety-critical software. Ann. Nucl. Energy 145, 107593 (2020). https:\/\/doi.org\/10.1016\/j.anucene.2020.107593","journal-title":"Ann. Nucl. Energy"},{"key":"626_CR7","doi-asserted-by":"crossref","unstructured":"Chetna, K.K.: Empirical study of meta-learning-based approach for Predictive Mutation Testing. In: International Conference on Advances and Applications of Artificial Intelligence and Machine Learning Springer, pp. 623\u2013635 (2022)","DOI":"10.1007\/978-981-99-5974-7_50"},{"key":"626_CR8","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1016\/j.infsof.2018.07.011","volume":"104","author":"P Delgado-P\u00e9rez","year":"2018","unstructured":"Delgado-P\u00e9rez, P., Medina-Bulo, I.: Search-based mutant selection for efficient test suite improvement: Evaluation and results. Inf. Softw. Technol. 104, 130\u2013143 (2018). https:\/\/doi.org\/10.1016\/j.infsof.2018.07.011","journal-title":"Inf. Softw. Technol."},{"issue":"5","key":"626_CR9","doi-asserted-by":"publisher","first-page":"e1728","DOI":"10.1002\/stvr.1728","volume":"31","author":"P Delgado-P\u00e9rez","year":"2021","unstructured":"Delgado-P\u00e9rez, P., S\u00e1nchez, A.B., Segura, S., Medina-Bulo, I.: Performance mutation testing. Softw. Test. Verif. Reliab. 31(5), e1728 (2021). https:\/\/doi.org\/10.1002\/stvr.1728","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"1","key":"626_CR10","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1080\/24751839.2023.2252186","volume":"8","author":"VN Do","year":"2024","unstructured":"Do, V.N., Nguyen, Q.V., Nguyen, T.B.: Predicting higher order mutation score based on machine learning. J. Inf. Telecommun. 8(1), 57\u201370 (2024). https:\/\/doi.org\/10.1080\/24751839.2023.2252186","journal-title":"J. Inf. Telecommun."},{"key":"626_CR11","doi-asserted-by":"crossref","unstructured":"Duque-Torres, A., Doliashvili, N., Pfahl, D., Ramler, R.: Predicting survived and killed mutants. In: 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 274\u2013283 (2020)","DOI":"10.1109\/ICSTW50294.2020.00053"},{"issue":"1","key":"626_CR12","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/TSE.2022.3140510","volume":"49","author":"A Garg","year":"2023","unstructured":"Garg, A., Ojdanic, M., Degiovanni, R., Chekam, T.T., Papadakis, M., Le Traon, Y.: Cerebro: Static subsuming mutant selection. IEEE Trans. Software Eng. 49(1), 24\u201343 (2023). https:\/\/doi.org\/10.1109\/TSE.2022.3140510","journal-title":"IEEE Trans. Software Eng."},{"key":"626_CR13","doi-asserted-by":"crossref","unstructured":"Gopinath, R., Alipour, M.A., Ahmed, I., Jensen, C., Groce, A.: On the limits of mutation reduction strategies. In: Proceedings of the 38th International Conference on Software Engineering ICSE \u201916, New York, NY, USA: Association for Computing Machinery, pp. 511\u2013522 (2016)","DOI":"10.1145\/2884781.2884787"},{"key":"626_CR14","doi-asserted-by":"crossref","unstructured":"Guerrero-Contreras, G., Balderas-D\u00edaz, S., Delgado-P\u00e9rez, P., Medina-Bulo, I.: Explainable artificial intelligence to improve interpretability in Predictive Mutation Testing. In: Nguyen, N.T., Matsuo, T., Gaol, F.L., Manolopoulos, Y., Fujita, H., Hong, T.P., et\u00a0al. (eds.) Intelligent Information and Database Systems Singapore, pp. 307\u2013318. Springer Nature Singapore (2025)","DOI":"10.1007\/978-981-96-6005-6_22"},{"key":"626_CR15","doi-asserted-by":"crossref","unstructured":"Jain, K., Alon, U., Groce, A., Le\u00a0Goues, C.: Contextual Predictive Mutation Testing. In: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering ESEC\/FSE 2023, New York, NY, USA: Association for Computing Machinery, pp. 250\u2013261 (2023)","DOI":"10.1145\/3611643.3616289"},{"issue":"10","key":"626_CR16","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1016\/j.infsof.2009.04.016","volume":"51","author":"Y Jia","year":"2009","unstructured":"Jia, Y., Harman, M.: Higher order mutation testing. Inf. Softw. Technol. 51(10), 1379\u20131393 (2009). https:\/\/doi.org\/10.1016\/j.infsof.2009.04.016","journal-title":"Inf. Softw. Technol."},{"key":"626_CR17","doi-asserted-by":"publisher","unstructured":"Kim, J., Jeon, J., Hong, S., Yoo, S.: Predictive Mutation Analysis via the natural language channel in source code. ACM Trans. Softw. Eng. Methodol. 31(4), (2022). https:\/\/doi.org\/10.1145\/3510417","DOI":"10.1145\/3510417"},{"key":"626_CR18","doi-asserted-by":"publisher","first-page":"107272","DOI":"10.1016\/j.infsof.2023.107272","volume":"162","author":"J Kim","year":"2023","unstructured":"Kim, J., An, G., Feldt, R., Yoo, S.: Learning test-mutant relationship for accurate fault localisation. Inf. Softw. Technol. 162, 107272 (2023). https:\/\/doi.org\/10.1016\/j.infsof.2023.107272","journal-title":"Inf. Softw. Technol."},{"issue":"1","key":"626_CR19","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1007\/s10515-024-00475-4","volume":"32","author":"W Langdon","year":"2025","unstructured":"Langdon, W., Clark, D.: Deep imperative mutations have less impact. Autom. Softw. Eng. 32(1), 6 (2025). https:\/\/doi.org\/10.1007\/s10515-024-00475-4","journal-title":"Autom. Softw. Eng."},{"key":"626_CR20","doi-asserted-by":"publisher","first-page":"107873","DOI":"10.1016\/j.infsof.2025.107873","volume":"188","author":"H Liu","year":"2025","unstructured":"Liu, H., Li, Z., Kang, X., Wu, S., Paul, D., Chen, X., et al.: SCOPE: Hybrid optimization strategy for higher-order mutation-based fault localization. Inf. Softw. Technol. 188, 107873 (2025). https:\/\/doi.org\/10.1016\/j.infsof.2025.107873","journal-title":"Inf. Softw. Technol."},{"key":"626_CR21","doi-asserted-by":"crossref","unstructured":"Mao, D., Chen, L., Zhang, L.; An extensive study on cross-project predictive mutation testing. In: 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) IEEE, pp. 160\u2013171 (2019)","DOI":"10.1109\/ICST.2019.00025"},{"key":"626_CR22","doi-asserted-by":"crossref","unstructured":"Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., Group, P., et\u00a0al.: Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Intern. J. Surg. 8(5), 336\u2013341 (2010)","DOI":"10.1016\/j.ijsu.2010.02.007"},{"key":"626_CR23","doi-asserted-by":"publisher","first-page":"158264","DOI":"10.1109\/ACCESS.2019.2950171","volume":"7","author":"MR Naeem","year":"2019","unstructured":"Naeem, M.R., Lin, T., Naeem, H., Ullah, F., Saeed, S.: Scalable mutation testing using predictive analysis of deep learning model. IEEE Access 7, 158264\u2013158283 (2019). https:\/\/doi.org\/10.1109\/ACCESS.2019.2950171","journal-title":"IEEE Access"},{"key":"626_CR24","doi-asserted-by":"crossref","unstructured":"Papadakis, M., Kintis, M., Zhang, J., Jia, Y., Traon, Y.L., Harman, M.: Mutation testing advances: An analysis and survey. vol. Volume 112 of Advances in Computers. Elsevier), pp. 275 \u2013 378 (2019)","DOI":"10.1016\/bs.adcom.2018.03.015"},{"key":"626_CR25","doi-asserted-by":"crossref","unstructured":"Peacock, S., Deng, L., Dehlinger, J., Chakraborty, S.: Automatic equivalent mutants classification using abstract syntax tree neural networks. In: 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 13\u201318 (2021)","DOI":"10.1109\/ICSTW52544.2021.00016"},{"issue":"10","key":"626_CR26","doi-asserted-by":"publisher","first-page":"3900","DOI":"10.1109\/TSE.2021.3107634","volume":"48","author":"G Petrovi\u0107","year":"2022","unstructured":"Petrovi\u0107, G., Ivankovi\u0107, M., Fraser, G., Just, R.: Practical mutation testing at scale: A view from Google. IEEE Trans. Software Eng. 48(10), 3900\u20133912 (2022). https:\/\/doi.org\/10.1109\/TSE.2021.3107634","journal-title":"IEEE Trans. Software Eng."},{"key":"626_CR27","doi-asserted-by":"publisher","first-page":"110388","DOI":"10.1016\/j.jss.2019.07.100","volume":"157","author":"AV Pizzoleto","year":"2019","unstructured":"Pizzoleto, A.V., Ferrari, F.C., Offutt, J., Fernandes, L., Ribeiro, M.: A systematic literature review of techniques and metrics to reduce the cost of mutation testing. J. Syst. Softw. 157, 110388 (2019). https:\/\/doi.org\/10.1016\/j.jss.2019.07.100","journal-title":"J. Syst. Softw."},{"key":"626_CR28","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.infsof.2018.03.009","volume":"99","author":"G Rodr\u00edguez-P\u00e9rez","year":"2018","unstructured":"Rodr\u00edguez-P\u00e9rez, G., Robles, G., Gonz\u00e1lez-Barahona, J.M.: Reproducibility and credibility in empirical software engineering: A case study based on a systematic literature review of the use of the SZZ algorithm. Inf. Softw. Technol. 99, 164\u2013176 (2018). https:\/\/doi.org\/10.1016\/j.infsof.2018.03.009","journal-title":"Inf. Softw. Technol."},{"key":"626_CR29","doi-asserted-by":"publisher","first-page":"107307","DOI":"10.1016\/j.infsof.2023.107307","volume":"164","author":"T Rostami","year":"2023","unstructured":"Rostami, T., Jalili, S.: FrMi: Fault-revealing mutant identification using killability severity. Inf. Softw. Technol. 164, 107307 (2023). https:\/\/doi.org\/10.1016\/j.infsof.2023.107307","journal-title":"Inf. Softw. Technol."},{"key":"626_CR30","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.infsof.2018.01.006","volume":"99","author":"M Shepperd","year":"2018","unstructured":"Shepperd, M., Ajienka, N., Counsell, S.: The role and value of replication in empirical software engineering results. Inf. Softw. Technol. 99, 120\u2013132 (2018). https:\/\/doi.org\/10.1016\/j.infsof.2018.01.006","journal-title":"Inf. Softw. Technol."},{"key":"626_CR31","doi-asserted-by":"crossref","unstructured":"Silva, K.L., Cota, E.: Using predictive models to evaluate the quality of a test suite at class and method level. In: Congresso Brasileiro de Software: Teoria e Pr\u00e1tica (CBSoft) SBC, pp. 84\u201390 (2020)","DOI":"10.5753\/cbsoft_estendido.2020.14613"},{"issue":"9","key":"626_CR32","doi-asserted-by":"publisher","first-page":"778","DOI":"10.3390\/math7090778","volume":"7","author":"L Tan","year":"2019","unstructured":"Tan, L., Gong, Y., Wang, Y.: A model for predicting statement mutation scores. Mathematics 7(9), 778 (2019). https:\/\/doi.org\/10.3390\/math7090778","journal-title":"Mathematics"},{"key":"626_CR33","doi-asserted-by":"publisher","unstructured":"Tip, F., Bell, J., Sch\u00e4fer, M.: LLMorpheus: Mutation testing using large language models. IEEE Trans. Software Eng. 1\u201321 (2025). https:\/\/doi.org\/10.1109\/TSE.2025.3562025","DOI":"10.1109\/TSE.2025.3562025"},{"key":"626_CR34","doi-asserted-by":"crossref","unstructured":"Vercacmmen, S., Borg, M., Demeyer, S.: Validation of mutation testing in the safety critical industry through a pilot study. In: 2023 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 334\u2013343 (2023)","DOI":"10.1109\/ICSTW58534.2023.00064"},{"key":"626_CR35","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhang, S., Liu, F., Feng, L., Zhao, Z.: MQP: Mutants quality prediction for cost-effective mutation testing. In: 2021 IEEE 21st International Conference on Software Quality, Reliability and Security Companion (QRS-C), pp. 45\u201350 (2021)","DOI":"10.1109\/QRS-C55045.2021.00017"},{"key":"626_CR36","doi-asserted-by":"crossref","unstructured":"Wei, Z., Wang, H., Ashraf, I., Chan, W.: Predictive mutation analysis of test case prioritization for deep neural networks. In: 2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS) IEEE, pp. 682\u2013693 (2022)","DOI":"10.1109\/QRS57517.2022.00074"},{"issue":"3","key":"626_CR37","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/0164-1212(94)00098-0","volume":"31","author":"WE Wong","year":"1995","unstructured":"Wong, W.E., Mathur, A.P.: Reducing the cost of mutation testing: An empirical study. J. Syst. Softw. 31(3), 185\u2013196 (1995). https:\/\/doi.org\/10.1016\/0164-1212(94)00098-0","journal-title":"J. Syst. Softw."},{"key":"626_CR38","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.infsof.2016.03.002","volume":"81","author":"F Wu","year":"2017","unstructured":"Wu, F., Nanavati, J., Harman, M., Jia, Y., Krinke, J.: Memory mutation testing. Inf. Softw. Technol. 81, 97\u2013111 (2017). https:\/\/doi.org\/10.1016\/j.infsof.2016.03.002","journal-title":"Inf. Softw. Technol."},{"key":"626_CR39","doi-asserted-by":"crossref","unstructured":"Xu, R., Shi, Y., Su, Z., Wang, X., Yan, Z., Kong, F.: Test case level Predictive Mutation Testing combining PIE and natural language features. In: 2023 30th Asia-Pacific Software Engineering Conference (APSEC) Los Alamitos. CA, USA: IEEE Computer Society, pp. 21\u201330 (2023)","DOI":"10.1109\/APSEC60848.2023.00012"},{"key":"626_CR40","doi-asserted-by":"crossref","unstructured":"Xu, S., Wu, S., Li, Z., Fan, L., Liu, Y.: Predictive mutation-based fault localization: Balancing effectiveness and cost. In: 2024 IEEE 24th International Conference on Software Quality, Reliability, and Security Companion (QRS-C), pp. 577\u2013582 (2024)","DOI":"10.1109\/QRS-C63300.2024.00078"},{"key":"626_CR41","doi-asserted-by":"crossref","unstructured":"Zhang, J., Wang, Z., Zhang, L., Hao, D., Zang, L., Cheng, S., et\u00a0al.: Predictive mutation testing. In: Proceedings of the 25th International Symposium on Software Testing and Analysis ISSTA 2016, New York, NY, USA: Association for Computing Machinery, pp. 342\u2013353 (2016)","DOI":"10.1145\/2931037.2931038"},{"key":"626_CR42","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhu, M., Hao, D., Zhang, L.: An empirical study on the scalability of selective mutation testing. In: 2014 IEEE 25th International Symposium on Software Reliability Engineering, pp. 277\u2013287 (2014)","DOI":"10.1109\/ISSRE.2014.27"},{"issue":"9","key":"626_CR43","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1109\/TSE.2018.2809496","volume":"45","author":"J Zhang","year":"2019","unstructured":"Zhang, J., Zhang, L., Harman, M., Hao, D., Jia, Y., Zhang, L.: Predictive Mutation Testing. IEEE Trans. Software Eng. 45(9), 898\u2013918 (2019). https:\/\/doi.org\/10.1109\/TSE.2018.2809496","journal-title":"IEEE Trans. Software Eng."},{"issue":"3","key":"626_CR44","doi-asserted-by":"publisher","first-page":"1067","DOI":"10.1109\/TSE.2020.3010361","volume":"48","author":"P Zhang","year":"2022","unstructured":"Zhang, P., Li, Y., Ma, W., Yang, Y., Chen, L., Lu, H., et al.: CBUA: A probabilistic, predictive, and practical approach for evaluating test suite effectiveness. IEEE Trans. Software Eng. 48(3), 1067\u20131096 (2022). https:\/\/doi.org\/10.1109\/TSE.2020.3010361","journal-title":"IEEE Trans. Software Eng."},{"key":"626_CR45","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Chen, Y., Sun, Z., Liang, Q., Wang, G., Hao, D.: Spotting code mutation for Predictive Mutation Testing. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering ASE \u201924, New York, NY, USA: Association for Computing Machinery, pp. 1133\u20131145 (2024)","DOI":"10.1145\/3691620.3695491"}],"container-title":["Automated Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00626-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10515-026-00626-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00626-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T02:14:50Z","timestamp":1779329690000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10515-026-00626-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,21]]},"references-count":45,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,11]]}},"alternative-id":["626"],"URL":"https:\/\/doi.org\/10.1007\/s10515-026-00626-9","relation":{},"ISSN":["0928-8910","1573-7535"],"issn-type":[{"value":"0928-8910","type":"print"},{"value":"1573-7535","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,21]]},"assertion":[{"value":"15 November 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose. Two of the included primary studies were authored by the review team. These were evaluated using the same criteria as all other studies.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}}],"article-number":"84"}}