{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:19:36Z","timestamp":1740122376202,"version":"3.37.3"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,6,20]],"date-time":"2023-06-20T00:00:00Z","timestamp":1687219200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,20]],"date-time":"2023-06-20T00:00:00Z","timestamp":1687219200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["PID2021-122270OB-I00","PID2019-108528RB-C22"],"award-info":[{"award-number":["PID2021-122270OB-I00","PID2019-108528RB-C22"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["S2018\/TCS-4314","S2018\/TCS-4339"],"award-info":[{"award-number":["S2018\/TCS-4314","S2018\/TCS-4339"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004431","name":"Directorate-General for Research and Innovation","doi-asserted-by":"publisher","award":["INFRAIA-2016-1-730897"],"award-info":[{"award-number":["INFRAIA-2016-1-730897"]}],"id":[{"id":"10.13039\/100004431","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004593","name":"Universidad Aut\u00f3noma de Madrid","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004593","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Mutation testing is a valuable technique for measuring the quality of test suites in terms of detecting faults. However, one of its main drawbacks is its high computational cost. For this purpose, several approaches have been recently proposed to speed-up the mutation testing process by exploiting computational resources in distributed systems. However, bottlenecks have been detected when those techniques are applied in large-scale systems. This work improves the performance of mutation testing using large-scale systems by proposing a new load distribution algorithm, and parallelising different steps of the process. To demonstrate the benefits of our approach, we report on a thorough empirical evaluation, which analyses and compares our proposal with existing solutions executed in large-scale systems. The results show that our proposal outperforms the state-of-the-art distribution algorithms up to 35% in three different scenarios, reaching a reduction of the execution time of\u2014at best\u2014up to 99.66%.<\/jats:p>","DOI":"10.1007\/s10586-023-04074-y","type":"journal-article","created":{"date-parts":[[2023,6,20]],"date-time":"2023-06-20T08:02:31Z","timestamp":1687248151000},"page":"2071-2097","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Parallel mutation testing for large scale systems"],"prefix":"10.1007","volume":"27","author":[{"given":"Pablo C.","family":"Ca\u00f1izares","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alberto","family":"N\u00fa\u00f1ez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rosa","family":"Filgueira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"de Lara","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,6,20]]},"reference":[{"key":"4074_CR1","doi-asserted-by":"publisher","unstructured":"Hierons, R.M., Merayo, M.G., N\u00fa\u00f1ez, M.: Controllability through nondeterminism in distributed testing. In: ICTSS, pp. 89\u2013105 (2016). https:\/\/doi.org\/10.1007\/978-3-319-47443-4_6","DOI":"10.1007\/978-3-319-47443-4_6"},{"key":"4074_CR2","unstructured":"EUROCAE (Agency). WG-12, RTCA (Firm). SC 167: Software considerations in airborne systems and equipment certification. Eurocae (1985). https:\/\/books.google.es\/books?id=3CbxxwEACAAJ"},{"key":"4074_CR3","doi-asserted-by":"crossref","unstructured":"Jordan, P.: Standard IEC 62304-medical device software\u2013software lifecycle processes (2006)","DOI":"10.1049\/ic:20060141"},{"key":"4074_CR4","doi-asserted-by":"crossref","unstructured":"Palin, R., Ward, D., Habli, I., Rivett, R.: ISO 26262 safety cases: compliance and assurance (2011)","DOI":"10.1049\/cp.2011.0251"},{"key":"4074_CR5","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.jss.2018.05.010","volume":"143","author":"PC Ca\u00f1izares","year":"2018","unstructured":"Ca\u00f1izares, P.C., N\u00fa\u00f1ez, A., Merayo, M.G.: Mutomvo: mutation testing framework for simulated cloud and HPC environments. J. Syst. Softw. 143, 187\u2013207 (2018). https:\/\/doi.org\/10.1016\/j.jss.2018.05.010","journal-title":"J. Syst. Softw."},{"issue":"3","key":"4074_CR6","doi-asserted-by":"publisher","first-page":"2267","DOI":"10.1007\/s10586-017-0892-6","volume":"20","author":"MM Ali","year":"2017","unstructured":"Ali, M.M., Huda, S., Abawajy, J., Alyahya, S., Al-Dossari, H., Yearwood, J.: A parallel framework for software defect detection and metric selection on cloud computing. Clust. Comput. 20(3), 2267\u20132281 (2017). https:\/\/doi.org\/10.1007\/s10586-017-0892-6","journal-title":"Clust. Comput."},{"issue":"1","key":"4074_CR7","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1007\/s10586-017-1000-7","volume":"21","author":"A Rauf","year":"2018","unstructured":"Rauf, A., Ramzan, M.: Parallel testing and coverage analysis for context-free applications. Clust. Comput. 21(1), 729\u2013739 (2018). https:\/\/doi.org\/10.1007\/s10586-017-1000-7","journal-title":"Clust. Comput."},{"key":"4074_CR8","doi-asserted-by":"publisher","first-page":"110542","DOI":"10.1016\/j.jss.2020.110542","volume":"164","author":"HB Braiek","year":"2020","unstructured":"Braiek, H.B., Khomh, F.: On testing machine learning programs. J. Syst. Softw. 164, 110542 (2020). https:\/\/doi.org\/10.1016\/j.jss.2020.110542","journal-title":"J. Syst. Softw."},{"key":"4074_CR9","doi-asserted-by":"publisher","unstructured":"Fraser, G., Wotawa, F.: Redundancy based test-suite reduction. In: International Conference on Fundamental Approaches to Software Engineering, pp. 291\u2013305. Springer (2007). https:\/\/doi.org\/10.1007\/978-3-540-71289-3_23","DOI":"10.1007\/978-3-540-71289-3_23"},{"key":"4074_CR10","unstructured":"Budd, T.: Mutation analysis of program test data. PhD Thesis, Yale University (1980)"},{"issue":"4","key":"4074_CR11","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/C-M.1978.218136","volume":"11","author":"RA DeMillo","year":"1978","unstructured":"DeMillo, R.A., Lipton, R.J., Sayward, F.G.: Hints on test data selection: help for the practicing programmer. Computer 11(4), 34\u201341 (1978). https:\/\/doi.org\/10.1109\/C-M.1978.218136","journal-title":"Computer"},{"issue":"4","key":"4074_CR12","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1109\/TSE.1977.231145","volume":"3","author":"RG Hamlet","year":"1977","unstructured":"Hamlet, R.G.: Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. 3(4), 279\u2013290 (1977). https:\/\/doi.org\/10.1109\/TSE.1977.231145","journal-title":"IEEE Trans. Softw. Eng."},{"key":"4074_CR13","doi-asserted-by":"publisher","unstructured":"Just, R., Kapfhammer, G.M., Schweiggert, F.: Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis. In: 23rd International Symposium on Software Reliability Engineering, pp. 11\u201320. IEEE (2012). https:\/\/doi.org\/10.1109\/ISSRE.2012.31","DOI":"10.1109\/ISSRE.2012.31"},{"key":"4074_CR14","first-page":"52","volume":"13","author":"D Klischies","year":"2016","unstructured":"Klischies, D., F\u00f6gen, K.: An analysis of current mutation testing techniques applied to real world examples. Full-scale Softw. Eng.\/Curr. Trends Release Eng. 13, 52 (2016)","journal-title":"Full-scale Softw. Eng.\/Curr. Trends Release Eng."},{"key":"4074_CR15","doi-asserted-by":"publisher","unstructured":"Mo\u017eucha, J., Rossi, B.: Is mutation testing ready to be adopted industry-wide? In: International Conference on Product-Focused Software Process Improvement, pp. 217\u2013232. Springer (2016). https:\/\/doi.org\/10.1007\/978-3-319-49094-6_14","DOI":"10.1007\/978-3-319-49094-6_14"},{"key":"4074_CR16","doi-asserted-by":"publisher","unstructured":"Papadakis, M., Kintis, M., Zhang, J., Jia, Y., Traon, Y.L., Harman, M.: Mutation testing advances: an analysis and survey. In: Advances in Computers, vol. 112, pp. 275\u2013378. Elsevier, Amsterdam (2019). https:\/\/doi.org\/10.1016\/bs.adcom.2018.03.015","DOI":"10.1016\/bs.adcom.2018.03.015"},{"key":"4074_CR17","first-page":"89","volume":"13","author":"JJ Dongarra","year":"1997","unstructured":"Dongarra, J.J., Meuer, H.W., Strohmaier, E., et al.: TOP500 supercomputer sites. Supercomputer 13, 89\u2013111 (1997)","journal-title":"Supercomputer"},{"key":"4074_CR18","unstructured":"Strohmaier, E., Dongarra, J., Simon, H., Meuer, M.: TOP 500 list. Web page at http:\/\/www.top500.org (2020). Accessed 8 June 2020"},{"issue":"5","key":"4074_CR19","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1109\/TSE.2010.62","volume":"37","author":"Y Jia","year":"2011","unstructured":"Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37(5), 649\u2013678 (2011). https:\/\/doi.org\/10.1109\/TSE.2010.62","journal-title":"IEEE Trans. Softw. Eng."},{"key":"4074_CR20","doi-asserted-by":"publisher","unstructured":"Ca\u00f1izares, P.C., N\u00fa\u00f1ez, A., de Lara, J.: OUTRIDER: optimizing the mutation testing process in distributed environments. In: 17th International Conference on Computational Science. ICCS\u201917, pp. 505\u2013514, Zurich (2017). https:\/\/doi.org\/10.1016\/j.procs.2017.05.095","DOI":"10.1016\/j.procs.2017.05.095"},{"key":"4074_CR21","doi-asserted-by":"publisher","unstructured":"Reales, P., Polo, M.: Bacterio: Java mutation testing tool: a framework to evaluate quality of tests cases. In: 28th International Conference on Software Maintenance. ICSME\u201912, pp. 646\u2013649. IEEE (2012). https:\/\/doi.org\/10.1109\/ICSM.2012.6405344","DOI":"10.1109\/ICSM.2012.6405344"},{"key":"4074_CR22","doi-asserted-by":"publisher","unstructured":"Vercammen, S., Demeyer, S., Borg, M., Eldh, S.: Speeding up mutation testing via the cloud: lessons learned for further optimisations. In: Proceedings of the 12th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 1\u20139 (2018). https:\/\/doi.org\/10.1145\/3239235.3240506","DOI":"10.1145\/3239235.3240506"},{"key":"4074_CR23","doi-asserted-by":"publisher","unstructured":"Ca\u00f1izares, P.C., Merayo, M.G., N\u00fa\u00f1ez, A.: EMINENT: embarrassingly parallel mutation testing. In: 16th International Conference on Computational Science. ICCS\u201916, pp. 63\u201373 (2016). https:\/\/doi.org\/10.1016\/j.procs.2016.05.298","DOI":"10.1016\/j.procs.2016.05.298"},{"key":"4074_CR24","doi-asserted-by":"publisher","unstructured":"Papadakis, M., Jia, Y., Harman, M., Traon, Y.L.: Trivial compiler equivalence: a large scale empirical study of a simple, fast and effective equivalent mutant detection technique. In: 7th International Conference on Software Engineering. ICSE \u201915, pp. 936\u2013946. IEEE Press (2015). https:\/\/doi.org\/10.1109\/ICSE.2015.103","DOI":"10.1109\/ICSE.2015.103"},{"issue":"2","key":"4074_CR25","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1002\/stvr.308","volume":"15","author":"Y Ma","year":"2005","unstructured":"Ma, Y., Offutt, A.J., Kwon, Y.R.: MuJava: an automated class mutation system: research articles. Softw. Test. Verif. Reliab. 15(2), 97\u2013133 (2005). https:\/\/doi.org\/10.1002\/stvr.308","journal-title":"Softw. Test. Verif. Reliab."},{"key":"4074_CR26","doi-asserted-by":"publisher","unstructured":"Jia, Y., Harman, M.: MILU: a customizable, runtime-optimized higher order mutation testing tool for the full C language. In: Testing: Academic & Industrial Conference\u2014Practice and Research Techniques. TAIC\u201908, pp. 94\u201398. IEEE (2008). https:\/\/doi.org\/10.1109\/TAIC-PART.2008.18","DOI":"10.1109\/TAIC-PART.2008.18"},{"key":"4074_CR27","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7055.001.0001","volume-title":"Using MPI-2: Advanced Features of the Message Passing Interface","author":"W Gropp","year":"1999","unstructured":"Gropp, W., Thakur, R., Lusk, E.: Using MPI-2: Advanced Features of the Message Passing Interface. MIT Press, Cambridge (1999)"},{"key":"4074_CR28","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.future.2020.01.026","volume":"106","author":"N Losada","year":"2020","unstructured":"Losada, N., Gonz\u00e1lez, P., Mart\u00edn, M.J., Bosilca, G., Bouteiller, A., Teranishi, K.: Fault tolerance of MPI applications in exascale systems: the ULFM solution. Future Gener. Comput. Syst. 106, 467\u2013481 (2020). https:\/\/doi.org\/10.1016\/j.future.2020.01.026","journal-title":"Future Gener. Comput. Syst."},{"key":"4074_CR29","doi-asserted-by":"publisher","unstructured":"Laguna, I., Marshall, R., Mohror, K., Ruefenacht, M., Skjellum, A., Sultana, N.: A large-scale study of MPI usage in open-source HPC applications. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. SC \u201919. Association for Computing Machinery, New York (2019). https:\/\/doi.org\/10.1145\/3295500.3356176","DOI":"10.1145\/3295500.3356176"},{"key":"4074_CR30","first-page":"14","volume":"2","author":"R Thakur","year":"2010","unstructured":"Thakur, R., Balaji, P., Buntinas, D., Goodell, D., Gropp, W., Hoefler, T., Kumar, S., Lusk, E., Tr\u00e4ff, J.L.: MPI at exascale. Proc. SciDAC 2, 14\u201335 (2010)","journal-title":"Proc. SciDAC"},{"issue":"2","key":"4074_CR31","first-page":"38","volume":"18","author":"K Qureshi","year":"2005","unstructured":"Qureshi, K., Rashid, H.: A performance evaluation of RPC, JAVA RMI, MPI and PVM. Malays. J. Comput. Sci. 18(2), 38\u201344 (2005)","journal-title":"Malays. J. Comput. Sci."},{"key":"4074_CR32","unstructured":"Khan, R.Z., Ali, M.F.: A comparative study on parallel programming tools in parallel distributed computing system: MPI and PVM. In: Proceedings of the 5th National Conference (2011)"},{"key":"4074_CR33","doi-asserted-by":"publisher","unstructured":"Andrews, J.H., Briand, L.C., Labiche, Y.: Is mutation an appropriate tool for testing experiments? In: 27th International Conference on Software Engineering. ICSE\u201905, pp. 402\u2013411 (2005). ACM. https:\/\/doi.org\/10.1145\/1062455.1062530","DOI":"10.1145\/1062455.1062530"},{"issue":"1","key":"4074_CR34","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/BF00625279","volume":"18","author":"TA Budd","year":"1982","unstructured":"Budd, T.A., Angluin, D.: Two notions of correctness and their relation to testing. Acta Inform. 18(1), 31\u201345 (1982)","journal-title":"Acta Inform."},{"issue":"3","key":"4074_CR35","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1002\/stvr.4370040303","volume":"4","author":"AJ Offutt","year":"1994","unstructured":"Offutt, A.J., Craft, W.M.: Using compiler optimization techniques to detect equivalent mutants. Softw. Test. Verif. Reliab. 4(3), 131\u2013154 (1994). https:\/\/doi.org\/10.1002\/stvr.4370040303","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"4","key":"4074_CR36","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1002\/(SICI)1099-1689(199912)9:4<233::AID-STVR191>3.0.CO;2-3","volume":"9","author":"RM Hierons","year":"1999","unstructured":"Hierons, R.M., Harman, M., Danicic, S.: Using program slicing to assist in the detection of equivalent mutants. Softw. Test. Verif. Reliab. 9(4), 233\u2013262 (1999)","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"7","key":"4074_CR37","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1002\/spe.4380210704","volume":"21","author":"KN King","year":"1991","unstructured":"King, K.N., Offutt, A.J.: A Fortran language system for mutation-based software testing. Softw. Pract. Exp. 21(7), 685\u2013718 (1991)","journal-title":"Softw. Pract. Exp."},{"key":"4074_CR38","unstructured":"Hussain, S.: Mutation clustering. Masters Thesis, Kings College London, Strand, London (2008)"},{"key":"4074_CR39","unstructured":"Ji, C., Chen, Z., Xu, B., Zhao, Z.: A novel method of mutation clustering based on domain analysis. In: SEKE, vol. 9, pp. 422\u2013425. CiteSeer (2009)"},{"issue":"4","key":"4074_CR40","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1002\/(SICI)1099-1689(199912)9:4<205::AID-STVR186>3.0.CO;2-X","volume":"9","author":"ES Mresa","year":"1999","unstructured":"Mresa, E.S., Bottaci, L.: Efficiency of mutation operators and selective mutation strategies: an empirical study. Softw. Test. Verif. Reliab. 9(4), 205\u2013232 (1999)","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"2","key":"4074_CR41","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1002\/stvr.392","volume":"19","author":"M Polo","year":"2009","unstructured":"Polo, M., Piattini, M., Garc\u00eda-Rodr\u00edguez, I.: Decreasing the cost of mutation testing with second-order mutants. Softw. Test. Verif. Reliab. 19(2), 111\u2013131 (2009)","journal-title":"Softw. Test. Verif. Reliab."},{"key":"4074_CR42","doi-asserted-by":"crossref","unstructured":"Offutt, A.J., Rothermel, G., Zapf, C.: An experimental evaluation of selective mutation. In: Proceedings of 1993 15th International Conference on Software Engineering, pp. 100\u2013107. IEEE (1993)","DOI":"10.1109\/ICSE.1993.346062"},{"key":"4074_CR43","doi-asserted-by":"crossref","unstructured":"Jia, Y., Harman, M.: Constructing subtle faults using higher order mutation testing. In: 2008 Eighth IEEE International Working Conference on Source Code Analysis and Manipulation, pp. 249\u2013258. IEEE (2008)","DOI":"10.1109\/SCAM.2008.36"},{"issue":"3","key":"4074_CR44","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1109\/TR.2017.2705662","volume":"66","author":"R Gopinath","year":"2017","unstructured":"Gopinath, R., Ahmed, I., Alipour, M.A., Jensen, C., Groce, A.: Mutation reduction strategies considered harmful. IEEE Trans. Reliab. 66(3), 854\u2013874 (2017)","journal-title":"IEEE Trans. Reliab."},{"key":"4074_CR45","doi-asserted-by":"crossref","unstructured":"Chekam, T.T., Papadakis, M., Traon, Y.L., Harman, M.: An empirical study on mutation, statement and branch coverage fault revelation that avoids the unreliable clean program assumption. In: 39th International Conference on Software Engineering (ICSE\u201917), pp. 597\u2013608 (2017)","DOI":"10.1109\/ICSE.2017.61"},{"key":"4074_CR46","doi-asserted-by":"crossref","unstructured":"Offutt, A.J., King, K.N.: A Fortran 77 interpreter for mutation analysis. In: Papers of the Symposium on Interpreters and Interpretive Techniques, pp. 177\u2013188 (1987)","DOI":"10.1145\/960114.29669"},{"issue":"1","key":"4074_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0167-6423(88)90013-5","volume":"10","author":"O Baruch","year":"1988","unstructured":"Baruch, O., Katz, S.: Partially interpreted schemas for CSP programming. Sci. Comput. Program. 10(1), 1\u201318 (1988)","journal-title":"Sci. Comput. Program."},{"key":"4074_CR48","doi-asserted-by":"crossref","unstructured":"Untch, R.H., Offutt, A.J., Harrold, M.J.: Mutation analysis using mutant schemata. In: Proceedings of the 1993 ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 139\u2013148 (1993)","DOI":"10.1145\/154183.154265"},{"key":"4074_CR49","unstructured":"Ma, Y.-S., Kwon, Y.-R., Offutt, J.: Inter-class mutation operators for Java. In: 13th International Symposium on Software Reliability Engineering, 2002. Proceedings, pp. 352\u2013363. IEEE (2002)"},{"key":"4074_CR50","unstructured":"Offutt, A.J., Pargas, R.P., Fichter, S.V., Khambekar, P.K.: Mutation testing of software using a MIMD computer. In: 21st International Conference on Parallel Processing. ICPP\u201992, pp. 255\u2013266 (1992)"},{"key":"4074_CR51","unstructured":"Kapfhammer, G.M.: Automatically and transparently distributing the execution of regression test suites. In: Proceedings of the 18th International Conference on Testing Computer Software, vol. 18 (2001)"},{"issue":"2","key":"4074_CR52","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/0164-1212(93)90005-I","volume":"20","author":"C Byoungju","year":"1993","unstructured":"Byoungju, C., Mathur, A.P.: High-performance mutation testing. J. Syst. Softw. 20(2), 135\u2013152 (1993)","journal-title":"J. Syst. Softw."},{"issue":"4","key":"4074_CR53","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1002\/stvr.1471","volume":"23","author":"P Reales","year":"2013","unstructured":"Reales, P., Polo, M.: Parallel mutation testing. Softw. Test. Verif. Reliab. 23(4), 315\u2013350 (2013). https:\/\/doi.org\/10.1002\/stvr.1471","journal-title":"Softw. Test. Verif. Reliab."},{"issue":"8","key":"4074_CR54","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1145\/135226.135232","volume":"35","author":"SF Hummel","year":"1992","unstructured":"Hummel, S.F., Schonberg, E., Flynn, L.E.: Factoring: a method for scheduling parallel loops. Commun. ACM 35(8), 90\u2013101 (1992)","journal-title":"Commun. ACM"},{"key":"4074_CR55","doi-asserted-by":"publisher","DOI":"10.5555\/560800","volume-title":"Java RMI","author":"W Grosso","year":"2001","unstructured":"Grosso, W.: Java RMI, 1st edn. O\u2019Reilly & Associates Inc., Sebastopol (2001). https:\/\/doi.org\/10.5555\/560800","edition":"1"},{"key":"4074_CR56","doi-asserted-by":"publisher","unstructured":"Saleh, I., Nagi, K.: HadoopMutator: a cloud-based mutation testing framework. In: Software Reuse for Dynamic Systems in the Cloud and Beyond, pp. 172\u2013187. Springer International Publishing Switzerland (2014). https:\/\/doi.org\/10.1007\/978-3-319-14130-5_13","DOI":"10.1007\/978-3-319-14130-5_13"},{"issue":"3","key":"4074_CR57","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/MCC.2014.51","volume":"1","author":"D Bernstein","year":"2014","unstructured":"Bernstein, D.: Containers and cloud: from LXC to Docker to Kubernetes. IEEE Cloud Comput. 1(3), 81\u201384 (2014). https:\/\/doi.org\/10.1109\/MCC.2014.51","journal-title":"IEEE Cloud Comput."},{"key":"4074_CR58","volume-title":"RabbitMQ Essentials","author":"D Dossot","year":"2014","unstructured":"Dossot, D.: RabbitMQ Essentials. Packt Publishing Ltd, Birmingham (2014)"},{"issue":"3","key":"4074_CR59","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1109\/MS.2010.79","volume":"27","author":"MP Usaola","year":"2010","unstructured":"Usaola, M.P., Mateo, P.R.: Mutation testing cost reduction techniques: a survey. IEEE Softw. 27(3), 80\u201386 (2010). https:\/\/doi.org\/10.1109\/MS.2010.79","journal-title":"IEEE Softw."},{"key":"4074_CR60","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.jss.2016.01.007","volume":"115","author":"Y Ma","year":"2016","unstructured":"Ma, Y., Kim, S.: Mutation testing cost reduction by clustering overlapped mutants. J. Syst. Softw. 115, 18\u201330 (2016). https:\/\/doi.org\/10.1016\/j.jss.2016.01.007","journal-title":"J. Syst. Softw."},{"issue":"03","key":"4074_CR61","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1142\/S0218194021500121","volume":"31","author":"ME Delamaro","year":"2021","unstructured":"Delamaro, M.E., Andrade, S.A., de Souza, S.R., de Souza, P.S.: Parallel execution of programs as a support for mutation testing: a replication study. Int. J. Softw. Eng. Knowl. Eng. 31(03), 337\u2013380 (2021). https:\/\/doi.org\/10.1142\/S0218194021500121","journal-title":"Int. J. Softw. Eng. Knowl. Eng."},{"issue":"5","key":"4074_CR62","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1109\/32.90444","volume":"17","author":"EW Krauser","year":"1991","unstructured":"Krauser, E.W., Mathur, A.P., Rego, V.J.: High performance software testing on SIMD machines. IEEE Trans. Softw. Eng. 17(5), 403\u2013423 (1991). https:\/\/doi.org\/10.1109\/32.90444","journal-title":"IEEE Trans. Softw. Eng."},{"key":"4074_CR63","doi-asserted-by":"publisher","unstructured":"Yao, X., Harman, M., Jia, Y.: A study of equivalent and stubborn mutation operators using human analysis of equivalence. In: Proceedings of the 36th International Conference on Software Engineering, pp. 919\u2013930 (2014). https:\/\/doi.org\/10.1145\/2568225.2568265","DOI":"10.1145\/2568225.2568265"},{"issue":"6","key":"4074_CR64","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/MCSE.2011.74","volume":"13","author":"A Szalay","year":"2011","unstructured":"Szalay, A.: Extreme data-intensive scientific computing. Comput. Sci. Eng. 13(6), 34\u201341 (2011). https:\/\/doi.org\/10.1109\/MCSE.2011.74","journal-title":"Comput. Sci. Eng."},{"key":"4074_CR65","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1016\/j.ins.2014.01.015","volume":"275","author":"CLP Chen","year":"2014","unstructured":"Chen, C.L.P., Zhang, C.-Y.: Data-intensive applications, challenges, techniques and technologies: a survey on Big Data. Inf. Sci. 275, 314\u2013347 (2014). https:\/\/doi.org\/10.1016\/j.ins.2014.01.015","journal-title":"Inf. Sci."},{"key":"4074_CR66","doi-asserted-by":"publisher","unstructured":"Peng, J., Dai, Y., Rao, Y., Zhi, X., Qiu, M.: Modeling for CPU-intensive applications in cloud computing. In: 17th International Conference on High Performance Computing and Communications, 7th International Symposium on Cyberspace Safety and Security, and 12th International Conference on Embedded Software and Systems, pp. 20\u201325. IEEE (2015). https:\/\/doi.org\/10.1109\/HPCC-CSS-ICESS.2015.128","DOI":"10.1109\/HPCC-CSS-ICESS.2015.128"},{"key":"4074_CR67","volume-title":"Compressed Image File Formats: JPEG, PNG, GIF, XBM, BMP","author":"J Miano","year":"1999","unstructured":"Miano, J.: Compressed Image File Formats: JPEG, PNG, GIF, XBM, BMP. Addison-Wesley Professional, Boston (1999)"},{"key":"4074_CR68","unstructured":"Seward, J.: Bzip2 and libbzip2. Web page at http:\/\/www.bzip.org (1996). Accessed 10 Apr 2021"},{"key":"4074_CR69","doi-asserted-by":"publisher","unstructured":"Coles, H., Laurent, T., Henard, C., Papadakis, M., Ventresque, A.: PIT: a practical mutation testing tool for Java (demo). In: International Symposium on Software Testing and Analysis (ISSTA), pp. 449\u2013452. ACM (2016). https:\/\/doi.org\/10.1145\/2931037.2948707","DOI":"10.1145\/2931037.2948707"},{"key":"4074_CR70","doi-asserted-by":"publisher","unstructured":"Derezi\u0144ska, A., Ha\u0142as, K.: Analysis of mutation operators for the python language. In: Proceedings of the Ninth International Conference on Dependability and Complex Systems DepCoS-RELCOMEX. June 30\u2013July 4, 2014, Brun\u00f3w, Poland, pp. 155\u2013164. Springer (2014). https:\/\/doi.org\/10.1007\/978-3-319-07013-1_15","DOI":"10.1007\/978-3-319-07013-1_15"}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-023-04074-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-023-04074-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-023-04074-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T16:58:24Z","timestamp":1729616304000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-023-04074-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,20]]},"references-count":70,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["4074"],"URL":"https:\/\/doi.org\/10.1007\/s10586-023-04074-y","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"type":"print","value":"1386-7857"},{"type":"electronic","value":"1573-7543"}],"subject":[],"published":{"date-parts":[[2023,6,20]]},"assertion":[{"value":"5 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 June 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}