{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T17:26:09Z","timestamp":1781976369242,"version":"3.54.5"},"reference-count":95,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2016,5,10]],"date-time":"2016-05-10T00:00:00Z","timestamp":1462838400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Software Qual J"],"published-print":{"date-parts":[[2017,9]]},"DOI":"10.1007\/s11219-016-9317-7","type":"journal-article","created":{"date-parts":[[2016,5,10]],"date-time":"2016-05-10T11:36:59Z","timestamp":1462880219000},"page":"871-920","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Does choice of mutation tool matter?"],"prefix":"10.1007","volume":"25","author":[{"given":"Rahul","family":"Gopinath","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iftekhar","family":"Ahmed","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Amin","family":"Alipour","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Jensen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"Groce","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2016,5,10]]},"reference":[{"key":"9317_CR1","unstructured":"Acree, Jr. A. T. (1980). On mutation. Ph.D. dissertation, Georgia Institute of Technology, Atlanta, GA, USA."},{"key":"9317_CR2","unstructured":"Ammann, P. (2015a). Problems with jester. https:\/\/sites.google.com\/site\/mutationworkshop2015\/program\/MutationKeynote ."},{"key":"9317_CR3","unstructured":"Ammann, P. (2015b). Transforming mutation testing from the technology of the future into the technology of the present. In International conference on software testing, verification and validation workshops. IEEE."},{"key":"9317_CR4","doi-asserted-by":"crossref","unstructured":"Ammann, P., Delamaro, M. E., & Offutt, J. (2014). Establishing theoretical minimal sets of mutants. In International conference on software testing, verification and validation (pp. 21\u201330). Washington, DC, USA: IEEE Computer Society.","DOI":"10.1109\/ICST.2014.13"},{"key":"9317_CR5","unstructured":"Andrews, J. H., Briand, L. C., & Labiche, Y. (2005). Is mutation an appropriate tool for testing experiments? In International conference on software engineering (pp. 402\u2013411). IEEE."},{"issue":"8","key":"9317_CR6","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1109\/TSE.2006.83","volume":"32","author":"JH Andrews","year":"2006","unstructured":"Andrews, J. H., Briand, L. C., Labiche, Y., & Namin, A. S. (2006). Using mutation analysis for assessing and comparing testing coverage criteria. IEEE Transactions on Software Engineering, 32(8), 608\u2013624.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9317_CR7","unstructured":"Apache Software Foundation. (2016). Apache commons. http:\/\/commons.apache.org\/ ."},{"key":"9317_CR8","doi-asserted-by":"crossref","unstructured":"Baldwin, D., & Sayward, F. (1979). Heuristics for determining equivalence of program mutations. DTIC Document: Tech. rep.","DOI":"10.21236\/ADA071795"},{"issue":"2","key":"9317_CR9","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1002\/stvr.226","volume":"11","author":"EF Barbosa","year":"2001","unstructured":"Barbosa, E. F., Maldonado, J. C., & Vincenzi, A. M. R. (2001). Toward the determination of sufficient mutant operators for c. Software Testing, Verification and Reliability, 11(2), 113\u2013136.","journal-title":"Software Testing, Verification and Reliability"},{"key":"9317_CR10","unstructured":"Budd, T. A. (1980). Mutation analysis of program test data. Ph.D. dissertation, Yale University, New Haven, CT, USA."},{"key":"9317_CR11","doi-asserted-by":"crossref","unstructured":"Budd, T. A., DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1980). Theoretical and empirical studies on using program mutation to test the functional correctness of programs. In ACM SIGPLAN-SIGACT symposium on principles of programming languages (pp. 220\u2013233). ACM.","DOI":"10.1145\/567446.567468"},{"key":"9317_CR12","doi-asserted-by":"crossref","unstructured":"Budd, T. A., Lipton, R. J., DeMillo, R. A., & Sayward, F. G. (1979). Mutation analysis. Yale University, Department of Computer Science.","DOI":"10.21236\/ADA068118"},{"issue":"1","key":"9317_CR13","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/0096-0551(85)90011-6","volume":"10","author":"TA Budd","year":"1985","unstructured":"Budd, T. A., & Gopal, A. S. (1985). Program testing by specification mutation. Computer Languages, 10(1), 63\u201373.","journal-title":"Computer Languages"},{"key":"9317_CR14","doi-asserted-by":"crossref","unstructured":"Cai, X., & Lyu, M. R. (2005). The effect of code coverage on fault detection under different testing profiles. In ACM SIGSOFT software engineering notes (Vol. 30, no. 4, pp. 1\u20137). ACM.","DOI":"10.1145\/1083274.1083288"},{"issue":"1","key":"9317_CR15","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1007\/s10009-002-0099-9","volume":"5","author":"P Chevalley","year":"2003","unstructured":"Chevalley, P., & Th\u00e9venod-Fosse, P. (2003). A mutation analysis tool for java programs. International Journal on Software Tools for Technology Transfer, 5(1), 90\u2013103.","journal-title":"International Journal on Software Tools for Technology Transfer"},{"key":"9317_CR16","unstructured":"Coles, H. (2016). Pit mutation testing. http:\/\/pitest.org\/ ."},{"key":"9317_CR17","unstructured":"Coles, H. (2016a). Mutation testing systems for java compared. http:\/\/pitest.org\/java_mutation_testing_systems\/ ."},{"key":"9317_CR18","unstructured":"Coles, H. (2016b). Pit mutators. http:\/\/pitest.org\/quickstart\/mutators\/ ."},{"key":"9317_CR19","doi-asserted-by":"crossref","unstructured":"Daran, M., & Th\u00e9venod-Fosse, P. (1996). Software error analysis: A real case study involving real faults and mutations. In ACM SIGSOFT international symposium on software testing and analysis (pp. 158\u2013171). ACM.","DOI":"10.1145\/229000.226313"},{"key":"9317_CR20","doi-asserted-by":"crossref","unstructured":"Delahaye, M., & Du Bousquet, L. (2013). A comparison of mutation analysis tools for java. In Quality software (QSIC), 2013 13th international conference on (pp. 187\u2013195). IEEE.","DOI":"10.1109\/QSIC.2013.47"},{"key":"9317_CR21","doi-asserted-by":"crossref","unstructured":"DeMillo, R. A., Guindi, D. S., McCracken, W., Offutt, A., & King, K. (1988). An extended overview of the mothra software testing environment. In International conference on software testing, verification and validation workshops (pp. 142\u2013151). IEEE.","DOI":"10.1109\/WST.1988.5369"},{"issue":"4","key":"9317_CR22","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/C-M.1978.218136","volume":"11","author":"RA DeMillo","year":"1978","unstructured":"DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978). Hints on test data selection: Help for the practicing programmer. Computer, 11(4), 34\u201341.","journal-title":"Computer"},{"key":"9317_CR23","doi-asserted-by":"crossref","unstructured":"Derezi\u0144ska, A., & Ha\u0142as, K. (2014). Analysis of mutation operators for the python language. In International conference on dependability and complex systems, ser. Advances in Intelligent Systems and Computing (Vol. 286, pp. 155\u2013164). Springer.","DOI":"10.1007\/978-3-319-07013-1_15"},{"issue":"9","key":"9317_CR24","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1109\/TSE.2006.92","volume":"32","author":"H Do","year":"2006","unstructured":"Do, H., & Rothermel, G. (2006). On the use of mutation faults in empirical assessments of test case prioritization techniques. IEEE Transactions on Software Engineering, 32(9), 733\u2013752.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9317_CR25","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1109\/ISSRE.2002.1173283","volume":"2002","author":"J Duraes","year":"2002","unstructured":"Duraes, J., & Madeira, H. (2002). Emulation of software faults by educated mutations at machine-code level. International Symposium on Software Reliability Engineering, 2002, 329\u2013340.","journal-title":"International Symposium on Software Reliability Engineering"},{"key":"9317_CR26","unstructured":"GitHub Inc. (2016). Software repository. http:\/\/www.github.com ."},{"key":"9317_CR27","doi-asserted-by":"crossref","unstructured":"Gligoric, M., Groce, A., Zhang, C., Sharma, R., Alipour, M. A., & Marinov, D. (2013). Comparing non-adequate test suites using coverage criteria. In ACM SIGSOFT international symposium on software testing and analysis. ACM.","DOI":"10.1145\/2483760.2483769"},{"key":"9317_CR28","doi-asserted-by":"crossref","unstructured":"Gligoric, M., Jagannath, V., & Marinov, D. (2010). Mutmut: Efficient exploration for mutation testing of multithreaded code. In Software testing, verification and validation (ICST), 2010 third international conference on (pp. 55\u201364). IEEE.","DOI":"10.1109\/ICST.2010.33"},{"key":"9317_CR29","unstructured":"Gopinath, R. (2015). Replication data for: Does choice of mutation tool matter?. http:\/\/eecs.osuosl.org\/rahul\/sqj2015 ."},{"key":"9317_CR30","unstructured":"Gopinath, R., Alipour, A., Ahmed, I., Jensen, C., & Groce, A. (2015). Do mutation reduction strategies matter? Oregon State University, tech. rep., August 2015, under review for Software Quality Journal. http:\/\/hdl.handle.net\/1957\/56917 ."},{"key":"9317_CR31","doi-asserted-by":"crossref","unstructured":"Gopinath, R., Alipour, A., Ahmed, I., Jensen, C., & Groce, A. (2016). On the limits of mutation reduction strategies. In Proceedings of the 38th international conference on software engineering. ACM.","DOI":"10.1145\/2884781.2884787"},{"key":"9317_CR32","doi-asserted-by":"crossref","unstructured":"Gopinath, R., Alipour, A., Iftekhar, A., Jensen, C., & Groce, A. (2015). How hard does mutation analysis have to be, anyway? In International symposium on software reliability engineering. IEEE.","DOI":"10.1109\/ISSRE.2015.7381815"},{"key":"9317_CR33","doi-asserted-by":"crossref","unstructured":"Gopinath, R., Jensen, C., & Groce, A. (2014). Code coverage for suite evaluation by developers. In International conference on software engineering. IEEE.","DOI":"10.1145\/2568225.2568278"},{"key":"9317_CR34","unstructured":"Gopinath, R., Jensen, C., & Groce, A. (2014). Mutations: How close are they to real faults? In Software reliability engineering (ISSRE), 2014 IEEE 25th international symposium on (pp. 189\u2013200), November 2014."},{"key":"9317_CR35","doi-asserted-by":"crossref","unstructured":"Harder, M., Mellen, J., & Ernst, M.D. (2003). Improving test suites via operational abstraction. In International conference on software engineering (pp. 60\u201371). IEEE Computer Society.","DOI":"10.1109\/ICSE.2003.1201188"},{"key":"9317_CR36","unstructured":"Harder, M., Morse, B., & Ernst, M. D. (2001). Specification coverage as a measure of test suite quality. MIT Lab for Computer Science: tech. rep."},{"key":"9317_CR37","doi-asserted-by":"crossref","unstructured":"Irvine, S. A., Pavlinic, T., Trigg, L., Cleary, J. G., Inglis, S., & Utting, M. (2007). Jumble java byte code to measure the effectiveness of unit tests. In Testing: Academic and industrial conference practice and research techniques-MUTATION, 2007. TAICPART- MUTATION 2007 (pp. 169\u2013175). IEEE, 2007.","DOI":"10.1109\/TAIC.PART.2007.38"},{"key":"9317_CR38","doi-asserted-by":"crossref","unstructured":"Jia, Y., & Harman, M. (2008). Milu: A customizable, runtime-optimized higher order mutation testing tool for the full c language. In Practice and Research Techniques, 2008. TAIC PART\u201908. Testing: Academic & industrial conference (pp. 94\u201398). IEEE, 2008.","DOI":"10.1109\/TAIC-PART.2008.18"},{"issue":"5","key":"9317_CR39","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/TSE.2010.62","volume":"37","author":"Y Jia","year":"2011","unstructured":"Jia, Y., & Harman, M. (2011). An analysis and survey of the development of mutation testing. IEEE Transactions on Software Engineering, 37(5), 649\u2013678.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9317_CR40","doi-asserted-by":"crossref","unstructured":"Just, R. (2014). The major mutation framework: Efficient and scalable mutation analysis for java. In Proceedings of the 2014 international symposium on software testing and analysis, ser. ISSTA 2014 (pp. 433\u2013436). New York, NY: ACM.","DOI":"10.1145\/2610384.2628053"},{"key":"9317_CR41","doi-asserted-by":"crossref","unstructured":"Just, R., Kapfhammer, G. M., & Schweiggert, F. (2012). Do redundant mutants affect the effectiveness and efficiency of mutation analysis? In Software testing, verification and validation (ICST), 2012 IEEE fifth international conference on (pp. 720\u2013725). IEEE.","DOI":"10.1109\/ICST.2012.162"},{"key":"9317_CR42","first-page":"654","volume-title":"ACM SIGSOFT symposium on the foundations of software engineering","author":"R Just","year":"2014","unstructured":"Just, R., Jalali, D., Inozemtseva, L., Ernst, M. D., Holmes, R., & Fraser, G. (2014). Are mutants a valid substitute for real faults in software testing? ACM SIGSOFT symposium on the foundations of software engineering (pp. 654\u2013665). Hong Kong: ACM."},{"key":"9317_CR43","doi-asserted-by":"crossref","unstructured":"Kintis, M., Papadakis, M., & Malevris, N. (2010). Evaluating mutation testing alternatives: A collateral experiment. In Asia Pacific software engineering conference (APSEC) (pp. 300\u2013309). IEEE.","DOI":"10.1109\/APSEC.2010.42"},{"key":"9317_CR44","doi-asserted-by":"crossref","unstructured":"Kurtz, B., Ammann, P., Delamaro, M. E., Offutt, J., & Deng, L. (2014). Mutant subsumption graphs. In Software testing, verification and validation workshops (ICSTW), 2014 IEEE seventh international conference on (pp. 176\u2013185). IEEE, 2014.","DOI":"10.1109\/ICSTW.2014.20"},{"key":"9317_CR45","doi-asserted-by":"crossref","unstructured":"Kusano, M., & Wang, C. (2013). Ccmutator: A mutation generator for concurrency constructs in multithreaded c\/c++ applications. In Automated software engineering (ASE), 2013 IEEE\/ACM 28th international conference on (pp. 722\u2013725). IEEE.","DOI":"10.1109\/ASE.2013.6693142"},{"issue":"12","key":"9317_CR46","doi-asserted-by":"crossref","first-page":"2416","DOI":"10.1016\/j.jss.2010.07.027","volume":"83","author":"WB Langdon","year":"2010","unstructured":"Langdon, W. B., Harman, M., & Jia, Y. (2010). Efficient multi-objective higher order mutation testing with genetic programming. Journal of systems and Software, 83(12), 2416\u20132430.","journal-title":"Journal of systems and Software"},{"key":"9317_CR47","doi-asserted-by":"crossref","unstructured":"Le, D., Alipour, M. A., Gopinath, R., & Groce, A. (2014). Mucheck: An extensible tool for mutation testing of haskell programs. In Proceedings of the 2014 international symposium on software testing and analysis (pp. 429\u2013432). ACM.","DOI":"10.1145\/2610384.2628052"},{"key":"9317_CR48","unstructured":"Lipton, R. J. (1971). Fault diagnosis of computer programs. Carnegie Mellon University, Tech. rep."},{"key":"9317_CR49","unstructured":"Ma, Y.-S., Kwon, Y.-R., & Offutt, J. (2002). Inter-class mutation operators for java. In International symposium on software reliability engineering (pp. 352\u2013363). IEEE."},{"key":"9317_CR50","doi-asserted-by":"crossref","unstructured":"Ma, Y.-S., Offutt, J., & Kwon, Y.-R. (2006). Mujava: A mutation system for java. In Proceedings of the 28th international conference on software engineering, ser. ICSE\u201906 (pp. 827\u2013830). New York, NY: ACM, 2006.","DOI":"10.1145\/1134285.1134425"},{"key":"9317_CR51","unstructured":"Macedo, M. G. (2016). Mutator. http:\/\/ortask.com\/mutator\/ ."},{"issue":"1","key":"9317_CR52","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1049\/iet-sen.2008.0038","volume":"4","author":"L Madeyski","year":"2010","unstructured":"Madeyski, L., & Radyk, N. (2010). Judy\u2014A mutation testing tool for java. IET software, 4(1), 32\u201342.","journal-title":"IET software"},{"issue":"2","key":"9317_CR53","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1002\/stvr.308","volume":"15","author":"Y-S Ma","year":"2005","unstructured":"Ma, Y.-S., Offutt, J., & Kwon, Y. R. (2005). Mujava: An automated class mutation system. Software Testing, Verification and Reliability, 15(2), 97\u2013133.","journal-title":"Software Testing, Verification and Reliability"},{"key":"9317_CR54","doi-asserted-by":"crossref","unstructured":"Mathur, A. (1991). Performance, effectiveness, and reliability issues in software testing. In Annual international computer software and applications conference, COMPSAC (pp. 604\u2013605), 1991.","DOI":"10.1109\/CMPSAC.1991.170248"},{"issue":"1","key":"9317_CR55","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1002\/stvr.4370040104","volume":"4","author":"AP Mathur","year":"1994","unstructured":"Mathur, A. P., & Wong, W. E. (1994). An empirical comparison of data flow and mutation-based test adequacy criteria. Software Testing, Verification and Reliability, 4(1), 9\u201331.","journal-title":"Software Testing, Verification and Reliability"},{"key":"9317_CR56","unstructured":"Moore, I. (2001). Jester\u2014a junit test tester. In International conference on extreme programming (pp. 84\u201387)."},{"key":"9317_CR57","doi-asserted-by":"crossref","unstructured":"Namin, A. S., & Andrews, J. H. (2009). The influence of size and coverage on test suite effectiveness. In ACM SIGSOFT international symposium on software testing and analysis (pp. 57\u201368). ACM.","DOI":"10.1145\/1572272.1572280"},{"key":"9317_CR58","unstructured":"Namin, A. S., Andrews, J. H., & Murdoch, D. J. (2008). Sufficient mutation operators for measuring test effectiveness. In International conference on software engineering (pp. 351\u2013360). ACM."},{"key":"9317_CR59","doi-asserted-by":"crossref","unstructured":"Nanavati, J., Wu, F., Harman, M., Jia, Y., & Krinke, J. (2015). Mutation testing of memory-related operators. In Software testing, verification and validation workshops (ICSTW), 2015 IEEE eighth international conference on (pp. 1\u201310). IEEE.","DOI":"10.1109\/ICSTW.2015.7107449"},{"key":"9317_CR60","doi-asserted-by":"crossref","unstructured":"Nica, S., & Wotawa, F. (2012). Using constraints for equivalent mutant detection. In Workshop on formal methods in the development of software, WS-FMDS (pp. 1\u20138).","DOI":"10.4204\/EPTCS.86.1"},{"issue":"4","key":"9317_CR61","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1145\/566171.566213","volume":"27","author":"JW Nimmer","year":"2002","unstructured":"Nimmer, J. W., & Ernst, M. D. (2002). Automatic generation of program specifications. ACM SIGSOFT Software Engineering Notes, 27(4), 229\u2013239.","journal-title":"ACM SIGSOFT Software Engineering Notes"},{"key":"9317_CR62","unstructured":"Offut, J. (2016a). Problems with jester. https:\/\/cs.gmu.edu\/offutt\/documents\/personal\/jester-anal.html ."},{"key":"9317_CR63","unstructured":"Offut, J. (2016b). Problems with parasoft insure++. https:\/\/cs.gmu.edu\/offutt\/documents\/handouts\/parasoft-anal.html ."},{"key":"9317_CR64","unstructured":"Offutt, J. (2016). Insure++ critique. https:\/\/cs.gmu.edu\/offutt\/documents\/handouts\/parasoft-anal.html ."},{"key":"9317_CR65","unstructured":"Offutt, A. J., & Untch, R. H. (2000). Mutation, uniting the orthogonal. In Mutation testing for the new century (pp. 34\u201344). Springer, 2001."},{"key":"9317_CR66","unstructured":"Offutt, A. J., & Voas, J. M. (1996). \u2018Subsumption of condition coverage techniques by mutation testing. Technical report ISSE-TR-96-01. Information and Software Systems Engineering. Tech. rep.: George Mason University."},{"key":"9317_CR67","doi-asserted-by":"crossref","unstructured":"Offutt, A. J., Rothermel, G., & Zapf, C. (1993). An experimental evaluation of selective mutation. In International conference on software engineering (pp. 100\u2013107). IEEE Computer Society Press.","DOI":"10.1109\/ICSE.1993.346062"},{"issue":"8","key":"9317_CR68","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1145\/75309.75324","volume":"14","author":"AJ Offutt","year":"1989","unstructured":"Offutt, A. J. (1989). The coupling effect: Fact or fiction? ACM SIGSOFT Software Engineering Notes, 14(8), 131\u2013140.","journal-title":"ACM SIGSOFT Software Engineering Notes"},{"issue":"1","key":"9317_CR69","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1145\/125489.125473","volume":"1","author":"AJ Offutt","year":"1992","unstructured":"Offutt, A. J. (1992). Investigations of the software testing coupling effect. ACM Transactions on Software Engineering and Methodology, 1(1), 5\u201320.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"issue":"3","key":"9317_CR70","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1002\/stvr.4370040303","volume":"4","author":"AJ Offutt","year":"1994","unstructured":"Offutt, A. J., & Craft, W. M. (1994). Using compiler optimization techniques to detect equivalent mutants. Software Testing, Verification and Reliability, 4(3), 131\u2013154.","journal-title":"Software Testing, Verification and Reliability"},{"issue":"2","key":"9317_CR71","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/227607.227610","volume":"5","author":"AJ Offutt","year":"1996","unstructured":"Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., & Zapf, C. (1996). An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology, 5(2), 99\u2013118.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"issue":"3","key":"9317_CR72","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1002\/(SICI)1099-1689(199709)7:3<165::AID-STVR143>3.0.CO;2-U","volume":"7","author":"AJ Offutt","year":"1997","unstructured":"Offutt, A. J., & Pan, J. (1997). Automatically detecting equivalent mutants and infeasible paths. Software Testing, Verification and Reliability, 7(3), 165\u2013192.","journal-title":"Software Testing, Verification and Reliability"},{"key":"9317_CR73","unstructured":"Okun, V. (2004). Specification mutation for test generation and analysis. Ph.D. dissertation, University of Maryland Baltimore County."},{"key":"9317_CR74","doi-asserted-by":"crossref","unstructured":"Papadakis, M., Jia, Y., Harman, M., & Traon, Y. L. (2015). Trivial compiler equivalence: A large scale empirical study of a simple, fast and effective equivalent mutant detection technique. In International conference on software engineering.","DOI":"10.1109\/ICSE.2015.103"},{"key":"9317_CR75","unstructured":"Parasoft. (2014). Insure++. www.parasoft.com\/products\/insure\/papers\/tech_mut.htm ."},{"key":"9317_CR76","unstructured":"Parasoft. (2015). Insure++ mutation analysis. http:\/\/www.parasoft.com\/jsp\/products\/article.jsp?articleId=291&product=Insure ."},{"key":"9317_CR77","doi-asserted-by":"crossref","unstructured":"Schuler, D., & Zeller, A. (2009). Javalanche: Efficient mutation testing for java. In ACM SIGSOFT symposium on the foundations of software engineering (pp. 297\u2013298). August, 2009.","DOI":"10.1145\/1595696.1595750"},{"key":"9317_CR78","doi-asserted-by":"crossref","unstructured":"Schuler, D., Dallmeier, V., & Zeller, A. (2009). Efficient mutation testing by checking invariant violations. In ACM SIGSOFT international symposium on software testing and analysis (pp. 69\u201380). ACM.","DOI":"10.1145\/1572272.1572282"},{"issue":"5","key":"9317_CR79","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1002\/stvr.1473","volume":"23","author":"D Schuler","year":"2013","unstructured":"Schuler, D., & Zeller, A. (2013). Covering and uncovering equivalent mutants. Software Testing, Verification and Reliability, 23(5), 353\u2013374.","journal-title":"Software Testing, Verification and Reliability"},{"issue":"1","key":"9317_CR80","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1145\/584091.584093","volume":"5","author":"CE Shannon","year":"2001","unstructured":"Shannon, C. E. (2001). A mathematical theory of communication. ACM SIGMOBILE Mobile Computing and Communications Review, 5(1), 3\u201355.","journal-title":"ACM SIGMOBILE Mobile Computing and Communications Review"},{"issue":"11","key":"9317_CR81","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5815\/ijmecs.2014.11.01","volume":"6","author":"PK Singh","year":"2014","unstructured":"Singh, P. K., Sangwan, O. P., & Sharma, A. (2014). A study and review on the development of mutation testing tools for java and aspect-j programs. International Journal of Modern Education and Computer Science (IJMECS), 6(11), 1.","journal-title":"International Journal of Modern Education and Computer Science (IJMECS)"},{"key":"9317_CR82","doi-asserted-by":"crossref","unstructured":"Smith, B. H., & Williams, L. (2007). An empirical evaluation of the mujava mutation operators. In Testing: academic and industrial conference practice and research techniques-MUTATION, 2007. TAICPART-MUTATION 2007 (pp. 193\u2013202). IEEE.","DOI":"10.1109\/TAIC.PART.2007.12"},{"key":"9317_CR83","doi-asserted-by":"crossref","unstructured":"Sridharan, M., & Namin, A. S. (2010). Prioritizing mutation operators based on importance sampling. In International symposium on software reliability engineering (pp. 378\u2013387). IEEE.","DOI":"10.1109\/ISSRE.2010.16"},{"key":"9317_CR84","doi-asserted-by":"crossref","unstructured":"Untch, R. H. (2009). On reduced neighborhood mutation analysis using a single mutagenic operator. In Annual southeast regional conference, ser. ACM-SE 47 (pp. 71:1\u201371:4). New York, NY: ACM.","DOI":"10.1145\/1566445.1566540"},{"key":"9317_CR85","unstructured":"Usaola, M. P., & Mateo, P. R. (2012). Bacterio: Java mutation testing tool: A framework to evaluate quality of tests cases. In Proceedings of the 2012 IEEE international conference on software maintenance (ICSM), ser. ICSM\u201912 (pp. 646\u2013649). Washington, DC: IEEE Computer Society."},{"issue":"1","key":"9317_CR86","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/(SICI)1099-1689(200003)10:1<3::AID-STVR196>3.0.CO;2-P","volume":"10","author":"KSHT Wah","year":"2000","unstructured":"Wah, K. S. H. T. (2000). A theoretical study of fault coupling. Software Testing, Verification and Reliability, 10(1), 3\u201345.","journal-title":"Software Testing, Verification and Reliability"},{"issue":"2","key":"9317_CR87","first-page":"119","volume":"48","author":"KSHT Wah","year":"2003","unstructured":"Wah, K. S. H. T. (2003). An analysis of the coupling effect i: Single test data. Science of Computer Programming, 48(2), 119\u2013161.","journal-title":"Science of Computer Programming"},{"issue":"1","key":"9317_CR88","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1147\/rd.41.0066","volume":"4","author":"S Watanabe","year":"1960","unstructured":"Watanabe, S. (1960). Information theoretical analysis of multivariate correlation. IBM Journal of Research and Development, 4(1), 66\u201382.","journal-title":"IBM Journal of Research and Development"},{"key":"9317_CR89","unstructured":"Wong, W. E. (1993). On mutation and data flow. Ph.D. dissertation, Purdue University, West Lafayette, IN, USA, uMI Order No. GAX94-20921."},{"issue":"3","key":"9317_CR90","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0164-1212(94)00098-0","volume":"31","author":"W Wong","year":"1995","unstructured":"Wong, W., & Mathur, A. P. (1995). Reducing the cost of mutation testing: An empirical study. Journal of Systems and Software, 31(3), 185\u2013196.","journal-title":"Journal of Systems and Software"},{"key":"9317_CR91","doi-asserted-by":"crossref","unstructured":"Yao, X., Harman, M., & Jia, Y. (2014). A study of equivalent and stubborn mutation operators using human analysis of equivalence. In International conference on software engineering (pp. 919\u2013930).","DOI":"10.1145\/2568225.2568265"},{"key":"9317_CR92","doi-asserted-by":"crossref","unstructured":"Zhang, L., Gligoric, M., Marinov, D., & Khurshid, S. (2013). Operator-based and random mutant selection: Better together. In IEEE\/ACM automated software engineering. ACM.","DOI":"10.1109\/ASE.2013.6693070"},{"key":"9317_CR93","doi-asserted-by":"crossref","unstructured":"Zhang, L., Hou, S.-S., Hu, J.-J., Xie, T., & Mei, H. (2010). Is operator-based mutant selection superior to random mutant selection? In International conference on software engineering (pp. 435\u2013444). New York, NY: ACM.","DOI":"10.1145\/1806799.1806863"},{"key":"9317_CR94","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhu, M., Hao, D., & Zhang, L. (2014). An empirical study on the scalability of selective mutation testing. In International symposium on software reliability engineering. ACM.","DOI":"10.1109\/ISSRE.2014.27"},{"key":"9317_CR95","doi-asserted-by":"crossref","unstructured":"Zhou, C., & Frankl, P. (2009). Mutation testing for java database applications. In Software testing verification and validation, ICST\u201909. International conference on (pp. 396\u2013405). IEEE, 2009.","DOI":"10.1109\/ICST.2009.43"}],"container-title":["Software Quality Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11219-016-9317-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-016-9317-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-016-9317-7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11219-016-9317-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,7]],"date-time":"2019-09-07T13:31:26Z","timestamp":1567863086000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11219-016-9317-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,10]]},"references-count":95,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9]]}},"alternative-id":["9317"],"URL":"https:\/\/doi.org\/10.1007\/s11219-016-9317-7","relation":{},"ISSN":["0963-9314","1573-1367"],"issn-type":[{"value":"0963-9314","type":"print"},{"value":"1573-1367","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,5,10]]}}}