{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T21:07:39Z","timestamp":1774732059816,"version":"3.50.1"},"reference-count":87,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T00:00:00Z","timestamp":1758153600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T00:00:00Z","timestamp":1758153600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"the T\u00dcB\u0130TAK 2219 International Postdoctoral Research Fellowship Program","award":["1059B192300060"],"award-info":[{"award-number":["1059B192300060"]}]},{"name":"State Key Laboratory of Complex and Critical Software Environment","award":["CCSE-2024ZX-01"],"award-info":[{"award-number":["CCSE-2024ZX-01"]}]},{"name":"the Fundamental Research Funds for the Central Universities"},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["864972"],"award-info":[{"award-number":["864972"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Autom Softw Eng"],"published-print":{"date-parts":[[2026,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Search-Based Software Testing (SBST) has seen several success stories in academia and industry. The effectiveness of a search algorithm at solving a software engineering problem strongly depends on how such algorithm can navigate the\n                    <jats:italic>fitness landscape<\/jats:italic>\n                    of the addressed problem. The fitness landscape depends on the used fitness function. Understanding the properties of a fitness landscape can help to provide insight on how a search algorithm behaves on it. Such insight can provide valuable information to researchers to being able to design novel, more effective search algorithms and fitness functions tailored for a specific problem. Due to its importance, few fitness landscape analyses have been carried out in the scientific literature of SBST. However, those have been focusing on the problem of\n                    <jats:italic>unit test<\/jats:italic>\n                    generation, e.g., with state-of-the-art tools such as EvoSuite. In this paper, we\n                    <jats:italic>replicate<\/jats:italic>\n                    one such existing study. However, in our work we focus on\n                    <jats:italic>system test<\/jats:italic>\n                    generation, with the state-of-the-art tool\n                    <jats:sc>EvoMaster<\/jats:sc>\n                    . Based on an empirical study involving the testing of 23 web services, this enables us to provide valuable insight into this important testing domain of practical industrial relevance. Our results indicate that fitness landscapes are largely dominated by neutral regions (e.g., plateaus), which make the search process challenging. We observe that the presence of information content in the landscape can improve search guidance, while boolean flags are a primary contributor to neutrality. These findings confirm prior results in unit testing but also reveal system-level differences, particularly in how branch types impact search effectiveness. These insights suggest the need for improved fitness functions, testability transformations, and search operators tailored to system-level testing.\n                  <\/jats:p>","DOI":"10.1007\/s10515-025-00539-z","type":"journal-article","created":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T11:13:58Z","timestamp":1758194038000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Causes and effects of fitness landscapes in system test generation: a replication study"],"prefix":"10.1007","volume":"33","author":[{"given":"Omur","family":"Sahin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Man","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Arcuri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,9,18]]},"reference":[{"key":"539_CR1","doi-asserted-by":"crossref","unstructured":"Albunian, N., Fraser, G., Sudholt, D: Causes and effects of fitness landscapes in unit test generation. In: Proceedings of the 2020 Genetic and Evolutionary Computation Conference, pp. 1204\u20131212 (2020)","DOI":"10.1145\/3377930.3390194"},{"key":"539_CR2","doi-asserted-by":"crossref","unstructured":"Aleti, A., Moser, I.: Fitness landscape characterisation for constrained software architecture optimisation problems. In: 2015 20th International Conference on Engineering of Complex Computer Systems (ICECCS), IEEE, pp. 11\u201320 (2015)","DOI":"10.1109\/ICECCS.2015.12"},{"key":"539_CR3","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1007\/s10515-016-0197-7","volume":"24","author":"A Aleti","year":"2017","unstructured":"Aleti, A., Moser, I., Grunske, L.: Analysing the fitness landscape of search-based software testing problems. Autom. Softw. Eng. 24, 603\u2013621 (2017)","journal-title":"Autom. Softw. Eng."},{"issue":"6","key":"539_CR4","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1109\/TSE.2009.52","volume":"36","author":"S Ali","year":"2010","unstructured":"Ali, S., Briand, L., Hemmati, H., et al.: A systematic review of the application and empirical investigation of search-based test-case generation. IEEE Trans. Softw. Eng. (TSE) 36(6), 742\u2013762 (2010)","journal-title":"IEEE Trans. Softw. Eng. (TSE)"},{"issue":"3","key":"539_CR5","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1002\/stvr.354","volume":"16","author":"M Alshraideh","year":"2006","unstructured":"Alshraideh, M., Bottaci, L.: Search-based software test data generation for string data using program-specific search operators. Softw. Test. Verif. Reliabil. (STVR) 16(3), 175\u2013203 (2006)","journal-title":"Softw. Test. Verif. Reliabil. (STVR)"},{"key":"539_CR6","doi-asserted-by":"crossref","unstructured":"Arcuri, A.: Many Independent Objective (MIO) Algorithm for Test Suite Generation. In: International Symposium on Search Based Software Engineering (SSBSE), pp. 3\u201317 (2017)","DOI":"10.1007\/978-3-319-66299-2_1"},{"key":"539_CR7","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/j.infsof.2018.05.003","volume":"104","author":"A Arcuri","year":"2018","unstructured":"Arcuri, A.: Test suite generation with the Many Independent Objective (MIO) algorithm. Inf. Softw. Technol. 104, 195\u2013206 (2018)","journal-title":"Inf. Softw. Technol."},{"issue":"1","key":"539_CR8","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1145\/3293455","volume":"28","author":"A Arcuri","year":"2019","unstructured":"Arcuri, A.: RESTful API Automated Test Case Generation with EvoMaster. ACM Trans. Softw. Eng. Methodol. (TOSEM) 28(1), 3 (2019)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"},{"issue":"3","key":"539_CR9","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/MS.2020.3013820","volume":"38","author":"A Arcuri","year":"2020","unstructured":"Arcuri, A.: Automated black-and white-box testing of restful apis with evomaster. IEEE Softw. 38(3), 72\u201378 (2020)","journal-title":"IEEE Softw."},{"issue":"3","key":"539_CR10","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1002\/stvr.1486","volume":"24","author":"A Arcuri","year":"2014","unstructured":"Arcuri, A., Briand, L.: A Hitchhiker\u2019s Guide to Statistical Tests for Assessing Randomized Algorithms in Software Engineering. Softw. Test. Verif. Reliabil. (STVR) 24(3), 219\u2013250 (2014)","journal-title":"Softw. Test. Verif. Reliabil. (STVR)"},{"issue":"3","key":"539_CR11","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1007\/s10664-013-9249-9","volume":"18","author":"A Arcuri","year":"2013","unstructured":"Arcuri, A., Fraser, G.: Parameter tuning or default values? An empirical investigation in search-based software engineering. Empir. Softw. Eng. (EMSE) 18(3), 594\u2013623 (2013)","journal-title":"Empir. Softw. Eng. (EMSE)"},{"issue":"4","key":"539_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3391533","volume":"29","author":"A Arcuri","year":"2020","unstructured":"Arcuri, A., Galeotti, J.P.: Handling SQL databases in automated system test generation. ACM Trans. Softw. Eng. Methodol. (TOSEM) 29(4), 1\u201331 (2020)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"},{"key":"539_CR13","first-page":"153","volume-title":"2020 IEEE 13th International Conference on Software Testing","author":"A Arcuri","year":"2020","unstructured":"Arcuri, A., Galeotti, J.P.: Testability transformations for existing apis. In: 2020 IEEE 13th International Conference on Software Testing, pp. 153\u2013163. Validation and Verification (ICST), IEEE (2020)"},{"issue":"1","key":"539_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3477271","volume":"31","author":"A Arcuri","year":"2021","unstructured":"Arcuri, A., Galeotti, J.P.: Enhancing search-based testing with testability transformations for existing apis. ACM Trans. Softw. Eng. Methodol. (TOSEM) 31(1), 1\u201334 (2021)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"},{"issue":"1","key":"539_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3477271","volume":"31","author":"A Arcuri","year":"2021","unstructured":"Arcuri, A., Galeotti, J.P.: Enhancing Search-based Testing with Testability Transformations for Existing APIs. ACM Trans. Softw. Eng. Methodol. (TOSEM) 31(1), 1\u201334 (2021)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"},{"issue":"2","key":"539_CR16","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1109\/TSE.2011.121","volume":"38","author":"A Arcuri","year":"2012","unstructured":"Arcuri, A., Iqbal, M.Z., Briand, L.: Random testing: Theoretical results and practical implications. IEEE Trans. Softw. Eng. (TSE) 38(2), 258\u2013277 (2012)","journal-title":"IEEE Trans. Softw. Eng. (TSE)"},{"issue":"57","key":"539_CR17","doi-asserted-by":"publisher","first-page":"2153","DOI":"10.21105\/joss.02153","volume":"6","author":"A Arcuri","year":"2021","unstructured":"Arcuri, A., Galeotti, J.P., Marculescu, B., et al.: EvoMaster: A Search-Based System Test Generation Tool. J. Open Source Softw. 6(57), 2153 (2021)","journal-title":"J. Open Source Softw."},{"key":"539_CR18","doi-asserted-by":"crossref","unstructured":"Arcuri, A., Zhang, M., Galeotti, J.P.: Advanced white-box heuristics for search-based fuzzing of rest apis (2023a). arXiv:2309.08360","DOI":"10.1145\/3652157"},{"key":"539_CR19","first-page":"433","volume-title":"2023 IEEE Conference on Software Testing","author":"A Arcuri","year":"2023","unstructured":"Arcuri, A., Zhang, M., Golmohammadi, A., et al.: EMB: A curated corpus of web\/enterprise applications and library support for software testing research. In: 2023 IEEE Conference on Software Testing, pp. 433\u2013442. Verification and Validation (ICST), IEEE (2023)"},{"key":"539_CR20","doi-asserted-by":"crossref","unstructured":"Arcuri, A., Poth, A., Rrjolli, O.: Introducing black-box fuzz testing for rest apis in industry: Challenges and solutions. In: IEEE International Conference on Software Testing, Verification and Validation (ICST) (2025a)","DOI":"10.1109\/ICST62969.2025.10988923"},{"key":"539_CR21","doi-asserted-by":"publisher","unstructured":"Arcuri, A., Zhang, M., Golmohammadi, A., et\u00a0al.: Webfuzzing\/emb: v3.4.0 (2025b). https:\/\/doi.org\/10.5281\/zenodo.14597431","DOI":"10.5281\/zenodo.14597431"},{"key":"539_CR22","doi-asserted-by":"publisher","unstructured":"Arcuri, A., Zhang, M., Seran, S., et\u00a0al.: Webfuzzing\/evomaster: v3.4 (2025c). https:\/\/doi.org\/10.5281\/zenodo.14597412","DOI":"10.5281\/zenodo.14597412"},{"issue":"1","key":"539_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10515-024-00478-1","volume":"32","author":"A Arcuri","year":"2025","unstructured":"Arcuri, A., Zhang, M., Seran, S., et al.: Tool report: Evomaster\u2014black and white box search-based fuzzing for rest, graphql and rpc apis. Autom. Softw. Eng. 32(1), 1\u201311 (2025)","journal-title":"Autom. Softw. Eng."},{"key":"539_CR24","doi-asserted-by":"crossref","unstructured":"Atlidakis, V., Godefroid, P., Polishchuk, M.: Restler: Stateful REST API fuzzing. In: ACM\/IEEE International Conference on Software Engineering (ICSE), pp. 748\u2013758 (2019)","DOI":"10.1109\/ICSE.2019.00083"},{"key":"539_CR25","unstructured":"Barnett, L., et\u00a0al.: Ruggedness and neutrality-the nkp family of fitness landscapes. In: Artificial Life VI: Proceedings of the sixth international conference on Artificial life, pp. 18\u201327 (1998)"},{"key":"539_CR26","doi-asserted-by":"crossref","unstructured":"Belhadi, A., Zhang, M., Arcuri, A.: Random Testing and Evolutionary Testing for Fuzzing GraphQL APIs. ACM Transactions on the Web (2023)","DOI":"10.1145\/3609427"},{"key":"539_CR27","doi-asserted-by":"crossref","unstructured":"Bertolino, A.: Software testing research: Achievements, challenges, dreams. In: Future of Software Engineering, 2007. FOSE\u201907, IEEE, pp. 85\u2013103 (2007)","DOI":"10.1109\/FOSE.2007.25"},{"issue":"4","key":"539_CR28","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1002\/stvr.1470","volume":"23","author":"M Bozkurt","year":"2013","unstructured":"Bozkurt, M., Harman, M., Hassoun, Y.: Testing and verification in service-oriented architecture: a survey. Softw. Test. Verif. Reliabil. (STVR) 23(4), 261\u2013313 (2013)","journal-title":"Softw. Test. Verif. Reliabil. (STVR)"},{"key":"539_CR29","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/j.infsof.2018.08.010","volume":"104","author":"J Campos","year":"2018","unstructured":"Campos, J., Ge, Y., Albunian, N., et al.: An empirical evaluation of evolutionary algorithms for unit test suite generation. Inf. Softw. Technol. (IST) 104, 207\u2013235 (2018)","journal-title":"Inf. Softw. Technol. (IST)"},{"key":"539_CR30","doi-asserted-by":"crossref","unstructured":"Canfora, G., Di\u00a0Penta, M.: Service-oriented architectures testing: A survey. In: Software Engineering. Springer, pp. 78\u2013105 (2009)","DOI":"10.1007\/978-3-540-95888-8_4"},{"key":"539_CR31","doi-asserted-by":"crossref","unstructured":"Chicano, F., Ferrer, J., Alba, E.: Elementary landscape decomposition of the test suite minimization problem. In: Search Based Software Engineering: Third International Symposium, SSBSE 2011, Szeged, Hungary, September 10-12, 2011. Proceedings 3, Springer, pp. 48\u201363 (2011)","DOI":"10.1007\/978-3-642-23716-4_7"},{"key":"539_CR32","doi-asserted-by":"crossref","unstructured":"Corradini, D., Montolli, Z., Pasqua, M., et\u00a0al.: Deeprest: Automated test case generation for rest apis exploiting deep reinforcement learning. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, pp. 1383\u20131394 (2024)","DOI":"10.1145\/3691620.3695511"},{"issue":"2","key":"539_CR33","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/4236.991449","volume":"6","author":"F Curbera","year":"2002","unstructured":"Curbera, F., Duftler, M., Khalaf, R., et al.: Unraveling the web services web: an introduction to soap, wsdl, and uddi. IEEE Internet Comput. 6(2), 86\u201393 (2002)","journal-title":"IEEE Internet Comput."},{"key":"539_CR34","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/S0304-3975(01)00182-7","volume":"276","author":"S Droste","year":"2002","unstructured":"Droste, S., Jansen, T., Wegener, I.: On the analysis of the (1+1) evolutionary algorithm. Theoret. Comput. Sci. 276, 51\u201381 (2002)","journal-title":"Theoret. Comput. Sci."},{"issue":"4","key":"539_CR35","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1109\/TSE.1984.5010257","volume":"10","author":"JW Duran","year":"1984","unstructured":"Duran, J.W., Ntafos, S.C.: An evaluation of random testing. IEEE Trans. Softw. Eng. (TSE) 10(4), 438\u2013444 (1984)","journal-title":"IEEE Trans. Softw. Eng. (TSE)"},{"key":"539_CR36","unstructured":"Fielding, R.T.: Architectural styles and the design of network-based software architectures. PhD thesis, University of California, Irvine (2000)"},{"key":"539_CR37","doi-asserted-by":"crossref","unstructured":"Fraser, G., Arcuri, A.: EvoSuite: Automatic Test Suite Generation for Object-Oriented Software. In: Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, pp. 416\u2013419 (2011)","DOI":"10.1145\/2025113.2025179"},{"key":"539_CR38","doi-asserted-by":"crossref","unstructured":"Fraser, G., Arcuri, A.: Evosuite at the SBST 2013 tool competition. In: International Workshop on Search-Based Software Testing (SBST), pp. 406\u2013409 (2013a)","DOI":"10.1109\/ICSTW.2013.53"},{"issue":"2","key":"539_CR39","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1109\/TSE.2012.14","volume":"39","author":"G Fraser","year":"2013","unstructured":"Fraser, G., Arcuri, A.: Whole test suite generation. IEEE Trans. Software Eng. 39(2), 276\u2013291 (2013)","journal-title":"IEEE Trans. Software Eng."},{"issue":"8","key":"539_CR40","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1109\/32.624304","volume":"23","author":"MJ Gallagher","year":"1997","unstructured":"Gallagher, M.J., Narasimhan, V.L.: Adtest: A test data generation suite for ada software systems. IEEE Trans. Softw. Eng. (TSE) 23(8), 473\u2013484 (1997)","journal-title":"IEEE Trans. Softw. Eng. (TSE)"},{"key":"539_CR41","doi-asserted-by":"crossref","unstructured":"Golmohammadi, A., Zhang, M., Arcuri, A.: NET\/C# instrumentation for search-based software testing. Softw. Qual. J. 1\u201327 (2023)","DOI":"10.1007\/s11219-023-09645-1"},{"key":"539_CR42","doi-asserted-by":"crossref","unstructured":"Golmohammadi, A., Zhang, M., Arcuri, A.: On the Impact of Tool Evolution and Case Study Size on SBSE Experiments: A Replicated Study with EvoMaster. In: International Symposium on Search Based Software Engineering, Springer, pp. 108\u2013122 (2023b)","DOI":"10.1007\/978-3-031-48796-5_8"},{"key":"539_CR43","doi-asserted-by":"publisher","unstructured":"Golmohammadi, A., Zhang, M., Arcuri, A.: Testing restful apis: A survey. ACM Trans. Softw. Eng. Methodol. (2023). https:\/\/doi.org\/10.1145\/3617175","DOI":"10.1145\/3617175"},{"issue":"14","key":"539_CR44","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1016\/S0950-5849(01)00189-6","volume":"43","author":"M Harman","year":"2001","unstructured":"Harman, M., Jones, B.F.: Search-based software engineering. J. Inf. Softw. Technol. 43(14), 833\u2013839 (2001)","journal-title":"J. Inf. Softw. Technol."},{"key":"539_CR45","unstructured":"Harman, M., Hu, L., Hierons, R., et\u00a0al.: Improving evolutionary testing by flag removal. In: Genetic and Evolutionary Computation Conference (GECCO), pp. 1351\u20131358 (2002)"},{"issue":"1","key":"539_CR46","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1109\/TSE.2004.1265732","volume":"30","author":"M Harman","year":"2004","unstructured":"Harman, M., Hu, L., Hierons, R., et al.: Testability transformation. IEEE Trans. Software Eng. 30(1), 3\u201316 (2004)","journal-title":"IEEE Trans. Software Eng."},{"issue":"1","key":"539_CR47","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1145\/2379776.2379787","volume":"45","author":"M Harman","year":"2012","unstructured":"Harman, M., Mansouri, S.A., Zhang, Y.: Search-based software engineering: Trends, techniques and applications. ACM Comput. Surv. (CSUR) 45(1), 11 (2012)","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"539_CR48","doi-asserted-by":"crossref","unstructured":"Hatfield-Dodds, Z., Dygalo, D.: Deriving semantics-aware fuzzers from web api schemas. In: 2022 IEEE\/ACM 44th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), IEEE, pp. 345\u2013346 (2022)","DOI":"10.1109\/ICSE-Companion55297.2022.9793781"},{"issue":"1","key":"539_CR49","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/scientificamerican0792-66","volume":"267","author":"JH Holland","year":"1992","unstructured":"Holland, J.H.: Genetic algorithms. Scientif. Am. 267(1), 66\u201373 (1992)","journal-title":"Scientif. Am."},{"key":"539_CR50","doi-asserted-by":"crossref","unstructured":"Kim, M., Sinha, S., Orso, A.: Adaptive rest api testing with reinforcement learning. In: 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE), IEEE, pp. 446\u2013458 (2023)","DOI":"10.1109\/ASE56229.2023.00218"},{"issue":"8","key":"539_CR51","doi-asserted-by":"publisher","first-page":"870","DOI":"10.1109\/32.57624","volume":"16","author":"B Korel","year":"1990","unstructured":"Korel, B.: Automated software test data generation. IEEE Trans. Software Eng. 16(8), 870\u2013879 (1990)","journal-title":"IEEE Trans. Software Eng."},{"key":"539_CR52","doi-asserted-by":"crossref","unstructured":"Kotelyanskii, A., Kapfhammer, G.M.: Parameter tuning for search-based test-data generation revisited: Support for previous results. In: 2014 14th International Conference on Quality Software, IEEE, pp 79\u201384 (2014)","DOI":"10.1109\/QSIC.2014.43"},{"key":"539_CR53","doi-asserted-by":"publisher","first-page":"24738","DOI":"10.1109\/ACCESS.2021.3056505","volume":"9","author":"N Laranjeiro","year":"2021","unstructured":"Laranjeiro, N., Agnelo, J., Bernardino, J.: A black box tool for robustness testing of rest services. IEEE Access 9, 24738\u201324754 (2021)","journal-title":"IEEE Access"},{"key":"539_CR54","doi-asserted-by":"crossref","unstructured":"Lefticaru, R., Ipate, F.: A comparative landscape analysis of fitness functions for search-based testing. In: 2008 10th international symposium on symbolic and numeric algorithms for scientific computing, IEEE, pp. 201\u2013208 (2008)","DOI":"10.1109\/SYNASC.2008.69"},{"key":"539_CR55","doi-asserted-by":"crossref","unstructured":"Liu, Y., Li, Y., Deng, G., et\u00a0al.: Morest: Model-based restful api testing with execution feedback. In: ACM\/IEEE International Conference on Software Engineering (ICSE) (2022)","DOI":"10.1145\/3510003.3510133"},{"key":"539_CR56","doi-asserted-by":"crossref","unstructured":"Lu, G., Bahsoon, R., Yao, X.: Applying Elementary Landscape Analysis to Search-Based Software Engineering. In: International Symposium on Search Based Software Engineering (SSBSE), pp. 3\u20138 (2010)","DOI":"10.1109\/SSBSE.2010.10"},{"key":"539_CR57","doi-asserted-by":"crossref","unstructured":"Lukasczyk, S., Fraser, G.: Pynguin: automated unit test generation for Python. In: Proceedings of the ACM\/IEEE 44th International Conference on Software Engineering: Companion Proceedings, pp. 168\u2013172 (2022)","DOI":"10.1145\/3510454.3516829"},{"key":"539_CR58","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.ins.2013.04.015","volume":"241","author":"KM Malan","year":"2013","unstructured":"Malan, K.M., Engelbrecht, A.P.: A survey of techniques for characterising fitness landscapes and some possible ways forward. Inf. Sci. 241, 148\u2013163 (2013)","journal-title":"Inf. Sci."},{"key":"539_CR59","first-page":"94","volume-title":"ACM Int","author":"K Mao","year":"2016","unstructured":"Mao, K., Harman, M., Jia, Y.: Sapienz: Multi-objective automated testing for android applications. In: ACM Int, pp. 94\u2013105. ACM, Symposium on Software Testing and Analysis (ISSTA) (2016)"},{"key":"539_CR60","doi-asserted-by":"crossref","unstructured":"Martin-Lopez, A., Segura, S., Ruiz-Cort\u00e9s, A.: RESTest: Automated Black-Box Testing of RESTful Web APIs. In: ACM Int. Symposium on Software Testing and Analysis (ISSTA). ACM, pp. 682\u2013685 (2021)","DOI":"10.1145\/3460319.3469082"},{"issue":"2","key":"539_CR61","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/stvr.294","volume":"14","author":"P McMinn","year":"2004","unstructured":"McMinn, P.: Search-based software test data generation: A survey. Softw. Test. Verif. Reliabil. 14(2), 105\u2013156 (2004)","journal-title":"Softw. Test. Verif. Reliabil."},{"issue":"6","key":"539_CR62","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1093\/beheco\/arh107","volume":"15","author":"S Nakagawa","year":"2004","unstructured":"Nakagawa, S.: A farewell to Bonferroni: the problems of low statistical power and publication bias. Behav. Ecol. 15(6), 1044\u20131045 (2004)","journal-title":"Behav. Ecol."},{"key":"539_CR63","unstructured":"Newman, S.: Building microservices. \" O\u2019Reilly Media, Inc.\" (2021)"},{"issue":"2","key":"539_CR64","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TSE.2017.2663435","volume":"44","author":"A Panichella","year":"2018","unstructured":"Panichella, A., Kifetew, F., Tonella, P.: Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets. IEEE Trans. Softw. Eng. (TSE) 44(2), 122\u2013158 (2018)","journal-title":"IEEE Trans. Softw. Eng. (TSE)"},{"key":"539_CR65","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1136\/bmj.316.7139.1236","volume":"316","author":"T Perneger","year":"1998","unstructured":"Perneger, T.: What\u2019s wrong with Bonferroni adjustments. BMJ 316, 1236\u20131238 (1998)","journal-title":"BMJ"},{"key":"539_CR66","doi-asserted-by":"crossref","unstructured":"Pitzer, E., Affenzeller, M.: A comprehensive survey on fitness landscape analysis. Recent advances in intelligent engineering systems pp. 161\u2013191 (2012)","DOI":"10.1007\/978-3-642-23229-9_8"},{"issue":"1","key":"539_CR67","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s10515-024-00477-2","volume":"32","author":"A Poth","year":"2025","unstructured":"Poth, A., Rrjolli, O., Arcuri, A.: Technology adoption performance evaluation applied to testing industrial rest apis. Autom. Softw. Eng. 32(1), 5 (2025)","journal-title":"Autom. Softw. Eng."},{"issue":"10","key":"539_CR68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3561818","volume":"55","author":"A Qui\u00f1a-Mera","year":"2023","unstructured":"Qui\u00f1a-Mera, A., Fernandez, P., Garc\u00eda, J.M., et al.: Graphql: A systematic mapping study. ACM Comput. Surv. 55(10), 1\u201335 (2023)","journal-title":"ACM Comput. Surv."},{"key":"539_CR69","unstructured":"Rajesh, R.: Spring Microservices. Packt Publishing Ltd (2016)"},{"key":"539_CR70","doi-asserted-by":"publisher","unstructured":"Sahin, O., Zhang, M., Arcuri, A.: Replication package for causes and effects of fitness landscapes in system test generation: A replication study. (2025). https:\/\/doi.org\/10.5281\/zenodo.14764981","DOI":"10.5281\/zenodo.14764981"},{"key":"539_CR71","doi-asserted-by":"crossref","unstructured":"Sayyad, A.S., Goseva-Popstojanova, K., Menzies, T., et\u00a0al.: On Parameter Tuning in Search Based Software Engineering: A Replicated Empirical Study. In: 2013 3rd International Workshop on Replication in Empirical Software Engineering Research, IEEE, pp. 84\u201390 (2013)","DOI":"10.1109\/RESER.2013.6"},{"issue":"4","key":"539_CR72","doi-asserted-by":"publisher","first-page":"e1660","DOI":"10.1002\/stvr.1660","volume":"28","author":"S Shamshiri","year":"2018","unstructured":"Shamshiri, S., Rojas, J.M., Gazzola, L., et al.: Random or evolutionary search for object-oriented test suite generation? Softw. Test. Verif. Reliabil. 28(4), e1660 (2018)","journal-title":"Softw. Test. Verif. Reliabil."},{"issue":"8","key":"539_CR73","doi-asserted-by":"publisher","first-page":"3185","DOI":"10.1109\/TSE.2021.3083360","volume":"48","author":"V Tawosi","year":"2021","unstructured":"Tawosi, V., Sarro, F., Petrozziello, A., et al.: Multi-objective software effort estimation: A replication study. IEEE Trans. Software Eng. 48(8), 3185\u20133205 (2021)","journal-title":"IEEE Trans. Software Eng."},{"issue":"1","key":"539_CR74","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1162\/106365600568095","volume":"8","author":"VK Vassilev","year":"2000","unstructured":"Vassilev, V.K., Fogarty, T.C., Miller, J.F.: Information characteristics and the structure of landscapes. Evol. Comput. 8(1), 31\u201360 (2000)","journal-title":"Evol. Comput."},{"key":"539_CR75","doi-asserted-by":"crossref","unstructured":"Viglianisi, E., Dallago, M., Ceccato, M.: Resttestgen: Automated black-box testing of restful apis. In: IEEE International Conference on Software Testing, Verification and Validation (ICST), IEEE (2020)","DOI":"10.1109\/ICST46399.2020.00024"},{"key":"539_CR76","doi-asserted-by":"crossref","unstructured":"Vogel, T., Tran, C., Grunske, L.: (2019) Does diversity improve the test suite generation for mobile applications? In: International Symposium on Search Based Software Engineering, Springer, pp 58\u201374","DOI":"10.1007\/978-3-030-27455-9_5"},{"key":"539_CR77","doi-asserted-by":"publisher","first-page":"106436","DOI":"10.1016\/j.infsof.2020.106436","volume":"130","author":"T Vogel","year":"2021","unstructured":"Vogel, T., Tran, C., Grunske, L.: A comprehensive empirical evaluation of generating test suites for mobile applications with diversity. Inf. Softw. Technol. 130, 106436 (2021)","journal-title":"Inf. Softw. Technol."},{"issue":"1","key":"539_CR78","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/s10664-006-7551-5","volume":"12","author":"H Waeselynck","year":"2006","unstructured":"Waeselynck, H., Fosse, P.T., Kaddour, O.A.: Simulated annealing applied to test generation: landscape characterization and stopping criteria. Empir. Softw. Eng. 12(1), 35\u201363 (2006)","journal-title":"Empir. Softw. Eng."},{"key":"539_CR79","doi-asserted-by":"crossref","unstructured":"Wu, H., Xu, L., Niu, X., et\u00a0al.: Combinatorial testing of restful apis. In: ACM\/IEEE International Conference on Software Engineering (ICSE) (2022)","DOI":"10.1145\/3510003.3510151"},{"key":"539_CR80","doi-asserted-by":"crossref","unstructured":"Zhang, M., Arcuri, A.: Adaptive Hypermutation for Search-Based System Test Generation: A Study on REST APIs with EvoMaster. ACM Trans. Softw. Eng. Methodol. 31(1), (2021)","DOI":"10.1145\/3464940"},{"key":"539_CR81","doi-asserted-by":"crossref","unstructured":"Zhang, M., Arcuri, A.: Enhancing Resource-Based Test Case Generation for RESTful APIs with SQL Handling. In: International Symposium on Search Based Software Engineering, Springer, pp. 103\u2013117 (2021b)","DOI":"10.1007\/978-3-030-88106-1_8"},{"key":"539_CR82","doi-asserted-by":"publisher","unstructured":"Zhang, M., Arcuri, A.: Open Problems in Fuzzing RESTful APIs: A Comparison of Tools. ACM Transactions on Software Engineering and Methodology (TOSEM) (2023). https:\/\/doi.org\/10.1145\/3597205","DOI":"10.1145\/3597205"},{"issue":"4","key":"539_CR83","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-020-09937-1","volume":"26","author":"M Zhang","year":"2021","unstructured":"Zhang, M., Marculescu, B., Arcuri, A.: Resource and dependency based test case generation for RESTful Web services. Empir. Softw. Eng. 26(4), 1\u201361 (2021)","journal-title":"Empir. Softw. Eng."},{"issue":"5","key":"539_CR84","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3585009","volume":"32","author":"M Zhang","year":"2023","unstructured":"Zhang, M., Arcuri, A., Li, Y., et al.: White-Box Fuzzing RPC-Based APIs with EvoMaster: An Industrial Case Study. ACM Trans. Softw. Eng. Methodol. 32(5), 1\u201338 (2023)","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"539_CR85","doi-asserted-by":"crossref","unstructured":"Zhang, M., Belhadi, A., Arcuri, A.: Javascript sbst heuristics to enable effective fuzzing of nodejs web apis. ACM Trans. Softw. Eng. Methodol. (2023b)","DOI":"10.1145\/3593801"},{"key":"539_CR86","doi-asserted-by":"crossref","unstructured":"Zhang, M., Arcuri, A., Teng, P., et\u00a0al.: Seeding and mocking in white-box fuzzing enterprise rpc apis: An industrial case study. In: Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering, pp. 2024\u20132034 (2024)","DOI":"10.1145\/3691620.3695265"},{"key":"539_CR87","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/J.NEUCOM.2022.06.084","volume":"503","author":"F Zou","year":"2022","unstructured":"Zou, F., Chen, D., Liu, H., et al.: A survey of fitness landscape analysis for optimization. Neurocomputing 503, 129\u201313 (2022). https:\/\/doi.org\/10.1016\/J.NEUCOM.2022.06.084","journal-title":"Neurocomputing"}],"container-title":["Automated Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-025-00539-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10515-025-00539-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-025-00539-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T05:04:42Z","timestamp":1769231082000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10515-025-00539-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,18]]},"references-count":87,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,5]]}},"alternative-id":["539"],"URL":"https:\/\/doi.org\/10.1007\/s10515-025-00539-z","relation":{},"ISSN":["0928-8910","1573-7535"],"issn-type":[{"value":"0928-8910","type":"print"},{"value":"1573-7535","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,18]]},"assertion":[{"value":"31 January 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 September 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}