{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T02:49:20Z","timestamp":1768877360867,"version":"3.49.0"},"reference-count":100,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Research Council"},{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["864972"],"award-info":[{"award-number":["864972"]}]},{"name":"UBACYT-2020","award":["20020190100233BA, PICT-2019-01793"],"award-info":[{"award-number":["20020190100233BA, PICT-2019-01793"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2024,7,31]]},"abstract":"<jats:p>\n            Due to its importance and widespread use in industry, automated testing of REST APIs has attracted major interest from the research community in the last few years. However, most of the work in the literature has been focused on black-box fuzzing. Although existing fuzzers have been used to automatically find many faults in existing APIs, there are still several open research challenges that hinder the achievement of better results (e.g., in terms of code coverage and fault finding). For example, under-specified schemas are a major issue for black-box fuzzers. Currently,\n            <jats:sc>EvoMaster<\/jats:sc>\n            is the only existing tool that supports white-box fuzzing of REST APIs. In this paper, we provide a series of novel white-box heuristics, including for example how to deal with under-specified constrains in API schemas, as well as under-specified schemas in SQL databases. Our novel techniques are implemented as an extension to our open-source, search-based fuzzer\n            <jats:sc>EvoMaster<\/jats:sc>\n            . An empirical study on 14 APIs from the EMB corpus, plus one industrial API, shows clear improvements of the results in some of these APIs.\n          <\/jats:p>","DOI":"10.1145\/3652157","type":"journal-article","created":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T12:18:30Z","timestamp":1710159510000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Advanced White-Box Heuristics for Search-Based Fuzzing of REST APIs"],"prefix":"10.1145","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0799-2930","authenticated-orcid":false,"given":"Andrea","family":"Arcuri","sequence":"first","affiliation":[{"name":"Kristiania University College and Oslo Metropolitan University, Oslo, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1204-9322","authenticated-orcid":false,"given":"Man","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0747-8205","authenticated-orcid":false,"given":"Juan","family":"Galeotti","sequence":"additional","affiliation":[{"name":"University of Buenos Aires, CONICET and Kristiania University College, Buenos Aires, Argentina"}]}],"member":"320","published-online":{"date-parts":[[2024,6,27]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"[n.d.]. APIs.guru. Online Accessed March 26 2024 https:\/\/apis.guru\/"},{"key":"e_1_3_3_3_2","unstructured":"[n.d.]. EvoMaster. Online Accessed March 26 2024 https:\/\/github.com\/EMResearch\/EvoMaster"},{"key":"e_1_3_3_4_2","unstructured":"[n.d.]. EvoMaster Benchmark (EMB). Online Accessed March 26 2024 https:\/\/github.com\/EMResearch\/EMB"},{"key":"e_1_3_3_5_2","unstructured":"[n.d.]. Fuzz-lightyear: Stateful Fuzzing Framework. Online Accessed March 26 2024 https:\/\/github.com\/Yelp\/fuzz-lightyear"},{"key":"e_1_3_3_6_2","unstructured":"[n.d.]. GraphQL Foundation. Online Accessed March 26 2024 https:\/\/graphql.org\/foundation\/"},{"key":"e_1_3_3_7_2","unstructured":"[n.d.]. gRPC. Online Accessed March 26 2024 https:\/\/grpc.io\/"},{"key":"e_1_3_3_8_2","unstructured":"[n.d.]. Hibernate. Online Accessed March 26 2024 http:\/\/hibernate.org"},{"key":"e_1_3_3_9_2","unstructured":"[n.d.]. Language-agnostic HTTP API Testing Tool. Online Accessed March 26 2024 https:\/\/github.com\/apiaryio\/dredd"},{"key":"e_1_3_3_10_2","unstructured":"[n.d.]. OpenAPI\/Swagger. Online Accessed March 26 2024 https:\/\/swagger.io\/"},{"key":"e_1_3_3_11_2","unstructured":"[n.d.]. RapidAPI. Online Accessed March 26 2024 https:\/\/rapidapi.com\/"},{"key":"e_1_3_3_12_2","unstructured":"[n.d.]. RestAssured. Online Accessed March 26 2024 https:\/\/github.com\/rest-assured\/rest-assured"},{"key":"e_1_3_3_13_2","unstructured":"[n.d.]. Spring Framework. Online Accessed March 26 2024 https:\/\/spring.io"},{"key":"e_1_3_3_14_2","unstructured":"[n.d.]. SQL. Online Accessed March 26 2024 https:\/\/www.iso.org\/standard\/63555.html"},{"key":"e_1_3_3_15_2","unstructured":"[n.d.]. Tcases for OpenAPI: From REST-ful to Test-ful. Online Accessed March 26 2024 https:\/\/github.com\/Cornutum\/tcases\/tree\/master\/tcases-openapi"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.52"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-99241-9_1"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.v16:3"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.5555\/1152613.1152616"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/1152613.1152616"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2018.00046"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9570-9"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.05.003"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293455"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2020.3013820"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1486"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3391533"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477271"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.21105\/joss.02153"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7821550"},{"key":"e_1_3_3_31_2","first-page":"1","article-title":"Building an open-source system test generation tool: Lessons learned and empirical analyses with EvoMaster","author":"Arcuri Andrea","year":"2023","unstructured":"Andrea Arcuri, Man Zhang, Asma Belhadi, Bogdan Marculescu, Amid Golmohammadi, Juan Pablo Galeotti, and Susruthan Seran. 2023. Building an open-source system test generation tool: Lessons learned and empirical analyses with EvoMaster. Software Quality Journal (2023), 1\u201344.","journal-title":"Software Quality Journal"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7821607"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST57152.2023.00047"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00083"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007527"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45110-2_148"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3609427"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2000791.2000796"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2643002"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.29"},{"key":"e_1_3_3_41_2","article-title":"Automated black-box testing of mass assignment vulnerabilities in RESTful APIs","author":"Corradini Davide","year":"2023","unstructured":"Davide Corradini, Michele Pasqua, and Mariano Ceccato. 2023. Automated black-box testing of mass assignment vulnerabilities in RESTful APIs. arXiv preprint arXiv:2301.01261 (2023).","journal-title":"arXiv preprint arXiv:2301.01261"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1808"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.5555\/932295"},{"key":"e_1_3_3_44_2","first-page":"416","volume-title":"ACM Symposium on the Foundations of Software Engineering (FSE\u201911)","author":"Fraser Gordon","year":"2011","unstructured":"Gordon Fraser and Andrea Arcuri. 2011. EvoSuite: Automatic generation for object-oriented software. In ACM Symposium on the Foundations of Software Engineering (FSE\u201911). 416\u2013419."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227195"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2012.14"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.624304"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.3641116"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.07.006"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09711-y"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3363824"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2093548.2093564"},{"key":"e_1_3_3_53_2","first-page":"1","article-title":".NET\/C# instrumentation for search-based software testing","author":"Golmohammadi Amid","year":"2023","unstructured":"Amid Golmohammadi, Man Zhang, and Andrea Arcuri. 2023. .NET\/C# instrumentation for search-based software testing. Software Quality Journal (2023), 1\u201327.","journal-title":"Software Quality Journal"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617175"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-011-0568-8"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92970-5_1"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-78917-8_11"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1265732"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1265732"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/2379776.2379787"},{"key":"e_1_3_3_61_2","first-page":"345","volume-title":"2022 IEEE\/ACM 44th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion\u201922)","author":"Hatfield-Dodds Zac","year":"2022","unstructured":"Zac Hatfield-Dodds and Dmitry Dygalo. 2022. Deriving semantics-aware fuzzers from web API schemas. In 2022 IEEE\/ACM 44th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion\u201922). IEEE, 345\u2013346."},{"key":"e_1_3_3_62_2","article-title":"Automatic property-based testing of GraphQL APIs","author":"Karlsson Stefan","year":"2020","unstructured":"Stefan Karlsson, Adnan \u010cau\u0161evi\u0107, and Daniel Sundmark. 2020. Automatic property-based testing of GraphQL APIs. arXiv preprint arXiv:2012.07380 (2020).","journal-title":"arXiv preprint arXiv:2012.07380"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST46399.2020.00023"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598131"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534401"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.57624"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3056505"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23716-4_21"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397358"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510133"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2946563"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491038"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE52982.2021.00034"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2021.3050610"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-33702-5_31"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340433.3342822"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3469082"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1570127"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/1525880.1525884"},{"key":"e_1_3_3_80_2","volume-title":"Building Microservices","author":"Newman Sam","year":"2021","unstructured":"Sam Newman. 2021. Building Microservices. O\u2019Reilly Media, Inc."},{"key":"e_1_3_3_81_2","article-title":"The human side of fuzzing: Challenges faced by developers during fuzzing activities","author":"Nourry Olivier","year":"2023","unstructured":"Olivier Nourry, Gabriele Bavota, Michele Lanza, and Yasutaka Kamei. 2023. The human side of fuzzing: Challenges faced by developers during fuzzing activities. ACM Transactions on Software Engineering and Methodology (2023).","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_82_2","volume-title":"Spring Microservices","author":"Rajesh R. V.","year":"2016","unstructured":"R. V. Rajesh. 2016. Spring Microservices. Packt Publishing Ltd."},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1601"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/4235.735432"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3150618"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/SBFT59156.2023.00026"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST46399.2020.00024"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3449639.3459339"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.06.037"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510151"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00167"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST53961.2022.00014"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3464940"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597205"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3585009"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","unstructured":"Man Zhang Andrea Arcuri Yonggang Li Kaiming Xue Zhao Wang Jian Huo and Weiwei Huang. 2022. Fuzzing Microservices in Industry: Experience of Applying EvoMaster at Meituan. DOI:10.48550\/ARXIV.2208.03988","DOI":"10.48550\/ARXIV.2208.03988"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST53961.2022.00022"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593801"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/3321707.3321815"},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09937-1"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/3512345"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3652157","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3652157","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:14Z","timestamp":1750291394000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3652157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,27]]},"references-count":100,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,7,31]]}},"alternative-id":["10.1145\/3652157"],"URL":"https:\/\/doi.org\/10.1145\/3652157","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,27]]},"assertion":[{"value":"2023-09-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}