{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T21:40:14Z","timestamp":1769722814098,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,7,18]],"date-time":"2020-07-18T00:00:00Z","timestamp":1595030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,7,18]]},"DOI":"10.1145\/3395363.3397381","type":"proceedings-article","created":{"date-parts":[[2020,7,13]],"date-time":"2020-07-13T21:44:18Z","timestamp":1594676658000},"page":"249-259","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Debugging the performance of Maven\u2019s test isolation: experience report"],"prefix":"10.1145","author":[{"given":"Pengyu","family":"Nie","sequence":"first","affiliation":[{"name":"University of Texas at Austin, USA"}]},{"given":"Ahmet","family":"Celik","sequence":"additional","affiliation":[{"name":"Facebook, USA"}]},{"given":"Matthew","family":"Coley","sequence":"additional","affiliation":[{"name":"George Mason University, USA"}]},{"given":"Aleksandar","family":"Milicevic","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}]},{"given":"Jonathan","family":"Bell","sequence":"additional","affiliation":[{"name":"George Mason University, USA"}]},{"given":"Milos","family":"Gligoric","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,7,18]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Apache. 2018. Test XML file is not valid when rerun \"fails\" with an assumption. https:\/\/issues.apache.org\/jira\/projects\/SUREFIRE\/issues\/SUREFIRE-1556.  Apache. 2018. Test XML file is not valid when rerun \"fails\" with an assumption. https:\/\/issues.apache.org\/jira\/projects\/SUREFIRE\/issues\/SUREFIRE-1556."},{"key":"e_1_3_2_1_2_1","unstructured":"Apache. 2018. Thread Pool in Maven Surefire Code. https:\/\/github.com\/apache\/maven-surefire.  Apache. 2018. Thread Pool in Maven Surefire Code. https:\/\/github.com\/apache\/maven-surefire."},{"key":"e_1_3_2_1_3_1","unstructured":"Apache. 2019. Maven Surefire Plugin. https:\/\/maven.apache.org\/surefire\/mavensurefire-plugin\/.  Apache. 2019. Maven Surefire Plugin. https:\/\/maven.apache.org\/surefire\/mavensurefire-plugin\/."},{"key":"e_1_3_2_1_4_1","unstructured":"Apache. 2019. Maven Surefire Plugin-surefire:test. https:\/\/maven.apache.org\/ surefire\/maven-surefire-plugin\/test-mojo.html.  Apache. 2019. Maven Surefire Plugin-surefire:test. https:\/\/maven.apache.org\/ surefire\/maven-surefire-plugin\/test-mojo.html."},{"key":"e_1_3_2_1_5_1","unstructured":"Apache. 2019. Should Surefire specialize test runner when test isolation (i.e. fork) is needed? https:\/\/issues.apache.org\/jira\/browse\/SUREFIRE-1516.  Apache. 2019. Should Surefire specialize test runner when test isolation (i.e. fork) is needed? https:\/\/issues.apache.org\/jira\/browse\/SUREFIRE-1516."},{"key":"e_1_3_2_1_6_1","volume-title":"Unit Test Virtualization with VMVM. In International Conference on Software Engineering. 550-561","author":"Bell Jonathan","year":"2014","unstructured":"Jonathan Bell and Gail Kaiser . 2014 . Unit Test Virtualization with VMVM. In International Conference on Software Engineering. 550-561 . Jonathan Bell and Gail Kaiser. 2014. Unit Test Virtualization with VMVM. In International Conference on Software Engineering. 550-561."},{"key":"e_1_3_2_1_7_1","volume-title":"Eficient Dependency Detection for Safe Java Test Acceleration. In International Symposium on Foundations of Software Engineering. 770-781","author":"Bell Jonathan","year":"2015","unstructured":"Jonathan Bell , Gail Kaiser , Eric Melski , and Mohan Dattatreya . 2015 . Eficient Dependency Detection for Safe Java Test Acceleration. In International Symposium on Foundations of Software Engineering. 770-781 . Jonathan Bell, Gail Kaiser, Eric Melski, and Mohan Dattatreya. 2015. Eficient Dependency Detection for Safe Java Test Acceleration. In International Symposium on Foundations of Software Engineering. 770-781."},{"key":"e_1_3_2_1_8_1","volume-title":"DeFlaker: Automatically Detecting Flaky Tests. In International Conference on Software Engineering. 433-444","author":"Bell J.","unstructured":"J. Bell , O. Legunsen , M. Hilton , L. Eloussi , T. Yung , and D. Marinov . 2018 . DeFlaker: Automatically Detecting Flaky Tests. In International Conference on Software Engineering. 433-444 . J. Bell, O. Legunsen, M. Hilton, L. Eloussi, T. Yung, and D. Marinov. 2018. DeFlaker: Automatically Detecting Flaky Tests. In International Conference on Software Engineering. 433-444."},{"key":"e_1_3_2_1_9_1","volume-title":"Hassan","author":"Bezemer Cor-Paul","year":"2017","unstructured":"Cor-Paul Bezemer , Shane Mcintosh , Bram Adams , Daniel M. German , and Ahmed E . Hassan . 2017 . An Empirical Study of Unspecified Dependencies in Make-Based Build Systems. Empirical Softw. Engg . 22, 6 ( 2017 ), 3117-3148. Cor-Paul Bezemer, Shane Mcintosh, Bram Adams, Daniel M. German, and Ahmed E. Hassan. 2017. An Empirical Study of Unspecified Dependencies in Make-Based Build Systems. Empirical Softw. Engg. 22, 6 ( 2017 ), 3117-3148."},{"key":"e_1_3_2_1_10_1","volume-title":"Build System with Lazy Retrieval for Java Projects. In International Symposium on Foundations of Software Engineering. 643-654","author":"Celik Ahmet","year":"2016","unstructured":"Ahmet Celik , Alex Knaust , Aleksandar Milicevic , and Milos Gligoric . 2016 . Build System with Lazy Retrieval for Java Projects. In International Symposium on Foundations of Software Engineering. 643-654 . Ahmet Celik, Alex Knaust, Aleksandar Milicevic, and Milos Gligoric. 2016. Build System with Lazy Retrieval for Java Projects. In International Symposium on Foundations of Software Engineering. 643-654."},{"key":"e_1_3_2_1_11_1","volume-title":"Regression Test Selection Across JVM Boundaries. In International Symposium on Foundations of Software Engineering. 809-820","author":"Celik Ahmet","year":"2017","unstructured":"Ahmet Celik , Marko Vasic , Aleksandar Milicevic , and Milos Gligoric . 2017 . Regression Test Selection Across JVM Boundaries. In International Symposium on Foundations of Software Engineering. 809-820 . Ahmet Celik, Marko Vasic, Aleksandar Milicevic, and Milos Gligoric. 2017. Regression Test Selection Across JVM Boundaries. In International Symposium on Foundations of Software Engineering. 809-820."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06410-9_43"},{"key":"e_1_3_2_1_13_1","unstructured":"Al Danial. 2020. Cloc. https:\/\/github.com\/AlDanial\/cloc.  Al Danial. 2020. Cloc. https:\/\/github.com\/AlDanial\/cloc."},{"key":"e_1_3_2_1_14_1","unstructured":"Tibor Digana. 2019. [SUREFIRE-1516] Poor performance in reuseForks=false. https:\/\/github.com\/apache\/maven-surefire\/commit\/ 5148b02ba552cd79ac212b869dec10d01ba4d2e6.  Tibor Digana. 2019. [SUREFIRE-1516] Poor performance in reuseForks=false. https:\/\/github.com\/apache\/maven-surefire\/commit\/ 5148b02ba552cd79ac212b869dec10d01ba4d2e6."},{"key":"e_1_3_2_1_15_1","volume-title":"Techniques for Improving Regression Testing in Continuous Integration Development Environments. In International Symposium on Foundations of Software Engineering. 235-245","author":"Elbaum Sebastian","year":"2014","unstructured":"Sebastian Elbaum , Gregg Rothermel , and John Penix . 2014 . Techniques for Improving Regression Testing in Continuous Integration Development Environments. In International Symposium on Foundations of Software Engineering. 235-245 . Sebastian Elbaum, Gregg Rothermel, and John Penix. 2014. Techniques for Improving Regression Testing in Continuous Integration Development Environments. In International Symposium on Foundations of Software Engineering. 235-245."},{"key":"e_1_3_2_1_16_1","first-page":"89","article-title":"A Sound and Optimal Incremental Build System with Dynamic Dependencies. In Object-Oriented Programming","author":"Erdweg Sebastian","year":"2015","unstructured":"Sebastian Erdweg , Moritz Lichter , and Weiel Manuel . 2015 . A Sound and Optimal Incremental Build System with Dynamic Dependencies. In Object-Oriented Programming , Systems, Languages & Applications. 89 - 106 . Sebastian Erdweg, Moritz Lichter, and Weiel Manuel. 2015. A Sound and Optimal Incremental Build System with Dynamic Dependencies. In Object-Oriented Programming, Systems, Languages & Applications. 89-106.","journal-title":"Systems, Languages & Applications."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2889222"},{"key":"e_1_3_2_1_18_1","unstructured":"Facebook. 2020. Nailgun. https:\/\/github.com\/facebook\/nailgun.  Facebook. 2020. Nailgun. https:\/\/github.com\/facebook\/nailgun."},{"key":"e_1_3_2_1_19_1","unstructured":"Martin Fowler. 2018. Eradicating Non-Determinism in Tests. http:\/\/martinfowler. com\/articles\/nonDeterminism.html.  Martin Fowler. 2018. Eradicating Non-Determinism in Tests. http:\/\/martinfowler. com\/articles\/nonDeterminism.html."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.28"},{"key":"e_1_3_2_1_21_1","volume-title":"Practical Regression Test Selection with Dynamic File Dependencies. In International Symposium on Software Testing and Analysis. 211-222","author":"Gligoric Milos","year":"2015","unstructured":"Milos Gligoric , Lamyaa Eloussi , and Darko Marinov . 2015 . Practical Regression Test Selection with Dynamic File Dependencies. In International Symposium on Software Testing and Analysis. 211-222 . Milos Gligoric, Lamyaa Eloussi, and Darko Marinov. 2015. Practical Regression Test Selection with Dynamic File Dependencies. In International Symposium on Software Testing and Analysis. 211-222."},{"key":"e_1_3_2_1_22_1","unstructured":"Google. 2020. Bazel. https:\/\/bazel.build\/.  Google. 2020. Bazel. https:\/\/bazel.build\/."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771793"},{"key":"e_1_3_2_1_24_1","unstructured":"Allan Heydon Roy Levin Timothy Mann and Yuan Yu. 2002. The Vesta Software Configuration Management System. Research Report. http:\/\/www.hpl.hp.com\/ techreports\/Compaq-DEC\/SRC-RR-177.pdf.  Allan Heydon Roy Levin Timothy Mann and Yuan Yu. 2002. The Vesta Software Configuration Management System. Research Report. http:\/\/www.hpl.hp.com\/ techreports\/Compaq-DEC\/SRC-RR-177.pdf."},{"key":"e_1_3_2_1_25_1","first-page":"426","article-title":"Usage, Costs, and Benefits of Continuous Integration in Open-Source Projects","author":"Hilton Michael","year":"2016","unstructured":"Michael Hilton , Timothy Tunnell , Kai Huang , Darko Marinov , and Danny Dig . 2016 . Usage, Costs, and Benefits of Continuous Integration in Open-Source Projects . In Automated Software Engineering. 426 - 437 . Michael Hilton, Timothy Tunnell, Kai Huang, Darko Marinov, and Danny Dig. 2016. Usage, Costs, and Benefits of Continuous Integration in Open-Source Projects. In Automated Software Engineering. 426-437.","journal-title":"Automated Software Engineering."},{"key":"e_1_3_2_1_26_1","volume-title":"Jumbo: Run-time Code Generation for Java and Its Applications. In International Symposium on Code Generation and Optimization. 48-56","author":"Kamin Sam","year":"2003","unstructured":"Sam Kamin , Lars Clausen , and Ava Jarvis . 2003 . Jumbo: Run-time Code Generation for Java and Its Applications. In International Symposium on Code Generation and Optimization. 48-56 . Sam Kamin, Lars Clausen, and Ava Jarvis. 2003. Jumbo: Run-time Code Generation for Java and Its Applications. In International Symposium on Code Generation and Optimization. 48-56."},{"key":"e_1_3_2_1_27_1","volume-title":"An Extensive Study of Static Regression Test Selection in Modern Software Evolution. In International Symposium on Foundations of Software Engineering. 583-594","author":"Legunsen Owolabi","year":"2016","unstructured":"Owolabi Legunsen , Farah Hariri , August Shi , Yafeng Lu , Lingming Zhang , and Darko Marinov . 2016 . An Extensive Study of Static Regression Test Selection in Modern Software Evolution. In International Symposium on Foundations of Software Engineering. 583-594 . Owolabi Legunsen, Farah Hariri, August Shi, Yafeng Lu, Lingming Zhang, and Darko Marinov. 2016. An Extensive Study of Static Regression Test Selection in Modern Software Evolution. In International Symposium on Foundations of Software Engineering. 583-594."},{"key":"e_1_3_2_1_28_1","volume-title":"An Empirical Analysis of Flaky Tests. In International Symposium on Foundations of Software Engineering. 643-653","author":"Luo Qingzhou","year":"2014","unstructured":"Qingzhou Luo , Farah Hariri , Lamyaa Eloussi , and Darko Marinov . 2014 . An Empirical Analysis of Flaky Tests. In International Symposium on Foundations of Software Engineering. 643-653 . Qingzhou Luo, Farah Hariri, Lamyaa Eloussi, and Darko Marinov. 2014. An Empirical Analysis of Flaky Tests. In International Symposium on Foundations of Software Engineering. 643-653."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-011-9169-5"},{"key":"e_1_3_2_1_30_1","volume-title":"International Conference on Software Engineering. 1479-1480","author":"Atif","unstructured":"Atif M. Memon and Myra B. Cohen. 2013. Automated Testing of GUI Applications: Models, Tools, and Controlling Flakiness . In International Conference on Software Engineering. 1479-1480 . Atif M. Memon and Myra B. Cohen. 2013. Automated Testing of GUI Applications: Models, Tools, and Controlling Flakiness. In International Conference on Software Engineering. 1479-1480."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236774"},{"key":"e_1_3_2_1_32_1","volume-title":"International Symposium on Foundations of Software Engineering. 496-499","author":"Mu\u015flu Kivan\u00e7","year":"2011","unstructured":"Kivan\u00e7 Mu\u015flu , Bilge Soran , and Jochen Wuttke . 2011 . Finding Bugs by Isolating Unit Tests . In International Symposium on Foundations of Software Engineering. 496-499 . Kivan\u00e7 Mu\u015flu, Bilge Soran, and Jochen Wuttke. 2011. Finding Bugs by Isolating Unit Tests. In International Symposium on Foundations of Software Engineering. 496-499."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Vladimir Nikolov R\u00fcdiger Kapitza and Franz J Hauck. 2009. Recoverable Class Loaders for a Fast Restart of Java Applications. Mobile Networks and Applications 14 1 ( 2009 ) 53-64.  Vladimir Nikolov R\u00fcdiger Kapitza and Franz J Hauck. 2009. Recoverable Class Loaders for a Fast Restart of Java Applications. Mobile Networks and Applications 14 1 ( 2009 ) 53-64.","DOI":"10.1007\/s11036-008-0115-8"},{"key":"e_1_3_2_1_34_1","volume-title":"Procedures for Reducing the Size of Coverage-based Test Sets. In International Conference on Testing Computer Software. 111-123","author":"Voas JM.","year":"1995","unstructured":"Voas JM. Ofutt J, Pan J. 1995 . Procedures for Reducing the Size of Coverage-based Test Sets. In International Conference on Testing Computer Software. 111-123 . Voas JM. Ofutt J, Pan J. 1995. Procedures for Reducing the Size of Coverage-based Test Sets. In International Conference on Testing Computer Software. 111-123."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.536955"},{"key":"e_1_3_2_1_36_1","unstructured":"Peter Smith. 2011. Software Build Systems: Principles and Experience. AddisonWesley Professional.  Peter Smith. 2011. Software Build Systems: Principles and Experience. AddisonWesley Professional."},{"key":"e_1_3_2_1_37_1","volume-title":"A Gentle Introduction to Multi-stage Programming","author":"Taha Walid","unstructured":"Walid Taha . 2004. A Gentle Introduction to Multi-stage Programming . Springer Berlin Heidelberg , 30-50. Walid Taha. 2004. A Gentle Introduction to Multi-stage Programming. Springer Berlin Heidelberg, 30-50."},{"key":"e_1_3_2_1_38_1","unstructured":"tevemadar. 2018. Blocking on stdin makes Java process take 350ms more to exit. https:\/\/stackoverflow.com\/a\/48979347.  tevemadar. 2018. Blocking on stdin makes Java process take 350ms more to exit. https:\/\/stackoverflow.com\/a\/48979347."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786850"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806596.1806616"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/stv.430"},{"key":"e_1_3_2_1_42_1","volume-title":"Empirically Revisiting the Test Independence Assumption. In International Symposium on Software Testing and Analysis. 385-396","author":"Zhang Sai","year":"2014","unstructured":"Sai Zhang , Darioush Jalali , Jochen Wuttke , K\u0131van\u00e7 Mu\u015flu , Wing Lam , Michael D Ernst , and David Notkin . 2014 . Empirically Revisiting the Test Independence Assumption. In International Symposium on Software Testing and Analysis. 385-396 . Sai Zhang, Darioush Jalali, Jochen Wuttke, K\u0131van\u00e7 Mu\u015flu, Wing Lam, Michael D Ernst, and David Notkin. 2014. Empirically Revisiting the Test Independence Assumption. In International Symposium on Software Testing and Analysis. 385-396."}],"event":{"name":"ISSTA '20: 29th ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Virtual Event USA","acronym":"ISSTA '20","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3395363.3397381","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3395363.3397381","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:45Z","timestamp":1750199925000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3395363.3397381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,18]]},"references-count":42,"alternative-id":["10.1145\/3395363.3397381","10.1145\/3395363"],"URL":"https:\/\/doi.org\/10.1145\/3395363.3397381","relation":{},"subject":[],"published":{"date-parts":[[2020,7,18]]},"assertion":[{"value":"2020-07-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}