{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T02:13:30Z","timestamp":1775873610791,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":59,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,8,12]],"date-time":"2019-08-12T00:00:00Z","timestamp":1565568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF-1421503, CNS-1513939, CNS-1564274, CNS-1646305, CNS-1740916, CCF-1763788, CCF-1816615, OAC-1839010"],"award-info":[{"award-number":["CCF-1421503, CNS-1513939, CNS-1564274, CNS-1646305, CNS-1740916, CCF-1763788, CCF-1816615, OAC-1839010"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,8,12]]},"DOI":"10.1145\/3338906.3338925","type":"proceedings-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T12:21:03Z","timestamp":1565353263000},"page":"545-555","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":95,"title":["iFixFlakies: a framework for automatically fixing order-dependent flaky tests"],"prefix":"10.1145","author":[{"given":"August","family":"Shi","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Wing","family":"Lam","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Reed","family":"Oei","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Tao","family":"Xie","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Darko","family":"Marinov","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,8,12]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"http:\/\/intellijava.blogspot.com\/2012\/05\/junit- andjava- 7.html","author":"Unit","year":"2013","unstructured":"2012. J Unit and Java 7. http:\/\/intellijava.blogspot.com\/2012\/05\/junit- andjava- 7.html . 2013 . JUnit test method ordering. http:\/\/www.javaallandsundry.com\/2013\/01\/. 2013. Maintaining the order of JUnit3 tests with JDK 1.7. https:\/\/coderanch.com\/ t\/600985\/engineering\/Maintainingorder-JUnittests-JDK. 2019. Elastic-Job. https:\/\/github.com\/elasticjob\/elasticjoblite. 2019. GitHub. https:\/\/github.com. 2019. 2012. JUnit and Java 7. http:\/\/intellijava.blogspot.com\/2012\/05\/junit- andjava- 7.html. 2013. JUnit test method ordering. http:\/\/www.javaallandsundry.com\/2013\/01\/. 2013. Maintaining the order of JUnit3 tests with JDK 1.7. https:\/\/coderanch.com\/ t\/600985\/engineering\/Maintainingorder-JUnittests-JDK. 2019. Elastic-Job. https:\/\/github.com\/elasticjob\/elasticjoblite. 2019. GitHub. https:\/\/github.com. 2019."},{"key":"e_1_3_2_1_2_1","volume-title":"Flaky Test Dataset. https:\/\/sites.google.com\/view\/ flakytestdataset","year":"2019","unstructured":"iDFlakies : Flaky Test Dataset. https:\/\/sites.google.com\/view\/ flakytestdataset . 2019 . iFixFlakies Framework. https:\/\/sites.google.com\/view\/ifixflakies. 2019. JavaParser. http:\/\/javaparser.org\/. 2019. JUnit expected annotation. https:\/\/junit.org\/junit4\/javadoc\/4.12\/org\/junit\/ Test.html. 2019. Maven. https:\/\/maven.apache.org. 2019. WildFly Application Server. https:\/\/github.com\/wildfly\/wildfly. 2019. WildFly Bug Report . https:\/\/issues.jboss.org\/browse\/WFLY- 11323. iDFlakies: Flaky Test Dataset. https:\/\/sites.google.com\/view\/ flakytestdataset. 2019. iFixFlakies Framework. https:\/\/sites.google.com\/view\/ifixflakies. 2019. JavaParser. http:\/\/javaparser.org\/. 2019. JUnit expected annotation. https:\/\/junit.org\/junit4\/javadoc\/4.12\/org\/junit\/ Test.html. 2019. Maven. https:\/\/maven.apache.org. 2019. WildFly Application Server. https:\/\/github.com\/wildfly\/wildfly. 2019. WildFly Bug Report. https:\/\/issues.jboss.org\/browse\/WFLY- 11323."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635883"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771796"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568248"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786823"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180164"},{"key":"e_1_3_2_1_8_1","unstructured":"Brett Daniel Tihomir Gvero and Darko Marinov. 2010.  Brett Daniel Tihomir Gvero and Darko Marinov. 2010."},{"key":"e_1_3_2_1_9_1","unstructured":"On test repair using symbolic execution. In ISSTA. Trento Italy 207\u2013218.  On test repair using symbolic execution. In ISSTA. Trento Italy 207\u2013218."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2009.17"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Alessio Gambi Jonathan Bell and Andreas Zeller. 2018. Practical test dependency detection. In ICST. Vasteras Sweden 1\u201311.  Alessio Gambi Jonathan Bell and Andreas Zeller. 2018. Practical test dependency detection. In ICST. Vasteras Sweden 1\u201311.","DOI":"10.1109\/ICST.2018.00011"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2454510"},{"key":"e_1_3_2_1_13_1","unstructured":"Zebao Gao Yalan Liang Myra B. Cohen Atif M. Memon and Zhen Wang. 2015.  Zebao Gao Yalan Liang Myra B. Cohen Atif M. Memon and Zhen Wang. 2015."},{"key":"e_1_3_2_1_14_1","unstructured":"Making system user interactive tests repeatable: When and what should we control?. In ICSE. Florence Italy 55\u201365.  Making system user interactive tests repeatable: When and what should we control?. In ICSE. Florence Italy 55\u201365."},{"key":"e_1_3_2_1_15_1","unstructured":"Ali Ghanbari Samuel Benton and Lingming Zhang. 2019.  Ali Ghanbari Samuel Benton and Lingming Zhang. 2019."},{"key":"e_1_3_2_1_16_1","volume-title":"ISSTA.","author":"Practical","unstructured":"Practical program repair via bytecode mutation. In ISSTA. Beijing, China . to-appear. Practical program repair via bytecode mutation. In ISSTA. Beijing, China. to-appear."},{"key":"e_1_3_2_1_17_1","unstructured":"Google. 2008. Avoiding Flakey Tests. http:\/\/googletesting.blogspot.com\/2008\/04\/ tottavoidingflakeytests.html.  Google. 2008. Avoiding Flakey Tests. http:\/\/googletesting.blogspot.com\/2008\/04\/ tottavoidingflakeytests.html."},{"key":"e_1_3_2_1_18_1","unstructured":"Alex Groce Amin Alipour Chaoqiang Zhang Yang Chen and John Regehr. 2014.  Alex Groce Amin Alipour Chaoqiang Zhang Yang Chen and John Regehr. 2014."},{"key":"e_1_3_2_1_19_1","volume-title":"ICST.","author":"Cause","unstructured":"Cause reduction for quick testing. In ICST. Cleveland, OH, USA , 243\u2013252. Cause reduction for quick testing. In ICST. Cleveland, OH, USA, 243\u2013252."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771793"},{"key":"e_1_3_2_1_21_1","volume-title":"SCAM.","author":"Harman Mark","unstructured":"Mark Harman and Peter O\u2019Hearn . 2018. From start-ups to scale-ups: Opportunities and open problems for static and dynamic program analysis . In SCAM. Madrid, Spain , 1\u201323. Mark Harman and Peter O\u2019Hearn. 2018. From start-ups to scale-ups: Opportunities and open problems for static and dynamic program analysis. In SCAM. Madrid, Spain, 1\u201323."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Kim Herzig and Nachiappan Nagappan. 2015. Empirically detecting false test alarms using association rules. In ICSE. Florence Italy 39\u201348.   Kim Herzig and Nachiappan Nagappan. 2015. Empirically detecting false test alarms using association rules. In ICSE. Florence Italy 39\u201348.","DOI":"10.1109\/ICSE.2015.133"},{"key":"e_1_3_2_1_23_1","unstructured":"Clint Hoagland. 2014.  Clint Hoagland. 2014."},{"key":"e_1_3_2_1_24_1","unstructured":"Fixing the brittleness problem with GUI tests. https: \/\/www.stickyminds.com\/articles\/fixingbrittlenessproblemguitests.  Fixing the brittleness problem with GUI tests. https: \/\/www.stickyminds.com\/articles\/fixingbrittlenessproblemguitests."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635917"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628053"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106288"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Wing Lam Reed Oei August Shi Darko Marinov and Tao Xie. 2019. iDFlakies: A framework for detecting and partially classifying flaky tests. In ICST. Xi\u2019an China 312\u2013322.  Wing Lam Reed Oei August Shi Darko Marinov and Tao Xie. 2019. iDFlakies: A framework for detecting and partially classifying flaky tests. In ICST. Xi\u2019an China 312\u2013322.","DOI":"10.1109\/ICST.2019.00038"},{"key":"e_1_3_2_1_29_1","volume-title":"ICSE.","author":"Goues Claire Le","unstructured":"Claire Le Goues , Michael Dewey-Vogt , Stephanie Forrest , and Westley Weimer . 2012. A systematic study of automated program repair: Fixing 55 out of 105 bugs for $8 each . In ICSE. Z\u00fcrich, Switzerland , 3\u201313. Claire Le Goues, Michael Dewey-Vogt, Stephanie Forrest, and Westley Weimer. 2012. A systematic study of automated program repair: Fixing 55 out of 105 bugs for $8 each. In ICSE. Z\u00fcrich, Switzerland, 3\u201313."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133916"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106253"},{"key":"e_1_3_2_1_32_1","unstructured":"Fan Long and Martin Rinard. 2016.  Fan Long and Martin Rinard. 2016."},{"key":"e_1_3_2_1_33_1","volume-title":"POPL. St.","author":"Automatic","unstructured":"Automatic patch generation by learning correct code. In POPL. St. Petersburg, Florida , 298\u2013312. Automatic patch generation by learning correct code. In POPL. St. Petersburg, Florida, 298\u2013312."},{"key":"e_1_3_2_1_34_1","unstructured":"Qingzhou Luo Farah Hariri Lamyaa Eloussi and Darko Marinov. 2014.  Qingzhou Luo Farah Hariri Lamyaa Eloussi and Darko Marinov. 2014."},{"key":"e_1_3_2_1_35_1","unstructured":"An empirical analysis of flaky tests. In FSE. Hong Kong 643\u2013653.  An empirical analysis of flaky tests. In FSE. Hong Kong 643\u2013653."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884807"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2017.16"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2012.103"},{"key":"e_1_3_2_1_39_1","unstructured":"Martin Monperrus. 2018.  Martin Monperrus. 2018."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105906"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Kivan\u00e7 Mu\u015flu Bilge Soran and Jochen Wuttke. 2011. Finding bugs by isolating unit tests. In ESEC\/FSE. Szeged Hungary 496\u2013499.  Kivan\u00e7 Mu\u015flu Bilge Soran and Jochen Wuttke. 2011. Finding bugs by isolating unit tests. In ESEC\/FSE. Szeged Hungary 496\u2013499.","DOI":"10.1145\/2025113.2025202"},{"key":"e_1_3_2_1_42_1","volume-title":"ICSE.","author":"Thien Nguyen Hoang Duong","unstructured":"Hoang Duong Thien Nguyen , Dawei Qi , Abhik Roychoudhury , and Satish Chandra . 2013. SemFix: Program repair via semantic analysis . In ICSE. San Francisco, CA, USA , 772\u2013781. Hoang Duong Thien Nguyen, Dawei Qi, Abhik Roychoudhury, and Satish Chandra. 2013. SemFix: Program repair via semantic analysis. In ICSE. San Francisco, CA, USA, 772\u2013781."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Fabio Palomba and Andy Zaidman. 2017. Does refactoring of test smells induce fixing flaky tests?. In ICSME. Shanghai China 1\u201312.  Fabio Palomba and Andy Zaidman. 2017. Does refactoring of test smells induce fixing flaky tests?. In ICSME. Shanghai China 1\u201312.","DOI":"10.1109\/ICSME.2017.12"},{"key":"e_1_3_2_1_44_1","unstructured":"Danilo Silva Ricardo Terra and Marco Tulio Valente. 2014.  Danilo Silva Ricardo Terra and Marco Tulio Valente. 2014."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597008.2597141"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236063"},{"key":"e_1_3_2_1_47_1","volume-title":"ICSE.","author":"Thummalapenta Suresh","unstructured":"Suresh Thummalapenta , Pranavadatta Devaki , Saurabh Sinha , Satish Chandra , Sivagami Gnanasundaram , Deepa D. Nagaraj , and Sampathkumar Sathishkumar . 2013. Efficient and change-resilient test automation: An industrial case study . In ICSE. San Francisco, CA, USA , 1002\u20131011. Suresh Thummalapenta, Pranavadatta Devaki, Saurabh Sinha, Satish Chandra, Sivagami Gnanasundaram, Deepa D. Nagaraj, and Sampathkumar Sathishkumar. 2013. Efficient and change-resilient test automation: An industrial case study. In ICSE. San Francisco, CA, USA, 1002\u20131011."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.1"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/154183.154265"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1831708.1831716"},{"key":"e_1_3_2_1_51_1","volume-title":"Claire Le Goues, and Stephanie Forrest","author":"Weimer Westley","year":"2009","unstructured":"Westley Weimer , ThanhVu Nguyen , Claire Le Goues, and Stephanie Forrest . 2009 . Westley Weimer, ThanhVu Nguyen, Claire Le Goues, and Stephanie Forrest. 2009."},{"key":"e_1_3_2_1_52_1","volume-title":"ICSE.","author":"Automatically","unstructured":"Automatically finding patches using genetic programming. In ICSE. Vancouver, BC , Canada , 364\u2013374. Automatically finding patches using genetic programming. In ICSE. Vancouver, BC, Canada, 364\u2013374."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2610390"},{"key":"e_1_3_2_1_54_1","unstructured":"Guowei Yang Sarfraz Khurshid and Miryung Kim. 2012.  Guowei Yang Sarfraz Khurshid and Miryung Kim. 2012."},{"key":"e_1_3_2_1_55_1","volume-title":"FM.","unstructured":"Specification-based test repair using a lightweight formal method. In FM. Paris, France , 455\u2013470. Specification-based test repair using a lightweight formal method. In FM. Paris, France, 455\u2013470."},{"key":"e_1_3_2_1_56_1","unstructured":"Andreas Zeller and Ralf Hildebrandt. 2002.  Andreas Zeller and Ralf Hildebrandt. 2002."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988498"},{"key":"e_1_3_2_1_58_1","unstructured":"Sai Zhang Darioush Jalali Jochen Wuttke K\u0131van\u00e7 Mu\u015flu Wing Lam Michael D. Ernst and David Notkin. 2014.  Sai Zhang Darioush Jalali Jochen Wuttke K\u0131van\u00e7 Mu\u015flu Wing Lam Michael D. Ernst and David Notkin. 2014."},{"key":"e_1_3_2_1_59_1","volume-title":"ISSTA.","author":"Empirically","unstructured":"Empirically revisiting the test independence assumption. In ISSTA. San Jose, CA, USA , 385\u2013396. Empirically revisiting the test independence assumption. In ISSTA. San Jose, CA, USA, 385\u2013396."}],"event":{"name":"ESEC\/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","location":"Tallinn Estonia","acronym":"ESEC\/FSE '19","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3338906.3338925","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3338906.3338925","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3338906.3338925","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:26:20Z","timestamp":1750206380000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3338906.3338925"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,12]]},"references-count":59,"alternative-id":["10.1145\/3338906.3338925","10.1145\/3338906"],"URL":"https:\/\/doi.org\/10.1145\/3338906.3338925","relation":{},"subject":[],"published":{"date-parts":[[2019,8,12]]},"assertion":[{"value":"2019-08-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}