{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:38:05Z","timestamp":1790937485944,"version":"4.1.0"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA","license":[{"start":{"date-parts":[[2019,10,10]],"date-time":"2019-10-10T00:00:00Z","timestamp":1570665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF-1421503,CCF-1566589,CNS-1646305,CNS-1740916,CCF-1763788,CCF-1763906"],"award-info":[{"award-number":["CCF-1421503,CCF-1566589,CNS-1646305,CNS-1740916,CCF-1763788,CCF-1763906"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2019,10,10]]},"abstract":"<jats:p>Regression test selection (RTS) aims to speed up regression testing by rerunning only tests that are affected by code changes. RTS can be performed using static or dynamic analysis techniques. Our prior study showed that static and dynamic RTS perform similarly for medium-sized Java projects. However, the results of that prior study also showed that static RTS can be unsafe, missing to select tests that dynamic RTS selects, and that reflection was the only cause of unsafety observed among the evaluated projects.<\/jats:p>\n          <jats:p>In this paper, we investigate five techniques\u2014three purely static techniques and two hybrid static-dynamic techniques\u2014that aim to make static RTS safe with respect to reflection. We implement these reflection-aware (RA) techniques by extending the reflection-unaware (RU) class-level static RTS technique in a tool called STARTS. To evaluate these RA techniques, we compare their end-to-end times with RU, and with RetestAll, which reruns all tests after every code change. We also compare safety and precision of the RA techniques with Ekstazi, a state-of-the-art dynamic RTS technique; precision is a measure of unaffected tests selected.<\/jats:p>\n          <jats:p>Our evaluation on 1173 versions of 24 open-source Java projects shows negative results. The RA techniques improve the safety of RU but at very high costs. The purely static techniques are safe in our experiments but decrease the precision of RU, with end-to-end time at best 85.8% of RetestAll time, versus 69.1% for RU. One hybrid static-dynamic technique improves the safety of RU but at high cost, with end-to-end time that is 91.2% of RetestAll. The other hybrid static-dynamic technique provides better precision, is safer than RU, and incurs lower end-to-end time\u201475.8% of RetestAll, but it can still be unsafe in the presence of test-order dependencies. Our study highlights the challenges involved in making static RTS safe with respect to reflection.<\/jats:p>","DOI":"10.1145\/3360613","type":"journal-article","created":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T14:53:33Z","timestamp":1570805613000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Reflection-aware static regression test selection"],"prefix":"10.1145","volume":"3","author":[{"given":"August","family":"Shi","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milica","family":"Hadzi-Tanovic","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingming","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Texas at Dallas, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darko","family":"Marinov","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Owolabi","family":"Legunsen","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,10,10]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Apache Software Foundation. 2019a. Apache Camel. (2019). http:\/\/camel.apache.org\/ .  Apache Software Foundation. 2019a. Apache Camel. (2019). http:\/\/camel.apache.org\/ ."},{"key":"e_1_2_2_2_1","unstructured":"Apache Software Foundation. 2019b. Apache Commons Math. (2019). https:\/\/commons.apache.org\/proper\/commons-math\/ .  Apache Software Foundation. 2019b. Apache Commons Math. (2019). https:\/\/commons.apache.org\/proper\/commons-math\/ ."},{"key":"e_1_2_2_3_1","volume-title":"https:\/\/cxf.apache.org\/","author":"Foundation Apache Software","year":"2019","unstructured":"Apache Software Foundation . 2019c. Apache CXF. ( 2019 ). https:\/\/cxf.apache.org\/ . Apache Software Foundation. 2019c. Apache CXF. (2019). https:\/\/cxf.apache.org\/ ."},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Linda Badri Mourad Badri and Daniel St-Yves. 2005. Supporting predictive change impact analysis: A control call graph based technique. In APSEC. 167\u2013175.  Linda Badri Mourad Badri and Daniel St-Yves. 2005. Supporting predictive change impact analysis: A control call graph based technique. In APSEC. 167\u2013175.","DOI":"10.1109\/APSEC.2005.100"},{"key":"e_1_2_2_5_1","volume-title":"Ernst","author":"Barros Paulo","year":"2015","unstructured":"Paulo Barros , Ren\u00e9 Just , Suzanne Millstein , Paul Vines , Werner Dietl , Marcelo d\u2019 Amorim , and Michael D . Ernst . 2015 . Static analysis of implicit control flow: Resolving Java reflection and Android intents. In ASE. 669\u2013679. Paulo Barros, Ren\u00e9 Just, Suzanne Millstein, Paul Vines, Werner Dietl, Marcelo d\u2019Amorim, and Michael D. Ernst. 2015. Static analysis of implicit control flow: Resolving Java reflection and Android intents. In ASE. 669\u2013679."},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Jonathan Bell and Gail Kaiser. 2014. Unit test virtualization with VMVM. In ICSE. 550\u2013561.  Jonathan Bell and Gail Kaiser. 2014. Unit test virtualization with VMVM. In ICSE. 550\u2013561.","DOI":"10.1145\/2568225.2568248"},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Jonathan Bell Gail Kaiser Eric Melski and Mohan Dattatreya. 2015. Efficient dependency detection for safe Java test acceleration. In ESEC\/FSE. 770\u2013781.  Jonathan Bell Gail Kaiser Eric Melski and Mohan Dattatreya. 2015. Efficient dependency detection for safe Java test acceleration. In ESEC\/FSE. 770\u2013781.","DOI":"10.1145\/2786805.2786823"},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Eric Bodden Andreas Sewe Jan Sinschek Hela Oueslati and Mira Mezini. 2011. Taming reflection: Aiding static analysis in the presence of reflection and custom class loaders. In ICSE. 241\u2013250.  Eric Bodden Andreas Sewe Jan Sinschek Hela Oueslati and Mira Mezini. 2011. Taming reflection: Aiding static analysis in the presence of reflection and custom class loaders. In ICSE. 241\u2013250.","DOI":"10.1145\/1985793.1985827"},{"key":"e_1_2_2_9_1","volume-title":"Young Chul Lee, and Milos Gligoric","author":"\u00c7elik Ahmet","year":"2018","unstructured":"Ahmet \u00c7elik , Young Chul Lee, and Milos Gligoric . 2018 . Regression test selection for TizenRT. In FSE Industry Track . 845\u2013850. Ahmet \u00c7elik, Young Chul Lee, and Milos Gligoric. 2018. Regression test selection for TizenRT. In FSE Industry Track. 845\u2013850."},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Ahmet \u00c7elik Marko Vasic Aleksandar Milicevic and Milos Gligoric. 2017. Regression test selection across JVM boundaries. In ESEC\/FSE. 809\u2013820.  Ahmet \u00c7elik Marko Vasic Aleksandar Milicevic and Milos Gligoric. 2017. Regression test selection across JVM boundaries. In ESEC\/FSE. 809\u2013820.","DOI":"10.1145\/3106237.3106297"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Lingchao Chen and Lingming Zhang. 2018. Speeding up mutation testing via regression test selection: An extensive study. In ICST. 58\u201369.  Lingchao Chen and Lingming Zhang. 2018. Speeding up mutation testing via regression test selection: An extensive study. In ICST. 58\u201369.","DOI":"10.1109\/ICST.2018.00016"},{"key":"e_1_2_2_12_1","unstructured":"Yih-Farn Chen David S. Rosenblum and Kiem-Phong Vo. 1994. TestTube: A system for selective regression testing. In ICSE. 211\u2013220.  Yih-Farn Chen David S. Rosenblum and Kiem-Phong Vo. 1994. TestTube: A system for selective regression testing. In ICSE. 211\u2013220."},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Shigeru Chiba. 2000. Load-time structural reflection in Java. In ECOOP. 313\u2013336.  Shigeru Chiba. 2000. Load-time structural reflection in Java. In ECOOP. 313\u2013336.","DOI":"10.1007\/3-540-45102-1_16"},{"key":"e_1_2_2_14_1","volume-title":"Schwartzbach","author":"Christensen Aske Simon","year":"2003","unstructured":"Aske Simon Christensen , Anders M\u00f8ller , and Michael I . Schwartzbach . 2003 . Precise analysis of string expressions. In SAS. 1\u201318. Aske Simon Christensen, Anders M\u00f8ller, and Michael I. Schwartzbach. 2003. Precise analysis of string expressions. In SAS. 1\u201318."},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Nima Dini Allison Sullivan Milos Gligoric and Gregg Rothermel. 2016. The effect of test suite type on regression test selection. In ISSRE. 47\u201358.  Nima Dini Allison Sullivan Milos Gligoric and Gregg Rothermel. 2016. The effect of test suite type on regression test selection. In ISSRE. 47\u201358.","DOI":"10.1109\/ISSRE.2016.28"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Sebastian Elbaum Gregg Rothermel and John Penix. 2014. Techniques for improving regression testing in continuous integration development environments. In FSE. 235\u2013245.  Sebastian Elbaum Gregg Rothermel and John Penix. 2014. Techniques for improving regression testing in continuous integration development environments. In FSE. 235\u2013245.","DOI":"10.1145\/2635868.2635910"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Hamed Esfahani Jonas Fietz Qi Ke Alexei Kolomiets Erica Lan Erik Mavrinac Wolfram Schulte Newton Sanches and Srikanth Kandula. 2016. CloudBuild: Microsoft\u2019s distributed and caching build service. In ICSE SEIP. 11\u201320.  Hamed Esfahani Jonas Fietz Qi Ke Alexei Kolomiets Erica Lan Erik Mavrinac Wolfram Schulte Newton Sanches and Srikanth Kandula. 2016. CloudBuild: Microsoft\u2019s distributed and caching build service. In ICSE SEIP. 11\u201320.","DOI":"10.1145\/2889160.2889222"},{"key":"e_1_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Alessio Gambi Jonathan Bell and Andreas Zeller. 2018. Practical test dependency detection. In ICST. 1\u201311.  Alessio Gambi Jonathan Bell and Andreas Zeller. 2018. Practical test dependency detection. In ICST. 1\u201311.","DOI":"10.1109\/ICST.2018.00011"},{"key":"e_1_2_2_19_1","volume-title":"Ekstazi: Lightweight test selection. In ICSE Demo. 713\u2013716.","author":"Gligoric Milos","year":"2015","unstructured":"Milos Gligoric , Lamyaa Eloussi , and Darko Marinov . 2015 a. Ekstazi: Lightweight test selection. In ICSE Demo. 713\u2013716. Milos Gligoric, Lamyaa Eloussi, and Darko Marinov. 2015a. Ekstazi: Lightweight test selection. In ICSE Demo. 713\u2013716."},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Milos Gligoric Lamyaa Eloussi and Darko Marinov. 2015b. Practical regression test selection with dynamic file dependencies. In ISSTA. 211\u2013222.  Milos Gligoric Lamyaa Eloussi and Darko Marinov. 2015b. Practical regression test selection with dynamic file dependencies. In ISSTA. 211\u2013222.","DOI":"10.1145\/2771783.2771784"},{"key":"e_1_2_2_21_1","unstructured":"Neville Grech George Kastrinis and Yannis Smaragdakis. 2018. Efficient reflection string analysis via graph coloring. In ECOOP . 1\u201325.  Neville Grech George Kastrinis and Yannis Smaragdakis. 2018. Efficient reflection string analysis via graph coloring. In ECOOP . 1\u201325."},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Michaela Greiler Arie van Deursen and Margaret-Anne Storey. 2013. Automated detection of test fixture strategies and smells. In ICST. 322\u2013331.  Michaela Greiler Arie van Deursen and Margaret-Anne Storey. 2013. Automated detection of test fixture strategies and smells. In ICST. 322\u2013331.","DOI":"10.1109\/ICST.2013.45"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Jos\u00e9 de Oliveira Guimar\u00e3es. 1998. Reflection for statically typed languages. In ECOOP. 440\u2013461.  Jos\u00e9 de Oliveira Guimar\u00e3es. 1998. Reflection for statically typed languages. In ECOOP. 440\u2013461.","DOI":"10.1007\/BFb0054103"},{"key":"e_1_2_2_24_1","volume-title":"Testing at the speed and scale of Google. (Jun","author":"Gupta Pooja","year":"2011","unstructured":"Pooja Gupta , Mark Ivey , and John Penix . 2011. Testing at the speed and scale of Google. (Jun 2011 ). http:\/\/goo.gl\/2B5cyl . Pooja Gupta, Mark Ivey, and John Penix. 2011. Testing at the speed and scale of Google. (Jun 2011). http:\/\/goo.gl\/2B5cyl ."},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Alex Gyori Owolabi Legunsen Farah Hariri and Darko Marinov. 2018. Evaluating regression test selection opportunities in a very large open-source ecosystem. In ISSRE. 112\u2013122.  Alex Gyori Owolabi Legunsen Farah Hariri and Darko Marinov. 2018. Evaluating regression test selection opportunities in a very large open-source ecosystem. In ISSRE. 112\u2013122.","DOI":"10.1109\/ISSRE.2018.00022"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Alex Gyori August Shi Farah Hariri and Darko Marinov. 2015. Reliable testing: Detecting state-polluting tests to prevent test dependency. In ISSTA. 223\u2013233.  Alex Gyori August Shi Farah Hariri and Darko Marinov. 2015. Reliable testing: Detecting state-polluting tests to prevent test dependency. In ISSTA. 223\u2013233.","DOI":"10.1145\/2771783.2771793"},{"key":"e_1_2_2_27_1","volume-title":"Reflection-aware static regression test selection. Master\u2019s thesis","author":"Hadzi-Tanovic Milica","unstructured":"Milica Hadzi-Tanovic . 2018. Reflection-aware static regression test selection. Master\u2019s thesis . University of Illinois at Urbana-Champaign , USA. Milica Hadzi-Tanovic. 2018. Reflection-aware static regression test selection. Master\u2019s thesis. University of Illinois at Urbana-Champaign, USA."},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Mary Jean Harrold James A. Jones Tongyu Li Donglin Liang Alessandro Orso Maikel Pennings Saurabh Sinha S. Alexander Spoon and Ashish Gujarathi. 2001. Regression test selection for Java software. In OOPSLA. 312\u2013326.  Mary Jean Harrold James A. Jones Tongyu Li Donglin Liang Alessandro Orso Maikel Pennings Saurabh Sinha S. Alexander Spoon and Ashish Gujarathi. 2001. Regression test selection for Java software. In OOPSLA. 312\u2013326.","DOI":"10.1145\/504311.504305"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Kim Herzig and Nachi Nagappan. 2015. Empirically detecting false test alarms using association rules. In ICSE. 39\u201348.  Kim Herzig and Nachi Nagappan. 2015. Empirically detecting false test alarms using association rules. In ICSE. 39\u201348.","DOI":"10.1109\/ICSE.2015.133"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Chen Huo and James Clause. 2014. Improving oracle quality by detecting brittle assertions and unused inputs in tests. In ISSTA . 621\u2013631.  Chen Huo and James Clause. 2014. Improving oracle quality by detecting brittle assertions and unused inputs in tests. In ISSTA . 621\u2013631.","DOI":"10.1145\/2635868.2635917"},{"key":"e_1_2_2_31_1","volume-title":"Limiting transitive closure for static regression test selection approaches. Master\u2019s thesis","author":"Karlsson Henrik","unstructured":"Henrik Karlsson . 2019. Limiting transitive closure for static regression test selection approaches. Master\u2019s thesis . KTH Royal Institute of Technology , Sweden . Henrik Karlsson. 2019. Limiting transitive closure for static regression test selection approaches. Master\u2019s thesis. KTH Royal Institute of Technology, Sweden."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1271173"},{"key":"e_1_2_2_33_1","first-page":"51","article-title":"Class firewall, test order, and regression testing of object-oriented programs","volume":"8","author":"Kung David Chenho","year":"1995","unstructured":"David Chenho Kung , Jerry Gao , Pei Hsia , Jeremy Lin , and Yasufumi Toyoshima . 1995 . Class firewall, test order, and regression testing of object-oriented programs . JOOP 8 , 2 (1995), 51 \u2013 65 . David Chenho Kung, Jerry Gao, Pei Hsia, Jeremy Lin, and Yasufumi Toyoshima. 1995. Class firewall, test order, and regression testing of object-oriented programs. JOOP 8, 2 (1995), 51\u201365.","journal-title":"JOOP"},{"key":"e_1_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Wing Lam Reed Oei August Shi Darko Marinov and Tao Xie. 2019. iDFlakies: A framework for detecting and partially classifying flaky tests. In ICST. 312\u2013322.  Wing Lam Reed Oei August Shi Darko Marinov and Tao Xie. 2019. iDFlakies: A framework for detecting and partially classifying flaky tests. In ICST. 312\u2013322.","DOI":"10.1109\/ICST.2019.00038"},{"key":"e_1_2_2_35_1","volume-title":"Ernst","author":"Lam Wing","year":"2015","unstructured":"Wing Lam , Sai Zhang , and Michael D . Ernst . 2015 . When tests collide: Evaluating and coping with the impact of test dependence. Technical Report. University of Washington CSE Dept . Wing Lam, Sai Zhang, and Michael D. Ernst. 2015. When tests collide: Evaluating and coping with the impact of test dependence. Technical Report. University of Washington CSE Dept."},{"key":"e_1_2_2_36_1","volume-title":"Vinju","author":"Landman Davy","year":"2017","unstructured":"Davy Landman , Alexander Serebrenik , and Jurgen J . Vinju . 2017 . Challenges for static analysis of Java reflection: Literature review and empirical study. In ICSE. 507\u2013518. Davy Landman, Alexander Serebrenik, and Jurgen J. Vinju. 2017. Challenges for static analysis of Java reflection: Literature review and empirical study. In ICSE. 507\u2013518."},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Owolabi Legunsen Farah Hariri August Shi Yafeng Lu Lingming Zhang and Darko Marinov. 2016. An extensive study of static regression test selection in modern software evolution. In FSE. 583\u2013594.  Owolabi Legunsen Farah Hariri August Shi Yafeng Lu Lingming Zhang and Darko Marinov. 2016. An extensive study of static regression test selection in modern software evolution. In FSE. 583\u2013594.","DOI":"10.1145\/2950290.2950361"},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Owolabi Legunsen Darko Marinov and Grigore Ro\u015fu. 2015. Evolution-aware monitoring-oriented programming. In ICSE NIER . 615\u2013618.  Owolabi Legunsen Darko Marinov and Grigore Ro\u015fu. 2015. Evolution-aware monitoring-oriented programming. In ICSE NIER . 615\u2013618.","DOI":"10.1109\/ICSE.2015.206"},{"key":"e_1_2_2_39_1","volume-title":"STARTS: STAtic Regression Test Selection. In ASE. 949\u2013954.","author":"Legunsen Owolabi","year":"2017","unstructured":"Owolabi Legunsen , August Shi , and Darko Marinov . 2017 . STARTS: STAtic Regression Test Selection. In ASE. 949\u2013954. Owolabi Legunsen, August Shi, and Darko Marinov. 2017. STARTS: STAtic Regression Test Selection. In ASE. 949\u2013954."},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Owolabi Legunsen Yi Zhang Milica Hadzi-Tanovic Grigore Ro\u015fu and Darko Marinov. 2019. Techniques for evolution-aware runtime verification. In ICST. 300\u2013311.  Owolabi Legunsen Yi Zhang Milica Hadzi-Tanovic Grigore Ro\u015fu and Darko Marinov. 2019. Techniques for evolution-aware runtime verification. In ICST. 300\u2013311.","DOI":"10.1109\/ICST.2019.00037"},{"key":"e_1_2_2_41_1","volume-title":"Leung and Lee White","author":"Hareton","year":"1990","unstructured":"Hareton K.N. Leung and Lee White . 1990 . A study of integration testing and software regression at the integration level. In ICSM . 290\u2013301. Hareton K.N. Leung and Lee White. 1990. A study of integration testing and software regression at the integration level. In ICSM . 290\u2013301."},{"key":"e_1_2_2_42_1","volume-title":"Halfond","author":"Li Ding","year":"2015","unstructured":"Ding Li , Yingjun Lyu , Mian Wan , and William G.J . Halfond . 2015 a. String analysis for Java and Android applications. In ESEC\/FSE . 661\u2013672. Ding Li, Yingjun Lyu, Mian Wan, and William G.J. Halfond. 2015a. String analysis for Java and Android applications. In ESEC\/FSE . 661\u2013672."},{"key":"e_1_2_2_43_1","volume-title":"Droidra: Taming reflection to support wholeprogram analysis of Android apps. In ISSTA. 318\u2013329.","author":"Li Li","year":"2016","unstructured":"Li Li , Tegawend\u00e9 F Bissyand\u00e9 , Damien Octeau , and Jacques Klein . 2016 a. Droidra: Taming reflection to support wholeprogram analysis of Android apps. In ISSTA. 318\u2013329. Li Li, Tegawend\u00e9 F Bissyand\u00e9, Damien Octeau, and Jacques Klein. 2016a. Droidra: Taming reflection to support wholeprogram analysis of Android apps. In ISSTA. 318\u2013329."},{"key":"e_1_2_2_44_1","doi-asserted-by":"crossref","unstructured":"Li Li Tegawend\u00e9 F Bissyand\u00e9 Damien Octeau and Jacques Klein. 2016b. Reflection-aware static analysis of Android apps. In ASE. 756\u2013761.  Li Li Tegawend\u00e9 F Bissyand\u00e9 Damien Octeau and Jacques Klein. 2016b. Reflection-aware static analysis of Android apps. In ASE. 756\u2013761.","DOI":"10.1145\/2970276.2970277"},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Yue Li Tian Tan Yulei Sui and Jingling Xue. 2014. Self-inferencing reflection resolution for Java. In ECOOP. 27\u201353.  Yue Li Tian Tan Yulei Sui and Jingling Xue. 2014. Self-inferencing reflection resolution for Java. In ECOOP. 27\u201353.","DOI":"10.1007\/978-3-662-44202-9_2"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Yue Li Tian Tan and Jingling Xue. 2015b. Effective soundness-guided reflection analysis. In SAS. 162\u2013180.  Yue Li Tian Tan and Jingling Xue. 2015b. Effective soundness-guided reflection analysis. In SAS. 162\u2013180.","DOI":"10.1007\/978-3-662-48288-9_10"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2644805"},{"key":"e_1_2_2_48_1","volume-title":"EALRTS: A predictive regression test selection tool. Master\u2019s thesis","author":"Lundsten Erik","year":"2019","unstructured":"Erik Lundsten . 2019 . EALRTS: A predictive regression test selection tool. Master\u2019s thesis . KTH Royal Institute of Technology , Sweden . Erik Lundsten. 2019. EALRTS: A predictive regression test selection tool. Master\u2019s thesis. KTH Royal Institute of Technology, Sweden."},{"key":"e_1_2_2_49_1","doi-asserted-by":"crossref","unstructured":"Mateusz Machalica Alex Samylkin Meredith Porth and Satish Chandra. 2019. Predictive test selection. In ICSE SEIP. 91\u2013100.  Mateusz Machalica Alex Samylkin Meredith Porth and Satish Chandra. 2019. Predictive test selection. In ICSE SEIP. 91\u2013100.","DOI":"10.1109\/ICSE-SEIP.2019.00018"},{"key":"e_1_2_2_50_1","doi-asserted-by":"crossref","unstructured":"Atif M. Memon Zebao Gao Bao N. Nguyen Sanjeev Dhanda Eric Nickell Rob Siemborski and John Micco. 2017. Taming Google-scale continuous testing. In ICSE-SEIP. 233\u2013242.  Atif M. Memon Zebao Gao Bao N. Nguyen Sanjeev Dhanda Eric Nickell Rob Siemborski and John Micco. 2017. Taming Google-scale continuous testing. In ICSE-SEIP. 233\u2013242.","DOI":"10.1109\/ICSE-SEIP.2017.16"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Jesper \u00d6qvist G\u00f6rel Hedin and Boris Magnusson. 2016. Extraction-based regression test selection. In PPPJ. 1\u201310.  Jesper \u00d6qvist G\u00f6rel Hedin and Boris Magnusson. 2016. Extraction-based regression test selection. In PPPJ. 1\u201310.","DOI":"10.1145\/2972206.2972224"},{"key":"e_1_2_2_52_1","unstructured":"Oracle. 2018. jdeps. (2018). https:\/\/docs.oracle.com\/javase\/8\/docs\/technotes\/tools\/unix\/jdeps.html .  Oracle. 2018. jdeps. (2018). https:\/\/docs.oracle.com\/javase\/8\/docs\/technotes\/tools\/unix\/jdeps.html ."},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Alessandro Orso Nanjuan Shi and Mary Jean Harrold. 2004. Scaling regression testing to large software systems. In FSE. 241\u2013251.  Alessandro Orso Nanjuan Shi and Mary Jean Harrold. 2004. Scaling regression testing to large software systems. In FSE. 241\u2013251.","DOI":"10.1145\/1041685.1029928"},{"key":"e_1_2_2_54_1","unstructured":"OW2 Consortium. 2018. ASM. (2018). http:\/\/asm.ow2.org\/ .  OW2 Consortium. 2018. ASM. (2018). http:\/\/asm.ow2.org\/ ."},{"key":"e_1_2_2_55_1","doi-asserted-by":"crossref","unstructured":"Fabio Palomba and Andy Zaidman. 2017. Does refactoring of test smells induce fixing flaky tests?. In ICSME. 1\u201312.  Fabio Palomba and Andy Zaidman. 2017. Does refactoring of test smells induce fixing flaky tests?. In ICSME. 1\u201312.","DOI":"10.1109\/ICSME.2017.12"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1035292.1029012"},{"key":"e_1_2_2_57_1","volume-title":"Chianti: A prototype change impact analysis tool for Java . Technical Report DCS-TR-533","author":"Ren Xiaoxia","year":"2003","unstructured":"Xiaoxia Ren , Fenil Shah , Frank Tip , Barbara G Ryder , Ophelia Chesley , and Julian Dolby . 2003 . Chianti: A prototype change impact analysis tool for Java . Technical Report DCS-TR-533 . Rutgers University CS Dept . Xiaoxia Ren, Fenil Shah, Frank Tip, Barbara G Ryder, Ophelia Chesley, and Julian Dolby. 2003. Chianti: A prototype change impact analysis tool for Java . Technical Report DCS-TR-533. Rutgers University CS Dept."},{"key":"e_1_2_2_58_1","unstructured":"Gregg Rothermel and Mary Jean Harrold. 1993. A safe efficient algorithm for regression test selection. In ICSM. 358\u2013367.  Gregg Rothermel and Mary Jean Harrold. 1993. A safe efficient algorithm for regression test selection. In ICSM. 358\u2013367."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/248233.248262"},{"key":"e_1_2_2_60_1","unstructured":"August Shi Wing Lam Reed Oei Tao Xie and Darko Marinov. 2019. iFixFlakies: A framework for automatically fixing order-dependent flaky tests. In ESEC\/FSE. 545\u2013555.  August Shi Wing Lam Reed Oei Tao Xie and Darko Marinov. 2019. iFixFlakies: A framework for automatically fixing order-dependent flaky tests. In ESEC\/FSE. 545\u2013555."},{"key":"e_1_2_2_61_1","unstructured":"August Shi Tifany Yung Alex Gyori and Darko Marinov. 2015. Comparing and combining test-suite reduction and regression test selection. In ESEC\/FSE. 237\u2013247.  August Shi Tifany Yung Alex Gyori and Darko Marinov. 2015. Comparing and combining test-suite reduction and regression test selection. In ESEC\/FSE. 237\u2013247."},{"key":"e_1_2_2_62_1","doi-asserted-by":"crossref","unstructured":"Yannis Smaragdakis George Balatsouras George Kastrinis and Martin Bravenboer. 2015. More sound static handling of Java reflection. In APLAS. 485\u2013503.  Yannis Smaragdakis George Balatsouras George Kastrinis and Martin Bravenboer. 2015. More sound static handling of Java reflection. In APLAS. 485\u2013503.","DOI":"10.1007\/978-3-319-26529-2_26"},{"key":"e_1_2_2_63_1","doi-asserted-by":"crossref","unstructured":"Davide Spadini Fabio Palomba Andy Zaidman Magiel Bruntink and Alberto Bacchelli. 2018. On the relation of test smells to software code quality. In ICSME. 1\u201312.  Davide Spadini Fabio Palomba Andy Zaidman Magiel Bruntink and Alberto Bacchelli. 2018. On the relation of test smells to software code quality. In ICSME. 1\u201312.","DOI":"10.1109\/ICSME.2018.00010"},{"key":"e_1_2_2_64_1","doi-asserted-by":"crossref","unstructured":"Amitabh Srivastava and Jay Thiagarajan. 2002. Effectively prioritizing tests in development environment. In ISSTA. 97\u2013106.  Amitabh Srivastava and Jay Thiagarajan. 2002. Effectively prioritizing tests in development environment. In ISSTA. 97\u2013106.","DOI":"10.1145\/566171.566187"},{"key":"e_1_2_2_65_1","unstructured":"STARTS Team. 2018. STARTS webpage. (2018). https:\/\/github.com\/TestingResearchIllinois\/starts .  STARTS Team. 2018. STARTS webpage. (2018). https:\/\/github.com\/TestingResearchIllinois\/starts ."},{"key":"e_1_2_2_66_1","doi-asserted-by":"crossref","unstructured":"Andreas Thies and Eric Bodden. 2012. RefaFlex: Safer refactorings for reflective Java programs. In ISSTA. 1\u201311.  Andreas Thies and Eric Bodden. 2012. RefaFlex: Safer refactorings for reflective Java programs. In ISSTA. 1\u201311.","DOI":"10.1145\/2338965.2336754"},{"key":"e_1_2_2_67_1","volume-title":"Andrea De Lucia, and Denys Poshyvanyk.","author":"Tufano Michele","year":"2015","unstructured":"Michele Tufano , Fabio Palomba , Gabriele Bavota , Rocco Oliveto , Massimiliano Di Penta , Andrea De Lucia, and Denys Poshyvanyk. 2015 . When and why your code starts to smell bad. In ICSE. 403\u2013414. Michele Tufano, Fabio Palomba, Gabriele Bavota, Rocco Oliveto, Massimiliano Di Penta, Andrea De Lucia, and Denys Poshyvanyk. 2015. When and why your code starts to smell bad. In ICSE. 403\u2013414."},{"key":"e_1_2_2_68_1","doi-asserted-by":"crossref","unstructured":"Kaiyuan Wang Chenguang Zhu Ahmet \u00c7elik Jongwook Kim Don Batory and Milos Gligoric. 2018. Towards refactoringaware regression test selection. In ICSE. 233\u2013244.  Kaiyuan Wang Chenguang Zhu Ahmet \u00c7elik Jongwook Kim Don Batory and Milos Gligoric. 2018. Towards refactoringaware regression test selection. In ICSE. 233\u2013244.","DOI":"10.1145\/3180155.3180254"},{"key":"e_1_2_2_69_1","volume-title":"A method for selecting regression test cases based on software changes and software faults. Master\u2019s thesis","author":"Yilmaz Ugur","unstructured":"Ugur Yilmaz . 2019. A method for selecting regression test cases based on software changes and software faults. Master\u2019s thesis . Hacettepe University , Turkey . Ugur Yilmaz. 2019. A method for selecting regression test cases based on software changes and software faults. Master\u2019s thesis. Hacettepe University, Turkey."},{"key":"e_1_2_2_70_1","first-page":"67","article-title":"Regression testing minimization, selection and prioritization: A survey","volume":"22","author":"Yoo Shin","year":"2012","unstructured":"Shin Yoo and Mark Harman . 2012 . Regression testing minimization, selection and prioritization: A survey . STVR 22 , 2 (2012), 67 \u2013 120 . Shin Yoo and Mark Harman. 2012. Regression testing minimization, selection and prioritization: A survey. STVR 22, 2 (2012), 67\u2013120.","journal-title":"STVR"},{"key":"e_1_2_2_71_1","volume-title":"Tools for continuous integration at Google scale. (Jan","author":"York Nathan","year":"2011","unstructured":"Nathan York . 2011. Tools for continuous integration at Google scale. (Jan 2011 ). https:\/\/goo.gl\/Gqj7uL . Nathan York. 2011. Tools for continuous integration at Google scale. (Jan 2011). https:\/\/goo.gl\/Gqj7uL ."},{"key":"e_1_2_2_72_1","unstructured":"Lingming Zhang. 2018. Hybrid regression test selection. In ICSE. 199\u2013209.  Lingming Zhang. 2018. Hybrid regression test selection. In ICSE. 199\u2013209."},{"key":"e_1_2_2_73_1","doi-asserted-by":"crossref","unstructured":"Lingming Zhang Miryung Kim and Sarfraz Khurshid. 2011. Localizing failure-inducing program edits based on spectrum information. In ICSM. 23\u201332.  Lingming Zhang Miryung Kim and Sarfraz Khurshid. 2011. Localizing failure-inducing program edits based on spectrum information. In ICSM. 23\u201332.","DOI":"10.1109\/ICSM.2011.6080769"},{"key":"e_1_2_2_74_1","doi-asserted-by":"crossref","unstructured":"Sai Zhang Darioush Jalali Jochen Wuttke Kivan\u00e7 Mu\u015flu Wing Lam Michael D. Ernst and David Notkin. 2014. Empirically revisiting the test independence assumption. In ISSTA. 385\u2013396.  Sai Zhang Darioush Jalali Jochen Wuttke Kivan\u00e7 Mu\u015flu Wing Lam Michael D. Ernst and David Notkin. 2014. Empirically revisiting the test independence assumption. In ISSTA. 385\u2013396.","DOI":"10.1145\/2610384.2610404"},{"key":"e_1_2_2_75_1","unstructured":"Chenguang Zhu Owolabi Legunsen August Shi and Milos Gligoric. 2019. A framework for checking regression test selection tools. In ICSE. 430\u2013441.  Chenguang Zhu Owolabi Legunsen August Shi and Milos Gligoric. 2019. A framework for checking regression test selection tools. In ICSE. 430\u2013441."}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360613","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3360613","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3360613","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:22:59Z","timestamp":1750202579000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,10]]},"references-count":75,"journal-issue":{"issue":"OOPSLA","published-print":{"date-parts":[[2019,10,10]]}},"alternative-id":["10.1145\/3360613"],"URL":"https:\/\/doi.org\/10.1145\/3360613","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,10]]},"assertion":[{"value":"2019-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}