{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T02:08:00Z","timestamp":1789178880271,"version":"build-2803163510"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/T030526\/1"],"award-info":[{"award-number":["EP\/T030526\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>Random testing approaches work by generating inputs at random, or by selecting inputs randomly from some pre-defined operational profile. One long-standing question that arises in this and other testing contexts is as follows: When can we stop testing? At what point can we be certain that executing further tests in this manner will not explore previously untested (and potentially buggy) software behaviors? This is analogous to the question in Machine Learning, of how many training examples are required in order to infer an accurate model. In this paper we show how probabilistic approaches to answer this question in Machine Learning (arising from Computational Learning Theory) can be applied in our testing context, to provide an upper-bound on the number of tests required to achieve a given level of adequacy. We validate this bound on a large set of Java units, and an autonomous driving system.<\/jats:p>","DOI":"10.1145\/3660819","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"2538-2560","source":"Crossref","is-referenced-by-count":1,"title":["Bounding Random Test Set Size with Computational Learning Theory"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2134-6548","authenticated-orcid":false,"given":"Neil","family":"Walkinshaw","sequence":"first","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8233-9873","authenticated-orcid":false,"given":"Michael","family":"Foster","sequence":"additional","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0079-5355","authenticated-orcid":false,"given":"Jos\u00e9 Miguel","family":"Rojas","sequence":"additional","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4771-1446","authenticated-orcid":false,"given":"Robert M.","family":"Hierons","sequence":"additional","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/MobileSoft.2015.11","article-title":"Exploiting the saturation effect in automatic random testing of android applications","author":"Amalfitano Domenico","year":"2015","unstructured":"Domenico Amalfitano, Nicola Amatucci, Anna Rita Fasolino, Porfirio Tramontana, Emily Kowalczyk, and Atif M Memon. 2015. Exploiting the saturation effect in automatic random testing of android applications. In 2015 2nd ACM International Conference on Mobile Software Engineering and Systems. IEEE, 33\u201343.","journal-title":"2015 2nd ACM International Conference on Mobile Software Engineering and Systems"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/0890-5401(87)90052-6"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.121"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/227607.227611"},{"issue":"5","key":"e_1_3_1_6_2","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1109\/TSE.2019.2906187","article-title":"Adaptive test case allocation, selection and generation using coverage spectrum and operational profile","volume":"47","author":"Bertolino Antonia","year":"2019","unstructured":"Antonia Bertolino, Breno Miranda, Roberto Pietrantuono, and Stefano Russo. 2019. Adaptive test case allocation, selection and generation using coverage spectrum and operational profile. IEEE Transactions on Software Engineering 47, 5 (2019), 881\u2013898.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_7_2","first-page":"5","article-title":"Assurances in software testing: A roadmap","author":"B\u00f6hme Marcel","year":"2019","unstructured":"Marcel B\u00f6hme. 2019. Assurances in software testing: A roadmap. In 2019 IEEE\/ACM 41st International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER). IEEE, 5\u20138.","journal-title":"2019 IEEE\/ACM 41st International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER)"},{"issue":"4","key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1109\/TSE.2015.2487274","article-title":"A probabilistic analysis of the efficiency of automated software testing","volume":"42","author":"B\u00f6hme Marcel","year":"2015","unstructured":"Marcel B\u00f6hme and Soumya Paul. 2015. A probabilistic analysis of the efficiency of automated software testing. IEEE Transactions on Software Engineering 42, 4 (2015), 345\u2013360.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2009.06.006"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00625279"},{"key":"e_1_3_1_11_2","first-page":"597","article-title":"An empirical study on mutation, statement and branch coverage fault revelation that avoids the unreliable clean program assumption","author":"Chekam Thierry Titcheu","year":"2017","unstructured":"Thierry Titcheu Chekam, Mike Papadakis, Yves Le Traon, and Mark Harman. 2017. An empirical study on mutation, statement and branch coverage fault revelation that avoids the unreliable clean program assumption. In 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE). IEEE, 597\u2013608.","journal-title":"2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE)"},{"key":"e_1_3_1_12_2","first-page":"320","volume-title":"Advances in Computer Science-ASIAN 2004. Higher-Level Decision Making: 9th Asian Computing Science Conference","author":"Chen Tsong Yueh","year":"2005","unstructured":"Tsong Yueh Chen, Hing Leung, and Ieng Kei Mak. 2005. Adaptive random testing. In Advances in Computer Science-ASIAN 2004. Higher-Level Decision Making: 9th Asian Computing Science Conference. Springer, 320\u2013329."},{"key":"e_1_3_1_13_2","first-page":"714","article-title":"PAC learning-based verification and model synthesis","author":"Chen Yu-Fang","year":"2016","unstructured":"Yu-Fang Chen, Chiao Hsieh, Ond\u0159ej Leng\u00e1l, Tsung-Ju Lii, Ming-Hsien Tsai, Bow-Yaw Wang, and Farn Wang. 2016. PAC learning-based verification and model synthesis. In Proceedings of the 38th International Conference on Software Engineering. 714\u2013724.","journal-title":"Proceedings of the 38th International Conference on Software Engineering"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2544173.2509552"},{"key":"e_1_3_1_15_2","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1145\/351240.351266","article-title":"QuickCheck: a lightweight tool for random testing of Haskell programs","author":"Claessen Koen","year":"2000","unstructured":"Koen Claessen and John Hughes. 2000. QuickCheck: a lightweight tool for random testing of Haskell programs. In Proceedings of the fifth ACM SIGPLAN international conference on Functional programming. 268\u2013279.","journal-title":"Proceedings of the fifth ACM SIGPLAN international conference on Functional programming"},{"key":"e_1_3_1_16_2","first-page":"1","article-title":"CARLA: An open urban driving simulator","author":"Dosovitskiy Alexey","year":"2017","unstructured":"Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. 2017. CARLA: An open urban driving simulator. In Conference on robot learning. PMLR, 1\u201316.","journal-title":"Conference on robot learning"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/08839510701853200"},{"key":"e_1_3_1_18_2","article-title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","author":"Dziugaite Gintare Karolina","year":"2017","unstructured":"Gintare Karolina Dziugaite and Daniel M. Roy. 2017. Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data. CoRR abs\/1703.11008 (2017). arXiv:1703.11008 https:\/\/arxiv.org\/abs\/1703.11008","journal-title":"CoRR"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.6194"},{"key":"e_1_3_1_20_2","first-page":"416","article-title":"Evosuite: automatic test suite generation for object-oriented software","author":"Fraser Gordon","year":"2011","unstructured":"Gordon Fraser and Andrea Arcuri. 2011. Evosuite: automatic test suite generation for object-oriented software. In Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering. 416\u2013419.","journal-title":"Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2685612"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1575"},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/ICSTW.2008.39","article-title":"Strengthening inferred specifications using search based testing","author":"Ghani Kamran","year":"2008","unstructured":"Kamran Ghani and John A Clark. 2008. Strengthening inferred specifications using search based testing. In 2008 IEEE International Conference on Software Testing Verification and Validation Workshop. IEEE, 187\u2013194.","journal-title":"2008 IEEE International Conference on Software Testing Verification and Validation Workshop"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(78)90562-4"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/285055.285060"},{"key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1145\/800027.808473","article-title":"Toward a theory of test data selection","author":"Goodenough John B","year":"1975","unstructured":"John B Goodenough and Susan L Gerhart. 1975. Toward a theory of test data selection. In Proceedings of the international conference on Reliable software. 493\u2013510.","journal-title":"Proceedings of the international conference on Reliable software"},{"key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1109\/ICSE.2007.68","article-title":"Randomized differential testing as a prelude to formal verification","author":"Groce Alex","year":"2007","unstructured":"Alex Groce, Gerard Holzmann, and Rajeev Joshi. 2007. Randomized differential testing as a prelude to formal verification. In 29th International Conference on Software Engineering (ICSE\u201907). IEEE, 621\u2013631.","journal-title":"29th International Conference on Software Engineering (ICSE\u201907)"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1109\/QSIC.2007.4385527","article-title":"Statistical metamorphic testing testing programs with random output by means of statistical hypothesis tests and metamorphic testing","author":"Guderlei Ralph","year":"2007","unstructured":"Ralph Guderlei and Johannes Mayer. 2007. Statistical metamorphic testing testing programs with random output by means of statistical hypothesis tests and metamorphic testing. In Seventh International Conference on Quality Software (QSIC 2007). IEEE, 404\u2013409.","journal-title":"Seventh International Conference on Quality Software (QSIC 2007)"},{"key":"e_1_3_1_29_2","first-page":"25725","article-title":"Online pac-bayes learning","volume":"35","author":"Haddouche Maxime","year":"2022","unstructured":"Maxime Haddouche and Benjamin Guedj. 2022. Online pac-bayes learning. Advances in Neural Information Processing Systems 35 (2022), 25725\u201325738.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_30_2","article-title":"Random Testing","author":"Hamlet Richard","year":"1994","unstructured":"Richard Hamlet. 1994. Random Testing. Encyclopedia of Software Engineering (1994).","journal-title":"Encyclopedia of Software Engineering"},{"key":"e_1_3_1_31_2","first-page":"61","article-title":"Testing: a roadmap","author":"Harrold Mary Jean","year":"2000","unstructured":"Mary Jean Harrold. 2000. Testing: a roadmap. In Proceedings of the Conference on the Future of Software Engineering. 61\u201372.","journal-title":"Proceedings of the Conference on the Future of Software Engineering"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1145\/277631.277647","article-title":"An empirical investigation of program spectra","author":"Harrold Mary Jean","year":"1998","unstructured":"Mary Jean Harrold, Gregg Rothermel, Rui Wu, and Liu Yi. 1998. An empirical investigation of program spectra. In Proceedings of the 1998 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering. 83\u201390.","journal-title":"Proceedings of the 1998 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(88)90002-1"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1145\/2568225.2568271","article-title":"Coverage is not strongly correlated with test suite effectiveness","author":"Inozemtseva Laura","year":"2014","unstructured":"Laura Inozemtseva and Reid Holmes. 2014. Coverage is not strongly correlated with test suite effectiveness. In Proceedings of the 36th international conference on software engineering. 435\u2013445.","journal-title":"Proceedings of the 36th international conference on software engineering"},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/978-3-319-21690-4_32","article-title":"The open-source learnLib: a framework for active automata learning","author":"Isberner Malte","year":"2015","unstructured":"Malte Isberner, Falk Howar, and Bernhard Steffen. 2015. The open-source learnLib: a framework for active automata learning. In Computer Aided Verification: 27th International Conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I 27. Springer, 487\u2013495.","journal-title":"Computer Aided Verification: 27th International Conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I 27"},{"key":"e_1_3_1_36_2","first-page":"955","article-title":"Code coverage at Google","author":"Ivankovi\u0107 Marko","year":"2019","unstructured":"Marko Ivankovi\u0107, Goran Petrovi\u0107, Ren\u00e9 Just, and Gordon Fraser. 2019. Code coverage at Google. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 955\u2013963.","journal-title":"Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering"},{"key":"e_1_3_1_37_2","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1145\/2610384.2628055","article-title":"Defects4J: A database of existing faults to enable controlled testing studies for Java programs","author":"Just Ren\u00e9","year":"2014","unstructured":"Ren\u00e9 Just, Darioush Jalali, and Michael D Ernst. 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the 2014 international symposium on software testing and analysis. 437\u2013440.","journal-title":"Proceedings of the 2014 international symposium on software testing and analysis"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3897.001.0001"},{"key":"e_1_3_1_39_2","first-page":"1501","article-title":"Castle: Regularization via auxiliary causal graph discovery","volume":"33","author":"Kyono Trent","year":"2020","unstructured":"Trent Kyono, Yao Zhang, and Mihaela van der Schaar. 2020. Castle: Regularization via auxiliary causal graph discovery. Advances in Neural Information Processing Systems 33 (2020), 1501\u20131512.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_40_2","article-title":"Reachable Coverage: Estimating Saturation in Fuzzing","author":"Liyanage Danushka","year":"2023","unstructured":"Danushka Liyanage, Marcel B\u00f6hme, Chakkrit Tantithamthavorn, and Stephan Lipp. 2023. Reachable Coverage: Estimating Saturation in Fuzzing. In Proceedings of the 45th IEEE\/ACM International Conference on Software Engineering (ICSE\u201923), 17-19 May 2023, Australia.","journal-title":"Proceedings of the 45th IEEE\/ACM International Conference on Software Engineering (ICSE\u201923), 17-19 May 2023, Australia"},{"key":"e_1_3_1_41_2","first-page":"1","article-title":"Extrapolating Coverage Rate in Greybox Fuzzing","author":"Liyanage Danushka","year":"2024","unstructured":"Danushka Liyanage, Seongmin Lee, Chakkrit Tantithamthavorn, and Marcel B\u00f6hme. 2024. Extrapolating Coverage Rate in Greybox Fuzzing. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering. 1\u201312.","journal-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.5555\/239425"},{"key":"e_1_3_1_43_2","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1145\/279943.279989","article-title":"Some pac-bayesian theorems","author":"McAllester David A","year":"1998","unstructured":"David A McAllester. 1998. Some pac-bayesian theorems. In Proceedings of the eleventh annual conference on Computational learning theory. 230\u2013234.","journal-title":"Proceedings of the eleventh annual conference on Computational learning theory"},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1007\/978-3-642-21768-5_11","article-title":"Incremental learning-based testing for reactive systems","author":"Meinke Karl","year":"2011","unstructured":"Karl Meinke and Muddassar A Sindhu. 2011. Incremental learning-based testing for reactive systems. In International Conference on Tests and Proofs. Springer, 134\u2013151.","journal-title":"International Conference on Tests and Proofs"},{"key":"e_1_3_1_45_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/SEAA.2015.69","article-title":"Improving test coverage measurement for reused software","author":"Miranda Breno","year":"2015","unstructured":"Breno Miranda and Antonia Bertolino. 2015. Improving test coverage measurement for reused software. In 2015 41st Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 27\u201334.","journal-title":"2015 41st Euromicro Conference on Software Engineering and Advanced Applications"},{"issue":"3","key":"e_1_3_1_46_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3389126","article-title":"Testing relative to usage scope: Revisiting software coverage criteria","volume":"29","author":"Miranda Breno","year":"2020","unstructured":"Breno Miranda and Antonia Bertolino. 2020. Testing relative to usage scope: Revisiting software coverage criteria. ACM Transactions on Software Engineering and Methodology (TOSEM) 29, 3 (2020), 1\u201324.","journal-title":"ACM Transactions on Software Engineering and Methodology (TOSEM)"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/3360093"},{"key":"e_1_3_1_48_2","first-page":"129","article-title":"Gedanken-experiments on sequential machines","volume":"34","author":"Moore Edward F","year":"1956","unstructured":"Edward F Moore et al. 1956. Gedanken-experiments on sequential machines. Automata studies 34 (1956), 129\u2013153.","journal-title":"Automata studies"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/234313.234327"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/52.199724"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/1883612.1883618"},{"key":"e_1_3_1_52_2","first-page":"432","article-title":"The use of program profiling for software maintenance with applications to the year 2000 problem","author":"Reps Thomas","year":"1997","unstructured":"Thomas Reps, Thomas Ball, Manuvir Das, and James Larus. 1997. The use of program profiling for software maintenance with applications to the year 2000 problem. In Proceedings of the 6th European SOFTWARE ENGINEERING conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering. 432\u2013449.","journal-title":"Proceedings of the 6th European SOFTWARE ENGINEERING conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering"},{"key":"e_1_3_1_53_2","first-page":"367","article-title":"Using computational learning theory to analyze the testing complexity of program segments","author":"Romanik Kathleen","year":"1993","unstructured":"Kathleen Romanik and Jeffrey Scott Vitter. 1993. Using computational learning theory to analyze the testing complexity of program segments. In Proceedings of 1993 IEEE 17th International Computer Software and Applications Conference COMPSAC\u201993. IEEE, 367\u2013373.","journal-title":"Proceedings of 1993 IEEE 17th International Computer Software and Applications Conference COMPSAC\u201993"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1006\/inco.1996.0065"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107298019"},{"key":"e_1_3_1_56_2","first-page":"13989","article-title":"A theory of pac learnability under transformation invariances","volume":"35","author":"Shao Han","year":"2022","unstructured":"Han Shao, Omar Montasser, and Avrim Blum. 2022. A theory of pac learnability under transformation invariances. Advances in Neural Information Processing Systems 35 (2022), 13989\u201314001.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3339836"},{"key":"e_1_3_1_58_2","unstructured":"Leslie Valiant. 2014. Probably Approximately Correct: Nature\u2019s Algorithms for Learning and Prospering in a Complex World."},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/1968.1972"},{"key":"e_1_3_1_60_2","volume-title":"The nature of statistical learning theory","author":"Vapnik Vladimir","year":"1999","unstructured":"Vladimir Vapnik. 1999. The nature of statistical learning theory. Springer science & business media."},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/ICST.2017.30","article-title":"Uncertainty-driven black-box test data generation","author":"Walkinshaw Neil","year":"2017","unstructured":"Neil Walkinshaw and Gordon Fraser. 2017. Uncertainty-driven black-box test data generation. In 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). IEEE, 253\u2013263.","journal-title":"2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/69575.357231"},{"key":"e_1_3_1_63_2","doi-asserted-by":"crossref","first-page":"1128","DOI":"10.1109\/TSE.1986.6313008","article-title":"Axiomatizing software test data adequacy","volume":"12","author":"Weyuker Elaine J","year":"1986","unstructured":"Elaine J Weyuker. 1986. Axiomatizing software test data adequacy. IEEE transactions on software engineering 12 (1986), 1128\u20131138.","journal-title":"IEEE transactions on software engineering"},{"issue":"8","key":"e_1_3_1_64_2","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1109\/TSE.2016.2521368","article-title":"A survey on software fault localization","volume":"42","author":"Eric Wong W","year":"2016","unstructured":"W Eric Wong, Ruizhi Gao, Yihao Li, Rui Abreu, and Franz Wotawa. 2016. A survey on software fault localization. IEEE Transactions on Software Engineering 42, 8 (2016), 707\u2013740.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_65_2","unstructured":"Penghao Wu Xiaosong Jia Li Chen Junchi Yan Hongyang Li and Yu Qiao. 2022. Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline. arXiv:2206.08129 [cs.CV]"},{"issue":"1","key":"e_1_3_1_66_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/(SICI)1099-1689(199603)6:1<3::AID-STVR108>3.0.CO;2-D","article-title":"A formal interpretation of software testing as inductive inference","volume":"6","author":"Zhu Hong","year":"1996","unstructured":"Hong Zhu. 1996. A formal interpretation of software testing as inductive inference. Software Testing, Verification and Reliability 6, 1 (1996), 3\u201331.","journal-title":"Software Testing, Verification and Reliability"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.4370020204"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/267580.267590"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3512345"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660819","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3660819","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T07:55:12Z","timestamp":1770191712000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660819"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":68,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3660819"],"URL":"https:\/\/doi.org\/10.1145\/3660819","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}