{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T08:58:18Z","timestamp":1773997098940,"version":"3.50.1"},"reference-count":131,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,2,6]],"date-time":"2020-02-06T00:00:00Z","timestamp":1580947200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"German Research Foundation within the ConcSys and Perf4JS projects"},{"name":"BMWF\/Hessen within CRISP"},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61672047, 61861130363, 61872008, 61828201"],"award-info":[{"award-number":["61672047, 61861130363, 61872008, 61828201"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Program of China","award":["2017YFB1001803"],"award-info":[{"award-number":["2017YFB1001803"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2021,1,31]]},"abstract":"<jats:p>Virtually any software running on a computer has been processed by a compiler or a compiler-like tool. Because compilers are such a crucial piece of infrastructure for building software, their correctness is of paramount importance. To validate and increase the correctness of compilers, significant research efforts have been devoted to testing compilers. This survey article provides a comprehensive summary of the current state-of-the-art of research on compiler testing. The survey covers different aspects of the compiler testing problem, including how to construct test programs, what test oracles to use for determining whether a compiler behaves correctly, how to execute compiler tests efficiently, and how to help compiler developers take action on bugs discovered by compiler testing. Moreover, we survey work that empirically studies the strengths and weaknesses of current compiler testing research and practice. Based on the discussion of existing work, we outline several open challenges that remain to be addressed in future work.<\/jats:p>","DOI":"10.1145\/3363562","type":"journal-article","created":{"date-parts":[[2020,2,6]],"date-time":"2020-02-06T21:54:04Z","timestamp":1581026044000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":167,"title":["A Survey of Compiler Testing"],"prefix":"10.1145","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3056-9962","authenticated-orcid":false,"given":"Junjie","family":"Chen","sequence":"first","affiliation":[{"name":"College of Intelligence and Computing, Tianjin University, Tianjin, China"}]},{"given":"Jibesh","family":"Patra","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Stuttgart, Stuttgart, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1623-498X","authenticated-orcid":false,"given":"Michael","family":"Pradel","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Stuttgart, Stuttgart, Germany"}]},{"given":"Yingfei","family":"Xiong","sequence":"additional","affiliation":[{"name":"Key Laboratory of High Confidence Software Technologies (Peking University), MoE, Beijing, China"}]},{"given":"Hongyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computing, University of Newcastle, NSW, Australia"}]},{"given":"Dan","family":"Hao","sequence":"additional","affiliation":[{"name":"Key Laboratory of High Confidence Software Technologies (Peking University), MoE, Beijing, China"}]},{"given":"Lu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of High Confidence Software Technologies (Peking University), MoE, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2020,2,6]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the International Conference on Automated Software Engineering. 88--99","author":"Abreu Rui","unstructured":"Rui Abreu , Peter Zoeteweij , and Arjan J. C . van Gemund. 2009. Spectrum-based multiple fault localization . In Proceedings of the International Conference on Automated Software Engineering. 88--99 . Rui Abreu, Peter Zoeteweij, and Arjan J. C. van Gemund. 2009. Spectrum-based multiple fault localization. In Proceedings of the International Conference on Automated Software Engineering. 88--99."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION. 89--98","author":"Abreu Rui","unstructured":"Rui Abreu , Peter Zoeteweij , and Arjan J. C . Van Gemund. 2007. On the accuracy of spectrum-based fault localization . In Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION. 89--98 . Rui Abreu, Peter Zoeteweij, and Arjan J. C. Van Gemund. 2007. On the accuracy of spectrum-based fault localization. In Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION. 89--98."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931056"},{"key":"e_1_2_1_4_1","unstructured":"M. Amodio S. Chaudhuri and T. Reps. 2017. Neural attribute machines for program generation. ArXiv e-prints (May 2017). arxiv:cs.AI\/1705.09231  M. Amodio S. Chaudhuri and T. Reps. 2017. Neural attribute machines for program generation. ArXiv e-prints (May 2017). arxiv:cs.AI\/1705.09231"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/3220904.3221145"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the Conference on TRI-Ada \u201991: Today\u2019s Accomplishments; Tomorrow\u2019s Expectations (TRI-Ada\u201991)","author":"Austin S. M.","unstructured":"S. M. Austin , D. R. Wilkins , and B. A. Wichmann . 1991. An Ada program test generator . In Proceedings of the Conference on TRI-Ada \u201991: Today\u2019s Accomplishments; Tomorrow\u2019s Expectations (TRI-Ada\u201991) . 320--325. S. M. Austin, D. R. Wilkins, and B. A. Wichmann. 1991. An Ada program test generator. In Proceedings of the Conference on TRI-Ada \u201991: Today\u2019s Accomplishments; Tomorrow\u2019s Expectations (TRI-Ada\u201991). 320--325."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178372.3179521"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3062341.3062349"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1982.235428"},{"key":"e_1_2_1_10_1","article-title":"Practical validation of bytecode to bytecode JIT compiler dynamic deoptimization","volume":"15","author":"B\u00e9ra Cl\u00e9ment","year":"2016","unstructured":"Cl\u00e9ment B\u00e9ra , Eliot Miranda , Marcus Denker , and St\u00e9phane Ducasse . 2016 . Practical validation of bytecode to bytecode JIT compiler dynamic deoptimization . J. Obj. Technol. 15 , 2 (2016), 1:1--26. Cl\u00e9ment B\u00e9ra, Eliot Miranda, Marcus Denker, and St\u00e9phane Ducasse. 2016. Practical validation of bytecode to bytecode JIT compiler dynamic deoptimization. J. Obj. Technol. 15, 2 (2016), 1:1--26.","journal-title":"J. Obj. Technol."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/948101.948104"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/1717752.1717758"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(97)00017-7"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(98)00075-5"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.4370040204"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/0950-5849(95)01055-6"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the ACM\/IEEE Conference on Supercomputing. 98--105","author":"Callahan D.","unstructured":"D. Callahan , J. Dongarra , and D. Levine . 1988. Vectorizing compilers: A test suite and results . In Proceedings of the ACM\/IEEE Conference on Supercomputing. 98--105 . D. Callahan, J. Dongarra, and D. Levine. 1988. Vectorizing compilers: A test suite and results. In Proceedings of the ACM\/IEEE Conference on Supercomputing. 98--105."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/74105.74106"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2011.04.023"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the ACM SIGPLAN International Workshop on Types in Languages Design and Implementation. 91--102","author":"Evan Chang Bor-Yuh","unstructured":"Bor-Yuh Evan Chang , Adam Chlipala , George C. Necula , and Robert R. Schneck . 2005. Type-based verification of assembly language for compiler debugging . In Proceedings of the ACM SIGPLAN International Workshop on Types in Languages Design and Implementation. 91--102 . Bor-Yuh Evan Chang, Adam Chlipala, George C. Necula, and Robert R. Schneck. 2005. Type-based verification of assembly language for compiler debugging. In Proceedings of the ACM SIGPLAN International Workshop on Types in Languages Design and Implementation. 91--102."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183440.3183456"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.70"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2016.19"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.45"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338957"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884878"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00037"},{"key":"e_1_2_1_28_1","unstructured":"Junjie Chen Guancheng Wang Dan Hao Yingfei Xiong Hongyu Zhang Lu Zhang and Bing Xie. 2018. Coverage prediction for accelerating compiler testing. Trans. Softw. Eng. (2018). to appear.  Junjie Chen Guancheng Wang Dan Hao Yingfei Xiong Hongyu Zhang Lu Zhang and Bing Xie. 2018. Coverage prediction for accelerating compiler testing. Trans. Softw. Eng. (2018). to appear."},{"key":"e_1_2_1_29_1","volume-title":"Metamorphic Testing: A New Approach for Generating Next Test Cases. Technical Report. Technical Report HKUST-CS98-01, Department of Computer Science","author":"Chen Tsong Y.","year":"1998","unstructured":"Tsong Y. Chen , Shing C. Cheung , and Shiu Ming Yiu . 1998 . Metamorphic Testing: A New Approach for Generating Next Test Cases. Technical Report. Technical Report HKUST-CS98-01, Department of Computer Science , Hong Kong University of Science and Technology , Hong Kong . Tsong Y. Chen, Shing C. Cheung, and Shiu Ming Yiu. 1998. Metamorphic Testing: A New Approach for Generating Next Test Cases. Technical Report. Technical Report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology, Hong Kong."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2462173"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908080.2908095"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/166197.166205"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSREW.2018.00005"},{"key":"e_1_2_1_34_1","unstructured":"C. J. Burgess. 1986. Towards the automatic generation of executable programs to test a Pascal compiler. (1986).  C. J. Burgess. 1986. Towards the automatic generation of executable programs to test a Pascal compiler. (1986)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1287624.1287651"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/966221.966235"},{"key":"e_1_2_1_37_1","unstructured":"Chromium developers. 2019. Chromium Testsuite. Retrieved from: https:\/\/www.chromium.org\/chromium-os\/testing\/test-suites.  Chromium developers. 2019. Chromium Testsuite. Retrieved from: https:\/\/www.chromium.org\/chromium-os\/testing\/test-suites."},{"key":"e_1_2_1_38_1","unstructured":"GCC developers. 2019. GCC Testsuites. Retrieved from: https:\/\/gcc.gnu.org\/onlinedocs\/gccint\/Testsuites.html#Testsuites.  GCC developers. 2019. GCC Testsuites. Retrieved from: https:\/\/gcc.gnu.org\/onlinedocs\/gccint\/Testsuites.html#Testsuites."},{"key":"e_1_2_1_39_1","unstructured":"LLVM developers. 2019. LLVM Testing Infrastructure Guide. Retrieved from: https:\/\/llvm.org\/docs\/TestingGuide.html.  LLVM developers. 2019. LLVM Testing Infrastructure Guide. Retrieved from: https:\/\/llvm.org\/docs\/TestingGuide.html."},{"key":"e_1_2_1_40_1","unstructured":"OpenJDK developers. 2019. OpenJDK Testsuite. Retrieved from: http:\/\/openjdk.java.net\/jtreg.  OpenJDK developers. 2019. OpenJDK Testsuite. Retrieved from: http:\/\/openjdk.java.net\/jtreg."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.65"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133917"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 1st International Workshop on Metamorphic Testing. 44--47","author":"Alastair","unstructured":"Alastair F. Donaldson and Andrei Lascu. 2016. Metamorphic testing for (graphics) compilers . In Proceedings of the 1st International Workshop on Metamorphic Testing. 44--47 . Alastair F. Donaldson and Andrei Lascu. 2016. Metamorphic testing for (graphics) compilers. In Proceedings of the 1st International Workshop on Metamorphic Testing. 44--47."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(05)80036-5"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 5th International Conference on Software Engineering. 170--178","author":"Duncan A. G.","unstructured":"A. G. Duncan and J. S. Hutchison . 1981. Using attributed grammars to test designs and implementations . In Proceedings of the 5th International Conference on Software Engineering. 170--178 . A. G. Duncan and J. S. Hutchison. 1981. Using attributed grammars to test designs and implementations. In Proceedings of the 5th International Conference on Software Engineering. 170--178."},{"key":"e_1_2_1_46_1","unstructured":"ECMAScript. 2019. Test262: ECMAScript Test Suite. Retrieved from: https:\/\/github.com\/tc39\/test262.  ECMAScript. 2019. Test262: ECMAScript Test Suite. Retrieved from: https:\/\/github.com\/tc39\/test262."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1450058.1450093"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06200-6_19"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1574"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2013.6698892"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338965.2336763"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.94.0242"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.2197\/ipsjtsldm.9.21"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491442"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 11th IEEE Symposium on Field-programmable Custom Computing Machines. 228--237","author":"Hemmert K. Scott","unstructured":"K. Scott Hemmert , Justin L. Tripp , Brad L. Hutchings , and Preston A. Jackson . 2003. Source level debugger for the sea cucumber synthesizing compiler . In Proceedings of the 11th IEEE Symposium on Field-programmable Custom Computing Machines. 228--237 . K. Scott Hemmert, Justin L. Tripp, Brad L. Hutchings, and Preston A. Jackson. 2003. Source level debugger for the sea cucumber synthesizing compiler. In Proceedings of the 11th IEEE Symposium on Field-programmable Custom Computing Machines. 228--237."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155669"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation (A-TEST\u201916)","author":"Ren\u00e1ta","unstructured":"Ren\u00e1ta Hodov\u00e1n and \u00c1kos Kiss. 2016. Modernizing hierarchical delta debugging . In Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation (A-TEST\u201916) . 31--37. Ren\u00e1ta Hodov\u00e1n and \u00c1kos Kiss. 2016. Modernizing hierarchical delta debugging. In Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation (A-TEST\u201916). 31--37."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/2362793.2362831"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2018.00027"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994291.2994301"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/800238.807151"},{"key":"e_1_2_1_62_1","unstructured":"Plum Hall Inc. 2019. The Plum Hall Validation Suite. Retrieved from: http:\/\/www.plumhall.com\/stec1.html.  Plum Hall Inc. 2019. The Plum Hall Validation Suite. Retrieved from: http:\/\/www.plumhall.com\/stec1.html."},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","unstructured":"Bo Jiang and W. K. Chan. 2015. Input-based adaptive randomized test case prioritization: A local beam search approach. J. Syst. Softw. 105 C (2015) 91--106.  Bo Jiang and W. K. Chan. 2015. Input-based adaptive randomized test case prioritization: A local beam search approach. J. Syst. Softw. 105 C (2015) 91--106.","DOI":"10.1016\/j.jss.2015.03.066"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1571-0661(05)82625-8"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.5555\/1754749.1754781"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278186.3278192"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01692511"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11086-005-0008-6"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-54572-7_13"},{"key":"e_1_2_1_70_1","first-page":"416","article-title":"Montages specifications of realistic programming languages","volume":"3","author":"Kutter Philipp W.","year":"1997","unstructured":"Philipp W. Kutter and Alfonso Pierantonio . 1997 . Montages specifications of realistic programming languages . J. Univ. Comput. Sci. 3 , 5 (1997), 416 -- 442 . Philipp W. Kutter and Alfonso Pierantonio. 1997. Montages specifications of realistic programming languages. J. Univ. Comput. Sci. 3, 5 (1997), 416--442.","journal-title":"J. Univ. Comput. Sci."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/645369.651271"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594291.2594334"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2814270.2814319"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771785"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236037"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1538788.1538814"},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the 36th Conference on Programming Language Design and Implementation. 65--76","author":"Lidbury Christopher","unstructured":"Christopher Lidbury , Andrei Lascu , Nathan Chong , and Alastair F. Donaldson . 2015. Many-core compiler fuzzing . In Proceedings of the 36th Conference on Programming Language Design and Implementation. 65--76 . Christopher Lidbury, Andrei Lascu, Nathan Chong, and Alastair F. Donaldson. 2015. Many-core compiler fuzzing. In Proceedings of the 36th Conference on Programming Language Design and Implementation. 65--76."},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the ACM International Symposium on Automated Analysis-Driven Debugging. 3--12","author":"Lindig Christian","year":"2005","unstructured":"Christian Lindig . 2005 . Find a compiler bug in 5 minutes . In Proceedings of the ACM International Symposium on Automated Analysis-Driven Debugging. 3--12 . Christian Lindig. 2005. Find a compiler bug in 5 minutes. In Proceedings of the ACM International Symposium on Automated Analysis-Driven Debugging. 3--12."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1085130.1085132"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/4372.4375"},{"key":"e_1_2_1_81_1","first-page":"100","article-title":"Differential testing for software","volume":"10","author":"McKeeman William M","year":"1998","unstructured":"William M McKeeman . 1998 . Differential testing for software . Dig. Tech. J. 10 , 1 (1998), 100 -- 107 . William M McKeeman. 1998. Differential testing for software. Dig. Tech. J. 10, 1 (1998), 100--107.","journal-title":"Dig. Tech. J."},{"key":"e_1_2_1_82_1","volume-title":"Euratom Seminar\\Machine en Talen","author":"Meertens L. G. L. T.","unstructured":"L. G. L. T. Meertens and C. H. A. Koster . 1962. Basic English, a generative grammar for a part of English . In Euratom Seminar\\Machine en Talen , Amsterdam . L. G. L. T. Meertens and C. H. A. Koster. 1962. Basic English, a generative grammar for a part of English. In Euratom Seminar\\Machine en Talen, Amsterdam."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3110259"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134307"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2491967"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGO.2009.26"},{"key":"e_1_2_1_87_1","volume-title":"Proceedings of the Workshop on Synthesis And System Integration of Mixed Information Technologies. 48--53","author":"Nagai Eriko","year":"2012","unstructured":"Eriko Nagai , Hironobu Awazu , Nagisa Ishiura , and Naoya Takeda . 2012 . Random testing of C compilers targeting arithmetic optimization . In Proceedings of the Workshop on Synthesis And System Integration of Mixed Information Technologies. 48--53 . Eriko Nagai, Hironobu Awazu, Nagisa Ishiura, and Naoya Takeda. 2012. Random testing of C compilers targeting arithmetic optimization. In Proceedings of the Workshop on Synthesis And System Integration of Mixed Information Technologies. 48--53."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.2197\/ipsjtsldm.7.91"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/APCCAS.2016.7804063"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998392.2998397"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/1167515.1167493"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/1982595.1982615"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909437.2909439"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791321.2791333"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01932308"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/2254064.2254104"},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the International Conference on Software Maintenance. 179--188","author":"Rothermel G.","unstructured":"G. Rothermel , R. H. Untch , C. Chu , and M. J. Harrold . 1999. Test case prioritization: An empirical study . In Proceedings of the International Conference on Software Maintenance. 179--188 . G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold. 1999. Test case prioritization: An empirical study. In Proceedings of the International Conference on Software Maintenance. 179--188."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/800191.805648"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1977.231159"},{"key":"e_1_2_1_101_1","volume-title":"ACM SIGART Bull.","author":"Samet Hanan","unstructured":"Hanan Samet . 1977. A normal form for compiler testing . In ACM SIGART Bull. Vol. 12 . 155--162. Hanan Samet. 1977. A normal form for compiler testing. In ACM SIGART Bull. Vol. 12. 155--162."},{"key":"e_1_2_1_102_1","volume-title":"Proceedings of the 5th International Joint Conference on Artificial Intelligence\u2014Volume 1. Morgan Kaufmann Publishers Inc., 379--379","author":"Samet Hanan","year":"1977","unstructured":"Hanan Samet . 1977 . Toward automatic debugging of compilers . In Proceedings of the 5th International Joint Conference on Artificial Intelligence\u2014Volume 1. Morgan Kaufmann Publishers Inc., 379--379 . Hanan Samet. 1977. Toward automatic debugging of compilers. In Proceedings of the 5th International Joint Conference on Artificial Intelligence\u2014Volume 1. Morgan Kaufmann Publishers Inc., 379--379."},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/71052.71055"},{"key":"e_1_2_1_104_1","volume-title":"Software Engineering Research and Practice","author":"Sassa Masataka","unstructured":"Masataka Sassa and Daijiro Sudosa . 2006. Experience in testing compiler optimizers using comparison checking . In Software Engineering Research and Practice . CSREA Press , 837--843. Masataka Sassa and Daijiro Sudosa. 2006. Experience in testing compiler optimizers using comparison checking. In Software Engineering Research and Practice. CSREA Press, 837--843."},{"key":"e_1_2_1_105_1","volume-title":"Int. J. PoC||GTFO 0x08","author":"Scotty Bauer","year":"2015","unstructured":"Bauer Scotty , Pascal Cuoq , and John Regehr . 2015. Deniable backdoors using compiler bugs . Int. J. PoC||GTFO 0x08 ( 2015 ), 7--9. Bauer Scotty, Pascal Cuoq, and John Regehr. 2015. Deniable backdoors using compiler bugs. Int. J. PoC||GTFO 0x08 (2015), 7--9."},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the USENIX Annual Technical Conference, General Track. 17--30","author":"Seward Julian","year":"2005","unstructured":"Julian Seward and Nicholas Nethercote . 2005 . Using Valgrind to detect undefined value errors with bit-precision . In Proceedings of the USENIX Annual Technical Conference, General Track. 17--30 . Julian Seward and Nicholas Nethercote. 2005. Using Valgrind to detect undefined value errors with bit-precision. In Proceedings of the USENIX Annual Technical Conference, General Track. 17--30."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.5555\/1298568.1298570"},{"key":"e_1_2_1_108_1","volume-title":"Proceedings of the 2nd Conference on Domain-specific Languages. 1--13","author":"Sirer Emin G\u00fcn","unstructured":"Emin G\u00fcn Sirer and Brian N. Bershad . 1999. Using production grammars in software testing . In Proceedings of the 2nd Conference on Domain-specific Languages. 1--13 . Emin G\u00fcn Sirer and Brian N. Bershad. 1999. Using production grammars in software testing. In Proceedings of the 2nd Conference on Domain-specific Languages. 1--13."},{"key":"e_1_2_1_109_1","volume-title":"Proceedings of the 13th International Symposium on Code Generation and Optimization. 46--55","author":"Stepanov Evgeniy","year":"2015","unstructured":"Evgeniy Stepanov and Konstantin Serebryany . 2015 . MemorySanitizer: Fast detector of uninitialized memory use in C++ . In Proceedings of the 13th International Symposium on Code Generation and Optimization. 46--55 . Evgeniy Stepanov and Konstantin Serebryany. 2015. MemorySanitizer: Fast detector of uninitialized memory use in C++. In Proceedings of the 13th International Symposium on Code Generation and Optimization. 46--55."},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884879"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984038"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931074"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180236"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC.2010.39"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-012-9219-7"},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330567"},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0055004"},{"key":"e_1_2_1_118_1","unstructured":"A. van Wijngaarden. 1965. Orthogonal Design and Description of a Formal Language. Stichting Mathematisch Centrum.  A. van Wijngaarden. 1965. Orthogonal Design and Description of a Formal Language. Stichting Mathematisch Centrum."},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1145\/186025.186103"},{"key":"e_1_2_1_120_1","first-page":"379","article-title":"A conformance test suite for Arden syntax compilers and interpreters","volume":"228","author":"Wolf Klaus-Hendrik","year":"2016","unstructured":"Klaus-Hendrik Wolf and Mike Klimek . 2016 . A conformance test suite for Arden syntax compilers and interpreters . Stud. Health Technol. Inf. 228 (2016), 379 -- 383 . Klaus-Hendrik Wolf and Mike Klimek. 2016. A conformance test suite for Arden syntax compilers and interpreters. Stud. Health Technol. Inf. 228 (2016), 379--383.","journal-title":"Stud. Health Technol. Inf."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2521368"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73230-3_8"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993498.1993532"},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1002\/stv.430"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2003.1319081"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73066-8_25"},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022904917707"},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.5555\/318773.318946"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988498"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606565"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1145\/3062341.3062379"},{"key":"e_1_2_1_132_1","volume-title":"Proceedings of the ICSE Workshop on Automation of Software Test. 36--43","author":"Zhao Chen","year":"2009","unstructured":"Chen Zhao , Yunzhi Xue , Qiuming Tao , Liang Guo , and Zhaohui Wang . 2009 . Automated test program generation for an industrial optimizing compiler . In Proceedings of the ICSE Workshop on Automation of Software Test. 36--43 . Chen Zhao, Yunzhi Xue, Qiuming Tao, Liang Guo, and Zhaohui Wang. 2009. Automated test program generation for an industrial optimizing compiler. In Proceedings of the ICSE Workshop on Automation of Software Test. 36--43."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3363562","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3363562","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:25Z","timestamp":1750203865000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3363562"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,6]]},"references-count":131,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1,31]]}},"alternative-id":["10.1145\/3363562"],"URL":"https:\/\/doi.org\/10.1145\/3363562","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,6]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}