{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T07:36:31Z","timestamp":1763105791571,"version":"3.40.3"},"publisher-location":"Cham","reference-count":62,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030714994"},{"type":"electronic","value":"9783030715007"}],"license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,20]],"date-time":"2021-03-20T00:00:00Z","timestamp":1616198400000},"content-version":"vor","delay-in-days":78,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Compilers are error-prone due to their high complexity. They are relevant for not only general purpose programming languages, but also for many domain specific languages. Bugs in compilers can potentially render all programs at risk. It is thus crucial that compilers are systematically tested, if not verified. Recently, a number of efforts have been made to formalise and standardise programming language semantics, which can be applied to verify the correctness of the respective compilers. In this work, we present a novel specification-based testing method named SpecTest to better utilise these semantics for testing. By applying an executable semantics as test oracle, SpecTest can discover deep semantic errors in compilers. Compared to existing approaches, SpecTest is built upon a novel test coverage criterion called semantic coverage which brings together mutation testing and fuzzing to specifically target less tested language features. We apply SpecTest to systematically test two compilers, i.e., the Java compiler and the Solidity compiler. SpecTest improves the semantic coverage of both compilers considerably and reveals multiple previously unknown bugs.<\/jats:p>","DOI":"10.1007\/978-3-030-71500-7_14","type":"book-chapter","created":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T13:12:14Z","timestamp":1616159534000},"page":"269-291","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["SpecTest: Specification-Based Compiler Testing"],"prefix":"10.1007","author":[{"given":"Richard","family":"Schumi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,3,20]]},"reference":[{"key":"14_CR1","unstructured":"Casting a floating-point number to an integer, https:\/\/github.com\/kframework\/java-semantics\/issues\/64"},{"key":"14_CR2","unstructured":"Casting double to int and long to int produce different results, https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=JDK-8246334"},{"key":"14_CR3","unstructured":"Division by zero exception, https:\/\/github.com\/kframework\/java-semantics\/issues\/63"},{"key":"14_CR4","unstructured":"Incorrect output from bitwise and unary operation function call, https:\/\/github.com\/Conflux-Chain\/conflux-rust\/issues\/988"},{"key":"14_CR5","unstructured":"Minus sign issues for hex octal and binary literals, https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=8236406"},{"key":"14_CR6","unstructured":"Missing error message incompatible types: possible lossy conversion, https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=JDK-8244681"},{"key":"14_CR7","unstructured":"More specific error message for division by zero, https:\/\/github.com\/ethereum\/solidity\/issues\/8064"},{"key":"14_CR8","unstructured":"New string leads to timeout, https:\/\/github.com\/kframework\/java-semantics\/issues\/62"},{"key":"14_CR9","unstructured":"Octal values in double\/float arrays, https:\/\/github.com\/kframework\/java-semantics\/issues\/61"},{"key":"14_CR10","unstructured":"Out of bounds array access, https:\/\/github.com\/ethereum\/solidity\/issues\/8364"},{"key":"14_CR11","unstructured":"Parsing issue for hexadecimal, https:\/\/github.com\/kframework\/java-semantics\/issues\/60"},{"key":"14_CR12","unstructured":"Type error for short computations, https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=JDK-8240371"},{"key":"14_CR13","unstructured":"Typeerror too restrictive or inconsistent?, https:\/\/github.com\/ethereum\/solidity\/issues\/8139"},{"key":"14_CR14","unstructured":"Wrong modulo computation for negative doubles, https:\/\/github.com\/kframework\/java-semantics\/issues\/58"},{"key":"14_CR15","unstructured":"Wrong precision for float variables, https:\/\/github.com\/kframework\/java-semantics\/issues\/59"},{"key":"14_CR16","unstructured":"Wrong representation of floating point numbers, https:\/\/github.com\/kframework\/java-semantics\/issues\/66"},{"key":"14_CR17","unstructured":"Conflux: High-efficiency public blockchain (2019), https:\/\/www.conflux-chain.org"},{"key":"14_CR18","unstructured":"Remix: Ethereum ide and tools for the web (2019), https:\/\/remix.ethereum.org"},{"key":"14_CR19","unstructured":"Specify and enforce evaluation order on sub-expressions (2019), https:\/\/github.com\/ethereum\/solidity\/issues\/7820"},{"key":"14_CR20","unstructured":"Discover, track and compare open source (2020), https:\/\/www.openhub.net"},{"key":"14_CR21","unstructured":"Truffle suite: Sweet tools for smart contracts (2020), http:\/\/truffleframework.com"},{"key":"14_CR22","doi-asserted-by":"crossref","unstructured":"Barr, E.T., Harman, M., McMinn, P., Shahbaz, M., Yoo, S.: The oracle problem in software testing: A survey. IEEE Trans. Software Eng. 41(5), 507\u2013525 (2015)","DOI":"10.1109\/TSE.2014.2372785"},{"key":"14_CR23","unstructured":"Bauer, J.A., Finger, A.B.: Test plan generation using formal grammars. In: Proceedings of the 4th International Conference on Software Engineering, Munich, Germany, September 1979. pp. 425\u2013432. IEEE Computer Society (1979), http:\/\/dl.acm.org\/citation.cfm?id=802969"},{"key":"14_CR24","doi-asserted-by":"publisher","unstructured":"Bogdanas, D., Rosu, G.: K-Java: A complete semantics of java. In: Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL 2015, Mumbai, India, January 15\u201317, 2015. pp. 445\u2013456. ACM (2015). https:\/\/doi.org\/10.1145\/2676726.2676982","DOI":"10.1145\/2676726.2676982"},{"key":"14_CR25","doi-asserted-by":"publisher","unstructured":"Boujarwah, A.S., Saleh, K.: Compiler test case generation methods: a survey and assessment. Information & Software Technology 39(9), 617\u2013625 (1997). https:\/\/doi.org\/10.1016\/S0950-5849(97)00017-7","DOI":"10.1016\/S0950-5849(97)00017-7"},{"key":"14_CR26","doi-asserted-by":"publisher","unstructured":"Chen, J., Hu, W., Hao, D., Xiong, Y., Zhang, H., Zhang, L., Xie, B.: An empirical comparison of compiler testing techniques. In: Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, Austin, TX, USA, May 14\u201322, 2016. pp. 180\u2013190. ACM (2016). https:\/\/doi.org\/10.1145\/2884781.2884878","DOI":"10.1145\/2884781.2884878"},{"key":"14_CR27","doi-asserted-by":"publisher","unstructured":"Chen, Y., Su, T., Su, Z.: Deep differential testing of JVM implementations. In: Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25\u201331, 2019. pp. 1257\u20131268. IEEE \/ ACM (2019). https:\/\/doi.org\/10.1109\/ICSE.2019.00127","DOI":"10.1109\/ICSE.2019.00127"},{"key":"14_CR28","doi-asserted-by":"publisher","unstructured":"Cummins, C., Petoumenos, P., Murray, A., Leather, H.: Compiler fuzzing through deep learning. In: Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018, Amsterdam, The Netherlands, July 16\u201321, 2018. pp. 95\u2013105. ACM (2018). https:\/\/doi.org\/10.1145\/3213846.3213848","DOI":"10.1145\/3213846.3213848"},{"key":"14_CR29","doi-asserted-by":"publisher","unstructured":"Ellison, C., Rosu, G.: An executable formal semantics of C with applications. In: Field, J., Hicks, M. (eds.) Proceedings of the 39th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL 2012, Philadelphia, Pennsylvania, USA, January 22\u201328, 2012. pp. 533\u2013544. ACM (2012). https:\/\/doi.org\/10.1145\/2103656.2103719, https:\/\/doi.org\/10.1145\/2103656.2103719","DOI":"10.1145\/2103656.2103719"},{"key":"14_CR30","unstructured":"Fowler, T.: How many computer languages are there? (2020), https:\/\/careerkarma.com\/blog\/how-many-coding-languages-are-there"},{"key":"14_CR31","doi-asserted-by":"publisher","unstructured":"Hanford, K.V.: Automatic generation of test cases. IBM Systems Journal 9(4), 242\u2013257 (1970). https:\/\/doi.org\/10.1147\/sj.94.0242","DOI":"10.1147\/sj.94.0242"},{"key":"14_CR32","doi-asserted-by":"publisher","unstructured":"Jackson, D., Damon, C.: Elements of style: Analyzing a software design feature with a counterexample detector. In: Proceedings of the 1996 International Symposium on Software Testing and Analysis, ISSTA 1996, San Diego, CA, USA, January 8\u201310, 1996. pp. 239\u2013249. ACM (1996). https:\/\/doi.org\/10.1145\/229000.226322","DOI":"10.1145\/229000.226322"},{"key":"14_CR33","doi-asserted-by":"publisher","unstructured":"Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Software Eng. 37(5), 649\u2013678 (2011). https:\/\/doi.org\/10.1109\/TSE.2010.62","DOI":"10.1109\/TSE.2010.62"},{"key":"14_CR34","unstructured":"Jiao, J., Kan, S., Lin, S., Sanan, D., Liu, Y., Sun, J.: Semantic understanding of smart contracts: Executable operational semantics of solidity. In: 2020 IEEE Symposium on Security and Privacy, SP 2020, San Francisco, CA, USA, May 18\u201320, 2020. IEEE (2020), accepted for publication"},{"key":"14_CR35","unstructured":"Kalinov, A., Kossatchev, A., Posypkin, M., Shishkov, V.: Using ASM specification for automatic test suite generation for mpC parallel programming language compiler. Action Semantics AS 2002 p. 99 (2002)"},{"key":"14_CR36","doi-asserted-by":"publisher","unstructured":"Kalinov, A., Kossatchev, A.S., Petrenko, A.K., Posypkin, M., Shishkov, V.: Coverage-driven automated compiler test suite generation. Electr. Notes Theor. Comput. Sci. 82(3), 500\u2013514 (2003). https:\/\/doi.org\/10.1016\/S1571-0661(05)82625-8","DOI":"10.1016\/S1571-0661(05)82625-8"},{"key":"14_CR37","doi-asserted-by":"publisher","unstructured":"Klein, C., Clements, J., Dimoulas, C., Eastlund, C., Felleisen, M., Flatt, M., McCarthy, J.A., Rafkind, J., Tobin-Hochstadt, S., Findler, R.B.: Run your research: on the effectiveness of lightweight mechanization. In: Proceedings of the 39th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL 2012, Philadelphia, Pennsylvania, USA, January 22\u201328, 2012. pp. 285\u2013296. ACM (2012). https:\/\/doi.org\/10.1145\/2103656.2103691","DOI":"10.1145\/2103656.2103691"},{"key":"14_CR38","doi-asserted-by":"publisher","unstructured":"K\u00f6roglu, Y., Wotawa, F.: Fully automated compiler testing of a reasoning engine via mutated grammar fuzzing. In: Proceedings of the 14th International Workshop on Automation of Software Test, AST@ICSE 2019, May 27, 2019, Montreal, QC, Canada. pp. 28\u201334. IEEE \/ ACM (2019). https:\/\/doi.org\/10.1109\/AST.2019.00010","DOI":"10.1109\/AST.2019.00010"},{"key":"14_CR39","doi-asserted-by":"publisher","unstructured":"Kossatchev, A.S., Posypkin, M.: Survey of compiler testing methods. Programming and Computer Software 31(1), 10\u201319 (2005). https:\/\/doi.org\/10.1007\/s11086-005-0008-6","DOI":"10.1007\/s11086-005-0008-6"},{"key":"14_CR40","doi-asserted-by":"publisher","unstructured":"Le, V., Afshari, M., Su, Z.: Compiler validation via equivalence modulo inputs. In: ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI \u201914, Edinburgh, United Kingdom - June 09\u201311, 2014. pp. 216\u2013226. ACM (2014). https:\/\/doi.org\/10.1145\/2594291.2594334","DOI":"10.1145\/2594291.2594334"},{"key":"14_CR41","doi-asserted-by":"publisher","unstructured":"Le, V., Sun, C., Su, Z.: Finding deep compiler bugs via guided stochastic program mutation. In: Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA 2015, part of SPLASH 2015, Pittsburgh, PA, USA, October 25\u201330, 2015. pp. 386\u2013399. ACM (2015). https:\/\/doi.org\/10.1145\/2814270.2814319","DOI":"10.1145\/2814270.2814319"},{"key":"14_CR42","doi-asserted-by":"publisher","unstructured":"Le, V., Sun, C., Su, Z.: Randomized stress-testing of link-time optimizers. In: Proceedings of the 2015 International Symposium on Software Testing and Analysis, ISSTA 2015, Baltimore, MD, USA, July 12\u201317, 2015. pp. 327\u2013337. ACM (2015). https:\/\/doi.org\/10.1145\/2771783.2771785","DOI":"10.1145\/2771783.2771785"},{"key":"14_CR43","doi-asserted-by":"publisher","unstructured":"Leroy, X.: Formal verification of a realistic compiler. Commun. ACM 52(7), 107\u2013115 (2009). https:\/\/doi.org\/10.1145\/1538788.1538814","DOI":"10.1145\/1538788.1538814"},{"key":"14_CR44","unstructured":"Lin, S.W.: KSolidity semantics (2018), https:\/\/github.com\/kframework\/solidity-semantics"},{"key":"14_CR45","unstructured":"McKeeman, W.M.: Differential testing for software. Digital Technical Journal 10(1), 100\u2013107 (1998), http:\/\/www.hpl.hp.com\/hpjournal\/dtj\/vol10num1\/vol10num1art9.pdf"},{"key":"14_CR46","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., Pham, L.H., Sun, J., Lin, Y., Tran, M.Q.: sFuzz: An efficient adaptive fuzzer for solidity smart contracts. In: Proceedings of the 42nd International Conference on Software Engineering, ICSE 2020. IEEE \/ ACM (2020)","DOI":"10.1145\/3377811.3380334"},{"key":"14_CR47","doi-asserted-by":"publisher","unstructured":"Park, D., Stefanescu, A., Rosu, G.: KJS: a complete formal semantics of javascript. In: Grove, D., Blackburn, S. (eds.) Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation, Portland, OR, USA, June 15\u201317, 2015. pp. 346\u2013356. ACM (2015). https:\/\/doi.org\/10.1145\/2737924.2737991, https:\/\/doi.org\/10.1145\/2737924.2737991","DOI":"10.1145\/2737924.2737991"},{"key":"14_CR48","doi-asserted-by":"publisher","unstructured":"Prechtel, D., Gro\u00df, T., M\u00fcller, T.: Evaluating spread of \u2018gasless send\u2019 in ethereum smart contracts. In: 10th IFIP International Conference on New Technologies, Mobility and Security, NTMS 2019, Canary Islands, Spain, June 24\u201326, 2019. pp. 1\u20136. IEEE (2019). https:\/\/doi.org\/10.1109\/NTMS.2019.8763848","DOI":"10.1109\/NTMS.2019.8763848"},{"key":"14_CR49","doi-asserted-by":"crossref","unstructured":"Purdom, P.: A sentence generator for testing parsers. BIT Numerical Mathematics 12(3), 366\u2013375 (1972)","DOI":"10.1007\/BF01932308"},{"key":"14_CR50","doi-asserted-by":"publisher","unstructured":"Rosu, G., Serbanuta, T.: An overview of the K semantic framework. J. Log. Algebr. Program. 79(6), 397\u2013434 (2010). https:\/\/doi.org\/10.1016\/j.jlap.2010.03.012","DOI":"10.1016\/j.jlap.2010.03.012"},{"key":"14_CR51","doi-asserted-by":"publisher","unstructured":"Sewell, P., Nardelli, F.Z., Owens, S., Peskine, G., Ridge, T., Sarkar, S., Strnisa, R.: Ott: Effective tool support for the working semanticist. J. Funct. Program. 20(1), 71\u2013122 (2010). https:\/\/doi.org\/10.1017\/S0956796809990293","DOI":"10.1017\/S0956796809990293"},{"key":"14_CR52","doi-asserted-by":"publisher","unstructured":"Sheridan, F.: Practical testing of a C99 compiler using output comparison. Softw., Pract. Exper. 37(14), 1475\u20131488 (2007). https:\/\/doi.org\/10.1002\/spe.812","DOI":"10.1002\/spe.812"},{"key":"14_CR53","unstructured":"Su, Z., Sun, C.: Emi-based compiler testing (2018), https:\/\/web.cs.ucdavis.edu\/~su\/emi-project"},{"key":"14_CR54","doi-asserted-by":"publisher","unstructured":"Sun, C., Le, V., Su, Z.: Finding and analyzing compiler warning defects. In: Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, Austin, TX, USA, May 14\u201322, 2016. pp. 203\u2013213. ACM (2016). https:\/\/doi.org\/10.1145\/2884781.2884879","DOI":"10.1145\/2884781.2884879"},{"key":"14_CR55","doi-asserted-by":"publisher","unstructured":"Sun, C., Le, V., Su, Z.: Finding compiler bugs via live code mutation. In: Proceedings of the 2016 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA 2016, part of SPLASH 2016, Amsterdam, The Netherlands, October 30 - November 4, 2016. pp. 849\u2013863. ACM (2016). https:\/\/doi.org\/10.1145\/2983990.2984038","DOI":"10.1145\/2983990.2984038"},{"key":"14_CR56","unstructured":"Tang, Y., Ren, Z., Kong, W., Jiang, H.: Compiler testing: A systematic literature analysis. CoRR abs\/1810.02718 (2018), http:\/\/arxiv.org\/abs\/1810.02718"},{"key":"14_CR57","doi-asserted-by":"publisher","unstructured":"Tao, Q., Wu, W., Zhao, C., Shen, W.: An automatic testing approach for compiler based on metamorphic testing technique. In: 17th Asia Pacific Software Engineering Conference, APSEC 2010, Sydney, Australia, November 30 - December 3, 2010. pp. 270\u2013279. IEEE Computer Society (2010). https:\/\/doi.org\/10.1109\/APSEC.2010.39","DOI":"10.1109\/APSEC.2010.39"},{"key":"14_CR58","unstructured":"Tip, F.: A survey of program slicing techniques. J. Prog. Lang. 3(3) (1995), http:\/\/compscinet.dcs.kcl.ac.uk\/JP\/jp030301.abs.html"},{"key":"14_CR59","doi-asserted-by":"publisher","unstructured":"Wang, C., Kang, S.: ADFL: an improved algorithm for american fuzzy lop in fuzz testing. In: Cloud Computing and Security - 4th International Conference, ICCCS 2018, Haikou, China, June 8\u201310, 2018, Revised Selected Papers, Part V. Lecture Notes in Computer Science, vol. 11067, pp. 27\u201336. Springer (2018). https:\/\/doi.org\/10.1007\/978-3-030-00018-9_3","DOI":"10.1007\/978-3-030-00018-9_3"},{"key":"14_CR60","doi-asserted-by":"publisher","unstructured":"Yang, X., Chen, Y., Eide, E., Regehr, J.: Finding and understanding bugs in C compilers. In: Proceedings of the 32nd ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI 2011, San Jose, CA, USA, June 4\u20138, 2011. pp. 283\u2013294. ACM (2011). https:\/\/doi.org\/10.1145\/1993498.1993532","DOI":"10.1145\/1993498.1993532"},{"key":"14_CR61","doi-asserted-by":"publisher","unstructured":"Zelenov, S.V., Zelenova, S.A.: Automated generation of positive and negative tests for parsers. In: Formal Approaches to Software Testing, 5th International Workshop, FATES 2005, Edinburgh, UK, July 11, 2005, Revised Selected Papers. Lecture Notes in Computer Science, vol. 3997, pp. 187\u2013202. Springer (2005). https:\/\/doi.org\/10.1007\/11759744_13","DOI":"10.1007\/11759744_13"},{"key":"14_CR62","doi-asserted-by":"publisher","unstructured":"Zeller, A., Hildebrandt, R.: Simplifying and isolating failure-inducing input. IEEE Trans. Software Eng. 28(2), 183\u2013200 (2002). https:\/\/doi.org\/10.1109\/32.988498","DOI":"10.1109\/32.988498"}],"container-title":["Lecture Notes in Computer Science","Fundamental Approaches to Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-71500-7_14","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,20]],"date-time":"2021-03-20T00:18:17Z","timestamp":1616199497000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-3-030-71500-7_14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"ISBN":["9783030714994","9783030715007"],"references-count":62,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-71500-7_14","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2021]]},"assertion":[{"value":"20 March 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"FASE","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Fundamental Approaches to Software Engineering","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Luxembourg City","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Luxembourg","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2021","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27 March 2021","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1 April 2021","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"24","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"fase2021","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/etaps.org\/2021\/fase","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"52","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"16","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"31% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"5,5","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"The conference changed to an online format due to the COVID-19 pandemic.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}