{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T19:57:27Z","timestamp":1771703847306,"version":"3.50.1"},"publisher-location":"Cham","reference-count":41,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031572586","type":"print"},{"value":"9783031572593","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,6]],"date-time":"2024-04-06T00:00:00Z","timestamp":1712361600000},"content-version":"vor","delay-in-days":96,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Over the last years, deductive program verifiers have substantially improved, and their applicability on non-trivial applications has been demonstrated. However, a major bottleneck is that for every new programming language, a new deductive verifier has to be built.<\/jats:p><jats:p>This paper describes the first steps in a project that aims to address this problem, by language-agnostic support for deductive verification: Rather than building a deductive program verifier for every programming language, we develop deductive program verification technology for a widely-used intermediate representation language (LLVM IR), such that we eventually get verification support for any language that can be compiled into the LLVM IR format.<\/jats:p><jats:p>Concretely, this paper describes the design of VCLLVM, a prototype tool that adds LLVM IR as a supported language to the VerCors verifier. We discuss the challenges that have to be addressed to develop verification support for such a low-level language. Moreover, we also sketch how we envisage to build verification support for any specified source program that can be compiled into LLVM IR on top of VCLLVM.<\/jats:p>","DOI":"10.1007\/978-3-031-57259-3_15","type":"book-chapter","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T13:01:39Z","timestamp":1712322099000},"page":"290-303","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["First Steps towards Deductive Verification of LLVM IR"],"prefix":"10.1007","author":[{"given":"Dr\u00e9","family":"van Oorschot","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4467-072X","authenticated-orcid":false,"given":"Marieke","family":"Huisman","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3457-5446","authenticated-orcid":false,"given":"\u00d6mer","family":"\u015eakar","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,4,6]]},"reference":[{"key":"15_CR1","doi-asserted-by":"crossref","unstructured":"W. Ahrendt, B. Beckert, R. Bubel, R. H\u00e4hnle, P. H. Schmitt, and M. Ulbrich. Deductive Software Verification - The KeY Book. Vol. 10001. Lecture Notes in Computer Science. Springer International Publishing, 2016. isbn: 9783319498126. doi:\u00a010.1007\/978-3-319-49812-6.","DOI":"10.1007\/978-3-319-49812-6"},{"key":"15_CR2","doi-asserted-by":"crossref","unstructured":"F. van der Berg. \u201cLLMC: Verifying High-Performance Software\u201d In: Computer Aided Verification: 33rd International Conference, CAV 2021, Virtual Event, July 20\u201323, 2021, Proceedings, Part II 33. Springer. 2021, pp. 690\u2013703.","DOI":"10.1007\/978-3-030-81688-9_32"},{"key":"15_CR3","doi-asserted-by":"crossref","unstructured":"A. Blanchard, F. Loulergue, and N. Kosmatov. \u201cTowards Full Proof Automation in Frama-C Using Auto-active Verification\u201d. In: NASA Formal Methods - 11th International Symposium, NFM 2019, Houston, TX, USA, May 7-9, 2019, Proceedings. Ed. by J. M. Badger and K. Y. Rozier. Vol. 11460. Lecture Notes in Computer Science. Springer, 2019, pp. 88\u2013105. doi: 10.1007\/978-3-030-20652-9_6. url: https:\/\/doi.org\/10.1007\/978-3-030-20652-9_6.","DOI":"10.1007\/978-3-030-20652-9_6"},{"key":"15_CR4","doi-asserted-by":"crossref","unstructured":"S. Blom, S. Darabi, M. Huisman, and W. Oortwijn. \u201cThe VerCors Tool Set: Verification of Parallel and Concurrent Software\u201d. In: integrated Formal Methods 2017. Ed. by N. Polikarpova and S. Schneider. LNCS 10510. Springer, 2017, pp. 102\u2013110. doi: 10.1007\/978-3-319-66845-1_7.","DOI":"10.1007\/978-3-319-66845-1_7"},{"key":"15_CR5","doi-asserted-by":"crossref","unstructured":"J. Boyland. \u201cChecking Interference with Fractional Permissions\u201d. In: SAS. Vol. 2694. LNCS. Springer, 2003, pp. 55\u201372.","DOI":"10.1007\/3-540-44898-5_4"},{"key":"15_CR6","unstructured":"C. Cadar, D. Dunbar, and D. R. Engler. \u201cKLEE: Unassisted and Automatic Generation of High-Coverage Tests for Complex Systems Programs\u201d. In: 8th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2008, December 8-10, 2008, San Diego, California, USA, Proceedings. Ed. by R. Draves and R. van Renesse. USENIX Association, 2008, pp. 209\u2013224. url: http:\/\/www.usenix.org\/events\/osdi08\/tech\/full_papers\/cadar\/cadar.pdf."},{"key":"15_CR7","doi-asserted-by":"crossref","unstructured":"D. R. Cok. \u201cOpenJML: JML for Java 7 by Extending OpenJDK\u201d. In: NASA Formal Methods. Ed. by M. Bobaru, K. Havelund, G. J. Holzmann, and R. Joshi. Berlin, Heidelberg: Springer Berlin Heidelberg, 2011, pp. 472\u2013479. isbn: 978-3-642-20398-5.","DOI":"10.1007\/978-3-642-20398-5_35"},{"key":"15_CR8","doi-asserted-by":"crossref","unstructured":"R. Dockins, A. Foltzer, J. Hendrix, B. Huffman, D. McNamee, and A. Tomb. \u201cConstructing semantic models of programs with the software analysis workbench\u201d. In: Verified Software. Theories, Tools, and Experiments: 8th International Conference, VSTTE 2016, Toronto, ON, Canada, July 17\u201318, 2016, Revised Selected Papers 8. Springer. 2016, pp. 56\u201372.","DOI":"10.1007\/978-3-319-48869-1_5"},{"key":"15_CR9","doi-asserted-by":"crossref","unstructured":"G. Ernst, J. Pf\u00e4hler, G. Schellhorn, D. Haneberg, and W. Reif. \u201cKIV: overview and VerifyThis competition\u201d. In: STTT 17.6 (2015), pp. 677\u2013694. issn: 1433\u20132787. doi: 10.1007\/s10009-014-0308-3. url: https:\/\/doi.org\/10.1007\/s10009-014-0308-3.","DOI":"10.1007\/s10009-014-0308-3"},{"key":"15_CR10","doi-asserted-by":"crossref","unstructured":"S. d. Gouw, F. S. de Boer, R. Bubel, R. H\u00e4hnle, J. Rot, and D. Steinh\u00f6fel. \u201cVerifying OpenJDK\u2019s Sort Method for Generic Collections\u201d. In: J. Autom. Reason. 62.1 (2019), pp. 93\u2013126. doi: 10.1007\/s10817-017-9426-4. url: https:\/\/doi.org\/10.1007\/s10817-017-9426-4","DOI":"10.1007\/s10817-017-9426-4"},{"key":"15_CR11","doi-asserted-by":"crossref","unstructured":"R. H\u00e4hnle and M. Huisman. \u201cDeductive Software Verification: From Penand-Paper Proofs to Industrial Tools\u201d. In: Computing and Software Science-State of the Art and Perspectives. Ed. by B. Steffen and G. J. Woeginger. Vol. 10000. Lecture Notes in Computer Science. Springer, 2019, pp. 345\u2013373.","DOI":"10.1007\/978-3-319-91908-9_18"},{"key":"15_CR12","doi-asserted-by":"crossref","unstructured":"M. S. Hecht and J. D. Ullman. \u201cFlow graph reducibility\u201d. In: Proceedings of the fourth annual ACM symposium on Theory of computing. 1972, pp. 238\u2013250.","DOI":"10.1145\/800152.804919"},{"key":"15_CR13","doi-asserted-by":"crossref","unstructured":"H. A. Hiep, O. Maathuis, J. Bian, F. S. de Boer, M. C. J. D. van Eekelen, and S. de Gouw. \u201cVerifying OpenJDK\u2019s LinkedList using KeY\u201d. In: Tools and Algorithms for the Construction and Analysis of Systems - 26th International Conference, TACAS 2020, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2020, Dublin, Ireland, April 25\u201330, 2020, Proceedings, Part II. Ed. by A. Biere and D. Parker. Vol. 12079. Lecture Notes in Computer Science. Springer, 2020, pp. 217\u2013234. doi: 10.1007\/978-3-030-45237-7_13. url: https:\/\/doi.org\/10.1007\/978-3-030-45237-7_13.","DOI":"10.1007\/978-3-030-45237-7_13"},{"key":"15_CR14","unstructured":"B. Jacobs and F. Piessens. The VeriFast program verifier. Tech. rep. CW520. Katholieke Universiteit Leuven, 2008."},{"key":"15_CR15","doi-asserted-by":"crossref","unstructured":"B. Jacobs, J. Smans, P. Philippaerts, F. Vogels, W. Penninckx, and F. Piessens. \u201cVeriFast: A powerful, sound, predictable, fast verifier for C and Java\u201d. In: NASA Formal Methods Symposium. Ed. by M. Bobaru, K. Havelund, G. J. Holzmann, and R. Joshi. Springer. 2011, pp. 41\u201355. doi: 10.1007\/978-3-642-20398-5_4.","DOI":"10.1007\/978-3-642-20398-5_4"},{"key":"15_CR16","doi-asserted-by":"crossref","unstructured":"M. Kokologiannakis, O. Lahav, K. Sagonas, and V. Vafeiadis. \u201cEffective stateless model checking for C\/C++ concurrency\u201d. In: Proceedings of the ACM on Programming Languages 2.POPL (2017), pp. 1\u201332.","DOI":"10.1145\/3158105"},{"key":"15_CR17","doi-asserted-by":"crossref","unstructured":"N. Kosmatov, D. Longuet, and R. Soulat. \u201cFormal Verification of an Industrial Distributed Algorithm: An Experience Report\u201d. In: Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Rhodes, Greece, October 20\u201330, 2020, Proceedings, Part I. Ed. by T. Margaria and B. Steffen. Vol. 12476. Lecture Notes in Computer Science. Springer, 2020, pp. 525\u2013542. doi: 10.1007\/978-3-030-61362-4_30. url: https:\/\/doi.org\/10.1007\/978-3-030-61362-4_30.","DOI":"10.1007\/978-3-030-61362-4_30"},{"key":"15_CR18","unstructured":"P. Lammich. \u201cGenerating Verified LLVM from Isabelle\/HOL\u201d. In: 10th International Conference on Interactive Theorem Proving (ITP 2019). Ed. by J. Harrison, J. O\u2019Leary, and A. Tolmach. Vol. 141. Leibniz International Proceedings in Informatics (LIPIcs). Dagstuhl, Germany: Schloss Dagstuhl\u2013Leibniz-Zentrum fuer Informatik, 2019, 22:1\u201322:19. isbn: 978-3-95977-122-1. doi: 10.4230\/LIPIcs.ITP.2019.22. url: http:\/\/drops.dagstuhl.de\/opus\/volltexte\/2019\/11077."},{"key":"15_CR19","unstructured":"C. Lattner and V. Adve. \u201cLLVM: A compilation framework for lifelong program analysis & transformation\u201d. In: International Symposium on Code Generation and Optimization, 2004. CGO 2004. IEEE. 2004, pp. 75\u201386. doi: 10.5555\/977395.977673."},{"key":"15_CR20","doi-asserted-by":"crossref","unstructured":"K. Leino. \u201cAccessible Software Verification with Dafny\u201d. In: IEEE Software 34.6 (2017), pp. 94\u201397. doi: 10.1109\/MS.2017.4121212.","DOI":"10.1109\/MS.2017.4121212"},{"key":"15_CR21","unstructured":"LLVM Project. LLVM Developer Policy: IR Backwards Compatibility. https:\/\/llvm.org\/docs\/DeveloperPolicy.html{#}ir-backwards-compatibility. [Accessed 05-Dec-2022]. Dec. 2022."},{"key":"15_CR22","unstructured":"LLVM Project. LLVM Language Reference Manual. https:\/\/releases.llvm.org\/15.0.0\/docs\/LangRef.html. [Accessed 05-Dec-2022]. Sept. 2022."},{"key":"15_CR23","unstructured":"LLVM Project. opt - LLVM optimizer. https:\/\/releases.llvm.org\/15.0.0\/docs\/CommandGuide\/opt.html. [Accessed 05-Dec-2022]. Sept. 2022."},{"key":"15_CR24","doi-asserted-by":"crossref","unstructured":"N. P. Lopes, J. Lee, C. Hur, Z. Liu, and J. Regehr. \u201cAlive2: bounded translation validation for LLVM\u201d. In: PLDI \u201921: 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation, Virtual Event, Canada, June 20\u201325, 2021. Ed. by S. N. Freund and E. Yahav. ACM, 2021, pp. 65\u201379. doi: 10.1145\/3453483.3454030. url: https:\/\/doi.org\/10.1145\/3453483.3454030.","DOI":"10.1145\/3453483.3454030"},{"key":"15_CR25","doi-asserted-by":"crossref","unstructured":"P. M\u00fcller, M. Schwerhoff, and A. Summers. \u201cViper - A Verification Infrastructure for Permission-Based Reasoning\u201d. In: Verification, Model Checking, and Abstract Interpretation. VMCAI. Ed. by B. Jobstmann and K. R. M. Leino. Springer Berlin Heidelberg, 2016. doi: 10.1007\/978-3-662-49122-5_2.","DOI":"10.1007\/978-3-662-49122-5_2"},{"key":"15_CR26","doi-asserted-by":"crossref","unstructured":"L. Nelson, J. Bornholt, R. Gu, A. Baumann, E. Torlak, and X. Wang. \u201cScaling symbolic evaluation for automated verification of systems code with Serval\u201d. In: Proceedings of the 27th ACM Symposium on Operating Systems Principles. 2019, pp. 225\u2013242.","DOI":"10.1145\/3341301.3359641"},{"key":"15_CR27","doi-asserted-by":"crossref","unstructured":"P. W. O\u2019Hearn. \u201cResources, concurrency and local reasoning\u201d. In: 375.1\u20133 (2007), pp. 271\u2013307.","DOI":"10.1016\/j.tcs.2006.12.035"},{"key":"15_CR28","unstructured":"D. van Oorschot. VCLLVM: A Transformation Tool for LLVM IR programs to aid Deductive Verification. 2023. url: http:\/\/essay.utwente.nl\/96536\/."},{"key":"15_CR29","doi-asserted-by":"crossref","unstructured":"W. Oortwijn, M. Huisman, S. Joosten, and J. van de Pol. \u201cAutomated Verification of Parallel Nested DFS\u201d. In: International Conference on Tools and Algorithms for the Construction and Analysis of Systems. Springer. 2020, pp. 247\u2013265.","DOI":"10.1007\/978-3-030-45190-5_14"},{"key":"15_CR30","doi-asserted-by":"crossref","unstructured":"M. Paganoni and C. A. Furia. \u201cVerifying Functional Correctness Properties at the Level of Java Bytecode\u201d. In: International Symposium on Formal Methods. Springer. 2023, pp. 343\u2013363.","DOI":"10.1007\/978-3-031-27481-7_20"},{"key":"15_CR31","doi-asserted-by":"crossref","unstructured":"D. J. Pearce, M. Utting, and L. Groves. \u201cAn Introduction to Software Verification with Whiley\u201d. In: Engineering Trustworthy Software Systems - 4th International School, SETSS 2018, Chongqing, China, April 7\u201312, 2018, Tutorial Lectures. Ed. by J. P. Bowen, Z. Liu, and Z. Zhang. Vol. 11430. Lecture Notes in Computer Science. Springer, 2018, pp. 1\u201337. doi: 10.1007\/978-3-030-17601-3_1.","DOI":"10.1007\/978-3-030-17601-3_1"},{"key":"15_CR32","doi-asserted-by":"crossref","unstructured":"Z. Rakamaric and M. Emmi. \u201cSMACK: Decoupling Source Language Details from Verifier Implementations\u201d. In: Computer Aided Verification - 26th International Conference, CAV 2014, Held as Part of the Vienna Summer of Logic, VSL 2014, Vienna, Austria, July 18-22, 2014. Proceedings. Ed. by A. Biere and R. Bloem. Vol. 8559. Lecture Notes in Computer Science. Springer, 2014, pp. 106\u2013113. doi: 10.1007\/978-3-319-08867-9_7. url: https:\/\/doi.org\/10.1007\/978-3-319-08867-9_7.","DOI":"10.1007\/978-3-319-08867-9_7"},{"key":"15_CR33","doi-asserted-by":"crossref","unstructured":"H. Riener and G. Fey. \u201cFAuST: A framework for formal verification, automated debugging, and software test generation\u201d. In: Model Checking Software: 19th International Workshop, SPIN 2012, Oxford, UK, July 23-24, 2012. Proceedings 19. Springer. 2012, pp. 234\u2013240.","DOI":"10.1007\/978-3-642-31759-0_17"},{"key":"15_CR34","doi-asserted-by":"crossref","unstructured":"M. Safari and M. Huisman. \u201cFormal Verification of Parallel Stream Compaction and Summed-Area Table Algorithms\u201d. In: Theoretical Aspects of Computing \u2013 ICTAC 2020. Ed. by V. K. I. Pun, V. Stolz, and A. Simao. Springer, 2020, pp. 181\u2013199. doi: 10.1007\/978-3-030-64276-1_10.","DOI":"10.1007\/978-3-030-64276-1_10"},{"key":"15_CR35","doi-asserted-by":"crossref","unstructured":"M. Safari, W. Oortwijn, S. Joosten, and M. Huisman. \u201cFormal verification of parallel prefix sum\u201d. In: NASA Formal Methods Symposium. Ed. by R. Lee, S. Jha, A. Mavridou, and D. Giannakopoulou. Springer, 2020, pp. 170\u2013186. doi: 10.1007\/978-3-030-55754-6_10.","DOI":"10.1007\/978-3-030-55754-6_10"},{"key":"15_CR36","doi-asserted-by":"crossref","unstructured":"P. D. Schubert, B. Hermann, and E. Bodden. \u201cPhASAR: An Inter-procedural Static Analysis Framework for C\/C++\u201d. In: Tools and Algorithms for the Construction and Analysis of Systems. Ed. by T. Vojnar and L. Zhang. Cham: Springer International Publishing, 2019, pp. 393\u2013410. isbn: 978-3-030-17465-1.","DOI":"10.1007\/978-3-030-17465-1_22"},{"key":"15_CR37","doi-asserted-by":"crossref","unstructured":"M. Sitaraman and B. W. Weide. \u201cA Synopsis of Twenty Five Years of RESOLVE PhD Research Efforts: Software Development Effort Estimation Using Ensemble Techniques\u201d. In: ACM SIGSOFT Softw. Eng. Notes 43.3 (2018), p. 17. doi: 10.1145\/3229783.3229794.","DOI":"10.1145\/3229783.3229794"},{"key":"15_CR38","unstructured":"VerCors team. The VerCors Verifier Tutorial. url: https:\/\/vercors.ewi.utwente.nl\/wiki\/."},{"key":"15_CR39","doi-asserted-by":"crossref","unstructured":"Y. Zakowski, C. Beck, I. Yoon, I. Zaichuk, V. Zaliva, and S. Zdancewic. \u201cModular, compositional, and executable formal semantics for LLVM IR\u201d. In: Proc. ACM Program. Lang. 5.ICFP (2021), pp. 1\u201330. doi: 10.1145\/3473572. url: https:\/\/doi.org\/10.1145\/3473572.","DOI":"10.1145\/3473572"},{"key":"15_CR40","doi-asserted-by":"crossref","unstructured":"J. Zhao, S. Nagarakatte, M. M. K. Martin, and S. Zdancewic. \u201cFormal verification of SSA-based optimizations for LLVM\u201d. In: ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI \u201913, Seattle, WA, USA, June 16-19, 2013. Ed. by H. Boehm and C. Flanagan. ACM, 2013, pp. 175\u2013186. doi: 10.1145\/2491956.2462164. url: https:\/\/doi.org\/10.1145\/2491956.2462164.","DOI":"10.1145\/2491956.2462164"},{"key":"15_CR41","unstructured":"\u00d6. \u015eakar, D. van Oorschot, and M. Huisman. Artifact for paper (First Steps towards Deductive Verification of LLVM IR). en. 2024. doi: 10.4121\/9C8C079E-A941-4A66-89D8-3462BF30FF05.V1."}],"container-title":["Lecture Notes in Computer Science","Fundamental Approaches to Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-57259-3_15","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T13:04:46Z","timestamp":1712322286000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-57259-3_15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"ISBN":["9783031572586","9783031572593"],"references-count":41,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-57259-3_15","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024]]},"assertion":[{"value":"6 April 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"FASE","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Fundamental Approaches to Software Engineering","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Luxembourg City","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Luxembourg","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"6 April 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 April 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"fase2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/etaps.org\/2024\/conferences\/fase\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"41","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"14","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"5","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"34% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3-4","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"4","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}