{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T01:54:40Z","timestamp":1789178080980,"version":"build-2803163510"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T00:00:00Z","timestamp":1675123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62032004"],"award-info":[{"award-number":["62032004"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Alibaba Group through Alibaba Innovative Research (AIR) programme"},{"name":"CCF-Huawei Innovative Research programme","award":["TC20210701006\/CCF2021-admin-270"],"award-info":[{"award-number":["TC20210701006\/CCF2021-admin-270"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2023,1,31]]},"abstract":"<jats:p>\n            Secure Sockets Layer (SSL) and Transport Security (TLS) are two secure protocols for creating secure connections over the Internet. X.509 certificate validation is important for security and needs to be performed before an SSL\/TLS connection is established. Some advanced testing techniques, such as\n            <jats:sans-serif>frankencert<\/jats:sans-serif>\n            , have revealed, through randomly mutating Internet accessible certificates, that there exist unexpected, sometimes critical, validation differences among different SSL\/TLS implementations. Despite these efforts, X.509 certificate validation still needs to be thoroughly tested as this work shows.\n          <\/jats:p>\n          <jats:p>\n            This article tackles this challenge by proposing\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            , a coverage-directed technique to much more effectively test real-world certificate validation code. Our core insight is to (1) leverage easily accessible Internet certificates as seed certificates and (2) use code coverage to direct certificate mutation toward generating a set of diverse certificates. The generated certificates are then used to reveal discrepancies, thus potential flaws, among different certificate validation implementations.\n          <\/jats:p>\n          <jats:p>\n            We implement\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            and evaluate it against\n            <jats:sans-serif>frankencert<\/jats:sans-serif>\n            ,\n            <jats:sans-serif>NEZHA<\/jats:sans-serif>\n            , and\n            <jats:sans-serif>RFCcert<\/jats:sans-serif>\n            (three advanced fuzzing techniques) on five widely used SSL\/TLS implementations. The evaluation results clearly show the strengths of\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            : During 10,000 iterations,\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            reveals 71 unique validation differences, 12\u00d7, 1.4\u00d7, and 7\u00d7 as many as those revealed by\n            <jats:sans-serif>frankencert<\/jats:sans-serif>\n            ,\n            <jats:sans-serif>NEZHA<\/jats:sans-serif>\n            , and\n            <jats:sans-serif>RFCcert<\/jats:sans-serif>\n            , respectively; it also supplements\n            <jats:sans-serif>RFCcert<\/jats:sans-serif>\n            in conformance testing of the SSL\/TLS implementations against 120 validation rules, 85 of which are exclusively covered by\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            -generated certificates. We identify 17 root causes of validation differences, all of which have been confirmed and 11 have never been reported previously. The\n            <jats:sans-serif>transcert<\/jats:sans-serif>\n            -generated X.509 certificates also reveal that the primary goal of certificate chain validation is stated ambiguously in the widely adopted public key infrastructure standard RFC 5280.\n          <\/jats:p>","DOI":"10.1145\/3510416","type":"journal-article","created":{"date-parts":[[2022,4,19]],"date-time":"2022-04-19T12:40:29Z","timestamp":1650372029000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Coverage-directed Differential Testing of X.509 Certificate Validation in SSL\/TLS Implementations"],"prefix":"10.1145","volume":"32","author":[{"given":"Pengbo","family":"Nie","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengcheng","family":"Wan","sequence":"additional","affiliation":[{"name":"University of Chicago, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiayu","family":"Zhu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyi","family":"Lin","sequence":"additional","affiliation":[{"name":"Alibaba Group Inc., Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuting","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhendong","family":"Su","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,2,22]]},"reference":[{"issue":"3","key":"e_1_3_2_2_2","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1002\/stvr.1486","article-title":"A hitchhiker\u2019s guide to statistical tests for assessing randomized algorithms in software engineering","volume":"24","author":"Arcuri Andrea","year":"2014","unstructured":"Andrea Arcuri and Lionel Briand. 2014. A hitchhiker\u2019s guide to statistical tests for assessing randomized algorithms in software engineering. Softw. Test. Verif. Reliabil. 24, 3 (2014), 219\u2013250.","journal-title":"Softw. Test. Verif. Reliabil."},{"key":"e_1_3_2_3_2","first-page":"1","article-title":"Deprecating secure sockets layer version 3.0","volume":"7568","author":"Barnes Richard L.","year":"2015","unstructured":"Richard L. Barnes, Martin Thomson, Alfredo Pironti, and Adam Langley. 2015. Deprecating secure sockets layer version 3.0. RFC 7568 (2015), 1\u20137.","journal-title":"RFC"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-3-319-66299-2_14","volume-title":"Search Based Software Engineering","author":"Basios Michail","year":"2017","unstructured":"Michail Basios, Lingbo Li, Fan Wu, Leslie Kanthan, and Earl T. Barr. 2017. Optimising darwinian data structures on google guava. In Search Based Software Engineering, Tim Menzies and Justyna Petke (Eds.). Springer International Publishing, Cham, 161\u2013167."},{"key":"e_1_3_2_5_2","first-page":"394","volume-title":"Proceedings of the ACM SIGSAC Conference on Computer and Communications Security","author":"Bates Adam","year":"2014","unstructured":"Adam Bates, Joe Pletcher, Tyler Nichols, Braden Hollembaek, Dave Tian, Kevin R. B. Butler, and Abdulrahman Alkhelaifi. 2014. Securing SSL certificate verification through dynamic linking. In Proceedings of the ACM SIGSAC Conference on Computer and Communications Security. ACM, 394\u2013405."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1109\/SP.2015.39","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201915)","author":"Beurdouche Benjamin","year":"2015","unstructured":"Benjamin Beurdouche, Karthikeyan Bhargavan, Antoine Delignat-Lavaud, C\u00e9dric Fournet, Markulf Kohlweiss, Alfredo Pironti, Pierre-Yves Strub, and Jean Karim Zinzindohoue. 2015. A messy state of the union: Taming the composite state machines of TLS. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201915). IEEE Computer Society, 535\u2013552."},{"key":"e_1_3_2_7_2","first-page":"1032","volume-title":"Proceedings of the ACM SIGSAC Conference on Computer and Communications Security","author":"B\u00f6hme Marcel","year":"2016","unstructured":"Marcel B\u00f6hme, Van-Thuan Pham, and Abhik Roychoudhury. 2016. Coverage-based greybox fuzzing as markov chain. In Proceedings of the ACM SIGSAC Conference on Computer and Communications Security. ACM, 1032\u20131043."},{"issue":"5","key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TSE.2017.2785841","article-title":"Coverage-based greybox fuzzing as markov chain","volume":"45","author":"B\u00f6hme Marcel","year":"2019","unstructured":"Marcel B\u00f6hme, Van-Thuan Pham, and Abhik Roychoudhury. 2019. Coverage-based greybox fuzzing as markov chain. IEEE Trans. Softw. Eng. 45, 5 (2019), 489\u2013506.","journal-title":"IEEE Trans. Softw. Eng."},{"key":"e_1_3_2_9_2","first-page":"122","volume-title":"Proceedings of the 35th International Conference on Software Engineering (ICSE\u201913)","author":"Bounimova Ella","year":"2013","unstructured":"Ella Bounimova, Patrice Godefroid, and David Molnar. 2013. Billions and billions of constraints: Whitebox fuzz testing in production. In Proceedings of the 35th International Conference on Software Engineering (ICSE\u201913). 122\u2013131. 10.1109\/ICSE.2013.6606558"},{"key":"e_1_3_2_10_2","first-page":"1","article-title":"Transport layer security (TLS) authorization extensions","volume":"5878","author":"Brown Mark","year":"2010","unstructured":"Mark Brown and Russell Housley. 2010. Transport layer security (TLS) authorization extensions. RFC 5878 (2010), 1\u201319.","journal-title":"RFC"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1109\/SP.2014.15","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201914)","author":"Brubaker Chad","year":"2014","unstructured":"Chad Brubaker, Suman Jana, Baishakhi Ray, Sarfraz Khurshid, and Vitaly Shmatikov. 2014. Using frankencerts for automated adversarial testing of certificate validation in SSL\/TLS implementations. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201914). IEEE Computer Society, 114\u2013129."},{"key":"e_1_3_2_12_2","first-page":"503","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917)","author":"Chau Sze Yiu","year":"2017","unstructured":"Sze Yiu Chau, Omar Chowdhury, Md. Endadul Hoque, Huangyi Ge, Aniket Kate, Cristina Nita-Rotaru, and Ninghui Li. 2017. SymCerts: Practical symbolic execution for exposing noncompliance in X.509 certificate validation implementations. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917). IEEE Computer Society, 503\u2013520."},{"key":"e_1_3_2_13_2","first-page":"48","volume-title":"Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201918)","author":"Chen Chao","year":"2018","unstructured":"Chao Chen, Wenrui Diao, Yingpei Zeng, Shanqing Guo, and Chengyu Hu. 2018. DRLgencert: Deep learning-based automated testing of certificate verification in SSL\/TLS implementations. In Proceedings of the IEEE International Conference on Software Maintenance and Evolution (ICSME\u201918). IEEE Computer Society, 48\u201358."},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1145\/3180155.3180226","volume-title":"Proceedings of the 40th International Conference on Software Engineering (ICSE\u201918)","author":"Chen Chu","year":"2018","unstructured":"Chu Chen, Cong Tian, Zhenhua Duan, and Liang Zhao. 2018. RFC-directed differential testing of certificate validation in SSL\/TLS implementations. In Proceedings of the 40th International Conference on Software Engineering (ICSE\u201918). ACM, 859\u2013870."},{"key":"e_1_3_2_15_2","first-page":"1257","volume-title":"Proceedings of the 41st International Conference on Software Engineering (ICSE\u201919)","author":"Chen Yuting","year":"2019","unstructured":"Yuting Chen, Ting Su, and Zhendong Su. 2019. Deep differential testing of JVM implementations. In Proceedings of the 41st International Conference on Software Engineering (ICSE\u201919). IEEE\/ACM, 1257\u20131268."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1145\/2786805.2786835","volume-title":"Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE\u201915)","author":"Chen Yuting","year":"2015","unstructured":"Yuting Chen and Zhendong Su. 2015. Guided differential testing of certificate validation in SSL\/TLS implementations. In Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE\u201915). Association for Computing Machinery, New York, NY, 793\u2013804. 10.1145\/2786805.2786835"},{"key":"e_1_3_2_17_2","first-page":"1","article-title":"Internet X.509 public key infrastructure certificate policy and certification practices framework","volume":"2527","author":"Chokhani Santosh","year":"1999","unstructured":"Santosh Chokhani and Warwick Ford. 1999. Internet X.509 public key infrastructure certificate policy and certification practices framework. RFC 2527 (1999), 1\u201345.","journal-title":"RFC"},{"key":"e_1_3_2_18_2","first-page":"1","article-title":"Internet X.509 public key infrastructure certificate policy and certification practices framework","volume":"3647","author":"Chokhani Santosh","year":"2003","unstructured":"Santosh Chokhani, Warwick Ford, Randy Sabett, Charles R. Merrill, and Stephen S. Wu. 2003. Internet X.509 public key infrastructure certificate policy and certification practices framework. RFC 3647 (2003), 1\u201394.","journal-title":"RFC"},{"key":"e_1_3_2_19_2","first-page":"1","article-title":"Internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile","volume":"5280","author":"Cooper David","year":"2008","unstructured":"David Cooper, Stefan Santesson, Stephen Farrell, Sharon Boeyen, Russell Housley, and W. Timothy Polk. 2008. Internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile. RFC 5280 (2008), 1\u2013151.","journal-title":"RFC"},{"key":"e_1_3_2_20_2","first-page":"1","article-title":"Internet X.509 public key infrastructure: Certification path building","volume":"4158","author":"Cooper Matt","year":"2005","unstructured":"Matt Cooper, Yuriy Dzambasow, Peter Hesse, Susan Joseph, and Richard Nicholas. 2005. Internet X.509 public key infrastructure: Certification path building. RFC 4158 (2005), 1\u201381.","journal-title":"RFC"},{"key":"e_1_3_2_21_2","first-page":"1","article-title":"The TLS protocol version 1.0","volume":"2246","author":"Dierks Tim","year":"1999","unstructured":"Tim Dierks and Christopher Allen. 1999. The TLS protocol version 1.0. RFC 2246 (1999), 1\u201380.","journal-title":"RFC"},{"key":"e_1_3_2_22_2","first-page":"1","article-title":"The transport layer security (TLS) protocol version 1.1","volume":"4346","author":"Dierks Tim","year":"2006","unstructured":"Tim Dierks and Eric Rescorla. 2006. The transport layer security (TLS) protocol version 1.1. RFC 4346 (2006), 1\u201387.","journal-title":"RFC"},{"key":"e_1_3_2_23_2","first-page":"1","article-title":"The transport layer security (TLS) protocol version 1.2","volume":"5246","author":"Dierks Tim","year":"2008","unstructured":"Tim Dierks and Eric Rescorla. 2008. The transport layer security (TLS) protocol version 1.2. RFC 5246 (2008), 1\u2013104.","journal-title":"RFC"},{"key":"e_1_3_2_24_2","volume-title":"The SSL Protocol","author":"Elgamal Dr. Taher","year":"1995","unstructured":"Dr. Taher Elgamal and Kipp E. B. Hickman. 1995. The SSL Protocol. Internet-Draft draft-hickman-netscape-ssl-00. Internet Engineering Task Force (unpublished)."},{"key":"e_1_3_2_25_2","first-page":"1","article-title":"The secure sockets layer (SSL) protocol version 3.0","volume":"6101","author":"Freier Alan O.","year":"2011","unstructured":"Alan O. Freier, Philip Karlton, and Paul C. Kocher. 2011. The secure sockets layer (SSL) protocol version 3.0. RFC 6101 (2011), 1\u201367.","journal-title":"RFC"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1145\/2382196.2382204","volume-title":"Proceedings of the 2012 ACM Conference on Computer and Communications Security (CCS\u201912)","author":"Georgiev Martin","year":"2012","unstructured":"Martin Georgiev, Subodh Iyengar, Suman Jana, Rishita Anubhai, Dan Boneh, and Vitaly Shmatikov. 2012. The most dangerous code in the world: Validating SSL certificates in non-browser software. In Proceedings of the 2012 ACM Conference on Computer and Communications Security (CCS\u201912). Association for Computing Machinery, New York, NY, 38\u201349. 10.1145\/2382196.2382204"},{"issue":"2","key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1145\/3363824","article-title":"Fuzzing: Hack, art, and science","volume":"63","author":"Godefroid Patrice","year":"2020","unstructured":"Patrice Godefroid. 2020. Fuzzing: Hack, art, and science. Commun. ACM 63, 2 (2020), 70\u201376.","journal-title":"Commun. ACM"},{"key":"e_1_3_2_28_2","first-page":"151","volume-title":"Proceedings of the Network and Distributed System Security Symposium (NDSS\u201908)","volume":"8","author":"Godefroid Patrice","year":"2008","unstructured":"Patrice Godefroid, Michael Y. Levin, and David A. Molnar. 2008. Automated whitebox fuzz testing. In Proceedings of the Network and Distributed System Security Symposium (NDSS\u201908), Vol. 8. The Internet Society, 151\u2013166."},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Keith J. Goulden. 2006. Effect sizes for research: A broad practical approach.","DOI":"10.1097\/00004703-200610000-00013"},{"key":"e_1_3_2_30_2","first-page":"621","volume-title":"Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907)","author":"Groce Alex","year":"2007","unstructured":"Alex Groce, Gerard Holzmann, and Rajeev Joshi. 2007. Randomized differential testing as a prelude to formal verification. In Proceedings of the 29th International Conference on Software Engineering (ICSE\u201907). IEEE, 621\u2013631."},{"key":"e_1_3_2_31_2","first-page":"342","volume-title":"Proceedings of the Annual Conference on the Future of Software Engineering (FOSE\u201907)","author":"Harman Mark","year":"2007","unstructured":"Mark Harman. 2007. The current state and future of search based software engineering. In Proceedings of the Annual Conference on the Future of Software Engineering (FOSE\u201907). 342\u2013357. 10.1109\/FOSE.2007.29"},{"issue":"14","key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/S0950-5849(01)00189-6","article-title":"Search-based software engineering","volume":"43","author":"Harman Mark","year":"2001","unstructured":"Mark Harman and Bryan F. Jones. 2001. Search-based software engineering. Inf. Softw. Technol. 43, 14 (2001), 833\u2013839.","journal-title":"Inf. Softw. Technol."},{"key":"e_1_3_2_33_2","first-page":"1","article-title":"Internationalization updates to RFC 5280","volume":"8399","author":"Housley Russ","year":"2018","unstructured":"Russ Housley. 2018. Internationalization updates to RFC 5280. RFC 8399 (2018), 1\u20139.","journal-title":"RFC"},{"key":"e_1_3_2_34_2","first-page":"1","article-title":"Internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile","volume":"3280","author":"Housley Russell","year":"2002","unstructured":"Russell Housley, W. Timothy Polk, Warwick Ford, and David Solo. 2002. Internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile. RFC 3280 (2002), 1\u2013129.","journal-title":"RFC"},{"key":"e_1_3_2_35_2","unstructured":"International Telecommunication Union. 2019. Recommendation ITU-T X.509 (Open Systems Interconnection: The Directory: Public-key and attribute certificate frameworks)."},{"key":"e_1_3_2_36_2","first-page":"69","volume-title":"Proceedings of the IEEE International Conference on Software Testing, Verification and Validation (ICST\u201917)","author":"Kleine Kristoffer","year":"2017","unstructured":"Kristoffer Kleine and Dimitris E. Simos. 2017. Coveringcerts: Combinatorial methods for X.509 certificate testing. In Proceedings of the IEEE International Conference on Software Testing, Verification and Validation (ICST\u201917). IEEE Computer Society, 69\u201379."},{"issue":"1","key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/TEVC.2013.2281544","article-title":"Optimizing existing software with genetic programming","volume":"19","author":"Langdon William B.","year":"2014","unstructured":"William B. Langdon and Mark Harman. 2014. Optimizing existing software with genetic programming. IEEE Trans. Evol. Comput. 19, 1 (2014), 118\u2013135.","journal-title":"IEEE Trans. Evol. Comput."},{"key":"e_1_3_2_38_2","unstructured":"Nancy L. Leech and Anthony J. Onwuegbuzie. 2002. A call for greater use of nonparametric statistics. (2002)."},{"issue":"6","key":"e_1_3_2_39_2","first-page":"580","article-title":"The value of exact analysis in requirements selection","volume":"43","author":"Li Lingbo","year":"2016","unstructured":"Lingbo Li, Mark Harman, Fan Wu, and Yuanyuan Zhang. 2016. The value of exact analysis in requirements selection. IEEE Trans. Softw. Eng. 43, 6 (2016), 580\u2013596.","journal-title":"IEEE Trans. Softw. Eng."},{"issue":"1","key":"e_1_3_2_40_2","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","article-title":"On a test of whether one of two random variables is stochastically larger than the other","volume":"18","author":"Mann H. B.","year":"1947","unstructured":"H. B. Mann and D. R. Whitney. 1947. On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 18, 1 (1947), 50\u201360.","journal-title":"Ann. Math. Stat."},{"issue":"1","key":"e_1_3_2_41_2","first-page":"100","article-title":"Differential testing for software","volume":"10","author":"McKeeman William M.","year":"1998","unstructured":"William M. McKeeman. 1998. Differential testing for software. Dig. Techn. J. 10, 1 (1998), 100\u2013107.","journal-title":"Dig. Techn. J."},{"key":"e_1_3_2_42_2","first-page":"1","article-title":"Internationalized email addresses in X.509 certificates","volume":"8398","author":"Melnikov Alexey","year":"2018","unstructured":"Alexey Melnikov and Weihaw Chuang. 2018. Internationalized email addresses in X.509 certificates. RFC 8398 (2018), 1\u201312.","journal-title":"RFC"},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"Leandro L. Minku Dirk Sudholt and Xin Yao. 2012. Evolutionary algorithms for the project scheduling problem: Runtime analysis and improved design. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201912). Association for Computing Machinery New York NY 1221\u20131228. 10.1145\/2330163.2330332","DOI":"10.1145\/2330163.2330332"},{"key":"e_1_3_2_44_2","first-page":"615","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917)","author":"Petsios Theofilos","year":"2017","unstructured":"Theofilos Petsios, Adrian Tang, Salvatore J. Stolfo, Angelos D. Keromytis, and Suman Jana. 2017. NEZHA: Efficient domain-independent differential testing. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917). IEEE Computer Society, 615\u2013632."},{"key":"e_1_3_2_45_2","first-page":"1","article-title":"The transport layer security (TLS) protocol version 1.3","volume":"8446","author":"Rescorla Eric","year":"2018","unstructured":"Eric Rescorla. 2018. The transport layer security (TLS) protocol version 1.3. RFC 8446 (2018), 1\u2013160.","journal-title":"RFC"},{"key":"e_1_3_2_46_2","first-page":"1","article-title":"Representation and verification of domain-based application service identity within internet public key infrastructure using X.509 (PKIX) certificates in the context of transport layer security (TLS)","volume":"6125","author":"Saint-Andre Peter","year":"2011","unstructured":"Peter Saint-Andre and Jeff Hodges. 2011. Representation and verification of domain-based application service identity within internet public key infrastructure using X.509 (PKIX) certificates in the context of transport layer security (TLS). RFC 6125 (2011), 1\u201357.","journal-title":"RFC"},{"key":"e_1_3_2_47_2","first-page":"1","article-title":"Authentication context certificate extension","volume":"7773","author":"Santesson Stefan","year":"2016","unstructured":"Stefan Santesson. 2016. Authentication context certificate extension. RFC 7773 (2016), 1\u201316.","journal-title":"RFC"},{"key":"e_1_3_2_48_2","first-page":"1","article-title":"Internet X.509 public key infrastructure authority information access certificate revocation list (CRL) extension","volume":"4325","author":"Santesson Stefan","year":"2005","unstructured":"Stefan Santesson and Russell Housley. 2005. Internet X.509 public key infrastructure authority information access certificate revocation list (CRL) extension. RFC 4325 (2005), 1\u20137.","journal-title":"RFC"},{"key":"e_1_3_2_49_2","first-page":"1","article-title":"Internet X.509 public key infrastructure: Logotypes in X.509 certificates","volume":"3709","author":"Santesson Stefan","year":"2004","unstructured":"Stefan Santesson, Russ Housley, and Trevor Freeman. 2004. Internet X.509 public key infrastructure: Logotypes in X.509 certificates. RFC 3709 (2004), 1\u201321.","journal-title":"RFC"},{"key":"e_1_3_2_50_2","first-page":"521","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917)","author":"Sivakorn Suphannee","year":"2017","unstructured":"Suphannee Sivakorn, George Argyros, Kexin Pei, Angelos D. Keromytis, and Suman Jana. 2017. HVLearn: Automated black-box analysis of hostname verification in SSL\/TLS implementations. In Proceedings of the IEEE Symposium on Security and Privacy (SP\u201917). IEEE Computer Society, 521\u2013538."},{"issue":"4","key":"e_1_3_2_51_2","first-page":"24:1\u201324:37","article-title":"Differential testing of certificate validation in SSL\/TLS implementations: An RFC-guided approach","volume":"28","author":"Tian Cong","year":"2019","unstructured":"Cong Tian, Chu Chen, Zhenhua Duan, and Liang Zhao. 2019. Differential testing of certificate validation in SSL\/TLS implementations: An RFC-guided approach. ACM Trans. Softw. Eng. Methodol. 28, 4 (2019), 24:1\u201324:37.","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"e_1_3_2_52_2","first-page":"1","article-title":"The NSA (No Secrecy Afforded) certificate extension","volume":"7169","author":"Turner Sean","year":"2014","unstructured":"Sean Turner. 2014. The NSA (No Secrecy Afforded) certificate extension. RFC 7169 (2014), 1\u20133.","journal-title":"RFC"},{"key":"e_1_3_2_53_2","first-page":"1","article-title":"Prohibiting secure sockets layer (SSL) version 2.0","volume":"6176","author":"Turner Sean","year":"2011","unstructured":"Sean Turner and Tim Polk. 2011. Prohibiting secure sockets layer (SSL) version 2.0. RFC 6176 (2011), 1\u20134.","journal-title":"RFC"},{"issue":"2","key":"e_1_3_2_54_2","first-page":"101","article-title":"A critique and improvement of the CL common language effect size statistics of McGraw and Wong","volume":"25","author":"Vargha Andr\u00e1s","year":"2000","unstructured":"Andr\u00e1s Vargha and Harold D. Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. J. Educ. Behav. Stat. 25, 2 (2000), 101\u2013132.","journal-title":"J. Educ. Behav. Stat."},{"key":"e_1_3_2_55_2","first-page":"1","volume-title":"Proceedings of the International Carnahan Conference on Security Technology (ICCST\u201918)","author":"Walz Andreas","year":"2018","unstructured":"Andreas Walz and Axel Sikora. 2018. Maximizing and leveraging behavioral discrepancies in TLS implementations using response-guided differential fuzzing. In Proceedings of the International Carnahan Conference on Security Technology (ICCST\u201918). IEEE, 1\u20135."},{"key":"e_1_3_2_56_2","first-page":"1","article-title":"Updates to the internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile","volume":"6818","author":"Yee Peter E.","year":"2013","unstructured":"Peter E. Yee. 2013. Updates to the internet X.509 public key infrastructure certificate and certificate revocation list (CRL) profile. RFC 6818 (2013), 1\u20138.","journal-title":"RFC"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3510416","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3510416","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:45Z","timestamp":1750183785000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3510416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,31]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1,31]]}},"alternative-id":["10.1145\/3510416"],"URL":"https:\/\/doi.org\/10.1145\/3510416","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,31]]},"assertion":[{"value":"2021-01-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}