{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:46:08Z","timestamp":1777128368203,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":67,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:00:00Z","timestamp":1635724800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11]]},"DOI":"10.1145\/3472883.3486995","type":"proceedings-article","created":{"date-parts":[[2021,10,27]],"date-time":"2021-10-27T10:48:16Z","timestamp":1635331696000},"page":"403-411","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Towards Reliable AI for Source Code Understanding"],"prefix":"10.1145","author":[{"given":"Sahil","family":"Suneja","sequence":"first","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunhui","family":"Zheng","sequence":"additional","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yufan","family":"Zhuang","sequence":"additional","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jim A.","family":"Laredo","sequence":"additional","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandro","family":"Morari","sequence":"additional","affiliation":[{"name":"IBM Research, Yorktown Heights, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,11]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Julius Adebayo Justin Gilmer Michael Muelly Ian J. Goodfellow Moritz Hardt and Been Kim. 2018. Sanity Checks for Saliency Maps. (2018) 9525--9536. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/294a8ed24blad22ec2e7efea049b8737-Abstract.html  Julius Adebayo Justin Gilmer Michael Muelly Ian J. Goodfellow Moritz Hardt and Been Kim. 2018. Sanity Checks for Saliency Maps. (2018) 9525--9536. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/294a8ed24blad22ec2e7efea049b8737-Abstract.html"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359591.3359735"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786849"},{"key":"e_1_3_2_2_4_1","volume-title":"ICLR","author":"Allamanis Miltiadis","year":"2018","unstructured":"Miltiadis Allamanis , Marc Brockschmidt , and Mahmoud Khademi . 2018 . Learning to Represent Programs with Graphs . In ICLR 2018. https:\/\/openreview.net\/forum?id=BJOFETxR- Miltiadis Allamanis, Marc Brockschmidt, and Mahmoud Khademi. 2018. Learning to Represent Programs with Graphs. In ICLR 2018. https:\/\/openreview.net\/forum?id=BJOFETxR-"},{"key":"e_1_3_2_2_5_1","volume-title":"A Convolutional Attention Network for Extreme Summarization of Source Code. In ICML 2016","volume":"48","author":"Allamanis M.","year":"2091","unstructured":"M. Allamanis , H. Peng , and C. Sutton . 2016 . A Convolutional Attention Network for Extreme Summarization of Source Code. In ICML 2016 , Vol. 48 . 2091 --2100. http:\/\/proceedings.mlr.press\/v48\/allamanis16.html M. Allamanis, H. Peng, and C. Sutton. 2016. A Convolutional Attention Network for Extreme Summarization of Source Code. In ICML 2016, Vol. 48. 2091--2100. http:\/\/proceedings.mlr.press\/v48\/allamanis16.html"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09878-9"},{"key":"e_1_3_2_2_7_1","unstructured":"Rohan Bavishi Michael Pradel and Koushik Sen. 2018. Context2Name: A Deep Learning-Based Approach to Infer Natural Variable Names from Usage Contexts. (2018). http:\/\/arxiv.org\/abs\/1809.05193  Rohan Bavishi Michael Pradel and Koushik Sen. 2018. Context2Name: A Deep Learning-Based Approach to Infer Natural Variable Names from Usage Contexts. (2018). http:\/\/arxiv.org\/abs\/1809.05193"},{"key":"e_1_3_2_2_8_1","volume-title":"Adversarial Robustness for Code. In ICML 2020 (Proceedings of Machine Learning Research","volume":"907","author":"Bielik Pavol","unstructured":"Pavol Bielik and Martin T. Vechev . 2020 . Adversarial Robustness for Code. In ICML 2020 (Proceedings of Machine Learning Research , Vol. 119). 896-- 907 . http:\/\/proceedings.mlr.press\/v119\/bielik20a.html Pavol Bielik and Martin T. Vechev. 2020. Adversarial Robustness for Code. In ICML 2020 (Proceedings of Machine Learning Research, Vol. 119). 896--907. http:\/\/proceedings.mlr.press\/v119\/bielik20a.html"},{"key":"e_1_3_2_2_9_1","volume-title":"Asking the Right Questions in Crowd Data Sourcing. In IEEE 28th International Conference on Data Engineering (ICDE 2012","author":"Boim R.","year":"2012","unstructured":"R. Boim , O. Greenshpan , T. Milo , S. Novgorodov , N. Polyzotis , and W. Tan . 2012 . Asking the Right Questions in Crowd Data Sourcing. In IEEE 28th International Conference on Data Engineering (ICDE 2012 ). https:\/\/doi.org\/10.1109\/ICDE. 2012 .122 10.1109\/ICDE.2012.122 R. Boim, O. Greenshpan, T. Milo, S. Novgorodov, N. Polyzotis, and W. Tan. 2012. Asking the Right Questions in Crowd Data Sourcing. In IEEE 28th International Conference on Data Engineering (ICDE 2012). https:\/\/doi.org\/10.1109\/ICDE.2012.122"},{"key":"e_1_3_2_2_10_1","unstructured":"Alfredo Canziani Adam Paszke and Eugenio Culurciello. 2016. An Analysis of Deep Neural Network Models for Practical Applications. (2016). http:\/\/arxiv.org\/abs\/1605.07678  Alfredo Canziani Adam Paszke and Eugenio Culurciello. 2016. An Analysis of Deep Neural Network Models for Practical Applications. (2016). http:\/\/arxiv.org\/abs\/1605.07678"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468537"},{"key":"e_1_3_2_2_12_1","volume-title":"Vulnerability Detection: Are We There Yet","author":"Chakraborty S.","year":"2021","unstructured":"S. Chakraborty , R. Krishna , Y. Ding , and B. Ray . 2021 . Deep Learning based Vulnerability Detection: Are We There Yet . IEEE Trans. Software Eng . (2021). https:\/\/doi.org\/10.1109\/TSE.2021.3087402 10.1109\/TSE.2021.3087402 S. Chakraborty, R. Krishna, Y. Ding, and B. Ray. 2021. Deep Learning based Vulnerability Detection: Are We There Yet. IEEE Trans. Software Eng. (2021). https:\/\/doi.org\/10.1109\/TSE.2021.3087402"},{"key":"e_1_3_2_2_13_1","volume-title":"SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 16","author":"Chawla Nitesh V.","year":"2002","unstructured":"Nitesh V. Chawla , Kevin W. Bowyer , Lawrence O. Hall , and W. Philip Kegelmeyer . 2002 . SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 16 (2002). https:\/\/doi.org\/10.1613\/jair.953 10.1613\/jair.953 Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. 2002. SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 16 (2002). https:\/\/doi.org\/10.1613\/jair.953"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_2_2_15_1","volume-title":"An Empirical Study on the Usage of BERT Models for Code Completion. In MSR 2021","author":"Ciniselli M.","year":"2021","unstructured":"M. Ciniselli , N. Cooper , L. Pascarella , D. Poshyvanyk , M. Penta , and G. Bavota . 2021 . An Empirical Study on the Usage of BERT Models for Code Completion. In MSR 2021 . 108--119. https:\/\/doi.org\/10.1109\/MSR52588. 2021 .00024 10.1109\/MSR52588.2021.00024 M. Ciniselli, N. Cooper, L. Pascarella, D. Poshyvanyk, M. Penta, and G. Bavota. 2021. An Empirical Study on the Usage of BERT Models for Code Completion. In MSR 2021. 108--119. https:\/\/doi.org\/10.1109\/MSR52588.2021.00024"},{"key":"e_1_3_2_2_16_1","volume-title":"Algorithmic Decision Making and the Cost of Fairness. In KDD","author":"Corbett-Davies Sam","year":"2017","unstructured":"Sam Corbett-Davies , Emma Pierson , Avi Feller , Sharad Goel , and Aziz Huq . 2017 . Algorithmic Decision Making and the Cost of Fairness. In KDD 2017. 797--806. https:\/\/doi.org\/10.1145\/3097983.3098095 10.1145\/3097983.3098095 Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. 2017. Algorithmic Decision Making and the Cost of Fairness. In KDD 2017. 797--806. https:\/\/doi.org\/10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2881961"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Thomas Davidson Debasmita Bhattacharya and Ingmar Weber. 2019. Racial Bias in Hate Speech and Abusive Language Detection Datasets. (2019). http:\/\/arxiv.org\/abs\/1905.12516  Thomas Davidson Debasmita Bhattacharya and Ingmar Weber. 2019. Racial Bias in Hate Speech and Abusive Language Detection Datasets. (2019). http:\/\/arxiv.org\/abs\/1905.12516","DOI":"10.18653\/v1\/W19-3504"},{"key":"e_1_3_2_2_19_1","first-page":"248","article-title":"ImageNet: A large-scale hierarchical image database","volume":"2009","author":"Deng Jia","year":"2009","unstructured":"Jia Deng , Wei Dong , Richard Socher , Li-Jia Li , Kai Li , and Li Fei-Fei . 2009 . ImageNet: A large-scale hierarchical image database . In (CVPR 2009. 248 -- 255 . https:\/\/doi.org\/10.1109\/CVPR.2009.5206848 10.1109\/CVPR.2009.5206848 Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A large-scale hierarchical image database. In (CVPR 2009. 248--255. https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","journal-title":"(CVPR"},{"key":"e_1_3_2_2_20_1","volume-title":"ICLR","author":"Dinella E.","year":"2020","unstructured":"E. Dinella , H. Dai , Z. Li , M. Naik , L. Song , and K. Wang . 2020. Hoppity: Learning Graph Transformations to Detect and Fix Bugs in Programs . In ICLR 2020 . https:\/\/openreview.net\/forum?id=SJeqs6EFvB E. Dinella, H. Dai, Z. Li, M. Naik, L. Song, and K. Wang. 2020. Hoppity: Learning Graph Transformations to Detect and Fix Bugs in Programs. In ICLR 2020. https:\/\/openreview.net\/forum?id=SJeqs6EFvB"},{"key":"e_1_3_2_2_21_1","unstructured":"Bill Doerrfeld. 2021. How Open Source Software Powers Digital Innovation. https:\/\/devops.com\/how-open-source-software-powers-digital-innovation\/.  Bill Doerrfeld. 2021. How Open Source Software Powers Digital Innovation. https:\/\/devops.com\/how-open-source-software-powers-digital-innovation\/."},{"key":"e_1_3_2_2_22_1","volume-title":"TCC 2006","author":"Dwork Cynthia","year":"1878","unstructured":"Cynthia Dwork , Frank McSherry , Kobbi Nissim , and Adam D. Smith . 2006. Calibrating Noise to Sensitivity in Private Data Analysis . In TCC 2006 . 265--284. https:\/\/doi.org\/10.1007\/1168 1878 _14 10.1007\/11681878_14 Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam D. Smith. 2006. Calibrating Noise to Sensitivity in Private Data Analysis. In TCC 2006. 265--284. https:\/\/doi.org\/10.1007\/11681878_14"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412841.3442029"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2664836"},{"key":"e_1_3_2_2_25_1","unstructured":"Github. 2021. GitHub Copilot- Your AI pair programmer. https:\/\/copilot.github.com\/.  Github. 2021. GitHub Copilot- Your AI pair programmer. https:\/\/copilot.github.com\/."},{"key":"e_1_3_2_2_26_1","volume-title":"ICST 2020","author":"Golagha Mojdeh","year":"2020","unstructured":"Mojdeh Golagha , Alexander Pretschner , and Lionel C. Briand . 2020. Can We Predict the Quality of Spectrum-based Fault Localization? . In ICST 2020 . 4--15. https:\/\/doi.org\/10.1109\/ICST46399. 2020 .00012 10.1109\/ICST46399.2020.00012 Mojdeh Golagha, Alexander Pretschner, and Lionel C. Briand. 2020. Can We Predict the Quality of Spectrum-based Fault Localization?. In ICST 2020. 4--15. https:\/\/doi.org\/10.1109\/ICST46399.2020.00012"},{"key":"e_1_3_2_2_27_1","unstructured":"S. Gowal K. Dvijotham R. Stanforth R. Bunel C. Qin J. Uesato R. Arandjelovic T. Mann and P. Kohli. 2018. On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Models. (2018). http:\/\/arxiv.org\/abs\/1810.12715  S. Gowal K. Dvijotham R. Stanforth R. Bunel C. Qin J. Uesato R. Arandjelovic T. Mann and P. Kohli. 2018. On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Models. (2018). http:\/\/arxiv.org\/abs\/1810.12715"},{"key":"e_1_3_2_2_28_1","first-page":"746","article-title":"Code to Comment \"Translation\": Data","volume":"2020","author":"Gros David","year":"2020","unstructured":"David Gros , Hariharan Sezhiyan , Prem Devanbu , and Zhou Yu . 2020 . Code to Comment \"Translation\": Data , Metrics, Baselining & Evaluation. In ASE 2020. 746 -- 757 . https:\/\/doi.org\/10.1145\/3324884.3416546 10.1145\/3324884.3416546 David Gros, Hariharan Sezhiyan, Prem Devanbu, and Zhou Yu. 2020. Code to Comment \"Translation\": Data, Metrics, Baselining & Evaluation. In ASE 2020. 746--757. https:\/\/doi.org\/10.1145\/3324884.3416546","journal-title":"Metrics, Baselining & Evaluation. In ASE"},{"key":"e_1_3_2_2_29_1","unstructured":"Red Hat. 2021. The State of Enterprise Open Source. https:\/\/www.redhat.com\/en\/enterprise-open-source-report\/2021.  Red Hat. 2021. The State of Enterprise Open Source. https:\/\/www.redhat.com\/en\/enterprise-open-source-report\/2021."},{"key":"e_1_3_2_2_30_1","volume-title":"AutoML: A survey of the state-of-the-art. Knowl. Based Syst. 212","author":"He Xin","year":"2021","unstructured":"Xin He , Kaiyong Zhao , and Xiaowen Chu . 2021. AutoML: A survey of the state-of-the-art. Knowl. Based Syst. 212 ( 2021 ). https:\/\/doi.org\/10.1016\/j.knosys.2020.106622 10.1016\/j.knosys.2020.106622 Xin He, Kaiyong Zhao, and Xiaowen Chu. 2021. AutoML: A survey of the state-of-the-art. Knowl. Based Syst. 212 (2021). https:\/\/doi.org\/10.1016\/j.knosys.2020.106622"},{"key":"e_1_3_2_2_31_1","volume-title":"ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP","author":"Hestness Joel","year":"2019","unstructured":"Joel Hestness , Newsha Ardalani , and Gregory F. Diamos . 2019. Beyond human-level accuracy: computational challenges in deep learning . In ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2019 . 1--14. https:\/\/doi.org\/10.1145\/3293883.3295710 10.1145\/3293883.3295710 Joel Hestness, Newsha Ardalani, and Gregory F. Diamos. 2019. Beyond human-level accuracy: computational challenges in deep learning. In ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2019. 1--14. https:\/\/doi.org\/10.1145\/3293883.3295710"},{"key":"e_1_3_2_2_32_1","volume-title":"CCS","author":"Hitaj B.","year":"2017","unstructured":"B. Hitaj , G. Ateniese , and F. P\u00e9rez-Cruz . 2017. Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning . In CCS 2017 . 603--618. https:\/\/doi.org\/10.1145\/3133956.3134012 10.1145\/3133956.3134012 B. Hitaj, G. Ateniese, and F. P\u00e9rez-Cruz. 2017. Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning. In CCS 2017. 603--618. https:\/\/doi.org\/10.1145\/3133956.3134012"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1195"},{"key":"e_1_3_2_2_34_1","volume-title":"Yves Le Traon, and Mark Harman","author":"Jimenez Matthieu","year":"2019","unstructured":"Matthieu Jimenez , Renaud Rwemalika , Mike Papadakis , Federica Sarro , Yves Le Traon, and Mark Harman . 2019 . The importance of accounting for real-world labelling when predicting software vulnerabilities. In ESEC\/FSE 2019. 695--705. https:\/\/doi.org\/10.1145\/3338906.3338941 10.1145\/3338906.3338941 Matthieu Jimenez, Renaud Rwemalika, Mike Papadakis, Federica Sarro, Yves Le Traon, and Mark Harman. 2019. The importance of accounting for real-world labelling when predicting software vulnerabilities. In ESEC\/FSE 2019. 695--705. https:\/\/doi.org\/10.1145\/3338906.3338941"},{"key":"e_1_3_2_2_35_1","volume-title":"MAPL","author":"Koc Ugur","year":"2017","unstructured":"Ugur Koc , Parsa Saadatpanah , Jeffrey S. Foster , and Adam A. Porter . 2017. Learning a classifier for false positive error reports emitted by static code analysis tools . In MAPL 2017 . 35--42. https:\/\/doi.org\/10.1145\/3088525.3088675 10.1145\/3088525.3088675 Ugur Koc, Parsa Saadatpanah, Jeffrey S. Foster, and Adam A. Porter. 2017. Learning a classifier for false positive error reports emitted by static code analysis tools. In MAPL 2017. 35--42. https:\/\/doi.org\/10.1145\/3088525.3088675"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389268"},{"key":"e_1_3_2_2_37_1","volume-title":"Deep Learning in Software Engineering. CoRR abs\/1805.04825","author":"Li Xiaochen","year":"2018","unstructured":"Xiaochen Li , He Jiang , Zhilei Ren , Ge Li , and Jingxuan Zhang . 2018. Deep Learning in Software Engineering. CoRR abs\/1805.04825 ( 2018 ). arXiv:1805.04825 http:\/\/arxiv.org\/abs\/1805.04825 Xiaochen Li, He Jiang, Zhilei Ren, Ge Li, and Jingxuan Zhang. 2018. Deep Learning in Software Engineering. CoRR abs\/1805.04825 (2018). arXiv:1805.04825 http:\/\/arxiv.org\/abs\/1805.04825"},{"key":"e_1_3_2_2_38_1","volume-title":"SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilities","author":"Li Zhen","year":"2021","unstructured":"Zhen Li , Deqing Zou , Shouhuai Xu , Hai Jin , Yawei Zhu , and Zhaoxuan Chen . 2021. SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilities . IEEE Transactions on Dependable and Secure Computing ( 2021 ). https:\/\/doi.org\/10.1109\/TDSC.2021.3051525 10.1109\/TDSC.2021.3051525 Zhen Li, Deqing Zou, Shouhuai Xu, Hai Jin, Yawei Zhu, and Zhaoxuan Chen. 2021. SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilities. IEEE Transactions on Dependable and Secure Computing (2021). https:\/\/doi.org\/10.1109\/TDSC.2021.3051525"},{"key":"e_1_3_2_2_39_1","volume-title":"In Network and Distributed System Security Symposium, NDSS","author":"Li Zhen","year":"2018","unstructured":"Zhen Li , Deqing Zou , Shouhuai Xu , Xinyu Ou , Hai Jin , Sujuan Wang , Zhijun Deng , and Yuyi Zhong . 2018 . In Network and Distributed System Security Symposium, NDSS 2018. http:\/\/wp.internetsociety.org\/ndss\/wp-content\/uploads\/sites\/25\/2018\/02\/ndss2018_03A-2_Li_paper.pdf Zhen Li, Deqing Zou, Shouhuai Xu, Xinyu Ou, Hai Jin, Sujuan Wang, Zhijun Deng, and Yuyi Zhong. 2018. In Network and Distributed System Security Symposium, NDSS 2018. http:\/\/wp.internetsociety.org\/ndss\/wp-content\/uploads\/sites\/25\/2018\/02\/ndss2018_03A-2_Li_paper.pdf"},{"key":"e_1_3_2_2_40_1","volume-title":"Microsoft COCO: Common Objects in Context. In European Conference on Computer Vision, ECCV","author":"Lin Tsung-Yi","year":"2014","unstructured":"Tsung-Yi Lin , Michael Maire , Serge J. Belongie , James Hays , Pietro Perona , Deva Ramanan , Piotr Doll\u00e1r , and C. Lawrence Zitnick . 2014 . Microsoft COCO: Common Objects in Context. In European Conference on Computer Vision, ECCV 2014 . 740--755. https:\/\/doi.org\/10.1007\/978-3-319-10602-1_48 10.1007\/978-3-319-10602-1_48 Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll\u00e1r, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In European Conference on Computer Vision, ECCV 2014. 740--755. https:\/\/doi.org\/10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_41_1","volume-title":"ICSE 2019","author":"Liu K.","year":"2019","unstructured":"K. Liu , D. Kim , T. Bissyand\u00e9 , T. Kim , K. Kim , A. Koyuncu , S. Kim , and Y. Traon . 2019. Learning to spot and refactor inconsistent method names . In ICSE 2019 . 1--12. https:\/\/doi.org\/10.1109\/ICSE. 2019 .00019 10.1109\/ICSE.2019.00019 K. Liu, D. Kim, T. Bissyand\u00e9, T. Kim, K. Kim, A. Koyuncu, S. Kim, and Y. Traon. 2019. Learning to spot and refactor inconsistent method names. In ICSE 2019. 1--12. https:\/\/doi.org\/10.1109\/ICSE.2019.00019"},{"key":"e_1_3_2_2_42_1","unstructured":"NIST. 2017. Juliet Test Suite for C\/C++ V1.3. https:\/\/samate.nist.gov\/SRD\/testsuite.php  NIST. 2017. Juliet Test Suite for C\/C++ V1.3. https:\/\/samate.nist.gov\/SRD\/testsuite.php"},{"key":"e_1_3_2_2_43_1","volume-title":"ACL 2020. 1853--1868","author":"Panthaplackel Sheena","year":"1865","unstructured":"Sheena Panthaplackel , Pengyu Nie , Milos Gligoric , Junyi Jessy Li , and Raymond J. Mooney . 2020. Learning to Update Natural Language Comments Based on Code Changes . In ACL 2020. 1853--1868 . https:\/\/doi.org\/10. 1865 3\/v1\/2020.acl-main.168 10.18653\/v1 Sheena Panthaplackel, Pengyu Nie, Milos Gligoric, Junyi Jessy Li, and Raymond J. Mooney. 2020. Learning to Update Natural Language Comments Based on Code Changes. In ACL 2020. 1853--1868. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.168"},{"key":"e_1_3_2_2_44_1","volume-title":"International Conference on Management of Data, SIGMOD","author":"Park Hyunjung","year":"2014","unstructured":"Hyunjung Park and Jennifer Widom . 2014 . CrowdFill: collecting structured data from the crowd . In International Conference on Management of Data, SIGMOD 2014. https:\/\/doi.org\/10.1145\/2588555.2610503 10.1145\/2588555.2610503 Hyunjung Park and Jennifer Widom. 2014. CrowdFill: collecting structured data from the crowd. In International Conference on Management of Data, SIGMOD 2014. https:\/\/doi.org\/10.1145\/2588555.2610503"},{"key":"e_1_3_2_2_45_1","volume-title":"On the performance of method-level bug prediction: A negative result. J. Syst. Softw. 161","author":"Pascarella Luca","year":"2020","unstructured":"Luca Pascarella , Fabio Palomba , and Alberto Bacchelli . 2020. On the performance of method-level bug prediction: A negative result. J. Syst. Softw. 161 ( 2020 ). https:\/\/doi.org\/10.1016\/j.jss.2019.110493 10.1016\/j.jss.2019.110493 Luca Pascarella, Fabio Palomba, and Alberto Bacchelli. 2020. On the performance of method-level bug prediction: A negative result. J. Syst. Softw. 161 (2020). https:\/\/doi.org\/10.1016\/j.jss.2019.110493"},{"key":"e_1_3_2_2_46_1","volume-title":"Vincent J. Hellendoorn, and Mohammad Amin Alipour.","year":"2021","unstructured":"Md. Rafiqul Islam Rabin , Vincent J. Hellendoorn, and Mohammad Amin Alipour. 2021 . Understanding neural code intelligence through program simplification. In ESEC\/FSE 2021. 441--452. https:\/\/doi.org\/10.1145\/3468264.3468539 10.1145\/3468264.3468539 Md. Rafiqul Islam Rabin, Vincent J. Hellendoorn, and Mohammad Amin Alipour. 2021. Understanding neural code intelligence through program simplification. In ESEC\/FSE 2021. 441--452. https:\/\/doi.org\/10.1145\/3468264.3468539"},{"key":"e_1_3_2_2_47_1","first-page":"1135","article-title":"Why Should I Trust You?","volume":"2016","author":"Ribeiro Marco T\u00falio","year":"2016","unstructured":"Marco T\u00falio Ribeiro , Sameer Singh , and Carlos Guestrin . 2016 . \" Why Should I Trust You? \": Explaining the Predictions of Any Classifier. In KDD 2016. 1135 -- 1144 . https:\/\/doi.org\/10.1145\/2939672.2939778 10.1145\/2939672.2939778 Marco T\u00falio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. \"Why Should I Trust You?\": Explaining the Predictions of Any Classifier. In KDD 2016. 1135--1144. https:\/\/doi.org\/10.1145\/2939672.2939778","journal-title":"Explaining the Predictions of Any Classifier. In KDD"},{"key":"e_1_3_2_2_48_1","volume-title":"Automated Vulnerability Detection in Source Code Using Deep Representation Learning. In ICMLA 2018","author":"Russell R.","year":"2018","unstructured":"R. Russell , L. Kim , L. Hamilton , T. Lazovich , J. Harer , O. Ozdemir , P. Ellingwood , and M. McConley . 2018 . Automated Vulnerability Detection in Source Code Using Deep Representation Learning. In ICMLA 2018 . https:\/\/doi.org\/10.1109\/ICMLA. 2018 .00120 10.1109\/ICMLA.2018.00120 R. Russell, L. Kim, L. Hamilton, T. Lazovich, J. Harer, O. Ozdemir, P. Ellingwood, and M. McConley. 2018. Automated Vulnerability Detection in Source Code Using Deep Representation Learning. In ICMLA 2018. https:\/\/doi.org\/10.1109\/ICMLA.2018.00120"},{"key":"e_1_3_2_2_49_1","volume-title":"VanHoudnos","author":"Sestili Carson D.","year":"2018","unstructured":"Carson D. Sestili , William S. Snavely , and Nathan M . VanHoudnos . 2018 . Towards security defect prediction with AI. CoRR abs\/1808.09897 (2018). http:\/\/arxiv.org\/abs\/1808.09897 Carson D. Sestili, William S. Snavely, and Nathan M. VanHoudnos. 2018. Towards security defect prediction with AI. CoRR abs\/1808.09897 (2018). http:\/\/arxiv.org\/abs\/1808.09897"},{"key":"e_1_3_2_2_50_1","unstructured":"Sonatype. 2020. State of the Software Supply Chain Report. https:\/\/www.sonatype.com\/resources\/white-paper-state-of-the-software-supply-chain-2020.  Sonatype. 2020. State of the Software Supply Chain Report. https:\/\/www.sonatype.com\/resources\/white-paper-state-of-the-software-supply-chain-2020."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428301"},{"key":"e_1_3_2_2_52_1","unstructured":"Sahil Suneja Yunhui Zheng Yufan Zhuang Jim Laredo and Alessandro Morari. 2020. Learning to map source code to software vulnerability using code-as-a-graph. (2020). https:\/\/arxiv.org\/abs\/2006.08614  Sahil Suneja Yunhui Zheng Yufan Zhuang Jim Laredo and Alessandro Morari. 2020. Learning to map source code to software vulnerability using code-as-a-graph. (2020). https:\/\/arxiv.org\/abs\/2006.08614"},{"key":"e_1_3_2_2_53_1","volume-title":"Jim Alain Laredo, and Alessandro Morari","author":"Suneja Sahil","year":"2021","unstructured":"Sahil Suneja , Yunhui Zheng , Yufan Zhuang , Jim Alain Laredo, and Alessandro Morari . 2021 . Probing model signal-awareness via prediction-preserving input minimization. In ESEC\/FSE 2021. 945--955. https:\/\/doi.org\/10.1145\/3468264.3468545 10.1145\/3468264.3468545 Sahil Suneja, Yunhui Zheng, Yufan Zhuang, Jim Alain Laredo, and Alessandro Morari. 2021. Probing model signal-awareness via prediction-preserving input minimization. In ESEC\/FSE 2021. 945--955. https:\/\/doi.org\/10.1145\/3468264.3468545"},{"key":"e_1_3_2_2_54_1","volume-title":"Fast and Memory-Efficient Neural Code Completion. In MSR 2021","author":"Svyatkovskiy Alexey","year":"2021","unstructured":"Alexey Svyatkovskiy , Sebastian Lee , Anna Hadjitofi , Maik Riechert , Juliana Vicente Franco , and Miltiadis Allamanis . 2021 . Fast and Memory-Efficient Neural Code Completion. In MSR 2021 . 329--340. https:\/\/doi.org\/10.1109\/MSR52588.2021.00045 10.1109\/MSR52588.2021.00045 Alexey Svyatkovskiy, Sebastian Lee, Anna Hadjitofi, Maik Riechert, Juliana Vicente Franco, and Miltiadis Allamanis. 2021. Fast and Memory-Efficient Neural Code Completion. In MSR 2021. 329--340. https:\/\/doi.org\/10.1109\/MSR52588.2021.00045"},{"key":"e_1_3_2_2_55_1","unstructured":"Synopsys. 2020. Open Source Security and Risk Analysis Report. https:\/\/www.synopsys.com\/software-integrity\/resources\/analyst-reports\/open-source-security-risk-analysis.html.  Synopsys. 2020. Open Source Security and Risk Analysis Report. https:\/\/www.synopsys.com\/software-integrity\/resources\/analyst-reports\/open-source-security-risk-analysis.html."},{"key":"e_1_3_2_2_56_1","volume-title":"2nd International Conference on Learning Representations, ICLR","author":"Szegedy Christian","year":"2014","unstructured":"Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian J. Goodfellow , and Rob Fergus . 2014 . Intriguing properties of neural networks . In 2nd International Conference on Learning Representations, ICLR 2014. http:\/\/arxiv.org\/abs\/1312.6199 Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian J. Goodfellow, and Rob Fergus. 2014. Intriguing properties of neural networks. In 2nd International Conference on Learning Representations, ICLR 2014. http:\/\/arxiv.org\/abs\/1312.6199"},{"key":"e_1_3_2_2_57_1","first-page":"762","article-title":"ALETHEIA","volume":"2014","author":"Tripp Omer","year":"2014","unstructured":"Omer Tripp , Salvatore Guarnieri , Marco Pistoia , and Aleksandr Y. Aravkin . 2014 . ALETHEIA : Improving the Usability of Static Security Analysis. In CCS 2014. 762 -- 774 . https:\/\/doi.org\/10.1145\/2660267.2660339 10.1145\/2660267.2660339 Omer Tripp, Salvatore Guarnieri, Marco Pistoia, and Aleksandr Y. Aravkin. 2014. ALETHEIA: Improving the Usability of Static Security Analysis. In CCS 2014. 762--774. https:\/\/doi.org\/10.1145\/2660267.2660339","journal-title":"Improving the Usability of Static Security Analysis. In CCS"},{"key":"e_1_3_2_2_58_1","unstructured":"Cody Watson Nathan Cooper David Nader-Palacio Kevin Moran and Denys Poshyvanyk. 2020. A Systematic Literature Review on the Use of Deep Learning in Software Engineering Research. (2020). https:\/\/arxiv.org\/abs\/2009.06520  Cody Watson Nathan Cooper David Nader-Palacio Kevin Moran and Denys Poshyvanyk. 2020. A Systematic Literature Review on the Use of Deep Learning in Software Engineering Research. (2020). https:\/\/arxiv.org\/abs\/2009.06520"},{"key":"e_1_3_2_2_59_1","volume-title":"Towards Fast Computation of Certified Robustness for ReLU Networks. In ICML","author":"Weng T.","year":"2018","unstructured":"T. Weng , H. Zhang , H. Chen , Z. Song , C. Hsieh , L. Daniel , D. Boning , and I. Dhillon . 2018 . Towards Fast Computation of Certified Robustness for ReLU Networks. In ICML 2018 . 5273--5282. http:\/\/proceedings.mlr.press\/v80\/weng18a.html T. Weng, H. Zhang, H. Chen, Z. Song, C. Hsieh, L. Daniel, D. Boning, and I. Dhillon. 2018. Towards Fast Computation of Certified Robustness for ReLU Networks. In ICML 2018. 5273--5282. http:\/\/proceedings.mlr.press\/v80\/weng18a.html"},{"key":"e_1_3_2_2_60_1","volume-title":"Grundy","author":"Yang Yanming","year":"2020","unstructured":"Yanming Yang , Xin Xia , David Lo , and John C . Grundy . 2020 . A Survey on Deep Learning for Software Engineering. CoRR abs\/2011.14597 (2020). arXiv:2011.14597 https:\/\/arxiv.org\/abs\/2011.14597 Yanming Yang, Xin Xia, David Lo, and John C. Grundy. 2020. A Survey on Deep Learning for Software Engineering. CoRR abs\/2011.14597 (2020). arXiv:2011.14597 https:\/\/arxiv.org\/abs\/2011.14597"},{"key":"e_1_3_2_2_61_1","unstructured":"Q. Yao M. Wang H. Escalante I. Guyon Y. Hu Y. Li W. Tu Q. Yang and Y. Yu. 2018. Taking Human out of Learning Applications: A Survey on Automated Machine Learning. (2018). http:\/\/arxiv.org\/abs\/1810.13306  Q. Yao M. Wang H. Escalante I. Guyon Y. Hu Y. Li W. Tu Q. Yang and Y. Yu. 2018. Taking Human out of Learning Applications: A Survey on Automated Machine Learning. (2018). http:\/\/arxiv.org\/abs\/1810.13306"},{"key":"e_1_3_2_2_62_1","volume-title":"Automated Classification of Static Code Analysis Alerts: A Case Study. In ICSM 2013","author":"Yuksel Ulas","year":"2013","unstructured":"Ulas Yuksel and Hasan S\u00f6zer . 2013 . Automated Classification of Static Code Analysis Alerts: A Case Study. In ICSM 2013 . 532--535. https:\/\/doi.org\/10.1109\/ICSM.2013.89 10.1109\/ICSM.2013.89 Ulas Yuksel and Hasan S\u00f6zer. 2013. Automated Classification of Static Code Analysis Alerts: A Case Study. In ICSM 2013. 532--535. https:\/\/doi.org\/10.1109\/ICSM.2013.89"},{"key":"e_1_3_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988498"},{"key":"e_1_3_2_2_64_1","first-page":"111","article-title":"D2A","volume":"2021","author":"Zheng Y.","year":"2021","unstructured":"Y. Zheng , S. Pujar , B. Lewis , L. Buratti , E. Epstein , B. Yang , J. Laredo , A. Morari , and Z. Su . 2021 . D2A : A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysis. In ICSE-SEIP 2021. 111 -- 120 . https:\/\/doi.org\/10.1109\/ICSE-SEIP52600.2021.00020 10.1109\/ICSE-SEIP52600.2021.00020 Y. Zheng, S. Pujar, B. Lewis, L. Buratti, E. Epstein, B. Yang, J. Laredo, A. Morari, and Z. Su. 2021. D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysis. In ICSE-SEIP 2021. 111--120. https:\/\/doi.org\/10.1109\/ICSE-SEIP52600.2021.00020","journal-title":"In ICSE-SEIP"},{"key":"e_1_3_2_2_65_1","volume-title":"Learning Deep Features for Discriminative Localization. In CVPR 2016","author":"Zhou Bolei","year":"2016","unstructured":"Bolei Zhou , Aditya Khosla , \u00c0gata Lapedriza , Aude Oliva , and Antonio Torralba . 2016 . Learning Deep Features for Discriminative Localization. In CVPR 2016 . 2921--2929. https:\/\/doi.org\/10.1109\/CVPR.2016.319 10.1109\/CVPR.2016.319 Bolei Zhou, Aditya Khosla, \u00c0gata Lapedriza, Aude Oliva, and Antonio Torralba. 2016. Learning Deep Features for Discriminative Localization. In CVPR 2016. 2921--2929. https:\/\/doi.org\/10.1109\/CVPR.2016.319"},{"key":"e_1_3_2_2_66_1","volume-title":"Xiaoning Du, and Yang Liu.","author":"Zhou Yaqin","year":"2019","unstructured":"Yaqin Zhou , Shangqing Liu , Jing Kai Siow , Xiaoning Du, and Yang Liu. 2019 . Devign : Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks. In NeurIPS 2019. 10197--10207. https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/49265d2447bc3bbfe9e76306ce40a31f-Abstract.html Yaqin Zhou, Shangqing Liu, Jing Kai Siow, Xiaoning Du, and Yang Liu. 2019. Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks. In NeurIPS 2019. 10197--10207. https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/49265d2447bc3bbfe9e76306ce40a31f-Abstract.html"},{"key":"e_1_3_2_2_67_1","unstructured":"Yufan Zhuang Sahil Suneja Veronika Thost Giacomo Domeniconi Alessandro Morari and Jim Laredo. 2021. Software Vulnerability Detection via Deep Learning over Disaggregated Code Graph Representation. (2021). https:\/\/arxiv.org\/abs\/2109.03341  Yufan Zhuang Sahil Suneja Veronika Thost Giacomo Domeniconi Alessandro Morari and Jim Laredo. 2021. Software Vulnerability Detection via Deep Learning over Disaggregated Code Graph Representation. (2021). https:\/\/arxiv.org\/abs\/2109.03341"}],"event":{"name":"SoCC '21: ACM Symposium on Cloud Computing","location":"Seattle WA USA","acronym":"SoCC '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the ACM Symposium on Cloud Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3486995","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472883.3486995","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:57Z","timestamp":1750191117000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472883.3486995"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11]]},"references-count":67,"alternative-id":["10.1145\/3472883.3486995","10.1145\/3472883"],"URL":"https:\/\/doi.org\/10.1145\/3472883.3486995","relation":{},"subject":[],"published":{"date-parts":[[2021,11]]},"assertion":[{"value":"2021-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}