{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:36:19Z","timestamp":1791459379116,"version":"4.3.4"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,3,10]],"date-time":"2021-03-10T00:00:00Z","timestamp":1615334400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"crossref","award":["F2020201016"],"award-info":[{"award-number":["F2020201016"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"crossref","award":["JCYJ20170413114215614"],"award-info":[{"award-number":["JCYJ20170413114215614"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U1936211 and 61802106"],"award-info":[{"award-number":["U1936211 and 61802106"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Plan of China","award":["2017YFB0802205"],"award-info":[{"award-number":["2017YFB0802205"]}]},{"name":"National Science Foundation","award":["1814825 and 1736209"],"award-info":[{"award-number":["1814825 and 1736209"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>Detecting software vulnerabilities is an important problem and a recent development in tackling the problem is the use of deep learning models to detect software vulnerabilities. While effective, it is hard to explain why a deep learning model predicts a piece of code as vulnerable or not because of the black-box nature of deep learning models. Indeed, the interpretability of deep learning models is a daunting open problem. In this article, we make a significant step toward tackling the interpretability of deep learning model in vulnerability detection. Specifically, we introduce a high-fidelity explanation framework, which aims to identify a small number of tokens that make significant contributions to a detector\u2019s prediction with respect to an example. Systematic experiments show that the framework indeed has a higher fidelity than existing methods, especially when features are not independent of each other (which often occurs in the real world). In particular, the framework can produce some vulnerability rules that can be understood by domain experts for accepting a detector\u2019s outputs (i.e., true positives) or rejecting a detector\u2019s outputs (i.e., false-positives and false-negatives). We also discuss limitations of the present study, which indicate interesting open problems for future research.<\/jats:p>","DOI":"10.1145\/3429444","type":"journal-article","created":{"date-parts":[[2021,3,10]],"date-time":"2021-03-10T19:47:26Z","timestamp":1615405646000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Interpreting Deep Learning-based Vulnerability Detector Predictions Based on Heuristic Searching"],"prefix":"10.1145","volume":"30","author":[{"given":"Deqing","family":"Zou","sequence":"first","affiliation":[{"name":"Huazhong University of Science and Technology, P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yawei","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shouhuai","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Texas at San Antonio, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Li","sequence":"additional","affiliation":[{"name":"Hebei University, P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hai","family":"Jin","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hengkai","family":"Ye","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,3,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Checkmarx. 2020. Checkmarx\u2014Application Security Testing and Static Code Analysis. Checkmarx Israel. Retrieved from https:\/\/www.checkmarx.com\/.  Checkmarx. 2020. Checkmarx\u2014Application Security Testing and Static Code Analysis. Checkmarx Israel. Retrieved from https:\/\/www.checkmarx.com\/."},{"key":"e_1_2_1_2_1","volume-title":"Chris Olah","author":"Abadi Mart\u00edn","unstructured":"Mart\u00edn Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Gregory S. Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Ian J. Goodfellow , Andrew Harp , Geoffrey Irving , Michael Isard , Yangqing Jia , Rafal J\u00f3zefowicz , Lukasz Kaiser , Manjunath Kudlur , Josh Levenberg , Dan Man\u00e9 , Rajat Monga , Sherry Moore , Derek Gordon Murray , Chris Olah , Mike Schuster , Jonathon Shlens , Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul A. Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda B. Vi\u00e9gas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: Large-scale machine learning on heterogeneous distributed systems. CoRR abs\/1603.04467. Mart\u00edn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Gregory S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian J. Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal J\u00f3zefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Man\u00e9, Rajat Monga, Sherry Moore, Derek Gordon Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul A. Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda B. Vi\u00e9gas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: Large-scale machine learning on heterogeneous distributed systems. CoRR abs\/1603.04467."},{"key":"e_1_2_1_3_1","unstructured":"Reza Abbasi-Asl and Bin Yu. 2017. Interpreting convolutional neural networks through compression. CoRR abs\/1711.02329.  Reza Abbasi-Asl and Bin Yu. 2017. Interpreting convolutional neural networks through compression. CoRR abs\/1711.02329."},{"key":"e_1_2_1_4_1","unstructured":"American Information Technology Laboratory 2020. National Vulnerability Database. American Information Technology Laboratory. Retrieved from https:\/\/nvd.nist.gov\/.  American Information Technology Laboratory 2020. National Vulnerability Database. American Information Technology Laboratory. Retrieved from https:\/\/nvd.nist.gov\/."},{"key":"e_1_2_1_5_1","unstructured":"American Information Technology Laboratory 2020. Software Assurance Reference Dataset. American Information Technology Laboratory. Retrieved from https:\/\/samate.nist.gov\/SRD\/.  American Information Technology Laboratory 2020. Software Assurance Reference Dataset. American Information Technology Laboratory. Retrieved from https:\/\/samate.nist.gov\/SRD\/."},{"key":"e_1_2_1_6_1","unstructured":"Osbert Bastani Carolyn Kim and Hamsa Bastani. 2017. Interpreting blackbox models via model extraction. CoRR abs\/1705.08504.  Osbert Bastani Carolyn Kim and Hamsa Bastani. 2017. Interpreting blackbox models via model extraction. CoRR abs\/1705.08504."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.354"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00014"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","author":"Chen Jianbo","unstructured":"Jianbo Chen , Le Song , Martin J. Wainwright , and Michael I. Jordan . 2018. Learning to explain: An information-theoretic perspective on model interpretation . In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918) . 882--891. Retrieved from http:\/\/proceedings.mlr.press\/v80\/chen18j.html. Jianbo Chen, Le Song, Martin J. Wainwright, and Michael I. Jordan. 2018. Learning to explain: An information-theoretic perspective on model interpretation. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918). 882--891. Retrieved from http:\/\/proceedings.mlr.press\/v80\/chen18j.html."},{"key":"e_1_2_1_10_1","unstructured":"Fran\u00e7ois Chollet et\u00a0al. 2015. Keras. Retrieved from https:\/\/keras.io.  Fran\u00e7ois Chollet et\u00a0al. 2015. Keras. Retrieved from https:\/\/keras.io."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220063"},{"key":"e_1_2_1_12_1","volume-title":"Shavlik","author":"Craven Mark W.","year":"1995","unstructured":"Mark W. Craven and Jude W . Shavlik . 1995 . Extracting tree-structured representations of trained networks. In Advances in Neural Information Processing Systems, David S. Touretzky, Michael Mozer, and Michael E. Hasselmo (Eds.). MIT Press , 24--30. Retrieved from http:\/\/papers.nips.cc\/paper\/1152-extracting-tree-structured-representations-of-trained-networks. Mark W. Craven and Jude W. Shavlik. 1995. Extracting tree-structured representations of trained networks. In Advances in Neural Information Processing Systems, David S. Touretzky, Michael Mozer, and Michael E. Hasselmo (Eds.). MIT Press, 24--30. Retrieved from http:\/\/papers.nips.cc\/paper\/1152-extracting-tree-structured-representations-of-trained-networks."},{"key":"e_1_2_1_13_1","volume-title":"Truyen Tran, John Grundy, Aditya Ghose, Taeksu Kim, and Chul-Joo Kim.","author":"Dam Hoa Khanh","year":"2018","unstructured":"Hoa Khanh Dam , Trang Pham , Shien Wee Ng , Truyen Tran, John Grundy, Aditya Ghose, Taeksu Kim, and Chul-Joo Kim. 2018 . A deep tree-based model for software defect prediction. Retrieved from http:\/\/arxiv.org\/abs\/1802.00921. Hoa Khanh Dam, Trang Pham, Shien Wee Ng, Truyen Tran, John Grundy, Aditya Ghose, Taeksu Kim, and Chul-Joo Kim. 2018. A deep tree-based model for software defect prediction. Retrieved from http:\/\/arxiv.org\/abs\/1802.00921."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201918)","author":"Dhurandhar Amit","unstructured":"Amit Dhurandhar , Karthikeyan Shanmugam , Ronny Luss , and Peder A. Olsen . 2018. Improving simple models with confidence profiles . In Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201918) . 10317--10327. Retrieved from http:\/\/papers.nips.cc\/paper\/8231-improving-simple-models-with-confidence-profiles. Amit Dhurandhar, Karthikeyan Shanmugam, Ronny Luss, and Peder A. Olsen. 2018. Improving simple models with confidence profiles. In Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201918). 10317--10327. Retrieved from http:\/\/papers.nips.cc\/paper\/8231-improving-simple-models-with-confidence-profiles."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/648"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)","author":"Ruth","year":"2017","unstructured":"Ruth C. Fong and Andrea Vedaldi. 2017. Interpretable explanations of black boxes by meaningful perturbation . In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917) . IEEE, 3449--3457. DOI:https:\/\/doi.org\/10.1109\/ICCV. 2017 .371 10.1109\/ICCV.2017.371 Ruth C. Fong and Andrea Vedaldi. 2017. Interpretable explanations of black boxes by meaningful perturbation. In Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917). IEEE, 3449--3457. DOI:https:\/\/doi.org\/10.1109\/ICCV.2017.371"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 1st International Workshop on Comprehensibility and Explanation in AI and ML with the 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA\u201917)","author":"Frosst Nicholas","year":"2071","unstructured":"Nicholas Frosst and Geoffrey E. Hinton . 2017. Distilling a neural network into a soft decision tree . In Proceedings of the 1st International Workshop on Comprehensibility and Explanation in AI and ML with the 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA\u201917) . Retrieved from http:\/\/ceur-ws.org\/Vol- 2071 \/CExAIIA_2017_paper_3.pdf. Nicholas Frosst and Geoffrey E. Hinton. 2017. Distilling a neural network into a soft decision tree. In Proceedings of the 1st International Workshop on Comprehensibility and Explanation in AI and ML with the 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA\u201917). Retrieved from http:\/\/ceur-ws.org\/Vol-2071\/CExAIIA_2017_paper_3.pdf."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897"},{"key":"e_1_2_1_19_1","unstructured":"Riccardo Guidotti Anna Monreale Salvatore Ruggieri Dino Pedreschi Franco Turini and Fosca Giannotti. 2018. Local rule-based explanations of black box decision systems. CoRR abs\/1805.10820.  Riccardo Guidotti Anna Monreale Salvatore Ruggieri Dino Pedreschi Franco Turini and Fosca Giannotti. 2018. Local rule-based explanations of black box decision systems. CoRR abs\/1805.10820."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3243792"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-018-9941-6"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Mahdi Hajiaghayi and Ehsan Vahedi. 2018. Code failure prediction and pattern extraction using LSTM networks. CoRR abs\/1812.05237.  Mahdi Hajiaghayi and Ehsan Vahedi. 2018. Code failure prediction and pattern extraction using LSTM networks. CoRR abs\/1812.05237.","DOI":"10.1109\/BigDataService.2019.00014"},{"key":"e_1_2_1_23_1","unstructured":"Bo-Jian Hou and Zhi-Hua Zhou. 2018. Learning with interpretable structure from RNN. CoRR abs\/1810.10708.  Bo-Jian Hou and Zhi-Hua Zhou. 2018. Learning with interpretable structure from RNN. CoRR abs\/1810.10708."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1082"},{"key":"e_1_2_1_25_1","unstructured":"Jiwei Li Will Monroe and Dan Jurafsky. 2016. Understanding neural networks through representation erasure. CoRR abs\/1612.08220.  Jiwei Li Will Monroe and Dan Jurafsky. 2016. Understanding neural networks through representation erasure. CoRR abs\/1612.08220."},{"key":"e_1_2_1_26_1","unstructured":"Zhen Li Deqing Zou Shouhuai Xu Hai Jin Yawei Zhu Zhaoxuan Chen Sujuan Wang and Jialai Wang. 2018. SySeVR: A framework for using deep learning to detect software vulnerabilities. Retrieved from http:\/\/arxiv.org\/abs\/1807.06756.  Zhen Li Deqing Zou Shouhuai Xu Hai Jin Yawei Zhu Zhaoxuan Chen Sujuan Wang and Jialai Wang. 2018. SySeVR: A framework for using deep learning to detect software vulnerabilities. Retrieved from http:\/\/arxiv.org\/abs\/1807.06756."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2018.23158"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3138840"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3586--3593","author":"Liu Lingqiao","year":"2012","unstructured":"Lingqiao Liu and Lei Wang . 2012 . What has my classifier learned? visualizing the classification rules of bag-of-feature model by support region detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3586--3593 . DOI:https:\/\/doi.org\/10.1109\/CVPR.2012.6248103 10.1109\/CVPR.2012.6248103 Lingqiao Liu and Lei Wang. 2012. What has my classifier learned? visualizing the classification rules of bag-of-feature model by support region detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3586--3593. DOI:https:\/\/doi.org\/10.1109\/CVPR.2012.6248103"},{"key":"e_1_2_1_30_1","unstructured":"Scott M. Lundberg Gabriel G. Erion and Su-In Lee. 2018. Consistent individualized feature attribution for tree ensembles. Retrieved from http:\/\/arxiv.org\/abs\/1802.03888.  Scott M. Lundberg Gabriel G. Erion and Su-In Lee. 2018. Consistent individualized feature attribution for tree ensembles. Retrieved from http:\/\/arxiv.org\/abs\/1802.03888."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems. 4765--4774","author":"Scott","unstructured":"Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions . In Proceedings of the Annual Conference on Neural Information Processing Systems. 4765--4774 . Retrieved from http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions. Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the Annual Conference on Neural Information Processing Systems. 4765--4774. Retrieved from http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116251"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI\u201919)","author":"Real Esteban","unstructured":"Esteban Real , Alok Aggarwal , Yanping Huang , and Quoc V. Le . 2019. Regularized evolution for image classifier architecture search . In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI\u201919) . 4780--4789. DOI:https:\/\/doi.org\/10.1609\/aaai.v33i01.33014780 10.1609\/aaai.v33i01.33014780 Esteban Real, Alok Aggarwal, Yanping Huang, and Quoc V. Le. 2019. Regularized evolution for image classifier architecture search. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI\u201919). 4780--4789. DOI:https:\/\/doi.org\/10.1609\/aaai.v33i01.33014780"},{"key":"e_1_2_1_34_1","volume-title":"Speech understanding systems: A summary of results of the five-year research effort. Department of Computer Science","author":"\u00a0al D. Raj Reddy","year":"1977","unstructured":"D. Raj Reddy et \u00a0al . 1977. Speech understanding systems: A summary of results of the five-year research effort. Department of Computer Science , Camegie-Mell University , Pittsburgh, PA ( 1977 ). Retrieved from https:\/\/kilthub.cmu.edu\/ndownloader\/files\/12101960. D. Raj Reddy et\u00a0al. 1977. Speech understanding systems: A summary of results of the five-year research effort. Department of Computer Science, Camegie-Mell University, Pittsburgh, PA (1977). Retrieved from https:\/\/kilthub.cmu.edu\/ndownloader\/files\/12101960."},{"key":"e_1_2_1_35_1","unstructured":"Marco T\u00falio Ribeiro Sameer Singh and Carlos Guestrin. 2016. Nothing else matters: Model-agnostic explanations by identifying prediction invariance. CoRR abs\/1611.05817.  Marco T\u00falio Ribeiro Sameer Singh and Carlos Guestrin. 2016. Nothing else matters: Model-agnostic explanations by identifying prediction invariance. CoRR abs\/1611.05817."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_37_1","volume-title":"Human and Machine Learning\u2014Visible, Explainable, Trustworthy and Transparent","author":"Robnik-Sikonja Marko","unstructured":"Marko Robnik-Sikonja and Marko Bohanec . 2018. Perturbation-based explanations of prediction models . In Human and Machine Learning\u2014Visible, Explainable, Trustworthy and Transparent . Springer , Berlin , 159--175. DOI:https:\/\/doi.org\/10.1007\/978-3-319-90403-0_9 10.1007\/978-3-319-90403-0_9 Marko Robnik-Sikonja and Marko Bohanec. 2018. Perturbation-based explanations of prediction models. In Human and Machine Learning\u2014Visible, Explainable, Trustworthy and Transparent. Springer, Berlin, 159--175. DOI:https:\/\/doi.org\/10.1007\/978-3-319-90403-0_9"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2007.190734"},{"key":"e_1_2_1_39_1","volume-title":"Automated program repair: A step towards software automation. Sci. China Info. Sci. 62, 10","author":"Roychoudhury Abhik","year":"2019","unstructured":"Abhik Roychoudhury and Yingfei Xiong . 2019. Automated program repair: A step towards software automation. Sci. China Info. Sci. 62, 10 ( 2019 ), 200103:1\u2013200103:3. DOI:https:\/\/doi.org\/10.1007\/s11432-019-9947-6 10.1007\/s11432-019-9947-6 Abhik Roychoudhury and Yingfei Xiong. 2019. Automated program repair: A step towards software automation. Sci. China Info. Sci. 62, 10 (2019), 200103:1\u2013200103:3. DOI:https:\/\/doi.org\/10.1007\/s11432-019-9947-6"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 17th IEEE International Conference on Machine Learning and Applications (ICMLA\u201918)","author":"Russell Rebecca L.","year":"2018","unstructured":"Rebecca L. Russell , Louis Y. Kim , Lei H. Hamilton , Tomo Lazovich , Jacob Harer , Onur Ozdemir , Paul M. Ellingwood , and Marc W . McConley. 2018. Automated vulnerability detection in source code using deep representation learning . In Proceedings of the 17th IEEE International Conference on Machine Learning and Applications (ICMLA\u201918) . 757--762. DOI:https:\/\/doi.org\/10.1109\/ICMLA. 2018 .00120 10.1109\/ICMLA.2018.00120 Rebecca L. Russell, Louis Y. Kim, Lei H. Hamilton, Tomo Lazovich, Jacob Harer, Onur Ozdemir, Paul M. Ellingwood, and Marc W. McConley. 2018. Automated vulnerability detection in source code using deep representation learning. In Proceedings of the 17th IEEE International Conference on Machine Learning and Applications (ICMLA\u201918). 757--762. DOI:https:\/\/doi.org\/10.1109\/ICMLA.2018.00120"},{"key":"e_1_2_1_41_1","volume-title":"Mastering the game of go without human knowledge. Nature 550, 7676","author":"Silver David","year":"2017","unstructured":"David Silver , Julian Schrittwieser , Karen Simonyan , Ioannis Antonoglou , Aja Huang , Arthur Guez , Thomas Hubert , Lucas Baker , Matthew Lai , and Adrian Bolton . 2017. Mastering the game of go without human knowledge. Nature 550, 7676 ( 2017 ), 354--359. DOI:https:\/\/doi.org\/10.1038\/nature24270 10.1038\/nature24270 David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, and Adrian Bolton. 2017. Mastering the game of go without human knowledge. Nature 550, 7676 (2017), 354--359. DOI:https:\/\/doi.org\/10.1038\/nature24270"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914)","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2014 . Deep inside convolutional networks: Visualising image classification models and saliency maps . In Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914) . Retrieved from http:\/\/arxiv.org\/abs\/1312.6034. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Deep inside convolutional networks: Visualising image classification models and saliency maps. In Proceedings of the 2nd International Conference on Learning Representations (ICLR\u201914). Retrieved from http:\/\/arxiv.org\/abs\/1312.6034."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2865044"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915)","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron C. Courville , Ruslan Salakhutdinov , Richard S. Zemel , and Yoshua Bengio . 2015 . Show, attend and tell: Neural image caption generation with visual attention . In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915) . 2048--2057. Retrieved from http:\/\/proceedings.mlr.press\/v37\/xuc15.html. Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron C. Courville, Ruslan Salakhutdinov, Richard S. Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In Proceedings of the 32nd International Conference on Machine Learning (ICML\u201915). 2048--2057. Retrieved from http:\/\/proceedings.mlr.press\/v37\/xuc15.html."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2435349.2435366"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CNS.2014.6997494"},{"key":"e_1_2_1_47_1","first-page":"16","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480--1489","author":"Yang Zichao","year":"1865","unstructured":"Zichao Yang , Diyi Yang , Chris Dyer , Xiaodong He , Alexander J. Smola , and Eduard H. Hovy . 2016. Hierarchical attention networks for document classification . In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480--1489 . DOI:https:\/\/doi.org\/10. 1865 3\/v1\/n 16 - 1174 10.18653\/v1 Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alexander J. Smola, and Eduard H. Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480--1489. DOI:https:\/\/doi.org\/10.18653\/v1\/n16-1174"},{"key":"e_1_2_1_48_1","unstructured":"Noam Yefet Uri Alon and Eran Yahav. 2019. Adversarial examples for models of code. Retrieved from http:\/\/arxiv.org\/abs\/1910.07517.  Noam Yefet Uri Alon and Eran Yahav. 2019. Adversarial examples for models of code. Retrieved from http:\/\/arxiv.org\/abs\/1910.07517."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 13th European Conference on Computer Vision (ECCV\u201914)","author":"Matthew","unstructured":"Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and understanding convolutional networks . In Proceedings of the 13th European Conference on Computer Vision (ECCV\u201914) . 818--833. DOI:https:\/\/doi.org\/10.1007\/978-3-319-10590-1_53 10.1007\/978-3-319-10590-1_53 Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and understanding convolutional networks. In Proceedings of the 13th European Conference on Computer Vision (ECCV\u201914). 818--833. DOI:https:\/\/doi.org\/10.1007\/978-3-319-10590-1_53"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5469"},{"key":"e_1_2_1_51_1","volume-title":"Ying Nian Wu, and Song-Chun Zhu","author":"Zhang Quanshi","year":"2018","unstructured":"Quanshi Zhang , Yu Yang , Ying Nian Wu, and Song-Chun Zhu . 2018 . Interpreting CNNs via decision trees. CoRR abs\/1802.00121. Quanshi Zhang, Yu Yang, Ying Nian Wu, and Song-Chun Zhu. 2018. Interpreting CNNs via decision trees. CoRR abs\/1802.00121."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.319"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201919)","author":"Zhou Yaqin","year":"2019","unstructured":"Yaqin Zhou , Shangqing Liu , Jingkai Siow , Xiaoning Du , and Yang Liu . 2019 . Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks . In Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201919) . 10197--10207. Yaqin Zhou, Shangqing Liu, Jingkai Siow, Xiaoning Du, and Yang Liu. 2019. Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS\u201919). 10197--10207."},{"key":"e_1_2_1_54_1","volume-title":"VulDeePecker: A deep learning-based system for multiclass vulnerability detection","author":"Zou Deqing","year":"2019","unstructured":"Deqing Zou , Sujuan Wang , Shouhuai Xu , Zhen Li , and Hai Jin . 2019. VulDeePecker: A deep learning-based system for multiclass vulnerability detection . IEEE Trans. Depend. Secure Comput . ( 2019 ). DOI:https:\/\/doi.org\/10.1109\/TDSC.2019.2942930 10.1109\/TDSC.2019.2942930 Deqing Zou, Sujuan Wang, Shouhuai Xu, Zhen Li, and Hai Jin. 2019. VulDeePecker: A deep learning-based system for multiclass vulnerability detection. IEEE Trans. Depend. Secure Comput. (2019). DOI:https:\/\/doi.org\/10.1109\/TDSC.2019.2942930"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429444","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3429444","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:03Z","timestamp":1750193283000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429444"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,10]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3429444"],"URL":"https:\/\/doi.org\/10.1145\/3429444","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,10]]},"assertion":[{"value":"2020-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}