{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T16:40:44Z","timestamp":1783096844444,"version":"3.54.6"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T00:00:00Z","timestamp":1629244800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,20]]},"DOI":"10.1145\/3468264.3468539","type":"proceedings-article","created":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T01:44:18Z","timestamp":1629337458000},"page":"441-452","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":34,"title":["Understanding neural code intelligence through program simplification"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5575-0528","authenticated-orcid":false,"given":"Md Rafiqul Islam","family":"Rabin","sequence":"first","affiliation":[{"name":"University of Houston, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent J.","family":"Hellendoorn","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Amin","family":"Alipour","sequence":"additional","affiliation":[{"name":"University of Houston, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,8,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970361"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_3_2_1_3_1","volume-title":"International Conference on Learning Representations","author":"Allamanis M.","year":"2018","unstructured":"Allamanis , M. , Brockschmidt , M. , and Khademi , M . Learning to represent programs with graphs . In International Conference on Learning Representations ( 2018 ). Allamanis, M., Brockschmidt, M., and Khademi, M. Learning to represent programs with graphs. In International Conference on Learning Representations (2018)."},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the 33nd International Conference on Machine Learning, ICML","author":"Allamanis M.","year":"2016","unstructured":"Allamanis , M. , Peng , H. , and Sutton , C. A . A convolutional attention network for extreme summarization of source code . In Proceedings of the 33nd International Conference on Machine Learning, ICML ( 2016 ). Allamanis, M., Peng, H., and Sutton, C. A. A convolutional attention network for extreme summarization of source code. In Proceedings of the 33nd International Conference on Machine Learning, ICML (2016)."},{"key":"e_1_3_2_1_5_1","volume-title":"International Conference on Learning Representations","author":"Alon U.","year":"2019","unstructured":"Alon , U. , Levy , O. , and Yahav , E . code2seq: Generating sequences from structured representations of code . In International Conference on Learning Representations ( 2019 ). Alon, U., Levy, O., and Yahav, E. code2seq: Generating sequences from structured representations of code. In International Conference on Learning Representations (2019)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290353"},{"key":"e_1_3_2_1_7_1","unstructured":"Balduzzi D. Frean M. Leary L. Lewis J. P. Ma K. W.-D. and \n      McWilliams B.\n  The shattered gradients problem: If resnets are the answer then what is the question? In Proceedings of the 34th International Conference on Machine Learning\n   (\n  International Convention Centre Sydney Australia 06\u201311 Aug \n  2017\n  ) D. Precup and Y. W. Teh Eds. vol. \n  70\n   of \n  Proceedings of Machine Learning Research PMLR pp. 342\u2013\n  350\n  .  Balduzzi D. Frean M. Leary L. Lewis J. P. Ma K. W.-D. and McWilliams B. The shattered gradients problem: If resnets are the answer then what is the question? In Proceedings of the 34th International Conference on Machine Learning (International Convention Centre Sydney Australia 06\u201311 Aug 2017) D. Precup and Y. W. Teh Eds. vol. 70 of Proceedings of Machine Learning Research PMLR pp. 342\u2013350."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Bielik P.","year":"2020","unstructured":"Bielik , P. , and Vechev , M . Adversarial robustness for code . Proceedings of the International Conference on Machine Learning (ICML) ( 2020 ). Bielik, P., and Vechev, M. Adversarial robustness for code. Proceedings of the International Conference on Machine Learning (ICML) (2020)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00014"},{"key":"e_1_3_2_1_10_1","first-page":"57","volume-title":"Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (S&P)","author":"Carlini N.","year":"2017","unstructured":"Carlini , N. , and Wagner , D . Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (S&P) ( 2017 ), IEEE , pp. 39\u2013 57 . Carlini, N., and Wagner, D. Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (S&P) (2017), IEEE, pp. 39\u201357."},{"key":"e_1_3_2_1_11_1","volume-title":"3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings","author":"Goodfellow I. J.","year":"2015","unstructured":"Goodfellow , I. J. , Shlens , J. , and Szegedy , C . Explaining and harnessing adversarial examples . In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings ( 2015 ), Y. Bengio and Y. LeCun, Eds. Goodfellow, I. J., Shlens, J., and Szegedy, C. Explaining and harnessing adversarial examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings (2015), Y. Bengio and Y. LeCun, Eds."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.37"},{"key":"e_1_3_2_1_13_1","first-page":"1","article-title":"Cause reduction: delta debugging, even without bugs","volume":"26","author":"Groce A.","year":"2016","unstructured":"Groce , A. , Alipour , M. A. , Zhang , C. , Chen , Y. , and Regehr , J . Cause reduction: delta debugging, even without bugs . Softw. Test. Verification Reliab. 26 , 1 ( 2016 ), 40\u201368. Groce, A., Alipour, M. A., Zhang, C., Chen, Y., and Regehr, J. Cause reduction: delta debugging, even without bugs. Softw. Test. Verification Reliab. 26, 1 (2016), 40\u201368.","journal-title":"Softw. Test. Verification Reliab."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950334"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236051"},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Learning Representations","author":"Hellendoorn V. J.","year":"2020","unstructured":"Hellendoorn , V. J. , Sutton , C. , Singh , R. , Maniatis , P. , and Bieber , D . Global relational models of source code . In International Conference on Learning Representations ( 2020 ). Hellendoorn, V. J., Sutton, C., Singh, R., Maniatis, P., and Bieber, D. Global relational models of source code. In International Conference on Learning Representations (2020)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"e_1_3_2_1_18_1","volume-title":"Multilayer feedforward networks are universal approximators. Neural networks 2, 5","author":"Hornik K.","year":"1989","unstructured":"Hornik , K. , Stinchcombe , M. , and White , H . Multilayer feedforward networks are universal approximators. Neural networks 2, 5 ( 1989 ), 359\u2013366. Hornik, K., Stinchcombe, M., and White, H. Multilayer feedforward networks are universal approximators. Neural networks 2, 5 (1989), 359\u2013366."},{"key":"e_1_3_2_1_19_1","first-page":"136","volume-title":"Advances in Neural Information Processing Systems","author":"Ilyas A.","year":"2019","unstructured":"Ilyas , A. , Santurkar , S. , Tsipras , D. , Engstrom , L. , Tran , B. , and Madry , A . Adversarial examples are not bugs, they are features . In Advances in Neural Information Processing Systems ( 2019 ), pp. 125\u2013 136 . Ilyas, A., Santurkar, S., Tsipras, D., Engstrom, L., Tran, B., and Madry, A. Adversarial examples are not bugs, they are features. In Advances in Neural Information Processing Systems (2019), pp. 125\u2013136."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6311"},{"key":"e_1_3_2_1_21_1","volume-title":"Pre-trained contextual embedding of source code. arXiv preprint arXiv:2001.00059","author":"Kanade A.","year":"2019","unstructured":"Kanade , A. , Maniatis , P. , Balakrishnan , G. , and Shi , K . Pre-trained contextual embedding of source code. arXiv preprint arXiv:2001.00059 ( 2019 ). Kanade, A., Maniatis, P., Balakrishnan, G., and Shi, K. Pre-trained contextual embedding of source code. arXiv preprint arXiv:2001.00059 (2019)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387491"},{"key":"e_1_3_2_1_23_1","volume-title":"Deep learning. nature 521, 7553","author":"LeCun Y.","year":"2015","unstructured":"LeCun , Y. , Bengio , Y. , and Hinton , G . Deep learning. nature 521, 7553 ( 2015 ), 436. LeCun, Y., Bengio, Y., and Hinton, G. Deep learning. nature 521, 7553 (2015), 436."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1900654116"},{"key":"e_1_3_2_1_25_1","volume-title":"On the generalizability of neural program models with respect to semantic-preserving program transformations. Information and Software Technology","author":"Rabin M. R. I.","year":"2021","unstructured":"Rabin , M. R. I. , Bui , N. D. , Wang , K. , Yu , Y. , Jiang , L. , and Alipour , M. A . On the generalizability of neural program models with respect to semantic-preserving program transformations. Information and Software Technology ( 2021 ), 106552. Rabin, M. R. I., Bui, N. D., Wang, K., Yu, Y., Jiang, L., and Alipour, M. A. On the generalizability of neural program models with respect to semantic-preserving program transformations. Information and Software Technology (2021), 106552."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3416506.3423580"},{"key":"e_1_3_2_1_27_1","volume-title":"34th IEEE\/ACM International Conference on Automated Software Engineering (Late Breaking Results-Track)","author":"Rabin M. R. I.","year":"2019","unstructured":"Rabin , M. R. I. , Wang , K. , and Alipour , M. A . Testing neural program analyzers . 34th IEEE\/ACM International Conference on Automated Software Engineering (Late Breaking Results-Track) ( 2019 ). Rabin, M. R. I., Wang, K., and Alipour, M. A. Testing neural program analyzers. 34th IEEE\/ACM International Conference on Automated Software Engineering (Late Breaking Results-Track) (2019)."},{"key":"e_1_3_2_1_28_1","volume-title":"Semantic robustness of models of source code. arXiv preprint arXiv:2002.03043","author":"Ramakrishnan G.","year":"2020","unstructured":"Ramakrishnan , G. , Henkel , J. , Wang , Z. , Albarghouthi , A. , Jha , S. , and Reps , T . Semantic robustness of models of source code. arXiv preprint arXiv:2002.03043 ( 2020 ). Ramakrishnan, G., Henkel, J., Wang, Z., Albarghouthi, A., Jha, S., and Reps, T. Semantic robustness of models of source code. arXiv preprint arXiv:2002.03043 (2020)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884848"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1103"},{"key":"e_1_3_2_1_31_1","volume-title":"-R. Toward interpretable machine learning: Transparent deep neural networks and beyond. arXiv preprint arXiv:2003.07631","author":"Samek W.","year":"2020","unstructured":"Samek , W. , Montavon , G. , Lapuschkin , S. , Anders , C. J. , and M\u00fcller , K . -R. Toward interpretable machine learning: Transparent deep neural networks and beyond. arXiv preprint arXiv:2003.07631 ( 2020 ). Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., and M\u00fcller, K.-R. Toward interpretable machine learning: Transparent deep neural networks and beyond. arXiv preprint arXiv:2003.07631 (2020)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_1_33_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan K.","year":"2013","unstructured":"Simonyan , K. , Vedaldi , A. , and Zisserman , A . Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 ( 2013 ). Simonyan, K., Vedaldi, A., and Zisserman, A. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_3_2_1_34_1","first-page":"3328","volume-title":"Proceedings of the 34th International Conference on Machine Learning","author":"Sundararajan M.","year":"2017","unstructured":"Sundararajan , M. , Taly , A. , and Yan , Q . Axiomatic attribution for deep networks . In Proceedings of the 34th International Conference on Machine Learning ( 2017 ), pp. 3319\u2013 3328 . Sundararajan, M., Taly, A., and Yan, Q. Axiomatic attribution for deep networks. In Proceedings of the 34th International Conference on Machine Learning (2017), pp. 3319\u20133328."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468545"},{"key":"e_1_3_2_1_36_1","volume-title":"International Conference on Learning Representations","author":"Vasic M.","year":"2019","unstructured":"Vasic , M. , Kanade , A. , Maniatis , P. , Bieber , D. , and singh, R. Neural program repair by jointly learning to localize and repair . In International Conference on Learning Representations ( 2019 ). Vasic, M., Kanade, A., Maniatis, P., Bieber, D., and singh, R. Neural program repair by jointly learning to localize and repair. In International Conference on Learning Representations (2019)."},{"key":"e_1_3_2_1_37_1","first-page":"6008","volume-title":"Advances in neural information processing systems","author":"Vaswani A.","year":"2017","unstructured":"Vaswani , A. , Shazeer , N. , Parmar , N. , Uszkoreit , J. , Jones , L. , Gomez , A. N. , Kaiser , \u0141., and Polosukhin , I . Attention is all you need . In Advances in neural information processing systems ( 2017 ), pp. 5998\u2013 6008 . Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141., and Polosukhin, I. Attention is all you need. In Advances in neural information processing systems (2017), pp. 5998\u20136008."},{"key":"e_1_3_2_1_38_1","volume-title":"Demystifying code summarization models. arXiv preprint arXiv:2102.04625","author":"Wang Y.","year":"2021","unstructured":"Wang , Y. , Gao , F. , and Wang , L . Demystifying code summarization models. arXiv preprint arXiv:2102.04625 ( 2021 ). Wang, Y., Gao, F., and Wang, L. Demystifying code summarization models. arXiv preprint arXiv:2102.04625 (2021)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/2820518.2820559"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988498"}],"event":{"name":"ESEC\/FSE '21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","location":"Athens Greece","acronym":"ESEC\/FSE '21","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3468264.3468539","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3468264.3468539","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:50Z","timestamp":1750195490000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3468264.3468539"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,18]]},"references-count":41,"alternative-id":["10.1145\/3468264.3468539","10.1145\/3468264"],"URL":"https:\/\/doi.org\/10.1145\/3468264.3468539","relation":{},"subject":[],"published":{"date-parts":[[2021,8,18]]},"assertion":[{"value":"2021-08-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}