{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T08:37:58Z","timestamp":1771576678969,"version":"3.50.1"},"reference-count":35,"publisher":"World Scientific Pub Co Pte Ltd","issue":"12","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61876018"],"award-info":[{"award-number":["61876018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1704309"],"award-info":[{"award-number":["1704309"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:p> In this paper, we propose a novel transformer-based deep neural network model to learn semantic bug patterns from a corpus of buggy\/fixed codes, then generate correct ones automatically. Transformer is a deep learning model relying entirely on attention mechanism to model global dependencies between input and output. Although there are a few endeavors to repair programs by learning neural language models (NLM), many special program properties, such as structure and semantics of an identifier, are not considered in embedding input sequence and designing model effectively, which results in undesired performance. <\/jats:p><jats:p> In the proposed Bug-Transformer, we design a novel context abstraction mechanism to better support neural language models. Specifically, it is capable of 1) compressing code information but preserving the key structure and semantics, which provides more thorough information for NLM models, 2) renaming identifiers and literals based on their lexical scopes, structural and semantic information, to reduce code vocabulary size and 3) reserving keywords and selected idioms (domain- or developer-specific vocabularies) for better understanding code structure and semantics. Hence, Bug-Transformer adequately embeds code structural and semantic information into input data and optimize attention-based transformer neural network to well handle code features in order to improve learning tasks for bug repair. <\/jats:p><jats:p> We evaluate the performance of the proposed work comprehensively on three datasets (Java code corpora) and generate patches to buggy code using a beam search decoder. The experimental results show that our proposed work outperforms the-state-of-art techniques: Bug-Transformer can successfully predict 54.81%, 34.45%, and 42.40% of the fixed code in these three datasets, respectively, which outperform the baseline models. These success rates steadily increase along with the increase of beam size. Besides, the overall syntactic correctness of all patches remains above 97%, 96%, and 50% on the three benchmarks, respectively, regardless of the beam size. <\/jats:p>","DOI":"10.1142\/s0218126622502103","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T10:27:36Z","timestamp":1652178456000},"source":"Crossref","is-referenced-by-count":5,"title":["Bug-Transformer: Automated Program Repair Using Attention-Based Deep Neural Network"],"prefix":"10.1142","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0533-6657","authenticated-orcid":false,"given":"Jie","family":"Yao","sequence":"first","affiliation":[{"name":"School of Software Engineering, Beijing Jiaotong University, Beijing, 100044, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bingbing","family":"Rao","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, 32816, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiwei","family":"Xing","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Beijing Jiaotong University, Beijing, 100044, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liqiang","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, 32816, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,5,9]]},"reference":[{"key":"S0218126622502103BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2021.108369"},{"key":"S0218126622502103BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3119921"},{"key":"S0218126622502103BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3113321"},{"key":"S0218126622502103BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3116132"},{"key":"S0218126622502103BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2020.3047606"},{"key":"S0218126622502103BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3128954"},{"key":"S0218126622502103BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3079574"},{"key":"S0218126622502103BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2015.2444238"},{"key":"S0218126622502103BIB009","author":"Tan L.","year":"2021","journal-title":"IEEE Consumer Electron. Mag."},{"key":"S0218126622502103BIB010","author":"Wang D.","year":"2021","journal-title":"IEEE Trans. Indust. Inform."},{"key":"S0218126622502103BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.011.2000223"},{"key":"S0218126622502103BIB012","doi-asserted-by":"publisher","DOI":"10.1145\/3105906"},{"key":"S0218126622502103BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2755013"},{"key":"S0218126622502103BIB014","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236032"},{"key":"S0218126622502103BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"S0218126622502103BIB016","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10742"},{"key":"S0218126622502103BIB017","first-page":"1943","volume":"47","author":"Chen Z.","year":"2019","journal-title":"IEEE Trans. Softw. Eng."},{"key":"S0218126622502103BIB018","doi-asserted-by":"publisher","DOI":"10.1145\/3340544"},{"key":"S0218126622502103BIB020","volume-title":"Principles of Program Analysis","author":"Nielson F.","year":"2015"},{"key":"S0218126622502103BIB021","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106290"},{"key":"S0218126622502103BIB023","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2804431"},{"key":"S0218126622502103BIB024","author":"Vaswani A.","year":"2017","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"S0218126622502103BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389261"},{"key":"S0218126622502103BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"S0218126622502103BIB029","series-title":"Virtual Event, Proceedings of Machine Learning Research","first-page":"11941","volume-title":"Proc. 38th Int. Conf. Machine Learning, ICML 2021","volume":"139","author":"Yasunaga M.","year":"2021"},{"key":"S0218126622502103BIB030","volume":"32","author":"M\u00fcller R.","year":"2019","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"S0218126622502103BIB031","doi-asserted-by":"publisher","DOI":"10.1145\/3183377.3183383"},{"key":"S0218126622502103BIB032","first-page":"23","volume":"12","author":"Gage P.","year":"1994","journal-title":"C Users J."},{"key":"S0218126622502103BIB033","volume-title":"Programming in Scala","author":"Odersky M.","year":"2008"},{"key":"S0218126622502103BIB035","first-page":"311","volume-title":"Proc. 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni K.","year":"2002"},{"key":"S0218126622502103BIB036","first-page":"31","volume":"18","author":"Brown P. F.","year":"1992","journal-title":"Comput. Linguist."},{"key":"S0218126622502103BIB037","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"S0218126622502103BIB038","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642982"},{"key":"S0218126622502103BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2019.00034"},{"key":"S0218126622502103BIB041","first-page":"177","volume-title":"Proc. 13th Conf. Association for Machine Translation in the Americas","volume":"1","author":"Klein G.","year":"2018"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126622502103","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,10]],"date-time":"2022-08-10T09:53:48Z","timestamp":1660125228000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126622502103"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,9]]},"references-count":35,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.1142\/S0218126622502103"],"URL":"https:\/\/doi.org\/10.1142\/s0218126622502103","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,9]]},"article-number":"2250210"}}