{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:45:51Z","timestamp":1777657551949,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,11,8]],"date-time":"2020-11-08T00:00:00Z","timestamp":1604793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,11,8]]},"DOI":"10.1145\/3368089.3417058","type":"proceedings-article","created":{"date-parts":[[2020,12,11]],"date-time":"2020-12-11T00:45:01Z","timestamp":1607647501000},"page":"1433-1443","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":354,"title":["IntelliCode compose: code generation using transformer"],"prefix":"10.1145","author":[{"given":"Alexey","family":"Svyatkovskiy","sequence":"first","affiliation":[{"name":"Microsoft, USA"}]},{"given":"Shao Kun","family":"Deng","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}]},{"given":"Shengyu","family":"Fu","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}]},{"given":"Neel","family":"Sundaresan","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,11,8]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Deep API learning. CoRR, abs\/1605.08535","author":"Gu Xiaodong","year":"2016","unstructured":"Xiaodong Gu , Hongyu Zhang , Dongmei Zhang , and Sunghun Kim . Deep API learning. CoRR, abs\/1605.08535 , 2016 . Xiaodong Gu, Hongyu Zhang, Dongmei Zhang, and Sunghun Kim. Deep API learning. CoRR, abs\/1605.08535, 2016."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180167"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884804"},{"key":"e_1_3_2_2_4_1","volume-title":"Program synthesis and semantic parsing with learned code idioms. CoRR, abs\/","author":"Shin Richard","year":"1906","unstructured":"Richard Shin , Miltiadis Allamanis , Marc Brockschmidt , and Oleksandr Polozov . Program synthesis and semantic parsing with learned code idioms. CoRR, abs\/ 1906 .10816, 2019. Richard Shin, Miltiadis Allamanis, Marc Brockschmidt, and Oleksandr Polozov. Program synthesis and semantic parsing with learned code idioms. CoRR, abs\/ 1906.10816, 2019."},{"key":"e_1_3_2_2_5_1","volume-title":"code2seq: Generating sequences from structured representations of code. CoRR, abs\/","author":"Alon Uri","year":"1808","unstructured":"Uri Alon , Omer Levy , and Eran Yahav . code2seq: Generating sequences from structured representations of code. CoRR, abs\/ 1808 .01400, 2018. Uri Alon, Omer Levy, and Eran Yahav. code2seq: Generating sequences from structured representations of code. CoRR, abs\/ 1808.01400, 2018."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1595696.1595728"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491458"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330699"},{"key":"e_1_3_2_2_10_1","volume-title":"Fast and memory-eficient neural code completion","author":"Svyatkovskiy Alexey","year":"2020","unstructured":"Alexey Svyatkovskiy , Sebastian Lee , Anna Hadjitofi , Maik Riechert , Juliana Franco , and Miltiadis Allamanis . Fast and memory-eficient neural code completion , 2020 . Alexey Svyatkovskiy, Sebastian Lee, Anna Hadjitofi, Maik Riechert, Juliana Franco, and Miltiadis Allamanis. Fast and memory-eficient neural code completion, 2020."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.29"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227136"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330571"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884841"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330723"},{"key":"e_1_3_2_2_16_1","volume-title":"Language models are unsupervised multitask learners","author":"Radford Alec","year":"2019","unstructured":"Alec Radford , Jef Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . Language models are unsupervised multitask learners . 2019 . Alec Radford, Jef Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. 2019."},{"key":"e_1_3_2_2_17_1","volume-title":"Ai-assisted development. https:\/\/marketplace. visualstudio.com\/items?itemName=VisualStudioExptTeam.VSIntelliCode. Visited","author":"Microsoft Corporation","year":"2020","unstructured":"Microsoft Corporation . Ai-assisted development. https:\/\/marketplace. visualstudio.com\/items?itemName=VisualStudioExptTeam.VSIntelliCode. Visited Jan 2020 . Microsoft Corporation. Ai-assisted development. https:\/\/marketplace. visualstudio.com\/items?itemName=VisualStudioExptTeam.VSIntelliCode. Visited Jan 2020."},{"key":"e_1_3_2_2_18_1","volume-title":"Attention is all you need","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , and Illia Polosukhin . Attention is all you need , 2017 . Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need, 2017."},{"key":"e_1_3_2_2_19_1","volume-title":"Improving language understanding by generative pre-training","author":"Radford Alec","year":"2018","unstructured":"Alec Radford . Improving language understanding by generative pre-training . 2018 . Alec Radford. Improving language understanding by generative pre-training. 2018."},{"key":"e_1_3_2_2_20_1","volume-title":"BERT: pretraining of deep bidirectional transformers for language understanding. CoRR, abs\/","author":"Devlin Jacob","year":"1810","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . BERT: pretraining of deep bidirectional transformers for language understanding. CoRR, abs\/ 1810 .04805, 2018. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: pretraining of deep bidirectional transformers for language understanding. CoRR, abs\/ 1810.04805, 2018."},{"key":"e_1_3_2_2_21_1","volume-title":"Xlnet: Generalized autoregressive pretraining for language understanding. CoRR, abs\/","author":"Yang Zhilin","year":"1906","unstructured":"Zhilin Yang , Zihang Dai , Yiming Yang , Jaime G. Carbonell , Ruslan Salakhutdinov , and Quoc V. Le . Xlnet: Generalized autoregressive pretraining for language understanding. CoRR, abs\/ 1906 .08237, 2019. Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. Xlnet: Generalized autoregressive pretraining for language understanding. CoRR, abs\/ 1906.08237, 2019."},{"key":"e_1_3_2_2_22_1","volume-title":"Roberta: A robustly optimized BERT pretraining approach. CoRR, abs\/","author":"Liu Yinhan","year":"1907","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . Roberta: A robustly optimized BERT pretraining approach. CoRR, abs\/ 1907 .11692, 2019. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. Roberta: A robustly optimized BERT pretraining approach. CoRR, abs\/ 1907.11692, 2019."},{"key":"e_1_3_2_2_23_1","volume-title":"Jamie Ryan Kiros, and Geofrey E. Hinton. Layer normalization","author":"Ba Jimmy Lei","year":"2016","unstructured":"Jimmy Lei Ba , Jamie Ryan Kiros, and Geofrey E. Hinton. Layer normalization , 2016 . Jimmy Lei Ba, Jamie Ryan Kiros, and Geofrey E. Hinton. Layer normalization, 2016."},{"key":"e_1_3_2_2_24_1","volume-title":"The evolved transformer. CoRR, abs\/","author":"So David R.","year":"1901","unstructured":"David R. So , Chen Liang , and Quoc V. Le . The evolved transformer. CoRR, abs\/ 1901 .11117, 2019. David R. So, Chen Liang, and Quoc V. Le. The evolved transformer. CoRR, abs\/ 1901.11117, 2019."},{"key":"e_1_3_2_2_25_1","volume-title":"Megatron-lm: Training multi-billion parameter language models using model parallelism","author":"Shoeybi Mohammad","year":"2019","unstructured":"Mohammad Shoeybi , Mostofa Patwary , Raul Puri , Patrick LeGresley , Jared Casper , and Bryan Catanzaro . Megatron-lm: Training multi-billion parameter language models using model parallelism , 2019 . Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. Megatron-lm: Training multi-billion parameter language models using model parallelism, 2019."},{"key":"e_1_3_2_2_26_1","volume-title":"Tying word vectors and word classifiers: A loss framework for language modeling. CoRR, abs\/1611.01462","author":"Inan Hakan","year":"2016","unstructured":"Hakan Inan , Khashayar Khosravi , and Richard Socher . Tying word vectors and word classifiers: A loss framework for language modeling. CoRR, abs\/1611.01462 , 2016 . Hakan Inan, Khashayar Khosravi, and Richard Socher. Tying word vectors and word classifiers: A loss framework for language modeling. CoRR, abs\/1611.01462, 2016."},{"key":"e_1_3_2_2_27_1","volume-title":"Autocompletion with deep learning. https:\/\/tabnine.com\/blog\/ deep\/. Visited","author":"Jackson Jacob","year":"2019","unstructured":"Jacob Jackson . Autocompletion with deep learning. https:\/\/tabnine.com\/blog\/ deep\/. Visited Sep 2019 . Jacob Jackson. Autocompletion with deep learning. https:\/\/tabnine.com\/blog\/ deep\/. Visited Sep 2019."},{"key":"e_1_3_2_2_28_1","volume-title":"Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv","author":"Sergeev Alexander","year":"1802","unstructured":"Alexander Sergeev and Mike Del Balso . Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv : 1802 .05799, 2018. Alexander Sergeev and Mike Del Balso. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv: 1802.05799, 2018."},{"key":"e_1_3_2_2_29_1","volume-title":"Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv e-prints","author":"Rafel Colin","year":"2019","unstructured":"Colin Rafel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J. Liu . Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv e-prints , 2019 . Colin Rafel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv e-prints, 2019."},{"key":"e_1_3_2_2_30_1","volume-title":"Ctrl: A conditional transformer language model for controllable generation","author":"Keskar Nitish Shirish","year":"2019","unstructured":"Nitish Shirish Keskar , Bryan McCann , Lav R. Varshney , Caiming Xiong , and Richard Socher . Ctrl: A conditional transformer language model for controllable generation , 2019 . Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, Caiming Xiong, and Richard Socher. Ctrl: A conditional transformer language model for controllable generation, 2019."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1098"},{"key":"e_1_3_2_2_32_1","volume-title":"Swag: A large-scale adversarial dataset for grounded commonsense inference","author":"Zellers Rowan","year":"2018","unstructured":"Rowan Zellers , Yonatan Bisk , Roy Schwartz , and Yejin Choi . Swag: A large-scale adversarial dataset for grounded commonsense inference , 2018 . Rowan Zellers, Yonatan Bisk, Roy Schwartz, and Yejin Choi. Swag: A large-scale adversarial dataset for grounded commonsense inference, 2018."},{"key":"e_1_3_2_2_33_1","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . ROUGE : A package for automatic evaluation of summaries . In Text Summarization Branches Out , pages 74 - 81 , Barcelona, Spain , July 2004 . Association for Computational Linguistics. Chin-Yew Lin. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out, pages 74-81, Barcelona, Spain, July 2004. Association for Computational Linguistics."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1219032"},{"key":"e_1_3_2_2_35_1","volume-title":"Huggingface's transformers: State-of-the-art natural language processing. ArXiv, abs\/","author":"Wolf Thomas","year":"1910","unstructured":"Thomas Wolf , Lysandre Debut , Victor Sanh , Julien Chaumond , Clement Delangue , Anthony Moi , Pierric Cistac , Tim Rault , R'emi Louf , Morgan Funtowicz , and Jamie Brew . Huggingface's transformers: State-of-the-art natural language processing. ArXiv, abs\/ 1910 .03771, 2019. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R'emi Louf, Morgan Funtowicz, and Jamie Brew. Huggingface's transformers: State-of-the-art natural language processing. ArXiv, abs\/ 1910.03771, 2019."},{"key":"e_1_3_2_2_36_1","unstructured":"Aaron Gokaslan and Vanya Cohen. Openwebtext corpus. http:\/\/Skylion007. github.io\/OpenWebTextCorpus 2019.  Aaron Gokaslan and Vanya Cohen. Openwebtext corpus. http:\/\/Skylion007. github.io\/OpenWebTextCorpus 2019."},{"key":"e_1_3_2_2_37_1","volume-title":"A survey of machine learning for big code and naturalness. CoRR, abs\/1709.06182","author":"Allamanis Miltiadis","year":"2017","unstructured":"Miltiadis Allamanis , Earl T. Barr , Premkumar T. Devanbu , and Charles A. Sutton . A survey of machine learning for big code and naturalness. CoRR, abs\/1709.06182 , 2017 . Miltiadis Allamanis, Earl T. Barr, Premkumar T. Devanbu, and Charles A. Sutton. A survey of machine learning for big code and naturalness. CoRR, abs\/1709.06182, 2017."},{"key":"e_1_3_2_2_38_1","volume-title":"Distilling the knowledge in a neural network","author":"Hinton Geofrey","year":"2015","unstructured":"Geofrey Hinton , Oriol Vinyals , and Jef Dean . Distilling the knowledge in a neural network , 2015 . Geofrey Hinton, Oriol Vinyals, and Jef Dean. Distilling the knowledge in a neural network, 2015."},{"key":"e_1_3_2_2_39_1","volume-title":"Distilling task-specific knowledge from bert into simple neural networks","author":"Tang Raphael","year":"2019","unstructured":"Raphael Tang , Yao Lu , Linqing Liu , Lili Mou , Olga Vechtomova , and Jimmy Lin . Distilling task-specific knowledge from bert into simple neural networks , 2019 . Raphael Tang, Yao Lu, Linqing Liu, Lili Mou, Olga Vechtomova, and Jimmy Lin. Distilling task-specific knowledge from bert into simple neural networks, 2019."},{"key":"e_1_3_2_2_40_1","volume-title":"a distilled version of bert: smaller, faster, cheaper and lighter","author":"Sanh Victor","year":"2019","unstructured":"Victor Sanh , Lysandre Debut , Julien Chaumond , and Thomas Wolf . Distilbert , a distilled version of bert: smaller, faster, cheaper and lighter , 2019 . Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter, 2019."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666356.2594321"},{"key":"e_1_3_2_2_42_1","volume-title":"Intelligent code completion with bayesian networks. ACM Transactions on Software Engineering and Methodology (TOSEM), 25 ( 1 ): 3","author":"Proksch Sebastian","year":"2015","unstructured":"Sebastian Proksch , Johannes Lerch , and Mira Mezini . Intelligent code completion with bayesian networks. ACM Transactions on Software Engineering and Methodology (TOSEM), 25 ( 1 ): 3 , 2015 . Sebastian Proksch, Johannes Lerch, and Mira Mezini. Intelligent code completion with bayesian networks. ACM Transactions on Software Engineering and Methodology (TOSEM), 25 ( 1 ): 3, 2015."},{"key":"e_1_3_2_2_43_1","volume-title":"www.eclipse.org\/recommenders. Visited","author":"Foundation Eclipse","year":"2017","unstructured":"Eclipse Foundation . Code Recommenders . www.eclipse.org\/recommenders. Visited June 2017 . Eclipse Foundation. Code Recommenders. www.eclipse.org\/recommenders. Visited June 2017."},{"key":"e_1_3_2_2_44_1","volume-title":"http:\/\/www.eclipse.org\/ recommenders\/manual\/#snipmatch","author":"Recommenders Eclipse","year":"2014","unstructured":"Eclipse Recommenders . Eclipse SnipMatch . http:\/\/www.eclipse.org\/ recommenders\/manual\/#snipmatch , 2014 . Visited Jun 2017. Eclipse Recommenders. Eclipse SnipMatch. http:\/\/www.eclipse.org\/ recommenders\/manual\/#snipmatch, 2014. Visited Jun 2017."}],"event":{"name":"ESEC\/FSE '20: 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","location":"Virtual Event USA","acronym":"ESEC\/FSE '20","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3368089.3417058","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3368089.3417058","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:58Z","timestamp":1750197718000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3368089.3417058"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,8]]},"references-count":44,"alternative-id":["10.1145\/3368089.3417058","10.1145\/3368089"],"URL":"https:\/\/doi.org\/10.1145\/3368089.3417058","relation":{},"subject":[],"published":{"date-parts":[[2020,11,8]]},"assertion":[{"value":"2020-11-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}