{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:48:18Z","timestamp":1791913698788,"version":"4.3.4"},"publisher-location":"New York, NY, USA","reference-count":16,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3558489.3559072","type":"proceedings-article","created":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T15:08:53Z","timestamp":1668006533000},"page":"62-71","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":137,"title":["Assessing the quality of GitHub copilot\u2019s code generation"],"prefix":"10.1145","author":[{"given":"Burak","family":"Yetistiren","sequence":"first","affiliation":[{"name":"Bilkent University, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isik","family":"Ozsoy","sequence":"additional","affiliation":[{"name":"Bilkent University, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eray","family":"Tuzun","sequence":"additional","affiliation":[{"name":"Bilkent University, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Matt Asay. 2021. GitHub copilot isn\u2019t changing the future. https:\/\/www.infoworld.com\/article\/3625517\/github-copilot-isnt-changing-the-future.html"},{"key":"e_1_3_2_1_2_1","unstructured":"Scott Carey. 2021. Developers react to github copilot. https:\/\/www.infoworld.com\/article\/3624688\/developers-react-to-github-copilot.html"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such Dave Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William Hebgen Guss Alex Nichol Alex Paino Nikolas Tezak Jie Tang Igor Babuschkin Suchir Balaji Shantanu Jain William Saunders Christopher Hesse Andrew N. Carr Jan Leike Josh Achiam Vedant Misra Evan Morikawa Alec Radford Matthew Knight Miles Brundage Mira Murati Katie Mayer Peter Welinder Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever and Wojciech Zaremba. 2021. Evaluating Large Language Models Trained on Code. https:\/\/doi.org\/10.48550\/ARXIV.2107.03374","DOI":"10.48550\/ARXIV.2107.03374"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2021.3133805"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","unstructured":"Shirley Anugrah Hayati Raphael Olivier Pravalika Avvaru Pengcheng Yin Anthony Tomasic and Graham Neubig. 2018. Retrieval-Based Neural Code Generation. https:\/\/doi.org\/10.48550\/ARXIV.1808.10025","DOI":"10.48550\/ARXIV.1808.10025"},{"key":"e_1_3_2_1_6_1","unstructured":"JetBrains. 2022. GitHub copilot - intellij IDES plugin: Marketplace. https:\/\/plugins.jetbrains.com\/plugin\/17718-github-copilot"},{"key":"e_1_3_2_1_7_1","unstructured":"Renato Losio. 2021. GitHub previews copilot an openai-powered coding assistant. https:\/\/www.infoq.com\/news\/2021\/07\/github-copilot-pair-programmming\/"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09968-2"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528470"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","unstructured":"Hammond Pearce Baleegh Ahmad Benjamin Tan Brendan Dolan-Gavitt and Ramesh Karri. 2021. Asleep at the Keyboard? Assessing the Security of GitHub Copilot\u2019s Code Contributions. https:\/\/doi.org\/10.48550\/ARXIV.2108.09293","DOI":"10.48550\/ARXIV.2108.09293"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512290.3528700"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6430"},{"key":"e_1_3_2_1_13_1","unstructured":"Darryl K. Taft. 2021. GitHub copilot: A powerful controversial autocomplete for developers. https:\/\/thenewstack.io\/github-copilot-a-powerful-controversial-autocomplete-for-developers\/"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3487569"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","unstructured":"Maosheng Zhong Gen Liu Hongwei Li Jiangling Kuang Jinshan Zeng and Mingwen Wang. 2022. CodeGen-Test: An Automatic Code Generation Model Integrating Program Test Information. https:\/\/doi.org\/10.48550\/ARXIV.2202.07612","DOI":"10.48550\/ARXIV.2202.07612"}],"event":{"name":"PROMISE '22: 18th International Conference on Predictive Models and Data Analytics in Software Engineering","location":"Singapore Singapore","acronym":"PROMISE '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","NUS NUS"]},"container-title":["Proceedings of the 18th International Conference on Predictive Models and Data Analytics in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3558489.3559072","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3558489.3559072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T12:47:08Z","timestamp":1750164428000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3558489.3559072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":16,"alternative-id":["10.1145\/3558489.3559072","10.1145\/3558489"],"URL":"https:\/\/doi.org\/10.1145\/3558489.3559072","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}