{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:25:33Z","timestamp":1776111933375,"version":"3.50.1"},"reference-count":29,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,2,22]],"date-time":"2024-02-22T00:00:00Z","timestamp":1708560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2024,3]]},"abstract":"<jats:p>Case study asks Copilot users about its impact on their productivity, and seeks to find their perceptions mirrored in user data.<\/jats:p>","DOI":"10.1145\/3633453","type":"journal-article","created":{"date-parts":[[2024,2,22]],"date-time":"2024-02-22T16:16:20Z","timestamp":1708618580000},"page":"54-63","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":76,"title":["Measuring GitHub Copilot's Impact on Productivity"],"prefix":"10.1145","volume":"67","author":[{"given":"Albert","family":"Ziegler","sequence":"first","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"Eirini","family":"Kalliamvakou","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"X. Alice","family":"Li","sequence":"additional","affiliation":[{"name":"GitHub, San Francisco, CA, USA"}]},{"given":"Andrew","family":"Rice","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"Devon","family":"Rifkin","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"Shawn","family":"Simister","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"Ganesh","family":"Sittampalam","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]},{"given":"Edward","family":"Aftandilian","sequence":"additional","affiliation":[{"name":"GitHub, Inc., San Francisco, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,2,22]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2016.39"},{"key":"e_1_2_2_2_1","unstructured":"Austin J. et al. Program synthesis with large language models. CoRR abs\/2108.07732 (2021); https:\/\/arxiv.org\/abs\/2108.07732"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP52600.2021.00022"},{"key":"e_1_2_2_4_1","first-page":"5","article-title":"Mind the gap: On the relationship between automatically measured and self-reported productivity","volume":"38","author":"Beller M.","year":"2020","unstructured":"Beller, M., Orgovan, V., Buja, S., and Zimmermann, T. Mind the gap: On the relationship between automatically measured and self-reported productivity. IEEE Software 38, 5 (2020), 24--31.","journal-title":"IEEE Software"},{"key":"e_1_2_2_5_1","unstructured":"Chen M. et al. Evaluating large language models trained on code. CoRR abs\/2107.03374 (2021); https:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3454122.3454124"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00101"},{"key":"e_1_2_2_8_1","unstructured":"Hendrycks D. et al. Measuring coding challenge competence with APPS. CoRR abs\/2105.09938 (2021); https:\/\/arxiv.org\/abs\/2105.09938"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2012.6227135"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-4221-6_2"},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of Advances in Neural Information Processing Systems 32","author":"Kulal S.","year":"2019","unstructured":"Kulal, S. et al. Spoc: Search-based pseudocode to code. In Proceedings of Advances in Neural Information Processing Systems 32, H.M. Wallach et al (eds), Dec. 2019, 11883--11894; https:\/\/bit.ly\/3H7YLtF"},{"key":"e_1_2_2_12_1","first-page":"5","article-title":"Today was a good day: The daily life of software developers","volume":"47","author":"Meyer A.N.","year":"2019","unstructured":"Meyer, A.N., Barr, E.T., Bird, C., and Zimmermann, T. Today was a good day: The daily life of software developers. IEEE Transactions on Software Engineering 47, 5 (2019), 863--880.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2656886"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635892"},{"key":"e_1_2_2_15_1","first-page":"3","article-title":"What predicts software developers' productivity?","volume":"47","author":"Murphy-Hill E.","year":"2019","unstructured":"Murphy-Hill, E. et al. What predicts software developers' productivity? IEEE Transactions on Software Engineering 47, 3 (2019), 582--594.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_2_16_1","unstructured":"Peng S. Kalliamvakou E. Cihon P. and Demirer M. The impact of AI on developer productivity: Evidence from GitHub Copilot. arXiv:2302.06590 [cs.SE] (2014)"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1108\/14691930410567040"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n19-1170"},{"key":"e_1_2_2_19_1","first-page":"10","article-title":"Towards a theory of software developer job satisfaction and perceived productivity","volume":"47","author":"Storey M.","year":"2019","unstructured":"Storey, M. et al. Towards a theory of software developer job satisfaction and perceived productivity. In Proceedings of the IEEE Trans. on Software Engineering 47, 10 (2019), 2125--2142.","journal-title":"Proceedings of the IEEE Trans. on Software Engineering"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417058"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR52588.2021.00045"},{"key":"e_1_2_2_22_1","volume-title":"Proceedings of the 2022 Conf. on Human Factors in Computing Systems.","author":"Vaithilingam P.","unstructured":"Vaithilingam, P., Zhang, T., and Glassman, E. Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models. In Proceedings of the 2022 Conf. on Human Factors in Computing Systems."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_2_2_24_1","volume-title":"A systematic review of productivity factors in software development. arXiv preprint arXiv:1801.06475","author":"Wagner S.","year":"2018","unstructured":"Wagner, S. and Ruhe, M. A systematic review of productivity factors in software development. arXiv preprint arXiv:1801.06475 (2018)."},{"key":"e_1_2_2_25_1","volume-title":"Proceedings of the 2020 CHI Conf. on Human Factors in Computing Systems","author":"Wang D.","year":"2020","unstructured":"Wang, D. et al. From human-human collaboration to human-AI collaboration: Designing AI systems that can work together with people. In Proceedings of the 2020 CHI Conf. on Human Factors in Computing Systems (2020), 1--6."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450656"},{"key":"e_1_2_2_27_1","volume-title":"Software Engineering at Google: Lessons Learned from Programming Over Time","author":"Winters T.","year":"2020","unstructured":"Winters, T., Manshreck, T., and Wright, H. Software Engineering at Google: Lessons Learned from Programming Over Time. O'Reilly Media (2020)."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7439(01)00155-1"},{"key":"e_1_2_2_29_1","unstructured":"Zhou W. Kim S. Murali V. and Ari Aye G. Improving code autocompletion with transfer learning. CoRR abs\/2105.05991 (2021); https:\/\/arxiv.org\/abs\/2105.05991"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3633453","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3633453","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T18:25:39Z","timestamp":1755973539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3633453"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,22]]},"references-count":29,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,3]]}},"alternative-id":["10.1145\/3633453"],"URL":"https:\/\/doi.org\/10.1145\/3633453","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,22]]},"assertion":[{"value":"2024-02-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}