{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:52:22Z","timestamp":1779101542386,"version":"3.51.4"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA1","license":[{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2023,4,6]]},"abstract":"<jats:p>\n            Powered by recent advances in code-generating models, AI assistants like Github Copilot promise to change the face of programming forever. But what\n            <jats:italic>is<\/jats:italic>\n            this new face of programming? We present the first grounded theory analysis of how programmers interact with Copilot, based on observing 20 participants\u2014with a range of prior experience using the assistant\u2014as they solve diverse programming tasks across four languages. Our main finding is that interactions with programming assistants are\n            <jats:italic>bimodal<\/jats:italic>\n            : in\n            <jats:italic>acceleration mode<\/jats:italic>\n            , the programmer knows what to do next and uses Copilot to get there faster; in\n            <jats:italic>exploration mode<\/jats:italic>\n            , the programmer is unsure how to proceed and uses Copilot to explore their options. Based on our theory, we provide recommendations for improving the usability of future AI programming assistants.\n          <\/jats:p>","DOI":"10.1145\/3586030","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T21:06:02Z","timestamp":1680815162000},"page":"85-111","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":300,"title":["Grounded Copilot: How Programmers Interact with Code-Generating Models"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8663-5175","authenticated-orcid":false,"given":"Shraddha","family":"Barke","sequence":"first","affiliation":[{"name":"University of California at San Diego, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2219-9355","authenticated-orcid":false,"given":"Michael B.","family":"James","sequence":"additional","affiliation":[{"name":"University of California at San Diego, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5571-173X","authenticated-orcid":false,"given":"Nadia","family":"Polikarpova","sequence":"additional","affiliation":[{"name":"University of California at San Diego, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,4,6]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989.","author":"Balog Matej","year":"2016","unstructured":"Matej Balog , Alexander L Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2016 . Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989. Matej Balog, Alexander L Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2016. Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7713789"},{"key":"#cr-split#-e_1_2_1_3_1.1","unstructured":"Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman Christine McLeavey Jerry Tworek and Mark Chen. 2022. Efficient Training of Language Models to Fill in the Middle. Jul https:\/\/doi.org\/10.48550\/arXiv.2207.14255 arXiv:2207.14255 [cs]. 10.48550\/arXiv.2207.14255"},{"key":"#cr-split#-e_1_2_1_3_1.2","unstructured":"Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman Christine McLeavey Jerry Tworek and Mark Chen. 2022. Efficient Training of Language Models to Fill in the Middle. Jul https:\/\/doi.org\/10.48550\/arXiv.2207.14255 arXiv:2207.14255 [cs]."},{"key":"e_1_2_1_4_1","volume-title":"Language models are few-shot learners. Advances in neural information processing systems, 33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , and Amanda Askell . 2020. Language models are few-shot learners. Advances in neural information processing systems, 33 ( 2020 ), 1877\u20131901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, and Amanda Askell. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33 (2020), 1877\u20131901."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781848607941"},{"key":"e_1_2_1_6_1","unstructured":"Donal E Carlston. 2013. Dual-Process Theories. isbn:978-0-19-998468-8 http:\/\/public.ebookcentral.proquest.com\/choice\/publicfullrecord.aspx?p=1336453 \t\t\t\t  Donal E Carlston. 2013. Dual-Process Theories. isbn:978-0-19-998468-8 http:\/\/public.ebookcentral.proquest.com\/choice\/publicfullrecord.aspx?p=1336453"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:EMSE.0000027786.04555.97"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242661"},{"key":"e_1_2_1_9_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman.","author":"Chen Mark","year":"2021","unstructured":"Mark Chen , Jerry Tworek , Heewoo Jun , Qiming Yuan , Henrique Ponde de Oliveira Pinto , Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021 . Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, and Greg Brockman. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/351240.351266"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452379"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-9088-8"},{"key":"e_1_2_1_13_1","volume-title":"Software design\u2014cognitive aspects","author":"D\u00e9tienne Fran\u00e7oise","unstructured":"Fran\u00e7oise D\u00e9tienne and Frank Bott . 2001. Software design\u2014cognitive aspects . Springer-Verlag . isbn:978-1-85233-253-2 Fran\u00e7oise D\u00e9tienne and Frank Bott. 2001. Software design\u2014cognitive aspects. Springer-Verlag. isbn:978-1-85233-253-2"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376442"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485530"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415869"},{"key":"#cr-split#-e_1_2_1_17_1.1","unstructured":"Daniel Fried Armen Aghajanyan Jessy Lin Sida Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer and Mike Lewis. 2022. InCoder: A Generative Model for Code Infilling and Synthesis. Apr https:\/\/doi.org\/10.48550\/arXiv.2204.05999 arXiv:2204.05999 [cs]. 10.48550\/arXiv.2204.05999"},{"key":"#cr-split#-e_1_2_1_17_1.2","unstructured":"Daniel Fried Armen Aghajanyan Jessy Lin Sida Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer and Mike Lewis. 2022. InCoder: A Generative Model for Code Infilling and Synthesis. Apr https:\/\/doi.org\/10.48550\/arXiv.2204.05999 arXiv:2204.05999 [cs]."},{"key":"e_1_2_1_18_1","unstructured":"Nat Friedman. 2021. https:\/\/github.blog\/2021-06-29-introducing-github-copilot-ai-pair-programmer\/ \t\t\t\t  Nat Friedman. 2021. https:\/\/github.blog\/2021-06-29-introducing-github-copilot-ai-pair-programmer\/"},{"key":"e_1_2_1_19_1","volume-title":"Strauss","author":"Glaser Barney G.","year":"1967","unstructured":"Barney G. Glaser and Anselm L . Strauss . 1967 . The discovery of grounded theory: strategies for qualitative research (5. paperback print ed.). Aldine Transaction . isbn:978-0-202-30260-7 Barney G. Glaser and Anselm L. Strauss. 1967. The discovery of grounded theory: strategies for qualitative research (5. paperback print ed.). Aldine Transaction. isbn:978-0-202-30260-7"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699751"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1925844.1926423"},{"key":"e_1_2_1_22_1","volume-title":"International Conference on Learning Representations.","author":"Guo Daya","year":"2021","unstructured":"Daya Guo , Alexey Svyatkovskiy , Jian Yin , Nan Duan , Marc Brockschmidt , and Miltiadis Allamanis . 2021 . Learning to Complete Code with Sketches . In International Conference on Learning Representations. Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, and Miltiadis Allamanis. 2021. Learning to Complete Code with Sketches. In International Conference on Learning Representations."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428273"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Dhanya Jayagopal Justin Lubin and Sarah E Chasins. 2022. Exploring the Learnability of Program Synthesizers by Novice Programmers. 15. \t\t\t\t  Dhanya Jayagopal Justin Lubin and Sarah E Chasins. 2022. Exploring the Learnability of Program Synthesizers by Novice Programmers. 15.","DOI":"10.1145\/3526113.3545659"},{"key":"e_1_2_1_25_1","volume-title":"Discovering the Syntax and Strategies of Natural Language Programming with Generative Language Models. In CHI Conference on Human Factors in Computing Systems. 1\u201319","author":"Jiang Ellen","year":"2022","unstructured":"Ellen Jiang , Edwin Toh , Alejandra Molina , Kristen Olson , Claire Kayacik , Aaron Donsbach , Carrie J Cai , and Michael Terry . 2022 . Discovering the Syntax and Strategies of Natural Language Programming with Generative Language Models. In CHI Conference on Human Factors in Computing Systems. 1\u201319 . Ellen Jiang, Edwin Toh, Alejandra Molina, Kristen Olson, Claire Kayacik, Aaron Donsbach, Carrie J Cai, and Michael Terry. 2022. Discovering the Syntax and Strategies of Natural Language Programming with Generative Language Models. In CHI Conference on Human Factors in Computing Systems. 1\u201319."},{"key":"e_1_2_1_26_1","volume-title":"fast and slow","author":"Kahneman Daniel","unstructured":"Daniel Kahneman . 2011. Thinking , fast and slow . Penguin Books . isbn:978-0-14-103357-0 Daniel Kahneman. 2011. Thinking, fast and slow. Penguin Books. isbn:978-0-14-103357-0"},{"key":"e_1_2_1_27_1","unstructured":"Ashwin Kalyan Abhishek Mohta Oleksandr Polozov Dhruv Batra Prateek Jain and Sumit Gulwani. 2018. Neural-guided deductive search for real-time program synthesis from examples. arXiv preprint arXiv:1804.01186. \t\t\t\t  Ashwin Kalyan Abhishek Mohta Oleksandr Polozov Dhruv Batra Prateek Jain and Sumit Gulwani. 2018. Neural-guided deductive search for real-time program synthesis from examples. arXiv preprint arXiv:1804.01186."},{"key":"e_1_2_1_28_1","volume-title":"Kite: AI-Powered Completions for JupyterLab. https:\/\/www.kite.com\/integrations\/jupyter\/","year":"2020","unstructured":"Kite. 2020 . Kite: AI-Powered Completions for JupyterLab. https:\/\/www.kite.com\/integrations\/jupyter\/ Kite. 2020. Kite: AI-Powered Completions for JupyterLab. https:\/\/www.kite.com\/integrations\/jupyter\/"},{"key":"e_1_2_1_29_1","volume-title":"Jun, arxiv:2006.10635 arXiv","author":"Lee Matthew","year":"2006","unstructured":"Matthew Lee . 2020. Detecting Affective Flow States of Knowledge Workers Using Physiological Sensors. arXiv:2006.10635 [cs] , Jun, arxiv:2006.10635 arXiv : 2006 .10635. Matthew Lee. 2020. Detecting Affective Flow States of Knowledge Workers Using Physiological Sensors. arXiv:2006.10635 [cs], Jun, arxiv:2006.10635 arXiv: 2006.10635."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376494"},{"key":"#cr-split#-e_1_2_1_31_1.1","unstructured":"Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser R\u00e9mi Leblond Tom Eccles James Keeling Felix Gimeno Agustin Dal Lago Thomas Hubert Peter Choy Cyprien de Masson d'Autume Igor Babuschkin Xinyun Chen Po-Sen Huang Johannes Welbl Sven Gowal Alexey Cherepanov James Molloy Daniel J. Mankowitz Esme Sutherland Robson Pushmeet Kohli Nando de Freitas Koray Kavukcuoglu and Oriol Vinyals. 2022. Competition-Level Code Generation with AlphaCode. https:\/\/doi.org\/10.48550\/ARXIV.2203.07814 10.48550\/ARXIV.2203.07814"},{"key":"#cr-split#-e_1_2_1_31_1.2","unstructured":"Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser R\u00e9mi Leblond Tom Eccles James Keeling Felix Gimeno Agustin Dal Lago Thomas Hubert Peter Choy Cyprien de Masson d'Autume Igor Babuschkin Xinyun Chen Po-Sen Huang Johannes Welbl Sven Gowal Alexey Cherepanov James Molloy Daniel J. Mankowitz Esme Sutherland Robson Pushmeet Kohli Nando de Freitas Koray Kavukcuoglu and Oriol Vinyals. 2022. Competition-Level Code Generation with AlphaCode. https:\/\/doi.org\/10.48550\/ARXIV.2203.07814"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485532"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2021.104881"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the ACM on Programming Languages, 3, OOPSLA","author":"Miltner Anders","year":"2019","unstructured":"Anders Miltner , Sumit Gulwani , Vu Le , Alan Leung , Arjun Radhakrishna , Gustavo Soares , Ashish Tiwari , and Abhishek Udupa . 2019 . On the fly synthesis of edit suggestions . Proceedings of the ACM on Programming Languages, 3, OOPSLA (2019), 1\u201329. Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, and Abhishek Udupa. 2019. On the fly synthesis of edit suggestions. Proceedings of the ACM on Programming Languages, 3, OOPSLA (2019), 1\u201329."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0378-8_2"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.200"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474748"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290327"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Hammond Pearce Baleegh Ahmad Benjamin Tan Brendan Dolan-Gavitt and Ramesh Karri. 2021. Asleep at the Keyboard? Assessing the Security of GitHub Copilot\u2019s Code Contributions. arXiv preprint arXiv:2108.09293. \t\t\t\t  Hammond Pearce Baleegh Ahmad Benjamin Tan Brendan Dolan-Gavitt and Ramesh Karri. 2021. Asleep at the Keyboard? Assessing the Security of GitHub Copilot\u2019s Code Contributions. arXiv preprint arXiv:2108.09293.","DOI":"10.1109\/SP46214.2022.9833571"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428227"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180189"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(87)90007-7"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594291.2594321"},{"key":"e_1_2_1_44_1","volume-title":"Sruti Srinivasa Ragavan, and Ben Zorn","author":"Sarkar Advait","year":"2022","unstructured":"Advait Sarkar , Andrew D Gordon , Carina Negreanu , Christian Poelitz , Sruti Srinivasa Ragavan, and Ben Zorn . 2022 . What is it like to program with artificial intelligence? arXiv preprint arXiv:2208.06213. Advait Sarkar, Andrew D Gordon, Carina Negreanu, Christian Poelitz, Sruti Srinivasa Ragavan, and Ben Zorn. 2022. What is it like to program with artificial intelligence? arXiv preprint arXiv:2208.06213."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-012-0249-7"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884833"},{"key":"e_1_2_1_47_1","volume-title":"Strauss and Juliet Corbin","author":"Anselm","year":"1990","unstructured":"Anselm L. Strauss and Juliet Corbin . 1990 . Basics of Qualitative Reseach: Grounded Theory Procedures and Techniques. SAGE Publications, Inc .. isbn:0-8039-3250-2 Anselm L. Strauss and Juliet Corbin. 1990. Basics of Qualitative Reseach: Grounded Theory Procedures and Techniques. SAGE Publications, Inc.. isbn:0-8039-3250-2"},{"key":"e_1_2_1_48_1","unstructured":"TabNine. 2018. TabNine: AI Assistant for Development Teams. https:\/\/www.tabnine.com\/ \t\t\t\t  TabNine. 2018. TabNine: AI Assistant for Development Teams. https:\/\/www.tabnine.com\/"},{"key":"e_1_2_1_49_1","volume-title":"Taylor and Robert Bogdan","author":"Steven","year":"1998","unstructured":"Steven J. Taylor and Robert Bogdan . 1998 . Introduction to qualitative research methods: A guidebook and resource, 3 rd ed. John Wiley and Sons Inc . isbn:978-0-471-16868-3 Steven J. Taylor and Robert Bogdan. 1998. Introduction to qualitative research methods: A guidebook and resource, 3rd ed. John Wiley and Sons Inc. isbn:978-0-471-16868-3","edition":"3"},{"key":"e_1_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Priyan Vaithilingam Tianyi Zhang and Elena Glassman. 2022. Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In CHI Late-Breaking Work. \t\t\t\t  Priyan Vaithilingam Tianyi Zhang and Elena Glassman. 2022. Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In CHI Late-Breaking Work.","DOI":"10.1145\/3491101.3519665"},{"key":"#cr-split#-e_1_2_1_51_1.1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention Is All You Need. Dec https:\/\/doi.org\/10.48550\/arXiv.1706.03762 arXiv:1706.03762 [cs]. 10.48550\/arXiv.1706.03762"},{"key":"#cr-split#-e_1_2_1_51_1.2","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention Is All You Need. Dec https:\/\/doi.org\/10.48550\/arXiv.1706.03762 arXiv:1706.03762 [cs]."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-006-9017-0"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445249"},{"key":"e_1_2_1_54_1","unstructured":"Eric Wastl. 2021. Advent of Code. https:\/\/adventofcode.com\/2021 \t\t\t\t  Eric Wastl. 2021. Advent of Code. https:\/\/adventofcode.com\/2021"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450656"},{"key":"#cr-split#-e_1_2_1_56_1.1","unstructured":"Frank F. Xu Zhengbao Jiang Pengcheng Yin Bogdan Vasilescu and Graham Neubig. 2020. Incorporating External Knowledge through Pre-training for Natural Language to Code Generation. https:\/\/doi.org\/10.48550\/ARXIV.2004.09015 10.48550\/ARXIV.2004.09015"},{"key":"#cr-split#-e_1_2_1_56_1.2","unstructured":"Frank F. Xu Zhengbao Jiang Pengcheng Yin Bogdan Vasilescu and Graham Neubig. 2020. Incorporating External Knowledge through Pre-training for Natural Language to Code Generation. https:\/\/doi.org\/10.48550\/ARXIV.2004.09015"},{"key":"#cr-split#-e_1_2_1_57_1.1","unstructured":"Frank F. Xu Bogdan Vasilescu and Graham Neubig. 2021. In-IDE Code Generation from Natural Language: Promise and Challenges. https:\/\/doi.org\/10.48550\/ARXIV.2101.11149 10.48550\/ARXIV.2101.11149"},{"key":"#cr-split#-e_1_2_1_57_1.2","unstructured":"Frank F. Xu Bogdan Vasilescu and Graham Neubig. 2021. In-IDE Code Generation from Natural Language: Promise and Challenges. https:\/\/doi.org\/10.48550\/ARXIV.2101.11149"},{"key":"e_1_2_1_58_1","unstructured":"Wojciech Zaremba Greg Brockman and  OpenAI. 2021. Codex. https:\/\/openai.com\/blog\/openai-codex\/ \t\t\t\t  Wojciech Zaremba Greg Brockman and  OpenAI. 2021. Codex. https:\/\/openai.com\/blog\/openai-codex\/"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445646"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415900"},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Xiangyu Zhou Ras Bodik Alvin Cheung and Chenglong Wang. 2022. Synthesizing Analytical SQL Queries from Computation Demonstration. In PLDI. \t\t\t\t  Xiangyu Zhou Ras Bodik Alvin Cheung and Chenglong Wang. 2022. Synthesizing Analytical SQL Queries from Computation Demonstration. In PLDI.","DOI":"10.1145\/3519939.3523712"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3586030","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3586030","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:10Z","timestamp":1750178770000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3586030"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":67,"journal-issue":{"issue":"OOPSLA1","published-print":{"date-parts":[[2023,4,6]]}},"alternative-id":["10.1145\/3586030"],"URL":"https:\/\/doi.org\/10.1145\/3586030","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,6]]},"assertion":[{"value":"2023-04-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}