{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:56:33Z","timestamp":1776113793328,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":82,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["SES-2326174, SES-2326175"],"award-info":[{"award-number":["SES-2326174, SES-2326175"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,6,25]]},"DOI":"10.1145\/3663384.3663393","type":"proceedings-article","created":{"date-parts":[[2024,6,22]],"date-time":"2024-06-22T06:19:08Z","timestamp":1719037148000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Non-Expert Programmers in the Generative AI Future"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5222-7720","authenticated-orcid":false,"given":"Molly Q","family":"Feldman","sequence":"first","affiliation":[{"name":"Oberlin College, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5717-4210","authenticated-orcid":false,"given":"Carolyn Jane","family":"Anderson","sequence":"additional","affiliation":[{"name":"Wellesley College, United States"}]}],"member":"320","published-online":{"date-parts":[[2024,6,25]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Hojjat Aghakhani Wei Dai Andre Manoel Xavier Fernandes Anant Kharkar Christopher Kruegel Giovanni Vigna David Evans Ben Zorn and Robert Sim. 2024. TrojanPuzzle: Covertly Poisoning Code-Suggestion Models. arxiv:2301.02344\u00a0[cs.CR]","DOI":"10.1109\/SP54263.2024.00140"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3439593"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502070"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8721.00196"},{"key":"e_1_3_2_1_5_1","unstructured":"Hannah\u00a0McLean Babe Sydney Nguyen Yangtian Zi Arjun Guha Molly\u00a0Q Feldman and Carolyn\u00a0Jane Anderson. 2023. StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code. arxiv:2306.04556\u00a0[cs.LG]"},{"key":"e_1_3_2_1_6_1","volume-title":"Aaron Grattafiori, Wenhan Xiong, Alexandre Defossez, Jade Copet, Faisal Azhar, Hugo Touvron, Gabriel Synnaeve, Nicolas Usunier, and Thomas Scialom.","author":"Rozi\u00e8re Baptiste","year":"2023","unstructured":"Baptiste Rozi\u00e8re, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Ellen Tan, Yossef (Yossi) Adi, Jingyu Liu, Tal Remez, Artyom Kozhevnikov, Ivan Evtimov, Joanna Bitton, Manish Bhatt, Cristian Canton Ferrer, Aaron Grattafiori, Wenhan Xiong, Alexandre Defossez, Jade Copet, Faisal Azhar, Hugo Touvron, Gabriel Synnaeve, Nicolas Usunier, and Thomas Scialom. 2023. Code Llama: Open Foundation Models for Code."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586030"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0001-3"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3344429.3372508"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352218"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3582083"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/567067.567069"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366879"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642377"},{"key":"e_1_3_2_1_15_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, and others.","author":"Chen Mark","year":"2021","unstructured":"Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de\u00a0Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, and others. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858323"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538911"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2307.16364"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445696"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Stefania Druga and Amy\u00a0J Ko. 2021. How do children\u2019s perceptions of machine intelligence change when training and coding smart programs?. In Interaction Design and Children. 49\u201361.","DOI":"10.1145\/3459990.3460712"},{"key":"e_1_3_2_1_21_1","volume-title":"Gpts are gpts: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130","author":"Eloundou Tyna","year":"2023","unstructured":"Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. 2023. Gpts are gpts: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130 (2023)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2311.06477"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173838"},{"key":"e_1_3_2_1_24_1","unstructured":"World\u00a0Economic Forum. 2023. Future of Jobs Report. https:\/\/www3.weforum.org\/docs\/WEF_Future_of_Jobs_2023.pdf"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432539"},{"key":"e_1_3_2_1_26_1","volume-title":"Incoder: A generative model for code infilling and synthesis. arXiv preprint arXiv:2204.05999","author":"Fried Daniel","year":"2022","unstructured":"Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Wen-tau Yih, Luke Zettlemoyer, and Mike Lewis. 2022. Incoder: A generative model for code infilling and synthesis. arXiv preprint arXiv:2204.05999 (2022)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568250"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2023.3308476"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5964\/jnc.v5i2.195"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3051467"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526113.3545659"},{"key":"e_1_3_2_1_33_1","volume-title":"Pedagogical framework for cultivating children\u2019s data agency and creative abilities in the age of AI. Informatics in Education","author":"Kahila Juho","year":"2024","unstructured":"Juho Kahila, Henriikka Vartiainen, Matti Tedre, Eetu Arkko, Anssi Lin, Nicolas Pope, Ilkka Jormanainen, and Teemu Valtonen. 2024. Pedagogical framework for cultivating children\u2019s data agency and creative abilities in the age of AI. Informatics in Education (2024)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.458"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580919"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631802.3631806"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Majeed Kazemitabaar Runlong Ye Xiaoning Wang Austin\u00a0Z. Henley Paul Denny Michelle Craig and Tovi Grossman. 2024. CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs. arxiv:2401.11314\u00a0[cs.HC]","DOI":"10.1145\/3613904.3642773"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025626"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173748"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231711"},{"key":"e_1_3_2_1_41_1","unstructured":"Karin Kimbrough and Mar Carpanelli. 2023. Preparing the Workforce for Generative AI. https:\/\/economicgraph.linkedin.com\/content\/dam\/me\/economicgraph\/en-us\/PDF\/preparing-the-workforce-for-generative-ai.pdf"},{"key":"e_1_3_2_1_42_1","volume-title":"Literate programming. The computer journal 27, 2","author":"Knuth Donald\u00a0Ervin","year":"1984","unstructured":"Donald\u00a0Ervin Knuth. 1984. Literate programming. The computer journal 27, 2 (1984), 97\u2013111."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2004.47"},{"key":"e_1_3_2_1_44_1","volume-title":"The stack: 3 tb of permissively licensed source code. arXiv preprint arXiv:2211.15533","author":"Kocetkov Denis","year":"2022","unstructured":"Denis Kocetkov, Raymond Li, Loubna\u00a0Ben Allal, Jia Li, Chenghao Mou, Carlos\u00a0Mu\u00f1oz Ferrandis, Yacine Jernite, Margaret Mitchell, Sean Hughes, Thomas Wolf, 2022. The stack: 3 tb of permissively licensed source code. arXiv preprint arXiv:2211.15533 (2022)."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568813.3600138"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445265"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v30i4.2262"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2016911.2016934"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569770"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568813.3600116"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.335"},{"key":"e_1_3_2_1_52_1","volume-title":"StarCoder: may the source be with you!arXiv preprint arXiv:2305.06161","author":"Li Raymond","year":"2023","unstructured":"Raymond Li, Loubna\u00a0Ben Allal, Yangtian Zi, Niklas Muennighoff, Denis Kocetkov, Chenghao Mou, Marc Marone, Christopher Akiki, Jia Li, Jenny Chim, and others. 2023. StarCoder: may the source be with you!arXiv preprint arXiv:2305.06161 (2023)."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","unstructured":"Jenny\u00a0T Liang Chenyang Yang and Brad\u00a0A Myers. 2023. Understanding the Usability of AI Programming Assistants. (2023). https:\/\/doi.org\/10.48550\/arXiv.2303.17125","DOI":"10.48550\/arXiv.2303.17125"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404531"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508865.1508959"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2102.04664"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953308"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807459"},{"key":"e_1_3_2_1_59_1","unstructured":"Vijayaraghavan Murali Chandra Maddila Imad Ahmad Michael Bolin Daniel Cheng Negar Ghorbani Renuka Fernandez and Nachiappan Nagappan. 2023. CodeCompose: A Large-Scale Industrial Deployment of AI-assisted Code Authoring. http:\/\/arxiv.org\/abs\/2305.12050 arXiv:2305.12050 [cs]."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642706"},{"key":"e_1_3_2_1_61_1","unstructured":"Erik Nijkamp Hiroaki Hayashi Caiming Xiong Silvio Savarese and Yingbo Zhou. 2023. CodeGen2: Lessons for Training LLMs on Programming and Natural Languages. arxiv:2305.02309\u00a0[cs.LG]"},{"key":"e_1_3_2_1_62_1","volume-title":"Codegen: An open large language model for code with multi-turn program synthesis. arXiv preprint arXiv:2203.13474","author":"Nijkamp Erik","year":"2022","unstructured":"Erik Nijkamp, Bo Pang, Hiroaki Hayashi, Lifu Tu, Huan Wang, Yingbo Zhou, Silvio Savarese, and Caiming Xiong. 2022. Codegen: An open large language model for code with multi-turn program synthesis. arXiv preprint arXiv:2203.13474 (2022)."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587102.3588840"},{"key":"e_1_3_2_1_64_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774\u00a0[cs]"},{"key":"e_1_3_2_1_65_1","volume-title":"Brent\u00a0N. Reeves, Stephen MacNeil, Brett\u00a0A. Becker, Andrew Luxton-Reilly, Thezyrie Amarouche, and Bailey Kimmel.","author":"Prather James","year":"2024","unstructured":"James Prather, Paul Denny, Juho Leinonen, David H. Smith\u00a0IV au2, Brent\u00a0N. Reeves, Stephen MacNeil, Brett\u00a0A. Becker, Andrew Luxton-Reilly, Thezyrie Amarouche, and Bailey Kimmel. 2024. Interactions with Prompt Problems: A New Way to Teach Programming with Large Language Models. arxiv:2401.10759\u00a0[cs.HC]"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","unstructured":"James Prather Brent\u00a0N. Reeves Paul Denny Brett\u00a0A. Becker Juho Leinonen Andrew Luxton-Reilly Garrett Powell James Finnie-Ansley and Eddie\u00a0Antonio Santos. 2023. \u201cIt\u2019s Weird That it Knows What I Want\u201d: Usability and Interactions with Copilot for Novice Programmers. ACM Transactions on Computer-Human Interaction (Aug. 2023) 3617367. https:\/\/doi.org\/10.1145\/3617367","DOI":"10.1145\/3617367"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2022.107066"},{"key":"e_1_3_2_1_68_1","volume-title":"Proceedings of the First Workshop on Generative AI and Law. Honolulu.","author":"Rahman Noorjahan","year":"2023","unstructured":"Noorjahan Rahman and Eduardo Santacana. 2023. Beyond Fair Use: Legal Risk Evaluation for Training LLMs on Copyrighted Text. In Proceedings of the First Workshop on Generative AI and Law. Honolulu."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2023.100145"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584037"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511599"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511119"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_3_2_1_74_1","volume-title":"Proceedings of the Air Force Forum for Intelligent Tutoring Systems","author":"VanLehn Kurt","year":"1989","unstructured":"Kurt VanLehn. 1989. Student modeling. Proceedings of the Air Force Forum for Intelligent Tutoring Systems (1989), 49\u201363."},{"key":"e_1_3_2_1_75_1","unstructured":"Helena Vasconcelos Gagan Bansal Adam Fourney Q.\u00a0Vera Liao and Jennifer\u00a0Wortman Vaughan. 2023. Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions. arxiv:2302.07248\u00a0[cs.HC]"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1584322.1584336"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","unstructured":"Zhiruo Wang Grace Cuenca Shuyan Zhou Frank\u00a0F. Xu and Graham Neubig. 2022. MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages. https:\/\/doi.org\/10.48550\/ARXIV.2203.08388","DOI":"10.48550\/ARXIV.2203.08388"},{"key":"e_1_3_2_1_78_1","volume-title":"Execution-Based Evaluation for Open-Domain Code Generation. In Conference on Empirical Methods in Natural Language Processing. https:\/\/api.semanticscholar.org\/CorpusID:254877069","author":"Wang Zhiruo","year":"2022","unstructured":"Zhiruo Wang, Shuyan Zhou, Daniel Fried, and Graham Neubig. 2022. Execution-Based Evaluation for Open-Domain Code Generation. In Conference on Empirical Methods in Natural Language Processing. https:\/\/api.semanticscholar.org\/CorpusID:254877069"},{"key":"e_1_3_2_1_79_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education -","volume":"52","author":"Whalley L.","year":"2006","unstructured":"Jacqueline\u00a0L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P.\u00a0K.\u00a0Ajith Kumar, and Christine Prasad. 2006. An Australasian study of reading and comprehension skills in novice programmers, using the bloom and SOLO taxonomies. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE \u201906). Australian Computer Society, Inc., AUS, 243\u2013252."},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3487569"},{"key":"e_1_3_2_1_81_1","unstructured":"Shuyin Zhao. 2023. GitHub Copilot Now Has a Better AI Model and New Capabilities. https:\/\/github.blog\/2023-02-14-github-copilot-now-has-a- better-ai-model-and-new-capabilities\/"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534864"}],"event":{"name":"CHIWORK 2024: Annual Symposium on Human-Computer Interaction for Work","location":"Newcastle upon Tyne United Kingdom","acronym":"CHIWORK 2024"},"container-title":["Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3663384.3663393","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3663384.3663393","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T21:46:35Z","timestamp":1755899195000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3663384.3663393"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,25]]},"references-count":82,"alternative-id":["10.1145\/3663384.3663393","10.1145\/3663384"],"URL":"https:\/\/doi.org\/10.1145\/3663384.3663393","relation":{},"subject":[],"published":{"date-parts":[[2024,6,25]]},"assertion":[{"value":"2024-06-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}