{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:05:45Z","timestamp":1776103545546,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":49,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,8,3]]},"DOI":"10.1145\/3702652.3744219","type":"proceedings-article","created":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T09:39:27Z","timestamp":1753954767000},"page":"407-420","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["The Effects of GitHub Copilot on Computing Students' Programming Effectiveness, Efficiency, and Processes in Brownfield Coding Tasks"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-9362-2268","authenticated-orcid":false,"given":"Md Istiak Hossain","family":"Shihab","sequence":"first","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5128-905X","authenticated-orcid":false,"given":"Christopher","family":"Hundhausen","sequence":"additional","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3050-0391","authenticated-orcid":false,"given":"Ahsun","family":"Tariq","sequence":"additional","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4658-4393","authenticated-orcid":false,"given":"Summit","family":"Haque","sequence":"additional","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5852-321X","authenticated-orcid":false,"given":"Yunhan","family":"Qiao","sequence":"additional","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-3144-7702","authenticated-orcid":false,"given":"Brian Wise","family":"Mulanda","sequence":"additional","affiliation":[{"name":"Software Engineering Education Assessment and Analytics Lab, School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,8,2]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"2021. GitHub Copilot. GitHub. Available at https:\/\/github.com\/features\/copilot."},{"key":"e_1_3_3_2_3_2","unstructured":"2025. Stack Overflow Developer Survey 2025. https:\/\/survey.stackoverflow.co\/2024\/"},{"key":"e_1_3_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Fahad\u00a0H Alshammari. 2022. Trends in Intelligent and AI-Based Software Engineering Processes: A Deep Learning-Based Software Process Model Recommendation Method. Computational intelligence and neuroscience 2022 1 (2022) 1960684.","DOI":"10.1155\/2022\/1960684"},{"key":"e_1_3_3_2_5_2","unstructured":"Amazon. [n. d.]. Amazon WorkSpaces. https:\/\/aws.amazon.com\/pm\/workspaces\/"},{"key":"e_1_3_3_2_6_2","unstructured":"Marcellin Atemkeng Sisipho Hamlomo Brian Welman Nicole Oyetunji Pouya Ataei and Jean Louis\u00a0KE Fendji. 2024. Ethics of Software Programming with Generative AI: Is Programming without Generative AI always radical? arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2408.10554 (2024)."},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","unstructured":"Yoav Benjamini and Daniel Yekutieli. 2001. The control of the false discovery rate in multiple testing under dependency. Annals of Statistics 29 4 (2001) 1165\u20131188. 10.1214\/aos\/1013699998","DOI":"10.1214\/aos\/1013699998"},{"key":"e_1_3_3_2_8_2","unstructured":"Aras Bozkurt. 2023. Generative artificial intelligence (AI) powered conversational educational agents: The inevitable paradigm shift. Asian Journal of Distance Education 18 1 (2023)."},{"key":"e_1_3_3_2_9_2","unstructured":"Allan Collins John\u00a0Seely Brown and Susan\u00a0E Newman. 1989. Cognitive apprenticeship: Teaching the crafts of reading writing and mathematics. Knowing learning and instruction: Essays in honor of Robert Glaser 18 (1989) 32\u201342."},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Arghavan\u00a0Moradi Dakhel Vahid Majdinasab Amin Nikanjam Foutse Khomh Michel\u00a0C Desmarais and Zhen Ming\u00a0Jack Jiang. 2023. Github copilot ai pair programmer: Asset or liability? Journal of Systems and Software 203 (2023) 111734.","DOI":"10.1016\/j.jss.2023.111734"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Fitsum Deriba Ismaila\u00a0Temitayo Sanusi Oladele O\u00a0Campbell and Solomon\u00a0Sunday Oyelere. 2024. Computer Programming Education in the Age of Generative AI: Insights from Empirical Research. (2024).","DOI":"10.2139\/ssrn.4891302"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"publisher","unstructured":"Michael\u00a0C. Feathers. 2004. Working Effectively with Legacy Code. (2004) 217. 10.1007\/978-3-540-27777-442","DOI":"10.1007\/978-3-540-27777-442"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511861.3511863"},{"key":"e_1_3_3_2_14_2","unstructured":"E Frank and O Godwin. 2024. Enhancing Developer Productivity: A Study on GitHub Copilot\u2019s Code Completion Capabilities. (2024)."},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649217.3653615"},{"key":"e_1_3_3_2_16_2","unstructured":"Nada Hashmi Zhi Li Salvatore Parise and G Shankaranarayanan. 2024. Generative AI\u2019s impact on programming students: frustration and confidence across learning styles. Issues in Information Systems 25 3 (2024)."},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Jan\u00a0H Klemmer Stefan\u00a0Albert Horstmann Nikhil Patnaik Cordelia Ludden Cordell Burton\u00a0Jr Carson Powers Fabio Massacci Akond Rahman Daniel Votipka Heather\u00a0Richter Lipford et\u00a0al. 2024. Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concerns. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2405.06371 (2024).","DOI":"10.1145\/3658644.3690283"},{"key":"e_1_3_3_2_18_2","unstructured":"Klaus Krippendorff. 2011. Computing Krippendorff\u2019s alpha-reliability."},{"key":"e_1_3_3_2_19_2","unstructured":"Raymond Li Loubna\u00a0Ben Allal Yangtian Zi Niklas Muennighoff Denis Kocetkov Chenghao Mou Marc Marone Christopher Akiki Jia Li Jenny Chim et\u00a0al. 2023. Starcoder: may the source be with you! arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.06161 (2023)."},{"key":"e_1_3_3_2_20_2","unstructured":"Jenny\u00a0T. Liang Chenyang Yang and Brad\u00a0A. Myers. 2023. Understanding the Usability of AI Programming Assistants. ArXiv abs\/2303.17125 (2023). https:\/\/api.semanticscholar.org\/CorpusID:263870561"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3608128"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3631802.3631830"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Joe Llerena-Izquierdo Johan Mendez-Reyes Raquel Ayala-Carabajo and Cesar Andrade-Martinez. 2024. Innovations in Introductory Programming Education: The Role of AI with Google Colab and Gemini. Education Sciences 14 12 (2024) 1330.","DOI":"10.3390\/educsci14121330"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858252"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649217.3653621"},{"key":"e_1_3_3_2_26_2","volume-title":"Visual Studio Code","year":"2015","unstructured":"Microsoft. 2015. Visual Studio Code. https:\/\/code.visualstudio.com\/"},{"key":"e_1_3_3_2_27_2","unstructured":"Kevin\u00a0KB Ng Liyana Fauzi Leon Leow and Jaren Ng. 2024. Harnessing the Potential of Gen-AI Coding Assistants in Public Sector Software Development. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2409.17434 (2024)."},{"key":"e_1_3_3_2_28_2","unstructured":"Gabrielle O\u2019Brien. 2025. How Scientists Use Large Language Models to Program. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2502.17348 (2025)."},{"key":"e_1_3_3_2_29_2","unstructured":"Sida Peng Eirini Kalliamvakou Peter Cihon and Mert Demirer. 2023. The impact of ai on developer productivity: Evidence from github copilot. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2302.06590 (2023)."},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470689516"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Farman\u00a0Ali Pirzado Awais Ahmed Rom\u00e1n\u00a0A Mendoza-Urdiales and Hugo Terashima-Marin. 2024. Navigating the pitfalls: Analyzing the behavior of LLMs as a coding assistant for computer science students-a systematic review of the literature. IEEE Access (2024).","DOI":"10.1109\/ACCESS.2024.3443621"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"crossref","unstructured":"James Prather Brent\u00a0N Reeves Paul Denny Brett\u00a0A Becker Juho Leinonen Andrew Luxton-Reilly Garrett Powell James Finnie-Ansley and Eddie\u00a0Antonio Santos. 2023. \u201cIt\u2019s weird that it knows what i want\u201d: Usability and interactions with copilot for novice programmers. ACM transactions on computer-human interaction 31 1 (2023) 1\u201331.","DOI":"10.1145\/3617367"},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3632620.3671116"},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Jaakko Sauvola Sasu Tarkoma Mika Klemettinen Jukka Riekki and David Doermann. 2024. Future of software development with generative AI. Automated Software Engineering 31 1 (2024) 26.","DOI":"10.1007\/s10515-024-00426-z"},{"key":"e_1_3_3_2_35_2","doi-asserted-by":"crossref","unstructured":"Andreas Scholl and Natalie Kiesler. 2024. How Novice Programmers Use and Experience ChatGPT when Solving Programming Exercises in an Introductory Course. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2407.20792 (2024).","DOI":"10.1109\/FIE61694.2024.10893442"},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Agnia Sergeyuk Yaroslav Golubev Timofey Bryksin and Iftekhar Ahmed. 2025. Using AI-based coding assistants in practice: State of affairs perceptions and ways forward. Information and Software Technology 178 (2025) 107610.","DOI":"10.1016\/j.infsof.2024.107610"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3641554.3701800"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3632620.3671112"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"crossref","unstructured":"M Srinivas G Ramakrishna K\u00a0Rajasekhara Rao and E\u00a0Suresh Babu. 2016. Analysis of legacy system in software application development: A comparative survey. International Journal of Electrical and Computer Engineering 6 1 (2016) 292.","DOI":"10.11591\/ijece.v6i1.8367"},{"key":"e_1_3_3_2_40_2","unstructured":"John Sweller. 2011. Cognitive load theory evolutionary educational psychology and instructional design. Evolutionary Psychology and Information Systems Research (2011) 255\u2013269."},{"key":"e_1_3_3_2_41_2","unstructured":"Benyamin Tabarsi Heidi Reichert Ally Limke Sandeep Kuttal and Tiffany Barnes. 2025. LLMs\u2019 Reshaping of People Processes Products and Society in Software Development: A Comprehensive Exploration with Early Adopters. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2503.05012 (2025)."},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC61105.2024.00252"},{"key":"e_1_3_3_2_43_2","unstructured":"Ben\u00a0Arie Tanay Lexy Arinze Siddhant\u00a0S Joshi Kirsten\u00a0A Davis and James\u00a0C Davis. 2024. An Exploratory Study on Upper-Level Computing Students\u2019 Use of Large Language Models as Tools in a Semester-Long Project. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2403.18679 (2024)."},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642902"},{"key":"e_1_3_3_2_45_2","unstructured":"Gemini Team Rohan Anil Sebastian Borgeaud Jean-Baptiste Alayrac Jiahui Yu Radu Soricut Johan Schalkwyk Andrew\u00a0M Dai Anja Hauth Katie Millican et\u00a0al. 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2312.11805 (2023)."},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649217.3653584"},{"key":"e_1_3_3_2_47_2","unstructured":"Ingmar Visser Maartje\u00a0EJ Raijmakers and Peter\u00a0CM Molenaar. 2010. A stochastic approach for sequential analysis of programming behaviors. Learning and Individual Differences 20 4 (2010) 313\u2013322."},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"crossref","unstructured":"Philip Welsby and Bernard\u00a0MY Cheung. 2023. ChatGPT. 1047\u20131048\u00a0pages.","DOI":"10.1093\/postmj\/qgad056"},{"key":"e_1_3_3_2_49_2","unstructured":"Tianyi Xu Pranav Vaithilingam Xinyu Li Yuntao Tian Laura Dabbish and Brad\u00a0A Myers. 2022. A theory-driven approach to AI-assisted programming. CHI Conference on Human Factors in Computing Systems (2022) 1\u201315."},{"key":"e_1_3_3_2_50_2","doi-asserted-by":"crossref","unstructured":"Hao Yu. 2023. Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Frontiers in Psychology 14 (2023) 1181712.","DOI":"10.3389\/fpsyg.2023.1181712"}],"event":{"name":"ICER 2025: ACM Conference on International Computing Education Research","location":"Charlottesville USA","acronym":"ICER '25","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 2025 ACM Conference on International Computing Education Research V.1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3702652.3744219","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T11:38:40Z","timestamp":1753961920000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3702652.3744219"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,2]]},"references-count":49,"alternative-id":["10.1145\/3702652.3744219","10.1145\/3702652"],"URL":"https:\/\/doi.org\/10.1145\/3702652.3744219","relation":{},"subject":[],"published":{"date-parts":[[2025,8,2]]},"assertion":[{"value":"2025-08-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}