{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T17:15:41Z","timestamp":1783444541071,"version":"3.54.6"},"reference-count":108,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T00:00:00Z","timestamp":1748217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>What if end-users could own the software development lifecycle from conception to deployment using only requirements expressed in language, images, video or audio? We explore this idea, building on the capabilities that Generative AI brings to software generation and maintenance techniques. How could designing software in this way better serve end-users? What are the implications of this process for the future of end-user software engineering and the software development lifecycle? We discuss the research needed to bridge the gap between where we are today and these imagined systems of the future.<\/jats:p>","DOI":"10.1145\/3708524","type":"journal-article","created":{"date-parts":[[2024,12,14]],"date-time":"2024-12-14T14:52:21Z","timestamp":1734187941000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Requirements Are All You Need: The Final Frontier for End-User Software Engineering"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7468-0123","authenticated-orcid":false,"given":"Diana","family":"Robinson","sequence":"first","affiliation":[{"name":"Computer Science and Technology, Cambridge University, Cambridge, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6954-6859","authenticated-orcid":false,"given":"Christian","family":"Cabrera","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5809-2484","authenticated-orcid":false,"given":"Andrew D.","family":"Gordon","sequence":"additional","affiliation":[{"name":"Cogna, London, United Kingdom of Great Britain and Northern Ireland and The University of Edinburgh School of Informatics, Edinburgh, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9258-1030","authenticated-orcid":false,"given":"Neil D.","family":"Lawrence","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9324-4921","authenticated-orcid":false,"given":"Lars","family":"Mennen","sequence":"additional","affiliation":[{"name":"Cogna, London, United Kingdom of Great Britain and Northern Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,26]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1109\/SP.2016.33","volume-title":"Proceedings of the 2016 IEEE Symposium on Security and Privacy (SP \u201916).","author":"Acar Yasemin","year":"2016","unstructured":"Yasemin Acar, Michael Backes, Sven Bugiel, Sascha Fahl, Patrick McDaniel, and Matthew Smith. 2016. Sok: Lessons learned from Android security research for appified software platforms. In Proceedings of the 2016 IEEE Symposium on Security and Privacy (SP \u201916). IEEE, 433\u2013451."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_3_2_4_2","first-page":"3","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi, Daniel S. Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi T. Iqbal, Paul N. Bennett, Kori Inkpen, et al. 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 3. Retrieved from https:\/\/www.microsoft.com\/en-us\/research\/publication\/guidelines-for-human-ai-interaction\/"},{"key":"e_1_3_2_5_2","unstructured":"Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski David Dohan Ellen Jiang Carrie Cai Michael Terry Quoc Le et al. 2021. Program synthesis with large language models. arXiv:2108.07732."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/1866307.1866317"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.11.041"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1049\/smc2.12063"},{"key":"e_1_3_2_9_2","first-page":"374","volume-title":"Proceedings of the Machine Learning and Systems","volume":"1","author":"Bonawitz Keith","year":"2019","unstructured":"Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chlo\u00e9 Kiddon, Jakub Kone\u010dn\u00fd, Stefano Mazzocchi, Brendan McMahan, et al. 2019. Towards federated learning at scale: System design. In Proceedings of the Machine Learning and Systems. A. Talwalkar, V. Smith, and M. Zaharia (Eds.), Vol. 1, 374\u2013388. Retrieved from https:\/\/proceedings.mlsys.org\/paper\/2019\/file\/bd686fd640be98efaae0091fa301e613-Paper.pdf"},{"key":"e_1_3_2_10_2","unstructured":"Catherine Breslin. 2024. September roundup. Retrieved September 09 2024 from https:\/\/aixinsights.substack.com\/p\/september-roundup"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/978-3-642-00427-8_2","volume-title":"End-User Development.","author":"Burnett Margaret","year":"2009","unstructured":"Margaret Burnett. 2009. What is end-user software engineering and why does it Matter?. In End-User Development. Volkmar Pipek, Mary Beth Rosson, Boris de Ruyter, and Volker Wulf (Eds.), Springer, Berlin, 15\u201328."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/1015864.1015889"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1093\/iwc\/iwv046"},{"key":"e_1_3_2_14_2","unstructured":"M. M. Burnett and C. Scaffidi. 2014. End-user development. In The Encyclopedia of Human-Computer Interaction (2nd. ed). Interaction Design Foundation - IxDF. Retrieved December 3 2024 from https:\/\/www.interaction-design.org\/literature\/book\/the-encyclopedia-of-human-computer-interaction-2nd-ed\/end-user-development"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1007\/978-3-030-91431-8_56","volume-title":"Service-Oriented Computing","author":"Cabrera Christian","year":"2021","unstructured":"Christian Cabrera and Siobh\u00e1n Clarke. 2021. A reinforcement learning-based service model for the Internet of things. In Service-Oriented Computing. Hakim Hacid, Odej Kao, Massimo Mecella, Naouel Moha, and Hye-young Paik (Eds.), Springer International Publishing, Cham, 790\u2013799."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643657.3643910"},{"key":"e_1_3_2_17_2","unstructured":"Christian Cabrera Andrei Paleyes Pierre Thodoroff and Neil D. Lawrence. 2023. Real-world machine learning systems: A survey from a data-oriented architecture perspective. arXiv:2302.04810."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2022.3143029"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3584364"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3559552"},{"key":"e_1_3_2_21_2","unstructured":"Bei Chen Fengji Zhang Anh Nguyen Daoguang Zan Zeqi Lin Jian-Guang Lou and Weizhu Chen. 2022. CodeT: Code generation with generated tests. arXiv:2207.10397."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i16.29728"},{"key":"e_1_3_2_23_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv:2107.03374"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594073"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300618"},{"key":"e_1_3_2_26_2","volume-title":"Watch What I Do: Programming by Demonstration","author":"Cypher Allen","year":"1993","unstructured":"Allen Cypher and Daniel Conrad Halbert. 1993. Watch What I Do: Programming by Demonstration. MIT press."},{"key":"e_1_3_2_27_2","series-title":"Lecture Notes in Computer Science, Vol. 9195","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1007\/978-3-319-21401-6_26","volume-title":"Automated Deduction - CADE-25.","author":"de Moura Leonardo Mendon\u00e7a","year":"2015","unstructured":"Leonardo Mendon\u00e7a de Moura, Soonho Kong, Jeremy Avigad, Floris van Doorn, and Jakob von Raumer. 2015. The Lean theorem prover (system description). In Automated Deduction - CADE-25. Amy P. Felty and Aart Middeldorp (Eds.), Lecture Notes in Computer Science, Vol. 9195, Springer, Cham, 378\u2013388."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/BFB0014656"},{"key":"e_1_3_2_29_2","unstructured":"Tyna Eloundou Sam Manning Pamela Mishkin and Daniel Rock. 2023. GPTs are GPTs: An early look at the labor market impact potential of large language models. arXiv:2303.10130. Retrieved from https:\/\/arxiv.org\/abs\/2303.10130"},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Mohamad Fakih Rahul Dharmaji Yasamin Moghaddas Gustavo Quiros Araya Oluwatosin Ogundare and Mohammad Abdullah Al Faruque. 2024. LLM4PLC: Harnessing large language models for verifiable programming of PLCs in industrial control systems. arXiv:2401.05443.","DOI":"10.1145\/3639477.3639743"},{"key":"e_1_3_2_31_2","unstructured":"Angela Fan Beliz Gokkaya Mark Harman Mitya Lyubarskiy Shubho Sengupta Shin Yoo and Jie M. Zhang. 2023. Large language models for software engineering: Survey and open problems. arXiv:2310.03533."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/VL-HCC57772.2023.00017"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-023-00834-7"},{"key":"e_1_3_2_34_2","unstructured":"Lynn Gilbert and Gaylen Moore. 1981. Particular Passions: Grace Murray Hopper. Lynn Gilbert. Retrieved from https:\/\/www.vassar.edu\/stories\/2017\/assets\/images\/170706-legacy-of-grace-hopper-hopperpdf.pdf"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/VL-HCC57772.2023.00013"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1109\/ACSAC.2009.44","volume-title":"Proceedings of the 2009 Annual Computer Security Applications Conference.","author":"Gong Li","year":"2009","unstructured":"Li Gong. 2009. Java security: A ten year retrospective. In Proceedings of the 2009 Annual Computer Security Applications Conference. IEEE, 395\u2013405."},{"key":"e_1_3_2_37_2","unstructured":"Andrew D. Gordon Carina Negreanu Jos\u00e9 Cambronero Rasika Chakravarthy Ian Drosos Hao Fang Bhaskar Mitra Hannah Richardson Advait Sarkar Stephanie Simmons et al. 2023. Co-audit: Tools to help humans double-check AI-generated content. arXiv:2310.01297."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/602382.602401"},{"key":"e_1_3_2_39_2","volume-title":"Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass","author":"Gray Mary L.","year":"2019","unstructured":"Mary L. Gray and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Eamon Dolan Books."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2240236.2240260"},{"key":"e_1_3_2_41_2","volume-title":"Beyond Just Programming: A Vision of Generative AI as an End-to End Expert Data Science Consultant","author":"Guo Phillip","year":"2024","unstructured":"Phillip Guo. 2024. Beyond Just Programming: A Vision of Generative AI as an End-to End Expert Data Science Consultant. Cogna Tech Talk."},{"key":"e_1_3_2_42_2","unstructured":"Yanzhu Guo Guokan Shang Michalis Vazirgiannis and Chlo\u00e9 Clavel. 2023. The curious decline of linguistic diversity: Training language models on synthetic text. arXiv:2311.09807."},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-13431-0","volume-title":"Systems Engineering: Fundamentals and Applications","author":"Haberfellner Reinhard","year":"2019","unstructured":"Reinhard Haberfellner, Olivier De Weck, Ernst Fricke, and Siegfried V\u00f6ssner. 2019. Systems Engineering: Fundamentals and Applications. Springer."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X0999152X"},{"key":"e_1_3_2_45_2","unstructured":"Sirui Hong Mingchen Zhuge Jonathan Chen Xiawu Zheng Yuheng Cheng Ceyao Zhang Jinlin Wang Zili Wang Steven Ka Shing Yau Zijuan Lin et al. 2023. MetaGPT: Meta programming for a multi-agent collaborative framework. arXiv:2308.00352"},{"key":"e_1_3_2_46_2","unstructured":"Evan Hubinger Carson Denison Jesse Mu Mike Lambert Meg Tong Monte MacDiarmid Tamera Lanham Daniel M. Ziegler Tim Maxwell Newton Cheng et al. 2024. Sleeper agents: Training deceptive LLMs that persist through safety training. arXiv:2401.05566. Retrieved from https:\/\/arxiv.org\/abs\/2401.05566"},{"key":"e_1_3_2_47_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Jimenez Carlos E.","year":"2024","unstructured":"Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R. Narasimhan. 2024. SWE-Bench: Can language models resolve real-world github issues?. In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=VTF8yNQM66"},{"key":"e_1_3_2_48_2","unstructured":"Haolin Jin Linghan Huang Haipeng Cai Jun Yan Bo Li and Huaming Chen. 2024. From LLMs to LLM-based agents for software engineering: A survey of current challenges and future. arXiv:2408.02479. Retrieved from https:\/\/arxiv.org\/abs\/2408.02479"},{"key":"e_1_3_2_49_2","doi-asserted-by":"crossref","unstructured":"Eunsuk Kang and Mary Shaw. 2024. tl; dr: Chill y\u2019all: AI will not devour SE. arXiv:2409.00764. Retrieved from https:\/\/arxiv.org\/abs\/2409.00764.","DOI":"10.1145\/3689492.3689816"},{"key":"e_1_3_2_50_2","unstructured":"Heidy Khlaaf. 2023. Toward comprehensive risk assessments and assurance of AI-based systems. Retrieved from https:\/\/www.trailofbits.com\/documents\/Toward_comprehensive_risk_assessments.pdf"},{"key":"e_1_3_2_51_2","unstructured":"Heidy Khlaaf Pamela Mishkin Joshua Achiam Gretchen Krueger and Miles Brundage. 2022. A hazard analysis framework for code synthesis large language models. arXiv:2207.14157."},{"key":"e_1_3_2_52_2","unstructured":"Donald E. Knuth and Luis Trabb Pardo. 1980. The early development of programming languages. A History of Computing in the Twentieth Century 197\u2013273. Retrieved from https:\/\/archive.org\/details\/DTIC_ADA032123\/page\/n1\/mode\/2up"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/1922649.1922658"},{"key":"e_1_3_2_54_2","first-page":"151","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201904)","author":"Ko Amy J.","year":"2004","unstructured":"Amy J. Ko and Brad A. Myers. 2004. Designing the whyline: A debugging interface for asking questions about program behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201904). ACM, 151\u2013158."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2004.47"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-5007-7"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/138873.138874"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281544"},{"issue":"1","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"6039","DOI":"10.1038\/s41467-022-33128-9","article-title":"Technology readiness levels for machine learning systems","volume":"13","author":"Lavin Alexander","year":"2022","unstructured":"Alexander Lavin, Ciar\u00e1n M. Gilligan-Lee, Alessya Visnjic, Siddha Ganju, Dava Newman, Sujoy Ganguly, Danny Lange, At\u00edl\u00edm G\u00fcne\u015f Baydin, Amit Sharma, Adam Gibson, et al. 2022. Technology readiness levels for machine learning systems. Nature Communications 13, 1 (2022), 6039.","journal-title":"Nature Communications"},{"key":"e_1_3_2_60_2","unstructured":"Neil D. Lawrence. 2017. Data readiness levels. arXiv:1705.02245."},{"key":"e_1_3_2_61_2","first-page":"348","volume-title":"Proceedings of the International Conference on Logic for Programming Artificial Intelligence and Reasoning","author":"Leino K Rustan M","year":"2010","unstructured":"K Rustan M Leino. 2010. Dafny: An automatic program verifier for functional correctness. In Proceedings of the International Conference on Logic for Programming Artificial Intelligence and Reasoning. Springer, 348\u2013370."},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.4230\/DagSemProc.07081.15"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580817"},{"key":"e_1_3_2_64_2","unstructured":"Zhenyan Lu Xiang Li Dongqi Cai Rongjie Yi Fangming Liu Xiwen Zhang Nicholas D. Lane and Mengwei Xu. 2024. Small language models: Survey measurements and insights. arXiv:2409.15790."},{"key":"e_1_3_2_65_2","unstructured":"Shuming Ma Hongyu Wang Lingxiao Ma Lei Wang Wenhui Wang Shaohan Huang Li Dong Ruiping Wang Jilong Xue and Furu Wei. 2024. The era of 1-bit LLMs: All large language models are in 1.58 bits. arXiv:2402.17764."},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1561\/1100000083"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643763"},{"key":"e_1_3_2_68_2","unstructured":"Fangwen Mu Lin Shi Song Wang Zhuohao Yu Binquan Zhang Chenxue Wang Shichao Liu and Qing Wang. 2023. ClarifyGPT: Empowering LLM-based code generation with intention clarification. arXiv:2310.10996."},{"key":"e_1_3_2_69_2","first-page":"973","volume-title":"Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering (ICSE \u201924)","author":"Murphy-Hill Emerson","year":"2024","unstructured":"Emerson Murphy-Hill, Alberto Elizondo, Ambar Murillo, Marian Harbach, Bogdan Vasilescu, Delphine Carlson, and Florian Dessloch. 2024. GenderMag improves discoverability in the field, especially for women. In Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering (ICSE \u201924). IEEE Computer Society, 973\u2013973."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1020.001.0001"},{"key":"e_1_3_2_71_2","volume-title":"Proceedings of the 12th ACM SIGPLAN Workshop on Higher-Order Programming with Effects (HOPE\u201924)","author":"Omar Cyrus","year":"2024","unstructured":"Cyrus Omar, Patrick Ferris, and Anil Madhavapeddy. 2024. Modularizing reasoning about AI capabilities via abstract dijkstra monads. In Proceedings of the 12th ACM SIGPLAN Workshop on Higher-Order Programming with Effects (HOPE\u201924)."},{"key":"e_1_3_2_72_2","unstructured":"OpenAI. 2024. GPT-4 technical report. arXiv:2303.08774."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2023.3248401"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/CAIN58948.2023.00010"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533378"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.5555\/287893.287899"},{"key":"e_1_3_2_77_2","first-page":"1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"4","author":"Porcheron Martin","year":"2021","unstructured":"Martin Porcheron, Joel E. Fischer, and Stuart Reeves. 2021. Pulling back the curtain on the wizards of Oz. Proceedings of the ACM on Human-Computer Interaction 4, CSCW3 (Jan. 2021), 1\u201322."},{"key":"e_1_3_2_78_2","volume-title":"Learn AI-Assisted Python Programming with GitHub Copilot and ChatGPT","author":"Porter Leo","year":"2023","unstructured":"Leo Porter and Daniel Zingaro. 2023. Learn AI-Assisted Python Programming with GitHub Copilot and ChatGPT. Manning Publications, New York, NY."},{"key":"e_1_3_2_79_2","first-page":"7:1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"5","author":"Rakova Bogdana","year":"2021","unstructured":"Bogdana Rakova, Jingying Yang, Henriette Cramer, and Rumman Chowdhury. 2021. Where responsible AI meets reality: Practitioner perspectives on enablers for shifting organizational practices. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 7:1\u20137:23."},{"key":"e_1_3_2_80_2","unstructured":"Remington Rand Univac 1958. FLOW-MATIC Programming System. Remington Rand Univac. Retrieved from https:\/\/bitsavers.trailing-edge.com\/pdf\/univac\/flow-matic\/U1518_FLOW-MATIC_Programming_System_1958.pdf"},{"key":"e_1_3_2_81_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/VLHCC.2004.44","volume-title":"Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing.","author":"Ruthruff J. R.","year":"2004","unstructured":"J. R. Ruthruff, A. Phalgune, L. Beckwith, M. Burnett, and C. Cook. 2004. Rewarding \u201cgood\u201d behavior: End-user debugging and rewards. In Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing. IEEE, 115\u2013122."},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/800025.1198367"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3622758.3622882"},{"key":"e_1_3_2_84_2","unstructured":"Advait Sarkar Andrew D. Gordon Carina Negreanu Christian Poelitz Sruti Srinivasa Ragavan and Ben Zorn. 2022. What is it like to program with artificial intelligence? arXiv:2208.06213."},{"key":"e_1_3_2_85_2","first-page":"1","volume-title":"Proceedings of the ACM on Programming Languages","volume":"4","author":"Shaw Mary","year":"2022","unstructured":"Mary Shaw. 2022. Myths and mythconceptions: What does it mean to be a programming language, anyhow? Proceedings of the ACM on Programming Languages 4, HOPL (2022), 1\u201344."},{"key":"e_1_3_2_86_2","unstructured":"Noah Shinn Federico Cassano Edward Berman Ashwin Gopinath Karthik Narasimhan and Shunyu Yao. 2023. Reflexion: Language agents with verbal reinforcement learning. arXiv:2303.11366."},{"key":"e_1_3_2_87_2","unstructured":"Ilia Shumailov Zakhar Shumaylov Yiren Zhao Yarin Gal Nicolas Papernot and Ross Anderson. 2023. The curse of recursion: Training on generated data makes models forget. arXiv:2305.17493."},{"key":"e_1_3_2_88_2","doi-asserted-by":"crossref","unstructured":"Auste Simkute Lev Tankelevitch Viktor Kewenig Ava Elizabeth Scott Abigail Sellen and Sean Rintel. 2024. Ironies of generative AI: Understanding and mitigating productivity loss in human-AI interactions. arXiv:2402.11364.","DOI":"10.1080\/10447318.2024.2405782"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2887201"},{"key":"e_1_3_2_90_2","first-page":"345","volume-title":"Proceedings of the 27th International Conference on Intelligent User Interfaces","author":"Ragavan Sruti Srinivasa","year":"2022","unstructured":"Sruti Srinivasa Ragavan, Zhitao Hou, Yun Wang, Andrew D. Gordon, Haidong Zhang, and Dongmei Zhang. 2022. Gridbook: Natural language formulas for the spreadsheet grid. In Proceedings of the 27th International Conference on Intelligent User Interfaces, 345\u2013368."},{"key":"e_1_3_2_91_2","first-page":"864","volume-title":"Proceedings of the 2017 International Conference on Computing, Communication and Automation (ICCCA \u201917).","author":"Srivastava Apoorva","year":"2017","unstructured":"Apoorva Srivastava, Sukriti Bhardwaj, and Shipra Saraswat. 2017. SCRUM model for agile methodology. In Proceedings of the 2017 International Conference on Computing, Communication and Automation (ICCCA \u201917). IEEE, 864\u2013869."},{"key":"e_1_3_2_92_2","doi-asserted-by":"crossref","unstructured":"Emma Strubell Ananya Ganesh and Andrew McCallum. 2019. Energy and policy considerations for deep learning in NLP. arXiv:1906.02243.","DOI":"10.18653\/v1\/P19-1355"},{"key":"e_1_3_2_93_2","doi-asserted-by":"crossref","unstructured":"Chuyue Sun Ying Sheng Oded Padon and Clark W. Barrett. 2024. Clover: Closed-loop verifiable code generation. In AI Verification SAIV. Guy Avni Mirco Giacobbe Taylor T. Johnson Guy Katz Anna Lukina Nina Narodytska and Christian Schilling (Eds.) Lecture Notes in Computer Science Vol. 14846 Springer Cham 134\u2013155. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1906.02243","DOI":"10.1007\/978-3-031-65112-0_7"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/2034574.2034811"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3160738"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642902"},{"key":"e_1_3_2_97_2","unstructured":"Gemini Team. 2023. Gemini: A family of highly capable multimodal models. arXiv:2312.11805."},{"key":"e_1_3_2_98_2","unstructured":"Eric Thorn Shawn C. Kimmel and Michelle Chaka. 2018. A Framework for Automated Driving System Testable Cases and Scenarios. Technical Report DOT HS 812 623. United States Department of Transportation. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2312.11805"},{"key":"e_1_3_2_99_2","unstructured":"Michele Tufano Anisha Agarwal Jinu Jang Roshanak Zilouchian Moghaddam and Neel Sundaresan. 2024. AutoDev: Automated AI-driven development. arXiv:2403.08299."},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1093\/mind\/LIX.236.433"},{"key":"e_1_3_2_101_2","doi-asserted-by":"crossref","unstructured":"Priyan Vaithilingam Ian Arawjo and Elena L. Glassman. 2024. Imagining a future of designing with AI: Dynamic grounding constructive negotiation and sustainable motivation. arXiv:2402.07342.","DOI":"10.1145\/3643834.3661525"},{"key":"e_1_3_2_102_2","unstructured":"Changjie Wang Mariano Scazzariello Alireza Farshin Dejan Kostic and Marco Chiesa. 2023. Making network configuration human friendly. arxiv:2309.06342."},{"key":"e_1_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00262-6_11"},{"key":"e_1_3_2_104_2","unstructured":"Qingyun Wu Gagan Bansal Jieyu Zhang Yiran Wu Beibin Li Erkang Zhu Li Jiang Xiaoyun Zhang Shaokun Zhang Jiale Liu et al. 2023. AutoGen: Enabling next-gen LLM applications via multi-agent conversation. arXiv:2308.08155."},{"issue":"2","key":"e_1_3_2_105_2","doi-asserted-by":"crossref","first-page":"439","DOI":"10.16920\/jeet\/2024\/v37is2\/24072","article-title":"Exploring the potential of generative AI in shaping engineering education: Opportunities and challenges","volume":"37","author":"Yelamarthi Kumar","year":"2024","unstructured":"Kumar Yelamarthi, Raju Dandu, Mohan Rao, Venkata Prasanth Yanambaka, and Satish Mahajan. 2024. Exploring the potential of generative AI in shaping engineering education: Opportunities and challenges. Journal of Engineering Education Transformations 37, Special Issue 2 (2024), 439\u2013445.","journal-title":"Journal of Engineering Education Transformations"},{"key":"e_1_3_2_106_2","first-page":"50117","article-title":"ToolQA: A dataset for LLM question answering with external tools","volume":"36","author":"Zhuang Yuchen","year":"2023","unstructured":"Yuchen Zhuang, Yue Yu, Kuan Wang, Haotian Sun, and Chao Zhang. 2023. ToolQA: A dataset for LLM question answering with external tools. Advances in Neural Information Processing Systems 36 (2023), 50117\u201350143.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_107_2","doi-asserted-by":"publisher","DOI":"10.1145\/3633453"},{"key":"e_1_3_2_108_2","unstructured":"Mehrotra Pronita Parab Aishni and Gulwani Sumit. 2024. Enhancing creativity in large language models through associative thinking strategies. arXiv: 2405.06715. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2405.06715"},{"key":"e_1_3_2_109_2","unstructured":"Khlaaf Heidy. 2023. Toward Comprehensive Risk Assessments and Assurance of AI-Based Systems. Retrieved from https:\/\/www.trailofbits.com\/documents\/Toward_comprehensive_risk_assessments.pdf"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3708524","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3708524","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:46Z","timestamp":1750295866000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3708524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,26]]},"references-count":108,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3708524"],"URL":"https:\/\/doi.org\/10.1145\/3708524","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,26]]},"assertion":[{"value":"2024-04-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-15","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}