{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T21:00:25Z","timestamp":1765486825393,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":65,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557079","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:29:57Z","timestamp":1665883797000},"page":"2933-2943","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["Fooling MOSS Detection with Pretrained Language Models"],"prefix":"10.1145","author":[{"given":"Stella","family":"Biderman","sequence":"first","affiliation":[{"name":"Booz Allen Hamilton &amp; EleutherAI, McLean, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edward","family":"Raff","sequence":"additional","affiliation":[{"name":"Booz Allen Hamilton, McLean, VA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"135","article-title":"Designing quality e-learning environments for emergency remote teaching in coronavirus crisis","volume":"11","author":"Affouneh Saida","year":"2020","unstructured":"Saida Affouneh , Soheil Salha , and Zuheir N Khlaif . 2020 . Designing quality e-learning environments for emergency remote teaching in coronavirus crisis . Interdisciplinary Journal of Virtual Learning in Medical Sciences , Vol. 11 , 2 (2020), 135 -- 137 . Saida Affouneh, Soheil Salha, and Zuheir N Khlaif. 2020. Designing quality e-learning environments for emergency remote teaching in coronavirus crisis. Interdisciplinary Journal of Virtual Learning in Medical Sciences, Vol. 11, 2 (2020), 135--137.","journal-title":"Interdisciplinary Journal of Virtual Learning in Medical Sciences"},{"key":"e_1_3_2_1_2_1","volume-title":"http:\/\/www. cs. berkeley. edu\/moss\/","author":"Aiken Alex","year":"2000","unstructured":"Alex Aiken . 2000. Moss (measure of software similarity) plagiarism detection system. http:\/\/www. cs. berkeley. edu\/moss\/ ( 2000 ). Alex Aiken. 2000. Moss (measure of software similarity) plagiarism detection system. http:\/\/www. cs. berkeley. edu\/moss\/ (2000)."},{"key":"e_1_3_2_1_3_1","volume-title":"Program synthesis with large language models. arXiv preprint arXiv:2108.07732","author":"Austin Jacob","year":"2021","unstructured":"Jacob Austin , Augustus Odena , Maxwell Nye , Maarten Bosma , Henryk Michalewski , David Dohan , Ellen Jiang , Carrie Cai , Michael Terry , Quoc V. Le , and Charles Sutton . 2021. Program synthesis with large language models. arXiv preprint arXiv:2108.07732 ( 2021 ). Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc V. Le, and Charles Sutton. 2021. Program synthesis with large language models. arXiv preprint arXiv:2108.07732 (2021)."},{"key":"e_1_3_2_1_4_1","unstructured":"Stella Biderman and Walter J Scheirer. 2020. Pitfalls in Machine Learning Research: Reexamining the Development Cycle. (2020).  Stella Biderman and Walter J Scheirer. 2020. Pitfalls in Machine Learning Research: Reexamining the Development Cycle. (2020)."},{"key":"e_1_3_2_1_5_1","volume-title":"The values encoded in machine learning research. arXiv preprint arXiv:2106.15590","author":"Birhane Abeba","year":"2021","unstructured":"Abeba Birhane , Pratyusha Kalluri , Dallas Card , William Agnew , Ravit Dotan , and Michelle Bao . 2021. The values encoded in machine learning research. arXiv preprint arXiv:2106.15590 ( 2021 ). Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, and Michelle Bao. 2021. The values encoded in machine learning research. arXiv preprint arXiv:2106.15590 (2021)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Sid Black Stella Biderman Eric Hallahan Quentin Anthony Leo Gao Laurence Golding Horace He Connor Leahy Kyle McDonell Jason Phang etal 2022. Gpt-neox-20b: An open-source autoregressive language model. arXiv preprint arXiv:2204.06745 (2022).  Sid Black Stella Biderman Eric Hallahan Quentin Anthony Leo Gao Laurence Golding Horace He Connor Leahy Kyle McDonell Jason Phang et al. 2022. Gpt-neox-20b: An open-source autoregressive language model. arXiv preprint arXiv:2204.06745 (2022).","DOI":"10.18653\/v1\/2022.bigscience-1.9"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.1999.840376"},{"key":"e_1_3_2_1_8_1","volume-title":"Lin (Eds.)","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , Sandhini Agarwal , Ariel Herbert-Voss , Gretchen Krueger , Tom Henighan , Rewon Child , Aditya Ramesh , Daniel Ziegler , Jeffrey Wu , Clemens Winter , Chris Hesse , Mark Chen , Eric Sigler , Mateusz Litwin , Scott Gray , Benjamin Chess , Jack Clark , Christopher Berner , Sam McCandlish , Alec Radford , Ilya Sutskever , and Dario Amodei . 2020 . Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H . Lin (Eds.) , Vol. 33 . Curran Associates, Inc. , 1877--1901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 1877--1901."},{"volume-title":"28th $$USENIX$$ Security Symposium ($$USENIX$$ Security 19). 267--284.","author":"Carlini Nicholas","key":"e_1_3_2_1_9_1","unstructured":"Nicholas Carlini , Chang Liu , \u00dalfar Erlingsson , Jernej Kos , and Dawn Song . 2019. The secret sharer: Evaluating and testing unintended memorization in neural networks . In 28th $$USENIX$$ Security Symposium ($$USENIX$$ Security 19). 267--284. Nicholas Carlini, Chang Liu, \u00dalfar Erlingsson, Jernej Kos, and Dawn Song. 2019. The secret sharer: Evaluating and testing unintended memorization in neural networks. In 28th $$USENIX$$ Security Symposium ($$USENIX$$ Security 19). 267--284."},{"volume-title":"30th $$USENIX$$ Security Symposium ($$USENIX$$ Security 21). 2633--2650.","author":"Carlini Nicholas","key":"e_1_3_2_1_10_1","unstructured":"Nicholas Carlini , Florian Tramer , Eric Wallace , Matthew Jagielski , Ariel Herbert-Voss , Katherine Lee , Adam Roberts , Tom Brown , Dawn Song , Ulfar Erlingsson , Alina Oprea , and Colin Raffel . 2021. Extracting training data from large language models . In 30th $$USENIX$$ Security Symposium ($$USENIX$$ Security 21). 2633--2650. Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, and Colin Raffel. 2021. Extracting training data from large language models. In 30th $$USENIX$$ Security Symposium ($$USENIX$$ Security 21). 2633--2650."},{"key":"e_1_3_2_1_11_1","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde Jared Kaplan Harrison Edwards Yura Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea. Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such David W. Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William H. Guss Alex Nichol Igor Babuschkin S. Arun Balaji Shantanu Jain Andrew Carr Jan Leike Joshua Achiam Vedant Misra Evan Morikawa Alec Radford Matthew M. Knight Miles Brundage Mira Murati Katie Mayer Peter Welinder Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever and Wojciech Zaremba. 2021a. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021).  Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde Jared Kaplan Harrison Edwards Yura Burda Nicholas Joseph Greg Brockman Alex Ray Raul Puri Gretchen Krueger Michael Petrov Heidy Khlaaf Girish Sastry Pamela Mishkin Brooke Chan Scott Gray Nick Ryder Mikhail Pavlov Alethea. Power Lukasz Kaiser Mohammad Bavarian Clemens Winter Philippe Tillet Felipe Petroski Such David W. Cummings Matthias Plappert Fotios Chantzis Elizabeth Barnes Ariel Herbert-Voss William H. Guss Alex Nichol Igor Babuschkin S. Arun Balaji Shantanu Jain Andrew Carr Jan Leike Joshua Achiam Vedant Misra Evan Morikawa Alec Radford Matthew M. Knight Miles Brundage Mira Murati Katie Mayer Peter Welinder Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever and Wojciech Zaremba. 2021a. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021)."},{"key":"e_1_3_2_1_12_1","volume-title":"Adaprompt: Adaptive prompt-based finetuning for relation extraction. arXiv preprint arXiv:2104.07650","author":"Chen Xiang","year":"2021","unstructured":"Xiang Chen , Xin Xie , Ningyu Zhang , Jiahuan Yan , Shumin Deng , Chuanqi Tan , Fei Huang , Luo Si , and Huajun Chen . 2021 b. Adaprompt: Adaptive prompt-based finetuning for relation extraction. arXiv preprint arXiv:2104.07650 (2021). Xiang Chen, Xin Xie, Ningyu Zhang, Jiahuan Yan, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, and Huajun Chen. 2021b. Adaprompt: Adaptive prompt-based finetuning for relation extraction. arXiv preprint arXiv:2104.07650 (2021)."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 4th International Plagiarism Conference (IPC-2010)","author":"Chong Miranda","year":"2010","unstructured":"Miranda Chong , Lucia Specia , and Ruslan Mitkov . 2010 . Using natural language processing for automatic detection of plagiarism . In Proceedings of the 4th International Plagiarism Conference (IPC-2010) . Miranda Chong, Lucia Specia, and Ruslan Mitkov. 2010. Using natural language processing for automatic detection of plagiarism. In Proceedings of the 4th International Plagiarism Conference (IPC-2010)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/0031721717745548"},{"key":"e_1_3_2_1_15_1","volume-title":"VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance. arXiv preprint arXiv:2204.08583","author":"Crowson Katherine","year":"2022","unstructured":"Katherine Crowson , Stella Biderman , Daniel Kornis , Dashiell Stander , Eric Hallahan , Louis Castricato , and Edward Raff . 2022. VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance. arXiv preprint arXiv:2204.08583 ( 2022 ). Katherine Crowson, Stella Biderman, Daniel Kornis, Dashiell Stander, Eric Hallahan, Louis Castricato, and Edward Raff. 2022. VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance. arXiv preprint arXiv:2204.08583 (2022)."},{"key":"e_1_3_2_1_17_1","volume-title":"Can software improve marker accuracy at detecting contract cheating? A pilot study of the Turnitin authorship investigate alpha. Assessment & Evaluation in higher education","author":"Dawson Phillip","year":"2020","unstructured":"Phillip Dawson , Wendy Sutherland-Smith , and Mark Ricksen . 2020. Can software improve marker accuracy at detecting contract cheating? A pilot study of the Turnitin authorship investigate alpha. Assessment & Evaluation in higher education , Vol. 45 , 4 ( 2020 ), 473--482. Phillip Dawson, Wendy Sutherland-Smith, and Mark Ricksen. 2020. Can software improve marker accuracy at detecting contract cheating? A pilot study of the Turnitin authorship investigate alpha. Assessment & Evaluation in higher education, Vol. 45, 4 (2020), 473--482."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428206"},{"key":"e_1_3_2_1_19_1","volume-title":"Program Synthesis: Calculus, Differential Equations, Linear Algebra, and More. arXiv preprint arXiv:2112.15594","author":"Drori Iddo","year":"2021","unstructured":"Iddo Drori , Sunny Tran , Roman Wang , Newman Cheng , Kevin Liu , Leonard Tang , Elizabeth Ke , Nikhil Singh , Taylor L Patti , Jayson Lynch , 2021 . A Neural Network Solves and Generates Mathematics Problems by Program Synthesis: Calculus, Differential Equations, Linear Algebra, and More. arXiv preprint arXiv:2112.15594 (2021). Iddo Drori, Sunny Tran, Roman Wang, Newman Cheng, Kevin Liu, Leonard Tang, Elizabeth Ke, Nikhil Singh, Taylor L Patti, Jayson Lynch, et al. 2021. A Neural Network Solves and Generates Mathematics Problems by Program Synthesis: Calculus, Differential Equations, Linear Algebra, and More. arXiv preprint arXiv:2112.15594 (2021)."},{"key":"e_1_3_2_1_20_1","volume-title":"Solving Linear Algebra by Program Synthesis. arXiv preprint arXiv:2111.08171","author":"Drori Iddo","year":"2021","unstructured":"Iddo Drori and Nakul Verma . 2021. Solving Linear Algebra by Program Synthesis. arXiv preprint arXiv:2111.08171 ( 2021 ). Iddo Drori and Nakul Verma. 2021. Solving Linear Algebra by Program Synthesis. arXiv preprint arXiv:2111.08171 (2021)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2010.03.505"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0360-1315(87)90042-X"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357713.3384290"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-43687-2_68"},{"key":"e_1_3_2_1_25_1","volume-title":"InCoder: A Generative Model for Code Infilling and Synthesis. arXiv preprint arXiv:2204.05999","author":"Fried Daniel","year":"2022","unstructured":"Daniel Fried , Armen Aghajanyan , Jessy Lin , Sida Wang , Eric Wallace , Freda Shi , Ruiqi Zhong , Wen-tau Yih, Luke Zettlemoyer , and Mike Lewis . 2022. InCoder: A Generative Model for Code Infilling and Synthesis. arXiv preprint arXiv:2204.05999 ( 2022 ). Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Wen-tau Yih, Luke Zettlemoyer, and Mike Lewis. 2022. InCoder: A Generative Model for Code Infilling and Synthesis. arXiv preprint arXiv:2204.05999 (2022)."},{"key":"e_1_3_2_1_26_1","volume-title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv preprint arXiv:2101.00027","author":"Gao Leo","year":"2020","unstructured":"Leo Gao , Stella Biderman , Sid Black , Laurence Golding , Travis Hoppe , Charles Foster , Jason Phang , Horace He , Anish Thite , Noa Nabeshima , Shawn Presser , and Connor Leahy . 2020 . The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv preprint arXiv:2101.00027 (2020). Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy. 2020. The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv preprint arXiv:2101.00027 (2020)."},{"key":"e_1_3_2_1_27_1","volume-title":"Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances. arXiv preprint arXiv:2204","author":"Han Seungju","year":"2022","unstructured":"Seungju Han , Beomsu Kim , Jin Yong Yoo , Seokjun Seo , Sangbum Kim , Enkhbayar Erdenee , and Buru Chang . 2022 . Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances. arXiv preprint arXiv:2204 .10825 (2022). Seungju Han, Beomsu Kim, Jin Yong Yoo, Seokjun Seo, Sangbum Kim, Enkhbayar Erdenee, and Buru Chang. 2022. Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances. arXiv preprint arXiv:2204.10825 (2022)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.161"},{"key":"e_1_3_2_1_29_1","volume-title":"Measuring Coding Challenge Competence With APPS. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track.","author":"Hendrycks Dan","year":"2021","unstructured":"Dan Hendrycks , Steven Basart , Saurav Kadavath , Mantas Mazeika , Akul Arora , Ethan Guo , Collin Burns , Samir Puranik , Horace He , Dawn Song , and Jacob Steinhardt . 2021 . Measuring Coding Challenge Competence With APPS. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track. Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt. 2021. Measuring Coding Challenge Competence With APPS. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track."},{"key":"e_1_3_2_1_30_1","volume-title":"The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751","author":"Holtzman Ari","year":"2019","unstructured":"Ari Holtzman , Jan Buys , Li Du , Maxwell Forbes , and Yejin Choi . 2019. The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751 ( 2019 ). Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2019. The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751 (2019)."},{"key":"e_1_3_2_1_31_1","volume-title":"Charu C Aggarwal, and Aston Zhang.","author":"Hu Zhiqiang","year":"2020","unstructured":"Zhiqiang Hu , Roy Ka-Wei Lee , Charu C Aggarwal, and Aston Zhang. 2020 . Text Style Transfer: A Review and Experimental Evaluation . arXiv preprint arXiv:2010.12742 (2020). Zhiqiang Hu, Roy Ka-Wei Lee, Charu C Aggarwal, and Aston Zhang. 2020. Text Style Transfer: A Review and Experimental Evaluation. arXiv preprint arXiv:2010.12742 (2020)."},{"key":"e_1_3_2_1_32_1","volume-title":"Are Algorithms Value-Free? Feminist Theoretical Virtues in Machine Learning. Journal of Moral Philosophy, special issue on \"Justice, Power, and the Ethics of Algorithmic Decision-Making","author":"Johnson Gabbrielle","year":"2022","unstructured":"Gabbrielle Johnson . 2022. Are Algorithms Value-Free? Feminist Theoretical Virtues in Machine Learning. Journal of Moral Philosophy, special issue on \"Justice, Power, and the Ethics of Algorithmic Decision-Making \" ( 2022 ). Gabbrielle Johnson. 2022. Are Algorithms Value-Free? Feminist Theoretical Virtues in Machine Learning. Journal of Moral Philosophy, special issue on \"Justice, Power, and the Ethics of Algorithmic Decision-Making\" (2022)."},{"key":"e_1_3_2_1_33_1","volume-title":"Transformation Of Learning For Early Childhood Education Through Parent Assistance In The Pandemic Covid-19","volume":"20","author":"Pramono Rudy","year":"2020","unstructured":"Juliana, Rudy Pramono , Rizaldi Parani , and Arifin Djakasaputra . 2020 . Transformation Of Learning For Early Childhood Education Through Parent Assistance In The Pandemic Covid-19 . Transformation Of Learning For Early Childhood Education Through Parent Assistance In The Pandemic Covid-19 , Vol. 20 , XX (2020), 1--14. Juliana, Rudy Pramono, Rizaldi Parani, and Arifin Djakasaputra. 2020. Transformation Of Learning For Early Childhood Education Through Parent Assistance In The Pandemic Covid-19. Transformation Of Learning For Early Childhood Education Through Parent Assistance In The Pandemic Covid-19, Vol. 20, XX (2020), 1--14."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.15388\/infedu.2019.15"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education. 1--19","author":"Karnalim Oscar","year":"2020","unstructured":"Oscar Karnalim , Judy Sheard , Ilir Dema , Amey Karkare , Juho Leinonen , Michael Liut , and Ren\u00e9e McCauley . 2020 . Choosing code segments to exclude from code similarity detection . In Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education. 1--19 . Oscar Karnalim, Judy Sheard, Ilir Dema, Amey Karkare, Juho Leinonen, Michael Liut, and Ren\u00e9e McCauley. 2020. Choosing code segments to exclude from code similarity detection. In Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education. 1--19."},{"key":"e_1_3_2_1_36_1","volume-title":"International Conference on Learning Representations.","author":"Krishna Kalpesh","year":"2020","unstructured":"Kalpesh Krishna , Gaurav Singh Tomar , Ankur P. Parikh , Nicolas Papernot , and Mohit Iyyer . 2020 . Thieves on Sesame Street! Model Extraction of BERT-based APIs . In International Conference on Learning Representations. Kalpesh Krishna, Gaurav Singh Tomar, Ankur P. Parikh, Nicolas Papernot, and Mohit Iyyer. 2020. Thieves on Sesame Street! Model Extraction of BERT-based APIs. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400412331363843"},{"key":"e_1_3_2_1_38_1","series-title":"Volume 4","volume-title":"The State of AI Ethics Report","author":"Leahy Connor","unstructured":"Connor Leahy and Stella Biderman . 2021. The Hard Problem of Aligning AI to Human Values . In The State of AI Ethics Report ( Volume 4 ). Connor Leahy and Stella Biderman. 2021. The Hard Problem of Aligning AI to Human Values. In The State of AI Ethics Report (Volume 4)."},{"key":"e_1_3_2_1_39_1","volume-title":"CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. arXiv preprint arXiv:2201.06796","author":"Lee Mina","year":"2022","unstructured":"Mina Lee , Percy Liang , and Qian Yang . 2022b. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. arXiv preprint arXiv:2201.06796 ( 2022 ). Mina Lee, Percy Liang, and Qian Yang. 2022b. CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities. arXiv preprint arXiv:2201.06796 (2022)."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.in2writing-1.9"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.555"},{"key":"e_1_3_2_1_42_1","volume-title":"Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190","author":"Li Xiang Lisa","year":"2021","unstructured":"Xiang Lisa Li and Percy Liang . 2021 . Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190 (2021). Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190 (2021)."},{"key":"e_1_3_2_1_43_1","volume-title":"prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv:2107.13586","author":"Liu Pengfei","year":"2021","unstructured":"Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , and Graham Neubig . 2021. Pre-train , prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv:2107.13586 ( 2021 ). Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv:2107.13586 (2021)."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1387"},{"key":"e_1_3_2_1_45_1","volume-title":"2018 5th International Symposium on Emerging Trends and Technologies in Libraries and Information Services (ETTLIS). Citeseer.","author":"Luke Divya","year":"2014","unstructured":"Divya Luke , PS Divya , Sony L Johnson , S Sreeprabha , and Elizabeth B Varghese . 2014 . Software plagiarism detection techniques: A comparative study . In 2018 5th International Symposium on Emerging Trends and Technologies in Libraries and Information Services (ETTLIS). Citeseer. Divya Luke, PS Divya, Sony L Johnson, S Sreeprabha, and Elizabeth B Varghese. 2014. Software plagiarism detection techniques: A comparative study. In 2018 5th International Symposium on Emerging Trends and Technologies in Libraries and Information Services (ETTLIS). Citeseer."},{"key":"e_1_3_2_1_46_1","volume-title":"Neural Program Generation Modulo Static Analysis. In Thirty-Fifth Conference on Neural Information Processing Systems.","author":"Mukherjee Rohan","year":"2021","unstructured":"Rohan Mukherjee , Yeming Wen , Dipak Chaudhari , Thomas Reps , Swarat Chaudhuri , and Chris Jermaine . 2021 . Neural Program Generation Modulo Static Analysis. In Thirty-Fifth Conference on Neural Information Processing Systems. Rohan Mukherjee, Yeming Wen, Dipak Chaudhari, Thomas Reps, Swarat Chaudhuri, and Chris Jermaine. 2021. Neural Program Generation Modulo Static Analysis. In Thirty-Fifth Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1158"},{"key":"e_1_3_2_1_48_1","volume-title":"Prompt Engineering for Text-Based Generative Art. arXiv preprint arXiv:2204.13988","author":"Oppenlaender Jonas","year":"2022","unstructured":"Jonas Oppenlaender . 2022. Prompt Engineering for Text-Based Generative Art. arXiv preprint arXiv:2204.13988 ( 2022 ). Jonas Oppenlaender. 2022. Prompt Engineering for Text-Based Generative Art. arXiv preprint arXiv:2204.13988 (2022)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/EDUCON.2018.8363346"},{"key":"e_1_3_2_1_50_1","volume-title":"Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683","author":"Raffel Colin","year":"2019","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J Liu . 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 ( 2019 ). Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv preprint arXiv:1910.10683 (2019)."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451760"},{"key":"e_1_3_2_1_52_1","volume-title":"Multitask Prompted Training Enables Zero-Shot Task Generalization. In The Tenth International Conference on Learning Representations.","author":"Sanh Victor","year":"2022","unstructured":"Victor Sanh , Albert Webson , Colin Raffel , Stephen Bach , Lintang Sutawika , Zaid Alyafeai , Antoine Chaffin , Arnaud Stiegler , Teven Le Scao , Arun Raja , 2022 . Multitask Prompted Training Enables Zero-Shot Task Generalization. In The Tenth International Conference on Learning Representations. Victor Sanh, Albert Webson, Colin Raffel, Stephen Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, et al. 2022. Multitask Prompted Training Enables Zero-Shot Task Generalization. In The Tenth International Conference on Learning Representations."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2893435"},{"key":"e_1_3_2_1_54_1","volume-title":"Teaching C programming using automated unit testing and test-driven development-Design and efficacy study. Computer Applications in Engineering Education","author":"Sheikh Waseem","year":"2022","unstructured":"Waseem Sheikh . 2022. Teaching C programming using automated unit testing and test-driven development-Design and efficacy study. Computer Applications in Engineering Education ( 2022 ). Waseem Sheikh. 2022. Teaching C programming using automated unit testing and test-driven development-Design and efficacy study. Computer Applications in Engineering Education (2022)."},{"key":"e_1_3_2_1_55_1","volume-title":"Learning Methods for Solving Astronomy Course Problems. preprint","author":"Shporer Avi","year":"2021","unstructured":"Avi Shporer , Sunny Tran , Nikhil Singh , Brandon Kates , Jayson Lynch , and Iddo Drori . 2021. Learning Methods for Solving Astronomy Course Problems. preprint ( 2021 ). https:\/\/www.cs.columbia.edu\/ idrori\/Learning_Methods_for_Solving_Astronomy_Course_Problems.pdf Avi Shporer, Sunny Tran, Nikhil Singh, Brandon Kates, Jayson Lynch, and Iddo Drori. 2021. Learning Methods for Solving Astronomy Course Problems. preprint (2021). https:\/\/www.cs.columbia.edu\/ idrori\/Learning_Methods_for_Solving_Astronomy_Course_Problems.pdf"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3051466"},{"key":"e_1_3_2_1_57_1","volume-title":"Asian Conference on Machine Learning. PMLR, 470--485","author":"Tran Sunny","year":"2021","unstructured":"Sunny Tran , Pranav Krishna , Ishan Pakuwal , Prabhakar Kafle , Nikhil Singh , Jayson Lynch , and Iddo Drori . 2021 . Solving machine learning problems . In Asian Conference on Machine Learning. PMLR, 470--485 . Sunny Tran, Pranav Krishna, Ishan Pakuwal, Prabhakar Kafle, Nikhil Singh, Jayson Lynch, and Iddo Drori. 2021. Solving machine learning problems. In Asian Conference on Machine Learning. PMLR, 470--485."},{"key":"e_1_3_2_1_58_1","volume-title":"Mapping the Latent Spaces of Culture. To appear in Startwords","author":"Underwood Ted","year":"2022","unstructured":"Ted Underwood . 2022. Mapping the Latent Spaces of Culture. To appear in Startwords ( 2022 ). https:\/\/doi.org\/10.17613\/faaa-1r21 10.17613\/faaa-1r21 Ted Underwood. 2022. Mapping the Latent Spaces of Culture. To appear in Startwords (2022). https:\/\/doi.org\/10.17613\/faaa-1r21"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_3_2_1_60_1","unstructured":"Ben Wang and Aran Komatsuzaki. 2021. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model.  Ben Wang and Aran Komatsuzaki. 2021. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511157"},{"key":"e_1_3_2_1_62_1","volume-title":"AI Creativity and the Human-AI Co-creation Model. In International Conference on Human-Computer Interaction. Springer, 171--190","author":"Wu Zhuohao","year":"2021","unstructured":"Zhuohao Wu , Danwen Ji , Kaiwen Yu , Xianxu Zeng , Dingming Wu , and Mohammad Shidujaman . 2021 . AI Creativity and the Human-AI Co-creation Model. In International Conference on Human-Computer Interaction. Springer, 171--190 . Zhuohao Wu, Danwen Ji, Kaiwen Yu, Xianxu Zeng, Dingming Wu, and Mohammad Shidujaman. 2021. AI Creativity and the Human-AI Co-creation Model. In International Conference on Human-Computer Interaction. Springer, 171--190."},{"key":"e_1_3_2_1_63_1","volume-title":"A systematic evaluation of large language models of code. arXiv preprint arXiv:2202.13169","author":"Xu Frank F","year":"2022","unstructured":"Frank F Xu , Uri Alon , Graham Neubig , and Vincent J Hellendoorn . 2022. A systematic evaluation of large language models of code. arXiv preprint arXiv:2202.13169 ( 2022 ). Frank F Xu, Uri Alon, Graham Neubig, and Vincent J Hellendoorn. 2022. A systematic evaluation of large language models of code. arXiv preprint arXiv:2202.13169 (2022)."},{"key":"e_1_3_2_1_64_1","volume-title":"The Policy of Credit Payment Relaxation in Overcoming the Impact of Covid-19 Spread to the Economic Society in Indonesia. Journal of Advanced Research in Dynamical and Control Systems","author":"Yasid Muhammad","year":"2020","unstructured":"Muhammad Yasid , Gomgom T.P. Siregar , and Muhammad Ansori Lubis . 2020. The Policy of Credit Payment Relaxation in Overcoming the Impact of Covid-19 Spread to the Economic Society in Indonesia. Journal of Advanced Research in Dynamical and Control Systems ( 2020 ). Muhammad Yasid, Gomgom T.P. Siregar, and Muhammad Ansori Lubis. 2020. The Policy of Credit Payment Relaxation in Overcoming the Impact of Covid-19 Spread to the Economic Society in Indonesia. Journal of Advanced Research in Dynamical and Control Systems (2020)."},{"key":"e_1_3_2_1_65_1","volume-title":"Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. 841--852","author":"Yuan Ann","year":"2022","unstructured":"Ann Yuan , Andy Coenen , Emily Reif , and Daphne Ippolito . 2022 . Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. 841--852 . Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. 841--852."},{"key":"e_1_3_2_1_66_1","volume-title":"Xi Victoria Lin, et al","author":"Zhang Susan","year":"2022","unstructured":"Susan Zhang , Stephen Roller , Naman Goyal , Mikel Artetxe , Moya Chen , Shuohui Chen , Christopher Dewan , Mona Diab , Xian Li , Xi Victoria Lin, et al . 2022 . OPT : Open Pre-trained Transformer Language Models . arXiv preprint arXiv:2205.01068 (2022). Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022. OPT: Open Pre-trained Transformer Language Models. arXiv preprint arXiv:2205.01068 (2022)."}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Atlanta GA USA","acronym":"CIKM '22"},"container-title":["Proceedings of the 31st ACM International Conference on Information &amp; Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557079","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557079","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:55Z","timestamp":1750188655000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":65,"alternative-id":["10.1145\/3511808.3557079","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557079","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}