{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:12:00Z","timestamp":1776100320259,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":112,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T00:00:00Z","timestamp":1733097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF","award":["IIS-2014552, DGE-1565570"],"award-info":[{"award-number":["IIS-2014552, DGE-1565570"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,2]]},"DOI":"10.1145\/3658644.3670392","type":"proceedings-article","created":{"date-parts":[[2024,12,9]],"date-time":"2024-12-09T12:19:20Z","timestamp":1733746760000},"page":"2236-2250","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["On the Detectability of ChatGPT Content: Benchmarking, Methodology, and Evaluation through the Lens of Academic Writing"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-6841-9702","authenticated-orcid":false,"given":"Zeyan","family":"Liu","sequence":"first","affiliation":[{"name":"EECS\/I2S, The University of Kansas, Lawrence, KS, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3647-8770","authenticated-orcid":false,"given":"Zijun","family":"Yao","sequence":"additional","affiliation":[{"name":"EECS\/I2S, The University of Kansas, Lawrence, KS, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4079-2228","authenticated-orcid":false,"given":"Fengjun","family":"Li","sequence":"additional","affiliation":[{"name":"EECS\/I2S, The University of Kansas, Lawrence, KS, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8196-2436","authenticated-orcid":false,"given":"Bo","family":"Luo","sequence":"additional","affiliation":[{"name":"EECS\/I2S, The University of Kansas, Lawrence, KS, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,12,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Fatih Kadir Ak?n et al. 2023. Awesome ChatGPT Prompts. Available at: https:\/\/github.com\/f\/awesome-chatgpt-prompts."},{"key":"e_1_3_2_1_2_1","unstructured":"Kevin Amiri. 2023. A collection of ChatGPT GPT-3.5 GPT-4 prompts. Available at: https:\/\/github.com\/kevinamiri\/Instructgpt-prompts."},{"key":"e_1_3_2_1_3_1","volume-title":"Patterns","author":"Anders Brent A","unstructured":"Brent A Anders. 2023. Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?. In Patterns, Vol. 4. Elsevier."},{"key":"e_1_3_2_1_4_1","unstructured":"Anton Bakhtin Sam Gross Myle Ott Yuntian Deng Marc'Aurelio Ranzato and Arthur Szlam. 2019. Real or fake? learning to discriminate machine from human generated text. In arXiv:1906.03351."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S18-1100"},{"key":"e_1_3_2_1_6_1","volume-title":"NeurlIPS","volume":"13","author":"Bengio Yoshua","year":"2000","unstructured":"Yoshua Bengio, R\u00e9jean Ducharme, and Pascal Vincent. 2000. A neural probabilistic language model. In NeurlIPS, Vol. 13."},{"key":"e_1_3_2_1_7_1","volume-title":"Variation across speech and writing","author":"Biber Douglas","unstructured":"Douglas Biber. 1991. Variation across speech and writing. Cambridge University Press."},{"key":"e_1_3_2_1_8_1","volume-title":"Challenging stereotypes about academic writing: Complexity, elaboration, explicitness","author":"Biber Douglas","unstructured":"Douglas Biber and Bethany Gray. 2010. Challenging stereotypes about academic writing: Complexity, elaboration, explicitness. In Journal of English for Academic Purposes, Vol. 9. Elsevier, 2--20."},{"key":"e_1_3_2_1_9_1","unstructured":"Arend Groot Bleumink and Aaron Shikhule. 2023. Keeping AI Honest in Education: Identifying GPT-generated text. Available at: https:\/\/www.aicheatcheck.com\/."},{"key":"e_1_3_2_1_10_1","volume-title":"ACL 2023 Policy on AI Writing Assistance. https:\/\/2023","author":"Boyd-Graber Jordan","year":"2023","unstructured":"Jordan Boyd-Graber, Naoaki Okazaki, and Anna Rogers. 2023. ACL 2023 Policy on AI Writing Assistance. https:\/\/2023.aclweb.org\/blog\/ACL-2023-policy\/."},{"key":"e_1_3_2_1_11_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. In NeurlIPS."},{"key":"e_1_3_2_1_12_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. In NeurlIPS."},{"key":"e_1_3_2_1_13_1","volume-title":"International Conference on Language Resources and Evaluation.","author":"Br\u00fcmmer Martin","year":"2016","unstructured":"Martin Br\u00fcmmer, Milan Dojchinovski, and Sebastian Hellmann. 2016. DBpedia abstracts: a large-scale, open, multilingual NLP training corpus. In International Conference on Language Resources and Evaluation."},{"key":"e_1_3_2_1_14_1","unstructured":"Enrico Cambiaso and Luca Caviglione. 2023. Scamming the Scammers: Using ChatGPT to Reply Mails for Wasting Time and Resources. In arXiv:2303.13521."},{"key":"e_1_3_2_1_15_1","volume-title":"Writing scientific research articles: Strategy and steps","author":"Cargill Margaret","unstructured":"Margaret Cargill and Patrick O'Connor. 2021. Writing scientific research articles: Strategy and steps. John Wiley & Sons."},{"key":"e_1_3_2_1_16_1","volume-title":"Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio.","author":"Cho Kyunghyun","year":"2014","unstructured":"Kyunghyun Cho, Bart Van Merri\u00ebnboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In EMNLP."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3409116"},{"key":"e_1_3_2_1_18_1","volume-title":"Frontiers in Public Health","volume":"11","author":"Angelis Luigi De","year":"2023","unstructured":"Luigi De Angelis, Francesco Baglivo, Guglielmo Arzilli, Gaetano Pierpaolo Privitera, Paolo Ferragina, Alberto Eugenio Tozzi, and Caterina Rizzo. 2023. ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health. In Frontiers in Public Health, Vol. 11. Frontiers, 1567."},{"key":"e_1_3_2_1_19_1","unstructured":"Erik Derner and Kristina Batistivc. 2023. Beyond the Safeguards: Exploring the Security Risks of ChatGPT. In arXiv:2305.08005."},{"key":"e_1_3_2_1_20_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. In arXiv:1810.04805.","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. In arXiv:1810.04805."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"David Duki\u0107 Dominik Kevca and Dominik Stipi\u0107. 2020. Are you human? Detecting bots on Twitter Using BERT. In DSAA.","DOI":"10.1109\/DSAA49011.2020.00089"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Sabit Ekin. 2023. Prompt Engineering For ChatGPT: A Quick Guide To Techniques Tips And Best Practices. TechRxiv.","DOI":"10.36227\/techrxiv.22683919"},{"key":"e_1_3_2_1_23_1","unstructured":"Mohammed Abu El-Nasr. 2023. Sentence embeddings using Siamese RoBERTa-networks. Available at: https:\/\/keras.io\/examples\/nlp\/sentence_embeddings_with_sbert\/."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818717"},{"key":"e_1_3_2_1_25_1","volume-title":"Journal of Applied Learning and Teaching","volume":"6","author":"Firat Mehmet","year":"2023","unstructured":"Mehmet Firat. 2023. What ChatGPT means for universities: Perceptions of scholars and students. In Journal of Applied Learning and Teaching, Vol. 6."},{"key":"e_1_3_2_1_26_1","volume-title":"Jama","volume":"329","author":"Flanagin Annette","year":"2023","unstructured":"Annette Flanagin, Kirsten Bibbins-Domingo, Michael Berkwits, and Stacy L Christiansen. 2023. Nonhuman \u201cauthors\u201d and implications for the integrity of scientific publication and medical knowledge. In Jama, Vol. 329. American Medical Association, 637--639."},{"key":"e_1_3_2_1_27_1","unstructured":"The Hewlett Foundation. 2012. The Hewlett Foundation: Automated Essay Scoring. Kaggle available at: https:\/\/www.kaggle.com\/c\/asap-aes."},{"key":"e_1_3_2_1_28_1","unstructured":"Catherine A Gao Frederick M Howard Nikolay S Markov Emma C Dyer Siddhi Ramesh Yuan Luo and Alexander T Pearson. 2022. Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector plagiarism detector and blinded human reviewers. In bioRxiv:2022.12.23.521610."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-4317"},{"key":"e_1_3_2_1_30_1","volume-title":"GLTR: Statistical Detection and Visualization of Generated Text. In ACL.","author":"Gehrmann Sebastian","year":"2019","unstructured":"Sebastian Gehrmann, Hendrik Strobelt, and Alexander M Rush. 2019. GLTR: Statistical Detection and Visualization of Generated Text. In ACL."},{"key":"e_1_3_2_1_31_1","unstructured":"Noah Goodman. 2023. Meta-Prompt: A Simple Self-Improving Language Agent. Available at: https:\/\/noahgoodman.substack.com\/p\/meta-prompt-a-simple-self-improving."},{"key":"e_1_3_2_1_32_1","volume-title":"Electric Sheep on the Pastures of Disinformation and Targeted Phishing Campaigns: The Security Implications of ChatGPT","author":"Gradonm Kacper T","unstructured":"Kacper T Gradonm. 2023. Electric Sheep on the Pastures of Disinformation and Targeted Phishing Campaigns: The Security Implications of ChatGPT. In IEEE S&P."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOTEH57020.2023.10094141"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Derek Greene and P\u00e1draig Cunningham. 2006. Practical Solutions to the Problem of Diagonal Dominance in Kernel Document Clustering. In ICML.","DOI":"10.1145\/1143844.1143892"},{"key":"e_1_3_2_1_35_1","unstructured":"Biyang Guo Xin Zhang Ziyuan Wang Minqi Jiang Jinran Nie Yuxuan Ding Jianwei Yue and Yupeng Wu. 2023. How Close is ChatGPT to Human Experts? Comparison Corpus Evaluation and Detection. In arXiv:2301.07597."},{"key":"e_1_3_2_1_36_1","unstructured":"Julian Hazell. 2023. Large language models can be used to effectively scale spear phishing campaigns. In arXiv:2305.06972."},{"key":"e_1_3_2_1_37_1","volume-title":"Mgtbench: Benchmarking machine-generated text detection. In arXiv:2303.14822.","author":"He Xinlei","year":"2023","unstructured":"Xinlei He, Xinyue Shen, Zeyuan Chen, Michael Backes, and Yang Zhang. 2023. Mgtbench: Benchmarking machine-generated text detection. In arXiv:2303.14822."},{"key":"e_1_3_2_1_38_1","volume-title":"Electronics & Mobile Communication Conference.","author":"Heidari Maryam","year":"2020","unstructured":"Maryam Heidari and James H Jones. 2020. Using bert to extract topic-independent sentiment features for social media bot detection. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference."},{"key":"e_1_3_2_1_39_1","volume-title":"Electronics & Mobile Communication Conference.","author":"Heidari Maryam","year":"2021","unstructured":"Maryam Heidari, Samira Zad, Parisa Hajibabaee, Masoud Malekzadeh, SeyyedPooya HekmatiAthar, Ozlem Uzuner, and James H Jones. 2021. Bert model for fake news detection based on social bot activities in the covid-19 pandemic. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference."},{"key":"e_1_3_2_1_40_1","volume-title":"Teaching academic ESL writing: Practical techniques in vocabulary and grammar","author":"Hinkel Eli","unstructured":"Eli Hinkel. 2003. Teaching academic ESL writing: Practical techniques in vocabulary and grammar. Routledge."},{"key":"e_1_3_2_1_41_1","volume-title":"Neural computation","author":"Hochreiter Sepp","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. In Neural computation, Vol. 9. MIT press, 1735--1780."},{"key":"e_1_3_2_1_42_1","unstructured":"Emma Hoes Sacha Altay and Juan Bermeo. 2023. Using ChatGPT to Fight Misinformation: ChatGPT Nails 72% of 12 000 Verified Claims. PsyArXiv."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Or Honovich Uri Shaham Samuel R Bowman and Omer Levy. 2023. Instruction induction: From few examples to natural language task descriptions. In ACL.","DOI":"10.18653\/v1\/2023.acl-long.108"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3363818"},{"key":"e_1_3_2_1_45_1","unstructured":"Huggingface. [n. d.]. RoBERTa. Available at: https:\/\/huggingface.co\/docs\/transformers\/model_doc\/roberta."},{"key":"e_1_3_2_1_46_1","volume-title":"Discourse studies","author":"Hyland Ken","unstructured":"Ken Hyland. 2005. Stance and engagement: A model of interaction in academic discourse. In Discourse studies, Vol. 7. SAGE Publications, 173--192."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Daphne Ippolito Daniel Duckworth Chris Callison-Burch and Douglas Eck. 2020. Automatic Detection of Generated Text is Easiest when Humans are Fooled. In ACL.","DOI":"10.18653\/v1\/2020.acl-main.164"},{"key":"e_1_3_2_1_48_1","unstructured":"Ashish Jaiswal. 2023. Smart ChatGPT Prompts. Available at: https:\/\/github.com\/asheeshcric\/smart-chatgpt-prompts."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-34411-4_32"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_2_1_51_1","volume-title":"G\u00e1bor Melis, and Edward Grefenstette.","author":"Kovcisk\u1ef3 Tom\u00e1vs","year":"2018","unstructured":"Tom\u00e1vs Kovcisk\u1ef3, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, G\u00e1bor Melis, and Edward Grefenstette. 2018. The narrativeqa reading comprehension challenge. In TACL, Vol. 6. MIT Press, 317--328."},{"key":"e_1_3_2_1_52_1","volume-title":"Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa.","author":"Kojima Takeshi","year":"2022","unstructured":"Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large language models are zero-shot reasoners. In NeurlIPS."},{"key":"e_1_3_2_1_53_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NeurlIPS."},{"key":"e_1_3_2_1_54_1","volume-title":"DEMASQ: Unmasking the ChatGPT Wordsmith. In NDSS.","author":"Kumari Kavita","year":"2024","unstructured":"Kavita Kumari, Alessandro Pegoraro, Hossein Fereidooni, and Ahmad-Reza Sadeghi. 2024. DEMASQ: Unmasking the ChatGPT Wordsmith. In NDSS."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Laida Kushnareva Daniil Cherniavskii Vladislav Mikhailov Ekaterina Artemova Serguei Barannikov Alexander Bernstein Irina Piontkovskaya Dmitri Piontkovski and Evgeny Burnaev. 2021. Artificial Text Detection via Examining the Topology of Attention Maps. In EMNLP.","DOI":"10.18653\/v1\/2022.findings-emnlp.7"},{"key":"e_1_3_2_1_56_1","volume-title":"Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In ACL.","author":"Lewis Mike","year":"2020","unstructured":"Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2020. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In ACL."},{"key":"e_1_3_2_1_57_1","unstructured":"Haoran Li Dadi Guo Wei Fan Mingshi Xu and Yangqiu Song. 2023. Multi-step Jailbreaking Privacy Attacks on ChatGPT. In Findings of EMNLP."},{"key":"e_1_3_2_1_58_1","unstructured":"Min Lin Qiang Chen and Shuicheng Yan. 2014. Network in network. In ICLR."},{"key":"e_1_3_2_1_59_1","unstructured":"Stephanie Lin Jacob Hilton and Owain Evans. 2022. TruthfulQA: Measuring How Models Mimic Human Falsehoods. In ACL."},{"key":"e_1_3_2_1_60_1","volume-title":"Yejin Choi, and Hannaneh Hajishirzi.","author":"Liu Jiacheng","year":"2022","unstructured":"Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, and Hannaneh Hajishirzi. 2022. Generated Knowledge Prompting for Commonsense Reasoning. In ACL."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Yi Liu Gelei Deng Zhengzi Xu Yuekang Li Yaowen Zheng Ying Zhang Lida Zhao Tianwei Zhang and Yang Liu. 2023. Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study. In arXiv:2305.13860.","DOI":"10.1145\/3663530.3665021"},{"key":"e_1_3_2_1_62_1","volume-title":"Roberta: A robustly optimized bert pretraining approach. In arXiv:1907.11692.","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. In arXiv:1907.11692."},{"key":"e_1_3_2_1_63_1","unstructured":"Yikang Liu Ziyin Zhang Wanyang Zhang Shisen Yue Xiaojing Zhao Xinyuan Cheng Yiwen Zhang and Hai Hu. 2023. ArguGPT: evaluating understanding and identifying argumentative essays generated by GPT models. In arXiv:2304.07666."},{"key":"e_1_3_2_1_64_1","volume-title":"SGDR: Stochastic Gradient Descent with Warm Restarts. In ICLR.","author":"Loshchilov Ilya","year":"2017","unstructured":"Ilya Loshchilov and Frank Hutter. 2017. SGDR: Stochastic Gradient Descent with Warm Restarts. In ICLR."},{"key":"e_1_3_2_1_65_1","unstructured":"Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. In ICLR."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555562"},{"key":"e_1_3_2_1_67_1","volume-title":"Grammar for academic writing","author":"Lynch Tony","unstructured":"Tony Lynch and Kenneth Anderson. 2013. Grammar for academic writing. In English Language Teaching Centre. 1--6."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"crossref","unstructured":"Dominik Macko Robert Moro Adaku Uchendu Jason Lucas Michiharu Yamashita Mat\u00favs Pikuliak Ivan Srba Thai Le Dongwon Lee Jakub Simko et al. 2023. MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark. In EMNLP.","DOI":"10.18653\/v1\/2023.emnlp-main.616"},{"key":"e_1_3_2_1_69_1","volume-title":"Self-refine: Iterative refinement with self-feedback. In NeurlIPS.","author":"Madaan Aman","year":"2024","unstructured":"Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et al. 2024. Self-refine: Iterative refinement with self-feedback. In NeurlIPS."},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587102.3588827"},{"key":"e_1_3_2_1_71_1","volume-title":"Network Security","volume":"2023","author":"Mansfield-Devine Steve","year":"2023","unstructured":"Steve Mansfield-Devine. 2023. Weaponising ChatGPT. In Network Security, Vol. 2023. MA Business London."},{"key":"e_1_3_2_1_72_1","unstructured":"Paulius Micikevicius Sharan Narang Jonah Alben Gregory Diamos Erich Elsen David Garcia Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh et al. 2018. Mixed Precision Training. In ICLR."},{"key":"e_1_3_2_1_73_1","volume-title":"Detectgpt: Zero-shot machine-generated text detection using probability curvature. In ICML.","author":"Mitchell Eric","year":"2023","unstructured":"Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D Manning, and Chelsea Finn. 2023. Detectgpt: Zero-shot machine-generated text detection using probability curvature. In ICML."},{"key":"e_1_3_2_1_74_1","unstructured":"Marius Mosbach Maksym Andriushchenko and Dietrich Klakow. 2021. On the Stability of Fine-tuning BERT: Misconceptions Explanations and Strong Baselines. In ICLR."},{"key":"e_1_3_2_1_75_1","unstructured":"OpenAI. 2023. AI Text Classifier. Available at: https:\/\/platform.openai.com\/ai-text-classifier."},{"key":"e_1_3_2_1_76_1","unstructured":"OpenAI. 2023. Educator considerations for ChatGPT. Available at: https:\/\/platform.openai.com\/docs\/chatgpt-education."},{"key":"e_1_3_2_1_77_1","unstructured":"OpenAI\u00adcommunity. 2019. roberta-base-openai-detector. Available at: https:\/\/huggingface.co\/openai-community\/roberta-base-openai-detector."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"crossref","unstructured":"Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier and Michael Auli. 2019. fairseq: A Fast Extensible Toolkit for Sequence Modeling. In NAACL.","DOI":"10.18653\/v1\/N19-4009"},{"key":"e_1_3_2_1_79_1","unstructured":"Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier and Michael Auli. 2020. Finetuning RoBERTa on a custom classification task. Available at: https:\/\/github.com\/facebookresearch\/fairseq\/blob\/main\/examples\/roberta\/README.custom_classification.md."},{"key":"e_1_3_2_1_80_1","volume-title":"Glove: Global vectors for word representation. In EMNLP.","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In EMNLP."},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"crossref","unstructured":"Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee and Luke Zettlemoyer. 2018. Deep Contextualized Word Representations. In NAACL.","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_3_2_1_82_1","unstructured":"PlexPt. 2023. Awesome ChatGPT Prompts. Available at: https:\/\/github.com\/PlexPt\/awesome-chatgpt-prompts."},{"key":"e_1_3_2_1_83_1","unstructured":"Prompt Perfect. 2023. Available at: https:\/\/promptperfect.xyz\/."},{"key":"e_1_3_2_1_84_1","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei Ilya Sutskever et al. 2019. Language models are unsupervised multitask learners. In OpenAI blog Vol. 1. 9."},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"crossref","unstructured":"Pranav Rajpurkar Jian Zhang Konstantin Lopyrev and Percy Liang. 2016. SQuAD: 100 000 Questions for Machine Comprehension of Text. In EMNLP.","DOI":"10.18653\/v1\/D16-1264"},{"key":"e_1_3_2_1_86_1","volume-title":"MIT Sloan Management Review","volume":"64","author":"Renaud Karen","year":"2023","unstructured":"Karen Renaud, Merrill Warkentin, and George Westerman. 2023. From ChatGPT to HackGPT: Meeting the Cybersecurity Threat of Generative AI. In MIT Sloan Management Review, Vol. 64. Massachusetts Institute of Technology, 1--4."},{"key":"e_1_3_2_1_87_1","volume-title":"Krishna Vamsi Naragam, and Shirin Nilizadeh","author":"Roy Sayak Saha","year":"2023","unstructured":"Sayak Saha Roy, Krishna Vamsi Naragam, and Shirin Nilizadeh. 2023. Generating Phishing Attacks using ChatGPT. In arXiv:2305.05133."},{"key":"e_1_3_2_1_88_1","volume-title":"Healthcare","volume":"11","author":"Sallam Malik","year":"2023","unstructured":"Malik Sallam. 2023. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. In Healthcare, Vol. 11. MDPI, 887."},{"key":"e_1_3_2_1_89_1","volume-title":"NeulIPS Fifth Workshop on Energy Efficient Machine Learning and Cognitive Computing.","author":"Sanh Victor","year":"2019","unstructured":"Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. In NeulIPS Fifth Workshop on Energy Efficient Machine Learning and Cognitive Computing."},{"key":"e_1_3_2_1_90_1","volume-title":"Muhammad Khurram Khan, and Kim-Kwang Raymond Choo.","author":"Shahid Wajiha","year":"2022","unstructured":"Wajiha Shahid, Bahman Jamshidi, Saqib Hakak, Haruna Isah, Wazir Zada Khan, Muhammad Khurram Khan, and Kim-Kwang Raymond Choo. 2022. Detecting and mitigating the dissemination of fake news: Challenges and future research opportunities. In IEEE Transactions on Computational Social Systems."},{"key":"e_1_3_2_1_91_1","volume-title":"Sarah Kreps, et al.","author":"Solaiman Irene","year":"2019","unstructured":"Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. 2019. Release strategies and the social impacts of language models. In arXiv:1908.09203."},{"key":"e_1_3_2_1_92_1","unstructured":"solrevdev. 2023. chatgpt-prompt-gen.txt. Available at: https:\/\/gist.github.com\/solrevdev\/c9ada9de794237acdd5028418cea8ec5."},{"key":"e_1_3_2_1_93_1","unstructured":"StackOverflow. 2023. Use of ChatGPT generated text for content on Stack Overflow is temporarily banned. Available at: https:\/\/meta.stackoverflow.com\/questions\/421831\/temporary-policy-chatgpt-is-banned."},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"crossref","unstructured":"Chris Stokel-Walker. 2022. AI bot ChatGPT writes smart essays-should academics worry?. In Nature.","DOI":"10.1038\/d41586-022-04397-7"},{"key":"e_1_3_2_1_95_1","doi-asserted-by":"crossref","unstructured":"Chris Stokel-Walker. 2023. ChatGPT listed as author on research papers: many scientists disapprove. In Nature.","DOI":"10.1038\/d41586-023-00107-z"},{"key":"e_1_3_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2012-65"},{"key":"e_1_3_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/3624725"},{"key":"e_1_3_2_1_98_1","volume-title":"Detection of Fake Generated Scientific Abstracts. In IEEE International Conference on Big Data Computing Service and Applications.","author":"Theocharopoulos Panagiotis C","year":"2023","unstructured":"Panagiotis C Theocharopoulos, Panagiotis Anagnostou, Anastasia Tsoukala, Spiros V Georgakopoulos, Sotiris K Tasoulis, and Vassilis P Plagianakos. 2023. Detection of Fake Generated Scientific Abstracts. In IEEE International Conference on Big Data Computing Service and Applications."},{"key":"e_1_3_2_1_99_1","unstructured":"Edward Tian. 2023. GPTZero. Available at: https:\/\/gptzero.me\/."},{"key":"e_1_3_2_1_100_1","unstructured":"Shangqing Tu Chunyang Li Jifan Yu Xiaozhi Wang Lei Hou and Juanzi Li. 2023. ChatLog: Recording and Analyzing ChatGPT Across Time. In arXiv:2304.14106."},{"key":"e_1_3_2_1_101_1","doi-asserted-by":"crossref","unstructured":"Adaku Uchendu Thai Le Kai Shu and Dongwon Lee. 2020. Authorship attribution for neural text generation. In EMNLP.","DOI":"10.18653\/v1\/2020.emnlp-main.673"},{"key":"e_1_3_2_1_102_1","volume-title":"JMLR","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE.. In JMLR, Vol. 9."},{"key":"e_1_3_2_1_103_1","unstructured":"Hong Wang Xuan Luo Weizhi Wang and Xifeng Yan. 2023. Bot or Human? Detecting ChatGPT Imposters with A Single Question. In arXiv:2305.06424."},{"key":"e_1_3_2_1_104_1","volume-title":"Tarek Mahmoud, Alham Fikri Aji, et al.","author":"Wang Yuxia","year":"2024","unstructured":"Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Chenxi Whitehouse, Osama Mohammed Afzal, Tarek Mahmoud, Alham Fikri Aji, et al. 2024. M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection. In EACL."},{"key":"e_1_3_2_1_105_1","unstructured":"Jules White Quchen Fu Sam Hays Michael Sandborn Carlos Olea Henry Gilbert Ashraf Elnashar Jesse Spencer-Smith and Douglas C Schmidt. 2023. A prompt pattern catalog to enhance prompt engineering with chatgpt. In arXiv:2302.11382."},{"key":"e_1_3_2_1_106_1","doi-asserted-by":"crossref","unstructured":"Jurgen Willems. 2023. ChatGPT at universities--the least of our concerns. In SSRN:4334162.","DOI":"10.2139\/ssrn.4334162"},{"key":"e_1_3_2_1_107_1","unstructured":"Kai-Cheng Yang Onur Varol Pik-Mai Hui and Filippo Menczer. 2020. Scalable and generalizable social bot detection through data selection. In AAAI."},{"key":"e_1_3_2_1_108_1","unstructured":"Wenpeng Yin Katharina Kann Mo Yu and Hinrich Sch\u00fctze. 2017. Comparative study of CNN and RNN for natural language processing. In arXiv:1702.01923."},{"key":"e_1_3_2_1_109_1","unstructured":"Rowan Zellers Ari Holtzman Hannah Rashkin Yonatan Bisk Ali Farhadi Franziska Roesner and Yejin Choi. 2019. Defending against neural fake news. In NeurlIPS."},{"key":"e_1_3_2_1_110_1","unstructured":"ZeroGPT. 2023. AI Text Detector. Available at: https:\/\/www.zerogpt.com."},{"key":"e_1_3_2_1_111_1","unstructured":"Denny Zhou Nathanael Sch\u00e4rli Le Hou Jason Wei Nathan Scales Xuezhi Wang Dale Schuurmans Claire Cui Olivier Bousquet Quoc Le et al. 2023. Least-to-most prompting enables complex reasoning in large language models. In ICLR."},{"key":"e_1_3_2_1_112_1","volume-title":"Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba.","author":"Zhou Yongchao","year":"2023","unstructured":"Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2023. Large language models are human-level prompt engineers. In ICLR."}],"event":{"name":"CCS '24: ACM SIGSAC Conference on Computer and Communications Security","location":"Salt Lake City UT USA","acronym":"CCS '24","sponsor":["SIGSAC ACM Special Interest Group on Security, Audit, and Control"]},"container-title":["Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658644.3670392","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658644.3670392","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T06:01:32Z","timestamp":1755842492000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658644.3670392"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,2]]},"references-count":112,"alternative-id":["10.1145\/3658644.3670392","10.1145\/3658644"],"URL":"https:\/\/doi.org\/10.1145\/3658644.3670392","relation":{},"subject":[],"published":{"date-parts":[[2024,12,2]]},"assertion":[{"value":"2024-12-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}