{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T06:53:34Z","timestamp":1778741614188,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,25]],"date-time":"2022-04-25T00:00:00Z","timestamp":1650844800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2016K1A1A2912757"],"award-info":[{"award-number":["2016K1A1A2912757"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,4,25]]},"DOI":"10.1145\/3487553.3524667","type":"proceedings-article","created":{"date-parts":[[2022,8,16]],"date-time":"2022-08-16T22:41:30Z","timestamp":1660689690000},"page":"887-893","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Making Adversarially-Trained Language Models Forget with Model Retraining: A Case Study on Hate Speech Detection"],"prefix":"10.1145","author":[{"given":"Marwan","family":"Omar","sequence":"first","affiliation":[{"name":"University of Central Florida, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Mohaisen","sequence":"additional","affiliation":[{"name":"University of Central Florida, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,8,16]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Sai\u00a0Saket Aluru Binny Mathew Punyajoy Saha and Animesh Mukherjee. 2020. Deep Learning Models for Multilingual Hate Speech Detection. arXiv preprint arXiv:2004.06465(2020).  Sai\u00a0Saket Aluru Binny Mathew Punyajoy Saha and Animesh Mukherjee. 2020. Deep Learning Models for Multilingual Hate Speech Detection. arXiv preprint arXiv:2004.06465(2020)."},{"key":"e_1_3_2_1_2_1","unstructured":"Nabiha Asghar. 2016. Yelp dataset challenge: Review rating prediction. arXiv preprint arXiv:1605.05362(2016).  Nabiha Asghar. 2016. Yelp dataset challenge: Review rating prediction. arXiv preprint arXiv:1605.05362(2016)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3041021.3054223"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of Findings of EMNLP.","author":"Barbieri Francesco","year":"2020","unstructured":"Francesco Barbieri , Jose Camacho-Collados , Luis Espinosa-Anke , and Leonardo Neves . 2020 . TweetEval:Unified Benchmark and Comparative Evaluation for Tweet Classification . In Proceedings of Findings of EMNLP. Francesco Barbieri, Jose Camacho-Collados, Luis Espinosa-Anke, and Leonardo Neves. 2020. TweetEval:Unified Benchmark and Comparative Evaluation for Tweet Classification. In Proceedings of Findings of EMNLP."},{"key":"e_1_3_2_1_5_1","volume-title":"International conference on machine learning. PMLR, 2206\u20132216","author":"Croce Francesco","year":"2020","unstructured":"Francesco Croce and Matthias Hein . 2020 . Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks . In International conference on machine learning. PMLR, 2206\u20132216 . Francesco Croce and Matthias Hein. 2020. Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. In International conference on machine learning. PMLR, 2206\u20132216."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Emily Dinan Samuel Humeau Bharath Chintagunta and Jason Weston. 2019. Build it break it fix it for dialogue safety: Robustness from adversarial human attack. arXiv preprint arXiv:1908.06083(2019).  Emily Dinan Samuel Humeau Bharath Chintagunta and Jason Weston. 2019. Build it break it fix it for dialogue safety: Robustness from adversarial human attack. arXiv preprint arXiv:1908.06083(2019).","DOI":"10.18653\/v1\/D19-1461"},{"key":"e_1_3_2_1_7_1","volume-title":"A survey on concept drift adaptation. ACM computing surveys (CSUR) 46, 4","author":"Gama Jo\u00e3o","year":"2014","unstructured":"Jo\u00e3o Gama , Indr\u0117 \u017dliobait\u0117 , Albert Bifet , Mykola Pechenizkiy , and Abdelhamid Bouchachia . 2014. A survey on concept drift adaptation. ACM computing surveys (CSUR) 46, 4 ( 2014 ), 1\u201337. Jo\u00e3o Gama, Indr\u0117 \u017dliobait\u0117, Albert Bifet, Mykola Pechenizkiy, and Abdelhamid Bouchachia. 2014. A survey on concept drift adaptation. ACM computing surveys (CSUR) 46, 4 (2014), 1\u201337."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3013"},{"key":"e_1_3_2_1_9_1","unstructured":"Ian\u00a0J Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572(2014).  Ian\u00a0J Goodfellow Jonathon Shlens and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572(2014)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3270101.3270103"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-2009"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6311"},{"key":"e_1_3_2_1_13_1","unstructured":"Keita Kurita Anna Belova and Antonios Anastasopoulos. 2019. Towards robust toxic content classification. arXiv preprint arXiv:1912.06872(2019).  Keita Kurita Anna Belova and Antonios Anastasopoulos. 2019. Towards robust toxic content classification. arXiv preprint arXiv:1912.06872(2019)."},{"key":"e_1_3_2_1_14_1","first-page":"2346","article-title":"Learning under concept drift: A review","volume":"31","author":"Lu Jie","year":"2018","unstructured":"Jie Lu , Anjin Liu , Fan Dong , Feng Gu , Joao Gama , and Guangquan Zhang . 2018 . Learning under concept drift: A review . IEEE Transactions on Knowledge and Data Engineering 31 , 12(2018), 2346 \u2013 2363 . Jie Lu, Anjin Liu, Fan Dong, Feng Gu, Joao Gama, and Guangquan Zhang. 2018. Learning under concept drift: A review. IEEE Transactions on Knowledge and Data Engineering 31, 12(2018), 2346\u20132363.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_1_15_1","volume-title":"Learning Word Vectors for Sentiment Analysis. In Annual Meeting of the Association for Computational Linguistics. 142\u2013150","author":"Maas L.","year":"2011","unstructured":"Andrew\u00a0 L. Maas , Raymond\u00a0 E. Daly , Peter\u00a0 T. Pham , Dan Huang , Andrew\u00a0 Y. Ng , and Christopher Potts . 2011 . Learning Word Vectors for Sentiment Analysis. In Annual Meeting of the Association for Computational Linguistics. 142\u2013150 . Andrew\u00a0L. Maas, Raymond\u00a0E. Daly, Peter\u00a0T. Pham, Dan Huang, Andrew\u00a0Y. Ng, and Christopher Potts. 2011. Learning Word Vectors for Sentiment Analysis. In Annual Meeting of the Association for Computational Linguistics. 142\u2013150."},{"key":"e_1_3_2_1_16_1","unstructured":"Binny Mathew Punyajoy Saha Seid\u00a0Muhie Yimam Chris Biemann Pawan Goyal and Animesh Mukherjee. 2020. HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection. arXiv preprint arXiv:2012.10289(2020).  Binny Mathew Punyajoy Saha Seid\u00a0Muhie Yimam Chris Biemann Pawan Goyal and Animesh Mukherjee. 2020. HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection. arXiv preprint arXiv:2012.10289(2020)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","unstructured":"John\u00a0X Morris Eli Lifland Jack Lanchantin Yangfeng Ji and Yanjun Qi. 2020. Reevaluating adversarial examples in natural language. arXiv preprint arXiv:2004.14174(2020).  John\u00a0X Morris Eli Lifland Jack Lanchantin Yangfeng Ji and Yanjun Qi. 2020. Reevaluating adversarial examples in natural language. arXiv preprint arXiv:2004.14174(2020).","DOI":"10.18653\/v1\/2020.findings-emnlp.341"},{"key":"e_1_3_2_1_18_1","volume-title":"Textattack: A framework for adversarial attacks, data augmentation, and adversarial training in nlp. arXiv preprint arXiv:2005.05909(2020).","author":"Morris X","year":"2020","unstructured":"John\u00a0 X Morris , Eli Lifland , Jin\u00a0Yong Yoo , Jake Grigsby , Di Jin , and Yanjun Qi . 2020 . Textattack: A framework for adversarial attacks, data augmentation, and adversarial training in nlp. arXiv preprint arXiv:2005.05909(2020). John\u00a0X Morris, Eli Lifland, Jin\u00a0Yong Yoo, Jake Grigsby, Di Jin, and Yanjun Qi. 2020. Textattack: A framework for adversarial attacks, data augmentation, and adversarial training in nlp. arXiv preprint arXiv:2005.05909(2020)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411990"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Ji\u00a0Ho Park and Pascale Fung. 2017. One-step and two-step classification for abusive language detection on twitter. arXiv preprint arXiv:1706.01206(2017).  Ji\u00a0Ho Park and Pascale Fung. 2017. One-step and two-step classification for abusive language detection on twitter. arXiv preprint arXiv:1706.01206(2017).","DOI":"10.18653\/v1\/W17-3006"},{"key":"e_1_3_2_1_21_1","volume-title":"HABERTOR: An efficient and effective deep hatespeech detector. arXiv preprint arXiv:2010.08865(2020).","author":"Tran Thanh","year":"2020","unstructured":"Thanh Tran , Yifan Hu , Changwei Hu , Kevin Yen , Fei Tan , Kyumin Lee , and Serim Park . 2020 . HABERTOR: An efficient and effective deep hatespeech detector. arXiv preprint arXiv:2010.08865(2020). Thanh Tran, Yifan Hu, Changwei Hu, Kevin Yen, Fei Tan, Kyumin Lee, and Serim Park. 2020. HABERTOR: An efficient and effective deep hatespeech detector. arXiv preprint arXiv:2010.08865(2020)."},{"key":"e_1_3_2_1_22_1","volume-title":"Chi","author":"Wang Tianlu","year":"2020","unstructured":"Tianlu Wang , Xuezhi Wang , Yao Qin , Ben Packer , Kang Li , Jilin Chen , Alex Beutel , and Ed Chi . 2020 . Cat-gen : Improving robustness in nlp models via controlled adversarial text generation. arXiv preprint arXiv:2010.02338(2020). Tianlu Wang, Xuezhi Wang, Yao Qin, Ben Packer, Kang Li, Jilin Chen, Alex Beutel, and Ed Chi. 2020. Cat-gen: Improving robustness in nlp models via controlled adversarial text generation. arXiv preprint arXiv:2010.02338(2020)."},{"key":"e_1_3_2_1_23_1","unstructured":"Dongxian Wu Shu-Tao Xia and Yisen Wang. 2020. Adversarial weight perturbation helps robust generalization. arXiv preprint arXiv:2004.05884(2020).  Dongxian Wu Shu-Tao Xia and Yisen Wang. 2020. Adversarial weight perturbation helps robust generalization. arXiv preprint arXiv:2004.05884(2020)."},{"key":"e_1_3_2_1_24_1","unstructured":"Jin\u00a0Yong Yoo and Yanjun Qi. 2021. Towards Improving Adversarial Training of NLP Models. arXiv preprint arXiv:2109.00544(2021).  Jin\u00a0Yong Yoo and Yanjun Qi. 2021. Towards Improving Adversarial Training of NLP Models. arXiv preprint arXiv:2109.00544(2021)."},{"key":"e_1_3_2_1_25_1","volume-title":"Semeval-2019 task 6: Identifying and categorizing offensive language in social media (offenseval). arXiv:1903.08983","author":"Zampieri Marcos","year":"2019","unstructured":"Marcos Zampieri , Shervin Malmasi , Preslav Nakov , Sara Rosenthal , Noura Farra , and Ritesh Kumar . 2019. Semeval-2019 task 6: Identifying and categorizing offensive language in social media (offenseval). arXiv:1903.08983 ( 2019 ). Marcos Zampieri, Shervin Malmasi, Preslav Nakov, Sara Rosenthal, Noura Farra, and Ritesh Kumar. 2019. Semeval-2019 task 6: Identifying and categorizing offensive language in social media (offenseval). arXiv:1903.08983 (2019)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Yichao Zhou Jyun-Yu Jiang Kai-Wei Chang and Wei Wang. 2019. Learning to discriminate perturbations for blocking adversarial attacks in text classification. arXiv preprint arXiv:1909.03084(2019).  Yichao Zhou Jyun-Yu Jiang Kai-Wei Chang and Wei Wang. 2019. Learning to discriminate perturbations for blocking adversarial attacks in text classification. arXiv preprint arXiv:1909.03084(2019).","DOI":"10.18653\/v1\/D19-1496"},{"key":"e_1_3_2_1_27_1","volume-title":"Freelb: Enhanced adversarial training for natural language understanding. arXiv preprint arXiv:1909.11764(2019).","author":"Zhu Chen","year":"2019","unstructured":"Chen Zhu , Yu Cheng , Zhe Gan , Siqi Sun , Tom Goldstein , and Jingjing Liu . 2019 . Freelb: Enhanced adversarial training for natural language understanding. arXiv preprint arXiv:1909.11764(2019). Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein, and Jingjing Liu. 2019. Freelb: Enhanced adversarial training for natural language understanding. arXiv preprint arXiv:1909.11764(2019)."}],"event":{"name":"WWW '22: The ACM Web Conference 2022","location":"Virtual Event, Lyon France","acronym":"WWW '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Companion Proceedings of the Web Conference 2022"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3487553.3524667","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3487553.3524667","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:22Z","timestamp":1750188622000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3487553.3524667"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,25]]},"references-count":27,"alternative-id":["10.1145\/3487553.3524667","10.1145\/3487553"],"URL":"https:\/\/doi.org\/10.1145\/3487553.3524667","relation":{},"subject":[],"published":{"date-parts":[[2022,4,25]]},"assertion":[{"value":"2022-08-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}