{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:38:43Z","timestamp":1776109123353,"version":"3.50.1"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,6,30]],"date-time":"2024-06-30T00:00:00Z","timestamp":1719705600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"funder":[{"name":"Ubisoft"},{"DOI":"10.13039\/100007631","name":"Canadian Institute for Advanced Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100007631","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC) Postgraduate Scholarship-Doctoral (PGS D) Award"},{"name":"Fonds de recherche du Qu\u00e9bec - Nature et Technologies (FRQNT) Doctoral Award"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Games"],"published-print":{"date-parts":[[2024,6,30]]},"abstract":"<jats:p>The advent of online spaces, particularly social media platforms and video games, has brought forth a significant challenge: the detection and mitigation of toxic and harmful speech. This issue is not only pervasive but also detrimental to the overall user experience. In this study, we leverage small language models to reliably detect toxicity, achieving an average precision of 0.95. Analyzing eight months of chat data from two Ubisoft games, we uncover patterns and trends in toxic behavior. The insights derived from our research will contribute to the development of healthier online communities and inform preventive measures against toxicity.<\/jats:p>","DOI":"10.1145\/3675805","type":"journal-article","created":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T11:01:45Z","timestamp":1719572505000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Game On, Hate Off: A Study of Toxicity in Online Multiplayer Environments"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-6765-2293","authenticated-orcid":false,"given":"Zachary","family":"Yang","sequence":"first","affiliation":[{"name":"School of Computer Science, McGill University Faculty of Science, Montreal, Canada, Mila, Montreal, Canada, and La Forge, Ubisoft, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6315-7018","authenticated-orcid":false,"given":"Nicolas","family":"Grenon-Godbout","sequence":"additional","affiliation":[{"name":"Ubisoft, Montreal, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2348-0353","authenticated-orcid":false,"given":"Reihaneh","family":"Rabbany","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University, Montreal, Canada and Mila, Montreal, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,8,8]]},"reference":[{"key":"e_1_3_4_2_2","article-title":"Online hate and harassment: The American experience 2021","year":"2021","unstructured":"ADL. 2021. Online hate and harassment: The American experience 2021. Anti-Defamation League (Mar. 2021). Retrieved from DOI:https:\/\/www.adl.org\/online-hate-2021","journal-title":"Anti-Defamation League"},{"key":"e_1_3_4_3_2","article-title":"Hate and harassment in online games","year":"2022","unstructured":"ADL. 2022. Hate and harassment in online games. Anti-Defamation League (Dec. 2022). Retrieved from DOI:https:\/\/www.adl.org\/sites\/default\/files\/documents\/2022-12\/Hate-and-Harassment-in-Online-Games-120622-v2.pdf","journal-title":"Anti-Defamation League"},{"key":"e_1_3_4_4_2","article-title":"Hate is no game: Hate and harassment in online games 2023","year":"2023","unstructured":"ADL. 2023. Hate is no game: Hate and harassment in online games 2023. Anti-Defamation League (Feb. 2023). Retrieved from DOI:https:\/\/www.adl.org\/resources\/report\/hate-no-game-hate-and-harassment-online-games-2023","journal-title":"Anti-Defamation League"},{"key":"e_1_3_4_5_2","first-page":"1","article-title":"Disruption and harms in online gaming framework","author":"Alliance Fair Play","year":"2020","unstructured":"Fair Play Alliance. 2020. Disruption and harms in online gaming framework. Fair Play Alliance (12 2020), 1\u201348. Retrieved from DOI:https:\/\/fairplayalliance.org\/wp-content\/uploads\/2022\/06\/FPA-Being-Targeted-about-Content-Moderation.pdf","journal-title":"Fair Play Alliance"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dim.2022.100019"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445157"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2567987"},{"key":"e_1_3_4_9_2","unstructured":"Tuba Ciftci Liridona Gashi Ren\u00e9 Hoffmann David Bahr Aylin Ilhan and Kaja Fietkiewicz. 2017. Hate speech on Facebook. In Proceedings of the 4th European Conference on Social Media Research. 425\u2013433."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.5771\/2192-4007-2020-1-62"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5110"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3013"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-049-6_036"},{"key":"e_1_3_4_14_2","article-title":"Toxicity detection for indic multilingual social media content","volume":"2201","author":"Jhaveri Manan","year":"2022","unstructured":"Manan Jhaveri, Devanshu Ramaiya, and Harveen Singh Chadha. 2022. Toxicity detection for indic multilingual social media content. CoRR abs\/2201.00598 (2022).","journal-title":"CoRR"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","unstructured":"Haewoon Kwak Jeremy Blackburn and Seungyeop Han. 2015. Exploring cyberbullying and other toxic behavior in team competition online games. 22 (04 2015). DOI:10.1145\/2702123.2702529","DOI":"10.1145\/2702123.2702529"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","unstructured":"Alyssa Lees Vinh Q. Tran Yi Tay Jeffrey Sorensen Jai Gupta Donald Metzler and Lucy Vasserman. 2022. A New Generation of Perspective API: Efficient Multilingual Character-level Transformers. DOI:10.48550\/ARXIV.2202.11176","DOI":"10.48550\/ARXIV.2202.11176"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539147"},{"key":"e_1_3_4_18_2","first-page":"1","article-title":"Being \u201cTargeted\u201d about content moderation:","author":"Lewington Robert","year":"2021","unstructured":"Robert Lewington. 2021. Being \u201cTargeted\u201d about content moderation:. Fair Play Alliance (04 2021), 1\u201321. Retrieved from https:\/\/fairplayalliance.org\/wp-content\/uploads\/2022\/06\/FPA-Being-Targeted-about-Content-Moderation.pdf","journal-title":"Fair Play Alliance"},{"key":"e_1_3_4_19_2","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","volume":"1907","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. CoRR abs\/1907.11692 (2019).","journal-title":"CoRR"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1038\/531568a"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","unstructured":"Shruthi Mohan Apala Guha Michael Harris Fred Popowich Ashley Schuster and Chris Priebe. 2017. The impact of toxic language on the health of Reddit communities. In Proceedings of the Canadian Conference on Artificial Intelligence. 51\u201356. DOI:10.1007\/978-3-319-57351-9_6","DOI":"10.1007\/978-3-319-57351-9_6"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3008"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","unstructured":"Marcus M\u00e4rtens Siqi Shen Alexandru Iosup and Fernando Kuipers. 2015. Toxicity detection in multiplayer online games. DOI:10.1109\/NetGames.2015.7382991","DOI":"10.1109\/NetGames.2015.7382991"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.396"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106343"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.34624\/jdmi.v3i6.15064"},{"key":"e_1_3_4_27_2","article-title":"Summary of responses from gaming companies","author":"Trahan Lori","year":"2022","unstructured":"Lori Trahan. 2022. Summary of responses from gaming companies. Anti-Defamation League (Dec. 2022). Retrieved from DOI:https:\/\/trahan.house.gov\/uploadedfiles\/summary_responses_to_letter_game_companies_online_harassment_extremism.pdf","journal-title":"Anti-Defamation League"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","unstructured":"Betty Van Aken Julian Risch Ralf Krestel and Alexander L\u00f6ser. 2018. Challenges for Toxic Comment Classification: An In-depth Error Analysis. DOI:10.48550\/ARXIV.1809.07572","DOI":"10.48550\/ARXIV.1809.07572"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2806394"},{"key":"e_1_3_4_30_2","doi-asserted-by":"crossref","unstructured":"Henry Weld Guanghao Huang Jean Lee Tongshu Zhang Kunze Wang Xinghong Guo Siqu Long Josiah Poon and Soyeon Caren Han. 2021. CONDA: A CONtextual Dual-Annotated dataset for in-game toxicity understanding and detection. arxiv:2106.06213 [cs.CL]","DOI":"10.18653\/v1\/2021.findings-acl.213"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.663"},{"key":"e_1_3_4_32_2","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Zhong Haoti","year":"2016","unstructured":"Haoti Zhong, Hao Li, Anna Cinzia Squicciarini, Sarah Michele Rajtmajer, Christopher Griffin, David J. Miller, and Cornelia Caragea. 2016. Content-driven detection of cyberbullying on the Instagram social network. In Proceedings of the International Joint Conference on Artificial Intelligence."},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmac017"}],"container-title":["Games: Research and Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3675805","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3675805","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:03Z","timestamp":1750291443000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3675805"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,30]]},"references-count":32,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6,30]]}},"alternative-id":["10.1145\/3675805"],"URL":"https:\/\/doi.org\/10.1145\/3675805","relation":{},"ISSN":["2832-5516"],"issn-type":[{"value":"2832-5516","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,30]]},"assertion":[{"value":"2023-09-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-07","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}