{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T18:37:19Z","timestamp":1774463839085,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2014,4,7]],"date-time":"2014-04-07T00:00:00Z","timestamp":1396828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2014,4,7]]},"DOI":"10.1145\/2566486.2567987","type":"proceedings-article","created":{"date-parts":[[2014,10,7]],"date-time":"2014-10-07T12:57:59Z","timestamp":1412686679000},"page":"877-888","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":105,"title":["STFU NOOB!"],"prefix":"10.1145","author":[{"given":"Jeremy","family":"Blackburn","sequence":"first","affiliation":[{"name":"University of South Florida, Tampa, FL, USA"}]},{"given":"Haewoon","family":"Kwak","sequence":"additional","affiliation":[{"name":"Telefonica Research, Barcelona, Spain"}]}],"member":"320","published-online":{"date-parts":[[2014,4,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/978-1-84882-825-4_12","volume-title":"Online worlds: Convergence of the real and the virtual","author":"Barnett J.","year":"2010","unstructured":"J. Barnett , M. Coulson , and N. Foreman . Examining player anger in World of Warcraft . In Online worlds: Convergence of the real and the virtual , pages 147 -- 160 . 2010 . J. Barnett, M. Coulson, and N. Foreman. Examining player anger in World of Warcraft. In Online worlds: Convergence of the real and the virtual, pages 147--160. 2010."},{"key":"e_1_3_2_1_2_1","volume-title":"Instruments, & Computers, 18(3):299--303","author":"Bellezza F. S.","year":"1986","unstructured":"F. S. Bellezza , A. G. Greenwald , and M. R. Banaji . Words high and low in pleasantness as rated by male and female college students. Behavior Research Methods , Instruments, & Computers, 18(3):299--303 , 1986 . F. S. Bellezza, A. G. Greenwald, and M. R. Banaji. Words high and low in pleasantness as rated by male and female college students. Behavior Research Methods, Instruments, & Computers, 18(3):299--303, 1986."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187848"},{"key":"e_1_3_2_1_5_1","first-page":"145","volume-title":"ECAI","author":"Brew A.","year":"2010","unstructured":"A. Brew , D. Greene , and P. Cunningham . Using crowdsourcing and active learning to track sentiment in online media . In ECAI , pages 145 -- 150 , 2010 . A. Brew, D. Greene, and P. Cunningham. Using crowdsourcing and active learning to track sentiment in online media. In ECAI, pages 145--150, 2010."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1690388.1690454"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2575.2009.00330.x"},{"key":"e_1_3_2_1_8_1","volume-title":"Gamers don't want any more grief","author":"Davies M.","year":"2011","unstructured":"M. Davies . Gamers don't want any more grief , 2011 . http:\/\/tinyurl.com\/stfunub11. M. Davies. Gamers don't want any more grief, 2011. http:\/\/tinyurl.com\/stfunub11."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10902-009-9150-9"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1067343.1067375"},{"key":"e_1_3_2_1_11_1","volume-title":"Happiness and the patterns of life: A study of geolocated tweets. Scientific Reports, 3(2625)","author":"Frank M. R.","year":"2013","unstructured":"M. R. Frank , L. Mitchell , P. S. Dodds , and C. M. Danforth . Happiness and the patterns of life: A study of geolocated tweets. Scientific Reports, 3(2625) , 2013 . M. R. Frank, L. Mitchell, P. S. Dodds, and C. M. Danforth. Happiness and the patterns of life: A study of geolocated tweets. Scientific Reports, 3(2625), 2013."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989331"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1202775"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/17538941003759255"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753357"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093650207313159"},{"issue":"6","key":"e_1_3_2_1_17_1","first-page":"1","article-title":"The rise of crowdsourcing","volume":"14","author":"Howe J.","year":"2006","unstructured":"J. Howe . The rise of crowdsourcing . Wired magazine , 14 ( 6 ): 1 -- 4 , 2006 . J. Howe. The rise of crowdsourcing. Wired magazine, 14(6):1--4, 2006.","journal-title":"Wired magazine"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837885.1837906"},{"key":"e_1_3_2_1_19_1","first-page":"467","volume-title":"AAMAS '12","author":"Kamar E.","year":"2012","unstructured":"E. Kamar , S. Hacker , and E. Horvitz . Combining human and machine intelligence in large-scale crowdsourcing . In AAMAS '12 , pages 467 -- 474 , 2012 . E. Kamar, S. Hacker, and E. Horvitz. Combining human and machine intelligence in large-scale crowdsourcing. In AAMAS '12, pages 467--474, 2012."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_3_2_1_21_1","first-page":"19","volume-title":"WSDM '11 Workshop on Crowdsourcing for Search and Data Mining","author":"Kumar A.","year":"2011","unstructured":"A. Kumar and M. Lease . Modeling annotator accuracies for supervised learning . In WSDM '11 Workshop on Crowdsourcing for Search and Data Mining , pages 19 -- 22 , 2011 . A. Kumar and M. Lease. Modeling annotator accuracies for supervised learning. In WSDM '11 Workshop on Crowdsourcing for Search and Data Mining, pages 19--22, 2011."},{"key":"e_1_3_2_1_22_1","unstructured":"H. Kwak and S. Han. \"So many bad guys so little time\": Understanding toxic behavior and reaction in team competition games. Submitted.  H. Kwak and S. Han. \"So many bad guys so little time\": Understanding toxic behavior and reaction in team competition games. Submitted."},{"key":"e_1_3_2_1_23_1","volume-title":"DiGRA '05","author":"Lin H.","year":"2005","unstructured":"H. Lin and C.-T. Sun . The \"white-eyed\" player culture : Grief play and construction of deviance in MMORPGs . In DiGRA '05 , 2005 . H. Lin and C.-T. Sun. The \"white-eyed\" player culture: Grief play and construction of deviance in MMORPGs. In DiGRA '05, 2005."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488460"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327957PSPR0401_6"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0064417"},{"key":"e_1_3_2_1_27_1","volume-title":"Pearson Education","author":"Mulligan J.","year":"2003","unstructured":"J. Mulligan , B. Patrovsky , and R. Koster . Developing online games: An insider's guide . Pearson Education , 2003 . J. Mulligan, B. Patrovsky, and R. Koster. Developing online games: An insider's guide. Pearson Education, 2003."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743384.1743478"},{"key":"e_1_3_2_1_29_1","first-page":"97","volume-title":"Aggressive Behavior: Current Perspectives","author":"Olweus D.","year":"1996","unstructured":"D. Olweus . Bullying at school: Long term outcomes for the victims and an effective school-based intervention program . Aggressive Behavior: Current Perspectives , pages 97 -- 130 , 1996 . D. Olweus. Bullying at school: Long term outcomes for the victims and an effective school-based intervention program. Aggressive Behavior: Current Perspectives, pages 97--130, 1996."},{"issue":"5","key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci G.","year":"2010","unstructured":"G. Paolacci , J. Chandler , and P. Ipeirotis . Running experiments on Amazon Mechanical Turk . Judgment and Decision Making , 5 ( 5 ): 411 -- 419 , 2010 . G. Paolacci, J. Chandler, and P. Ipeirotis. Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5(5):411--419, 2010.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_31_1","volume-title":"CHI '11 Workshop On Crowdsourcing And Human Computation","author":"Quinn A. J.","year":"2011","unstructured":"A. J. Quinn and B. B. Bederson . Human-machine hybrid computation . In CHI '11 Workshop On Crowdsourcing And Human Computation , 2011 . A. J. Quinn and B. B. Bederson. Human-machine hybrid computation. In CHI '11 Workshop On Crowdsourcing And Human Computation, 2011."},{"key":"e_1_3_2_1_32_1","volume-title":"Better Performance Over Iterations","author":"Quinn A. J.","year":"2010","unstructured":"A. J. Quinn , B. B. Bederson , T. Yeh , and J. Lin . CrowdFlow: Integrating machine learning with Mechanical Turk for speed-cost-quality flexibility . Better Performance Over Iterations , 2010 . A. J. Quinn, B. B. Bederson, T. Yeh, and J. Lin. CrowdFlow: Integrating machine learning with Mechanical Turk for speed-cost-quality flexibility. Better Performance Over Iterations, 2010."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.2007.01846.x"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1089\/1094931041291295"},{"key":"e_1_3_2_1_37_1","volume-title":"SIGIR '11 Workshop on Crowdsourcing for Information Retrieval","author":"Tang W.","year":"2011","unstructured":"W. Tang and M. Lease . Semi-supervised consensus labeling for crowdsourcing . In SIGIR '11 Workshop on Crowdsourcing for Information Retrieval , 2011 . W. Tang and M. Lease. Semi-supervised consensus labeling for crowdsourcing. In SIGIR '11 Workshop on Crowdsourcing for Information Retrieval, 2011."},{"key":"e_1_3_2_1_38_1","first-page":"178","volume-title":"ICWSM '10","author":"Tumasjan A.","year":"2010","unstructured":"A. Tumasjan , T. O. Sprenger , P. G. Sandner , and I. M. Welpe . Predicting elections with Twitter: What 140 characters reveal about political sentiment . In ICWSM '10 , pages 178 -- 185 , 2010 . A. Tumasjan, T. O. Sprenger, P. G. Sandner, and I. M. Welpe. Predicting elections with Twitter: What 140 characters reveal about political sentiment. In ICWSM '10, pages 178--185, 2010."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-068740-4.50007-6"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(00)00010-8"},{"issue":"7","key":"e_1_3_2_1_41_1","article-title":"Social context in massively-multiplayer online games (MMOGs): Ethical questions in shared space","volume":"4","author":"Warner D. E.","year":"2005","unstructured":"D. E. Warner and M. Ratier . Social context in massively-multiplayer online games (MMOGs): Ethical questions in shared space . International Review of Information Ethics , 4 ( 7 ), 2005 . D. E. Warner and M. Ratier. Social context in massively-multiplayer online games (MMOGs): Ethical questions in shared space. International Review of Information Ethics, 4(7), 2005.","journal-title":"International Review of Information Ethics"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.39.2.186"},{"key":"e_1_3_2_1_43_1","first-page":"1220","volume-title":"ACL '11","author":"Zaidan O.","year":"2011","unstructured":"O. Zaidan and C. Callison-Burch . Crowdsourcing translation: Professional quality from non-professionals . In ACL '11 , pages 1220 -- 1229 , 2011 . O. Zaidan and C. Callison-Burch. Crowdsourcing translation: Professional quality from non-professionals. In ACL '11, pages 1220--1229, 2011."}],"event":{"name":"WWW '14: 23rd International World Wide Web Conference","location":"Seoul Korea","acronym":"WWW '14","sponsor":["IW3C2 International World Wide Web Conference Committee","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the 23rd international conference on World wide web"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2566486.2567987","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2566486.2567987","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:00:59Z","timestamp":1750230059000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2566486.2567987"}},"subtitle":["predicting crowdsourced decisions on toxic behavior in online games"],"short-title":[],"issued":{"date-parts":[[2014,4,7]]},"references-count":42,"alternative-id":["10.1145\/2566486.2567987","10.1145\/2566486"],"URL":"https:\/\/doi.org\/10.1145\/2566486.2567987","relation":{},"subject":[],"published":{"date-parts":[[2014,4,7]]},"assertion":[{"value":"2014-04-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}