{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T14:30:19Z","timestamp":1773930619140,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,9,28]],"date-time":"2020-09-28T00:00:00Z","timestamp":1601251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key R8D Program of China","award":["2018AAA0100603"],"award-info":[{"award-number":["2018AAA0100603"]}]},{"DOI":"10.13039\/501100004731","name":"Zhejiang Natural Science Foundation","doi-asserted-by":"crossref","award":["LR19F020006"],"award-info":[{"award-number":["LR19F020006"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61836002, 61751209, and U1611461"],"award-info":[{"award-number":["61836002, 61751209, and U1611461"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>Game bots are automated programs that assist cheating users, leading to an imbalance in the game ecosystem and the collapse of user interest. Online games provide immersive gaming experience and attract many loyal fans. However, game bots have proliferated in volume and method, evolving with the real-world detection methods and showing strong diversity, leaving game bot detection efforts extremely difficult. Existing game bot detection techniques mostly rely on handcrafted features or time-series based features instead of fully utilizing player behavior sequences. In this regard, a more reasonable way should be learning user patterns from player behavior sequences when facing the fast-changing nature of game bots. Here we propose a general game bot detection framework for massively multiplayer online role playing games termed NGUARD+ (denoting NetEase Games\u2019 Guard), which captures user patterns in order to identify game bots from player behavior sequences. NGUARD+ mainly employs attention-based methods to automatically differentiate game bots from humans. We provide a combination of supervised and unsupervised methods for game bot detection to detect game bots and new type of game bots even when the labels of game bots are limited. Specifically, we propose the following two variants for attention-based sequence modeling: Attention based Bidirectional Long Short-Term Memory Networks (ABLSTM) and Hierarchical Self-Attention Network (HSAN) as our supervised models. ABLSTM is keen on inducing certain inductive biases which makes learning more reasonable as well as capturing local dependency and global information, while HSAN could handle much longer behavior sequences with less memory and higher computational efficiency. Experiments conducted on a real-world dataset show that NGUARD+ can achieve remarkable performance improvement compared to traditional methods. Moreover, NGUARD+ can reveal outstanding robustness for game bots in mutated patterns and even in completely unseen patterns.<\/jats:p>","DOI":"10.1145\/3399711","type":"journal-article","created":{"date-parts":[[2020,9,29]],"date-time":"2020-09-29T04:10:30Z","timestamp":1601352630000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["NGUARD+"],"prefix":"10.1145","volume":"14","author":[{"given":"Jiarong","family":"Xu","sequence":"first","affiliation":[{"name":"Zhejiang University, Zhejiang, China"}]},{"given":"Yifan","family":"Luo","sequence":"additional","affiliation":[{"name":"Zhejiang University, Zhejiang, China"}]},{"given":"Jianrong","family":"Tao","sequence":"additional","affiliation":[{"name":"NetEase Fuxi AI Lab, Zhejiang, China"}]},{"given":"Changjie","family":"Fan","sequence":"additional","affiliation":[{"name":"NetEase Fuxi AI Lab, Zhejiang, China"}]},{"given":"Zhou","family":"Zhao","sequence":"additional","affiliation":[{"name":"Zhejiang University, Zhejiang, China"}]},{"given":"Jiangang","family":"Lu","sequence":"additional","affiliation":[{"name":"Zhejiang University, Zhejiang, China"}]}],"member":"320","published-online":{"date-parts":[[2020,9,28]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 12th International Conference on Computational Science and Engineering.","author":"Ahmad M. A.","unstructured":"M. A. Ahmad , B. Keegan , J. Srivastava , D. Williams , and N. Contractor . 2009. Mining for gold farmers: Automatic detection of deviant players in MMOGs . In Proceedings of the 12th International Conference on Computational Science and Engineering. M. A. Ahmad, B. Keegan, J. Srivastava, D. Williams, and N. Contractor. 2009. Mining for gold farmers: Automatic detection of deviant players in MMOGs. In Proceedings of the 12th International Conference on Computational Science and Engineering."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_6"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 3rd International Conference on Learning Representations.","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2015 . Neural machine translation by jointly learning to align and translate . In Proceedings of the 3rd International Conference on Learning Representations. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102254.3102263"},{"key":"e_1_2_1_5_1","volume-title":"Identifying MMORPG bots: A traffic analysis approach. EURASIP Journal on Advances in Signal Processing","author":"Chen Kuan-Ta","year":"2009","unstructured":"Kuan-Ta Chen , Jhih-Wei Jiang , Polly Huang , Hao-Hua Chu , Chin-Laung Lei , and Wen-Chin Chen . 2009. Identifying MMORPG bots: A traffic analysis approach. EURASIP Journal on Advances in Signal Processing ( 2009 ), 797159. Kuan-Ta Chen, Jhih-Wei Jiang, Polly Huang, Hao-Hua Chu, Chin-Laung Lei, and Wen-Chin Chen. 2009. Identifying MMORPG bots: A traffic analysis approach. EURASIP Journal on Advances in Signal Processing (2009), 797159."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1517494.1517498"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-015-1545-2"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078186"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 29th International Conference on Neural Information Processing Systems. Curran Associates, Inc.","author":"Andrew","unstructured":"Andrew M. Dai and Quoc V. Le. 2015. Semi-supervised sequence learning . In Proceedings of the 29th International Conference on Neural Information Processing Systems. Curran Associates, Inc. Andrew M. Dai and Quoc V. Le. 2015. Semi-supervised sequence learning. In Proceedings of the 29th International Conference on Neural Information Processing Systems. Curran Associates, Inc."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 7th International Conference on Learning Representations.","author":"Dehghani Mostafa","year":"2019","unstructured":"Mostafa Dehghani , Stephan Gouws , Oriol Vinyals , Jakob Uszkoreit , and Lukasz Kaiser . 2019 . Universal transformers . In Proceedings of the 7th International Conference on Learning Representations. Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, and Lukasz Kaiser. 2019. Universal transformers. In Proceedings of the 7th International Conference on Learning Representations."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1402_1"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 226--231","author":"Ester Martin","year":"1996","unstructured":"Martin Ester , Hans-Peter Kriegel , J\u00f6rg Sander , and Xiaowei Xu . 1996 . A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise . In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 226--231 . Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, and Xiaowei Xu. 1996. A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 226--231."},{"key":"e_1_2_1_13_1","volume-title":"Philippe Fournier-Viger, Han-Chieh Chao, and Philip S. Yu.","author":"Gan Wensheng","year":"2019","unstructured":"Wensheng Gan , Jerry Chun-Wei Lin , Philippe Fournier-Viger, Han-Chieh Chao, and Philip S. Yu. 2019 . A survey of parallel sequential pattern mining. ACM Transactions on Knowledge Discovery from Data 13, 3 (2019), 1--34. Wensheng Gan, Jerry Chun-Wei Lin, Philippe Fournier-Viger, Han-Chieh Chao, and Philip S. Yu. 2019. A survey of parallel sequential pattern mining. ACM Transactions on Knowledge Discovery from Data 13, 3 (2019), 1--34."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. PMLR, 249--256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio . 2010 . Understanding the difficulty of training deep feedforward neural networks . In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. PMLR, 249--256 . Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. PMLR, 249--256."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077246.1077255"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. 770--778","author":"He Kaiming","year":"2015","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2015 . Deep residual learning for image recognition . In Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. 770--778 . Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep residual learning for image recognition. In Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition. 770--778."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CQR.2010.5619911"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_19_1","volume-title":"Alexandru Iosup, Fernando Kuipers, and Dick H. J. Epema.","author":"Jia Adele Lu","year":"2015","unstructured":"Adele Lu Jia , Siqi Shen , Ruud Van De Bovenkamp , Alexandru Iosup, Fernando Kuipers, and Dick H. J. Epema. 2015 . Socializing by gaming: Revealing social relationships in multiplayer online games. ACM Transactions on Knowledge Discovery from Data 10, 2 (2015), 1--29. Adele Lu Jia, Siqi Shen, Ruud Van De Bovenkamp, Alexandru Iosup, Fernando Kuipers, and Dick H. J. Epema. 2015. Socializing by gaming: Revealing social relationships in multiplayer online games. ACM Transactions on Knowledge Discovery from Data 10, 2 (2015), 1--29."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 8th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum, 531--546","author":"Jordan Michael I.","year":"1986","unstructured":"Michael I. Jordan . 1986 . Attractor dynamics and parallelism in a connectionist sequential machine . In Proceedings of the 8th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum, 531--546 . Michael I. Jordan. 1986. Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the 8th Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum, 531--546."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40064-016-2122-8"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/11589990_187"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 5th International Conference on Learning Representations.","author":"Kim Yoon","unstructured":"Yoon Kim , Carl Denton , Luong Hoang , and Alexander M. Rush . 2017. Structured attention networks . In Proceedings of the 5th International Conference on Learning Representations. Yoon Kim, Carl Denton, Luong Hoang, and Alexander M. Rush. 2017. Structured attention networks. In Proceedings of the 5th International Conference on Learning Representations."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2016.2623586"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2016.23436"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-13356-0_32"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 14th Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1412--1421","author":"Luong Thang","unstructured":"Thang Luong , Hieu Pham , and Christopher D. Manning . 2015. Effective approaches to attention-based neural machine translation . In Proceedings of the 14th Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1412--1421 . Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 14th Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1412--1421."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2016.7752297"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.222"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICICS.2011.6174239"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00114845"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1944796.1944812"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976602320263980"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 32th AAAI Conference on Artificial Intelligence.","author":"Shen Tao","year":"2018","unstructured":"Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Shirui Pan , and Chengqi Zhang . 2018 . DiSAN: Directional self-attention network for RNN\/CNN-free language understanding . In Proceedings of the 32th AAAI Conference on Artificial Intelligence. Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, Shirui Pan, and Chengqi Zhang. 2018. DiSAN: Directional self-attention network for RNN\/CNN-free language understanding. In Proceedings of the 32th AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 28th International Conference on Neural Information Processing Systems. Curran Associates, Inc.","author":"Sutskever Ilya","unstructured":"Ilya Sutskever , Oriol Vinyals , and Quoc V. Le . 2014. Sequence to sequence learning with neural networks . In Proceedings of the 28th International Conference on Neural Information Processing Systems. Curran Associates, Inc. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems. Curran Associates, Inc."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219925"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.2.270"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2425296.2425300"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2018436.2018484"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1324198.1324205"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3399711","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3399711","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:13Z","timestamp":1750199893000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3399711"}},"subtitle":["An Attention-based Game Bot Detection Framework via Player Behavior Sequences"],"short-title":[],"issued":{"date-parts":[[2020,9,28]]},"references-count":44,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3399711"],"URL":"https:\/\/doi.org\/10.1145\/3399711","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,28]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}