{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T14:32:16Z","timestamp":1780929136609,"version":"3.54.1"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T00:00:00Z","timestamp":1617840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1719722 and 2036127"],"award-info":[{"award-number":["1719722 and 2036127"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2021,5,31]]},"abstract":"<jats:p>\n                    Cyberbullying is rapidly becoming one of the most serious online risks for adolescents. This has motivated work on machine learning methods to automate the process of cyberbullying detection, which have so far mostly viewed cyberbullying as one-off incidents that occur at a single point in time. Comparatively less is known about how cyberbullying behavior occurs and evolves over time. This oversight highlights a crucial open challenge for cyberbullying-related research, given that cyberbullying is typically defined as intentional acts of aggression via electronic communication that occur\n                    <jats:italic toggle=\"yes\">repeatedly<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">persistently<\/jats:italic>\n                    . In this article, we center our discussion on the challenge of modeling temporal patterns of cyberbullying behavior. Specifically, we investigate how temporal information within a social media session, which has an inherently hierarchical structure (e.g., words form a comment and comments form a session), can be leveraged to facilitate cyberbullying detection. Recent findings from interdisciplinary research suggest that the temporal characteristics of bullying sessions differ from those of non-bullying sessions and that the temporal information from users\u2019 comments can improve cyberbullying detection. The proposed framework consists of three distinctive features: (1) a hierarchical structure that reflects how a social media session is formed in a bottom-up manner; (2) attention mechanisms applied at the word- and comment-level to differentiate the contributions of words and comments to the representation of a social media session; and (3) the incorporation of temporal features in modeling cyberbullying behavior at the comment-level. Quantitative and qualitative evaluations are conducted on a real-world dataset collected from Instagram, the social networking site with the highest percentage of users reporting cyberbullying experiences. Results from empirical evaluations show the significance of the proposed methods, which are tailored to capture temporal patterns of cyberbullying detection.\n                  <\/jats:p>","DOI":"10.1145\/3441141","type":"journal-article","created":{"date-parts":[[2021,4,8]],"date-time":"2021-04-08T16:54:59Z","timestamp":1617900899000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["Modeling Temporal Patterns of Cyberbullying Detection with Hierarchical Attention Networks"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2503-2522","authenticated-orcid":false,"given":"Lu","family":"Cheng","sequence":"first","affiliation":[{"name":"Arizona State University, Tempe, AZ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruocheng","family":"Guo","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, AZ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasin N.","family":"Silva","sequence":"additional","affiliation":[{"name":"Arizona State University, Glendale, AZ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deborah","family":"Hall","sequence":"additional","affiliation":[{"name":"Arizona State University, Glendale, AZ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huan","family":"Liu","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, AZ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,8]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Multi-task learning for universal sentence embeddings: A thorough evaluation using transfer and auxiliary tasks. arXiv preprint arXiv:1804.07911","author":"Ahmad Wasi Uddin","year":"2018","unstructured":"Wasi Uddin Ahmad, Xueying Bai, Zhechao Huang, Chao Jiang, Nanyun Peng, and Kai-Wei Chang. 2018. Multi-task learning for universal sentence embeddings: A thorough evaluation using transfer and auxiliary tasks. arXiv preprint arXiv:1804.07911 (2018)."},{"key":"e_1_2_1_2_1","volume-title":"Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473","author":"Bahdanau Dzmitry","year":"2014","unstructured":"Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622407.1622416"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326024"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3316503"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the SIAM International Conference on Data Mining. SIAM, 235\u2013243","author":"Cheng Lu","year":"2019","unstructured":"Lu Cheng, Ruocheng Guo, Yasin Silva, Deborah Hall, and Huan Liu. 2019. Hierarchical attention networks for cyberbullying detection on the Instagram social network. In Proceedings of the SIAM International Conference on Data Mining. SIAM, 235\u2013243."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/3367722.3367858"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3291037"},{"key":"e_1_2_1_10_1","volume-title":"Session-based cyberbullying detection: Problems and challenges","author":"Cheng Lu","year":"2020","unstructured":"Lu Cheng, Yasin Silva, Deborah Hall, and Huan Liu. 2020. Session-based cyberbullying detection: Problems and challenges. IEEE Internet Comput., Spec. Iss. Cyber-soc. Health: Promot. Good Counter. Harm Soc. Media (2020)."},{"key":"e_1_2_1_11_1","volume-title":"Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555","author":"Chung Junyoung","year":"2014","unstructured":"Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)."},{"key":"e_1_2_1_12_1","volume-title":"Very deep convolutional networks for text classification. arXiv preprint arXiv:1606.01781","author":"Conneau Alexis","year":"2016","unstructured":"Alexis Conneau, Holger Schwenk, Lo\u00efc Barrault, and Yann Lecun. 2016. Very deep convolutional networks for text classification. arXiv preprint arXiv:1606.01781 (2016)."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop (DIR\u201912)","author":"Dadvar Maral","year":"2012","unstructured":"Maral Dadvar, F. M. G. de Jong, Roeland Ordelman, and Dolf Trieschnigg. 2012. Improved cyberbullying detection using gender information. In Proceedings of the 12th Dutch-Belgian Information Retrieval Workshop (DIR\u201912). University of Ghent."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-71249-9_4"},{"key":"e_1_2_1_15_1","volume-title":"BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_2_1_16_1","volume-title":"TopicRNN: A recurrent neural network with long-range semantic dependency. arXiv preprint arXiv:1611.01702","author":"Dieng Adji B.","year":"2016","unstructured":"Adji B. Dieng, Chong Wang, Jianfeng Gao, and John Paisley. 2016. TopicRNN: A recurrent neural network with long-range semantic dependency. arXiv preprint arXiv:1611.01702 (2016)."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the Social Mobile Web Conference.","author":"Dinakar Karthik","year":"2011","unstructured":"Karthik Dinakar, Roi Reichart, and Henry Lieberman. 2011. Modeling the detection of textual cyberbullying. In Proceedings of the Social Mobile Web Conference."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397269"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366424.3385771"},{"key":"e_1_2_1_20_1","volume-title":"The annual bullying survey","author":"Hackett L.","year":"2017","unstructured":"L. Hackett. 2017. The annual bullying survey 2017. DitchThe Label. Retrieved from https:\/\/www.ditchthelabel.org\/research-papers\/the-annual-bullyingsurvey-2017."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_22_1","volume-title":"Rahat Ibn Rafiq, Richard Han, Qin Lv, and Shivakant Mishra.","author":"Hosseinmardi Homa","year":"2015","unstructured":"Homa Hosseinmardi, Sabrina Arredondo Mattson, Rahat Ibn Rafiq, Richard Han, Qin Lv, and Shivakant Mishra. 2015. Detection of cyberbullying incidents on the Instagram social network. arXiv preprint arXiv:1503.03909 (2015)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661126.2661133"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 53rd Meeting of the Association for Computational Linguistics. 1681\u20131691","author":"Iyyer Mohit","year":"2015","unstructured":"Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, and Hal Daum\u00e9 III. 2015. Deep unordered composition rivals syntactic methods for text classification. In Proceedings of the 53rd Meeting of the Association for Computational Linguistics. 1681\u20131691."},{"key":"e_1_2_1_25_1","volume-title":"Effective use of word order for text categorization with convolutional neural networks. arXiv preprint arXiv:1412.1058","author":"Johnson Rie","year":"2014","unstructured":"Rie Johnson and Tong Zhang. 2014. Effective use of word order for text categorization with convolutional neural networks. arXiv preprint arXiv:1412.1058 (2014)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969342"},{"key":"e_1_2_1_27_1","volume-title":"A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188","author":"Kalchbrenner Nal","year":"2014","unstructured":"Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188 (2014)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016586"},{"key":"e_1_2_1_29_1","volume-title":"Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882","author":"Kim Yoon","year":"2014","unstructured":"Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 12th Conference of the International Speech Communication Association.","author":"Kombrink Stefan","year":"2011","unstructured":"Stefan Kombrink, Tom\u00e1\u0161 Mikolov, Martin Karafi\u00e1t, and Luk\u00e1\u0161 Burget. 2011. Recurrent neural network based language modeling in meeting recognition. In Proceedings of the 12th Conference of the International Speech Communication Association."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2464464.2464499"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886636"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080834"},{"key":"e_1_2_1_34_1","first-page":"2579","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, Nov. (2008), 2579\u20132605.","journal-title":"J. Mach. Learn. Res. 9"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/2999792.2999959"},{"key":"e_1_2_1_36_1","volume-title":"Deep learning based text classification: A comprehensive review. arXiv preprint arXiv:2004.03705","author":"Minaee Shervin","year":"2020","unstructured":"Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, and Jianfeng Gao. 2020. Deep learning based text classification: A comprehensive review. arXiv preprint arXiv:2004.03705 (2020)."},{"key":"e_1_2_1_37_1","first-page":"238","article-title":"An effective approach for cyberbullying detection","volume":"3","author":"Nahar Vinita","year":"2013","unstructured":"Vinita Nahar, Xue Li, and Chaoyi Pang. 2013. An effective approach for cyberbullying detection. Commun. Inf. Sci. Manag. Eng. 3, 5 (2013), 238.","journal-title":"Commun. Inf. Sci. Manag. Eng."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29253-8_75"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers. 695\u2013706","author":"Nand Parma","year":"2016","unstructured":"Parma Nand, Rivindu Perera, and Abhijeet Kasture. 2016. \u201cHow bullying is this message?\u201d: A psychometric thermometer for bullying. In Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers. 695\u2013706."},{"key":"e_1_2_1_40_1","volume-title":"Booth","author":"Pennebaker James W.","year":"2001","unstructured":"James W. Pennebaker, Martha E. Francis, and Roger J. Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawr. Erlb. Assoc. 71, 2001 (2001)."},{"key":"e_1_2_1_41_1","first-page":"3","article-title":"Approaches to automated detection of cyberbullying: A survey","volume":"11","author":"Salawu Semiu","year":"2017","unstructured":"Semiu Salawu, Yulan He, and Joanna Lumsden. 2017. Approaches to automated detection of cyberbullying: A survey. IEEE Trans. Automat. Control 11, 1 (2017), 3--24.","journal-title":"IEEE Trans. Automat. Control"},{"key":"e_1_2_1_42_1","volume-title":"Attentive pooling networks. arXiv preprint arXiv:1602.03609","author":"dos Santos Cicero","year":"2016","unstructured":"Cicero dos Santos, Ming Tan, Bing Xiang, and Bowen Zhou. 2016. Attentive pooling networks. arXiv preprint arXiv:1602.03609 (2016)."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence.","author":"Shen Tao","year":"2018","unstructured":"Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, Shirui Pan, and Chengqi Zhang. 2018. DiSAN: Directional self-attention network for RNN\/CNN-free language understanding. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.2007.01846.x"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 12thInternational AAAI Conference on Web and Social Media.","author":"Soni Devin","year":"2018","unstructured":"Devin Soni and Vivek Singh. 2018. Time reveals all wounds: Modeling temporal characteristics of cyberbullying. In Proceedings of the 12thInternational AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2808797.2809398"},{"key":"e_1_2_1_47_1","volume-title":"Manning","author":"Tai Kai Sheng","year":"2015","unstructured":"Kai Sheng Tai, Richard Socher, and Christopher D. Manning. 2015. Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075 (2015)."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 52nd Meeting of the Association for Computational Linguistics","volume":"1","author":"Tang Duyu","year":"2014","unstructured":"Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, and Bing Qin. 2014. Learning sentiment-specific word embedding for Twitter sentiment classification. In Proceedings of the 52nd Meeting of the Association for Computational Linguistics, Vol. 1. 1555\u20131565."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/2382029.2382139"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the International Conference on Advances in Neural Information Processing Systems. 5754\u20135764","author":"Yang Zhilin","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R. Salakhutdinov, and Quoc V. Le. 2019. XLNet: Generalized autoregressive pretraining for language understanding. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 5754\u20135764."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1174"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313462"},{"key":"e_1_2_1_54_1","first-page":"1","article-title":"Detection of harassment on web 2.0","volume":"2","author":"Yin Dawei","year":"2009","unstructured":"Dawei Yin, Zhenzhen Xue, Liangjie Hong, Brian D. Davison, April Kontostathis, and Lynne Edwards. 2009. Detection of harassment on web 2.0. Proc. Content Anal. WEB 2 (2009), 1\u20137.","journal-title":"Proc. Content Anal. WEB"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1186\/s40537-017-0095-2","article-title":"Using deep learning for short text understanding","volume":"4","author":"Zhan Justin","year":"2017","unstructured":"Justin Zhan and Binay Dahal. 2017. Using deep learning for short text understanding. J. Big Data 4, 1 (2017), 34.","journal-title":"J. Big Data"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969312"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. 247\u2013256","author":"Zhou Xinjie","year":"2016","unstructured":"Xinjie Zhou, Xiaojun Wan, and Jianguo Xiao. 2016. Attention-based LSTM network for cross-lingual sentiment classification. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 247\u2013256."},{"key":"e_1_2_1_58_1","volume-title":"repetitive, intentional, visible, and imbalanced: Refining representations for cyberbullying classification. arXiv preprint arXiv:2004.01820","author":"Ziems Caleb","year":"2020","unstructured":"Caleb Ziems, Ymir Vigfusson, and Fred Morstatter. 2020. Aggressive, repetitive, intentional, visible, and imbalanced: Refining representations for cyberbullying classification. arXiv preprint arXiv:2004.01820 (2020)."}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3441141","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3441141","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:55:43Z","timestamp":1776347743000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3441141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,8]]},"references-count":58,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,5,31]]}},"alternative-id":["10.1145\/3441141"],"URL":"https:\/\/doi.org\/10.1145\/3441141","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2021,4,8]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}