{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:18:02Z","timestamp":1760059082227,"version":"build-2065373602"},"reference-count":73,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T00:00:00Z","timestamp":1747785600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Trolling behavior is not simply a result of \u2018bad actors\u2019, an individual trait, or a linguistic phenomenon, but emerges from complex contagious social dynamics. This study uses formal concepts from information theory and complexity science to study it as such. The data comprised over 13 million Reddit comments, which were classified as troll or non-troll messages using the BERT model, fine-tuned with a human coding set. We derive the unique, minimally complex, and maximally predictive model from statistical mechanics, i.e., \u03b5-machines and transducers, and can distinguish which aspects of trolling behaviors are both self-motivated and socially induced. While the vast majority of self-driven dynamics are like flipping a coin (86.3%), when social contagion is considered, most users (95.6%) show complex hidden multiple-state patterns. Within this complexity, trolling follows predictable transitions, with, for example, a 76% probability of remaining in a trolling state once it is reached. We find that replying to a trolling comment significantly increases the likelihood of switching to a trolling state or staying in it (72%). Besides being a showcase for the use of information-theoretic measures from dynamic systems theory to conceptualize human dynamics, our findings suggest that users and platform designers should go beyond calling out and removing trolls, but foster and design environments that discourage the dynamics leading to the emergence of trolling behavior.<\/jats:p>","DOI":"10.3390\/e27050542","type":"journal-article","created":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T06:31:27Z","timestamp":1747809087000},"page":"542","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Will You Become the Next Troll? A Computational Mechanics Approach to the Contagion of Trolling Behavior"],"prefix":"10.3390","volume":"27","author":[{"given":"Qiusi","family":"Sun","sequence":"first","affiliation":[{"name":"School of Information Studies, Syracuse University, Syracuse, NY 13244, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0809-6361","authenticated-orcid":false,"given":"Martin","family":"Hilbert","sequence":"additional","affiliation":[{"name":"Department of Communication, University of California, Davis, CA 95616, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,5,21]]},"reference":[{"key":"ref_1","unstructured":"Statista (2025, April 25). Share of Adult Internet Users in the United States Who Have Personally Experienced Online Harassment as of March 2023. Available online: https:\/\/www.statista.com\/statistics\/1497946\/us-internet-online-harassment-severe\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Vel\u00e1squez, N., Leahy, R., Restrepo, N.J., Lupu, Y., Sear, R., Gabriel, N., Jha, O.K., Goldberg, B., and Johnson, N.F. (2021). Online hate network spreads malicious COVID-19 content outside the control of individual social media platforms. Sci. Rep., 11.","DOI":"10.1038\/s41598-021-89467-y"},{"key":"ref_3","unstructured":"Shin, J. (2008, January 3). Morality and Internet Behavior: A study of the Internet Troll and its relation with morality on the Internet. Proceedings of the Society for Information Technology & Teacher Education International Conference, Las Vegas, NV, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1080\/01972240290108186","article-title":"Searching for safety online: Managing \u201ctrolling\u201d in a feminist forum","volume":"18","author":"Herring","year":"2002","journal-title":"Inf. Soc."},{"key":"ref_5","unstructured":"Engelin, M., and De Silva, F. (2016). Troll detection: A comparative study in detecting troll farms on Twitter using cluster analysis. [Bachelor Thesis, KTH Royal Institute of Technology]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.chb.2016.02.070","article-title":"Trolling the trolls: Online forum users constructions of the nature and properties of trolling","volume":"60","author":"Coles","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1515\/jplr.2010.011","article-title":"Trolling in asynchronous computer-mediated communication: From user discussions to academic definitions","volume":"6","author":"Hardaker","year":"2010","journal-title":"J. Politeness Res."},{"key":"ref_8","unstructured":"L\u00f6kk, A., and Hallman, J. (2025, March 10). Viability of Sentiment Analysis for Troll Detection on Twitter: A Comparative Study Between the Naive Bayes and Maximum Entropy Algorithms. Available online: https:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:kth:diva-186443."},{"key":"ref_9","first-page":"293","article-title":"For whom the gamer trolls: A study of trolling interactions in the online gaming context","volume":"24","author":"Cook","year":"2019","journal-title":"J. Comput.-Mediat. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1080\/19312450701434979","article-title":"Generalization in process theories of communication","volume":"1","author":"Poole","year":"2007","journal-title":"Commun. Methods Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1023\/A:1010388907793","article-title":"Computational mechanics: Pattern and prediction, structure and simplicity","volume":"104","author":"Shalizi","year":"2001","journal-title":"J. Stat. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1111\/j.1468-2958.1975.tb00268.x","article-title":"Phases of conflict in small group development: A Markov analysis","volume":"1","author":"Ellis","year":"1975","journal-title":"Hum. Commun. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1080\/03637758309390154","article-title":"A cyclical model of developing relationships: A study of relational control interaction","volume":"50","author":"Fisher","year":"1983","journal-title":"Commun. Monogr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/j.1468-2958.1979.tb00287.x","article-title":"Talk-silence sequences in informal conversations I","volume":"6","author":"Cappella","year":"1979","journal-title":"Hum. Commun. Res."},{"key":"ref_15","unstructured":"Thomas, M., and Joy, A.T. (2006). Elements of Information Theory, Wiley-Interscience."},{"key":"ref_16","first-page":"7","article-title":"Dynamic systems research on interindividual communication: The transformation of meaning-making","volume":"1","author":"Fogel","year":"2006","journal-title":"J. Dev. Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Koma\u00e7, G., and \u00c7a\u011f\u0131ltay, K. (2019, January 6\u20137). An overview of trolling behavior in online spaces and gaming context. Proceedings of the 2019 1st International Informatics and Software Engineering Conference (UBMYK), Ankara, Turkey.","DOI":"10.1109\/UBMYK48245.2019.8965625"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1558\/ijsll.34803","article-title":"Functional linguistic variation in Twitter trolling","volume":"26","author":"Clarke","year":"2019","journal-title":"Int. J. Speech Lang. Law"},{"key":"ref_19","unstructured":"Breeze, M. (2025, March 10). The Problems with Anonymous Trolls and Accountability in the Digital Age. Available online: https:\/\/thenextweb.com\/insider\/2012\/10\/27\/the-problems-with-anonymous-trolls-and-accountability-in-the-digital-age\/."},{"key":"ref_20","unstructured":"Donath, J.S. (2002). Identity and deception in the virtual community. Communities Cyberspace, Routledge."},{"key":"ref_21","first-page":"8","article-title":"\u201cDon\u2019t feed the troll\u201d: Shutting down debate about community expectations on Reddit.com","volume":"16","author":"Bergstrom","year":"2011","journal-title":"First Monday"},{"key":"ref_22","unstructured":"Merritt, E. (2012). An analysis of the Discourse of Internet Trolling: A Case Study of Reddit.com. [Bachelor\u2019s thesis, Mount Holyoke College]."},{"key":"ref_23","unstructured":"Nevin, A.D. (2015). Cyber-Psychopathy: Examining the Relationship Between Dark E-Personality and Online Misconduct. [Master\u2019s Thesis, The University of Western Ontario]."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"176","DOI":"10.17645\/mac.v7i4.2347","article-title":"Between a troll and a hard place: The demand framework\u2019s answer to one of gaming\u2019s biggest problems","volume":"7","author":"Cook","year":"2019","journal-title":"Media Commun."},{"key":"ref_25","unstructured":"Fichman, P., and Sanfilippo, M.R. (2016). Online Trolling and Its Perpetrators: Under the Cyberbridge, Rowman & Littlefield."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Cheng, J., Bernstein, M., Danescu-Niculescu-Mizil, C., and Leskovec, J. (March, January 25). Anyone can become a troll: Causes of trolling behavior in online discussions. Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, Portland, ON, USA.","DOI":"10.1145\/2998181.2998213"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.paid.2014.01.016","article-title":"Trolls just want to have fun","volume":"67","author":"Buckels","year":"2014","journal-title":"Personal. Individ. Differ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.paid.2016.06.043","article-title":"The dark side of Facebook\u00ae: The Dark Tetrad, negative social potency, and trolling behaviours","volume":"102","author":"Craker","year":"2016","journal-title":"Personal. Individ. Differ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1111\/1469-7610.00034","article-title":"Annotation: The role of prefrontal deficits, low autonomic arousal, and early health factors in the development of antisocial and aggressive behavior in children","volume":"43","author":"Raine","year":"2002","journal-title":"J. Child Psychol. Psychiatry"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cinelli, M., Pelicon, A., Mozeti\u010d, I., Quattrociocchi, W., Novak, P.K., and Zollo, F. (2021). Dynamics of online hate and misinformation. Sci. Rep., 11.","DOI":"10.1038\/s41598-021-01487-w"},{"key":"ref_31","first-page":"279","article-title":"Information theory and statistics","volume":"1","author":"Cover","year":"1991","journal-title":"Elem. Inf. Theory"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_33","first-page":"754","article-title":"Entropy per unit time as a metric invariant of automorphisms","volume":"124","author":"Kolmogorov","year":"1959","journal-title":"Dokl. Russ. Acad. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2034","DOI":"10.4249\/scholarpedia.2034","article-title":"Kolmogorov-sinai entropy","volume":"4","author":"Sinai","year":"2009","journal-title":"Scholarpedia"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1002\/j.1538-7305.1951.tb01366.x","article-title":"Prediction and entropy of printed English","volume":"30","author":"Shannon","year":"1951","journal-title":"Bell Syst. Tech. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/0167-2789(94)90273-9","article-title":"The calculi of emergence: Computation, dynamics and induction","volume":"75","author":"Crutchfield","year":"1994","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_37","unstructured":"Crutchfield, J.P. (2017). The origins of computational mechanics: A brief intellectual history and several clarifications. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1103\/PhysRevLett.63.105","article-title":"Inferring statistical complexity","volume":"63","author":"Crutchfield","year":"1989","journal-title":"Phys. Rev. Lett."},{"key":"ref_39","unstructured":"Darmon, D. (2015). Statistical Methods for Analyzing Time Series Data Drawn from Complex Social Systems. [Ph.D. Thesis, University of Maryland]."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1038\/nphys2190","article-title":"Between order and chaos","volume":"8","author":"Crutchfield","year":"2012","journal-title":"Nat. Phys."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1007\/s10955-015-1327-5","article-title":"Computational Mechanics of Input\u2013Output Processes: Structured Transformations and the \u03f5-Transducer","volume":"161","author":"Barnett","year":"2015","journal-title":"J. Stat. Phys."},{"key":"ref_42","first-page":"233","article-title":"Contagion: A theoretical and empirical review and reconceptualization","volume":"119","author":"Levy","year":"1993","journal-title":"Genet. Soc. Gen. Psychol. Monogr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"36","DOI":"10.15195\/v2.a4","article-title":"The social contagion of antisocial behavior","volume":"2","author":"Tsvetkova","year":"2015","journal-title":"Sociol. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1002\/hec.2873","article-title":"Social contagion of mental health: Evidence from college roommates","volume":"22","author":"Eisenberg","year":"2013","journal-title":"Health Econ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1111\/1467-8721.ep10770953","article-title":"Emotional contagion","volume":"2","author":"Hatfield","year":"1993","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1146\/annurev.psych.51.1.539","article-title":"Attitude change: Persuasion and social influence","volume":"51","author":"Wood","year":"2000","journal-title":"Annu. Rev. Psychol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1037\/h0023023","article-title":"Toward a theory of behavioral contagion","volume":"73","author":"Wheeler","year":"1966","journal-title":"Psychol. Rev."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1899","DOI":"10.1257\/aer.99.5.1899","article-title":"Innovation diffusion in heterogeneous populations: Contagion, social influence, and social learning","volume":"99","author":"Young","year":"2009","journal-title":"Am. Econ. Rev."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Herrando, C., and Constantinides, E. (2021). Emotional contagion: A brief overview and future directions. Front. Psychol., 12.","DOI":"10.3389\/fpsyg.2021.712606"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1126\/science.6612338","article-title":"Autonomic nervous system activity distinguishes among emotions","volume":"221","author":"Ekman","year":"1983","journal-title":"Science"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"8788","DOI":"10.1073\/pnas.1320040111","article-title":"Experimental evidence of massive-scale emotional contagion through social networks","volume":"111","author":"Kramer","year":"2014","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1002\/1098-2337(1984)10:3<243::AID-AB2480100308>3.0.CO;2-6","article-title":"Cognitive processes and the persistence of aggressive behavior","volume":"10","author":"Huesmann","year":"1984","journal-title":"Aggress. Behav."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.chb.2019.09.003","article-title":"I\u2019m just trolling: The role of normative beliefs in aggressive behaviour in online gaming","volume":"102","author":"Neill","year":"2020","journal-title":"Comput. Hum. Behav."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Beres, N.A., Frommel, J., Reid, E., Mandryk, R.L., and Klarkowski, M. (2021, January 8\u201313). Don\u2019t you know that you\u2019re toxic: Normalization of toxicity in online gaming. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445157"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"106343","DOI":"10.1016\/j.chb.2020.106343","article-title":"Viral vitriol: Predictors and contagion of online toxicity in World of Tanks","volume":"108","author":"Shen","year":"2020","journal-title":"Comput. Hum. Behav."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1145\/230514.571645","article-title":"Introduction to the Theory of Computation","volume":"27","author":"Sipser","year":"1996","journal-title":"ACM Sigact News"},{"key":"ref_57","unstructured":"Statista (2023, February 14). Most Popular Social Networks Worldwide as of January 2023, Ranked by Number of Monthly Actuve Users. Available online: https:\/\/www.statista.com\/statistics\/272014\/global-social-networks-ranked-by-number-of-users\/."},{"key":"ref_58","unstructured":"Reddit (2021, September 02). Reddit Policy. Available online: https:\/\/www.reddithelp.com\/hc\/en-us\/categories\/360003246511-Privacy-Security."},{"key":"ref_59","first-page":"22","article-title":"The measurement of interrater agreement","volume":"2","author":"Fleiss","year":"1981","journal-title":"Stat. Methods Rates Proportions"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Sun, Q., Wojcieszak, M., and Davidson, S. (2021). Over-Time Trends in Incivility on Social Media: Evidence From Political, Non-Political, and Mixed Sub-Reddits Over Eleven Years. Front. Political Sci., 3.","DOI":"10.3389\/fpos.2021.741605"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"106786","DOI":"10.1016\/j.chb.2021.106786","article-title":"Who would respond to A troll? A social network analysis of reactions to trolls in online communities","volume":"121","author":"Sun","year":"2021","journal-title":"Comput. Hum. Behav."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Davidson, S., Sun, Q., and Wojcieszak, M. (2020, January 20). Developing a New Classifier for Automated Identification of Incivility in Social Media. Proceedings of the Fourth Workshop on Online Abuse and Harms, Online.","DOI":"10.18653\/v1\/2020.alw-1.12"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"094101","DOI":"10.1103\/PhysRevLett.103.094101","article-title":"Time\u2019s barbed arrow: Irreversibility, crypticity, and stored information","volume":"103","author":"Crutchfield","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Darmon, D., Sylvester, J., Girvan, M., and Rand, W. (2013, January 8\u201314). Predictability of user behavior in social media: Bottom-up v. top-down modeling. In Proceedings of the 2013 International Conference on Social Computing, Washington, DC, USA.","DOI":"10.1109\/SocialCom.2013.22"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Hilbert, M., and Darmon, D. (2020). How complexity and uncertainty grew with algorithmic trading. Entropy, 22.","DOI":"10.3390\/e22050499"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1093\/joc\/jqaa021","article-title":"Large-scale communication is more complex and unpredictable with automated bots","volume":"70","author":"Hilbert","year":"2020","journal-title":"J. Commun."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/BF00668821","article-title":"Toward a quantitative theory of self-generated complexity","volume":"25","author":"Grassberger","year":"1986","journal-title":"Int. J. Theor. Phys."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"R1239","DOI":"10.1103\/PhysRevE.55.R1239","article-title":"Statistical complexity of simple one-dimensional spin systems","volume":"55","author":"Crutchfield","year":"1997","journal-title":"Phys. Rev. E"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1162\/089976601753195969","article-title":"Predictability, complexity, and learning","volume":"13","author":"Bialek","year":"2001","journal-title":"Neural Comput."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Nav. Res. Logist. Q."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1137\/0105003","article-title":"Algorithms for the assignment and transportation problems","volume":"5","author":"Munkres","year":"1957","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"e1169","DOI":"10.1542\/peds.2006-0815","article-title":"Examining characteristics and associated distress related to Internet harassment: Findings from the Second Youth Internet Safety Survey","volume":"118","author":"Ybarra","year":"2006","journal-title":"Pediatrics"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1089\/1094931041291295","article-title":"The online disinhibition effect","volume":"7","author":"Suler","year":"2004","journal-title":"Cyberpsychol. Behav."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/5\/542\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:36:21Z","timestamp":1760031381000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/5\/542"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,21]]},"references-count":73,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["e27050542"],"URL":"https:\/\/doi.org\/10.3390\/e27050542","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2025,5,21]]}}}