{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:54:44Z","timestamp":1760234084571,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,3,20]],"date-time":"2021-03-20T00:00:00Z","timestamp":1616198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 107-2218-E-035-009-MY3"],"award-info":[{"award-number":["MOST 107-2218-E-035-009-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Online social media platforms play an important role in political communication where users can freely express and exchange their political opinion. Political entities have leveraged social media platforms as essential channels to disseminate information, interact with voters, and even influence public opinion. For this purpose, some organizations may create one or more accounts to join online political discussions. Using these accounts, they could promote candidates and attack competitors. To avoid such misleading speeches and improve the transparency of the online society, spotting such malicious accounts and understanding their behaviors are crucial issues. In this paper, we aim to use network-based analysis to sense influential human-operated malicious accounts who attempt to manipulate public opinion on political discussion forums. To this end, we collected the election-related articles and malicious accounts from the prominent Taiwan discussion forum spanning from 25 May 2018 to 11 January 2020 (the election day). We modeled the discussion network as a multilayer network and used various centrality measures to sense influential malicious accounts not only in a single-layer but also across different layers of the network. Moreover, community analysis was performed to discover prominent communities and their characteristics for each layer of the network. The results demonstrate that our proposed method can successfully identify several influential malicious accounts and prominent communities with apparent behavior differences from others.<\/jats:p>","DOI":"10.3390\/s21062183","type":"journal-article","created":{"date-parts":[[2021,3,21]],"date-time":"2021-03-21T23:47:41Z","timestamp":1616370461000},"page":"2183","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Understanding Malicious Accounts in Online Political Discussions: A Multilayer Network Approach"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8623-8428","authenticated-orcid":false,"given":"Nhut-Lam","family":"Nguyen","sequence":"first","affiliation":[{"name":"Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5680-4003","authenticated-orcid":false,"given":"Ming-Hung","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Chen","family":"Dai","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0978-9576","authenticated-orcid":false,"given":"Chyi-Ren","family":"Dow","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1177\/1354068811407580","article-title":"Online Social Networks and Micro-blogging in Political Campaigning: The Exploration of a New Campaign Tool and a New Campaign Style","volume":"19","author":"Vergeer","year":"2013","journal-title":"Party Politics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/j.giq.2017.11.001","article-title":"Analysis of Political Discourse on Twitter in the Context of the 2016 US Presidential Elections","volume":"34","author":"Yaqub","year":"2017","journal-title":"Gov. Inf. Q."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Badawy, A., Ferrara, E., and Lerman, K. (2018, January 28\u201331). Analyzing the Digital Traces of Political Manipulation: The 2016 Russian Interference Twitter Campaign. Proceedings of the 2018 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining, Barcelona, Spain.","DOI":"10.1109\/ASONAM.2018.8508646"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1080\/19331681.2017.1337602","article-title":"Opinion Leadership in Parliamentary Twitter Networks: A Matter of Layers of Interaction?","volume":"14","author":"Bravo","year":"2017","journal-title":"J. Inf. Technol. Polit."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1177\/0267323120940909","article-title":"The Importance of Influential Users in (Re)Producing Swedish Far-Right Discourse on Twitter","volume":"35","year":"2020","journal-title":"Eur. J. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1016\/j.ipm.2016.04.003","article-title":"Measuring User Influence on Twitter: A Survey","volume":"52","author":"Riquelme","year":"2016","journal-title":"Inf. Process. Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2721","DOI":"10.3233\/JIFS-169112","article-title":"Identifying the Influential Spreaders in Multilayer Interactions of Online Social Networks","volume":"31","author":"Varathan","year":"2016","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1016\/j.chb.2017.04.001","article-title":"Discovering Suspicious Behavior in Multilayer Social Networks","volume":"73","author":"Bindu","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.chaos.2014.12.023","article-title":"Multiple Leaders on a Multilayer Social Media","volume":"72","author":"Borondo","year":"2015","journal-title":"Chaos Solitons Fractals"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bessi, A., and Ferrara, E. (2016). Social Bots Distort the 2016 US Presidential Election Online Discussion. First Monday, 21.","DOI":"10.5210\/fm.v21i11.7090"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hagen, L., Neely, S., Keller, T.E., Scharf, R., and Vasquez, F.E. (2020). Rise of the Machines? Examining the Influence of Social Bots on a Political Discussion Network. Soc. Sci. Comput. Rev.","DOI":"10.1177\/0894439320908190"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Heredia, B., Prusa, J.D., and Khoshgoftaar, T.M. (2018, January 18\u201320). The Impact of Malicious Accounts on Political Tweet Sentiment. Proceedings of the 2018 IEEE 4th International Conference on Collaboration and Internet Computing (CIC), Philadelphia, PA, USA.","DOI":"10.1109\/CIC.2018.00035"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ciampaglia, G.L., Mashhadi, A., and Yasseri, T. (2017). Seminar Users in the Arabic Twitter Sphere. Lecture Notes in Computer Science, Proceedings of the Social Informatics, Oxford, UK, 13\u201315 September 2017, Springer International Publishing.","DOI":"10.1007\/978-3-319-67217-5"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zuccon, G., Geva, S., Joho, H., Scholer, F., Sun, A., and Zhang, P. (2015). Analysis of Cyber Army\u2019s Behaviours on Web Forum for Elect Campaign. Lecture Notes in Computer Science, Proceedings of the Information Retrieval Technology, Brisbane, QLD, Australia, 2\u20134 December 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-28940-3"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, M.H., and Dai, Y.C. (2020, January 5\u20139). POSTER: How Do Suspicious Accounts Participate in Online Political Discussions? A Preliminary Study in Taiwan. Proceedings of the 15th ACM Asia Conference on Computer and Communications Security, Taipei, Taiwan.","DOI":"10.1145\/3320269.3405433"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chiang, C.P., Chen, H.Y., Tsai, T.M., Chang, S.H., Chen, Y.C., and Wang, S.J. (2020, January 5\u20138). Profiling Operations of Cyber Army in Manipulating Public Opinions. Proceedings of the 2020 The 6th International Conference on Frontiers of Educational Technologies, Tokyo, Japan.","DOI":"10.1145\/3404709.3404766"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1177\/0267323115577305","article-title":"Followers Are Opinion Leaders: The Role of People in the Flow of Political Communication on and Beyond Social Networking Sites","volume":"30","author":"Karlsen","year":"2015","journal-title":"Eur. J. Commun."},{"key":"ref_18","first-page":"214","article-title":"Online Influence? Social Media Use, Opinion Leadership, and Political Persuasion","volume":"29","author":"Weeks","year":"2015","journal-title":"Int. J. Public Opin. Res."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cha, M., Haddadi, H., Benevenuto, F., and Gummadi, K. (2010, January 23\u201326). Measuring User Influence in Twitter: The Million Follower Fallacy. Proceedings of the International AAAI Conference on Web and Social Media, Washington, DC, USA.","DOI":"10.1609\/icwsm.v4i1.14033"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.chb.2015.07.052","article-title":"Are You Connected? Evaluating Information Cascades in Online Discussion about the #RaceTogether Campaign","volume":"54","author":"Feng","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"180642","DOI":"10.1098\/rsos.180642","article-title":"Variations in Power of Opinion Leaders in Online Communication Networks","volume":"5","author":"Adalat","year":"2018","journal-title":"R. Soc. Open Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lamir\u00e1n-Palomares, J.M., Baviera, T., and Baviera-Puig, A. (2019). Identifying Opinion Leaders on Twitter During Sporting Events: Lessons from a Case Study. Soc. Sci., 8.","DOI":"10.3390\/socsci8050141"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Tang, X., and Yang, C.C. (2012). Ranking User Influence in Healthcare Social Media. ACM Trans. Intell. Syst. Technol., 3.","DOI":"10.1145\/2337542.2337558"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.1177\/0002764214527088","article-title":"The Multiple Facets of Influence: Identifying Political Influentials and Opinion Leaders on Twitter","volume":"58","author":"Dubois","year":"2014","journal-title":"Am. Behav. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Benigni, M.C., Joseph, K., and Carley, K.M. (2019). Bot-ivistm: Assessing Information Manipulation in Social Media Using Network Analytics. Emerging Research Challenges and Opportunities in Computational Social Network Analysis and Mining, Springer International Publishing.","DOI":"10.1007\/978-3-319-94105-9_2"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9602","DOI":"10.1038\/srep09602","article-title":"Core-Like Groups Result in Invalidation of Identifying Super-Spreader by K-Shell Decomposition","volume":"5","author":"Liu","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1007\/s13278-018-0515-0","article-title":"Exploring Visual Impairment Awareness Campaigns on Twitter","volume":"8","author":"Gunes","year":"2018","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kwak, H., Lee, C., Park, H., and Moon, S. (2010, January 26\u201330). What is Twitter, a Social Network or a News Media?. Proceedings of the 19th International Conference on World Wide Web, Raleigh North, CA, USA.","DOI":"10.1145\/1772690.1772751"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bibi, F., Khan, H.U., Iqbal, T., Farooq, M., Mehmood, I., and Nam, Y. (2018). Ranking authors in an academic network using social network measures. Appl. Sci., 8.","DOI":"10.3390\/app8101824"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jussila, J., Huhtam\u00e4ki, J., K\u00e4rkk\u00e4inen, H., and Still, K. (2013, January 1\u20134). Information Visualization of Twitter Data for Co-Organizing Conferences. Proceedings of the International Conference on Making Sense of Converging Media, Tampere, Finland.","DOI":"10.1145\/2523429.2523482"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.eswa.2018.05.002","article-title":"User Influence Analysis for Github Developer Social Networks","volume":"108","author":"Hu","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Desai, T., Dhingra, V., Shariff, A., Shariff, A., Lerma, E., Singla, P., Kachare, S., Syed, Z., Minhas, D., and Madanick, R. (2016). Quantifying the Twitter Influence of Third Party Commercial Entities versus Healthcare Providers in Thirteen Medical Conferences from 2011\u20132013. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0162376"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1080\/18756891.2012.696922","article-title":"Analysis of Neighbourhoods in Multi-layered Dynamic Social Networks","volume":"5","author":"Kazienko","year":"2012","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Halu, A., Mondrag\u00f3n, R.J., Panzarasa, P., and Bianconi, G. (2013). Multiplex PageRank. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0078293"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0169-7552(98)00110-X","article-title":"The Anatomy of a Large-Scale Hypertextual Web Search Engine","volume":"30","author":"Brin","year":"1998","journal-title":"Comput. Networks ISDN Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"065306","DOI":"10.1063\/1.4953161","article-title":"Extracting Information from Multiplex Networks","volume":"26","author":"Iacovacci","year":"2016","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/TNSE.2017.2775152","article-title":"Identifying Influential Spreaders in Complex Multilayer Networks: A Centrality Perspective","volume":"6","author":"Basaras","year":"2019","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Khan, H.U., Daud, A., and Malik, T.A. (2015). MIIB: A Metric to Identify Top Influential Bloggers in a Community. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0138359"},{"key":"ref_39","first-page":"100987","article-title":"Measuring Similarity for Clarifying Layer Difference in Multiplex Ad Hoc Duplex Information Networks","volume":"14","author":"Zhang","year":"2020","journal-title":"J. Inf."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1630001","DOI":"10.1142\/S2425038416300019","article-title":"Community detection in social networks","volume":"01","author":"Fani","year":"2017","journal-title":"Encycl. Semant. Comput. Robot. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"P10008","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","article-title":"Fast Unfolding of Communities in Large Networks","volume":"2008","author":"Blondel","year":"2008","journal-title":"J. Stat. Mech. Theory Exp."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wasserman, S., and Faust, K. (1994). Social Network Analysis: Methods and Applications, Cambridge University Press. Structural Analysis in the Social Sciences.","DOI":"10.1017\/CBO9780511815478"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1126\/science.286.5439.509","article-title":"Emergence of Scaling in Random Networks","volume":"286","author":"Albert","year":"1999","journal-title":"Science"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1137\/070710111","article-title":"Power-Law Distributions in Empirical Data","volume":"51","author":"Clauset","year":"2009","journal-title":"SIAM Rev."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.1951.10500769","article-title":"The Kolmogorov-Smirnov Test for Goodness of Fit","volume":"46","author":"Massey","year":"1951","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1038\/scientificamerican0503-60","article-title":"Scale-Free Networks","volume":"288","author":"Bonabeau","year":"2003","journal-title":"Sci. Am."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s11192-019-03112-0","article-title":"Mining Network-Level Properties of Twitter Altmetrics Data","volume":"120","author":"Said","year":"2019","journal-title":"Scientometrics"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2183\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:38:37Z","timestamp":1760161117000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2183"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,20]]},"references-count":47,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21062183"],"URL":"https:\/\/doi.org\/10.3390\/s21062183","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,3,20]]}}}