{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T06:03:39Z","timestamp":1792821819319,"version":"4.5.0"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,4]],"date-time":"2022-01-04T00:00:00Z","timestamp":1641254400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Social media platforms are part of everyday life, allowing the interconnection of people around the world in large discussion groups relating to every topic, including important social or political issues. Therefore, social media have become a valuable source of information-rich data, commonly referred to as Social Big Data, effectively exploitable to study the behavior of people, their opinions, moods, interests and activities. However, these powerful communication platforms can be also used to manipulate conversation, polluting online content and altering the popularity of users, through spamming activities and misinformation spreading. Recent studies have shown the use on social media of automatic entities, defined as social bots, that appear as legitimate users by imitating human behavior aimed at influencing discussions of any kind, including political issues. In this paper we present a new methodology, namely TIMBRE (Time-aware opInion Mining via Bot REmoval), aimed at discovering the polarity of social media users during election campaigns characterized by the rivalry of political factions. This methodology is temporally aware and relies on a keyword-based classification of posts and users. Moreover, it recognizes and filters out data produced by social media bots, which aim to alter public opinion about political candidates, thus avoiding heavily biased information. The proposed methodology has been applied to a case study that analyzes the polarization of a large number of Twitter users during the 2016 US presidential election. The achieved results show the benefits brought by both removing bots and taking into account temporal aspects in the forecasting process, revealing the high accuracy and effectiveness of the proposed approach. Finally, we investigated how the presence of social bots may affect political discussion by studying the 2016 US presidential election. Specifically, we analyzed the main differences between human and artificial political support, estimating also the influence of social bots on legitimate users.<\/jats:p>","DOI":"10.3390\/bdcc6010003","type":"journal-article","created":{"date-parts":[[2022,1,5]],"date-time":"2022-01-05T20:42:16Z","timestamp":1641415336000},"page":"3","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Analyzing Political Polarization on Social Media by Deleting Bot Spamming"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3053-6132","authenticated-orcid":false,"given":"Riccardo","family":"Cantini","sequence":"first","affiliation":[{"name":"Department of Informatics, Modeling, Electronics and Systems Engineering, University of Calabria, 87036 Rende, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7887-1314","authenticated-orcid":false,"given":"Fabrizio","family":"Marozzo","sequence":"additional","affiliation":[{"name":"Department of Informatics, Modeling, Electronics and Systems Engineering, University of Calabria, 87036 Rende, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1910-9236","authenticated-orcid":false,"given":"Domenico","family":"Talia","sequence":"additional","affiliation":[{"name":"Department of Informatics, Modeling, Electronics and Systems Engineering, University of Calabria, 87036 Rende, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5076-6544","authenticated-orcid":false,"given":"Paolo","family":"Trunfio","sequence":"additional","affiliation":[{"name":"Department of Informatics, Modeling, Electronics and Systems Engineering, University of Calabria, 87036 Rende, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1080\/17445760.2017.1422501","article-title":"Programming Models and Systems for Big Data Analysis","volume":"34","author":"Belcastro","year":"2019","journal-title":"Int. J. Parallel Emergent Distrib. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"115733","DOI":"10.1016\/j.eswa.2021.115733","article-title":"Automatic Detection of User Trajectories from Social Media Posts","volume":"186","author":"Belcastro","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100167","DOI":"10.1016\/j.osnem.2021.100167","article-title":"A Weighted Artificial Bee Colony Algorithm for Influence Maximization","volume":"26","author":"Cantini","year":"2021","journal-title":"Online Soc. Netw. Media"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"14","DOI":"10.3390\/bdcc4020014","article-title":"#Lockdown: Network-enhanced Emotional Profiling in the Time of Covid-19","volume":"4","author":"Stella","year":"2020","journal-title":"Big Data Cogn. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Spettel, S., and Vagianos, D. (2019). Twitter Analyzer\u2014How to Use Semantic Analysis to Retrieve an Atmospheric Image around Political Topics in Twitter. Big Data Cogn. Comput., 3.","DOI":"10.3390\/bdcc3030038"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3466876","article-title":"Learning Sentence-to-Hashtags Semantic Mapping for Hashtag Recommendation on Microblogs","volume":"16","author":"Cantini","year":"2022","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"47177","DOI":"10.1109\/ACCESS.2020.2978950","article-title":"Learning Political Polarization on Social Media Using Neural Networks","volume":"8","author":"Belcastro","year":"2020","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1257\/jep.31.2.211","article-title":"Social Media and Fake News in the 2016 Election","volume":"31","author":"Allcott","year":"2017","journal-title":"J. Econ. Perspect."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bessi, A., and Ferrara, E. (2021, December 24). Social Bots Distort the 2016 US Presidential Election Online Discussion. First Monday, 7 November 2016. Available online: https:\/\/ssrn.com\/abstract=2982233.","DOI":"10.5210\/fm.v21i11.7090"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jin, Z., Cao, J., Guo, H., Zhang, Y., Wang, Y., and Luo, J. (2017, January 5\u20138). Detection and Analysis of 2016 US Presidential Election Related Rumors on Twitter. Proceedings of the International Conference on Social Computing, Behavioral-cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation, Washington, DC, USA.","DOI":"10.1007\/978-3-319-60240-0_2"},{"key":"ref_11","unstructured":"Shao, C., Ciampaglia, G.L., Varol, O., Flammini, A., and Menczer, F. (2017). The Spread of Fake News by Social Bots. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alothali, E., Zaki, N., Mohamed, E.A., and Alashwal, H. (2018, January 18\u201319). Detecting Social Bots on Twitter: A Literature Review. Proceedings of the 2018 International Conference on Innovations in Information Technology (IIT), Al Ain, United Arab Emirates.","DOI":"10.1109\/INNOVATIONS.2018.8605995"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.jnca.2016.11.030","article-title":"Malicious Accounts: Dark of the Social Networks","volume":"79","author":"Adewole","year":"2017","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jia, J., Wang, B., and Gong, N.Z. (2017, January 26\u201329). Random Walk Based Fake Account Detection in Online Social Networks. Proceedings of the 2017 47th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN), Denver, CO, USA.","DOI":"10.1109\/DSN.2017.55"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mehrotra, A., Sarreddy, M., and Singh, S. (2016, January 14\u201317). Detection of Fake Twitter Followers Using Graph Centrality Measures. Proceedings of the 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I), Greater Noida, India.","DOI":"10.1109\/IC3I.2016.7918016"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MC.2016.183","article-title":"The DARPA Twitter Bot Challenge","volume":"49","author":"Subrahmanian","year":"2016","journal-title":"Computer"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gilani, Z., Kochmar, E., and Crowcroft, J. (August, January 31). Classification of Twitter Accounts into Automated Agents and Human Users. Proceedings of the 2017 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining, Sydney, Australia.","DOI":"10.1145\/3110025.3110091"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.ins.2016.08.036","article-title":"Twitter Turing Test: Identifying Social Machines","volume":"372","author":"Alarifi","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kantepe, M., and Ganiz, M.C. (2017, January 5\u20138). Preprocessing Framework for Twitter Bot Detection. Proceedings of the 2017 International Conference on Computer Science and Engineering, Antalya, Turkey.","DOI":"10.1109\/UBMK.2017.8093483"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Davis, C.A., Varol, O., Ferrara, E., Flammini, A., and Menczer, F. (2016, January 11\u201315). Botornot: A system to Evaluate Social Bots. Proceedings of the 25th International Conference Companion on World Wide Web, Montr\u00e9al, QC, Canada.","DOI":"10.1145\/2872518.2889302"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Er\u015fahin, B., Akta\u015f, \u00d6., K\u0131l\u0131n\u00e7, D., and Akyol, C. (2017, January 5\u20138). Twitter Fake Account Detection. Proceedings of the 2017 International Conference on Computer Science and Engineering (UBMK), Antalya, Turkey.","DOI":"10.1109\/UBMK.2017.8093420"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cai, C., Li, L., and Zengi, D. (2017, January 22\u201324). Behavior Enhanced Deep Bot Detection in Social Media. Proceedings of the 2017 IEEE International Conference on Intelligence and Security Informatics (ISI), Beijing, China.","DOI":"10.1109\/ISI.2017.8004887"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13278-017-0479-5","article-title":"Analyzing Polarization of Social Media Users and News Sites during Political Campaigns","volume":"8","author":"Marozzo","year":"2018","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1016\/j.future.2018.01.051","article-title":"Social Information Discovery Enhanced by Sentiment Analysis Techniques","volume":"95","author":"Diamantini","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.electstud.2015.11.017","article-title":"140 Characters to Victory? Using Twitter to Predict the UK 2015 General Election","volume":"41","author":"Burnap","year":"2016","journal-title":"Elect. Stud."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Oikonomou, L., and Tjortjis, C. (2018, January 22\u201324). A Method for Predicting the Winner of the USA Presidential Elections using Data extracted from Twitter. Proceedings of the 2018 South-Eastern European Design Automation, Computer Engineering, Computer Networks and Society Media Conference (SEEDA_CECNSM), Kastoria, Greece.","DOI":"10.23919\/SEEDA-CECNSM.2018.8544919"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1080\/01292986.2018.1453849","article-title":"Predicting Elections from Social Media: A Three-country, Three-method Comparative Study","volume":"29","author":"Jaidka","year":"2018","journal-title":"Asian J. Commun."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Olorunnimbe, M.K., and Viktor, H.L. (2015, January 21\u201323). Tweets as a Vote: Exploring Political Sentiments on Twitter for Opinion Mining. Proceedings of the International Symposium on Methodologies for Intelligent Systems, Lyon, France.","DOI":"10.1007\/978-3-319-25252-0_19"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2158","DOI":"10.1109\/TKDE.2016.2553667","article-title":"Quantifying Political Leaning from Tweets, Retweets, and Retweeters","volume":"28","author":"Wong","year":"2016","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Alashri, S., Kandala, S.S., Bajaj, V., Ravi, R., Smith, K.L., and Desouza, K.C. (2016, January 18\u201321). An Analysis of Sentiments on Facebook during the 2016 US Presidential Election. Proceedings of the 2016 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), San Francisco, CA, USA.","DOI":"10.1109\/ASONAM.2016.7752329"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Singh, A., Kumar, A., Dua, N., Mishra, V.K., Singh, D., and Agrawal, A. (2021, January 19\u201320). Predicting Elections Results using Social Media Activity A Case Study: USA Presidential Election 2020. Proceedings of the 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS51430.2021.9441835"},{"key":"ref_32","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Borodin, A., Filmus, Y., and Oren, J. (2010, January 13\u201317). Threshold Models for Competitive Influence in Social Networks. Proceedings of the International Workshop on Internet and Network Economics, Stanford, CA, USA.","DOI":"10.1007\/978-3-642-17572-5_48"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/6\/1\/3\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:36:04Z","timestamp":1760362564000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/6\/1\/3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,4]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["bdcc6010003"],"URL":"https:\/\/doi.org\/10.3390\/bdcc6010003","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,4]]}}}