{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T15:04:51Z","timestamp":1779375891498,"version":"3.53.1"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The online social media ecosystem is becoming more and more confused because of more and more fake information and the social media of malicious users\u2019 fake content; at the same time, unspeakable pain has been brought to mankind. Social robot detection uses supervised classification based on artificial feature extraction. However, user privacy is also involved in using these methods, and the hidden feature information is also ignored, such as semi-supervised algorithms with low utilization rates and graph features. In this work, we symmetrically combine BERT and GCN (Graph Convolutional Network, GCN) and propose a novel model that combines large scale pretraining and transductive learning for social robot detection, BGSRD. BGSRD constructs a heterogeneous graph over the dataset and represents Twitter as nodes using BERT representations. Corpus learning via text graph convolution network is a single text graph, which is mainly built for corpus-based on word co-occurrence and document word relationship. BERT and GCN modules can be jointly trained in BGSRD to achieve the best of merit, training data and unlabeled test data can spread label influence through graph convolution and can be carried out in the large-scale pre-training of massive raw data and the transduction learning of joint learning representation. The experiment shows that a better performance can also be achieved by BGSRD on a wide range of social robot detection datasets.<\/jats:p>","DOI":"10.3390\/sym14010030","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T01:20:43Z","timestamp":1640654443000},"page":"30","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Social Bots Detection via Fusing BERT and Graph Convolutional Networks"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1552-9033","authenticated-orcid":false,"given":"Qinglang","family":"Guo","sequence":"first","affiliation":[{"name":"School of Cyber Science and Technology, University of Science and Technology of China, Hefei 230027, China"},{"name":"National Engineering Research Center for Public Safety Risk Perception and Control by Big Data (RPP), China Academic of Electronics and Information Technology, Beijing 100041, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2084-2697","authenticated-orcid":false,"given":"Haiyong","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Technology, University of Science and Technology of China, Hefei 230027, China"},{"name":"Key Laboratory of Cyberculture Content Cognition and Detection, Ministry of Culture and Tourism, University of Science and Technology of China, 96 Jinzhai Road, Hefei 237009, China"},{"name":"Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing 100160, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yangyang","family":"Li","sequence":"additional","affiliation":[{"name":"National Engineering Research Center for Public Safety Risk Perception and Control by Big Data (RPP), China Academic of Electronics and Information Technology, Beijing 100041, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9584-4887","authenticated-orcid":false,"given":"Wen","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Software, Xinjiang University, Urumqi 830049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Zhang","sequence":"additional","affiliation":[{"name":"National Engineering Research Center for Public Safety Risk Perception and Control by Big Data (RPP), China Academic of Electronics and Information Technology, Beijing 100041, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Granik, M., and Mesyura, V. (June, January 29). Fake news detection using naive Bayes classifier. Proceedings of the 2017 IEEE first Ukraine Conference on Electrical and Computer Engineering (UKRCON), Kyiv, Ukraine.","DOI":"10.1109\/UKRCON.2017.8100379"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cassa, C.A., Chunara, R., Mandl, K., and Brownstein, J.S. (2013). Twitter as a sentinel in emergency situations: Lessons from the Boston marathon explosions. PLoS Curr., 5.","DOI":"10.1371\/currents.dis.ad70cd1c8bc585e9470046cde334ee4b"},{"key":"ref_3","unstructured":"Conover, M.D., Ratkiewicz, J., Francisco, M., Gon\u00e7alves, B., Menczer, F., and Flammini, A. (2011, January 17\u201321). Political polarization on twitter. Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, Barcelona, Spain."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.cose.2017.08.014","article-title":"Combating the evolving spammers in online social networks","volume":"72","author":"Fu","year":"2018","journal-title":"Comput. Secur."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.physa.2015.12.148","article-title":"Discriminating bot accounts based solely on temporal features of microblog behavior","volume":"450","author":"Pan","year":"2016","journal-title":"Phys. A Stat. Mech. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.inffus.2017.11.002","article-title":"Semi-supervised clue fusion for spammer detection in Sina Weibo","volume":"44","author":"Chen","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.neucom.2016.03.036","article-title":"Co-detecting social spammers and spam messages in microblogging via exploiting social contexts","volume":"201","author":"Wu","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2991","DOI":"10.1007\/s11227-015-1437-5","article-title":"ELM-based spammer detection in social networks","volume":"72","author":"Zheng","year":"2016","journal-title":"J. Supercomput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Fu, H., Xie, X., and Rui, Y. (2015, January 18\u201322). Leveraging careful microblog users for spammer detection. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.","DOI":"10.1145\/2740908.2745400"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1145\/2818717","article-title":"The rise of social bots","volume":"59","author":"Ferrara","year":"2016","journal-title":"Commun. ACM"},{"key":"ref_11","unstructured":"Wang, G.A., Mohanlal, M., Wilson, C., Wang, X., Metzger, M., Zheng, H., and Zhao, B.Y. (2013, January 24\u201327). Social Turing Tests: Crowdsourcing Sybil Detection. Proceedings of the NDSS Symposium 2013, San Diego, CA, USA."},{"key":"ref_12","unstructured":"Twitter Inc. (2019). Q1 2019 Letter to Shareholders, Twitter Inc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ahmad, J., Farman, H., and Jan, Z. (2019). Deep learning methods and applications. Deep Learning: Convergence to Big Data Analytics, Springer.","DOI":"10.1007\/978-981-13-3459-7_3"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Song, H.A., and Lee, S.Y. (2013). Hierarchical representation using NMF. International Conference on Neural Information Processing, Springer.","DOI":"10.1007\/978-3-642-42054-2_58"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ping, H., and Qin, S. (2018, January 8\u201311). A social bots detection model based on deep learning algorithm. Proceedings of the 2018 IEEE 18th International Conference on Communication Technology (ICCT), Chongqing, China.","DOI":"10.1109\/ICCT.2018.8600029"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.ins.2018.08.019","article-title":"Deep neural networks for bot detection","volume":"467","author":"Kudugunta","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wei, F., and Nguyen, U.T. (2019, January 12\u201314). Twitter bot detection using bidirectional long short-term memory neural networks and word embeddings. Proceedings of the 2019 First IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA), Los Angeles, CA, USA.","DOI":"10.1109\/TPS-ISA48467.2019.00021"},{"key":"ref_19","unstructured":"Abou Daya, A., Salahuddin, M.A., Limam, N., and Boutaba, R. (2019, January 8\u201312). A graph-based machine learning approach for bot detection. Proceedings of the 2019 IFIP\/IEEE Symposium on Integrated Network and Service Management (IM), Arlington, VA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TNSM.2020.2972405","article-title":"Botchase: Graph-based bot detection using machine learning","volume":"17","author":"Salahuddin","year":"2020","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_21","unstructured":"Cao, Q., Sirivianos, M., Yang, X., and Pregueiro, T. (2012, January 25\u201327). Aiding the detection of fake accounts in large scale social online services. Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12), San Jose, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jia, J., Wang, B., and Gong, N.Z. (2017, January 26\u201329). Random walk based fake account detection in online social networks. Proceedings of the 2017 47th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN), Denver, CO, USA.","DOI":"10.1109\/DSN.2017.55"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, B., Gong, N.Z., and Fu, H. (2017, January 18\u201321). GANG: Detecting fraudulent users in online social networks via guilt-by-association on directed graphs. Proceedings of the 2017 IEEE International Conference on Data Mining (ICDM), New Orleans, LA, USA.","DOI":"10.1109\/ICDM.2017.56"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/TNSE.2018.2813672","article-title":"Structure-based sybil detection in social networks via local rule-based propagation","volume":"6","author":"Wang","year":"2018","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gao, P., Wang, B., Gong, N.Z., Kulkarni, S.R., Thomas, K., and Mittal, P. (June, January 30). Sybilfuse: Combining local attributes with global structure to perform robust sybil detection. Proceedings of the 2018 IEEE Conference on Communications and Network Security (CNS), Beijing, China.","DOI":"10.1109\/CNS.2018.8433147"},{"key":"ref_26","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_27","unstructured":"Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv."},{"key":"ref_28","unstructured":"Yao, L., Mao, C., and Luo, Y. (February, January 27). Graph convolutional networks for text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Hilton Hawalian Village, Honolulu, HI, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, Q., Han, Z., and Wu, X.M. (2018, January 2\u20137). Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning. Proceedings of the AAAI, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11604"},{"key":"ref_30","unstructured":"Mazza, M., Cresci, S., Avvenuti, M., Quattrociocchi, W., and Tesconi, M. (July, January 30). Rtbust: Exploiting temporal patterns for botnet detection on twitter. Proceedings of the 10th ACM Conference on Web Science, Boston, MA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1002\/hbe2.115","article-title":"Arming the public with artificial intelligence to counter social bots","volume":"1","author":"Yang","year":"2019","journal-title":"Hum. Behav. Emerg. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gilani, Z., Farahbakhsh, R., Tyson, G., Wang, L., and Crowcroft, J. (August, January 31). Of bots and humans (on twitter). Proceedings of the 2017 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining 2017, Sydney, Australia.","DOI":"10.1145\/3110025.3110090"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cresci, S., Lillo, F., Regoli, D., Tardelli, S., and Tesconi, M. (2018, January 25\u201328). $FAKE: Evidence of spam and bot activity in stock microblogs on Twitter. Proceedings of the Twelfth International AAAI Conference on Web and Social Media, New Orleans, LA, USA.","DOI":"10.1609\/icwsm.v12i1.15073"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3313184","article-title":"Cashtag piggybacking: Uncovering spam and bot activity in stock microblogs on Twitter","volume":"13","author":"Cresci","year":"2019","journal-title":"ACM Trans. Web (TWEB)"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yang, K.C., Varol, O., Hui, P.M., and Menczer, F. (2020, January 7\u201312). Scalable and generalizable social bot detection through data selection. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i01.5460"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gilani, Z., Wang, L., Crowcroft, J., Almeida, M., and Farahbakhsh, R. (2016, January 11\u201315). Stweeler: A framework for twitter bot analysis. Proceedings of the 25th International Conference Companion on World Wide Web, Montreal, QC, Canada.","DOI":"10.1145\/2872518.2889360"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Antenore, M., Camacho-Rodriguez, J.M., and Panizzi, E. (2021). A comparative study of Bot Detection techniques methods with an application related to COVID-19 discourse on Twitter. arXiv.","DOI":"10.1177\/08944393211073733"},{"key":"ref_38","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., and Bengio, Y. (2017). Graph attention networks. arXiv."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/30\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:54:07Z","timestamp":1760169247000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/30"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["sym14010030"],"URL":"https:\/\/doi.org\/10.3390\/sym14010030","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]}}}