{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T01:48:07Z","timestamp":1783648087614,"version":"3.55.0"},"reference-count":45,"publisher":"National Library of Serbia","issue":"2","license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ComSIS","COMPUT SCI INF SYST","COMPUT SCI INFORM SY","COMPUTER SCI INFORM","COMSIS J"],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:p>The spread of fake news on online media is very dangerous and can lead to casualties, effects on psychology, character assassination, elections for political parties, and state chaos. Fake news that concerning Covid-19 massively spread during the pandemic. Detecting misinformation on the Internet is an essential and challenging task since humans face difficulty detecting fake news. We applied BERT and GPT2 as pre-trained using the BiGRU-Att-CapsuleNet model and BiGRU-CRF features augmentation to solve Fake News detection in Constraint @ AAAI2021 - COVID19 Fake News Detection in English Dataset. This research proved that our hybrid model with augmentation got better accuracy compared to our baseline model. It also showed that BERT gave a better result than GPT2 in all models; the highest accuracy we achieved for BERT is 0.9196, and GPT2 is 0.8986.<\/jats:p>","DOI":"10.2298\/csis210501053k","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T14:51:07Z","timestamp":1635778267000},"page":"639-658","source":"Crossref","is-referenced-by-count":18,"title":["Transfer learning and GRU-CRF augmentation for Covid-19 fake news detection"],"prefix":"10.2298","volume":"19","author":[{"suffix":"Stevens","given":"Andrea","family":"Karnyoto","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengjie","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingquan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1078","reference":[{"key":"ref1","doi-asserted-by":"crossref","unstructured":"Shu, K., Mahudeswaran, D., Wang, S., Lee, D., & Liu, H. (2020). Fakenewsnet: A data repository with news content, social context, and spatiotemporal information for studying fake news on social media. Big Data, 8(3), 171-188.","DOI":"10.1089\/big.2020.0062"},{"key":"ref2","unstructured":"Riedel, B., Augenstein, I., Spithourakis, G. P., & Riedel, S. (2017). A simple but tough-to-beat baseline for the Fake News Challenge stance detection task. arXiv preprint arXiv:1707.03264."},{"key":"ref3","doi-asserted-by":"crossref","unstructured":"Apuke, O. D., & Omar, B. (2020). Fake news proliferation in Nigeria: Consequences, motivations, and prevention through awareness strategies. Humanities and Social Sciences Reviews, 8(2), 318-327.","DOI":"10.18510\/hssr.2020.8236"},{"key":"ref4","doi-asserted-by":"crossref","unstructured":"Ozbay, F. A., & Alatas, B. (2020). Fake news detection within online social media using supervised artificial intelligence algorithms. Physica A: Statistical Mechanics and its Applications, 540, 123174.","DOI":"10.1016\/j.physa.2019.123174"},{"key":"ref5","doi-asserted-by":"crossref","unstructured":"Pulido, C. M., Ruiz-Eugenio, L., Redondo-Sama, G., & Villarejo-Carballido, B. (2020). A new application of social impact in social media for overcoming fake news in health. International journal of environmental research and public health, 17(7), 2430.","DOI":"10.3390\/ijerph17072430"},{"key":"ref6","doi-asserted-by":"crossref","unstructured":"Maldonado, M. A. (2019). Understanding fake news: Technology, affects, and the politics of the untruth. Historia y Comunicaci\u00f3n Social, 24(2), 533.","DOI":"10.5209\/hics.66298"},{"key":"ref7","doi-asserted-by":"crossref","unstructured":"Waisbord, S. (2018). Truth is what happens to news: On journalism, fake news, and post-truth. Journalism studies, 19(13), 1866-1878.","DOI":"10.1080\/1461670X.2018.1492881"},{"key":"ref8","unstructured":"Constraint-shared-task-2021, Available: https:\/\/constraint-shared-task-2021.github.io\/ (current April 2021)"},{"key":"ref9","doi-asserted-by":"crossref","unstructured":"Akhtar, M. S., & Chakraborty, T. (2021). Overview of constraint 2021 shared tasks: Detecting english covid-19 fake news and hindi hostile posts. In Combating Online Hostile Posts in Regional Languages during Emergency Situation: First International Workshop, CONSTRAINT 2021, Collocated with AAAI 2021, Virtual Event, February 8, 2021, Revised Selected Papers (p. 42). Springer Nature.","DOI":"10.1007\/978-3-030-73696-5_5"},{"key":"ref10","doi-asserted-by":"crossref","unstructured":"Azhan, M., & Ahmad, M. (2021). LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT. arXiv preprint arXiv:2101.04965.","DOI":"10.1007\/978-3-030-73696-5_6"},{"key":"ref11","doi-asserted-by":"crossref","unstructured":"Kakwani, D., Kunchukuttan, A., Golla, S., Gokul, N. C., Bhattacharyya, A., Khapra, M. M., & Kumar, P. (2020, November). iNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings (pp. 4948-4961).","DOI":"10.18653\/v1\/2020.findings-emnlp.445"},{"key":"ref12","doi-asserted-by":"crossref","unstructured":"Baris, I., & Boukhers, Z. (2021). ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information. arXiv preprint arXiv:2101.05499.","DOI":"10.1007\/978-3-030-73696-5_14"},{"key":"ref13","doi-asserted-by":"crossref","unstructured":"Ovchinnikova, E. (2012). Integration of world knowledge for natural language understanding (Vol. 3). Springer Science & Business Media.","DOI":"10.2991\/978-94-91216-53-4"},{"key":"ref14","unstructured":"Van Harmelen, F., Lifschitz, V., & Porter, B. (Eds.). (2008). Handbook of knowledge representation. Elsevier."},{"key":"ref15","doi-asserted-by":"crossref","unstructured":"Petrovi\u0107, \u0110., & Stankovi\u0107, M. (2018). Use of linguistic forms mining in the link analysis of legal documents. Computer Science and Information Systems, 15(2), 369-392.","DOI":"10.2298\/CSIS170701005P"},{"key":"ref16","doi-asserted-by":"crossref","unstructured":"Zhao, H., Cao, J., Xu, M., & Lu, J. (2020). Variational neural decoder for abstractive text summarization. Computer Science and Information Systems, 17(2), 537-552.","DOI":"10.2298\/CSIS200131012Z"},{"key":"ref17","doi-asserted-by":"crossref","unstructured":"Ni, P., Li, Y., Li, G., & Chang, V. (2020). Natural language understanding approaches based on joint task of intent detection and slot filling for IoT voice interaction. Neural Computing and Applications, 1-18.","DOI":"10.1007\/s00521-020-04805-x"},{"key":"ref18","doi-asserted-by":"crossref","unstructured":"Ahmad, I., Yousaf, M., Yousaf, S., & Ahmad, M. O. (2020). Fake News Detection Using Machine Learning Ensemble Methods. Complexity, 2020.","DOI":"10.1155\/2020\/8885861"},{"key":"ref19","doi-asserted-by":"crossref","unstructured":"Gilda, S. (2017, December). Notice of Violation of IEEE Publication Principles: Evaluating machine learning algorithms for fake news detection. In 2017 IEEE 15th student conference on research and development (SCOReD) (pp. 110-115). IEEE.","DOI":"10.1109\/SCORED.2017.8305411"},{"key":"ref20","doi-asserted-by":"crossref","unstructured":"Aphiwongsophon, S., & Chongstitvatana, P. (2018, July). Detecting fake news with machine learning method. In 2018 15th International Conference on Electrical Engineering\/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (pp. 528-531). IEEE.","DOI":"10.1109\/ECTICon.2018.8620051"},{"key":"ref21","unstructured":"Monti, F., Frasca, F., Eynard, D., Mannion, D., & Bronstein, M. M. (2019). Fake news detection on social media using geometric deep learning. arXiv preprint arXiv:1902.06673."},{"key":"ref22","doi-asserted-by":"crossref","unstructured":"Sahoo, S. R., & Gupta, B. B. (2021). Multiple features based approach for automatic fake news detection on social networks using deep learning. Applied Soft Computing, 100, 106983.","DOI":"10.1016\/j.asoc.2020.106983"},{"key":"ref23","doi-asserted-by":"crossref","unstructured":"Kaliyar, R. K., Goswami, A., & Narang, P. (2021). FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia Tools and Applications, 1-24.","DOI":"10.1007\/s11042-020-10183-2"},{"key":"ref24","doi-asserted-by":"crossref","unstructured":"Konkobo, P. M., Zhang, R., Huang, S., Minoungou, T. T., Ouedraogo, J. A., & Li, L. (2020, November). A Deep Learning Model for Early Detection of Fake News on Social Media. In 2020 7th International Conference on Behavioural and Social Computing (BESC) (pp. 1-6). IEEE.","DOI":"10.1109\/BESC51023.2020.9348311"},{"key":"ref25","unstructured":"Oriola, O. Exploring N-gram, Word Embedding and Topic Models for Content-based Fake News Detection in FakeNewsNet Evaluation. International Journal of Computer Applications, 975, 8887."},{"key":"ref26","unstructured":"Shakeel, D., & Jain, N. Fake news detection and fact verification using knowledge graphs and machine learning."},{"key":"ref27","unstructured":"Xu, J., Zadorozhny, V., Zhang, D., & Grant, J. (2020). FaNDS: Fake News Detection System Using Energy Flow. arXiv preprint arXiv:2010.02097."},{"key":"ref28","doi-asserted-by":"crossref","unstructured":"Hassan, F. M., & Lee, M. (2020, September). Multi-stage News-Stance Classification Based on Lexical and Neural Features. In Conference on Complex, Intelligent, and Software Intensive Systems (pp. 218-228). Springer, Cham.","DOI":"10.1007\/978-3-030-57805-3_21"},{"key":"ref29","unstructured":"Virtanen, A., Kanerva, J., Ilo, R., Luoma, J., Luotolahti, J., Salakoski, T., ... & Pyysalo, S. (2019). Multilingual is not enough: BERT for Finnish. arXiv preprint arXiv:1912.07076."},{"key":"ref30","unstructured":"Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805."},{"key":"ref31","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. arXiv preprint arXiv:1706.03762."},{"key":"ref32","unstructured":"Gundapu, S., & Mamid, R. (2021). Transformer based Automatic COVID-19 Fake News Detection System. arXiv preprint arXiv:2101.00180."},{"key":"ref33","unstructured":"Gupta, A., Sukumaran, R., John, K., & Teki, S. (2021). Hostility Detection and Covid-19 Fake News Detection in Social Media. arXiv preprint arXiv:2101.05953."},{"key":"ref34","unstructured":"Wang, A., & Cho, K. (2019). Bert has a mouth, and it must speak: Bert as a markov random field language model. arXiv preprint arXiv:1902.04094."},{"key":"ref35","unstructured":"Harrag, F., Debbah, M., Darwish, K., & Abdelali, A. (2021). Bert transformer model for detecting Arabic GPT2 auto-generated tweets. arXiv preprint arXiv:2101.09345."},{"key":"ref36","unstructured":"Singh, D., Shams, S., Kim, J., Park, S. J., & Yang, S. Fighting for Information Credibility: An End-to-End Framework to Identify Fake News during Natural Disasters."},{"key":"ref37","doi-asserted-by":"crossref","unstructured":"Ishiwatari, T., Yasuda, Y., Miyazaki, T., & Goto, J. (2020, November). Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 7360-7370).","DOI":"10.18653\/v1\/2020.emnlp-main.597"},{"key":"ref38","doi-asserted-by":"crossref","unstructured":"Lu, Y. J., & Li, C. T. (2020). GCAN: Graph-aware co-attention networks for explainable fake news detection on social media. arXiv preprint arXiv:2004.11648.","DOI":"10.18653\/v1\/2020.acl-main.48"},{"key":"ref39","doi-asserted-by":"crossref","unstructured":"Mandelli, S., Cozzolino, D., Bestagini, P., Verdoliva, L., & Tubaro, S. (2020). CNN-based fast source device identification. IEEE Signal Processing Letters, 27, 1285-1289.","DOI":"10.1109\/LSP.2020.3008855"},{"key":"ref40","unstructured":"Chen, Y., Kak, S., & Wang, L. (2008). Hybrid neural network architecture for on-line learning. arXiv preprint arXiv:0809.5087."},{"key":"ref41","doi-asserted-by":"crossref","unstructured":"Rojek, I. (2010, June). Hybrid neural networks as prediction models. In International Conference on Artificial Intelligence and Soft Computing (pp. 88-95). Springer, Berlin, Heidelberg.","DOI":"10.1007\/978-3-642-13232-2_12"},{"key":"ref42","doi-asserted-by":"crossref","unstructured":"Nasir, J. A., Khan, O. S., & Varlamis, I. (2021). Fake news detection: A hybrid CNN-RNN based deep learning approach. International Journal of Information Management Data Insights, 1(1), 100007.","DOI":"10.1016\/j.jjimei.2020.100007"},{"key":"ref43","doi-asserted-by":"crossref","unstructured":"Song, C., Ning, N., Zhang, Y., & Wu, B. (2021). A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks. Information Processing & Management, 58(1), 102437.","DOI":"10.1016\/j.ipm.2020.102437"},{"key":"ref44","doi-asserted-by":"crossref","unstructured":"Ranade, P., Piplai, A., Mittal, S., Joshi, A., & Finin, T. (2021). Generating Fake Cyber Threat Intelligence Using Transformer-Based Models. arXiv preprint arXiv:2102.04351.","DOI":"10.1109\/IJCNN52387.2021.9534192"},{"key":"ref45","doi-asserted-by":"crossref","unstructured":"Goldani, M. H., Safabakhsh, R., & Momtazi, S. (2021). Convolutional neural network with margin loss for fake news detection. Information Processing & Management, 58(1), 102418.","DOI":"10.1016\/j.ipm.2020.102418"}],"container-title":["Computer Science and Information Systems"],"original-title":[],"language":"en","deposited":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T08:05:50Z","timestamp":1685347550000},"score":1,"resource":{"primary":{"URL":"https:\/\/doiserbia.nb.rs\/Article.aspx?ID=1820-02142100053K"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.2298\/csis210501053k","relation":{},"ISSN":["1820-0214","2406-1018"],"issn-type":[{"value":"1820-0214","type":"print"},{"value":"2406-1018","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022]]}}}