{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:51:12Z","timestamp":1777704672682,"version":"3.51.4"},"reference-count":36,"publisher":"SAGE Publications","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2023,11,4]]},"abstract":"<jats:p>Fake news production, accessibility, and consumption have all increased with the rise of internet-connected gadgets and social media platforms. A good fake news detection system is essential because the news readers receive can affect their opinions. Several works on fake news detection have been done using machine learning and deep learning approaches. Recently, the deep learning approach has been preferred over machine learning because of its ability to comprehend the intricacies of textual data. The introduction of transformer architecture changed the NLP paradigm and distinguished itself from recurrent models by enabling the processing of sentences as a whole rather than word by word. The attention mechanisms introduced in Transformers allowed them to understand the relationship between far-apart tokens in a sentence. Numerous deep learning works on fake news detection have been published by focusing on different features to determine the authenticity of a news source. We performed an extensive analysis of the comprehensive NELA-GT 2020 dataset, which revealed that the title and content of a news source contain discernible information critical for determining its integrity. To this objective, we introduce \u2018FakeNews Transformer\u2019 \u2014 a specialized Transformer-based architecture that considers the news story\u2019s title and content to assess its veracity. Our proposed work achieved an accuracy of 74.0% on a subset of the NELA-GT 2020 dataset. To our knowledge, FakeNews Transformer is the first published work that considers both title and content for evaluating a news article; thus, we compare the performance of our work against two BERT and two LSTM models working independently on title and content. Our work outperformed the BERT and LSTM models working independently on title by 7.6% and 9.6%, while performing better than the BERT and LSTM models working independently on content by 8.9% and 10.5%, respectively.<\/jats:p>","DOI":"10.3233\/jifs-223980","type":"journal-article","created":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T10:46:21Z","timestamp":1692960381000},"page":"8001-8013","source":"Crossref","is-referenced-by-count":2,"title":["Fake news detection using a deep learning transformer based encoder-decoder architecture"],"prefix":"10.1177","volume":"45","author":[{"given":"M. Badri","family":"Narayanan","sequence":"first","affiliation":[{"name":"Department of Information Technology, Sri Sivasubramaniya Nadar College of Engineering, Kalavakkam, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arun Kumar","family":"Ramesh","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Sri Sivasubramaniya Nadar College of Engineering, Kalavakkam, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"K.S.","family":"Gayathri","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Sri Sivasubramaniya Nadar College of Engineering, Kalavakkam, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Shahina","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Sri Sivasubramaniya Nadar College of Engineering, Kalavakkam, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-223980_ref1","unstructured":"Craig Silverman , Viral fake election news outperformed real news on facebook in final months of the us election, BuzzFeed News 16 (2016)."},{"key":"10.3233\/JIFS-223980_ref2","doi-asserted-by":"crossref","first-page":"1146","DOI":"10.1126\/science.aap9559","article-title":"The spread of true and false news online","volume":"359","author":"Vosoughi","year":"2018","journal-title":"Science"},{"issue":"4","key":"10.3233\/JIFS-223980_ref3","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1007\/s11109-020-09597-3","article-title":"Fake claims of fake news: Political misinformation, warnings, and the tainted truth effect","volume":"43","author":"Freeze","year":"2021","journal-title":"Political Behavior"},{"issue":"2","key":"10.3233\/JIFS-223980_ref4","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1017\/S0033291720001890","article-title":"Coronavirus conspiracy beliefs, mistrust, and compliance with government guidelines in england","volume":"52","author":"Freeman","year":"2022","journal-title":"Psychological Medicine"},{"key":"10.3233\/JIFS-223980_ref5","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1609\/icwsm.v11i1.14976","article-title":"This just Fake newsacks a lot in title, uses simpler, repetitive content in text body, more similar to satire than real news","volume":"11","author":"Horne","year":"2017","journal-title":"Proceedings of the international AAAI conference on web and social media"},{"key":"10.3233\/JIFS-223980_ref6","unstructured":"Vaswani Ashish , Shazeer Noam , Parmar Niki , Uszkoreit Jakob , Jones Llion , Gomez Aidan N. , Kaiser \u0141ukasz and Polosukhin Illia , Attention is all you need, Advances in Neural Information Processing Systems 30 (2017)."},{"key":"10.3233\/JIFS-223980_ref7","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1109\/ICDM.2019.00062","article-title":"Exploiting multi-domain visual information for fake news detection","author":"Qi","year":"2019","journal-title":"2019 IEEE International Conference on Data Mining (ICDM)"},{"key":"10.3233\/JIFS-223980_ref8","first-page":"101","article-title":"Fighting fake news: Image splice detection via learned self-consistency","author":"Huh","year":"2018","journal-title":"Proceedings of the European conference on computer vision (ECCV)"},{"key":"10.3233\/JIFS-223980_ref9","unstructured":"Dong Xishuang , Victor Uboho , Chowdhury Shanta and Qian Lijun , Deep two-path semi-supervised learning for fake news detection, arXiv preprint arXiv:1906.05659, 2019."},{"issue":"8","key":"10.3233\/JIFS-223980_ref10","doi-asserted-by":"crossref","first-page":"11765","DOI":"10.1007\/s11042-020-10183-2","article-title":"Fakebert: Fake news detection in social media with a bertbased deep learning approach","volume":"80","author":"Kaliyar","year":"2021","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/JIFS-223980_ref11","unstructured":"Saini Bhupender kumar , Hare Swathi Chidipothu , Goud Ravineesh , Rameshbhai Mayur , Waghela Lokesh Sharma and Baris Ipek , False article detection with weakly supervised learning."},{"key":"10.3233\/JIFS-223980_ref12","unstructured":"Gruppi Mauricio , Horne Benjamin D. and Adal\u0131 Sibel , Nelagt-2019: A large multi-labelled news dataset for the study of misinformation in news articles, 2020."},{"issue":"1","key":"10.3233\/JIFS-223980_ref13","doi-asserted-by":"crossref","first-page":"102418","DOI":"10.1016\/j.ipm.2020.102418","article-title":"Convolutional neural network with margin loss for fake news detection","volume":"58","author":"Goldani","year":"2021","journal-title":"Information Processing & Management"},{"key":"10.3233\/JIFS-223980_ref14","first-page":"1532","article-title":"Glove: Global vectors for word representation","author":"Pennington","year":"2014","journal-title":"Empirical Methods in Natural Language Processing (EMNLP)"},{"key":"10.3233\/JIFS-223980_ref15","doi-asserted-by":"crossref","unstructured":"Wang William Yang , \u201cliar, liar pants on fire\u201d: A new benchmark dataset for fake news detection, arXiv preprint arXiv:1705.00648, 2017.","DOI":"10.18653\/v1\/P17-2067"},{"issue":"2","key":"10.3233\/JIFS-223980_ref16","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1007\/s00521-021-06230-0","article-title":"Deep learning for fake news detection on twitter regarding the hong kong protests","volume":"34","author":"Zervopoulos","year":"2022","journal-title":"Neural Computing and Applications"},{"key":"10.3233\/JIFS-223980_ref17","unstructured":"Shu Kai , Zheng Guoqing , Li Yichuan , Mukherjee Subhabrata , Awadallah Ahmed Hassan , Ruston Scott and Liu Huan , Leveraging multi-source weak social supervision for early detection of fake news, arXiv preprint arXiv:2004.01732, 2020."},{"key":"10.3233\/JIFS-223980_ref18","unstructured":"Shu Kai , Wang Suhang and Liu Huan , Exploiting trirelationship for fake news detection, arXiv preprint arXiv:1712.07709, 8, 2017."},{"key":"10.3233\/JIFS-223980_ref19","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1145\/3292500.3330935","article-title":"defend: Explainable fake news detection","author":"Shu","year":"2019","journal-title":"Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining"},{"key":"10.3233\/JIFS-223980_ref20","doi-asserted-by":"crossref","unstructured":"Olivieri Alex , Shabani Shaban , Sokhn Maria and Cudre-Mauroux Philippe , Creating task-generic features for fake news detection, In Proceedings of the 52nd Hawaii International Conference on System Sciences, 2019.","DOI":"10.24251\/HICSS.2019.624"},{"key":"10.3233\/JIFS-223980_ref21","unstructured":"Shu Kai , Mahudeswaran Deepak , Wang Suhang , Lee Dongwon and Liu Huan , Fakenewsnet: A data repository with news content, social context and dynamic information for studying fake news on social media, arXiv preprint arXiv:1809.01286, 2018."},{"issue":"1","key":"10.3233\/JIFS-223980_ref22","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1145\/3137597.3137600","article-title":"Fake news detection on social media: A data mining perspective","volume":"19","author":"Shu","year":"2017","journal-title":"ACM SIGKDD Explorations Newsletter"},{"issue":"2","key":"10.3233\/JIFS-223980_ref23","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1145\/3373464.3373473","article-title":"Network-based fake news detection: A pattern-driven approach","volume":"21","author":"Zhou","year":"2019","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"10.3233\/JIFS-223980_ref24","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1145\/3372923.3404783","article-title":"Unsupervised fake news detection: A graphbased approach","author":"Gangireddy","year":"2020","journal-title":"Proceedings of the 31st ACM conference on hypertext and social media"},{"key":"10.3233\/JIFS-223980_ref25","unstructured":"Liao Hao , Liu Qixin , Shu Kai , et al., Incorporating usercomment graph for fake news detection, arXiv e-prints, pages arXiv\u20132011, 2020."},{"key":"10.3233\/JIFS-223980_ref26","first-page":"1","article-title":"Fake news detection on newsoriented heterogeneous information networks through hierarchical graph attention","author":"Ren","year":"2021","journal-title":"2021 International Joint Conference on Neural Networks (IJCNN)"},{"key":"10.3233\/JIFS-223980_ref27","unstructured":"Gruppi Mauricio , Horne Benjamin D. and Adal\u0131 Sibel , Nelagt-2020: A large multi-labelled news dataset for the study of misinformation in news articles, 2021, URL https:\/\/arxiv.org\/abs\/2102.04567"},{"key":"10.3233\/JIFS-223980_ref28","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1609\/icwsm.v13i01.3261","article-title":"Nelagt-2018: A large multi-labelled news dataset for the study of misinformation in news articles","volume":"13","author":"Norregaard","year":"2019","journal-title":"Proceedings of the international AAAI conference on web and social media"},{"key":"10.3233\/JIFS-223980_ref29","unstructured":"Raffel Colin , Shazeer Noam , Roberts Adam , Lee Katherine , Narang Sharan , Matena Michael , Zhou Yanqi , Li Wei and Liu Peter J. , Exploring the limits of transfer learning with a unified text-to-text transformer, arXiv preprint arXiv:1910.10683, 2019."},{"key":"10.3233\/JIFS-223980_ref30","unstructured":"Paszke Adam , Gross Sam , Massa Francisco , Lerer Adam , Bradbury James , Chanan Gregory , Killeen Trevor , Lin Zeming , Gimelshein Natalia , Antiga Luca , et al., Pytorch: An imperative style, high-performance deep learning library, Advances in Neural Information Processing Systems 32 (2019)."},{"key":"10.3233\/JIFS-223980_ref31","unstructured":"Abadi Martin , Agarwal Ashish , Barham Paul , Brevdo Eugene , Chen Zhifeng , Citro Craig , Corrado Greg S. , Davis Andy , Dean Jeffrey , Devin Matthieu , et al., Tensorflow: Large-scale machine learning on heterogeneous distributed systems, arXiv preprint arXiv:1603.04467, 2016."},{"key":"10.3233\/JIFS-223980_ref32","doi-asserted-by":"crossref","unstructured":"Bojanowski Piotr , Grave Edouard , Joulin Armand and Mikolov Tomas , Enriching word vectors with subword information, arXiv preprint arXiv:1607.04606, 2016.","DOI":"10.1162\/tacl_a_00051"},{"key":"10.3233\/JIFS-223980_ref33","unstructured":"Hendrycks Dan and Gimpel Kevin , Gaussian error linear units (gelus), arXiv preprint arXiv:1606.08415, 2016."},{"key":"10.3233\/JIFS-223980_ref34","unstructured":"Kingma Diederik P. and Ba Jimmy , Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980, 2014."},{"key":"10.3233\/JIFS-223980_ref35","unstructured":"Devlin Jacob , Chang Ming-Wei , Lee Kenton and Toutanova Kristina , Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805, 2018."},{"issue":"8","key":"10.3233\/JIFS-223980_ref36","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-223980","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:41:45Z","timestamp":1777455705000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-223980"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,4]]},"references-count":36,"journal-issue":{"issue":"5"},"URL":"https:\/\/doi.org\/10.3233\/jifs-223980","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,4]]}}}