{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T02:14:35Z","timestamp":1758593675800,"version":"3.44.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"9","license":[{"start":{"date-parts":[[2025,3,30]],"date-time":"2025-03-30T00:00:00Z","timestamp":1743292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62162057"],"award-info":[{"award-number":["62162057"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Natural Science Foundation of Sichuan","award":["2025ZNSFSC0509"],"award-info":[{"award-number":["2025ZNSFSC0509"]}]},{"name":"Sichuan Science and Technology Program","award":["2023YFG0294"],"award-info":[{"award-number":["2023YFG0294"]}]},{"DOI":"10.13039\/100009122","name":"Ministry of Education","doi-asserted-by":"publisher","award":["2023CDLZ-2"],"award-info":[{"award-number":["2023CDLZ-2"]}],"id":[{"id":"10.13039\/100009122","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,9,21]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The spread of disinformation on online social media has caused massive concern. Existing disinformation detection methods neglect the diverse compositional forms of tweets in real-life scenarios, making them less applicable and effective in social media settings. Meanwhile, these methods use pattern cues but overlook important aspects such as syntax, lexicon, and shallow visual semantics, and lack attention to factual content such as time, place, and person relay in both text and images, thus failing to fully explore features of disinformation and limiting detection accuracy. Furthermore, with the popularity of large language models (LLMs), the tweets generated by these models make the style of disinformation more subtle. Since existing datasets are mostly human-generated and lack style diversity, it results in weak detection capabilities of methods trained on these datasets. To address these challenges, a dual-feature adaptive framework for multimodal disinformation detection is proposed. The framework first using a similarity-based algorithm adaptively handles different tweet forms. It then enhances pattern features by bridging multimodal output from single-modal pretrained modal, and factual features are subsequently extracted using a zero-shot method based on a large vision language model. Finally, an expert network aggregates and reweights the dual-feature representation for tweets using an LLM-text detector in gating strategy. This paper also presents two multimodal disinformation datasets that include both LLM-generated and human-generated tweets reflecting real-world scenarios. The true tweets in datasets are diverse in style, while the fake tweets are more misleading. Experimentally verified, the proposed method outperforms baseline methods by an accuracy of 1.04% and 0.72% on typical datasets while also achieving a minimum accuracy drop of 0.65% and 0.87% on the proposed dataset.<\/jats:p>","DOI":"10.1093\/comjnl\/bxaf024","type":"journal-article","created":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T16:32:21Z","timestamp":1743438741000},"page":"1105-1117","source":"Crossref","is-referenced-by-count":0,"title":["Dual-feature adaptive framework for multimodal disinformation detection"],"prefix":"10.1093","volume":"68","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3874-0598","authenticated-orcid":false,"given":"Kexiang","family":"Yan","sequence":"first","affiliation":[{"name":"School of Cyber Science and Engineering, Sichuan University , Chuanda Road, Shuangliu District, Chengdu 610207 ,","place":["China"]},{"name":"The 30th Research Institute of China Electronics Technology Group Corporation , Chuangye Road, Wuhou District, Chengdu, 610041 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7153-8014","authenticated-orcid":false,"given":"Gang","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Engineering, Sichuan University , Chuanda Road, Shuangliu District, Chengdu 610207 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4223-6719","authenticated-orcid":false,"given":"Lei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Engineering, Sichuan University , Chuanda Road, Shuangliu District, Chengdu 610207 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8448-0158","authenticated-orcid":false,"given":"Mingxu","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Engineering, Sichuan University , Chuanda Road, Shuangliu District, Chengdu 610207 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1609-979X","authenticated-orcid":false,"given":"Kui","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Engineering, Sichuan University , Chuanda Road, Shuangliu District, Chengdu 610207 ,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,3,30]]},"reference":[{"key":"2025092201572133200_ref1","first-page":"6625","article-title":"A survey on multimodal disinformation detection","volume-title":"Proceedings of the 29th international conference on computational linguistics, Gyeongju, Republic of Korea, October","author":"Firoj","year":"2022"},{"key":"2025092201572133200_ref4","first-page":"849","article-title":"EANN: Event adversarial neural networks for multimodal fake news detection","volume-title":"Proceedings of the 24th ACM SIGKDD international conference on Knowledge Discovery & Data Mining, London, United Kingdom, august 19-23","author":"Wang","year":"2018"},{"key":"2025092201572133200_ref5","doi-asserted-by":"crossref","first-page":"2892","DOI":"10.1145\/3366423.3380054","article-title":"VRoC: Variational autoencoder-aided multi-task rumor classifier based on text","volume-title":"Proceedings of the web conference 2020, Taipei, Taiwan, April 20\u201324","author":"Cheng","year":"2020"},{"key":"2025092201572133200_ref6","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1145\/3137597.3137600","article-title":"Fake news detection on social media: A data mining perspective","volume":"19","author":"Shu","year":"2017","journal-title":"SIGKDD Explor Newsl"},{"key":"2025092201572133200_ref7","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1109\/TMM.2016.2617078","article-title":"Novel visual and statistical image features for microblogs news verification","volume":"19","author":"Jin","year":"2017","journal-title":"IEEE Trans Multimed"},{"key":"2025092201572133200_ref8","first-page":"3818","article-title":"Detecting rumors from microblogs with recurrent neural networks","volume-title":"Proceedings of the twenty-fifth international joint conference on artificial intelligence IJCAI\u201916, New York, USA, 9\u201315 July","author":"Ma","year":"2016"},{"key":"2025092201572133200_ref9","first-page":"549","article-title":"Rumor detection on social media with bi-directional graph convolutional networks","volume-title":"Proceedings of the AAAI conference on artificial intelligence, New York, USA, 07-12 Feb","author":"Bian","year":"2020"},{"key":"2025092201572133200_ref10","first-page":"1417","article-title":"Rumor detection on social media with graph structured adversarial learning","volume-title":"Proceedings of the twenty-ninth international joint conference on artificial intelligence, Yokohama, Japan, 07-15 Jan","author":"Yang","year":"2021"},{"key":"2025092201572133200_ref11","doi-asserted-by":"crossref","DOI":"10.1145\/3308558.3313552","article-title":"MVAE: Multimodal variational autoencoder for fake news detection","volume-title":"The world wide web conference, WWW \u201819, San Francisco, USA, 13-17 may, 2915\u20132921","author":"Khattar","year":"2019"},{"key":"2025092201572133200_ref12","first-page":"39","article-title":"SpotFake: A multi-modal framework for fake news detection","volume-title":"2019 IEEE fifth international conference on multimedia big data (BigMM), Singapore, Singapore, 11-13 Sep","author":"Singhal","year":"2019"},{"key":"2025092201572133200_ref13","first-page":"354","article-title":"SAFE: Similarity-aware multi-modal fake news detection","volume-title":"24th Pacific-Asia Conference on Knowledge Discovery and Data Mining, ELECTR NETWORK, 11\u201314 May","author":"Zhou","year":"2020"},{"key":"2025092201572133200_ref14","doi-asserted-by":"publisher","first-page":"5384","DOI":"10.1609\/aaai.v37i4.25670","article-title":"(2022) bootstrapping multi-view representations for fake news detection","volume":"37","author":"Ying","year":"2023","journal-title":"Proceedings of the AAAI conference on Artificial Intelligence"},{"key":"2025092201572133200_ref15","doi-asserted-by":"publisher","first-page":"13915","DOI":"10.1609\/aaai.v34i10.7230","article-title":"SpotFake+: A multimodal framework for fake news detection via transfer learning (student abstract)","volume":"34","author":"Singhal","year":"2020","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2025092201572133200_ref16","first-page":"153","article-title":"Hierarchical multi-modal contextual attention Network for fake news detection","volume-title":"Proceedings of the 44th international ACM SIGIR conference on Research and Development in information retrieval, virtual event, Canada, 11-15 July","author":"Qian","year":"2021"},{"key":"2025092201572133200_ref17","first-page":"4733","article-title":"Cross-modal knowledge distillation in multi-modal fake news detection","volume-title":"47th IEEE international conference on acoustics, speech and signal processing (ICASSP). Singapore, Singapore, 22-27 may","author":"Wei","year":"2022"},{"key":"2025092201572133200_ref18","first-page":"2","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume":"1","author":"Devlin","year":"2019","journal-title":"Proceedings of naacL-HLT"},{"article-title":"RoBERTa: A robustly optimized BERT pretraining approach","author":"Liu","key":"2025092201572133200_ref19","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1907.11692"},{"key":"2025092201572133200_ref20","first-page":"770","article-title":"Deep residual learning for image recognition","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition, Seattle, WA, 27-30 JUN","author":"He","year":"2016"},{"author":"Dosovitskiy","key":"2025092201572133200_ref21","article-title":"An image is worth 16x16 words: Transformers for image recognition at scale"},{"key":"2025092201572133200_ref22","first-page":"754","article-title":"Compare to the knowledge: Graph neural fake news detection with external knowledge","volume-title":"Proceedings of the 59th annual meeting of the Association for Computational Linguistics and the 11th international joint conference on natural language processing, online, 1-6 august","author":"Hu","year":"2021"},{"key":"2025092201572133200_ref23","first-page":"81","article-title":"KAN: Knowledge-aware attention Network for fake news detection","volume-title":"35th AAAI conference on artificial intelligence, ELECTR NETWORK, 02-09 Feb, 35","author":"Dun","year":"2021"},{"key":"2025092201572133200_ref24","first-page":"2120","article-title":"Generalizing to the future: Mitigating entity bias in fake news detection","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, SPAIN, 11\u201315 Jul","author":"Zhu","year":"2022"},{"key":"2025092201572133200_ref25","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1145\/3474085.3481548","article-title":"Improving fake news detection by using an entity-enhanced framework to fuse diverse multimodal clues","volume-title":"Proceedings of the 29th ACM international conference on multimedia, virtual event","author":"Qi","year":"2021"},{"key":"2025092201572133200_ref26","first-page":"3424","article-title":"Hierarchical semantic enhancement Network for multimodal fake news detection","volume-title":"Proceedings of the 31st ACM international conference on multimedia. Ottawa, ON, Canada, October 29\u2013November 3","author":"Zhang","year":"2023"},{"key":"2025092201572133200_ref27","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1089\/big.2020.0062","article-title":"FakeNewsNet: A data repository with news content, social context and Spatialtemporal information for studying fake news on social media","volume":"8","author":"Shu","year":"2019","journal-title":"Big data"},{"author":"Su","key":"2025092201572133200_ref28","article-title":"Fake news detectors are biased against texts generated by large language models"},{"key":"2025092201572133200_ref29","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.114171","article-title":"Linguistic feature based learning model for fake news detection and classification","volume":"169","author":"Choudhary","year":"2021","journal-title":"Expert Syst Appl"},{"key":"2025092201572133200_ref30","first-page":"3901","article-title":"A convolutional approach for misinformation identification","volume-title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, Melbourne, Australia, 19\u201325 August","author":"Yu","year":"2017"},{"key":"2025092201572133200_ref31","first-page":"3343","article-title":"MDFEND: Multi-domain fake news detection","volume-title":"Proceedings of the 30th ACM international conference on Information & Knowledge Management, virtual event, 1-5 Nov","author":"Nan","year":"2021"},{"key":"2025092201572133200_ref32","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1109\/ICDM.2019.00062","article-title":"Exploiting multi-domain visual information for fake news detection","volume-title":"2019 IEEE international conference on data mining (ICDM), Beijing, CHINA, 08-11 NOV","author":"Qi","year":"2019"},{"key":"2025092201572133200_ref33","first-page":"651","article-title":"False rumors detection on Sina Weibo by propagation structures","volume-title":"2015 IEEE 31st International Conference on Data Engineering, Seoul, SOUTH KOREA, 13\u201317 APR","author":"Wu","year":"2015"},{"key":"2025092201572133200_ref34","first-page":"675","article-title":"Information credibility on twitter","volume-title":"Proceedings of the 20th international conference on world wide web, WWW \u201811, Hyderabad, India, 28 march - 1 April","author":"Castillo","year":"2011"},{"key":"2025092201572133200_ref35","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1145\/3132847.3132877","article-title":"CSI: A hybrid deep model for fake news detection","volume-title":"Proceedings of the 2017 ACM on conference on information and knowledge management, CIKM \u201817, Singapore, 6-10 November","author":"Ruchansky","year":"2017"},{"key":"2025092201572133200_ref36","first-page":"795","article-title":"Multimodal fusion with recurrent neural networks for rumor detection on microblogs","volume-title":"Proceedings of the 25th ACM international conference on multimedia, comp hist museum, mountain view, CA, 23-27 oct","author":"Jin","year":"2017"},{"key":"2025092201572133200_ref37","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1145\/3485447.3511968","article-title":"Cross-modal ambiguity learning for multimodal fake news detection","volume-title":"Proceedings of the ACM web conference 2022, ELECTR NETWORK, 25-29 APR","author":"Chen","year":"2022"},{"key":"2025092201572133200_ref38","doi-asserted-by":"crossref","first-page":"2560","DOI":"10.18653\/v1\/2021.findings-acl.226","article-title":"Multimodal fusion with Co-attention networks for fake news detection","volume-title":"Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, Online, 01\u201306 AUG","author":"Wu","year":"2021"},{"article-title":"Adapting fake news detection to the era of large language models","year":"2023","author":"Su","key":"2025092201572133200_ref39"},{"key":"2025092201572133200_ref40","first-page":"12888","article-title":"BLIP: Bootstrapping language-image pre-training for unified vision-language understanding and generation","volume-title":"Proceedings of the 39th international conference on machine learning, Baltimore, MD, 17-23 JUL","author":"Li","year":"2022"},{"key":"2025092201572133200_ref41","doi-asserted-by":"crossref","first-page":"3651","DOI":"10.18653\/v1\/P19-1356","article-title":"What does BERT learn about the structure of language?","volume-title":"Proceedings of the 57th annual meeting of the Association for Computational Linguistics. Florence, Italy,28 July - 2 august","author":"Jawahar","year":"2019"},{"key":"2025092201572133200_ref42","first-page":"12116","volume-title":"Do Vision Transformers See like Convolutional Neural Networks?Advances in Neural Information Processing Systems","author":"Raghu","year":"2021"},{"key":"2025092201572133200_ref43","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1162\/tacl_a_00385","article-title":"Decoupling the role of data, attention, and losses in multimodal transformers","volume":"9","author":"Hendricks","year":"2021","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2025092201572133200_ref44","doi-asserted-by":"publisher","first-page":"10637","DOI":"10.1609\/aaai.v37i9.26263","article-title":"BridgeTower: Building bridges between encoders in vision-language representation learning","volume":"37","author":"Xu","year":"2023","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2025092201572133200_ref45","doi-asserted-by":"publisher","first-page":"e12811","DOI":"10.1049\/ell2.12811","article-title":"MMRDF: An improved multitask multi-modal rumor detection framework","volume":"59","author":"Jiang","year":"2023","journal-title":"Electron Lett"},{"key":"2025092201572133200_ref47","first-page":"10867","article-title":"From images to textual prompts: Zero-shot visual question answering with frozen large language models","volume-title":"2023 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), Vancouver, BC, Canada, 17-24 JUN","author":"Guo","year":"2023"},{"key":"2025092201572133200_ref48","doi-asserted-by":"crossref","first-page":"951","DOI":"10.18653\/v1\/2022.findings-emnlp.67","article-title":"Plug-and-play VQA: Zero-shot VQA by conjoining large pretrained models with zero training","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, 7-11 December","author":"Tiong","year":"2022"},{"key":"2025092201572133200_ref49","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual explanations from deep networks via gradient-based localization","volume":"128","author":"Selvaraju","year":"2020","journal-title":"Int J Comput Vis"},{"key":"2025092201572133200_ref50","first-page":"1930","article-title":"Modeling task relationships in multi-task learning with multi-gate mixture-of-experts","volume-title":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, ENGLAND, 19-23 AUG","author":"Ma","year":"2018"},{"key":"2025092201572133200_ref51","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans Signal Process"},{"key":"2025092201572133200_ref52","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"article-title":"Fast-DetectGPT: Efficient zero-shot detection of machine-generated text via conditional probability curvature","year":"2024","author":"Bao","key":"2025092201572133200_ref53"},{"key":"2025092201572133200_ref54","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1089\/big.2020.0062","article-title":"FakeNewsNet: A data repository with news content, social context and Spatialtemporal information for studying fake news on social media","volume":"8","author":"Shu","year":"2020","journal-title":"Big"}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/68\/9\/1105\/62811761\/bxaf024.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/68\/9\/1105\/62811761\/bxaf024.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,22]],"date-time":"2025-09-22T05:57:44Z","timestamp":1758520664000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/68\/9\/1105\/8100540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,30]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,3,30]]},"published-print":{"date-parts":[[2025,9,21]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxaf024","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"type":"print","value":"0010-4620"},{"type":"electronic","value":"1460-2067"}],"subject":[],"published-other":{"date-parts":[[2025,9]]},"published":{"date-parts":[[2025,3,30]]}}}