{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T06:39:42Z","timestamp":1771915182353,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T00:00:00Z","timestamp":1736985600000},"content-version":"vor","delay-in-days":15,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"FAIR \u2013 Future Artificial Intelligence Research","award":["CUP H23C22000860006"],"award-info":[{"award-number":["CUP H23C22000860006"]}]},{"name":"FAIR \u2013 Future Artificial Intelligence Research","award":["CUP H23C22000860006"],"award-info":[{"award-number":["CUP H23C22000860006"]}]},{"name":"Tech4You","award":["n. ECS0000009"],"award-info":[{"award-number":["n. ECS0000009"]}]},{"DOI":"10.13039\/501100007069","name":"Universit\u00e0 della Calabria","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007069","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>In the digital landscape, social media has emerged as a prevalent channel for global communication, connecting like-minded individuals worldwide. However, while facilitating information exchange, it is also susceptible to the dissemination of false information, posing a constant challenge to the reliability of online content. To address this issue, this paper introduces a novel methodology called <jats:italic>TM-FID (Topic-oriented Multimodal False Information Detection)<\/jats:italic>, which combines false information detection and neural topic modeling within a semi-supervised multimodal approach. By jointly leveraging textual and visual information contained in online news, our approach provides insights into how false information influences specific discussion topics, thus enabling a comprehensive and fine-grained understanding of its spread and impact on social media conversation. Experimental evaluation carried out on a set of multimodal gossip-related news demonstrates the quality of the identified topics, assessed through a novel centroid-based metric, as well as the efficacy of the cross-attention mechanism used within <jats:italic>TM-FID<\/jats:italic> to accurately identify false information in multimodal news. Overall, the proposed methodology can enable effective strategies to counter the spread of false information, thereby fostering trust and confidence in the information shared on social media platforms.<\/jats:p>","DOI":"10.1007\/s10994-024-06727-4","type":"journal-article","created":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T16:17:50Z","timestamp":1737044270000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Unmasking deception: a topic-oriented multimodal approach to uncover false information on social media"],"prefix":"10.1007","volume":"114","author":[{"given":"Riccardo","family":"Cantini","sequence":"first","affiliation":[]},{"given":"Cristian","family":"Cosentino","sequence":"additional","affiliation":[]},{"given":"Irene","family":"Kilanioti","sequence":"additional","affiliation":[]},{"given":"Fabrizio","family":"Marozzo","sequence":"additional","affiliation":[]},{"given":"Domenico","family":"Talia","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,1,16]]},"reference":[{"key":"6727_CR1","doi-asserted-by":"crossref","unstructured":"Abavisani, M., Wu, L., Hu, S., Tetreault, J., & Jaimes, A. (2020). Multimodal categorization of crisis events in social media. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 14679\u201314689),","DOI":"10.1109\/CVPR42600.2020.01469"},{"key":"6727_CR2","doi-asserted-by":"publisher","first-page":"47177","DOI":"10.1109\/ACCESS.2020.2978950","volume":"8","author":"L Belcastro","year":"2020","unstructured":"Belcastro, L., Cantini, R., Marozzo, F., Talia, D., & Trunfio, P. (2020). Learning political polarization on social media using neural networks. IEEE Access, 8, 47177\u201347187.","journal-title":"IEEE Access"},{"key":"6727_CR3","doi-asserted-by":"crossref","unstructured":"Cantini, R., Cosentino, C., Kilanioti, I., Marozzo, F., & Talia, D. (2023). Unmasking covid-19 false information on twitter: A topic-based approach with bert. In International Conference on Discovery Science (pp. 126\u2013140). Berlin: Springer.","DOI":"10.1007\/978-3-031-45275-8_9"},{"issue":"2","key":"6727_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3466876","volume":"16","author":"R Cantini","year":"2021","unstructured":"Cantini, R., Marozzo, F., Bruno, G., & Trunfio, P. (2021). Learning sentence-to-hashtags semantic mapping for hashtag recommendation on microblogs. ACM Transactions on Knowledge Discovery from Data (TKDD), 16(2), 1\u201326.","journal-title":"ACM Transactions on Knowledge Discovery from Data (TKDD)"},{"issue":"1","key":"6727_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3390\/bdcc6010003","volume":"6","author":"R Cantini","year":"2022","unstructured":"Cantini, R., Marozzo, F., Talia, D., & Trunfio, P. (2022). Analyzing political polarization on social media by deleting bot spamming. Big Data and Cognitive Computing, 6(1), 3.","journal-title":"Big Data and Cognitive Computing"},{"key":"6727_CR6","doi-asserted-by":"crossref","unstructured":"Chen, Y., Li, D., Zhang, P., Sui, J., Lv, Q., Tun, L., & Shang, L. (2022). Cross-modal ambiguity learning for multimodal fake news detection. In Proceedings of the ACM web conference 2022 (pp. 2897\u20132905).","DOI":"10.1145\/3485447.3511968"},{"key":"6727_CR7","unstructured":"Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"6727_CR8","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929"},{"key":"6727_CR9","doi-asserted-by":"publisher","DOI":"10.3389\/fsoc.2022.886498","author":"R Egger","year":"2022","unstructured":"Egger, R., & Yu, J. (2022). A topic modeling comparison between LDA, NMF, top2vec, and bertopic to demystify twitter posts. Frontiers in Sociology. https:\/\/doi.org\/10.3389\/fsoc.2022.886498","journal-title":"Frontiers in Sociology"},{"key":"6727_CR10","first-page":"403","volume":"302","author":"E Gabarron","year":"2023","unstructured":"Gabarron, E., Dorronzoro, E., Reichenpfader, D., & Denecke, K. (2023). What do autistic people discuss on twitter? An approach using bertopic modelling. Caring Is Sharing-Exploiting the Value in Data for Health and Innovation, 302, 403\u2013407.","journal-title":"Caring Is Sharing-Exploiting the Value in Data for Health and Innovation"},{"issue":"11","key":"6727_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2024.e32464","volume":"10","author":"T Gokcimen","year":"2024","unstructured":"Gokcimen, T., & Das, B. (2024). Exploring climate change discourse on social media and blogs using a topic modeling analysis. Heliyon, 10(11), e32464.","journal-title":"Heliyon"},{"key":"6727_CR12","unstructured":"Grootendorst, M. (2022). Bertopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794"},{"key":"6727_CR13","first-page":"2018","volume":"34","author":"A Hoyle","year":"2021","unstructured":"Hoyle, A., Goel, P., Hian-Cheong, A., Peskov, D., Boyd-Graber, J., & Resnik, P. (2021). Is automated topic model evaluation broken? The incoherence of coherence. Advances in Neural Information Processing Systems, 34, 2018\u20132033.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"2","key":"6727_CR14","doi-asserted-by":"publisher","first-page":"2913","DOI":"10.1007\/s11042-022-12668-8","volume":"82","author":"A Jarrahi","year":"2023","unstructured":"Jarrahi, A., & Safari, L. (2023). Evaluating the effectiveness of publishers\u2019 features in fake news detection on social media. Multimedia Tools and Applications, 82(2), 2913\u20132939.","journal-title":"Multimedia Tools and Applications"},{"key":"6727_CR15","doi-asserted-by":"crossref","unstructured":"Jin, Z., Cao, J., Guo, H., Zhang, Y., Wang, Y., & Luo, J. (2017). Detection and analysis of 2016 us presidential election related rumors on twitter. In Social, cultural, and Behavioral Modeling: 10th international conference, SBP-BRiMS 2017, Washington, DC, USA, July 5\u20138, 2017, Proceedings 10, (pp. 14\u201324). Berlin: Springer","DOI":"10.1007\/978-3-319-60240-0_2"},{"issue":"8","key":"6727_CR16","doi-asserted-by":"publisher","first-page":"11765","DOI":"10.1007\/s11042-020-10183-2","volume":"80","author":"RK Kaliyar","year":"2021","unstructured":"Kaliyar, R. K., Goswami, A., & Narang, P. (2021). Fakebert: Fake news detection in social media with a bert-based deep learning approach. Multimedia Tools and Applications, 80(8), 11765\u201311788.","journal-title":"Multimedia Tools and Applications"},{"key":"6727_CR17","doi-asserted-by":"crossref","unstructured":"Kula, S., Chora\u015b, M., & Kozik, R. (2021). Application of the bert-based architecture in fake news detection. In 13th International conference on computational intelligence in security for information systems (CISIS 2020) 12 (pp. 239\u2013249).","DOI":"10.1007\/978-3-030-57805-3_23"},{"key":"6727_CR18","doi-asserted-by":"crossref","unstructured":"Lau, J. H., Newman, D., & Baldwin, T. (2014). Machine reading tea leaves: Automatically evaluating topic coherence and topic model quality. In Proceedings of the 14th conference of the European chapter of the association for computational linguistics (pp. 530\u2013539).","DOI":"10.3115\/v1\/E14-1056"},{"key":"6727_CR19","unstructured":"Liu, L., et al. (2019). On the variance of the adaptive learning rate and beyond. arxiv 2019. arXiv preprint arXiv:1908.03265"},{"key":"6727_CR20","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692"},{"key":"6727_CR21","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3390\/informatics11010008","volume":"11","author":"M Mendon\u00e7a","year":"2024","unstructured":"Mendon\u00e7a, M., & Figueira, \u00c1. (2024). Topic extraction: Bertopic\u2019s insight into the 117th congress\u2019s twitterverse. Informatics, 11, 8.","journal-title":"Informatics"},{"key":"6727_CR22","unstructured":"Mosbach, M., Andriushchenko, M., & Klakow, D. (2020). On the stability of fine-tuning bert: Misconceptions, explanations, and strong baselines. arXiv preprint arXiv:2006.04884"},{"issue":"1","key":"6727_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.jjimei.2020.100007","volume":"1","author":"JA Nasir","year":"2021","unstructured":"Nasir, J. A., Khan, O. S., & Varlamis, I. (2021). Fake news detection: A hybrid CNN-RNN based deep learning approach. International Journal of Information Management Data Insights, 1(1), 100007.","journal-title":"International Journal of Information Management Data Insights"},{"key":"6727_CR24","doi-asserted-by":"crossref","unstructured":"Nguyen, D.Q., Vu, T., & Nguyen, A.T. (2020). Bertweet: A pre-trained language model for English tweets. arXiv preprint arXiv:2005.10200","DOI":"10.18653\/v1\/2020.emnlp-demos.2"},{"issue":"1","key":"6727_CR25","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3390\/info12010038","volume":"12","author":"NR Oliveira","year":"2021","unstructured":"Oliveira, N. R., Pisa, P. S., Lopez, M. A., Medeiros, D. S. V., & Mattos, D. M. (2021). Identifying fake news on social networks based on natural language processing: Trends and challenges. Information, 12(1), 38.","journal-title":"Information"},{"key":"6727_CR26","unstructured":"Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et\u00a0al. (2021). Learning transferable visual models from natural language supervision. In International conference on machine learning (pp. 8748\u20138763). PMLR"},{"key":"6727_CR27","unstructured":"Shu, K., Mahudeswaran, D., Wang, S., Lee, D., & Liu, H. (2018). Fakenewsnet: A data repository with news content, social context and dynamic information for studying fake news on social media. arXiv preprint arXiv:1809.01286"},{"issue":"3","key":"6727_CR28","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1089\/big.2020.0062","volume":"8","author":"K Shu","year":"2020","unstructured":"Shu, K., Mahudeswaran, D., Wang, S., Lee, D., & Liu, H. (2020). Fakenewsnet: A data repository with news content, social context, and spatiotemporal information for studying fake news on social media. Big Data, 8(3), 171\u2013188.","journal-title":"Big Data"},{"key":"6727_CR29","doi-asserted-by":"publisher","first-page":"13915","DOI":"10.1609\/aaai.v34i10.7230","volume":"34","author":"S Singhal","year":"2020","unstructured":"Singhal, S., Kabra, A., Sharma, M., Shah, R. R., Chakraborty, T., & Kumaraguru, P. (2020). Spotfake+: A multimodal framework for fake news detection via transfer learning. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 13915\u201313916.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"6727_CR30","doi-asserted-by":"crossref","unstructured":"Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to fine-tune bert for text classification? In Chinese computational linguistics: 18th China national conference, CCL 2019, Kunming, China, October 18\u201320, 2019, Proceedings 18 (pp. 194\u2013206). Springer: Berlin","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"6727_CR31","doi-asserted-by":"crossref","unstructured":"Udupa, A., Adarsh, K., Aravinda, A., Godihal, N.H., & Kayarvizhy, N. (2022). An exploratory analysis of GSDMM and bertopic on short text topic modelling. In 2022 fourth international conference on cognitive computing and information processing (CCIP) (pp. 1\u20139). IEEE","DOI":"10.1109\/CCIP57447.2022.10058687"},{"key":"6727_CR32","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems (Vol. 30)."},{"key":"6727_CR33","unstructured":"Vijjali, R., Potluri, P., Kumar, S., & Teki, S. (2020). Two stage transformer model for covid-19 fake news detection and fact checking. arXiv preprint arXiv:2011.13253"},{"key":"6727_CR34","doi-asserted-by":"crossref","unstructured":"Wei, Z., Pan, H., Qiao, L., Niu, X., Dong, P., & Li, D. (2022). Cross-modal knowledge distillation in multi-modal fake news detection. In IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 4733\u20134737).","DOI":"10.1109\/ICASSP43922.2022.9747280"},{"key":"6727_CR35","unstructured":"Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R.R., & Le, Q.V. (2019). Xlnet: Generalized autoregressive pretraining for language understanding. In: Advances in Neural Information Processing Systems (Vol. 32)."},{"key":"6727_CR36","unstructured":"Yang, Y., Zheng, L., Zhang, J., Cui, Q., Li, Z., & Yu, P.S. (2018). TI-CNN: Convolutional neural networks for fake news detection. arXiv preprint arXiv:1806.00749"},{"key":"6727_CR37","doi-asserted-by":"crossref","unstructured":"Zhou, X., Wu, J., & Zafarani, R. (2020). Safe: Similarity-aware multi-modal fake news detection. In Pacific-Asia conference on knowledge discovery and data mining (pp. 354\u2013367). Berlin: Springer","DOI":"10.1007\/978-3-030-47436-2_27"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06727-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-024-06727-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06727-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T16:19:48Z","timestamp":1738945188000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-024-06727-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["6727"],"URL":"https:\/\/doi.org\/10.1007\/s10994-024-06727-4","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"8 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 September 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 January 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"13"}}