{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T21:22:50Z","timestamp":1783977770817,"version":"3.55.0"},"reference-count":52,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2025,2,17]],"date-time":"2025-02-17T00:00:00Z","timestamp":1739750400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["EL"],"published-print":{"date-parts":[[2025,3,28]]},"abstract":"<jats:sec>\n<jats:title>Purpose<\/jats:title>\n<jats:p>Previous research mainly uses graph neural networks on syntactic dependency graphs, often neglecting emotional cues in sarcasm detection and failing to integrate image features for multimodal information effectively. To address these limitations, this study proposes a novel multimodal sarcasm detection model based on the directed graph isomorphism network with sentiment enhancement and multimodal fusion (DGIN-SE-MF).<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Design\/methodology\/approach<\/jats:title>\n<jats:p>The approach extracts image and text features through vision transformer and BERT, respectively. To deeply integrate the extracted features, the author develops a text-guided multi-head attention fusion mechanism module. Subsequently, a directed graph is constructed through SE and the multimodal factorized bilinear pooling method to integrate image features into the graph. The DGIN then fuses the image and text features, using a weighted attention mechanism to generate the final representation.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Findings<\/jats:title>\n<jats:p>The model is validated on three datasets: English, Chinese and an Indonesian\u2013English dataset. The results demonstrate that the proposed model consistently outperforms other baseline models, particularly on the Chinese and English sarcasm datasets, achieving F1 scores of 88.75 % and 83.10 %, respectively.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Originality\/value<\/jats:title>\n<jats:p>The proposed model addresses the inadequacies of previous methods by effectively integrating emotional cues and image features into sarcasm detection. To the best of the authors\u2019 knowledge, this is the first work to leverage a DGIN-SE-MF for this task, leading to significant improvements in detection performance across different languages.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/el-07-2024-0198","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T02:39:21Z","timestamp":1739414361000},"page":"211-236","source":"Crossref","is-referenced-by-count":1,"title":["A knowledge-enhanced directed graph isomorphism network for multimodal sarcasm detection"],"prefix":"10.1108","volume":"43","author":[{"given":"Yu","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziming","family":"Zeng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","published-online":{"date-parts":[[2025,2,17]]},"reference":[{"key":"key2025032709300089500_ref001","doi-asserted-by":"publisher","first-page":"109780","DOI":"10.1016\/j.knosys.2022.109780","article-title":"Sentiment analysis on Twitter data integrating TextBlob and deep learning models: the case of US airline industry","volume":"255","year":"2022","journal-title":"Knowledge-Based Systems"},{"issue":"4","key":"key2025032709300089500_ref002","doi-asserted-by":"publisher","first-page":"345","DOI":"10.3934\/electreng.2022021","article-title":"A novel algorithm for sarcasm detection using supervised machine learning approach","volume":"6","year":"2022","journal-title":"AIMS Electronics and Electrical Engineering"},{"key":"key2025032709300089500_ref003","doi-asserted-by":"publisher","first-page":"36","DOI":"10.12840\/ISSN.2255-4165.036","article-title":"Socio-cultural and individual factors in verbal irony use and understanding: what we know, what we don\u2019t know, what we want to know","volume":"10","year":"2022","journal-title":"Review of Communication Research"},{"key":"key2025032709300089500_ref004","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/1653696","article-title":"Multimodal sarcasm detection: a deep learning approach","volume-title":"Wireless Communications and Mobile Computing","year":"2022"},{"key":"key2025032709300089500_ref005","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1109\/ICCCMLA58983.2023.10346908","article-title":"A comparative analysis on sarcasm detection","volume-title":"IEEE 5th International Conference on Cybernetics, Cognition and Machine Learning Applications (ICCCMLA \u201823)","year":"2023"},{"key":"key2025032709300089500_ref006","doi-asserted-by":"publisher","first-page":"2506","DOI":"10.18653\/v1\/P19-1239","article-title":"Multi-modal sarcasm detection in Twitter with hierarchical fusion model","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","year":"2019"},{"issue":"4","key":"key2025032709300089500_ref007","doi-asserted-by":"publisher","first-page":"102600","DOI":"10.1016\/j.ipm.2021.102600","article-title":"Machine learning and feature engineering-based study into sarcasm and irony classification with application to cyberbullying detection","volume":"58","year":"2021","journal-title":"Information Processing and Management"},{"key":"key2025032709300089500_ref008","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","year":"2019"},{"key":"key2025032709300089500_ref009","article-title":"An image is worth 16x16 words: transformers for image recognition at scale","year":"2021"},{"key":"key2025032709300089500_ref010","doi-asserted-by":"publisher","first-page":"127440","DOI":"10.1016\/j.neucom.2024.127440","article-title":"Multi-modal sarcasm detection based on multi-channel enhanced fusion model","volume":"578","year":"2024","journal-title":"Neurocomputing"},{"key":"key2025032709300089500_ref011","article-title":"Inductive representation learning on large graphs","year":"2018"},{"key":"key2025032709300089500_ref012","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR '16)","year":"2016"},{"issue":"12","key":"key2025032709300089500_ref013","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2021.0121286","article-title":"Arabic sentiment analysis for multi-dialect text using machine learning techniques","volume":"12","year":"2021","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"key2025032709300089500_ref014","doi-asserted-by":"publisher","first-page":"11305","DOI":"10.1109\/CVPR.2019.01157","article-title":"Semi-supervised learning with graph learning-convolutional networks","volume-title":"IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR '19)","year":"2019"},{"key":"key2025032709300089500_ref015","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.3115\/v1\/D14-1181","article-title":"Convolutional neural networks for sentence classification","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '14)","year":"2014"},{"issue":"3","key":"key2025032709300089500_ref016","doi-asserted-by":"publisher","first-page":"103651","DOI":"10.1016\/j.ipm.2024.103651","article-title":"Integrating GIN-based multimodal feature transformation and multi-feature combination voting for irony-aware cyberbullying detection","volume":"61","year":"2024","journal-title":"Information Processing and Management"},{"key":"key2025032709300089500_ref017","doi-asserted-by":"publisher","first-page":"111457","DOI":"10.1016\/j.knosys.2024.111457","article-title":"An attention-based, context-aware multimodal fusion method for sarcasm detection using inter-modality inconsistency","volume":"287","year":"2024","journal-title":"Knowledge-Based Systems"},{"key":"key2025032709300089500_ref018","doi-asserted-by":"publisher","first-page":"4707","DOI":"10.1145\/3474085.3475190","article-title":"Multi-modal sarcasm detection with interactive in-modal and cross-modal graphs","volume-title":"Proceedings of the 29th ACM International Conference on Multimedia","year":"2021"},{"key":"key2025032709300089500_ref019","doi-asserted-by":"publisher","first-page":"1767","DOI":"10.18653\/v1\/2022.acl-long.124","article-title":"Multi-modal sarcasm detection via cross-modal graph convolutional network","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","year":"2022"},{"key":"key2025032709300089500_ref020","doi-asserted-by":"publisher","first-page":"4995","DOI":"10.18653\/v1\/2022.emnlp-main.333","article-title":"Towards multi-modal sarcasm detection via hierarchical congruity modeling with knowledge enhancement","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","year":"2022"},{"issue":"5","key":"key2025032709300089500_ref021","doi-asserted-by":"publisher","first-page":"2146","DOI":"10.3390\/app14052146","article-title":"A multi-view interactive approach for multimodal sarcasm detection in social internet of things with knowledge enhancement","volume":"14","year":"2024","journal-title":"Applied Sciences"},{"key":"key2025032709300089500_ref022","doi-asserted-by":"publisher","first-page":"102203","DOI":"10.1016\/j.inffus.2023.102203","article-title":"Fact-sentiment incongruity combination network for multimodal sarcasm detection","volume":"104","year":"2024","journal-title":"Information Fusion"},{"issue":"1","key":"key2025032709300089500_ref023","doi-asserted-by":"publisher","first-page":"12048","DOI":"10.1609\/aaai.v32i1.12048","article-title":"Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM","volume":"32","year":"2018","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"key2025032709300089500_ref024","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1145\/3477495.3531925","article-title":"A multitask framework for sentiment, emotion and sarcasm aware cyberbullying detection from multi-modal code-mixed memes","year":"2022"},{"key":"key2025032709300089500_ref025","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.procs.2022.12.405","article-title":"Sarcasm detection using bidirectional encoder representations from transformers and graph convolutional networks","volume":"218","year":"2023","journal-title":"Procedia Computer Science"},{"key":"key2025032709300089500_ref026","doi-asserted-by":"publisher","first-page":"128874","DOI":"10.1016\/j.neucom.2024.128874","article-title":"Modeling inter-modal incongruous sentiment expressions for multi-modal sarcasm detection","volume":"616","year":"2025","journal-title":"Neurocomputing"},{"key":"key2025032709300089500_ref027","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.18653\/v1\/2020.findings-emnlp.124","article-title":"Modeling intra and inter-modality incongruity for multi-modal sarcasm detection","volume-title":"Findings of the Association for Computational Linguistics (EMNLP '20)","year":"2020"},{"key":"key2025032709300089500_ref028","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1109\/CCWC.2018.8301729","article-title":"Compressed residual-VGG16 CNN model for big data places image recognition","volume-title":"IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC '18)","year":"2018"},{"issue":"6","key":"key2025032709300089500_ref029","doi-asserted-by":"publisher","first-page":"103521","DOI":"10.1016\/j.ipm.2023.103521","article-title":"A knowledge-augmented neural network model for sarcasm detection","volume":"60","year":"2023","journal-title":"Information Processing and Management"},{"issue":"2","key":"key2025032709300089500_ref030","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1108\/IDD-01-2023-0002","article-title":"Sarcasm detection in online comments using machine learning","volume":"52","year":"2024","journal-title":"Information Discovery and Delivery"},{"key":"key2025032709300089500_ref031","doi-asserted-by":"publisher","first-page":"1136","DOI":"10.1145\/2964284.2964321","article-title":"Detecting sarcasm in multimodal social platforms","volume-title":"Proceedings of the 24th ACM International Conference on Multimedia (MM \u201916)","year":"2016"},{"issue":"3","key":"key2025032709300089500_ref032","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1108\/EL-05-2023-0105","article-title":"A robust approach for aspect-based sentiment analysis using deep learning and domain ontologies","volume":"42","year":"2024","journal-title":"The Electronic Library"},{"issue":"21","key":"key2025032709300089500_ref033","doi-asserted-by":"publisher","first-page":"11235","DOI":"10.3390\/app122111235","article-title":"EFAFN: an efficient feature adaptive fusion network with facial feature for multimodal sarcasm detection","volume":"12","year":"2022","journal-title":"Applied Sciences"},{"key":"key2025032709300089500_ref034","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.18653\/v1\/P18-1093","article-title":"Reasoning with sarcasm by reading in-between","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","year":"2018"},{"key":"key2025032709300089500_ref035","doi-asserted-by":"publisher","first-page":"102085","DOI":"10.1016\/j.inffus.2023.102085","article-title":"Quantum fuzzy neural network for multimodal sentiment and sarcasm detection","volume":"103","year":"2024","journal-title":"Information Fusion"},{"key":"key2025032709300089500_ref036","doi-asserted-by":"publisher","first-page":"963666","DOI":"10.3389\/fpsyg.2022.963666","article-title":"A novel task to evaluate irony comprehension and its essential elements in Spanish speakers","volume":"13","year":"2022","journal-title":"Frontiers in Psychology"},{"key":"key2025032709300089500_ref037","doi-asserted-by":"publisher","article-title":"Graph attention networks","year":"2018","DOI":"10.17863\/CAM.48429"},{"key":"key2025032709300089500_ref038","doi-asserted-by":"publisher","first-page":"102132","DOI":"10.1016\/j.inffus.2023.102132","article-title":"Cross-modal incongruity aligning and collaborating for multi-modal sarcasm detection","volume":"103","year":"2024","journal-title":"Information Fusion"},{"key":"key2025032709300089500_ref039","doi-asserted-by":"publisher","first-page":"112109","DOI":"10.1016\/j.knosys.2024.112109","article-title":"Towards multimodal sarcasm detection via label-aware graph contrastive learning with back-translation augmentation","volume":"300","year":"2024","journal-title":"Knowledge-Based Systems"},{"key":"key2025032709300089500_ref040","doi-asserted-by":"publisher","first-page":"2540","DOI":"10.1109\/CVPR52729.2023.00250","article-title":"DIP: Dual incongruity perceiving network for sarcasm detection","volume-title":"IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR '23)","year":"2023"},{"issue":"3","key":"key2025032709300089500_ref041","doi-asserted-by":"publisher","first-page":"102883","DOI":"10.1016\/j.ipm.2022.102883","article-title":"SEMEME knowledge and auxiliary information enhanced approach for sarcasm detection","volume":"59","year":"2022","journal-title":"Information Processing and Management"},{"issue":"12","key":"key2025032709300089500_ref042","doi-asserted-by":"publisher","first-page":"4119","DOI":"10.1007\/s13042-023-01884-9","article-title":"Multi-perspective contrastive learning framework guided by SEMEME knowledge and label information for sarcasm detection","volume":"14","year":"2023","journal-title":"International Journal of Machine Learning and Cybernetics"},{"key":"key2025032709300089500_ref043","doi-asserted-by":"publisher","first-page":"128689","DOI":"10.1016\/j.neucom.2024.128689","article-title":"Dual-level adaptive incongruity-enhanced model for multimodal sarcasm detection","volume":"612","year":"2025","journal-title":"Neurocomputing"},{"issue":"2","key":"key2025032709300089500_ref044","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/MMUL.2021.3069097","article-title":"Modeling incongruity between modalities for multimodal sarcasm detection","volume":"28","year":"2021","journal-title":"IEEE MultiMedia"},{"key":"key2025032709300089500_ref045","article-title":"How powerful are graph neural networks?","year":"2019"},{"key":"key2025032709300089500_ref046","doi-asserted-by":"publisher","first-page":"3777","DOI":"10.18653\/v1\/2020.acl-main.349","article-title":"Reasoning with multimodal sarcastic tweets via modeling cross-modality contrast and semantic association","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","year":"2020"},{"issue":"1","key":"key2025032709300089500_ref047","doi-asserted-by":"crossref","first-page":"69","DOI":"10.32985\/ijeces.15.1.7","article-title":"A survey of sentiment analysis and sarcasm detection: challenges, techniques, and trends","volume":"15","year":"2024","journal-title":"International Journal of Electrical and Computer Engineering Systems"},{"issue":"1","key":"key2025032709300089500_ref048","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1109\/TNNLS.2021.3093416","article-title":"Mimicking the brain\u2019s cognition of sarcasm from multidisciplines for Twitter sarcasm detection","volume":"34","year":"2023","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"4","key":"key2025032709300089500_ref049","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1108\/EL-03-2022-0064","article-title":"Dynamic sentiment sensing of cities with social media data","volume":"40","year":"2022","journal-title":"The Electronic Library"},{"issue":"7","key":"key2025032709300089500_ref050","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1162\/neco_a_01199","article-title":"A review of recurrent neural networks: LSTM cells and network architectures","volume":"31","year":"2019","journal-title":"Neural Computation"},{"key":"key2025032709300089500_ref051","doi-asserted-by":"publisher","first-page":"112298","DOI":"10.1016\/j.knosys.2024.112298","article-title":"Multifaceted and deep semantic alignment network for multimodal sarcasm detection","volume":"301","year":"2024","journal-title":"Knowledge-Based Systems"},{"key":"key2025032709300089500_ref052","doi-asserted-by":"publisher","first-page":"101921","DOI":"10.1016\/j.inffus.2023.101921","article-title":"KnowleNet: knowledge fusion network for multimodal sarcasm detection","volume":"100","year":"2023","journal-title":"Information Fusion"}],"container-title":["The Electronic Library"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-07-2024-0198\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/EL-07-2024-0198\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T01:07:44Z","timestamp":1753405664000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/el\/article\/43\/2\/211-236\/1240267"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,17]]},"references-count":52,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2,17]]},"published-print":{"date-parts":[[2025,3,28]]}},"alternative-id":["10.1108\/EL-07-2024-0198"],"URL":"https:\/\/doi.org\/10.1108\/el-07-2024-0198","relation":{},"ISSN":["0264-0473","1758-616X"],"issn-type":[{"value":"0264-0473","type":"print"},{"value":"1758-616X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,17]]}}}