{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:29:40Z","timestamp":1777854580507,"version":"3.51.4"},"reference-count":49,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T00:00:00Z","timestamp":1672099200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72174086"],"award-info":[{"award-number":["72174086"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:p>Memes have gained popularity as a means to share visual ideas through the Internet and social media by mixing text, images and videos, often for humorous purposes. Research enabling automated analysis of memes has gained attention in recent years, including among others the task of classifying the emotion expressed in memes. In this article, we propose a novel model, cluster-based deep ensemble learning (CDEL), for emotion classification in memes. CDEL is a hybrid model that leverages the benefits of a deep learning model in combination with a clustering algorithm, which enhances the model with additional information after clustering memes with similar facial features. We evaluate the performance of CDEL on a benchmark data set for emotion classification, proving its effectiveness by outperforming a wide range of baseline models and achieving state-of-the-art performance. Further evaluation through ablated models demonstrates the effectiveness of the different components of CDEL.<\/jats:p>","DOI":"10.1177\/01655515221136241","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T03:47:31Z","timestamp":1672112851000},"page":"265-283","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Cluster-based deep ensemble learning for emotion classification in Internet memes"],"prefix":"10.1177","volume":"51","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0901-2222","authenticated-orcid":false,"given":"Xiaoyu","family":"Guo","sequence":"first","affiliation":[{"name":"College of Economics and Management, Nanjing University of Aeronautics and Astronautics, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Economics and Management, Nanjing University of Aeronautics and Astronautics, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arkaitz","family":"Zubiaga","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering and Computer Science, Queen Mary University of London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2022,12,27]]},"reference":[{"issue":"6","key":"bibr1-01655515221136241","first-page":"199","volume":"44","author":"Guo X","year":"2021","journal-title":"Inf Stud Theor Appl"},{"key":"bibr2-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.114"},{"key":"bibr3-01655515221136241","unstructured":"Sonnad N. The world\u2019s biggest meme is the word \u2018meme\u2019 itself, 2018, https:\/\/qz.com\/1324334\/memes-around-the-world-the-worlds-biggest-meme-is-the-word-meme-itself\/"},{"key":"bibr4-01655515221136241","first-page":"483","volume-title":"International conference on multidisciplinary social networks research","author":"Doong SH"},{"key":"bibr5-01655515221136241","first-page":"226","volume-title":"2019 8th international conference on affective computing and intelligent interaction workshops and demos (ACIIW)","author":"Fersini E"},{"key":"bibr6-01655515221136241","unstructured":"Mussumeci E, Coelho FC. Modeling news spread as an sir process over temporal networks. arXiv preprint arXiv:170107853, 2016."},{"key":"bibr7-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v8i1.14530"},{"key":"bibr8-01655515221136241","unstructured":"Sabat BO, Ferrer CC, Giro-i Nieto X. Hate speech in pixels: detection of offensive memes towards automatic moderation. arXiv preprint arXiv:191002334, 2019."},{"key":"bibr9-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.99"},{"key":"bibr10-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-018-9416-0"},{"key":"bibr11-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102170"},{"key":"bibr12-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1177\/1461444814568784"},{"key":"bibr13-01655515221136241","volume-title":"Optical character recognition","author":"Mori S","year":"1999"},{"key":"bibr14-01655515221136241","first-page":"629","volume-title":"Ninth international conference on document analysis and recognition (ICDAR 2007)","author":"Smith R"},{"key":"bibr15-01655515221136241","first-page":"188","volume-title":"Proceedings of the internet measurement conference","author":"Zannettou S"},{"key":"bibr16-01655515221136241","first-page":"1225","volume-title":"Proceedings of the 2018 world wide web conference","author":"Dubey A"},{"key":"bibr17-01655515221136241","first-page":"1","volume-title":"2017 international conference on computational intelligence in data science (ICCIDS)","author":"Priyashree S"},{"key":"bibr18-01655515221136241","first-page":"1","volume-title":"2018 third international conference on informatics and computing (ICIC)","author":"Amalia A"},{"key":"bibr19-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.150"},{"key":"bibr20-01655515221136241","first-page":"300","volume-title":"6th international conference on computational creativity (ICCC 2015)","author":"Costa D"},{"key":"bibr21-01655515221136241","first-page":"2611","volume":"33","author":"Kiela D","year":"2020","journal-title":"Adv Neur Inf Proc Syst"},{"key":"bibr22-01655515221136241","unstructured":"Groll E. How Russia hacked U.S. politics with Instagram marketing, 2018, https:\/\/foreignpolicy.com\/2018\/12\/17\/how-russia-hacked-us-politics-with-instagram-marketing\/"},{"key":"bibr23-01655515221136241","unstructured":"Devlin J, Chang MW, Lee K et al. Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprintarXiv:181004805 2018."},{"key":"bibr24-01655515221136241","unstructured":"Yang Z, Dai Z, Yang Y et al. XLNET: generalized autoregressive pretraining for language understanding. In: Neural information processing systems, 32. Curran Associates, https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/dc6a7e655d7e5840e66733e9ee67cc69-Paper.pdf"},{"key":"bibr25-01655515221136241","first-page":"4700","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Huang G"},{"key":"bibr26-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.107038"},{"key":"bibr27-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2017.2695218"},{"key":"bibr28-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2012.02.019"},{"key":"bibr29-01655515221136241","first-page":"713","volume-title":"2015 IEEE\/ACM international conference on advances in social networks analysis and mining (ASONAM)","author":"Dang A"},{"key":"bibr30-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2021.01.061"},{"key":"bibr31-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-010-0375-z"},{"issue":"2","key":"bibr32-01655515221136241","first-page":"49","volume":"32","author":"Fu J","year":"2018","journal-title":"J Chinese Inf Process"},{"key":"bibr33-01655515221136241","first-page":"1","volume-title":"2017 2nd international conference on computational systems and information technology for sustainable solution (CSITSS)","author":"Rayhan F"},{"key":"bibr34-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2008.2010275"},{"key":"bibr35-01655515221136241","unstructured":"Geitgey A. Face recognition, 2019, https:\/\/github.com\/ageitgey\/face_recognition"},{"key":"bibr36-01655515221136241","volume-title":"Programming computer vision with python: Tools and algorithms for analyzing images","author":"Solem JE","year":"2012"},{"key":"bibr37-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0686-2"},{"key":"bibr38-01655515221136241","unstructured":"Buitinck L, Louppe G, Blondel M et al. Api design for machine learning software: experiences from the scikit-learn project. Arxiv Preprint Arxiv:13090238, 2013."},{"key":"bibr39-01655515221136241","first-page":"770","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"He K"},{"key":"bibr40-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"bibr41-01655515221136241","unstructured":"Menon AK, Jayasumana S, Rawat AS et al. Long-tail learning via logit adjustment. arXiv preprintarXiv:200707314, 2021."},{"key":"bibr42-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.158"},{"key":"bibr43-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.160"},{"key":"bibr44-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.161"},{"key":"bibr45-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.151"},{"key":"bibr46-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.155"},{"key":"bibr47-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.102"},{"key":"bibr48-01655515221136241","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.148"},{"key":"bibr49-01655515221136241","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.07.034"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221136241","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515221136241","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221136241","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:09:55Z","timestamp":1777504195000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515221136241"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,27]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["10.1177\/01655515221136241"],"URL":"https:\/\/doi.org\/10.1177\/01655515221136241","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,27]]}}}