{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T17:51:05Z","timestamp":1771523465070,"version":"3.50.1"},"reference-count":32,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":108,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>Millions of memes are created and shared every day on social media platforms. Memes are a great tool to spread humour. However, some people use it to target an individual or a group generating offensive content in a polite and sarcastic way. Lack of moderation of such memes spreads hatred and can lead to depression like psychological conditions. Many successful studies related to analysis of language such as sentiment analysis and analysis of images such as image classification have been performed. However, most of these studies rely only upon either one of these components. As classifying meme is one problem which cannot be solved by relying upon only any one of these aspects, the present work identifies, addresses, and ensembles both the aspects for analyzing such data. In this research, we propose a solution to the problems in which the classification depends on more than one model. This paper proposes two different approaches to solve the problem of identifying hate memes. The first approach uses sentiment analysis based on image captioning and text written on the meme. The second approach is to combine features from different modalities. These approaches utilize a combination of glove, encoder\u2010decoder, and OCR with Adamax optimizer deep learning algorithms. Facebook Challenge Hateful Meme Dataset is utilized which contains approximately 8500 meme images. Both the approaches are implemented on the live challenge competition by Facebook and predicted quite acceptable results. Both approaches are tested on the validation dataset, and results are found to be promising for both models.<\/jats:p>","DOI":"10.1155\/2021\/5510253","type":"journal-article","created":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T21:37:30Z","timestamp":1618868250000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Two\u2010Way Feature Extraction Using Sequential and Multimodal Approach for Hateful Meme Classification"],"prefix":"10.1155","volume":"2021","author":[{"given":"Apeksha","family":"Aggarwal","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vibhav","family":"Sharma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anshul","family":"Trivedi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mayank","family":"Yadav","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chirag","family":"Agrawal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dilbag","family":"Singh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vipul","family":"Mishra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5643-134X","authenticated-orcid":false,"given":"Hass\u00e8ne","family":"Gritli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2021,4,19]]},"reference":[{"key":"e_1_2_10_1_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/9789431"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/5283471"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/4608647"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.2174\/2213275912666190429152319"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/2059075"},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7243296"},{"key":"e_1_2_10_7_2","unstructured":"MaasA. DalyR. E. PhamP. T. HuangD. NgA. Y. andPottsC. Learning word vectors for sentiment analysis Proceedings of the 49th Annual Meeting Of The Association for Computational Linguistics: Human Language Technologies June 2011 Portland OR USA 142\u2013150."},{"key":"e_1_2_10_8_2","doi-asserted-by":"crossref","unstructured":"YouQ. JinH. WangZ. FangC. andLuoJ. Image captioning with semantic attention Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2016 Las Vegas NV USA 4651\u20134659.","DOI":"10.1109\/CVPR.2016.503"},{"key":"e_1_2_10_9_2","doi-asserted-by":"crossref","unstructured":"AndersonP. HeX. BuehlerCet al. Bottom-up and top-down attention for image captioning and visual question answering Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2018 New York NY USA.","DOI":"10.1109\/CVPR.2018.00636"},{"key":"e_1_2_10_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-50252-6_2"},{"key":"e_1_2_10_11_2","unstructured":"WickC. ReulC. andPuppeF. Calamari-a high-performance tensorflow-based deep learning package for optical character recognition 2018 https:\/\/arxiv.org\/abs\/1807.02004."},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-015-0195-2"},{"key":"e_1_2_10_13_2","doi-asserted-by":"crossref","unstructured":"KhorramiP. Le PaineT. BradyK. DagliC. andHuangT. S. How deep neural networks can improve emotion recognition on video data IEEE International Conference on Image Processing (ICIP) September 2016 Phoenix AZ USA.","DOI":"10.1109\/ICIP.2016.7532431"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/5093620"},{"key":"e_1_2_10_15_2","doi-asserted-by":"publisher","DOI":"10.14419\/ijet.v7i2.7.10892"},{"key":"e_1_2_10_16_2","doi-asserted-by":"crossref","unstructured":"LinT. Y. Doll\u00e1rP. GirshickR. HeK. HariharanB. andBelongieS. Feature pyramid networks for object detection Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition July 2017 Honolulu HI USA 2117\u20132125.","DOI":"10.1109\/CVPR.2017.106"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-12568-8_98"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.5121\/csit.2014.4910"},{"key":"e_1_2_10_19_2","article-title":"Robust real-time object detection","volume":"4","author":"Viola P.","year":"2001","journal-title":"International Journal of Computer Vision"},{"key":"e_1_2_10_20_2","unstructured":"Hateful Memes Challenge and dataset for research on harmful multimodal content https:\/\/ai.facebook.com\/blog\/hateful-memes-challenge-and-data-set\/."},{"key":"e_1_2_10_21_2","unstructured":"fastText: Facebook Open Source.https:\/\/fasttext.cc\/."},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7130146"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1504\/ijhm.2019.102893"},{"key":"e_1_2_10_24_2","unstructured":"Tensorflow documentation:https:\/\/www.tensorflow.org\/api_docs\/python\/tf\/keras\/applications\/ResNet152."},{"key":"e_1_2_10_25_2","doi-asserted-by":"publisher","DOI":"10.1504\/ijhm.2019.098951"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1049\/trit.2019.0051"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1049\/trit.2018.1006"},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1504\/ijhm.2019.098949"},{"key":"e_1_2_10_29_2","doi-asserted-by":"publisher","DOI":"10.1049\/trit.2019.0028"},{"key":"e_1_2_10_30_2","unstructured":"TesseractO. C. R. Google Open Source.https:\/\/opensource.google\/projects\/tesseract."},{"key":"e_1_2_10_31_2","unstructured":"MemesH. Phase 2: Facebook 2021 https:\/\/www.drivendata.org\/competitions\/70\/hateful-memes-phase-2\/."},{"key":"e_1_2_10_32_2","unstructured":"PackageP. Torch Optim 2021 https:\/\/pytorch.org\/docs\/stable\/optim.html."}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2021\/5510253.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2021\/5510253.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/5510253","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T23:26:45Z","timestamp":1723246005000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/5510253"}},"subtitle":[],"editor":[{"given":"M. Irfan","family":"Uddin","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/5510253"],"URL":"https:\/\/doi.org\/10.1155\/2021\/5510253","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"value":"1076-2787","type":"print"},{"value":"1099-0526","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2021-02-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"5510253"}}