{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T10:28:41Z","timestamp":1776940121750,"version":"3.51.4"},"reference-count":103,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T00:00:00Z","timestamp":1671062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Hashtags have been an integral element of social media platforms over the years and are widely used by users to promote, organize and connect users. Despite the intensive use of hashtags, there is no basis for using congruous tags, which causes the creation of many unrelated contents in hashtag searches. The presence of mismatched content in the hashtag creates many problems for individuals and brands. Although several methods have been presented to solve the problem by recommending hashtags based on the users\u2019 interest, the detection and analysis of the characteristics of these repetitive contents with irrelevant hashtags have rarely been addressed. To this end, we propose a novel hybrid deep learning hashtag incongruity detection by fusing visual and textual modality. We fine-tune BERT and ResNet50 pre-trained models to encode textual and visual information to encode textual and visual data simultaneously. We further attempt to show the capability of logo detection and face recognition in discriminating images. To extract faces, we introduce a pipeline that ranks faces based on the number of times they appear on Instagram accounts using face clustering. Moreover, we conduct our analysis and experiments on a dataset of Instagram posts that we collect from hashtags related to brands and celebrities. Unlike the existing works, we analyze these contents from both content and user perspectives and show a significant difference between data. In light of our results, we show that our multimodal model outperforms other models and the effectiveness of object detection in detecting mismatched information.<\/jats:p>","DOI":"10.3390\/s22249870","type":"journal-article","created":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T04:54:14Z","timestamp":1671080054000},"page":"9870","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Novel Hybrid Multi-Modal Deep Learning for Detecting Hashtag Incongruity on Social Media"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2420-7407","authenticated-orcid":false,"given":"Sajad","family":"Dadgar","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran 15875-4413, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9537-9513","authenticated-orcid":false,"given":"Mehdi","family":"Neshat","sequence":"additional","affiliation":[{"name":"Adjunct Research Fellow at Center for Artificial Intelligence Research and Optimization, Torrens University Australia, Brisbane, QLD 4006, Australia"},{"name":"Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW 2007, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s40685-016-0027-6","article-title":"The effect of social media interactions on customer relationship management","volume":"9","author":"Maecker","year":"2016","journal-title":"Bus. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fatichah, C., Lazuardi, W.F., Navastara, D.A., Suciati, N., and Munif, A. (2019). Image spam detection on Instagram using Convolutional Neural Network. Intelligent and Interactive Computing, Springer.","DOI":"10.1007\/978-981-13-6031-2_19"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1080\/02650487.2017.1368859","article-title":"# Me and brands: Understanding brand-selfie posters on social media","volume":"37","author":"Sung","year":"2018","journal-title":"Int. J. Advert."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1177\/00027162221084709","article-title":"Defining and measuring scientific misinformation","volume":"700","author":"Southwell","year":"2022","journal-title":"Ann. Am. Acad. Political Soc. Sci."},{"key":"ref_5","first-page":"6","article-title":"Integration of Computer Vision and natural language processing in multimedia robotics application","volume":"7","author":"Shahin","year":"2022","journal-title":"Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1089\/cyber.2015.0157","article-title":"Pictures speak louder than words: Motivations for using Instagram","volume":"18","author":"Lee","year":"2015","journal-title":"Cyberpsychol. Behav. Soc. Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e2143096","DOI":"10.1001\/jamanetworkopen.2021.43096","article-title":"Influence at the Intersection of Social Media and Celebrity","volume":"5","author":"Selkie","year":"2022","journal-title":"JAMA Netw. Open"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1177\/1065912918786805","article-title":"Images that matter: Online protests and the mobilizing role of pictures","volume":"72","author":"Casas","year":"2019","journal-title":"Political Res. Q."},{"key":"ref_9","first-page":"1","article-title":"Impact of Advertisement on the Development of Brand Image","volume":"1","author":"Jaulkar","year":"2022","journal-title":"SSRN Electron. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"250595","DOI":"10.51359\/2526-7884.2022.250595","article-title":"The Impact of Product Tagging on Trust and Purchase Intention: A cross-cultural perspective in visual e-commerce","volume":"6","author":"Broeder","year":"2022","journal-title":"CBR-Consum. Behav. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5922967","DOI":"10.1155\/2022\/5922967","article-title":"A Brand Image Design Service Model Using the Visual Communication Technology under the Background of Internationalization","volume":"2022","author":"Fu","year":"2022","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1287\/mksc.2020.1226","article-title":"Visual listening in: Extracting brand image portrayed on social media","volume":"39","author":"Liu","year":"2020","journal-title":"Mark. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Paolanti, M., Kaiser, C., Schallner, R., Frontoni, E., and Zingaretti, P. (2017). Visual and textual sentiment analysis of brand-related social media pictures using deep Convolutional Neural Networks. Image Analysis and Processing\u2014ICIAP 2017, Springer.","DOI":"10.1007\/978-3-319-68560-1_36"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Apostolova, E., and Tomuro, N. (2014, January 25\u201329). Combining visual and textual features for information extraction from online flyers. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1206"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"17","DOI":"10.17706\/IJCCE.2021.10.1.17-27","article-title":"Deep LSTM for Generating Brand Personalities Using Social Media: A Case Study from Higher Education Institutions","volume":"10","author":"Wijenayake","year":"2021","journal-title":"Int. J. Comput. Commun. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1007\/s11634-020-00429-0","article-title":"Predicting brand confusion in imagery markets based on deep learning of visual advertisement content","volume":"14","author":"Nakayama","year":"2020","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"27123","DOI":"10.1007\/s11042-018-5910-z","article-title":"Automated curation of brand-related social media images with deep learning","volume":"77","author":"Tous","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1108\/JPBM-02-2020-2757","article-title":"How endorser-product congruity and self-expressiveness affect Instagram micro-celebrities\u2019 native advertising effectiveness","volume":"31","author":"Lee","year":"2021","journal-title":"J. Prod. Brand Manag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"106443","DOI":"10.1016\/j.chb.2020.106443","article-title":"The effects of visual congruence on increasing consumers\u2019 brand engagement: An empirical investigation of influencer marketing on Instagram using deep-learning algorithms for automatic image classification","volume":"112","author":"Argyris","year":"2020","journal-title":"Comput. Hum. Behav."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Strycharz, J., van Noort, G., Smit, E., and Helberger, N. (2019). Consumer view on personalized advertising: Overview of self-reported benefits and concerns. Advances in Advertising Research X, Springer Gabler.","DOI":"10.1007\/978-3-658-24878-9_5"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hong, T., Choi, J.A., Lim, K., and Kim, P. (2020). Enhancing personalized ads using interest category classification of SNS users based on deep neural networks. Sensors, 21.","DOI":"10.3390\/s21010199"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1080\/00913367.2020.1843091","article-title":"Automatically detecting image\u2013text mismatch on Instagram with deep learning","volume":"50","author":"Ha","year":"2020","journal-title":"J. Advert."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"020134","DOI":"10.1063\/5.0074501","article-title":"Characteristic based spam detection system to reveal the mock appraise in online social media","volume":"2393","author":"Sirija","year":"2022","journal-title":"Aip Conf. Proc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"20539517211022370","DOI":"10.1177\/20539517211022370","article-title":"Visual media analysis for Instagram and other online platforms","volume":"8","author":"Rogers","year":"2021","journal-title":"Big Data Soc."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Alorini, D., and Rawat, D.B. (2019, January 18\u201321). Automatic spam detection on gulf dialectical Arabic Tweets. Proceedings of the 2019 International Conference on Computing, Networking and Communications (ICNC), Honolulu, HI, USA.","DOI":"10.1109\/ICCNC.2019.8685659"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Alsini, A., Huynh, D.Q., and Datta, A. (2021). Hashtag Recommendation Methods for Twitter and Sina Weibo: A Review. Future Int., 13.","DOI":"10.3390\/fi13050129"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s10115-020-01515-7","article-title":"Hashtag recommendation for short social media texts using word-embeddings and external knowledge","volume":"63","author":"Kumar","year":"2021","journal-title":"Knowl. Inf. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bhaskar, R., and Bansal, A. (2022, January 27\u201328). Implementing Prioritized-Breadth-First-Search for Instagram Hashtag Recommendation. Proceedings of the 2022 12th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Noida, India.","DOI":"10.1109\/Confluence52989.2022.9734217"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.neucom.2020.01.091","article-title":"Tag recommendation by text classification with attention-based capsule network","volume":"391","author":"Lei","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hachaj, T., and Miazga, J. (2020). Image hashtag recommendations using a voting deep neural network and associative rules mining approach. Entropy, 22.","DOI":"10.3390\/e22121351"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.future.2015.10.012","article-title":"A personalized hashtag recommendation approach using LDA-based topic model in microblog environment","volume":"65","author":"Zhao","year":"2016","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TCSS.2020.2988983","article-title":"On utilizing communities detected from social networks in hashtag recommendation","volume":"7","author":"Alsini","year":"2020","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bansal, S., Gowda, K., and Kumar, N. (2022). A Hybrid Deep Neural Network for Multimodal Personalized Hashtag Recommendation. IEEE Trans. Comput. Soc. Syst.","DOI":"10.1109\/TCSS.2022.3184307"},{"key":"ref_34","first-page":"386","article-title":"Brand Analysis in Social Networks Using Deep Learning Techniques","volume":"27","author":"Fatma","year":"2021","journal-title":"Avrupa Bilim Teknol. Derg."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1177\/1532673X17725864","article-title":"Complex thinking as a result of incongruent information exposure","volume":"46","author":"Erisen","year":"2018","journal-title":"Am. Politics Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"102585","DOI":"10.1016\/j.jretconser.2021.102585","article-title":"Building influencers\u2019 credibility on Instagram: Effects on followers\u2019 attitudes and behavioral responses toward the influencer","volume":"61","author":"Belanche","year":"2021","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1080\/02650487.2020.1801198","article-title":"The effect of influencer\u2013product fit on advertising recognition and the role of an enhanced disclosure in increasing sponsorship transparency","volume":"40","author":"Iacobucci","year":"2021","journal-title":"Int. J. Advert."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"329","DOI":"10.3758\/BF03202511","article-title":"Discrepancy detection and vulnerability to misleading postevent information","volume":"14","author":"Tousignant","year":"1986","journal-title":"Mem. Cogn."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2236","DOI":"10.1016\/j.procs.2020.03.276","article-title":"Deep neural approach to Fake-News identification","volume":"167","author":"Deepak","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Park, K., Kim, T., Yoon, S., Cha, M., and Jung, K. (2020). BaitWatcher: A lightweight web interface for the detection of incongruent news headlines. Disinformation, Misinformation and Fake News in Social Media, Springer.","DOI":"10.1007\/978-3-030-42699-6_12"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"116866","DOI":"10.1016\/j.eswa.2022.116866","article-title":"Detecting incongruent news headlines with auxiliary textual information","volume":"199","author":"Jang","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Mishra, R., Yadav, P., Calizzano, R., and Leippold, M. (2020, January 14\u201317). MuSeM: Detecting incongruent news headlines using mutual attentive semantic matching. Proceedings of the 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA.","DOI":"10.1109\/ICMLA51294.2020.00116"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3309699","article-title":"The web of false information: Rumors, fake news, hoaxes, clickbait, and various other shenanigans","volume":"11","author":"Zannettou","year":"2019","journal-title":"J. Data Inf. Qual. (JDIQ)"},{"key":"ref_44","first-page":"105","article-title":"False Information as a Threat to Modern Society: A Systematic Review of False Information, Its Impact on Society and Current Remedies","volume":"21","author":"Ahmed","year":"2022","journal-title":"J. Inf. Warf."},{"key":"ref_45","first-page":"2056305120935102","article-title":"Misinformation on Instagram: The impact of trusted endorsements on message credibility","volume":"6","author":"Mena","year":"2020","journal-title":"Soc. Media+ Soc."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Shahzad, H.F., Rustam, F., Flores, E.S., Lu\u00eds Vidal Maz\u00f3n, J., de la Torre Diez, I., and Ashraf, I. (2022). A Review of Image Processing Techniques for Deepfakes. Sensors, 22.","DOI":"10.3390\/s22124556"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/TBIOM.2021.3065735","article-title":"Fighting fake news: Two stream network for deepfake detection via learnable SRM","volume":"3","author":"Han","year":"2021","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Xarhoulacos, C.G., Anagnostopoulou, A., Stergiopoulos, G., and Gritzalis, D. (2021). Misinformation vs. Situational Awareness: The Art of Deception and the Need for Cross-Domain Detection. Sensors, 21.","DOI":"10.3390\/s21165496"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1109\/JBHI.2020.3037027","article-title":"Detecting medical misinformation on social media using multimodal deep learning","volume":"25","author":"Wang","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Mir\u00f3-Llinares, F., and Aguerri, J.C. (2021). Misinformation about fake news: A systematic critical review of empirical studies on the phenomenon and its status as a \u2018threat\u2019. Eur. J. Criminol., 1\u201319.","DOI":"10.1177\/1477370821994059"},{"key":"ref_51","first-page":"429","article-title":"An Efficient Method for Detection of Fake Accounts on the Instagram Platform","volume":"34","author":"Sheikhi","year":"2020","journal-title":"Rev. D\u2019Intell. Artif."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Akyon, F.C., and Kalfaoglu, M.E. (November, January 31). Instagram fake and automated account detection. Proceedings of the 2019 Innovations in Intelligent Systems and Applications Conference (ASYU), Izmir, Turkey.","DOI":"10.1109\/ASYU48272.2019.8946437"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.jbusres.2020.11.037","article-title":"Fake news, social media and marketing: A systematic review","volume":"124","author":"Sit","year":"2021","journal-title":"J. Bus. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1007\/s10462-019-09697-5","article-title":"Deceptive consumer review detection: A survey","volume":"53","author":"Vidanagama","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Zhang, W., Deng, Y., Ma, J., and Lam, W. (2020, January 16\u201320). AnswerFact: Fact checking in product question answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.188"},{"key":"ref_56","unstructured":"Tainter, J.A., Taylor, T.G., Brain, R., and Lobo, J. (2015). Emerging Trends in the Social and Behavioral Sciences: An Interdisciplinary, Searchable and Linkable Resource, John Wiley & Sons."},{"key":"ref_57","first-page":"384","article-title":"Survey on internet spam: Classification and analysis","volume":"4","author":"Geerthik","year":"2013","journal-title":"Int. J. Comput. Technol. Appl."},{"key":"ref_58","first-page":"1862888","article-title":"Machine learning techniques for spam detection in email and IoT platforms: Analysis and research challenges","volume":"2022","author":"Ahmed","year":"2022","journal-title":"Secur. Commun. Net."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"109","DOI":"10.21108\/INDOJC.2019.4.1.284","article-title":"Study on the effect of preprocessing methods for spam email detection","volume":"4","author":"Ruskanda","year":"2019","journal-title":"Indones. J. Comput. (Indo-JC)"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Shang, E.X., and Zhang, H.G. (2016, January 10\u201313). Image spam classification based on Convolutional Neural Network. Proceedings of the 2016 International Conference on Machine Learning and Cybernetics (ICMLC), Jeju, Korea.","DOI":"10.1109\/ICMLC.2016.7860934"},{"key":"ref_61","first-page":"226","article-title":"Image SPAM Detection Using ML and DL Techniques","volume":"14","author":"Abuzaid","year":"2022","journal-title":"Int. J. Adv. Soft. Compu. Appl."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Gargiulo, F., and Sansone, C. (2008, January 8\u201311). Combining visual and textual features for filtering spam emails. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761828"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10586-017-1615-8","article-title":"Visual and textual features based email spam classification using S-Cuckoo search and hybrid kernel Support Vector Machine","volume":"22","author":"Kumaresan","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Seth, S., and Biswas, S. (2017, January 4\u20137). Multimodal spam classification using deep learning techniques. Proceedings of the 2017 13th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Jaipur, India.","DOI":"10.1109\/SITIS.2017.91"},{"key":"ref_65","first-page":"2642","article-title":"Critical evaluation on spam content detection in social media","volume":"100","author":"Chrismanto","year":"2022","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"263","DOI":"10.22146\/ijccs.47046","article-title":"Detection of Spam Comments on Instagram Using Complementary Na\u00efve Bayes","volume":"13","author":"Haqimi","year":"2019","journal-title":"IJCCS (Indones. J. Comput. Cybern. Syst.)"},{"key":"ref_67","first-page":"1","article-title":"Image spam detection using machine learning and natural language processing","volume":"55","author":"Yaseen","year":"2020","journal-title":"J. Southwest Jiaotong Univ."},{"key":"ref_68","first-page":"1889","article-title":"Execution Assessment of Machine Learning Algorithms for Spam Profile Detection on Instagram","volume":"10","author":"Raza","year":"2021","journal-title":"Int. J."},{"key":"ref_69","unstructured":"Fahfouh, A., Riffi, J., Mahraz, M.A., Yahyaouy, A., and Tairi, H. (2022). A Contextual Relationship Model for Deceptive Opinion Spam Detection. IEEE Trans. Neural Net. Learn. Syst., 1\u201312."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"381","DOI":"10.21275\/ART20203995","article-title":"Machine learning algorithms-a review","volume":"9","author":"Mahesh","year":"2020","journal-title":"Int. J. Sci. Res. (IJSR)"},{"key":"ref_71","first-page":"012148","article-title":"A comparison of traditional machine learning and deep learning in image recognition","volume":"1314","author":"Lai","year":"2019","journal-title":"J. Phys."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Peng, Y. (2021). Image clustering: An unsupervised approach to categorize visual data in social science research. Sociol. Methods Res., 00491241221082603.","DOI":"10.31235\/osf.io\/mw57x"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Mredula, M.S., Dey, N., Rahman, M.S., Mahmud, I., and Cho, Y.-Z. (2022). A Review on the Trends in Event Detection by Analyzing Social Media Platforms\u2019 Data. Sensors, 22.","DOI":"10.3390\/s22124531"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"6999","DOI":"10.1109\/TNNLS.2021.3084827","article-title":"A survey of Convolutional Neural Networks: Analysis, applications, and prospects","volume":"33","author":"Li","year":"2021","journal-title":"IEEE Trans. Neural Net. Learn. Syst."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"5929","DOI":"10.1007\/s10462-020-09838-1","article-title":"A review on the long short-term memory model","volume":"53","author":"Mosquera","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_76","first-page":"139","article-title":"Natural language processing (NLP) in management research: A literature review","volume":"7","author":"Kang","year":"2020","journal-title":"J. Manag. Anal."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3295748","article-title":"A comprehensive survey of deep learning for image captioning","volume":"51","author":"Hossain","year":"2019","journal-title":"ACM Comput. Surv. (CsUR)"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Bakkali, S., Ming, Z., Coustaty, M., and Rusi\u00f1ol, M. (2020, January 14\u201319). Visual and textual deep feature fusion for document image classification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00289"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.cviu.2017.06.005","article-title":"Visual question answering: Datasets, algorithms and future challenges","volume":"163","author":"Kafle","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Seeland, M., and M\u00e4der, P. (2021). Multi-view classification with Convolutional Neural Networks. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0245230"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"18473","DOI":"10.1007\/s00521-022-07454-4","article-title":"Adam or Eve? Automatic users\u2019 gender classification via gestures analysis on touch devices","volume":"34","author":"Guarino","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"36","DOI":"10.24297\/jal.v11i.8655","article-title":"Impoliteness in Indonesian language hate speech on social media contained in the Instagram account","volume":"11","author":"Subyantoro","year":"2020","journal-title":"J. Adv. Linguist."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"155961","DOI":"10.1109\/ACCESS.2020.3019600","article-title":"Lies kill, facts save: Detecting COVID-19 misinformation in Twitter","volume":"8","year":"2020","journal-title":"IEEE Access"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/TCSS.2016.2517458","article-title":"Rumor identification in microblogging systems based on users\u2019 behavior","volume":"2","author":"Liang","year":"2015","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/TCSS.2016.2516039","article-title":"A performance evaluation of machine learning-based streaming spam tweets detection","volume":"2","author":"Chen","year":"2015","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_86","first-page":"3666","article-title":"Review on optical character recognition","volume":"6","author":"Awel","year":"2019","journal-title":"Int. Res. J. Eng. Technol. (IRJET)"},{"key":"ref_87","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1162\/neco_a_00990","article-title":"Deep Convolutional Neural Networks for image classification: A comprehensive review","volume":"29","author":"Rawat","year":"2017","journal-title":"Neural Comput."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Mascarenhas, S., and Agarwal, M. (2021, January 19\u201321). A comparison between VGG16, VGG19 and ResNet50 architecture frameworks for Image Classification. Proceedings of the 2021 International Conference on Disruptive Technologies for Multi-Disciplinary Research and Applications (CENTCON), Bengaluru, India.","DOI":"10.1109\/CENTCON52345.2021.9687944"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Kruk, J., Lubin, J., Sikka, K., Lin, X., Jurafsky, D., and Divakaran, A. (2019). Integrating text and image: Determining multimodal document intent in Instagram posts. arXiv.","DOI":"10.18653\/v1\/D19-1469"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NA, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 15). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_96","first-page":"1","article-title":"A content analysis of celebrity Instagram posts and parasocial interaction","volume":"7","author":"Ward","year":"2016","journal-title":"Elon J. Undergrad. Res. Commun."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1057\/pb.2016.3","article-title":"Analysing the complex relationship between logo and brand","volume":"13","author":"Kelly","year":"2017","journal-title":"Place Brand. Public Dipl."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Net."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"124623","DOI":"10.1016\/j.energy.2022.124623","article-title":"Wave power forecasting using an effective decomposition-based convolutional Bi-directional model with equilibrium Nelder-Mead optimiser","volume":"256","author":"Neshat","year":"2022","journal-title":"Energy"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"115590","DOI":"10.1016\/j.enconman.2022.115590","article-title":"Quaternion convolutional long short-term memory neural model with an adaptive decomposition method for wind speed forecasting: North aegean islands case studies","volume":"259","author":"Neshat","year":"2022","journal-title":"Energy Convers. Manag."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9870\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:41:50Z","timestamp":1760146910000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9870"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,15]]},"references-count":103,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249870"],"URL":"https:\/\/doi.org\/10.3390\/s22249870","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,15]]}}}