{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:44:36Z","timestamp":1760233476660,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T00:00:00Z","timestamp":1611187200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The appearance of images in social messages is continuously increasing, along with user engagement with that type of content. Analysis of social images can provide valuable latent information, often not present in the social posts. In that direction, a framework is proposed exploiting latent information from Twitter images, by leveraging the Google Cloud Vision API platform, aiming at enriching social analytics with semantics and hidden textual information. As validated by our experiments, social analytics can be further enriched by considering the combination of user-generated content, latent concepts, and textual data extracted from social images, along with linked data. Moreover, we employed word embedding techniques for investigating the usage of latent semantic information towards the identification of similar Twitter images, thereby showcasing that hidden textual information can improve such information retrieval tasks. Finally, we offer an open enhanced version of the annotated dataset described in this study with the aim of further adoption by the research community.<\/jats:p>","DOI":"10.3390\/info12020049","type":"journal-article","created":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T11:49:40Z","timestamp":1611229780000},"page":"49","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Latent Twitter Image Information for Social Analytics"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8504-3234","authenticated-orcid":false,"given":"Gerasimos","family":"Razis","sequence":"first","affiliation":[{"name":"Computer Science and Biomedical Informatics Department, University of Thessaly, 35131 Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georgios","family":"Theofilou","sequence":"additional","affiliation":[{"name":"School of Electrical &amp; Computer Engineering, National Technical University of Athens, 15780 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0832-0522","authenticated-orcid":false,"given":"Ioannis","family":"Anagnostopoulos","sequence":"additional","affiliation":[{"name":"Computer Science and Biomedical Informatics Department, University of Thessaly, 35131 Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,21]]},"reference":[{"key":"ref_1","unstructured":"Lee, K. (2020, November 21). How to Tweet\u2014New research on what drives engagement, Buffer. Available online: https:\/\/buffer.com\/resources\/twitter-data-1-million-tweets."},{"key":"ref_2","unstructured":"Vempala, A., and Preo\u0163iuc-Pietro, D. (August, January 28). Categorizing and Inferring the Relationship between the Text and Image of Twitter Posts. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_3","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv."},{"key":"ref_4","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. Distributed Representations of Words and Phrases and their Compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems\u2014Volume 2 (NIPS \u201813)."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Razis, G., Anagnostopoulos, I., and Saloun, P. (2016, January 20\u201321). Thematic Labeling of Twitter Accounts using DBpedia Properties. Proceedings of the 11th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), Thessaloniki, Greece.","DOI":"10.1109\/SMAP.2016.7753393"},{"key":"ref_6","unstructured":"Chen, T., Lu, D., Kan, M.-Y., and Cui, P. Understanding and Classifying Image Tweets. Proceedings of the 21st ACM International Conference on Multimedia (MM \u201913)."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ferwerda, B., and Tkalcic, M. (2018). Predicting Users\u2019 Personality from Instagram Pictures: Using Visual and\/or Content Features?. Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization (UMAP \u201918), Association for Computing Machinery.","DOI":"10.1145\/3209219.3209248"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Alfarrarjeh, A., Agrawal, S., Kim, S.H., and Shahabi, C. (2017, January 19\u201321). Geo-Spatial Multimedia Sentiment Analysis in Disasters. Proceedings of the 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Tokyo, Japan.","DOI":"10.1109\/DSAA.2017.77"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zannettou, S., Caulfield, T., Bradlyn, B., Cristofaro, E.D., Stringhini, G., and Blackburn, J. Characterizing the Use of Images in State-Sponsored Information Warfare Operations by Russian Trolls on Twitter. Proceedings of the 14th International AAAI Conference on Web and Social Media (ICWSM 2020).","DOI":"10.1609\/icwsm.v14i1.7342"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Boselli, R., Cesarini, M., Mercorio, F., Mezzanzanica, M., and Vaccarino, A. (2017, January 24\u201326). A Pipeline for Multimedia Twitter Analysis through Graph Databases: Preliminary Results. Proceedings of the 6th International Conference on Data Science, Technology and Applications (DATA), Madrid, Spain.","DOI":"10.5220\/0006490703430349"},{"key":"ref_11","unstructured":"Noaeen, M., and Far, B.H. Social Media Analysis for Traffic Management. Proceedings of the 14th International Conference on Global Software Engineering (ICGSE \u201919)."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"O\u2019Neal, A., Rodgers, B., Segler, J., Murthy, D., Lakuduva, N., Johnson, M., and Stephens, K.K. (2018, January 17\u201320). Training an Emergency-Response Image Classifier on Signal Data. 17th IEEE International Conference on Machine Learning and Applications (ICMLA). Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00119"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sakai, T., Tamura, K., Kitakami, H., and Takezawa, T. (2017, January 11\u201312). Photo Image Classification using Pre-trained Deep Network for Density-based Spatiotemporal Analysis System. Proceedings of the 2017 IEEE 10th International Workshop on Computational Intelligence and Applications (IWCIA), Hiroshima, Japan.","DOI":"10.1109\/IWCIA.2017.8203586"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sakaki, S., Miura, Y., Ma, X., Hattori, K., and Ohkuma, T. (2014, January 23). Twitter User Gender Inference Using Combined Analysis of Text and Image Processing. Proceedings of the Third Workshop on Vision and Language, Dublin, Ireland.","DOI":"10.3115\/v1\/W14-5408"},{"key":"ref_15","first-page":"108","article-title":"Twitter Sentiment Analysis with word2vec","volume":"8","author":"Hoai","year":"2019","journal-title":"Int. J. Adv. Res. Comput. Eng. Technol."},{"key":"ref_16","unstructured":"Li, Q., Shah, S., Liu, X., and Nourbakhsh, A. (2017, January 15\u201318). Data Sets: Word Embeddings Learned from Tweets and General Data. Proceedings of the Eleventh International Conference on Web and Social Media (ICWSM 2017), Montr\u00e9al, QC, Canada."},{"key":"ref_17","unstructured":"Arias, C.F., Z\u00fa\u00f1iga, J., Sidorov, G., Batyrshin, I.Z., and Gelbukh, A.F. (2017, January 11\u201314). A Tweets Classifier based on Cosine Similarity. Working Notes of CLEF 2017\u2014Conference and Labs of the Evaluation Forum, Dublin, Ireland."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jang, B., Kim, I., and Kim, J.W. (2019). Word2vec convolutional neural networks for classification of news articles and tweets. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0220976"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.procs.2018.01.092","article-title":"Using Tweets Embeddings for Hashtag Recommendation in Twitter","volume":"127","author":"Nfaoui","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"012006","DOI":"10.1088\/1742-6596\/976\/1\/012006","article-title":"Chinese Text Summarization Algorithm Based on Word2vec","volume":"976","author":"Chengzhang","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Orkpho, K., and Yang, W. (2019). Word Sense Disambiguation Using Cosine Similarity Collaborates with Word2vec and WordNet. Future Internet, 11.","DOI":"10.3390\/fi11050114"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.procs.2019.08.153","article-title":"Word2Vec Model Analysis for Semantic Similarities in English Words","volume":"157","author":"Jatnika","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kim, J., Hong, T., and Kim, P. (2019, January 8\u201312). Word2Vec based Spelling Correction Method of Twitter Message. Proceedings of 34th ACM\/SIGAPP Symposium on Applied Computing (SAC \u201819), Limassol, Cyprus.","DOI":"10.1145\/3297280.3297478"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1142\/S0218194017400113","article-title":"Mining Hidden Interests from Twitter Based on Word Similarity and Social Relationship for OLAP","volume":"27","author":"Yu","year":"2017","journal-title":"Int. J. Soft. Eng. Knowl. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.cities.2019.03.019","article-title":"Characterization of citizens using word2vec and latent topic analysis in a large set of tweets","volume":"92","author":"Camargo","year":"2019","journal-title":"Cities"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Razis, G., Theofilou, G., and Anagnostopoulos, I. (2020, January 29\u201330). Enriching Social Analytics with Latent Twitter Image Information. Proceedings of the 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), Zakynthos, Greece.","DOI":"10.1109\/SMAP49528.2020.9248464"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Razis, G., and Anagnostopoulos, I. (2014, January 6\u20137). Semantifying Twitter: The Influence Tracker Ontology. Proceedings of the 9th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), Corfu, Greece.","DOI":"10.1109\/SMAP.2014.23"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s42001-020-00094-5","article-title":"Misinformation, manipulation, and abuse on social media in the era of COVID-19","volume":"3","author":"Ferrara","year":"2020","journal-title":"J. Comput. Soc. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.engappai.2016.01.015","article-title":"Discovering similar Twitter accounts using semantics","volume":"51","author":"Razis","year":"2016","journal-title":"Eng. Appl. Artif. Intell."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/2\/49\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:13:40Z","timestamp":1760159620000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/2\/49"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,21]]},"references-count":29,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["info12020049"],"URL":"https:\/\/doi.org\/10.3390\/info12020049","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2021,1,21]]}}}