{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T21:40:04Z","timestamp":1729978804216,"version":"3.28.0"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T00:00:00Z","timestamp":1728345600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T00:00:00Z","timestamp":1728345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Life Robotics"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In communication, emotional information is crucial, yet its preservation in tweet embeddings remains a challenge. This study aims to address this gap by exploring three distinct methods for generating embedding vectors of tweets: word2vec models, pre-trained BERT models, and fine-tuned BERT models. We conducted an analysis to assess the degree to which emotional information is conserved in the resulting embedding vectors. Our findings indicate that the fine-tuned BERT model exhibits a higher level of preservation of emotional information compared to other methods. These results underscore the importance of utilizing advanced natural language processing techniques for preserving emotional context in text data, with potential implications for enhancing sentiment analysis and understanding human communication in social media contexts.<\/jats:p>","DOI":"10.1007\/s10015-024-00974-3","type":"journal-article","created":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T12:01:49Z","timestamp":1728388909000},"page":"486-493","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Preservation of emotional context in tweet embeddings on social networking sites"],"prefix":"10.1007","volume":"29","author":[{"given":"Osamu","family":"Maruyama","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asato","family":"Yoshinaga","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ken-ichi","family":"Sawai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,8]]},"reference":[{"key":"974_CR1","doi-asserted-by":"publisher","unstructured":"Bahdanau D, Cho K, Bengio Y (2014). Neural machine translation by jointly learning to align and translate. https:\/\/doi.org\/10.1016\/j.jneumeth.2010.04.011","DOI":"10.1016\/j.jneumeth.2010.04.011"},{"key":"974_CR2","unstructured":"cl-tohoku (2020) Bert base Japanese (IPA dictionary, whole word masking enabled). https:\/\/huggingface.co\/cl-tohoku\/bert-base-japanese-whole-word-masking"},{"issue":"2","key":"974_CR3","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","volume":"PAMI\u20131","author":"DL Davies","year":"1979","unstructured":"Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans Pattern Anal Mach Intell PAMI\u20131(2):224\u2013227. https:\/\/doi.org\/10.1109\/TPAMI.1979.4766909","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"974_CR4","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805v2"},{"key":"974_CR5","first-page":"45","volume-title":"Basic emotions. Chap.\u00a03","author":"P Ekman","year":"1999","unstructured":"Ekman P (1999) Basic emotions. Chap.\u00a03. Wiley, Hoboken, pp 45\u201360"},{"key":"974_CR6","doi-asserted-by":"publisher","unstructured":"Kajiwara T, Chu C, Takemura N, Nakashima Y, Nagahara H (2021) WRIME: a new dataset for emotional intensity estimation with subjective and objective annotations. In: Proceedings of the 2021 conference of the North American chapter of the Association for computational linguistics: human language technologies. Association for Computational Linguistics, Online. pp 2095\u20132104. https:\/\/doi.org\/10.18653\/v1\/2021.naacl-main.169","DOI":"10.18653\/v1\/2021.naacl-main.169"},{"key":"974_CR7","doi-asserted-by":"publisher","unstructured":"Kim Y (2014). Convolutional neural networks for sentence classification. https:\/\/doi.org\/10.3115\/v1\/D14-1181","DOI":"10.3115\/v1\/D14-1181"},{"key":"974_CR8","unstructured":"Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: Proceedings of the 31st international conference on machine learning, 32. pp 1188\u20131196. PMLR"},{"issue":"7553","key":"974_CR9","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y Lecun","year":"2015","unstructured":"Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"issue":"29","key":"974_CR10","doi-asserted-by":"publisher","first-page":"861","DOI":"10.21105\/joss.00861","volume":"3","author":"L McInnes","year":"2018","unstructured":"McInnes L, Healy J, Saul N, Gro\u00dfberger L (2018) UMAP: uniform manifold approximation and projection. J Open Source Softw 3(29):861","journal-title":"J Open Source Softw"},{"key":"974_CR11","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. https:\/\/arxiv.org\/abs\/1301.3781"},{"key":"974_CR12","doi-asserted-by":"crossref","unstructured":"Mohammad S, Bravo-Marquez F, Salameh M, Kiritchenko S (2018) Semeval-2018 task 1: affect in tweets. In: Proceedings of the 12th international workshop on semantic evaluation, pp 1-17","DOI":"10.18653\/v1\/S18-1001"},{"key":"974_CR13","first-page":"3","volume-title":"Emotion: theory, research and experience. Theories of emotion","author":"R Plutchik","year":"1980","unstructured":"Plutchik R (1980) Chap.\u00a01. A general psychoevolutionary theory of emotion. In: Plutchik R, Kellerman H (eds) Emotion: theory, research and experience. Theories of emotion, vol I. Academic Press, New York, pp 3\u201333"},{"key":"974_CR14","doi-asserted-by":"publisher","first-page":"842","DOI":"10.1162\/tacl_a_00349","volume":"8","author":"A Rogers","year":"2020","unstructured":"Rogers A, Kovaleva O, Rumshisky A (2020) A primer in BERTology: what we know about how BERT works. Trans Assoc Comput Linguist 8:842\u2013866","journal-title":"Trans Assoc Comput Linguist"},{"key":"974_CR15","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","volume":"20","author":"PJ Rousseeuw","year":"1987","unstructured":"Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Comput Appl Math 20:53\u201365. https:\/\/doi.org\/10.1016\/0377-0427(87)90125-7","journal-title":"Comput Appl Math"},{"key":"974_CR16","doi-asserted-by":"publisher","unstructured":"Seo M, Kembhavi A, Farhadi A, Hajishirzi H (2016). Bidirectional attention flow for machine comprehension. https:\/\/doi.org\/10.18653\/v1\/N16-1014","DOI":"10.18653\/v1\/N16-1014"},{"key":"974_CR17","unstructured":"Taku Kudo: MeCab: yet another part-of-speech and morphological analyzer. https:\/\/taku910.github.io\/mecab\/"}],"container-title":["Artificial Life and Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-00974-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10015-024-00974-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10015-024-00974-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T21:03:34Z","timestamp":1729976614000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10015-024-00974-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,8]]},"references-count":17,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["974"],"URL":"https:\/\/doi.org\/10.1007\/s10015-024-00974-3","relation":{},"ISSN":["1433-5298","1614-7456"],"issn-type":[{"type":"print","value":"1433-5298"},{"type":"electronic","value":"1614-7456"}],"subject":[],"published":{"date-parts":[[2024,10,8]]},"assertion":[{"value":"1 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 September 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}