{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:40:43Z","timestamp":1770918043787,"version":"3.50.1"},"reference-count":79,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T00:00:00Z","timestamp":1677801600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T00:00:00Z","timestamp":1677801600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"crossref","award":["273478"],"award-info":[{"award-number":["273478"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]},{"name":"University of Helsinki including Helsinki University Central Hospital"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Sentiment analysis and opinion mining are essential tasks with many prominent application areas, e.g., when researching popular opinions on products or brands. Sentiments expressed in social media can be used in brand name monitoring and indicating fake news. In our survey of previous work, we note that there is no large-scale social media data set with sentiment polarity annotations for Finnish. This publication aims to remedy this shortcoming by introducing a 27,000-sentence data set annotated independently with sentiment polarity by three native annotators. We had three annotators annotate the whole data set, which provides a unique opportunity for further studies of annotator behavior over the sample annotation order. We analyze their inter-annotator agreement and provide two baselines to validate the usefulness of the data set.<\/jats:p>","DOI":"10.1007\/s10579-023-09644-5","type":"journal-article","created":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T04:29:16Z","timestamp":1677817756000},"page":"581-609","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["FinnSentiment: a Finnish social media corpus for sentiment polarity annotation"],"prefix":"10.1007","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2337-303X","authenticated-orcid":false,"given":"Krister","family":"Lind\u00e9n","sequence":"first","affiliation":[]},{"given":"Tommi","family":"Jauhiainen","sequence":"additional","affiliation":[]},{"given":"Sam","family":"Hardwick","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,3]]},"reference":[{"key":"9644_CR1","doi-asserted-by":"crossref","unstructured":"Abdul-Mageed, M., & Ungar, L. (2017). Emonet: Fine-grained emotion detection with gated recurrent neural networks. In Proceedings of the 55th annual meeting of the association for computational linguistics (volume 1: Long papers) (pp. 718\u2013728).","DOI":"10.18653\/v1\/P17-1067"},{"issue":"1\u20132","key":"9644_CR2","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1504\/IJBDI.2014.063845","volume":"1","author":"NA Abdulla","year":"2014","unstructured":"Abdulla, N. A., Al-Ayyoub, M., & Al-Kabi, M. N. (2014). An extended analytical study of arabic sentiments. International Journal of Big Data Intelligence, 1(1\u20132), 103\u2013113.","journal-title":"International Journal of Big Data Intelligence"},{"key":"9644_CR3","unstructured":"Aller Media Ltd. (2019). The Suomi24 sentences corpus 2001\u20132017, Korp version 1.1. Retrieved from http:\/\/urn.fi\/urn:nbn:fi:lb-2020021803."},{"issue":"11","key":"9644_CR4","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.3390\/electronics10111348","volume":"10","author":"MA Alonso","year":"2021","unstructured":"Alonso, M. A., Vilares, D., G\u00f3mez-Rodr\u00edguez, C., & Vilares, J. (2021). Sentiment analysis for fake news detection. Electronics, 10(11), 1348.","journal-title":"Electronics"},{"key":"9644_CR5","unstructured":"Apidianaki, M., Tannier, X., & Richart, C. (2016). Datasets for aspect-based sentiment analysis in French. In Proceedings of the tenth international conference on language resources and evaluation (LREC 2016) European Language Resources Association (ELRA), Paris, France."},{"key":"9644_CR6","doi-asserted-by":"crossref","unstructured":"Bhutani, B., Rastogi, N., Sehgal, P., & Purwar, A. (2019). Fake news detection using sentiment analysis. In 2019 twelfth international conference on contemporary computing (IC3) (pp. 1\u20135). IEEE.","DOI":"10.1109\/IC3.2019.8844880"},{"key":"9644_CR7","unstructured":"Boland, K., Wira-Alam, A., & Messerschmidt, R. (2013). Creating an annotated corpus for sentiment analysis of german product reviews, GESIS-technical reports (Vol. 2013\/05). GESIS - Leibniz-Institut f\u00fcr Sozialwissenschaften, Mannheim."},{"key":"9644_CR8","unstructured":"Bostan LAM., & Klinger R. (2018). An analysis of annotated corpora for emotion classification in text. In Proceedings of the 27th international conference on computational linguistics (pp. 2104\u20132119)."},{"key":"9644_CR9","unstructured":"City Digital Group. (2021). The Suomi24 sentences corpus 2001\u20132020, Korp version. Retrieved from http:\/\/urn.fi\/urn:nbn:fi:lb-2021101525."},{"key":"9644_CR10","unstructured":"Clematide, S., Gindl, S., Klenner, M., Petrakis, S., Remus, R., Ruppenhofer, J., Waltinger, U., & Wiegand, M. (2012). MLSA\u2014a multi-layered reference corpus for German sentiment analysis. In Proceedings of the eighth international conference on language resources and evaluation (LREC\u201912) (pp. 3551\u20133556). European Language Resources Association (ELRA), Istanbul, Turkey. Retrieved from http:\/\/www.lrec-conf.org\/proceedings\/lrec2012\/pdf\/125_Paper.pdf."},{"issue":"1","key":"9644_CR11","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37\u201346.","journal-title":"Educational and Psychological Measurement"},{"key":"9644_CR12","unstructured":"Einolander, J. (2019). Deeper customer insight from NPS-questionnaires with text mining\u2014comparison of machine, representation and deep learning models in Finnish language sentiment classification. G2 pro gradu, diplomity\u00f6, Aalto University. Retrieved from http:\/\/urn.fi\/URN:NBN:fi:aalto-201904072554."},{"issue":"4","key":"9644_CR13","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1145\/2436256.2436274","volume":"56","author":"R Feldman","year":"2013","unstructured":"Feldman, R. (2013). Techniques and applications for sentiment analysis. Communications of the ACM, 56(4), 82\u201389. https:\/\/doi.org\/10.1145\/2436256.2436274","journal-title":"Communications of the ACM"},{"key":"9644_CR14","doi-asserted-by":"publisher","unstructured":"Feng, Y., & Wan, X. (2019). Learning bilingual sentiment-specific word embeddings without cross-lingual supervision. In Proceedings of the 2019 conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics, Minneapolis, Minnesota (pp. 420\u2013429). https:\/\/doi.org\/10.18653\/v1\/N19-1040, https:\/\/aclanthology.org\/N19-1040.","DOI":"10.18653\/v1\/N19-1040"},{"key":"9644_CR16","doi-asserted-by":"crossref","unstructured":"Ghosh, A., Li, G., Veale, T., Rosso, P., Shutova, E., Barnden, J., & Reyes, A. (2015). Semeval-2015 task 11: Sentiment analysis of figurative language in twitter. In Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015) (pp. 470\u2013478).","DOI":"10.18653\/v1\/S15-2080"},{"issue":"2","key":"9644_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2938640","volume":"49","author":"A Giachanou","year":"2016","unstructured":"Giachanou, A., & Crestani, F. (2016). Like it or not: A survey of twitter sentiment analysis methods. ACM Computing Surveys (CSUR), 49(2), 1\u201341.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"9644_CR18","doi-asserted-by":"publisher","unstructured":"H\u00e4m\u00e4l\u00e4inen, M., & Alnajjar, K. (2019). Let\u2019s FACE it. Finnish poetry generation with aesthetics and framing. In Proceedings of the 12th international conference on natural language generation, Association for Computational Linguistics, Tokyo, Japan (pp. 290\u2013300). https:\/\/doi.org\/10.18653\/v1\/W19-8637, https:\/\/aclanthology.org\/W19-8637.","DOI":"10.18653\/v1\/W19-8637"},{"key":"9644_CR19","unstructured":"H\u00e4m\u00e4l\u00e4inen, M., & Alnajjar, K. (2021). The current state of finnish nlp. In Proceedings of the seventh international workshop on computational linguistics of uralic languages (pp. 65\u201372)"},{"issue":"1","key":"9644_CR20","doi-asserted-by":"publisher","first-page":"51","DOI":"10.23983\/mv.69952","volume":"41","author":"A Harju","year":"2018","unstructured":"Harju, A. (2018). Suomi24-keskustelut kohtaamisten ja t\u00f6rm\u00e4ysten tilana. Media & viestint\u00e4, 41(1), 51\u201374.","journal-title":"Media & viestint\u00e4"},{"key":"9644_CR21","unstructured":"Hellstr\u00f6m, R. (2022). Aspect based sentiment analysis in Finnish. Master\u2019s thesis, Aalto University. School of Science. Retrieved from http:\/\/urn.fi\/URN:NBN:fi:aalto-202202061750."},{"issue":"1","key":"9644_CR22","doi-asserted-by":"publisher","first-page":"3","DOI":"10.23997\/pk.65488","volume":"38","author":"JH Jantunen","year":"2018","unstructured":"Jantunen, J. H. (2018). Homot ja heterot suomi24: Ss\u00e4: Analyysi digitaalisista diskursseista. Puhe ja kieli, 38(1), 3\u201322.","journal-title":"Puhe ja kieli"},{"key":"9644_CR23","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/978-3-319-56288-9_7","volume-title":"Strategic innovative marketing","author":"J Jussila","year":"2017","unstructured":"Jussila, J., Vuori, V., Okkonen, J., & Helander, N. (2017). Reliability and perceived value of sentiment analysis for twitter data. In Strategic innovative marketing (pp. 43\u201348). Springer."},{"key":"9644_CR24","unstructured":"Kajava, K. (2018). Cross-lingual sentiment preservation and transfer learning in binary and multi-class classification. Master\u2019s thesis, University of Helsinki."},{"key":"9644_CR25","unstructured":"Kajava, K., \u00d6hman E., Piao H., Tiedemann J. (2020). Emotion preservation in translation: Evaluating datasets for annotation projection. In DHN (pp. 38\u201350)"},{"key":"9644_CR26","unstructured":"Karttunen, J. (2021). Predicting omx helsinki stock prices using social media sentiment of finnish retail investors. Master\u2019s thesis, Lappeenranta-Lahti University of Technology LUT."},{"key":"9644_CR27","unstructured":"Kaustinen, J. (2018). Sentiment analysis of Finnish movie reviews: Extracting sentiment from texts in a morphologically rich language. Master\u2019s thesis, \u00c5bo Akademi."},{"key":"9644_CR28","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Association for Computational Linguistics, Doha, Qatar (pp. 1746\u20131751). Retrieved from https:\/\/www.emnlp2014.org\/papers\/pdf\/EMNLP2014181.pdf.","DOI":"10.3115\/v1\/D14-1181"},{"key":"9644_CR29","unstructured":"Krippendorff, K. (2011). Computing krippendorff\u2019s alpha-reliability. Tech. rep., University of Pennsylvania. Retrieved from http:\/\/repository.upenn.edu\/asc_papers\/43."},{"key":"9644_CR30","doi-asserted-by":"crossref","unstructured":"Ku, L. W., Lo, Y. S., & Chen, H. H. (2007). Test collection selection and gold standard generation for a multiply-annotated opinion corpus. In Proceedings of the 45th annual meeting of the association for computational linguistics companion volume proceedings of the demo and poster sessions (pp. 89\u201392).","DOI":"10.3115\/1557769.1557796"},{"key":"9644_CR31","doi-asserted-by":"crossref","unstructured":"Kula, S., Chora\u015b, M., Kozik, R., Ksieniewicz, P., & Wo\u017aniak, M. (2020). Sentiment analysis for fake news detection by means of neural networks. In International conference on computational science (pp. 653\u2013666). Springer.","DOI":"10.1007\/978-3-030-50423-6_49"},{"key":"9644_CR32","doi-asserted-by":"publisher","unstructured":"Kuutila, M., M\u00e3ntyl a, M.V., & Claes, M. (2020). Chat activity is a better predictor than chat sentiment on software developers productivity, Association for Computing Machinery, New York, NY, USA (pp. 553\u2013556). https:\/\/doi.org\/10.1145\/3387940.3392224.","DOI":"10.1145\/3387940.3392224"},{"key":"9644_CR33","unstructured":"Lagus, K., Ruckenstein, M., Pantzar, M., & Ylisiurua, M. (2016). Suomi24: Muodonantoa aineistolle. No.\u00a010 in Valtiotieteellisen tiedekunnan julkaisuja, Helsingin yliopisto, Suomi."},{"key":"9644_CR34","unstructured":"Leuhu, T. (2014). Sentiment analysis using machine learning. Master\u2019s thesis, Tampere University of Technology."},{"key":"9644_CR35","unstructured":"Lind\u00e9n, K., Jauhiainen, T., & Hardwick, S. (2020). FinnSentiment, source. Retrieved from http:\/\/urn.fi\/urn:nbn:fi:lb-2020111001."},{"key":"9644_CR36","unstructured":"Lison, P., & Tiedemann, J. (2016). Opensubtitles2016: Extracting large parallel corpora from movie and tv subtitles. In Proceedings of the tenth international conference on language resources and evaluation (LREC 2016), European Language Resources Association (pp. 923\u2013929)."},{"issue":"1","key":"9644_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-031-02145-9","volume":"5","author":"B Liu","year":"2012","unstructured":"Liu, B. (2012). Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies, 5(1), 1\u2013167.","journal-title":"Synthesis Lectures on Human Language Technologies"},{"issue":"2","key":"9644_CR38","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1080\/00913367.2017.1297273","volume":"46","author":"X Liu","year":"2017","unstructured":"Liu, X., Burns, A. C., & Hou, Y. (2017). An investigation of brand-related user-generated content on twitter. Journal of Advertising, 46(2), 236\u2013247.","journal-title":"Journal of Advertising"},{"key":"9644_CR39","doi-asserted-by":"publisher","unstructured":"Luo, H., Ji, L., Li, T., Jiang, D., & Duan, N. (2020). GRACE: Gradient harmonized and cascaded labeling for aspect-based sentiment analysis. In Findings of the association for computational linguistics: EMNLP 2020, Association for Computational Linguistics (pp. 54\u201364). https:\/\/doi.org\/10.18653\/v1\/2020.findings-emnlp.6, https:\/\/aclanthology.org\/2020.findings-emnlp.6.","DOI":"10.18653\/v1\/2020.findings-emnlp.6"},{"key":"9644_CR40","doi-asserted-by":"crossref","unstructured":"M\u00e4\u00e4tt\u00e4, S. K., Suomalainen, K., & Tuomarla, U. (2020). Maahanmuuttovastaisen ideologian ja ryhm\u00e4identiteetin rakentuminen suomi24-keskustelussa. Viritt\u00e4j\u00e4.","DOI":"10.23982\/vir.81931"},{"key":"9644_CR41","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.cosrev.2017.10.002","volume":"27","author":"MV M\u00e4ntyl\u00e4","year":"2018","unstructured":"M\u00e4ntyl\u00e4, M. V., Graziotin, D., & Kuutila, M. (2018). The evolution of sentiment analysis-a review of research topics, venues, and top cited papers. Computer Science Review, 27, 16\u201332.","journal-title":"Computer Science Review"},{"issue":"4","key":"9644_CR42","doi-asserted-by":"publisher","first-page":"1093","DOI":"10.1016\/j.asej.2014.04.011","volume":"5","author":"W Medhat","year":"2014","unstructured":"Medhat, W., Hassan, A., & Korashy, H. (2014). Sentiment analysis algorithms and applications: A survey. Ain Shams Engineering Journal, 5(4), 1093\u20131113.","journal-title":"Ain Shams Engineering Journal"},{"key":"9644_CR43","unstructured":"Mikolov, T., Chen, K., Corrado, G., & Jeffrey, D. (2013). Efficient estimation of word representations in vector space. arXiv:1301.3781 [cs.CL]."},{"issue":"3","key":"9644_CR44","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1111\/j.1467-8640.2012.00460.x","volume":"29","author":"SM Mohammad","year":"2013","unstructured":"Mohammad, S. M., & Turney, P. D. (2013). Crowdsourcing a word-emotion association lexicon. Computational Intelligence, 29(3), 436\u2013465.","journal-title":"Computational Intelligence"},{"key":"9644_CR45","unstructured":"Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2013). Semeval-2013 task 2: Sentiment analysis in twitter. In SemEval@NAACL-HLT"},{"key":"9644_CR46","doi-asserted-by":"crossref","unstructured":"Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2019). Semeval-2016 task 4: Sentiment analysis in twitter. arXiv preprint arXiv:1912.01973.","DOI":"10.18653\/v1\/S16-1001"},{"key":"9644_CR47","unstructured":"Nukarinen, V. (2018). Automated text sentiment analysis for Finnish language using deep learning. Master\u2019s thesis, Tampere University of Technology."},{"key":"9644_CR48","doi-asserted-by":"crossref","unstructured":"\u00d6hman, E. (2020). Challenges in annotation: Annotator experiences from a crowdsourced emotion annotation task. In DHN (pp. 293\u2013301).","DOI":"10.5617\/dhnbpub.11200"},{"key":"9644_CR49","doi-asserted-by":"publisher","unstructured":"\u00d6hman, E. (2021). Self &; feil: Emotion and intensity lexicons for finnish. https:\/\/doi.org\/10.48550\/ARXIV.2104.13691, https:\/\/arxiv.org\/abs\/2104.13691.","DOI":"10.48550\/ARXIV.2104.13691"},{"key":"9644_CR50","doi-asserted-by":"crossref","unstructured":"\u00d6hman, E., & Kajava, K. (2018). Sentimentator: Gamifying fine-grained sentiment annotation. In DHN (pp. 98\u2013110).","DOI":"10.5617\/dhnbpub.11013"},{"key":"9644_CR51","unstructured":"\u00d6hman, E., Honkela, T., & Tiedemann, J. (2016). The challenges of multi-dimensional sentiment analysis across languages. In Proceedings of the workshop on computational modeling of people\u2019s opinions, personality, and emotions in social media (PEOPLES) (pp 138\u2013142)."},{"key":"9644_CR52","doi-asserted-by":"crossref","unstructured":"\u00d6hman, E., Kajava, K., Tiedemann, J., & Honkela, T. (2018). Creating a dataset for multilingual fine-grained emotion-detection using gamification-based annotation. In Proceedings of the 9th workshop on computational approaches to subjectivity, sentiment and social media analysis (pp. 24\u201330).","DOI":"10.18653\/v1\/W18-6205"},{"key":"9644_CR53","doi-asserted-by":"crossref","unstructured":"\u00d6hman, E., P\u00e0mies, M., Kajava, K., & Tiedemann, J. (2020). Xed: A multilingual dataset for sentiment analysis and emotion detection. In The 28th international conference on computational linguistics (COLING 2020).","DOI":"10.18653\/v1\/2020.coling-main.575"},{"key":"9644_CR54","unstructured":"Paavola, J., & Jalonen, H. (2015). An approach to detect and analyze the impact of biased information sources in the social media. In ECCWS2015-proceedings of the 14th European conference on cyber warfare and security (p. 213)."},{"issue":"4","key":"9644_CR55","first-page":"100","volume":"15","author":"J Paavola","year":"2016","unstructured":"Paavola, J., Helo, T., Jalonen, H., Sartonen, M., & Huhtinen, A. (2016a). Understanding the trolling phenomenon: The automated detection of bots and cyborgs in the social media. Journal of Information Warfare, 15(4), 100\u2013111.","journal-title":"Journal of Information Warfare"},{"key":"9644_CR56","unstructured":"Paavola, J., Helo, T., Sartonen, H. J. M., & Huhtinen, A. M. (2016b). The automated detection of trolling bots and cyborgs and the analysis of their impact in the social media. In ECCWS2016-proceedings of the 15th European conference on cyber warfare and security, Academic Conferences and publishing limited (p. 237)."},{"key":"9644_CR57","unstructured":"Pak, A., & Paroubek, P. (2010). Twitter as a corpus for sentiment analysis and opinion mining. In Proceedings of the seventh international conference on language resources and evaluation (LREC\u201910), European Language Resources Association (ELRA), Valletta, Malta."},{"issue":"1\u20132","key":"9644_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1500000011","volume":"2","author":"B Pang","year":"2008","unstructured":"Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Information Retrieval, 2(1\u20132), 1\u2013135.","journal-title":"Information Retrieval"},{"key":"9644_CR59","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/B978-0-12-558701-3.50007-7","volume-title":"Theories of emotion","author":"R Plutchik","year":"1980","unstructured":"Plutchik, R. (1980). A general psychoevolutionary theory of emotion. In Theories of emotion (pp. 3\u201333). Elsevier."},{"key":"9644_CR60","doi-asserted-by":"publisher","unstructured":"Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., & Manandhar S. (2014). SemEval-2014 task 4: Aspect based sentiment analysis. In Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), Association for Computational Linguistics, Dublin, Ireland (pp. 27\u201335). https:\/\/doi.org\/10.3115\/v1\/S14-2004, https:\/\/www.aclweb.org\/anthology\/S14-2004.","DOI":"10.3115\/v1\/S14-2004"},{"key":"9644_CR61","doi-asserted-by":"crossref","unstructured":"Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I. (2015). Semeval-2015 task 12: Aspect based sentiment analysis. In Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015) (pp. 486\u2013495).","DOI":"10.18653\/v1\/S15-2082"},{"key":"9644_CR62","doi-asserted-by":"crossref","unstructured":"Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., & De\u00a0Clercq, O., et\u00a0al. (2016). Semeval-2016 task 5: Aspect based sentiment analysis. In 10th international workshop on semantic evaluation (SemEval 2016).","DOI":"10.18653\/v1\/S16-1002"},{"key":"9644_CR63","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1108\/JPBAFM-10-2020-0179","volume":"33","author":"A Rautiainen","year":"2021","unstructured":"Rautiainen, A., & Luoma-aho, V. (2021). Reputation and financial reporting in Finnish public organizations. Journal of Public Budgeting, Accounting & Financial Management, 33, 487\u2013511.","journal-title":"Journal of Public Budgeting, Accounting & Financial Management"},{"key":"9644_CR64","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.knosys.2015.06.015","volume":"89","author":"K Ravi","year":"2015","unstructured":"Ravi, K., & Ravi, V. (2015). A survey on opinion mining and sentiment analysis: Tasks, approaches and applications. Knowledge-Based Systems, 89, 14\u201346.","journal-title":"Knowledge-Based Systems"},{"key":"9644_CR65","doi-asserted-by":"crossref","unstructured":"Read, J. (2005). Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In Proceedings of the ACL student research workshop (pp. 43\u201348).","DOI":"10.3115\/1628960.1628969"},{"key":"9644_CR66","doi-asserted-by":"publisher","unstructured":"Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V. (2014). SemEval-2014 task 9: Sentiment analysis in twitter. In Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), Association for Computational Linguistics, Dublin, Ireland (pp. 73\u201380). https:\/\/doi.org\/10.3115\/v1\/S14-2009.","DOI":"10.3115\/v1\/S14-2009"},{"key":"9644_CR67","doi-asserted-by":"crossref","unstructured":"Rosenthal, S., Mohammad, S. M., Nakov, P., Ritter, A., Kiritchenko, S., & Stoyanov, V. (2015). Semeval-2015 task 10: Sentiment analysis in twitter. arXiv preprint arXiv:1912.02387.","DOI":"10.18653\/v1\/S15-2078"},{"key":"9644_CR68","doi-asserted-by":"crossref","unstructured":"Rosenthal, S., Farra, N., & Nakov, P. (2017). Semeval-2017 task 4: Sentiment analysis in twitter. arXiv preprint arXiv:1912.00741.","DOI":"10.18653\/v1\/S17-2088"},{"key":"9644_CR69","unstructured":"Seki, Y., Evans, D. K., Ku, L. W., Chen, H. H., Kando, N., Lin, C. Y. (2007). Overview of opinion analysis pilot task at ntcir-6. In NTCIR"},{"key":"9644_CR70","unstructured":"Seki, Y., Evans, D. K., Ku, L. W., Sun, L., Chen, H. H., Kando, N., Lin, C. Y. (2008). Overview of multilingual opinion analysis task at ntcir-7. In NTCIR."},{"key":"9644_CR71","unstructured":"Seki, Y., Ku, L. W., Sun, L., Chen, H. H., & Kando, N. (2010). Overview of multilingual opinion analysis task at ntcir-8. In Proc. of the Seventh NTCIR Workshop."},{"issue":"12","key":"9644_CR72","doi-asserted-by":"publisher","first-page":"2544","DOI":"10.1002\/asi.21416","volume":"61","author":"M Thelwall","year":"2010","unstructured":"Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010). Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology, 61(12), 2544\u20132558.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"9644_CR73","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1002\/asi.21662","volume":"63","author":"M Thelwall","year":"2012","unstructured":"Thelwall, M., Buckley, K., & Paltoglou, G. (2012). Sentiment strength detection for the social web. Journal of the American Society for Information Science and Technology, 63(1), 163\u2013173.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"9644_CR74","first-page":"2214","volume":"2012","author":"J Tiedemann","year":"2012","unstructured":"Tiedemann, J. (2012). Parallel data, tools and interfaces in opus. Lrec, 2012, 2214\u20132218.","journal-title":"Lrec"},{"key":"9644_CR75","doi-asserted-by":"crossref","unstructured":"Vankka, J., Myllykoski, H., Peltonen, T., & Riippa, K. (2019). Sentiment analysis of finnish customer reviews. In 2019 sixth international conference on social networks analysis (pp. 344\u2013350). IEEE: Management and Security (SNAMS).","DOI":"10.1109\/SNAMS.2019.8931724"},{"key":"9644_CR76","doi-asserted-by":"publisher","unstructured":"Vankka, J., Vesselkov, A., Myllykoski, H., & Kosomaa, O. (2021). Framework for analyzing and visualizing topics and sentiments on social media: the case of mh 17 tweets. In 2021 IEEE 6th International Conference on Big Data Analytics (ICBDA) (pp. 257\u2013266). https:\/\/doi.org\/10.1109\/ICBDA51983.2021.9403069.","DOI":"10.1109\/ICBDA51983.2021.9403069"},{"key":"9644_CR77","doi-asserted-by":"publisher","unstructured":"Virtanen, A., Kanerva, J., Ilo, R., Luoma, J., Luotolahti, J., Salakoski, T., Ginter, F., & Pyysalo, S. (2019). Multilingual is not enough: Bert for finnish. https:\/\/doi.org\/10.48550\/ARXIV.1912.07076, https:\/\/arxiv.org\/abs\/1912.07076.","DOI":"10.48550\/ARXIV.1912.07076"},{"key":"9644_CR15","first-page":"215","volume":"51","author":"RA y Montse Cuadros y Se\u00e1n Gaines y Ge","year":"2013","unstructured":"y Montse Cuadros y Se\u00e1n Gaines y German Rigau, R. A. (2013). Opener: Open polarity enhanced named entity recognition. Procesamiento del Lenguaje Natural, 51, 215\u2013218.","journal-title":"Procesamiento del Lenguaje Natural"},{"key":"9644_CR78","unstructured":"Ylilauta. (2015). Ylilauta Corpus. Retrieved from http:\/\/urn.fi\/urn:nbn:fi:lb-2015031802."},{"issue":"4","key":"9644_CR79","volume":"8","author":"L Zhang","year":"2018","unstructured":"Zhang, L., Wang, S., & Liu, B. (2018). Deep learning for sentiment analysis: A survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(4), e1253.","journal-title":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-023-09644-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-023-09644-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-023-09644-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T17:16:46Z","timestamp":1729012606000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-023-09644-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,3]]},"references-count":79,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["9644"],"URL":"https:\/\/doi.org\/10.1007\/s10579-023-09644-5","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,3]]},"assertion":[{"value":"1 February 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}