{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T13:13:33Z","timestamp":1782738813456,"version":"3.54.5"},"reference-count":44,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,6,17]],"date-time":"2021-06-17T00:00:00Z","timestamp":1623888000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The dissemination of disinformation and fabricated content on social media is growing. Yet little is known of what the functional Twitter data analysis methods are for languages (such as Finnish) that include word formation with endings and word stems together with derivation and compounding. Furthermore, there is a need to understand which themes linked with misinformation\u2014and the concepts related to it\u2014manifest in different countries and language areas in Twitter discourse. To address this issue, this study explores misinformation and its related concepts: disinformation, fake news, and propaganda in Finnish language tweets. We utilized (1) word cloud clustering, (2) topic modeling, and (3) word count analysis and clustering to detect and analyze misinformation-related concepts and themes connected to those concepts in Finnish language Twitter discussions. Our results are two-fold: (1) those concerning the functional data analysis methods and (2) those about the themes connected in discourse to the misinformation-related concepts. We noticed that each utilized method individually has critical limitations, especially all the automated analysis methods processing for the Finnish language, yet when combined they bring value to the analysis. Moreover, we discovered that politics, both internal and external, are prominent in the Twitter discussions in connection with misinformation and its related concepts of disinformation, fake news, and propaganda.<\/jats:p>","DOI":"10.3390\/fi13060157","type":"journal-article","created":{"date-parts":[[2021,6,17]],"date-time":"2021-06-17T11:20:26Z","timestamp":1623928826000},"page":"157","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Text Analysis Methods for Misinformation\u2013Related Research on Finnish Language Twitter"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7337-1211","authenticated-orcid":false,"given":"Jari","family":"Jussila","sequence":"first","affiliation":[{"name":"HAMK Smart Research Unit, H\u00e4me University of Applied Sciences, P.O. Box 230, 13100 H\u00e4meenlinna, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9841-5153","authenticated-orcid":false,"given":"Anu Helena","family":"Suominen","sequence":"additional","affiliation":[{"name":"Faculty of Management and Business, Tampere University, P.O. Box 300, 28100 Pori, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7188-4577","authenticated-orcid":false,"given":"Atte","family":"Partanen","sequence":"additional","affiliation":[{"name":"HAMK Smart Research Unit, H\u00e4me University of Applied Sciences, P.O. Box 230, 13100 H\u00e4meenlinna, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tapani","family":"Honkanen","sequence":"additional","affiliation":[{"name":"School of Entrepreneurship and Business, H\u00e4me University of Applied Sciences, P.O. Box 230, 13100 H\u00e4meenlinna, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"106716","DOI":"10.1016\/j.chb.2021.106716","article-title":"Machine learning techniques and older adults processing of online information and misinformation: A covid 19 study","volume":"119","author":"Choudrie","year":"2021","journal-title":"Comput. Human Behav."},{"key":"ref_2","unstructured":"EU (2021, June 10). Final Report of the High Level Expert Group on Fake News and Online Disinformation. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/final-report-high-level-expert-group-fake-news-and-online-disinformation."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1126\/science.aao2998","article-title":"The science of fake news","volume":"359","author":"Lazer","year":"2018","journal-title":"Science"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/widm.1385","article-title":"Combating Disinformation in A Social Media Age","volume":"10","author":"Shu","year":"2020","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Spradling, M., Straub, J., and Strong, J. (2021). Protection from \u2018Fake News\u2019: The Need for Descriptive Factual Labeling for Online Content. Futur. Internet, 13.","DOI":"10.3390\/fi13060142"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Helmstetter, S., and Paulheim, H. (2021). Collecting a Large Scale Dataset for Classifying Fake News Tweets Using Weak Supervision. Futur. Internet, 13.","DOI":"10.3390\/fi13050114"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Carchiolo, V., Longheu, A., Malgeri, M., Mangioni, G., and Previti, M. (2021). Mutual Influence of Users Credibility and News Spreading in Online Social Networks. Future Internet, 13.","DOI":"10.3390\/fi13050107"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1207\/s15327957pspr1001_3","article-title":"The paranoid optimist: An integrative evolutionary model of cognitive biases","volume":"10","author":"Haselton","year":"2006","journal-title":"Personal. Soc. Psychol. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2767","DOI":"10.1093\/cercor\/bhp055","article-title":"Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies","volume":"19","author":"Binder","year":"2009","journal-title":"Cereb Cortex"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"E6256","DOI":"10.1073\/pnas.1612132113","article-title":"Neural correlate of the construction of sentence meaning","volume":"113","author":"Fedorenko","year":"2016","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1080\/10584609.2020.1723755","article-title":"Disinformation as political communication","volume":"37","author":"Freelon","year":"2020","journal-title":"Polit. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1080\/10584609.2019.1663322","article-title":"Sourcing and automation of political news and information over social media in the United States, 2016\u20132018","volume":"37","author":"Bradshaw","year":"2020","journal-title":"Polit. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.inffus.2015.08.005","article-title":"Social big data: Recent achievements and new challenges","volume":"28","author":"Jung","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"10983","DOI":"10.1007\/s00500-020-05084-3","article-title":"Social media mining for smart cities and smart villages research","volume":"24","author":"Lytras","year":"2020","journal-title":"Soft Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2542","DOI":"10.1109\/ACCESS.2016.2559584","article-title":"Social set analysis: A set theoretical approach to big data analytics","volume":"4","author":"Vatrapu","year":"2016","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, J., and Su, M.H. (2020). Real Talk about Fake News: Identity Language and Disconnected Networks of the US Public\u2019s \u201cFake News\u201d Discourse on Twitter. Soc. Media Soc., 6.","DOI":"10.1177\/2056305120916841"},{"key":"ref_17","first-page":"1146","article-title":"The spread of true and false news online","volume":"359","author":"Vosoughi","year":"2018","journal-title":"Soc. Sci."},{"key":"ref_18","unstructured":"Varol, O., Ferrara, E., Davis, C.A., Menczer, F., and Flammini, A. (2017, January 15\u201318). Online Human-Bot Interactions: Detection, Estimation, and Characterization. Proceedings of the Eleventh International AAAI Conference on Web and Social Media (ICWSM 2017), Montr\u00e9al, QC, Canada."},{"key":"ref_19","unstructured":"(2021, June 10). EU Institutions Data Flash Eurobarometer 464: Fake News and Disinformation Online. Available online: https:\/\/data.europa.eu\/data\/datasets\/s2183_464_eng?locale=en."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zakharchenko, A., Per\u00e1\u010dek, T., Fedushko, S., Syerov, Y., and Trach, O. (2021). When Fact-Checking and \u2018BBC Standards\u2019 Are Helpless: \u2018Fake Newsworthy Event\u2019Manipulation and the Reaction of the \u2018High-Quality Media\u2019on It. Sustainability, 13.","DOI":"10.3390\/su13020573"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Dann, S. (2015). Twitter data acquisition and analysis: Methodology and best practice. Maximizing Commerce and Marketing Strategies through Micro-Blogging, IGI Global.","DOI":"10.4018\/978-1-4666-8408-9.ch012"},{"key":"ref_22","unstructured":"UN (2021, June 10). UN Tackles \u2018Infodemic\u2019 of Misinformation and Cybercrime in COVID-19 Crisis|United Nations. Available online: https:\/\/www.un.org\/en\/un-coronavirus-communications-team\/un-tackling-%E2%80%98infodemic%E2%80%99-misinformation-and-cybercrime-covid-19."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zeng, J., and Chan, C.H. (2021). A cross-national diagnosis of infodemics: Comparing the topical and temporal features of misinformation around COVID-19 in China, India, the US, Germany and France. Online Inf. Rev.","DOI":"10.1108\/OIR-09-2020-0417"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1023\/B:MIND.0000021683.28604.5b","article-title":"Disinformation: The use of false information","volume":"14","author":"Fetzer","year":"2004","journal-title":"Minds Mach."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chiluwa, I.E., and Samoilenko, S.A. (2019). Handbook of Research on Deception, Fake News, and Misinformation Online. Advances in Media, Entertainment, and the Arts, IGI Global.","DOI":"10.4018\/978-1-5225-8535-0"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1023\/B:MIND.0000021682.61365.56","article-title":"Information: Does it have to Be True?","volume":"14","author":"Fetzer","year":"2004","journal-title":"Minds Mach."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"106633","DOI":"10.1016\/j.chb.2020.106633","article-title":"Would you notice if fake news changed your behavior? An experiment on the unconscious effects of disinformation","volume":"116","author":"Bastick","year":"2021","journal-title":"Comput. Human Behav."},{"key":"ref_28","first-page":"137","article-title":"Defining \u201cFake News\u201d: A typology of scholarly definitions","volume":"6","author":"Tandoc","year":"2018","journal-title":"Digit. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"110","DOI":"10.17645\/mac.v9i1.3331","article-title":"What Is (Fake) News? Analyzing News Values (and More) in Fake Stories","volume":"9","author":"Tandoc","year":"2021","journal-title":"Media Commun."},{"key":"ref_30","unstructured":"(2021, May 28). UK Parliament Disinformation and \u2018fake news\u2019: Interim Report. Available online: https:\/\/publications.parliament.uk\/pa\/cm201719\/cmselect\/cmcumeds\/363\/363.pdf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"105958","DOI":"10.1016\/j.chb.2019.03.022","article-title":"Tweeting and mining OECD-related microcontent in the post-truth era: A cloud-based app","volume":"107","author":"Visvizi","year":"2020","journal-title":"Comput. Human Behav."},{"key":"ref_32","first-page":"524","article-title":"An Examination of Factors Contributing to the Acceptance of Online Health Misinformation","volume":"12","author":"Pan","year":"2020","journal-title":"Front. Psychol."},{"key":"ref_33","unstructured":"Van Sant, K., Fredheim, R., and Bergmanis-Korats, G. (2021, June 10). Abuse of Power: Coordinated Online Harassment of Finnish Government Ministers. Riga: NATO Strategic Communications Centre of Excellence. Available online: https:\/\/stratcomcoe.org\/pdfjs\/?file=\/cuploads\/pfiles\/abuse_of_power_online_harassment_of_fin_ministers_16-03-2021.pdf?zoom=page-fit."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mejova, Y., Weber, I., and Macy, M.W. (2015). Twitter: A Digital Socioscope, Cambridge University Press.","DOI":"10.1017\/CBO9781316182635"},{"key":"ref_35","unstructured":"Friese, S. (2019). Qualitative Data Analysis with ATLAS.ti, SAGE."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Karlsson, F. (2002). Finnish: An Essential Grammar, Taylor & Francis e-Library.","DOI":"10.4324\/9780203018224"},{"key":"ref_37","unstructured":"Bird, S., Klein, E., and Loper, E. (2009). Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit, O\u2019Reilly Media, Inc."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Korenius, T., Laurikkala, J., J\u00e4rvelin, K., and Juhola, M. (2004, January 8\u201313). Stemming and lemmatization in the clustering of finnish text documents. Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, Washington, DC, USA.","DOI":"10.1145\/1031171.1031285"},{"key":"ref_39","unstructured":"Roesslein, J. (2021, May 03). Tweepy. Available online: https:\/\/docs.tweepy.org\/en\/stable\/."},{"key":"ref_40","unstructured":"Partanen, A. (2021, June 11). TweetCollector. Available online: https:\/\/github.com\/hamk-uas\/TweetCollector."},{"key":"ref_41","unstructured":"(2021, June 11). Twitter Twitter API v2: Early Access. Available online: https:\/\/developer.twitter.com\/en\/docs\/twitter-api\/early-access."},{"key":"ref_42","unstructured":"Rosen, A. (2021, May 07). Tweeting Made Easier. Available online: https:\/\/blog.twitter.com\/en_us\/topics\/product\/2017\/tweetingmadeeasier.html."},{"key":"ref_43","unstructured":"(2021, May 28). Antupis Finnish Lemmatization with Python. Available online: https:\/\/antupis.github.io\/lemmatization\/finnish\/2019\/06\/12\/Lemmatizing-finnish-text.html."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bakshy, E., Hofman, J.M., Mason, W.A., and Watts, D.J. (2011, January 9\u201312). Everyone\u2019s an influencer: Quantifying influence on twitter. Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China.","DOI":"10.1145\/1935826.1935845"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/6\/157\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:17:29Z","timestamp":1760163449000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/6\/157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,17]]},"references-count":44,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["fi13060157"],"URL":"https:\/\/doi.org\/10.3390\/fi13060157","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,17]]}}}