{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T22:33:31Z","timestamp":1759962811562,"version":"3.44.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T00:00:00Z","timestamp":1651795200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T00:00:00Z","timestamp":1651795200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Campus-Institut Data Science (CIDAS) G\u00f6ttingen"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Data Sci Anal"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Conspiracy theories have seen a rise in popularity in recent years. Spreading quickly through social media, their disruptive effect can lead to a biased public view on policy decisions and events. We present a novel approach for LDA-pre-processing called Iterative Filtering to study such phenomena based on Twitter data. In combination with Hashtag Pooling as an additional pre-processing step, we are able to achieve a coherent framing of the discussion and topics of interest, despite of the inherent noisiness and sparseness of Twitter data. Our novel approach enables researchers to gain detailed insights into discourses of interest on Twitter, allowing them to identify tweets iteratively that are related to an investigated topic of interest. As an application, we study the dynamics of conspiracy-related topics on US Twitter during the last four months of 2020, which were dominated by the US-Presidential Elections and Covid-19. We monitor the public discourse in the USA with geo-spatial Twitter data to identify conspiracy-related contents by estimating Latent Dirichlet Allocation (LDA) Topic Models. We find that in this period, usual conspiracy-related topics played a marginal role in comparison with dominating topics, such as the US-Presidential Elections or the general discussions about Covid-19. The main conspiracy theories in this period were the ones linked to \u201cElection Fraud\u201d and the \u201cCovid-19-hoax.\u201d Conspiracy-related keywords tended to appear together with Trump-related words and words related to his presidential campaign.<\/jats:p>","DOI":"10.1007\/s41060-022-00321-4","type":"journal-article","created":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T02:03:36Z","timestamp":1651802616000},"page":"269-289","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An iterative topic model filtering framework for short and noisy user-generated data: analyzing conspiracy theories on twitter"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2346-2841","authenticated-orcid":false,"given":"Gillian","family":"Kant","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Levin","family":"Wiebelt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0616-1027","authenticated-orcid":false,"given":"Christoph","family":"Weisser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2459-1274","authenticated-orcid":false,"given":"Krisztina","family":"Kis-Katos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mattias","family":"Luber","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4702-3333","authenticated-orcid":false,"given":"Benjamin","family":"S\u00e4fken","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,5,6]]},"reference":[{"key":"321_CR1","doi-asserted-by":"crossref","unstructured":"Agarwal, A., Salehundam, P., Padhee, S., Romine, W.L., Banerjee, T.: Leveraging Natural Language Processing to Mine Issues on Twitter During the COVID-19 Pandemic. arXiv e-prints (2020)","DOI":"10.1109\/BigData50022.2020.9378028"},{"key":"321_CR2","doi-asserted-by":"publisher","unstructured":"Ahmed, W., Bath, P.A., Demartini, G.: Using twitter as a data source: an overview of ethical, legal, and methodological challenges. In: The ethics of online research, pp. 79\u2013107. Emerald publishing limited (2017). https:\/\/doi.org\/10.1108\/s2398-601820180000002004","DOI":"10.1108\/s2398-601820180000002004"},{"key":"321_CR3","doi-asserted-by":"crossref","unstructured":"Auerbach, J., Pierson, S.: Does voting by mail increase fraud? Estimating the change in reported voter fraud when states switch to elections by mail. Technical Report: american Statistical Association (2020)","DOI":"10.1080\/2330443X.2021.1906806"},{"issue":"4","key":"321_CR4","doi-asserted-by":"publisher","first-page":"1270","DOI":"10.1111\/aphw.12223","volume":"12","author":"K Bierwiaczonek","year":"2020","unstructured":"Bierwiaczonek, K., Kunst, J.R., Pich, O.: Belief in COVID-19 conspiracy theories reduces social distancing over time. Appl Psychol: Health Well-Being 12(4), 1270\u20131285 (2020). https:\/\/doi.org\/10.1111\/aphw.12223","journal-title":"Appl Psychol: Health Well-Being"},{"key":"321_CR5","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993\u20131022 (2003)","journal-title":"J. Mach. Learn. Res."},{"key":"321_CR6","doi-asserted-by":"publisher","DOI":"10.2196\/21978","author":"S Boon-Itt","year":"2020","unstructured":"Boon-Itt, S., Skunkan, Y.: Public perception of the COVID-19 pandemic on twitter: sentiment analysis and topic modeling study. JMIR Publ Health Surveill (2020). https:\/\/doi.org\/10.2196\/21978","journal-title":"JMIR Publ Health Surveill"},{"issue":"2\u20133","key":"321_CR7","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1561\/1500000030","volume":"11","author":"J Boyd-Graber","year":"2017","unstructured":"Boyd-Graber, J., Hu, Y., Mimno, D.: Applications of topic models. Foundat Trend Info Retr 11(2\u20133), 143\u2013296 (2017). https:\/\/doi.org\/10.1561\/1500000030","journal-title":"Foundat Trend Info Retr"},{"key":"321_CR8","unstructured":"Chang, J., Boyd-Graber, J., Gerrish, S., Wang, C., Blei, D.M.: Reading tea leaves: how humans interpret topic models. In: Proceedings of the 22nd international conference on neural information processing systems. Curran Associates Inc. (2009)"},{"key":"321_CR9","doi-asserted-by":"crossref","unstructured":"Fee, C.R., Webb, J.B.: Conspiracies and conspiracy theories in American history, vol. 1. ABC-CLIO, Santa Barbara (2019)","DOI":"10.5040\/9798216962441"},{"key":"321_CR10","unstructured":"Feng, Y., Zhou, W.: Is working from home the new norm? an observational study based on a large Geo-tagged COVID-19 twitter dataset. arXiv e-prints (2020)"},{"issue":"4","key":"321_CR11","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1080\/10570318109374052","volume":"45","author":"GT Goodnight","year":"1981","unstructured":"Goodnight, G.T., Poulakos, J.: Conspiracy rhetoric: from pragmatism to fantasy in public discourse. Western J Speech Commun 45(4), 299\u2013316 (1981). https:\/\/doi.org\/10.1080\/10570318109374052","journal-title":"Western J Speech Commun"},{"key":"321_CR12","unstructured":"Hoffman, M.D., Blei, D.M., Bach, F.: Online Learning for Latent Dirichlet Allocation. In: Proceedings of the 23rd international conference on neural information processing systems - Volume 1. Curran Associates Inc. (2010)"},{"key":"321_CR13","doi-asserted-by":"publisher","unstructured":"Hong, L., Davison, B.D.: Empirical study of topic modeling in twitter. In: proceedings of the first workshop on social media analytics - SOMA \u201910. ACM Press (2010). https:\/\/doi.org\/10.1145\/1964858.1964870","DOI":"10.1145\/1964858.1964870"},{"key":"321_CR14","doi-asserted-by":"publisher","first-page":"8658","DOI":"10.1109\/ACCESS.2019.2961100","volume":"8","author":"T Hu","year":"2020","unstructured":"Hu, T., She, B., Duan, L., Yue, H., Clunis, J.: A systematic spatial and temporal sentiment analysis on geo-tweets. IEEE Access 8, 8658\u20138667 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2019.2961100","journal-title":"IEEE Access"},{"key":"321_CR15","doi-asserted-by":"crossref","unstructured":"Hutto, C., Gilbert, E.: VADER: A parsimonious rule-based model for sentiment analysis of social media text. In: Proceedings of the international AAAI conference on web and social media. The AAAI Press (2014)","DOI":"10.1609\/icwsm.v8i1.14550"},{"key":"321_CR16","doi-asserted-by":"publisher","unstructured":"Kant, G., Weisser, C., S\u00e4fken, B.: TTLocVis: a twitter topic location visualization package. J Open Sour Softw (2020). https:\/\/doi.org\/10.21105\/joss.02507","DOI":"10.21105\/joss.02507"},{"issue":"6","key":"321_CR17","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1177\/0165551515608733","volume":"42","author":"EHJ Kim","year":"2016","unstructured":"Kim, E.H.J., Jeong, Y.K., Kim, Y., Kang, K.Y., Song, M.: Topic-based content and sentiment analysis of Ebola virus on twitter and in the news. J Info Sci 42(6), 763\u2013781 (2016)","journal-title":"J Info Sci"},{"key":"321_CR18","first-page":"20","volume":"10","author":"M Kim","year":"2016","unstructured":"Kim, M., Cao, X.: The impact of exposure to media messages promoting government conspiracy theories on distrust in the government: evidence from a two-stage randomized experiment. Int J Commun 10, 20 (2016)","journal-title":"Int J Commun"},{"key":"321_CR19","doi-asserted-by":"crossref","unstructured":"Lee, L.: Measures of distributional similarity. 37th Annual Meeting of the ACL, 1999, pp. 25-32 (2000)","DOI":"10.3115\/1034678.1034693"},{"key":"321_CR20","doi-asserted-by":"publisher","unstructured":"Lim, K.W., Buntine, W.: Twitter opinion topic model. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management. ACM (2014). https:\/\/doi.org\/10.1145\/2661829.2662005","DOI":"10.1145\/2661829.2662005"},{"key":"321_CR21","unstructured":"Mebane, W.: Inappropriate applications of Benford\u2019s law regularities to some data from the 2020 Presidential election in the United States (2020)"},{"key":"321_CR22","doi-asserted-by":"publisher","unstructured":"Mehrotra, R., Sanner, S., Buntine, W., Xie, L.: Improving LDA topic models for microblogs via tweet pooling and automatic labeling. In: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. ACM (2013). https:\/\/doi.org\/10.1145\/2484028.2484166","DOI":"10.1145\/2484028.2484166"},{"key":"321_CR23","unstructured":"Morales, C.: \u2018Cuties\u2019 sparks a firestorm, again, after its netflix release. the new york times (2020). URL https:\/\/www.nytimes.com\/2020\/09\/12\/movies\/cuties-netflix.html. Accessed 27 December 2020"},{"key":"321_CR24","volume-title":"Analyzing public discourse: discourse analysis in the making of public policy","author":"R Scollon","year":"2008","unstructured":"Scollon, R.: Analyzing public discourse: discourse analysis in the making of public policy. Routledge, London (2008)"},{"issue":"2","key":"321_CR25","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/s42001-020-00086-5","volume":"3","author":"S Shahsavari","year":"2020","unstructured":"Shahsavari, S., Holur, P., Tangherlini, T.R., Roychowdhury, V.: Conspiracy in the time of corona: automatic detection of Covid-19 conspiracy theories in social media and the news. J Comput Social Science 3(2), 279\u2013317 (2020)","journal-title":"J Comput Social Science"},{"key":"321_CR26","doi-asserted-by":"publisher","unstructured":"Sievert, C., Shirley, K.: LDAvis: A method for visualizing and interpreting topics. In: Proceedings of the workshop on interactive language learning, visualization, and interfaces. association for computational linguistics (2014). https:\/\/doi.org\/10.3115\/v1\/w14-3110","DOI":"10.3115\/v1\/w14-3110"},{"key":"321_CR27","doi-asserted-by":"publisher","unstructured":"Thielmann, A., Weisser, C., Krenz, A.: One-class support vector machine and LDA topic model integration\u2014Evidence for AI patents, pp. 263\u2013272. Springer international publishing (2021). https:\/\/doi.org\/10.1007\/978-3-030-76620-7_23","DOI":"10.1007\/978-3-030-76620-7_23"},{"issue":"0","key":"321_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/02664763.2021.1919063","volume":"0","author":"A Thielmann","year":"2021","unstructured":"Thielmann, A., Weisser, C., Krenz, A., S\u00e4fken, B.: Unsupervised document classification integrating web scraping, one-class SVM and LDA topic modelling. J Appl Stat 0(0), 1\u201318 (2021). https:\/\/doi.org\/10.1080\/02664763.2021.1919063","journal-title":"J Appl Stat"},{"issue":"66","key":"321_CR29","doi-asserted-by":"publisher","first-page":"3719","DOI":"10.21105\/joss.03719","volume":"6","author":"A Tillmann","year":"2021","unstructured":"Tillmann, A., Thielmann, A., Kant, G., Weisser, C., S\u00e4fken, B., Silbersdorff, A., Kneib, T.: Audolab: automatic document labelling and classification for extremely unbalanced data. J Open Source Softw 6(66), 3719 (2021). https:\/\/doi.org\/10.21105\/joss.03719","journal-title":"J Open Source Softw"},{"key":"321_CR30","unstructured":"Wang, S.I., Manning, C.D.: Baselines and bigrams: simple, good sentiment and topic classification. In: Proceedings of the 50th annual meeting of the association for computational linguistics (Volume 2: Short Papers), pp. 90\u201394 (2012)"},{"key":"321_CR31","doi-asserted-by":"publisher","unstructured":"Xiang, B., Zhou, L.: Improving twitter sentiment analysis with topic-based mixture modeling and semi-supervised training. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (Volume 2: Short Papers). Association for Computational Linguistics (2014). https:\/\/doi.org\/10.3115\/v1\/p14-2071","DOI":"10.3115\/v1\/p14-2071"},{"key":"321_CR32","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0239441","author":"J Xue","year":"2020","unstructured":"Xue, J., Chen, J., Chen, C., Zheng, C., Li, S., Zhu, T.: Public discourse and sentiment during the COVID 19 pandemic: using latent dirichlet allocation for topic modeling on Twitter. Plos One (2020). https:\/\/doi.org\/10.1371\/journal.pone.0239441","journal-title":"Plos One"},{"key":"321_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijdrr.2020.101611","author":"W Zhai","year":"2020","unstructured":"Zhai, W., Peng, Z.R., Yuan, F.: Examine the effects of neighborhood equity on disaster situational awareness: Harness machine learning and geotagged Twitter data. Int J Disast Risk Reduct (2020). https:\/\/doi.org\/10.1016\/j.ijdrr.2020.101611","journal-title":"Int J Disast Risk Reduct"}],"container-title":["International Journal of Data Science and Analytics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41060-022-00321-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41060-022-00321-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41060-022-00321-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T17:19:10Z","timestamp":1757092750000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41060-022-00321-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,6]]},"references-count":33,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["321"],"URL":"https:\/\/doi.org\/10.1007\/s41060-022-00321-4","relation":{},"ISSN":["2364-415X","2364-4168"],"issn-type":[{"type":"print","value":"2364-415X"},{"type":"electronic","value":"2364-4168"}],"subject":[],"published":{"date-parts":[[2022,5,6]]},"assertion":[{"value":"12 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 March 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}