{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T17:16:20Z","timestamp":1776532580389,"version":"3.51.2"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We tackle the problem of classifying news articles pertaining to<jats:italic>disinformation<\/jats:italic>vs<jats:italic>mainstream<\/jats:italic>news by solely inspecting their diffusion mechanisms on Twitter. This approach is inherently simple compared to existing text-based approaches, as it allows to by-pass the multiple levels of complexity which are found in news content (e.g. grammar, syntax, style). As we employ a multi-layer representation of Twitter diffusion networks where each layer describes one single type of interaction (tweet, retweet, mention, etc.), we quantify the advantage of separating the layers with respect to an aggregated approach and assess the impact of each layer on the classification. Experimental results with two large-scale datasets, corresponding to diffusion cascades of news shared respectively in the United States and Italy, show that a simple Logistic Regression model is able to classify disinformation vs mainstream networks with high accuracy (AUROC up to 94%). We also highlight differences in the sharing patterns of the two news domains which appear to be common in the two countries. We believe that our network-based approach provides useful insights which pave the way to the future development of a system to detect misleading and harmful information spreading on social media.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-020-00253-8","type":"journal-article","created":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T19:07:30Z","timestamp":1606158450000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["A multi-layer approach to disinformation detection in US and Italian news spreading on Twitter"],"prefix":"10.1140","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9339-7566","authenticated-orcid":false,"given":"Francesco","family":"Pierri","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlo","family":"Piccardi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefano","family":"Ceri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,11,23]]},"reference":[{"issue":"2","key":"253_CR1","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1257\/jep.31.2.211","volume":"31","author":"H Allcott","year":"2017","unstructured":"Allcott H, Gentzkow M (2017) Social media and fake news in the 2016 election. J Econ Perspect 31(2):211\u2013236","journal-title":"J Econ Perspect"},{"issue":"6425","key":"253_CR2","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1126\/science.aau2706","volume":"363","author":"N Grinberg","year":"2019","unstructured":"Grinberg N, Joseph K, Friedland L, Swire-Thompson B, Lazer D (2019) Fake news on Twitter during the 2016 U.S. presidential election. Science 363(6425):374\u2013378","journal-title":"Science"},{"issue":"1","key":"253_CR3","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-07761-2","volume":"10","author":"A Bovet","year":"2019","unstructured":"Bovet A, Makse HA (2019) Influence of fake news in Twitter during the 2016 US presidential election. Nat Commun 10(1):7","journal-title":"Nat Commun"},{"issue":"6380","key":"253_CR4","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1126\/science.aao2998","volume":"359","author":"DMJ Lazer","year":"2018","unstructured":"Lazer DMJ, Baum MA, Benkler Y, Berinsky AJ, Greenhill KM, Menczer F, Metzger MJ, Nyhan B, Pennycook G, Rothschild D, Schudson M, Sloman SA, Sunstein CR, Thorson EA, Watts DJ, Zittrain JL (2018) The science of fake news. Science 359(6380):1094\u20131096","journal-title":"Science"},{"issue":"2","key":"253_CR5","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.2.2.175","volume":"2","author":"RS Nickerson","year":"1998","unstructured":"Nickerson RS (1998) Confirmation bias: a ubiquitous phenomenon in many guises. Rev Gen Psychol 2(2):175","journal-title":"Rev Gen Psychol"},{"key":"253_CR6","unstructured":"Reed ES, Turiel E, Brown T (2013) Naive realism in everyday life: implications for social conflict and misunderstanding. Values Knowl 113\u2013146"},{"issue":"1","key":"253_CR7","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-06930-7","volume":"9","author":"C Shao","year":"2018","unstructured":"Shao C, Ciampaglia GL, Varol O, Yang K-C, Flammini A, Menczer F (2018) The spread of low-credibility content by social bots. Nat Commun 9(1):4787","journal-title":"Nat Commun"},{"issue":"3","key":"253_CR8","doi-asserted-by":"publisher","first-page":"554","DOI":"10.1073\/pnas.1517441113","volume":"113","author":"M Del Vicario","year":"2016","unstructured":"Del Vicario M, Bessi A, Zollo F, Petroni F, Scala A, Caldarelli G, Stanley HE, Quattrociocchi W (2016) The spreading of misinformation online. Proc Natl Acad Sci 113(3):554\u2013559","journal-title":"Proc Natl Acad Sci"},{"key":"253_CR9","doi-asserted-by":"crossref","unstructured":"Pierri F, Ceri S (2019) False news on social media: a data-driven survey. ACM Sigmod Rec 48(2)","DOI":"10.1145\/3377330.3377334"},{"issue":"6380","key":"253_CR10","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1126\/science.aap9559","volume":"359","author":"S Vosoughi","year":"2018","unstructured":"Vosoughi S, Roy D, Aral S (2018) The spread of true and false news online. Science 359(6380):1146\u20131151","journal-title":"Science"},{"key":"253_CR11","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-58166-5","volume":"10","author":"F Pierri","year":"2020","unstructured":"Pierri F, Piccardi C, Ceri S (2020) Topology comparison of Twitter diffusion networks effectively reveals misleading news. Sci Rep 10:1372","journal-title":"Sci Rep"},{"key":"253_CR12","unstructured":"Batagelj V, Zaversnik M (2003) An O(m) algorithm for cores decomposition of networks. arXiv preprint. arXiv:cs\/0310049"},{"issue":"1","key":"253_CR13","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1287\/mnsc.2015.2158","volume":"62","author":"S Goel","year":"2015","unstructured":"Goel S, Anderson A, Hofman J, Watts DJ (2015) The structural virality of online diffusion. Manag Sci 62(1):180\u2013196","journal-title":"Manag Sci"},{"key":"253_CR14","unstructured":"Monti F, Frasca F, Eynard D, Mannion D, Bronstein MM (2019) Fake news detection on social media using geometric deep learning. arXiv preprint. arXiv:1902.06673"},{"issue":"1","key":"253_CR15","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-020-00224-z","volume":"9","author":"Z Zhao","year":"2020","unstructured":"Zhao Z, Zhao J, Sano Y, Levy O, Takayasu H, Takayasu M, Li D, Wu J, Havlin S (2020) Fake news propagates differently from real news even at early stages of spreading. EPJ Data Sci 9(1):7","journal-title":"EPJ Data Sci"},{"key":"253_CR16","unstructured":"Ratkiewicz J, Conover M, Meiss M, Gon\u00e7alves B, Patil S, Flammini A, Menczer F (2011) Detecting and tracking political abuse in social media. In: ICWSM 2011, 249"},{"key":"253_CR17","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1145\/2872518.2889302","volume-title":"Proceedings of the 25th international conference companion on world wide web","author":"CA Davis","year":"2016","unstructured":"Davis CA, Varol O, Ferrara E, Flammini A, Menczer F (2016) Botornot: a system to evaluate social bots. In: Proceedings of the 25th international conference companion on world wide web, pp\u00a0273\u2013274. International World Wide Web Conferences Steering Committee"},{"key":"253_CR18","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1145\/2872518.2890098","volume-title":"Proceedings of the 25th international conference companion on world wide web. WWW\u201916 companion","author":"C Shao","year":"2016","unstructured":"Shao C, Ciampaglia GL, Flammini A, Menczer F (2016) Hoaxy: a platform for tracking online misinformation. In: Proceedings of the 25th international conference companion on world wide web. WWW\u201916 companion. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, pp\u00a0745\u2013750."},{"issue":"4","key":"253_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0196087","volume":"13","author":"C Shao","year":"2018","unstructured":"Shao C, Hui P-M, Wang L, Jiang X, Flammini A, Menczer F, Ciampaglia GL (2018) Anatomy of an online misinformation network. PLoS ONE 13(4):1\u201323","journal-title":"PLoS ONE"},{"key":"253_CR20","unstructured":"Mitchell A, Gottfried J, Kiley J, Matsa KE (2014) Political polarization & media habits. Pew Res Centr 21"},{"issue":"10","key":"253_CR21","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1177\/0956797615594620","volume":"26","author":"P Barber\u00e1","year":"2015","unstructured":"Barber\u00e1 P, Jost JT, Nagler J, Tucker JA, Bonneau R (2015) Tweeting from left to right: is online political communication more than an echo chamber? Psychol Sci 26(10):1531\u20131542","journal-title":"Psychol Sci"},{"issue":"1","key":"253_CR22","doi-asserted-by":"publisher","DOI":"10.1140\/epjds6","volume":"1","author":"MD Conover","year":"2012","unstructured":"Conover MD, Gon\u00e7alves B, Flammini A, Menczer F (2012) Partisan asymmetries in online political activity. EPJ Data Sci 1(1):6","journal-title":"EPJ Data Sci"},{"issue":"1","key":"253_CR23","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-26951-y","volume":"8","author":"A Bovet","year":"2018","unstructured":"Bovet A, Morone F, Makse HA (2018) Validation of Twitter opinion trends with national polling aggregates: Hillary Clinton vs Donald Trump. Sci Rep 8(1):8673","journal-title":"Sci Rep"},{"issue":"2","key":"253_CR24","doi-asserted-by":"publisher","DOI":"10.1145\/3316809","volume":"13","author":"MD Vicario","year":"2019","unstructured":"Vicario MD, Quattrociocchi W, Scala A, Zollo F (2019) Polarization and fake news: early warning of potential misinformation targets. ACM Trans Web 13(2):10","journal-title":"ACM Trans Web"},{"key":"253_CR25","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1145\/3366424.3385776","volume-title":"Companion proceedings of the web conference 2020","author":"F Pierri","year":"2020","unstructured":"Pierri F (2020) The diffusion of mainstream and disinformation news on Twitter: the case of Italy and France. In: Companion proceedings of the web conference 2020, pp\u00a0617\u2013622"},{"issue":"1","key":"253_CR26","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0227821","volume":"15","author":"F Pierri","year":"2020","unstructured":"Pierri F, Artoni A, Ceri S (2020) Investigating Italian disinformation spreading on Twitter in the context of 2019 European elections. PLoS ONE 15(1):e0227821","journal-title":"PLoS ONE"},{"key":"253_CR27","unstructured":"Nielsen RK, Newman N, Fletcher R, Kalogeropoulos A (2019) Reuters institute digital news report 2019. Report of the Reuters Institute for the Study of Journalism"},{"key":"253_CR28","first-page":"1","volume-title":"2010 43rd Hawaii international conference on system sciences","author":"D Boyd","year":"2010","unstructured":"Boyd D, Golder S, Lotan G (2010) Tweet, tweet, retweet: conversational aspects of retweeting on Twitter. In: 2010 43rd Hawaii international conference on system sciences. IEEE Press, New York, pp\u00a01\u201310"},{"issue":"1","key":"253_CR29","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0029358","volume":"7","author":"PA Grabowicz","year":"2012","unstructured":"Grabowicz PA, Ramasco JJ, Moro E, Pujol JM, Eguiluz VM (2012) Social features of online networks: the strength of intermediary ties in online social media. PLoS ONE 7(1):e29358","journal-title":"PLoS ONE"},{"issue":"3","key":"253_CR30","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1093\/comnet\/cnu016","volume":"2","author":"M Kivel\u00e4","year":"2014","unstructured":"Kivel\u00e4 M, Arenas A, Barthelemy M, Gleeson JP, Moreno Y, Porter MA (2014) Multilayer networks. J Complex Netw 2(3):203\u2013271","journal-title":"J Complex Netw"},{"key":"253_CR31","doi-asserted-by":"crossref","unstructured":"Wasserman S, Faust K (1994) Social network analysis. Methods Appl 8","DOI":"10.1017\/CBO9780511815478"},{"issue":"2","key":"253_CR32","volume":"75","author":"J Saram\u00e4ki","year":"2007","unstructured":"Saram\u00e4ki J, Kivel\u00e4 M, Onnela J-P, Kaski K, Kertesz J (2007) Generalizations of the clustering coefficient to weighted complex networks. Phys Rev\u00a0E 75(2):027105","journal-title":"Phys Rev\u00a0E"},{"issue":"1","key":"253_CR33","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1021\/ja01193a005","volume":"69","author":"H Wiener","year":"1947","unstructured":"Wiener H (1947) Structural determination of paraffin boiling points. J Am Chem Soc 69(1):17\u201320","journal-title":"J Am Chem Soc"},{"key":"253_CR34","unstructured":"Hagberg A, Swart P, Chult D (2008) Exploring network structure, dynamics, and function using networkX. Technical report, Los Alamos National Lab. (LANL), Los Alamos, NM (United States)"},{"key":"253_CR35","volume-title":"Seventh international AAAI conference on weblogs and social media","author":"F Morstatter","year":"2013","unstructured":"Morstatter F, Pfeffer J, Liu H, Carley KM (2013) Is the sample good enough? Comparing data from Twitter\u2019s streaming api with Twitter\u2019s firehose. In: Seventh international AAAI conference on weblogs and social media"},{"key":"253_CR36","first-page":"60","volume-title":"Proceedings of the international AAAI conference on web and social media","author":"L Bozarth","year":"2020","unstructured":"Bozarth L, Budak C (2020) Toward a better performance evaluation framework for fake news classification. In: Proceedings of the international AAAI conference on web and social media, vol\u00a014, pp\u00a060\u201371"},{"key":"253_CR37","first-page":"9051","volume-title":"Advances in neural information processing systems","author":"R Zellers","year":"2019","unstructured":"Zellers R, Holtzman A, Rashkin H, Bisk Y, Farhadi A, Roesner F, Choi Y (2019) Defending against neural fake news. In: Advances in neural information processing systems, pp\u00a09051\u20139062"},{"key":"253_CR38","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V et al.(2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"issue":"8","key":"253_CR39","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","volume":"27","author":"T Fawcett","year":"2006","unstructured":"Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27(8):861\u2013874","journal-title":"Pattern Recognit Lett"},{"issue":"17","key":"253_CR40","first-page":"1","volume":"18","author":"G Lema\u00eetre","year":"2017","unstructured":"Lema\u00eetre G, Nogueira F, Aridas CK (2017) Imbalanced-learn: a python toolbox to tackle the curse of imbalanced datasets in machine learning. J Mach Learn Res 18(17):1\u20135","journal-title":"J Mach Learn Res"},{"key":"253_CR41","volume-title":"Proceedings ACM WSDM, workshop on misinformation and misbehavior mining on the web","author":"LG Stewart","year":"2018","unstructured":"Stewart LG, Arif A, Starbird K (2018) Examining trolls and polarization with a retweet network. In: Proceedings ACM WSDM, workshop on misinformation and misbehavior mining on the web"},{"key":"253_CR42","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1109\/ASONAM.2018.8508646","volume-title":"2018 IEEE\/ACM international conference on advances in social networks analysis and mining (ASONAM)","author":"A Badawy","year":"2018","unstructured":"Badawy A, Ferrara E, Lerman K (2018) Analyzing the digital traces of political manipulation: the 2016 Russian interference Twitter campaign. In: 2018 IEEE\/ACM international conference on advances in social networks analysis and mining (ASONAM). IEEE Press, New York, pp\u00a0258\u2013265"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-020-00253-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-020-00253-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-020-00253-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T10:59:32Z","timestamp":1669719572000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-020-00253-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,23]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["253"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-020-00253-8","relation":{},"ISSN":["2193-1127"],"issn-type":[{"value":"2193-1127","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,23]]},"assertion":[{"value":"30 April 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"35"}}