{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:37:09Z","timestamp":1765546629115,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T00:00:00Z","timestamp":1591920000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Social networks play an important role in today\u2019s society and in our relationships with others. They give the Internet user the opportunity to play an active role, e.g., one can relay certain information via a blog, a comment, or even a vote. The Internet user has the possibility to share any content at any time. However, some malicious Internet users take advantage of this freedom to share fake news to manipulate or mislead an audience, to invade the privacy of others, and also to harm certain institutions. Fake news seeks to resemble traditional media to establish its credibility with the public. Its seriousness pushes the public to share them. As a result, fake news can spread quickly. This fake news can cause enormous difficulties for users and institutions. Several authors have proposed systems to detect fake news in social networks using crowd signals through the process of crowdsourcing. Unfortunately, these authors do not use the expertise of the crowd and the expertise of a third party in an associative way to make decisions. Crowds are useful in indicating whether or not a story should be fact-checked. This work proposes a new method of binary aggregation of opinions of the crowd and the knowledge of a third-party expert. The aggregator is based on majority voting on the crowd side and weighted averaging on the third-party side. An experimentation has been conducted on 25 posts and 50 voters. A quantitative comparison with the majority vote model reveals that our aggregation model provides slightly better results due to weights assigned to accredited users. A qualitative investigation against existing aggregation models shows that the proposed approach meets the requirements or properties expected of a crowdsourcing system and a voting system.<\/jats:p>","DOI":"10.3390\/info11060319","type":"journal-article","created":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T03:17:32Z","timestamp":1592191052000},"page":"319","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Reliable Weighting Scheme for the Aggregation of Crowd Intelligence to Detect Fake News"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0723-2640","authenticated-orcid":false,"given":"Franklin","family":"Tchakount\u00e9","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Faculty of Science, University of Ngaound\u00e9r\u00e9, Ngaound\u00e9r\u00e9 640001, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmadou","family":"Faissal","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Faculty of Science, University of Ngaound\u00e9r\u00e9, Ngaound\u00e9r\u00e9 640001, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcellin","family":"Atemkeng","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Rhodes University, Grahamstown 6140, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Achille","family":"Ntyam","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, Faculty of Science, University of Ngaound\u00e9r\u00e9, Ngaound\u00e9r\u00e9 640001, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,12]]},"reference":[{"key":"ref_1","unstructured":"(2020, May 31). Fake News\u2014Statistics & Facts. Available online: https:\/\/www.statista.com\/topics\/3251\/fake-news\/."},{"key":"ref_2","first-page":"107","article-title":"An Exploratory Study of \u201cFake News\u201d and Media Trust in Kenya, Nigeria and South Africa","volume":"40","author":"Wasserman","year":"2019","journal-title":"Afr. J. Stud."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3917\/pouv.164.0099","article-title":"Un guide critique des Fake News: de la com\u00e9die \u00e0 la trag\u00e9die","volume":"1","author":"Harsin","year":"2018","journal-title":"Pouvoirs"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tschiatschek, S., Singla, A., Gomez Rodriguez, M., Merchant, A., and Krause, A. (2018, January 23\u201327). Fake news detection in social networks via crowd signals. Proceedings of the Web Conference 2018, Lyon, France.","DOI":"10.1145\/3184558.3188722"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Della Vedova, M.L., Tacchini, E., Moret, S., Ballarin, G., DiPierro, M., and de Alfaro, L. (2018, January 11\u201313). Automatic online fake news detection combining content and social signals. Proceedings of the 2018 22nd Conference of Open Innovations Association (FRUCT), Petrozavodsk, Russia.","DOI":"10.23919\/FRUCT.2018.8468301"},{"key":"ref_6","unstructured":"De Alfaro, L., Di Pierro, M., Agrawal, R., Tacchini, E., Ballarin, G., Della Vedova, M.L., and Moret, S. (2018). Reputation systems for news on twitter: A large-scale study. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shabani, S., and Sokhn, M. (2018, January 18\u201320). Hybrid machine-crowd approach for fake news detection. Proceedings of the 2018 IEEE 4th International Conference on Collaboration and Internet Computing (CIC), Philadelphia, PA, USA.","DOI":"10.1109\/CIC.2018.00048"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kim, J., Tabibian, B., Oh, A., Sch\u00f6lkopf, B., and Gomez-Rodriguez, M. (2018, January 5\u20139). Leveraging the crowd to detect and reduce the spread of fake news and misinformation. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA.","DOI":"10.1145\/3159652.3159734"},{"key":"ref_9","unstructured":"Zhou, X., and Zafarani, R. (2018). Fake news: A survey of research, detection methods, and opportunities. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3305260","article-title":"Combating fake news: A survey on identification and mitigation techniques","volume":"10","author":"Sharma","year":"2019","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hassan, N., Arslan, F., Li, C., and Tremayne, M. (2017, January 13\u201317). Toward automated fact-checking: Detecting check-worthy factual claims by ClaimBuster. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.","DOI":"10.1145\/3097983.3098131"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hassan, N., Li, C., and Tremayne, M. (2015, January 19\u201323). Detecting check-worthy factual claims in presidential debates. Proceedings of the 24th ACM International Conference on Information and Knowledge Management, Melbourne, Australia.","DOI":"10.1145\/2806416.2806652"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sethi, R.J. (2017, January 4\u20137). Crowdsourcing the verification of fake news and alternative facts. Proceedings of the 28th ACM Conference on Hypertext and Social Media, Prague, Czech Republic.","DOI":"10.1145\/3078714.3078746"},{"key":"ref_14","unstructured":"Tacchini, E., Ballarin, G., Della Vedova, M.L., Moret, S., and de Alfaro, L. (2017). Some like it hoax: Automated fake news detection in social networks. arXiv."},{"key":"ref_15","unstructured":"(2020, May 31). Latest Email and Social Media Hoaxes\u2014Current Internet Scams\u2014Hoax-Slayer. Available online: https:\/\/hoax-slayer.com\/."},{"key":"ref_16","unstructured":"(2020, May 31). StopBlaBlaCam. Available online: https:\/\/www.stopblablacam.com\/."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Brown-Liburd, H., Cohen, J., and Zamora, V.L. (2011, January 14\u201315). The Effect of Corporate Social Responsibility Investment, Assurance, and Perceived Fairness on Investors\u2019 Judgments. Proceedings of the 2011 Academic Conference on CSR, Tacoma, WA, USA.","DOI":"10.2139\/ssrn.1985839"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.artint.2012.06.001","article-title":"YAGO2: A spatially and temporally enhanced knowledge base from Wikipedia","volume":"194","author":"Hoffart","year":"2013","journal-title":"Artif. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pisarevskaya, D. (2017, January 7). Deception detection in news reports in the russian language: Lexics and discourse. Proceedings of the 2017 EMNLP Workshop: Natural Language Processing Meets Journalism, Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4213"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Potthast, M., Kiesel, J., Reinartz, K., Bevendorff, J., and Stein, B. (2017). A stylometric inquiry into hyperpartisan and fake news. arXiv.","DOI":"10.18653\/v1\/P18-1022"},{"key":"ref_21","unstructured":"Volkova, S., Shaffer, K., Jang, J.Y., and Hodas, N. (August, January 30). Separating facts from fiction: Linguistic models to classify suspicious and trusted news posts on twitter. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Vancouver, Canada."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.ins.2017.01.015","article-title":"Neural networks for deceptive opinion spam detection: An empirical study","volume":"385","author":"Ren","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., and Gao, J. (2018, January 19\u201323). Eann: Event adversarial neural networks for multi-modal fake news detection. Proceedings of the 24th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), London, UK.","DOI":"10.1145\/3219819.3219903"},{"key":"ref_24","unstructured":"Du, N., Liang, Y., Balcan, M., and Song, L. (2014, January 21\u201326). Influence function learning in information diffusion networks. Proceedings of the International Conference on Machine Learning, Beijing, China."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Najar, A., Denoyer, L., and Gallinari, P. (2012, January 16\u201320). Predicting information diffusion on social networks with partial knowledge. Proceedings of the 21st International Conference on World Wide Web, Lyon, France.","DOI":"10.1145\/2187980.2188261"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Draper, N.R., and Smith, H. (1998). Applied Regression Analysis, John Wiley & Sons.","DOI":"10.1002\/9781118625590"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1038\/540525a","article-title":"Study epidemiology of fake news","volume":"540","author":"Kucharski","year":"2016","journal-title":"Nature"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1145\/3137597.3137600","article-title":"Fake news detection on social media: A data mining perspective","volume":"19","author":"Shu","year":"2017","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ma, J., Gao, W., and Wong, K.F. (2018, January 15\u201320). Rumor detection on twitter with tree-structured recursive neural networks. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1184"},{"key":"ref_30","first-page":"1201","article-title":"Graph kernels","volume":"11","author":"Vishwanathan","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, K., Yang, S., and Zhu, K.Q. (2015, January 13\u201316). False rumors detection on sina weibo by propagation structures. Proceedings of the2015 IEEE 31st International Conference on Data Engineering, Seoul, Korea.","DOI":"10.1109\/ICDE.2015.7113322"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"30","DOI":"10.15585\/mmwr.mm6502e1","article-title":"Interim guidelines for pregnant women during a Zika virus outbreak\u2014United States, 2016","volume":"65","author":"Petersen","year":"2016","journal-title":"Morb. Mortal. Wkly Rep."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Esteves, D., Reddy, A.J., Chawla, P., and Lehmann, J. (2018). Belittling the source: Trustworthiness indicators to obfuscate fake news on the web. arXiv.","DOI":"10.18653\/v1\/W18-5508"},{"key":"ref_34","unstructured":"Dungs, S., Aker, A., Fuhr, N., and Bontcheva, K. (2018, January 20\u201326). Can rumour stance alone predict veracity?. Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA."},{"key":"ref_35","first-page":"5","article-title":"Un (der) paid Innovators. The Commercial Utilization of Consumer Work through Crowdsourcing","volume":"4","author":"Kleemann","year":"2008","journal-title":"Sci. Technol. Innov. Stud."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schenk, E., and Guittard, C. (2011). Towards a characterization of crowdsourcing practices. J. Innov. Econ. Manag., 93\u2013107.","DOI":"10.3917\/jie.007.0093"},{"key":"ref_37","first-page":"7522","article-title":"Le crowdsourcing: typologie et enjeux d\u2019une externalisation vers la foule","volume":"2","author":"Guittard","year":"2011","journal-title":"Document de Travail du Bureau d\u2019\u00e9conomie Th\u00e9orique et Appliqu\u00e9e"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Thomas, K., Grier, C., Song, D., and Paxson, V. (2011, January 2\u20134). Suspended accounts in retrospect: An analysis of twitter spam. Proceedings of the 2011 ACM SIGCOMM Conference on Internet Measurement Conference, Berlin, Germany.","DOI":"10.1145\/2068816.2068840"},{"key":"ref_39","first-page":"407","article-title":"Crowdfunding: The current state of research","volume":"14","author":"Bouncken","year":"2015","journal-title":"Int. Bus. Econ. Res. J."},{"key":"ref_40","first-page":"32","article-title":"Crowdsourcing\u2013what it is, works and why it involves so many people?","volume":"48","year":"2016","journal-title":"World Sci. News"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1111\/ijmr.12135","article-title":"Crowdsourcing: A review and suggestions for future research","volume":"20","author":"Ghezzi","year":"2018","journal-title":"Int. J. Manag. Rev."},{"key":"ref_42","first-page":"1","article-title":"The rise of crowdsourcing","volume":"14","author":"Howe","year":"2006","journal-title":"Wired Mag."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1037\/xge0000042","article-title":"Automaticity of unconscious response inhibition: Comment on Chiu and Aron (2014)","volume":"144","author":"Lin","year":"2015","journal-title":"J. Exp. Psychol. Gen."},{"key":"ref_44","unstructured":"Granskogen, T. (2018). Automatic Detection of Fake News in Social Media using Contextual Information. [Master\u2019s Thesis, NTNU]."},{"key":"ref_45","unstructured":"Kumar, S., and Shah, N. (2018). False information on web and social media: A survey. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Marsick, V.J., and Watkins, K. (2015). Informal and Incidental Learning in the Workplace (Routledge Revivals), Routledge.","DOI":"10.4324\/9781315715926"},{"key":"ref_47","unstructured":"Ahmadou, F. (2020, June 01). Welcome to Our Crowdsourcing Platform. Available online: hoax.smartedubizness.com."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s10624-009-9113-x","article-title":"Sustainable mining","volume":"34","author":"Kirsch","year":"2010","journal-title":"Dialect. Anthropol."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/6\/319\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:38:29Z","timestamp":1760175509000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/6\/319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,12]]},"references-count":48,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["info11060319"],"URL":"https:\/\/doi.org\/10.3390\/info11060319","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2020,6,12]]}}}