{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T02:35:13Z","timestamp":1788489313748,"version":"build-2803163510"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1943370"],"award-info":[{"award-number":["1943370"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>As news is increasingly spread through social media platforms, the problem of identifying misleading or false information (colloquially called \"fake news'') has come into sharp focus. There are many factors which may help users judge the accuracy of news articles, ranging from the text itself to meta-data like the headline, an image, or the bias of the originating source. In this research, participants (\\textitn = 175) of various political ideological leaning categorized news articles as real or fake based on either article text or meta-data. We used a mixed methods approach to investigate how various article elements (news title, image, source bias, and excerpt) impact users' accuracy in identifying real and fake news. We also compared human performance to automated detection based on the same article elements and found that automated techniques were more accurate than our human sample while in both cases the best performance came not from the article text itself but when focusing on some elements of meta-data. Adding the source bias does not help humans, but does help computer automated detectors. Open-ended responses suggested that the image in particular may be a salient element for humans detecting fake news.<\/jats:p>","DOI":"10.1145\/3449183","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:47:59Z","timestamp":1619113679000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["That's Fake News! Reliability of News When Provided Title, Image, Source Bias &amp; Full Article"],"prefix":"10.1145","volume":"5","author":[{"given":"Francesca","family":"Spezzano","sequence":"first","affiliation":[{"name":"Boise State University, Boise, ID, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anu","family":"Shrestha","sequence":"additional","affiliation":[{"name":"Boise State University, Boise, ID, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jerry Alan","family":"Fails","sequence":"additional","affiliation":[{"name":"Boise State University, Boise, ID, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian W.","family":"Stone","sequence":"additional","affiliation":[{"name":"Boise State University, Boise, ID, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000729"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-4101(97)00014-1"},{"key":"e_1_2_1_3_1","volume-title":"See something, say something: Correction of global health misinformation on social media. Health communication","author":"Bode Leticia","year":"2018","unstructured":"Leticia Bode and Emily K Vraga. 2018. See something, say something: Correction of global health misinformation on social media. Health communication, Vol. 33, 9 (2018), 1131--1140."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167294203006"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","unstructured":"William J. Brady Molly Crockett and Jay Joseph Van Bavel. 2019. The MAD Model of Moral Contagion: The role of motivation attention and design in the spread of moralized content online. preprint. PsyArXiv. https:\/\/doi.org\/10.31234\/osf.io\/pz9g6","DOI":"10.31234\/osf.io"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1093\/ijpor\/edz037"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0026456"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2011.03.016"},{"key":"e_1_2_1_9_1","unstructured":"Pew Research Center. 2019. Demographics of Social Media Users and Adoption in the United States. https:\/\/www.pewresearch.org\/internet\/fact-sheet\/social-media\/"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272973.3274079"},{"key":"e_1_2_1_11_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_2_1_12_1","volume-title":"Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory","author":"Sc Juliet","unstructured":"Juliet DNSc and Anselm Strauss. 2014. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory fourth edition ed.). SAGE Publications, Inc, Los Angeles."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797619887896"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-2466.2006.00336.x"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964791.2901462"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmz012"},{"key":"e_1_2_1_17_1","volume-title":"Handbook of media economics.","author":"Gentzkow Matthew","unstructured":"Matthew Gentzkow, Jesse M Shapiro, and Daniel F Stone. 2015. Media bias in the marketplace: Theory. In Handbook of media economics. Vol. 1. Elsevier, 623--645."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2017.2742242"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aau4586"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1920498117"},{"key":"e_1_2_1_21_1","volume-title":"The 2nd International Workshop on News and Public Opinion at ICWSM.","author":"Benjamin","unstructured":"Benjamin D. Horne and Sibel Adali. 2017. This Just In: Fake News Packs a Lot in Title, Uses Simpler, Repetitive Content in Text Body, More Similar to Satire than Real News. In The 2nd International Workshop on News and Public Opinion at ICWSM."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the Thirteenth International Conference on Web and Social Media, ICWSM","author":"Horne Benjamin D.","year":"2019","unstructured":"Benjamin D. Horne, Dorit Nevo, John O'Donovan, Jin-Hee Cho, and Sibel Adali. 2019. Rating Reliability and Bias in News Articles: Does AI Assistance Help Everyone?. In Proceedings of the Thirteenth International Conference on Web and Social Media, ICWSM 2019. 247--256."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfu010"},{"key":"e_1_2_1_24_1","volume-title":"False Information on Web and Social Media: A Survey. CoRR","author":"Kumar Srijan","year":"2018","unstructured":"Srijan Kumar and Neil Shah. 2018. False Information on Web and Social Media: A Survey. CoRR, Vol. abs\/1804.08559 (2018)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883085"},{"key":"e_1_2_1_26_1","volume-title":"Seventh International AAAI Conference on Weblogs and Social Media. https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM13\/paper\/view\/6085","author":"Lakkaraju Himabindu","year":"2013","unstructured":"Himabindu Lakkaraju, Julian McAuley, and Jure Leskovec. 2013. What's in a Name? Understanding the Interplay between Titles, Content, and Communities in Social Media. In Seventh International AAAI Conference on Weblogs and Social Media. https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM13\/paper\/view\/6085"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1315930.1315940"},{"key":"e_1_2_1_29_1","volume-title":"Psychological approaches to credibility assessment online. The handbook of the psychology of communication technology","author":"Metzger Miriam J","year":"2015","unstructured":"Miriam J Metzger and Andrew J Flanagin. 2015. Psychological approaches to credibility assessment online. The handbook of the psychology of communication technology, Vol. 32 (2015), 445--466."},{"key":"e_1_2_1_30_1","volume-title":"Distinguishing Between Factual and Opinion Statements in the News","author":"Mitchell Amy","year":"2018","unstructured":"Amy Mitchell, Jeffrey Gottfriedd, Michael Barthel, and Nami Sumida. 2018. Distinguishing Between Factual and Opinion Statements in the News. Pew Research Center (2018)."},{"key":"e_1_2_1_31_1","volume-title":"a concept explication and taxonomy of online content. American Behavioral Scientist","author":"Molina Maria D","year":"2019","unstructured":"Maria D Molina, S Shyam Sundar, Thai Le, and Dongwon Lee. 2019. ?Fake news\" is not simply false information: a concept explication and taxonomy of online content. American Behavioral Scientist (2019), 0002764219878224."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145274"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.2.2.175"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-010-9112-2"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002512"},{"key":"e_1_2_1_36_1","first-page":"314","article-title":"Diatom autofocusing in brightfield microscopy: a comparative study","volume":"3","author":"Pech-Pacheco Jos\u00e9 Luis","year":"2000","unstructured":"Jos\u00e9 Luis Pech-Pacheco, Gabriel Crist\u00f3bal, Jes\u00fas Chamorro-Martinez, and Joaqu'in Fern\u00e1ndez-Valdivia. 2000. Diatom autofocusing in brightfield microscopy: a comparative study. In ICPR, Vol. 3. 314--317.","journal-title":"ICPR"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","unstructured":"Gordon Pennycook Ziv Epstein Mohsen Mosleh Antonio A Arechar Dean Eckles and David G Rand. 2019. Understanding and reducing the spread of misinformation online. https:\/\/doi.org\/10.31234\/osf.io\/3n9u8","DOI":"10.31234\/osf.io"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2018.06.011"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics. 3391--3401","author":"P\u00e9rez-Rosas Ver\u00f3nica","year":"2018","unstructured":"Ver\u00f3nica P\u00e9rez-Rosas, Bennett Kleinberg, Alexandra Lefevre, and Rada Mihalcea. 2018. Automatic Detection of Fake News. In Proceedings of the 27th International Conference on Computational Linguistics. 3391--3401."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1022"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","unstructured":"Ronald Robertson. 2018. Partisan Bias Scores for Web Domains. https:\/\/doi.org\/10.7910\/DVN\/QAN5VX","DOI":"10.7910\/DVN"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3305260"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290994"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341161.3342927"},{"key":"e_1_2_1_46_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_1_47_1","volume-title":"Science","volume":"359","author":"Vosoughi Soroush","year":"2018","unstructured":"Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science, Vol. 359, 6380 (2018), 1146--1151."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/1075547017731776"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Sam Wineburg and Sarah McGrew. 2017. Lateral reading: Reading less and learning more when evaluating digital information. (2017).","DOI":"10.2139\/ssrn.3048994"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1515\/opis-2019-0012"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376213"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3188731"},{"key":"e_1_2_1_53_1","volume-title":"SAFE: Similarity-Aware Multi-modal Fake News Detection. In Advances in Knowledge Discovery and Data Mining. 354--367.","author":"Zhou Xinyi","year":"2020","unstructured":"Xinyi Zhou, Jindi Wu, and Reza Zafarani. 2020. SAFE: Similarity-Aware Multi-modal Fake News Detection. In Advances in Knowledge Discovery and Data Mining. 354--367."},{"key":"e_1_2_1_54_1","volume-title":"Fake News: A Survey of Research, Detection Methods, and Opportunities. CoRR","author":"Zhou Xinyi","year":"2018","unstructured":"Xinyi Zhou and Reza Zafarani. 2018. Fake News: A Survey of Research, Detection Methods, and Opportunities. CoRR, Vol. abs\/1812.00315 (2018)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449183","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449183","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449183","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:17Z","timestamp":1750191497000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449183"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":53,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449183"],"URL":"https:\/\/doi.org\/10.1145\/3449183","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}