{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T01:07:43Z","timestamp":1776128863091,"version":"3.50.1"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100007289","name":"Purdue Research Foundation","doi-asserted-by":"publisher","award":["Ross-Lynn Research Scholar Fund"],"award-info":[{"award-number":["Ross-Lynn Research Scholar Fund"]}],"id":[{"id":"10.13039\/100007289","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-185033"],"award-info":[{"award-number":["IIS-185033"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,11,7]]},"abstract":"<jats:p>Misinformation on social media has become a serious concern. Marking news stories with credibility indicators, possibly generated by an AI model, is one way to help people combat misinformation. In this paper, we report the results of two randomized experiments that aim to understand the effects of AI-based credibility indicators on people's perceptions of and engagement with the news, when people are under social influence such that their judgement of the news is influenced by other people. We find that the presence of AI-based credibility indicators nudges people into aligning their belief in the veracity of news with the AI model's prediction regardless of its correctness, thereby changing people's accuracy in detecting misinformation. However, AI-based credibility indicators show limited impacts on influencing people's engagement with either real news or fake news when social influence exists. Finally, it is shown that when social influence is present, the effects of AI-based credibility indicators on the detection and spread of misinformation are larger as compared to when social influence is absent, when these indicators are provided to people before they form their own judgements about the news. We conclude by providing implications for better utilizing AI to fight misinformation.<\/jats:p>","DOI":"10.1145\/3555562","type":"journal-article","created":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T22:58:54Z","timestamp":1668207534000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":41,"title":["The Effects of AI-based Credibility Indicators on the Detection and Spread of Misinformation under Social Influence"],"prefix":"10.1145","volume":"6","author":[{"given":"Zhuoran","family":"Lu","sequence":"first","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]},{"given":"Patrick","family":"Li","sequence":"additional","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]},{"given":"Weilong","family":"Wang","sequence":"additional","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]},{"given":"Ming","family":"Yin","sequence":"additional","affiliation":[{"name":"Purdue University, West Lafayette, IN, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,11,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-6261.2007.01204.x"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.31.2.211"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053168019848554"},{"key":"e_1_2_2_4_1","volume-title":"Information cascades in the laboratory. The American economic review","author":"Anderson Lisa R","year":"1997","unstructured":"Lisa R Anderson and Charles A Holt . 1997. Information cascades in the laboratory. The American economic review ( 1997 ), 847--862. Lisa R Anderson and Charles A Holt. 1997. Information cascades in the laboratory. The American economic review (1997), 847--862."},{"key":"e_1_2_2_5_1","volume-title":"Exposure to social engagement metrics increases vulnerability to misinformation. arXiv preprint arXiv:2005.04682","author":"Avram Mihai","year":"2020","unstructured":"Mihai Avram , Nicholas Micallef , Sameer Patil , and Filippo Menczer . 2020. Exposure to social engagement metrics increases vulnerability to misinformation. arXiv preprint arXiv:2005.04682 ( 2020 ). Mihai Avram, Nicholas Micallef, Sameer Patil, and Filippo Menczer. 2020. Exposure to social engagement metrics increases vulnerability to misinformation. arXiv preprint arXiv:2005.04682 (2020)."},{"key":"e_1_2_2_6_1","volume-title":"Combining interventions to reduce the spread of viral misinformation. Nature Human Behaviour","author":"Bak-Coleman Joseph B","year":"2022","unstructured":"Joseph B Bak-Coleman , Ian Kennedy , Morgan Wack , Andrew Beers , Joseph S Schafer , Emma S Spiro , Kate Starbird , and Jevin D West . 2022. Combining interventions to reduce the spread of viral misinformation. Nature Human Behaviour ( 2022 ), 1--9. Joseph B Bak-Coleman, Ian Kennedy, Morgan Wack, Andrew Beers, Joseph S Schafer, Emma S Spiro, Kate Starbird, and Jevin D West. 2022. Combining interventions to reduce the spread of viral misinformation. Nature Human Behaviour (2022), 1--9."},{"key":"e_1_2_2_7_1","volume-title":"Science","volume":"348","author":"Bakshy Eytan","year":"2015","unstructured":"Eytan Bakshy , Solomon Messing , and Lada A Adamic . 2015 . Exposure to ideologically diverse news and opinion on Facebook . Science , Vol. 348 , 6239 (2015), 1130--1132. Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science, Vol. 348, 6239 (2015), 1130--1132."},{"key":"e_1_2_2_8_1","volume-title":"Optimizing AI for Teamwork. In Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Bansal Gagan","year":"2021","unstructured":"Gagan Bansal , Besmira Nushi , Ece Kamar , Eric Horvitz , and Daniel S Weld . 2021 a. Is the Most Accurate AI the Best Teammate ? Optimizing AI for Teamwork. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 35 . 11405--11414. Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, and Daniel S Weld. 2021a. Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 11405--11414."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2745939"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2020043118"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3629666"},{"key":"e_1_2_2_13_1","volume-title":"Vaccine hesitancy and (fake) news: Quasi-experimental evidence from Italy. Health economics","author":"Carrieri Vincenzo","year":"2019","unstructured":"Vincenzo Carrieri , Leonardo Madio , and Francesco Principe . 2019. Vaccine hesitancy and (fake) news: Quasi-experimental evidence from Italy. Health economics , Vol. 28 , 11 ( 2019 ), 1377--1382. Vincenzo Carrieri, Leonardo Madio, and Francesco Principe. 2019. Vaccine hesitancy and (fake) news: Quasi-experimental evidence from Italy. Health economics, Vol. 28, 11 (2019), 1377--1382."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462487"},{"key":"e_1_2_2_15_1","volume-title":"Proceedings of the 2007 ACM SIGMIS CPR conference on Computer personnel research: The global information technology workforce. 159--167","author":"Kenneth Chung Kon Shing","year":"2007","unstructured":"Kon Shing Kenneth Chung , Liaquat Hossain , and Joseph Davis . 2007 . Individual performance in knowledge intensive work through social networks . In Proceedings of the 2007 ACM SIGMIS CPR conference on Computer personnel research: The global information technology workforce. 159--167 . Kon Shing Kenneth Chung, Liaquat Hossain, and Joseph Davis. 2007. Individual performance in knowledge intensive work through social networks. In Proceedings of the 2007 ACM SIGMIS CPR conference on Computer personnel research: The global information technology workforce. 159--167."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-019-09533-0"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.03.032"},{"key":"e_1_2_2_18_1","volume-title":"CoAID: COVID-19 Healthcare Misinformation Dataset. arxiv","author":"Cui Limeng","year":"2006","unstructured":"Limeng Cui and Dongwon Lee . 2020. CoAID: COVID-19 Healthcare Misinformation Dataset. arxiv : 2006 .00885 [cs.SI] Limeng Cui and Dongwon Lee. 2020. CoAID: COVID-19 Healthcare Misinformation Dataset. arxiv: 2006.00885 [cs.SI]"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403092"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.116.3.509"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-937X.2007.00438.x"},{"key":"e_1_2_2_22_1","first-page":"4","article-title":"Selective exposure to misinformation: Evidence from the consumption of fake news during the 2016 US presidential campaign","volume":"9","author":"Guess Andrew","year":"2018","unstructured":"Andrew Guess , Brendan Nyhan , and Jason Reifler . 2018 . Selective exposure to misinformation: Evidence from the consumption of fake news during the 2016 US presidential campaign . European Research Council , Vol. 9 , 3 (2018), 4 . Andrew Guess, Brendan Nyhan, and Jason Reifler. 2018. Selective exposure to misinformation: Evidence from the consumption of fake news during the 2016 US presidential campaign. European Research Council , Vol. 9, 3 (2018), 4.","journal-title":"European Research Council"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2020.100043"},{"key":"e_1_2_2_24_1","unstructured":"Elle Hunt. 2017. 'Disputed by multiple fact-checkers': Facebook rolls out new alert to combat fake news. https:\/\/www.theguardian.com\/technology\/2017\/mar\/22\/facebook-fact-checking-tool-fake-news.  Elle Hunt. 2017. 'Disputed by multiple fact-checkers': Facebook rolls out new alert to combat fake news. https:\/\/www.theguardian.com\/technology\/2017\/mar\/22\/facebook-fact-checking-tool-fake-news."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/13669877.2020.1756385"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531677"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376873"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386253"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445562"},{"key":"e_1_2_2_30_1","volume-title":"Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy & internet","author":"Mena Paul","year":"2020","unstructured":"Paul Mena . 2020. Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy & internet , Vol. 12 , 2 ( 2020 ), 165--183. Paul Mena. 2020. Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy & internet, Vol. 12, 2 (2020), 165--183."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512258"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Mohsen Mosleh Cameron Martel Dean Eckles and David Rand. 2021. Perverse Downstream Consequences of Debunking: Being Corrected by Another User for Posting False Political News Increases Subsequent Sharing of Low Quality Partisan and Toxic Content in a Twitter Field Experiment. In proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--13.  Mohsen Mosleh Cameron Martel Dean Eckles and David Rand. 2021. Perverse Downstream Consequences of Debunking: Being Corrected by Another User for Posting False Political News Increases Subsequent Sharing of Low Quality Partisan and Toxic Content in a Twitter Field Experiment. In proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--13.","DOI":"10.1145\/3411764.3445642"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0228882"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242666"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2019.3478"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000465"},{"key":"e_1_2_2_37_1","volume-title":"Nature","volume":"592","author":"Pennycook Gordon","year":"2021","unstructured":"Gordon Pennycook , Ziv Epstein , Mohsen Mosleh , Antonio A Arechar , Dean Eckles , and David G Rand . 2021 . Shifting attention to accuracy can reduce misinformation online . Nature , Vol. 592 , 7855 (2021), 590--595. Gordon Pennycook, Ziv Epstein, Mohsen Mosleh, Antonio A Arechar, Dean Eckles, and David G Rand. 2021. Shifting attention to accuracy can reduce misinformation online. Nature, Vol. 592, 7855 (2021), 590--595."},{"key":"e_1_2_2_38_1","volume-title":"Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychological science","author":"Pennycook Gordon","year":"2020","unstructured":"Gordon Pennycook , Jonathon McPhetres , Yunhao Zhang , Jackson G Lu , and David G Rand . 2020b. Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychological science , Vol. 31 , 7 ( 2020 ), 770--780. Gordon Pennycook, Jonathon McPhetres, Yunhao Zhang, Jackson G Lu, and David G Rand. 2020b. Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy-nudge intervention. Psychological science, Vol. 31, 7 (2020), 770--780."},{"key":"e_1_2_2_39_1","volume-title":"The psychology of fake news. Trends in cognitive sciences","author":"Pennycook Gordon","year":"2021","unstructured":"Gordon Pennycook and David G Rand . 2021. The psychology of fake news. Trends in cognitive sciences ( 2021 ). Gordon Pennycook and David G Rand. 2021. The psychology of fake news. Trends in cognitive sciences (2021)."},{"key":"e_1_2_2_40_1","volume-title":"Can't we just disregard fake news? The consequences of exposure to inaccurate information. Policy Insights from the Behavioral and Brain Sciences","author":"Rapp David N","year":"2018","unstructured":"David N Rapp and Nikita A Salovich . 2018. Can't we just disregard fake news? The consequences of exposure to inaccurate information. Policy Insights from the Behavioral and Brain Sciences , Vol. 5 , 2 ( 2018 ), 232--239. David N Rapp and Nikita A Salovich. 2018. Can't we just disregard fake news? The consequences of exposure to inaccurate information. Policy Insights from the Behavioral and Brain Sciences, Vol. 5, 2 (2018), 232--239."},{"key":"e_1_2_2_41_1","volume-title":"When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In CHI Conference on Human Factors in Computing Systems. 1--14","author":"Rechkemmer Amy","year":"2022","unstructured":"Amy Rechkemmer and Ming Yin . 2022 . When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In CHI Conference on Human Factors in Computing Systems. 1--14 . Amy Rechkemmer and Ming Yin. 2022. When Confidence Meets Accuracy: Exploring the Effects of Multiple Performance Indicators on Trust in Machine Learning Models. In CHI Conference on Human Factors in Computing Systems. 1--14."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326027"},{"key":"e_1_2_2_43_1","unstructured":"Yoel Roth and Nick Pickles. 2020. Updating our approach to misleading information. https:\/\/blog.twitter.com\/en_us\/topics\/product\/2020\/updating-our-approach-to-misleading-information.  Yoel Roth and Nick Pickles. 2020. Updating our approach to misleading information. https:\/\/blog.twitter.com\/en_us\/topics\/product\/2020\/updating-our-approach-to-misleading-information."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326012"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIC.2018.00048"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0203958"},{"key":"e_1_2_2_47_1","volume-title":"Analyst forecasts and herding behavior. The review of financial studies","author":"Trueman Brett","year":"1994","unstructured":"Brett Trueman . 1994. Analyst forecasts and herding behavior. The review of financial studies , Vol. 7 , 1 ( 1994 ), 97--124. Brett Trueman. 1994. Analyst forecasts and herding behavior. The review of financial studies , Vol. 7, 1 (1994), 97--124."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341161.3343526"},{"key":"e_1_2_2_49_1","unstructured":"John C Turner. 1991. Social influence. Thomson Brooks\/Cole Publishing Co.  John C Turner. 1991. Social influence. Thomson Brooks\/Cole Publishing Co."},{"key":"e_1_2_2_50_1","volume-title":"Science","volume":"359","author":"Vosoughi Soroush","year":"2018","unstructured":"Soroush Vosoughi , Deb Roy , and Sinan Aral . 2018 . The spread of true and false news online . Science , Vol. 359 , 6380 (2018), 1146--1151. Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online. Science, Vol. 359, 6380 (2018), 1146--1151."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797620952797"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1026\/0033-3042.55.2.72"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450650"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373464.3373475"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376213"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555562","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555562","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555562","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:03Z","timestamp":1750182543000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555562"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":57,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2022,11,7]]}},"alternative-id":["10.1145\/3555562"],"URL":"https:\/\/doi.org\/10.1145\/3555562","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}