{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T00:07:28Z","timestamp":1771459648232,"version":"3.50.1"},"reference-count":115,"publisher":"MIS Quarterly","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,3,1]]},"abstract":"<jats:p>This research note examines how sociocognitive influences can systematically distort crowdsourced ground truth in event-centric data through subgroups. The \u201cwisdom of the crowd\u201d is based on the assumption that consensus drives accuracy. While existing research addresses the tendencies of the overall crowd, this research note shows that identifiable subgroups within the crowd can systematically influence crowdsource validation. We conducted an immersive experiment to investigate whether crowd consensus can be systematically distorted by subgroup-based sociocognitive influences, such as affective polarization. In the experiment, raters from a range of subgroups with varying levels of affective polarization were asked to view and validate crisis data from a violent public riot in the year 2020. Relying in part on double debiased machine learning techniques, we analyzed heterogeneous treatment effects across subgroups. The results show that affective polarization and more extreme raters, via the constructs of loyalty and betrayal, distort consensus-based ground truth in different ways. This research note demonstrates how subgroup-based sociocognitive influences can systematically distort the results of consensus-based crowdsourced validation. Additionally, it provides guidance for research and practice on how to account for identifiable subgroups in the crowd. These findings challenge key assumptions about the wisdom of crowds and the accuracy of crowdsourced ground truth in event-centric situations.<\/jats:p>","DOI":"10.25300\/misq\/2024\/17482","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T15:42:31Z","timestamp":1723045351000},"page":"347-366","source":"Crossref","is-referenced-by-count":2,"title":["Do Crowds Validate False Data? Systematic Distortion and Affective Polarization"],"prefix":"10.25300","volume":"49","author":[{"given":"Daniel A.","family":"Pienta","sequence":"first","affiliation":[{"name":"Department of Accounting and Information Management Haslam College of Business, University of Tennessee, Knoxville, TN, U.S.A."}]},{"given":"Sriram","family":"Somanchi","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Analytics, and Operations, Mendoza College of Business, University of Notre Dame, South Bend, IN, U.S.A."}]},{"given":"Nishant","family":"Vishwamitra","sequence":"additional","affiliation":[{"name":"Department of Information Systems and Cyber Security, Alvarez College of Business, University of Texas at San Antonio, San Antonio, TX, U.S.A."}]},{"given":"Nicholas","family":"Berente","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Analytics, and Operations, Mendoza College of Business, University of Notre Dame, South Bend, IN, U.S.A."}]},{"given":"Jason Bennett","family":"Thatcher","sequence":"additional","affiliation":[{"name":"Leeds School of Business, University of Colorado Boulder, Boulder, CO, U.S.A."},{"name":"Alliance Manchester Business School, University of Manchester, Manchester, U.K."}]}],"member":"10933","published-online":{"date-parts":[[2025,3,1]]},"reference":[{"key":"2025082211025635200_b1-13_rn_10_25300_misq_2024_17482","unstructured":"Anti-Defamation League\n          . (2017). Who are ANTIFA?\u2008https:\/\/www.adl.org\/resources\/backgrounder\/who-are-antifa"},{"issue":"4","key":"2025082211025635200_b2-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1177\/1094428114547952","article-title":"Best practice recommendations for designing and implementing experimental vignette methodology Studies","volume":"17","author":"Aguinis","year":"2014","journal-title":"Organizational Research Methods"},{"issue":"3","key":"2025082211025635200_b3-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1287\/isre.2019.0847","article-title":"Don\u2019t mention it? Analyzing user-generated content signals for early adverse event warnings","volume":"30","author":"Abbasi","year":"2019","journal-title":"Information Systems Research"},{"issue":"6","key":"2025082211025635200_b4-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"2681","DOI":"10.1109\/TKDE.2020.3017786","article-title":"Deep learning for adverse event detection from web search","volume":"34","author":"Ahmad","year":"2022","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"1","key":"2025082211025635200_b5-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1017\/S002238161100123X","article-title":"Polarized political communication, oppositional media hostility, and selective exposure","volume":"74","author":"Arceneaux","year":"2012","journal-title":"The Journal of Politics"},{"issue":"2","key":"2025082211025635200_b6-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1148","DOI":"10.1214\/18-AOS1709","article-title":"Generalized random forests","volume":"47","author":"Athey","year":"2019","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2025082211025635200_b7-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1027\/1614-2241\/a000014","article-title":"Experimental vignette studies in survey research","volume":"6","author":"Atzm\u00fcller","year":"2010","journal-title":"Methodology: European Journal of Research Methods for the Behavioral and Social Sciences"},{"key":"2025082211025635200_b8-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1627","DOI":"10.1109\/BigData.2017.8258097","article-title":"Detecting and summarizing emergent events in microblogs and social media streams by dynamic centralities","author":"Avudaiappan","year":"2017"},{"key":"2025082211025635200_b9-13_rn_10_25300_misq_2024_17482","first-page":"213","article-title":"Social-learning theory of identificatory processes","volume-title":"Handbook of socialization theory and research","author":"Bandura","year":"1969"},{"issue":"3","key":"2025082211025635200_b10-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1521\/jscp.1986.4.3.359","article-title":"The explanatory and predictive scope of self-efficacy theory","volume":"4","author":"Bandura","year":"1986","journal-title":"Journal of Social and Clinical Psychology"},{"issue":"1","key":"2025082211025635200_b11-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"115","DOI":"10.25300\/MISQ\/2017\/41.1.06","article-title":"Trust and the strength of ties in online social networks: An exploratory field experiment","volume":"41","author":"Bapna","year":"2017","journal-title":"MIS Quarterly"},{"issue":"10","key":"2025082211025635200_b12-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1177\/0956797615594620","article-title":"Tweeting from left to right: Is online political communication more than an echo chamber?","volume":"26","author":"Barber\u00e1","year":"2015","journal-title":"Psychological Science"},{"issue":"26","key":"2025082211025635200_b13-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"E5070","DOI":"10.1073\/pnas.1615978114","article-title":"Network dynamics of social influence in the wisdom of crowds","volume":"114","author":"Becker","year":"2017","journal-title":"PNAS"},{"issue":"5","key":"2025082211025635200_b14-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"3949","DOI":"10.1287\/mnsc.2021.4127","article-title":"The crowd classification problem: Social dynamics of binary-choice accuracy","volume":"68","author":"Becker","year":"2022","journal-title":"Management Science"},{"issue":"1","key":"2025082211025635200_b15-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1287\/isre.2018.0774","article-title":"Research commentary\u2014Data-driven Computationally Intensive Theory Development","volume":"30","author":"Berente","year":"2019","journal-title":"Information Systems Research"},{"key":"2025082211025635200_b16-13_rn_10_25300_misq_2024_17482","unstructured":"Bisserbe, N., & Dalton, M. (2023). French workers mount new strike against Macron\u2019s pension overhaul. The Wall Street Journal. https:\/\/www.wsj.com\/articles\/france-workers-strike-macron-retirement-age-11675157389"},{"issue":"1","key":"2025082211025635200_b17-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1287\/isre.2015.0605","article-title":"Rate or trade? Identifying winning ideas in open idea sourcing","volume":"27","author":"Blohm","year":"2016","journal-title":"Information Systems Research"},{"issue":"4","key":"2025082211025635200_b18-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1287\/orsc.6.4.350","article-title":"Perspective making and perspective taking in communities of knowing","volume":"6","author":"Boland","year":"1995","journal-title":"Organization Science"},{"issue":"4","key":"2025082211025635200_b19-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"941","DOI":"10.25300\/MISQ\/2016\/40.4.07","article-title":"Crowd-Squared","volume":"40","author":"Brynjolfsson","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082211025635200_b20-13_rn_10_25300_misq_2024_17482","unstructured":"Cabral, S.\n           (2023). Sri Lanka\u2019s anti-government protests have gone silent\u2014for now. BBC. https:\/\/www.bbc.com\/news\/world-asia-64142694"},{"key":"2025082211025635200_b21-13_rn_10_25300_misq_2024_17482","article-title":"The enemy within: A social history of treason","volume-title":"Citizen espionage: Studies in trust and betrayal","author":"Carney","year":"1994"},{"issue":"4","key":"2025082211025635200_b22-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"931","DOI":"10.25300\/MISQ\/2015\/39.4.9","article-title":"Me, my self, and I(T)","volume":"39","author":"Carter","year":"2015","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082211025635200_b23-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1080\/07421222.2019.1598686","article-title":"Monetary incentive and stock opinions on social media","volume":"36","author":"Chen","year":"2019","journal-title":"Journal of Management Information Systems"},{"key":"2025082211025635200_b24-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.1111\/ectj.12097","volume-title":"Double\/debiased machine learning for treatment and structural parameters","author":"Chernozhukov","year":"2018"},{"issue":"4","key":"2025082211025635200_b25-13_rn_10_25300_misq_2024_17482","first-page":"332","article-title":"Volunteered geographic information: The nature and motivation of produsers","volume":"4","author":"Coleman","year":"2009","journal-title":"International Journal of Spatial Data Infrastructures Research"},{"issue":"4","key":"2025082211025635200_b26-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1080\/17439884.2018.1544149","article-title":"Memes and symbolic violence: #proudboys and the use of memes for propaganda and the construction of collective identity","volume":"43","author":"DeCook","year":"2018","journal-title":"Learning, Media and Technology"},{"issue":"1","key":"2025082211025635200_b27-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/srep37825","article-title":"Echo chambers: Emotional contagion and group polarization on Facebook","volume":"6","author":"Del Vicario","year":"2016","journal-title":"Scientific Reports"},{"issue":"2","key":"2025082211025635200_b28-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1111\/ajps.12044","article-title":"Does choice bring loyalty? Electoral participation and the development of party identification","volume":"58","author":"Dinas","year":"2014","journal-title":"American Journal of Political Science"},{"issue":"11","key":"2025082211025635200_b29-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1111\/ajps.12044open_in_new","article-title":"Medical crowdsourcing: Harnessing the \u201cwisdom of the crowd\u201d to solve medical mysteries","volume":"20","author":"Dissanayake","year":"2019","journal-title":"Journal of the Association for Information Systems"},{"key":"2025082211025635200_b30-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1290","DOI":"10.1145\/2998181.2998216","article-title":"Mass participation during emergency response: Event-centric Crowdsourcing in Humanitarian mapping","author":"Dittus","year":"2017"},{"issue":"3","key":"2025082211025635200_b31-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"547","DOI":"10.2307\/259294","article-title":"Betrayal of trust in organizations","volume":"23","author":"Elangovan","year":"1998","journal-title":"The Academy of Management Review"},{"key":"2025082211025635200_b32-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"3007","DOI":"10.1145\/3340531.3412876","article-title":"A multidimensional dataset based on crowdsourcing for analyzing and detecting news bias","author":"F\u00e4rber","year":"2020"},{"key":"2025082211025635200_b33-13_rn_10_25300_misq_2024_17482","unstructured":"Fassihi, F.\n           (2022). Iran cracks down as protests show no sign of easing. The New York Times. https:\/\/www.nytimes.com\/2022\/11\/15\/world\/middleeast\/iran-protests-tehran-metro-shooting.html"},{"issue":"3","key":"2025082211025635200_b34-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/j.jsis.2012.03.002","article-title":"Orchestrating\u201d sustainable crowdsourcing: A characterisation of solver brokerages","volume":"21","author":"Feller","year":"2012","journal-title":"The Journal of Strategic Information Systems"},{"key":"2025082211025635200_b35-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/2206.00885","author":"Fingerhut","year":"2022","journal-title":"Coordinated double machine learning"},{"key":"2025082211025635200_b36-13_rn_10_25300_misq_2024_17482","volume-title":"Social cognition","author":"Fiske","year":"1991"},{"issue":"5","key":"2025082211025635200_b37-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"888","DOI":"10.1086\/508117","article-title":"Exploratory experiments","volume":"72","author":"Franklin","year":"2005","journal-title":"Philosophy of Science"},{"issue":"3","key":"2025082211025635200_b38-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1016\/0191-8869(86)90014-0","article-title":"Response bias, social desirability and dissimulation","volume":"7","author":"Furnham","year":"1986","journal-title":"Personality and Individual Differences"},{"issue":"1","key":"2025082211025635200_b39-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1111\/j.1540-5907.2008.00362.x","article-title":"Confirmation politics and the legitimacy of the US Supreme Court: Institutional loyalty, positivity bias, and the Alito nomination","volume":"53","author":"Gibson","year":"2009","journal-title":"American Journal of Political Science"},{"key":"2025082211025635200_b40-13_rn_10_25300_misq_2024_17482","first-page":"30","article-title":"Toward a comparative research agenda on affective polarization in mass publics","volume":"29","author":"Gidron","year":"2019","journal-title":"APSA Comparative Politics Newsletter"},{"issue":"2","key":"2025082211025635200_b41-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.jsis.2019.01.001","article-title":"Crowdwork platform governance toward organizational value creation","volume":"28","author":"Gol","year":"2019","journal-title":"The Journal of Strategic Information Systems"},{"key":"2025082211025635200_b42-13_rn_10_25300_misq_2024_17482","article-title":"Generative adversarial nets","author":"Goodfellow","year":"2014"},{"issue":"3","key":"2025082211025635200_b43-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"945","DOI":"10.25300\/MISQ\/2018\/14084","article-title":"Do experts or crowd-based models produce more bias? Evidence from Encyclopedia Britannica and Wikipedia","volume":"42","author":"Greenstein","year":"2018","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082211025635200_b44-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1287\/isre.2014.0531","article-title":"Research note\u2014The allure of homophily in social media: Evidence from investor responses on virtual communities","volume":"25","author":"Gu","year":"2014","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082211025635200_b45-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1198\/jcgs.2010.08162","article-title":"Bayesian nonparametric modeling for causal inference","volume":"20","author":"Hill","year":"2011","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"2025082211025635200_b46-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/2008.05174","author":"Huang","year":"2020","journal-title":"Information verification for humanitarians: A critical review"},{"issue":"3","key":"2025082211025635200_b47-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1080\/07421222.2015.1099181","article-title":"Machiavellianism or morality: which behavior pays off in online innovation contests?","volume":"32","author":"Hutter","year":"2015","journal-title":"Journal of Management Information Systems"},{"key":"2025082211025635200_b48-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference in statistics, social, and biomedical sciences","author":"Imbens","year":"2015"},{"key":"2025082211025635200_b49-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1146\/annurev-polisci-051117-073034","article-title":"The origins and consequences of affective polarization in the United States","volume":"22","author":"Iyengar","year":"2019","journal-title":"Annual Review of Political Science"},{"issue":"2","key":"2025082211025635200_b50-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1006\/obhd.1994.1080","article-title":"Dispositional group loyalty and individual action for the benefit of an ingroup: Experimental and correlational evidence","volume":"60","author":"James","year":"1994","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"2025082211025635200_b51-13_rn_10_25300_misq_2024_17482","first-page":"243","article-title":"Betrayal in relationships","volume-title":"Perspectives on close relationships","author":"Jones","year":"1994"},{"issue":"4","key":"2025082211025635200_b52-13_rn_10_25300_misq_2024_17482","first-page":"iii","article-title":"Editor\u2019s comments: Opportunities and challenges for different types of online experiments","volume":"42","author":"Karahanna","year":"2018","journal-title":"MIS Quarterly"},{"key":"2025082211025635200_b53-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1312.6114","author":"Kingma","year":"2013","journal-title":"Auto-encoding variational Bayes"},{"issue":"4","key":"2025082211025635200_b54-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1619","DOI":"10.25300\/MISQ\/2020\/16371","article-title":"Understanding echo chambers and filter bubbles: The impact of social media on diversification and partisan shifts in news consumption","volume":"44","author":"Kitchens","year":"2020","journal-title":"MIS Quarterly"},{"key":"2025082211025635200_b55-13_rn_10_25300_misq_2024_17482","first-page":"297","article-title":"From Twitter to Charlottesville: Analyzing the fighting words between the alt-right and Antifa","volume":"13","author":"Klein","year":"2019","journal-title":"International Journal of Communication"},{"key":"2025082211025635200_b56-13_rn_10_25300_misq_2024_17482","volume-title":"Principles and practice of structural equation modeling","author":"Kline","year":"2015"},{"issue":"2","key":"2025082211025635200_b57-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/S0749-5978(02)00518-6","article-title":"Betrayal aversion: When agents of protection become agents of harm","volume":"90","author":"Koehler","year":"2003","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"2025082211025635200_b58-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6291.001.0001","volume-title":"Social cognition: Making sense of people","author":"Kunda","year":"1999"},{"key":"2025082211025635200_b59-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"4156","DOI":"10.1073\/pnas.1804597116","article-title":"Metalearners for estimating heterogeneous treatment effects using machine learning","author":"K\u00fcnzel","year":"2019"},{"key":"2025082211025635200_b60-13_rn_10_25300_misq_2024_17482","volume-title":"Swiping right: The allure of hyper masculinity and cryptofascism for men who join the Proud Boys","author":"Kutner","year":"2020"},{"issue":"3","key":"2025082211025635200_b61-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1007\/s12115-018-0246-x","article-title":"Is Antifa a terrorist group?","volume":"55","author":"LaFree","year":"2018","journal-title":"Society"},{"issue":"1","key":"2025082211025635200_b62-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1111\/j.2044-8309.1993.tb00983.x","article-title":"Groups as problem-solving units: Toward a new meaning of social cognition","volume":"32","author":"Larson","year":"1993","journal-title":"British Journal of Social Psychology"},{"key":"2025082211025635200_b63-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1145\/2531602.2531733","article-title":"Information extraction and manipulation threats in crowd-powered systems","author":"Lasecki","year":"2014"},{"issue":"2","key":"2025082211025635200_b64-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1287\/isre.2018.0775","article-title":"Salience bias in crowdsourcing contests","volume":"29","author":"Lee","year":"2018","journal-title":"Information Systems Research"},{"issue":"3","key":"2025082211025635200_b65-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1037\/pspi0000136","article-title":"Who is trustworthy? Predicting trustworthy intentions and behavior","volume":"115","author":"Levine","year":"2018","journal-title":"Journal of Personality and Social Psychology"},{"issue":"1","key":"2025082211025635200_b66-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1080\/14792779543000093","article-title":"Group socialization: Theory and research","volume":"5","author":"Levine","year":"1994","journal-title":"European Review of Social Psychology"},{"issue":"3","key":"2025082211025635200_b67-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.jsis.2016.06.002","article-title":"Cargo cult\u201d science in traditional organization and information systems survey research: A case for using nontraditional methods of data collection, including Mechanical Turk and online panels","volume":"25","author":"Lowry","year":"2016","journal-title":"The Journal of Strategic Information Systems"},{"issue":"12","key":"2025082211025635200_b68-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"2346","DOI":"10.1109\/TKDE.2018.2876857","article-title":"Learning under concept drift: A review","volume":"31","author":"Lu","year":"2018","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"4","key":"2025082211025635200_b69-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1287\/isre.2014.0537","article-title":"The IQ of the crowd: Understanding and improving information quality in structured user-generated content","volume":"25","author":"Lukyanenko","year":"2014","journal-title":"Information Systems Research"},{"issue":"4","key":"2025082211025635200_b70-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"297","DOI":"10.17705\/1jais.00456","article-title":"Representing crowd knowledge: Guidelines for conceptual modeling of user-generated content","volume":"18","author":"Lukyanenko","year":"2017","journal-title":"Journal of the Association for Information Systems"},{"issue":"2","key":"2025082211025635200_b71-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"623","DOI":"10.25300\/MISQ\/2019\/14439","article-title":"Expecting the unexpected: Effects of data collection design choices on the quality of crowdsourced user-generated content","volume":"43","author":"Lukyanenko","year":"2019","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082211025635200_b72-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.1177\/2053168017737411","article-title":"Supporters and opponents of Donald Trump respond differently to racial cues: An experimental analysis","volume":"4","author":"Luttig","year":"2017","journal-title":"Research & Politics"},{"issue":"1","key":"2025082211025635200_b73-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1287\/orsc.1060.0228","article-title":"Coordinating expertise among emergent groups responding to disasters","volume":"18","author":"Majchrzak","year":"2007","journal-title":"Organization Science"},{"issue":"4","key":"2025082211025635200_b74-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/j.jsis.2013.07.004","article-title":"Towards an information systems perspective and research agenda on crowdsourcing for innovation","volume":"22","author":"Majchrzak","year":"2013","journal-title":"The Journal of Strategic Information Systems"},{"issue":"6","key":"2025082211025635200_b75-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","article-title":"A survey on bias and fairness in machine learning","volume":"54","author":"Mehrabi","year":"2021","journal-title":"ACM Computing Surveys"},{"issue":"3","key":"2025082211025635200_b76-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"919","DOI":"10.25300\/MISQ\/2018\/14103","article-title":"Know when to run","volume":"42","author":"Mo","year":"2018","journal-title":"MIS Quarterly"},{"issue":"6","key":"2025082211025635200_b77-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s41562-018-0353-0","article-title":"Moralization in social networks and the emergence of violence during protests","volume":"2","author":"Mooijman","year":"2018","journal-title":"Nature Human Behaviour"},{"key":"2025082211025635200_b78-13_rn_10_25300_misq_2024_17482","first-page":"87","article-title":"Self-categorization and work group socialization","volume-title":"Social identity processes in organizational contexts","author":"Moreland","year":"2001"},{"issue":"12","key":"2025082211025635200_b79-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1476","DOI":"10.1177\/01461672992510004","article-title":"Gone but not forgotten: Loyalty and betrayal among ex-members of small groups","volume":"25","author":"Moreland","year":"1999","journal-title":"Personality and Social Psychology Bulletin"},{"issue":"3","key":"2025082211025635200_b80-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1037\/vio0000176","article-title":"Situational dynamics and the emergence of violence in protests","volume":"8","author":"Nassauer","year":"2018","journal-title":"Psychology of Violence"},{"issue":"2","key":"2025082211025635200_b81-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1093\/biomet\/asaa076","article-title":"Quasi-oracle estimation of heterogeneous treatment effects","volume":"108","author":"Nie","year":"2021","journal-title":"Biometrika"},{"issue":"2","key":"2025082211025635200_b82-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1037\/0033-295X.108.2.291","article-title":"Culture and systems of thought: holistic versus analytic cognition","volume":"108","author":"Nisbett","year":"2001","journal-title":"Psychological Review"},{"issue":"2","key":"2025082211025635200_b83-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"407","DOI":"10.25300\/MISQ\/2013\/37.2.05","article-title":"Community intelligence and social media services: A rumor theoretic analysis of tweets during social crises","volume":"37","author":"Oh","year":"2013","journal-title":"MIS Quarterly"},{"key":"2025082211025635200_b84-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-00914-9","article-title":"Citizen science provides a reliable and scalable tool to track disease-carrying mosquitoes","volume":"8","author":"Palmer","year":"2017","journal-title":"Nature Communications"},{"issue":"4","key":"2025082211025635200_b85-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.17705\/1jais.00875","article-title":"An empirical investigation of the unintended consequences of vulnerability assessments leading to betrayal","volume":"25","author":"Pienta","year":"2024","journal-title":"Journal of the Association for Information Systems"},{"key":"2025082211025635200_b86-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1109\/CSCWD.2019.8791903","article-title":"Towards fact-checking through crowdsourcing","author":"Pinto","year":"2019"},{"key":"2025082211025635200_b87-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2101.06914","author":"Prabhu","year":"2021","journal-title":"Capitol (Pat) riots: A comparative study of Twitter and Parler"},{"issue":"2","key":"2025082211025635200_b88-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1111\/j.1468-5973.1993.tb00009.x","article-title":"Community crises: An exploratory comparison of the characteristics and consequences of disasters and riots","volume":"1","author":"Quarantelli","year":"1993","journal-title":"Journal of Contingencies and Crisis Management"},{"issue":"2","key":"2025082211025635200_b89-13_rn_10_25300_misq_2024_17482","first-page":"iii","article-title":"Editor\u2019s comments\u2014The COVID-19 pandemic: Building resilience with IS research","volume":"44","author":"Rai","year":"2020","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082211025635200_b90-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1111\/1475-6765.12351","article-title":"Fear and loathing across party lines\u201d (also) in Europe: Affective polarisation in European party systems","volume":"59","author":"Reiljan","year":"2020","journal-title":"European Journal of Political Research"},{"key":"2025082211025635200_b91-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/978-3-030-12334-5_3","article-title":"Crowdsourcing controls: A review and research agenda for crowdsourcing controls used for macro-tasks","volume-title":"Macrotask crowdsourcing: Engaging the crowds to address complex problems","author":"Robert","year":"2019"},{"issue":"9","key":"2025082211025635200_b92-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1286","DOI":"10.1037\/apl0000232","article-title":"The role of political affiliation in employment decisions: A model and research agenda","volume":"102","author":"Roth","year":"2017","journal-title":"Journal of Applied Psychology"},{"issue":"3","key":"2025082211025635200_b93-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"695","DOI":"10.25300\/MISQ\/2019\/13747","article-title":"The sociotechnical axis of cohesion for the IS discipline: Its historical legacy and its continued relevance","volume":"43","author":"Sarker","year":"2019","journal-title":"MIS Quarterly"},{"key":"2025082211025635200_b94-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1145\/3078714.3078746","article-title":"Crowdsourcing the verification of fake news and alternative facts","author":"Sethi","year":"2017"},{"issue":"5","key":"2025082211025635200_b95-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.5465\/amj.2011.0776","article-title":"I care about nature, but\u2026\u201d: Disengaging values in assessing opportunities that cause harm","volume":"56","author":"Shepherd","year":"2013","journal-title":"Academy of Management journal"},{"issue":"6","key":"2025082211025635200_b96-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"2495","DOI":"10.1287\/mnsc.2019.3308","article-title":"Targeting prospective customers: Robustness of machine-learning methods to typical data challenges","volume":"66","author":"Simester","year":"2020","journal-title":"Management Science"},{"issue":"4","key":"2025082211025635200_b97-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1037\/0003-066X.56.4.319","article-title":"Politicized collective identity: A social psychological analysis","volume":"56","author":"Simon","year":"2001","journal-title":"American Psychologist"},{"key":"2025082211025635200_b98-13_rn_10_25300_misq_2024_17482","unstructured":"Southern Poverty Law Center\n          . (2020). Proud boys. https:\/\/www.splcenter.org\/fighting-hate\/extremist-files\/group\/proud-boys"},{"key":"2025082211025635200_b99-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.9776\/14308","article-title":"Rumors, false flags, and digital vigilantes: Misinformation on Twitter after the 2013 Boston Marathon bombing","author":"Starbird","year":"2014"},{"issue":"3","key":"2025082211025635200_b100-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1080\/00213624.1997.11505962","article-title":"How institutions learn: a socio-cognitive perspective","volume":"31","author":"Stein","year":"1997","journal-title":"Journal of Economic Issues"},{"key":"2025082211025635200_b101-13_rn_10_25300_misq_2024_17482","volume-title":"Proud boys and the White ethnostate: How the alt-right is warping the American imagination","author":"Stern","year":"2019"},{"key":"2025082211025635200_b102-13_rn_10_25300_misq_2024_17482","volume-title":"The wisdom of crowds","author":"Surowiecki","year":"2005"},{"issue":"3","key":"2025082211025635200_b103-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1111\/isj.12225","article-title":"Joining the crowd: The career anchors of information technology workers participating in crowdsourcing","volume":"29","author":"Taylor","year":"2019","journal-title":"Information Systems Journal"},{"issue":"2","key":"2025082211025635200_b104-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1111\/isj.12114","article-title":"Digitally enabled disaster response: The emergence of social media as boundary objects in a flooding disaster","volume":"27","author":"Tim","year":"2017","journal-title":"Information Systems Journal"},{"key":"2025082211025635200_b105-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2001.00179","author":"Tolosana","year":"2020","journal-title":"Deepfakes and beyond: A survey of face manipulation and fake detection. arXiv"},{"key":"2025082211025635200_b106-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.48550\/1711.09025","author":"Tschiatschek","year":"2017","journal-title":"Detecting fake news in social networks via crowdsourcing"},{"key":"2025082211025635200_b107-13_rn_10_25300_misq_2024_17482","first-page":"210","article-title":"Towards a cognitive redefinition of the social group","volume-title":"Rediscovering social identity","author":"Turner","year":"2010"},{"issue":"4","key":"2025082211025635200_b108-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1037\/0022-3514.86.4.585","article-title":"Social identity as social glue: The origins of group loyalty","volume":"86","author":"Van Vugt","year":"2004","journal-title":"Journal of Personality and Social Psychology"},{"issue":"1","key":"2025082211025635200_b109-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1287\/isre.2016.0661","article-title":"Cost-effective quality assurance in crowd labeling","volume":"28","author":"Wang","year":"2017","journal-title":"Information Systems Research"},{"issue":"2","key":"2025082211025635200_b110-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1111\/isj.12129","article-title":"Examining employee computer abuse intentions: Insights from justice, deterrence and neutralization perspectives","volume":"28","author":"Willison","year":"2018","journal-title":"Information Systems Journal"},{"issue":"CSCW2","key":"2025082211025635200_b111-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.1145\/3476086","article-title":"Cross-platform information operations: Mobilizing narratives & building resilience through both \u201cbig\u201d & \u201calt\u201d tech","volume":"5","author":"Wilson","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"issue":"2","key":"2025082211025635200_b112-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.jsis.2017.02.001","article-title":"Solvers\u2019 participation in crowdsourcing platforms: Examining the impacts of trust, and benefit and cost factors","volume":"26","author":"Ye","year":"2017","journal-title":"The Journal of Strategic Information Systems"},{"issue":"3","key":"2025082211025635200_b113-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1287\/isre.2021.1000","article-title":"Learning from crowdsourced multi-labeling: A variational Bayesian approach","volume":"32","author":"Yin","year":"2021","journal-title":"Information Systems Research"},{"key":"2025082211025635200_b114-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","DOI":"10.1145\/3274464","article-title":"From situational awareness to actionability: Towards improving the utility of social media data for crisis response","author":"Zade","year":"2018"},{"key":"2025082211025635200_b115-13_rn_10_25300_misq_2024_17482","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1145\/2684822.2685301","article-title":"Leveraging in-batch annotation bias for crowdsourced active learning","author":"Zhuang","year":"2015"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/49\/1\/347\/1678\/13_rn_10.25300_misq_2024_17482.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/49\/1\/347\/1678\/13_rn_10.25300_misq_2024_17482.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T15:03:09Z","timestamp":1755874989000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/49\/1\/347\/78\/Do-Crowds-Validate-False-Data-Systematic"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,1]]},"references-count":115,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,3,1]]},"published-print":{"date-parts":[[2025,3,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2024\/17482","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,1]]}}}