{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T14:12:57Z","timestamp":1778940777834,"version":"3.51.4"},"reference-count":115,"publisher":"MIS Quarterly","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,6,1]]},"abstract":"<jats:p>As crowdsourced user-generated content becomes an important source of data for organizations, a pressing question is how to ensure that data contributed by ordinary people outside of traditional organizational boundaries is of suitable quality to be useful for both known and unanticipated purposes. This research examines the impact of different information quality management strategies, and corresponding data collection design choices, on key dimensions of information quality in crowdsourced user-generated content. We conceptualize a contributor-centric information quality management approach focusing on instance-based data collection. We contrast it with the traditional consumer-centric fitness-for-use conceptualization of information quality that emphasizes class-based data collection. We present laboratory and field experiments conducted in a citizen science domain that demonstrate trade-offs between the quality dimensions of accuracy, completeness (including discoveries), and precision between the two information management approaches and their corresponding data collection designs. Specifically, we show that instance-based data collection results in higher accuracy, dataset completeness, and number of discoveries, but this comes at the expense of lower precision. We further validate the practical value of the instance-based approach by conducting an applicability check with potential data consumers (scientists, in our context of citizen science). In a follow-up study, we show, using human experts and supervised machine learning techniques, that substantial precision gains on instance-based data can be achieved with post-processing. We conclude by discussing the benefits and limitations of different information quality and data collection design choices for information quality in crowdsourced user-generated content.<\/jats:p>","DOI":"10.25300\/misq\/2019\/14439","type":"journal-article","created":{"date-parts":[[2019,5,30]],"date-time":"2019-05-30T12:07:42Z","timestamp":1559218062000},"page":"623-647","source":"Crossref","is-referenced-by-count":92,"title":["Expecting the Unexpected: Effects of Data Collection Design Choices on the Quality of Crowdsourced User-Generated Content1"],"prefix":"10.25300","volume":"43","author":[{"given":"Roman","family":"Lukyanenko","sequence":"first","affiliation":[{"name":"Department of Information Technologies, HEC Montr\u00e9al, Montr\u00e9al, QC Canada H3T 2A7"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Parsons","sequence":"additional","affiliation":[{"name":"Faculty of Business Administration, Memorial University of Newfoundland, St. John\u2019s, NL Canada A1B 3X5"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yolanda F.","family":"Wiersma","sequence":"additional","affiliation":[{"name":"Department of Biology, Memorial University of Newfoundland, St. John\u2019s, NL Canada A1B 3X5"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mahed","family":"Maddah","sequence":"additional","affiliation":[{"name":"Sawyer Business School, Suffolk University, Boston, MA 02108 U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10933","published-online":{"date-parts":[[2019,6,1]]},"reference":[{"issue":"2","key":"2025082212121966100_b1-12_14439_ra_lukyanenko","first-page":"1","article-title":"Text Analytics to Support Sense-Making in Social Media: A Language-Action Perspective","volume":"42","author":"Abbasi","year":"2018","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082212121966100_b2-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1287\/isre.1080.0189","article-title":"Is Query Reuse Potentially Harmful? Anchoring and Adjustment in Adapting Existing Database Queries","volume":"21","author":"Allen","year":"2010","journal-title":"Information Systems Research"},{"issue":"12","key":"2025082212121966100_b3-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1145\/1859204.1859225","article-title":"Business Impact of Web 2.0 Technologies","volume":"53","author":"Andriole","year":"2010","journal-title":"Communications of the ACM"},{"issue":"3","key":"2025082212121966100_b4-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541883","article-title":"Methodologies for Data Quality Assessment and Improvement","volume":"41","author":"Batini","year":"2009","journal-title":"Computing Surveys"},{"issue":"3","key":"2025082212121966100_b5-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1080\/00219266.1981.9654381","article-title":"When Is an Animal, Not an Animal?","volume":"15","author":"Bell","year":"1981","journal-title":"Journal of Biological Education"},{"issue":"3746","key":"2025082212121966100_b6-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1126\/science.154.3746.273","article-title":"Folk Taxonomies and Biological Classification","volume":"154","author":"Berlin","year":"1966","journal-title":"Science"},{"issue":"6","key":"2025082212121966100_b7-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pbio.1000385","article-title":"Distorted Views of Biodiversity: Spatial and Temporal Bias in Species Occurrence Data","volume":"8","author":"Boakes","year":"2010","journal-title":"PLoS Biology"},{"issue":"11","key":"2025082212121966100_b8-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1525\/bio.2009.59.11.9","article-title":"Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy","volume":"59","author":"Bonney","year":"2009","journal-title":"BioScience"},{"key":"2025082212121966100_b9-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9693.001.0001","volume-title":"Crowdsourcing","author":"Brabham","year":"2013"},{"issue":"8","key":"2025082212121966100_b10-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1016\/S0378-7206(02)00014-9","article-title":"Improving Information Requirements Determination: A Cognitive Perspective","volume":"39","author":"Browne","year":"2002","journal-title":"Information & Management"},{"issue":"4","key":"2025082212121966100_b11-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"941","DOI":"10.25300\/MISQ\/2016\/40.4.07","article-title":"Crowd-Squared: Amplifying the Predictive Power of Search Trend Data","volume":"40","author":"Brynjolfsson","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b12-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-010-9924-0","volume-title":"Treatise on Basic Philosophy: Ontology I: The Furniture of the World","author":"Bunge","year":"1977"},{"key":"2025082212121966100_b13-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.biocon.2016.05.014","article-title":"The Science of Citizen Science: Exploring Barriers to Use as a Primary Research Tool","volume":"108","author":"Burgess","year":"2017","journal-title":"Biological Conservation"},{"issue":"3","key":"2025082212121966100_b14-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1287\/isre.2017.0702","article-title":"How Can We Develop Contextualized Theories of Effective Use? A Demonstration in the Context of Community-Care Electronic Health Records","volume":"28","author":"Burton-Jones","year":"2017","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082212121966100_b15-12_14439_ra_lukyanenko","first-page":"1","article-title":"Efficacy of EBird Data as an Aid in Conservation Planning and Monitoring","volume":"1","author":"Callaghan","year":"2015","journal-title":"Journal of Field Ornithology"},{"issue":"1","key":"2025082212121966100_b16-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/320434.320440","article-title":"The Entity-Relationship Model\u2014Toward a Unified View of Data","volume":"1","author":"Chen","year":"1976","journal-title":"ACM Transactions on Database Systems"},{"issue":"9","key":"2025082212121966100_b17-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"2246","DOI":"10.1109\/TKDE.2016.2555805","article-title":"A Survey of General-Purpose Crowdsourcing Techniques","volume":"28","author":"Chittilappilly","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"2","key":"2025082212121966100_b18-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1287\/isre.2016.0631","article-title":"On the Ontological Quality and Logical Quality of Conceptual-Modeling Grammars: The Need for a Dual Perspective","volume":"27","author":"Clarke","year":"2016","journal-title":"Information Systems Research"},{"issue":"6039","key":"2025082212121966100_b19-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1126\/science.333.6039.173","article-title":"Galaxy Zoo Volunteers Share Pain and Glory of Research","volume":"333","author":"Clery","year":"2011","journal-title":"Science"},{"key":"2025082212121966100_b20-12_14439_ra_lukyanenko","first-page":"34","article-title":"ISpot Analysed: Participatory Learning and Reputation","author":"Clow","year":"2011"},{"key":"2025082212121966100_b21-12_14439_ra_lukyanenko","first-page":"CO-120","article-title":"Extending the Formal Model of a Spatial Data Infrastructure to Include Volunteered Geographical Information","author":"Cooper","year":"2011"},{"issue":"4","key":"2025082212121966100_b22-12_14439_ra_lukyanenko","first-page":"243","article-title":"How Large U.S. Companies Can Use Twitter and Other Social Media to Gain Business Value","volume":"9","author":"Culnan","year":"2010","journal-title":"MIS Quarterly Executive"},{"issue":"1","key":"2025082212121966100_b23-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1145\/3148148","article-title":"Quality Control in Crowdsourcing: A Survey of Quality Attributes, Assessment Techniques, and Assurance Actions","volume":"51","author":"Daniel","year":"2018","journal-title":"ACM Computing Surveys"},{"issue":"2","key":"2025082212121966100_b24-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"279","DOI":"10.25300\/MISQ\/2016\/40.2.01","article-title":"The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: Giving Voice to the Less Powerful through Value Sensitive Design","volume":"40","author":"Deng","year":"2016","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082212121966100_b25-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1111\/j.1467-9671.2010.01212.x","article-title":"Thirty Years of Research on Spatial Data Quality: Achievements, Failures, and Opportunities","volume":"14","author":"Devillers","year":"2010","journal-title":"Transactions in GIS"},{"issue":"3","key":"2025082212121966100_b26-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1287\/isre.1110.0405","article-title":"Research Note\u2014Music Blogging, Online Sampling, and the Long Tail","volume":"23","author":"Dewan","year":"2012","journal-title":"Information Systems Research"},{"issue":"4","key":"2025082212121966100_b27-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/1924421.1924442","article-title":"Crowd-sourcing Systems on the World-Wide Web","volume":"54","author":"Doan","year":"2011","journal-title":"Communications of the ACM"},{"issue":"3","key":"2025082212121966100_b28-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1093\/ae\/48.3.164","article-title":"Volunteer Biological Monitoring: Can It Accurately Assess the Ecological Condition of Streams?","volume":"48","author":"Engel","year":"2002","journal-title":"American Entomologist"},{"key":"2025082212121966100_b29-12_14439_ra_lukyanenko","article-title":"Hanging with the Right Crowd: Matching Crowdsourcing Need to Crowd Characteristics","author":"Erickson","year":"2012"},{"issue":"6","key":"2025082212121966100_b30-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"737","DOI":"10.4039\/tce.2015.5","article-title":"Aedes Japonicus Japonicus (Diptera: Culicidae) Arrives at the Most Easterly Point in North America","volume":"147","author":"Fielden","year":"2015","journal-title":"The Canadian Entomologist"},{"issue":"5","key":"2025082212121966100_b31-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.2193\/0091-7648(2006)34[1425:TROCSA]2.0.CO;2","article-title":"The Reliability of Citizen Science: A Case Study of Oregon White Oak Stand Surveys","volume":"34","author":"Galloway","year":"2006","journal-title":"Wildlife Society Bulletin"},{"issue":"3","key":"2025082212121966100_b32-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"565","DOI":"10.25300\/MISQ\/2015\/39.3.03","article-title":"Vocal Minority and Silent Majority: How Do Online Ratings Reflect Population Perceptions of Quality?","volume":"39","author":"Gao","year":"2015","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082212121966100_b33-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1109\/TKDE.2016.2518669","article-title":"Challenges in Data Crowdsourcing","volume":"28","author":"Garcia-Molina","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"3","key":"2025082212121966100_b34-12_14439_ra_lukyanenko","first-page":"8","article-title":"Information System Flexibility and the Cost Efficiency of Business Processes","volume":"7","author":"Gebauer","year":"2006","journal-title":"Journal of the AIS"},{"key":"2025082212121966100_b35-12_14439_ra_lukyanenko","volume-title":"Simple Heuristics That Make Us Smart","author":"Gigerenzer","year":"1999"},{"key":"2025082212121966100_b36-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511808098","volume-title":"Heuristics and Biases: The Psychology of Intuitive Judgment","author":"Gilovich","year":"2002"},{"issue":"1","key":"2025082212121966100_b37-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.25300\/MISQ\/2014\/38.1.E0","article-title":"Editor\u2019s Comments: Design Science Research in Top Information Systems Journals","volume":"38","author":"Goes","year":"2014","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b38-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3425-6","volume-title":"Resampling Methods: A Practical Guide to Data Analysis","author":"Good","year":"2001","edition":"Second"},{"issue":"1","key":"2025082212121966100_b39-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1093\/jcr\/ucx047","article-title":"Crowdsourcing Consumer Research","volume":"44","author":"Goodman","year":"2017","journal-title":"Journal of Consumer Research"},{"key":"2025082212121966100_b40-12_14439_ra_lukyanenko","first-page":"134","article-title":"The Crowd Is a Collaborative Network","author":"Gray","year":"2016"},{"key":"2025082212121966100_b41-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1183\/09031936.00136408","article-title":"Small Studies: Strengths and Limitations","volume":"32","author":"Hackshaw","year":"2008","journal-title":"European Respiratory Journal"},{"key":"2025082212121966100_b42-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/B978-008044612-7\/50056-1","article-title":"To Cognize Is to Categorize: Cognition Is Categorization","volume-title":"Handbook of Categorization in Cognitive","author":"Harnad","year":"2005"},{"key":"2025082212121966100_b43-12_14439_ra_lukyanenko","first-page":"3928","article-title":"The Nature of Knowledge in the Social Media Age: Implications for Knowledge Management Models","author":"Hemsley","year":"2012"},{"key":"2025082212121966100_b44-12_14439_ra_lukyanenko","first-page":"64","article-title":"Quality Management on Amazon Mechanical Turk","author":"Ipeirotis","year":"2010"},{"issue":"3","key":"2025082212121966100_b45-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"795","DOI":"10.25300\/MISQ\/2014\/38.3.08","article-title":"Emergence of Power Laws in Online Communities: The Role of Social Mechanisms and Preferential Attachment","volume":"38","author":"Johnson","year":"2014","journal-title":"MIS Quarterly"},{"issue":"4","key":"2025082212121966100_b46-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1287\/isre.2014.0544","article-title":"Patient Data as Medical Facts: Social Media Practices as a Foundation for Medical Knowledge Creation","volume":"25","author":"Kallinikos","year":"2014","journal-title":"Information Systems Research"},{"issue":"10","key":"2025082212121966100_b47-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1038\/nsmb.2119","article-title":"Crystal Structure of a Monomeric Retroviral Protease Solved by Protein Folding Game Players","volume":"18","author":"Khatib","year":"2011","journal-title":"Nature Structural & Molecular Biology"},{"key":"2025082212121966100_b48-12_14439_ra_lukyanenko","article-title":"When it Absolutely Has to Be Accurate, Don\u2019t Trust the Crowd","author":"Kilian","year":"2008","journal-title":"ECT News Network"},{"issue":"10","key":"2025082212121966100_b49-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1002\/fee.1436","article-title":"Assessing Data Quality in Citizen Science","volume":"14","author":"Kosmala","year":"2016","journal-title":"Frontiers in Ecology and the Environment"},{"key":"2025082212121966100_b50-12_14439_ra_lukyanenko","first-page":"242","article-title":"Strictly Class-Based Modelling Considered Harmful","author":"Krogh","year":"1996"},{"issue":"1","key":"2025082212121966100_b51-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"issue":"3","key":"2025082212121966100_b52-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"529","DOI":"10.25300\/MISQ\/2016\/40.3.01","article-title":"A Tool for Addressing Construct Identity in Literature Reviews and Meta-Analyses","volume":"40","author":"Larsen","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b53-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/S0166-4115(08)61013-4","article-title":"Basic Levels in Artificial and Natural Categories: Are All Basic Levels Created Equal?","volume-title":"Percepts, Concepts and Categories: The Representation and Processing of Information","author":"Lassaline","year":"1992"},{"issue":"3","key":"2025082212121966100_b54-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1080\/07421222.2003.11045770","article-title":"Crafting Rules: Context-Reflective Data Quality Problem Solving","volume":"20","author":"Lee","year":"2003","journal-title":"Journal of Management Information Systems"},{"key":"2025082212121966100_b55-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4037.001.0001","volume-title":"Journey to Data Quality","author":"Lee","year":"2006"},{"issue":"1","key":"2025082212121966100_b56-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"147","DOI":"10.2307\/23043493","article-title":"When Flexible Routines Meet Flexible Technologies: Affordance, Constraint, and the Imbrication of Human and Material Agencies","volume":"35","author":"Leonardi","year":"2011","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b57-12_14439_ra_lukyanenko","article-title":"The Potential for Citizen Science in Information Systems Research","volume":"40","author":"Levy","year":"2017","journal-title":"Communications of the AIS"},{"issue":"3","key":"2025082212121966100_b58-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1111\/cobi.12481","article-title":"Influence of Volunteer and Project Characteristics on Data Quality of Biological Surveys","volume":"29","author":"Lewandowski","year":"2015","journal-title":"Conservation Biology"},{"issue":"9","key":"2025082212121966100_b59-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/TKDE.2016.2535242","article-title":"Crowd-sourced Data Management: A Survey","volume":"28","author":"Li","year":"2016","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"2025082212121966100_b60-12_14439_ra_lukyanenko","volume-title":"Citizen Science: Public Participation in Environmental Research","author":"Louv","year":"2012"},{"issue":"4","key":"2025082212121966100_b61-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1057\/s41303-017-0036-3","article-title":"Crowdsourcing of Information Systems Research","volume":"26","author":"Love","year":"2017","journal-title":"European Journal of Information Systems"},{"issue":"1","key":"2025082212121966100_b62-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/0960085X.2018.1488567","article-title":"Representing Instances: The Case for Reengineering Conceptual Modeling Grammars","volume":"28","author":"Lukyanenko","year":"2019","journal-title":"European Journal of Information Systems"},{"issue":"4","key":"2025082212121966100_b63-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1287\/isre.2014.0537","article-title":"The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content","volume":"25","author":"Lukyanenko","year":"2014","journal-title":"Information Systems Research"},{"issue":"3","key":"2025082212121966100_b64-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1111\/cobi.12706","article-title":"Emerging Problems of Data Quality in Citizen Science","volume":"30","author":"Lukyanenko","year":"2016","journal-title":"Conservation Biology"},{"issue":"4","key":"2025082212121966100_b65-12_14439_ra_lukyanenko","first-page":"297","article-title":"Representing Crowd Knowl edge: Guidelines for Conceptual Modeling of User-Generated Content","volume":"18","author":"Lukyanenko","year":"2017","journal-title":"Journal of the AIS"},{"issue":"1","key":"2025082212121966100_b66-12_14439_ra_lukyanenko","first-page":"37","article-title":"Participatory Design for User-Generated Content: Understanding the Challenges and Moving Forward","volume":"28","author":"Lukyanenko","year":"2016","journal-title":"Scandinavian Journal of Information Systems"},{"issue":"1","key":"2025082212121966100_b67-12_14439_ra_lukyanenko","first-page":"1","article-title":"Overview and Framework for Data and Information Quality Research","volume":"1","author":"Madnick","year":"2009","journal-title":"Journal of Data and Information Quality"},{"issue":"10\/11","key":"2025082212121966100_b68-12_14439_ra_lukyanenko","first-page":"609","article-title":"A Foundation for the Study of IT Effects: A New Look at DeSanctis and Poole\u2019s Concepts of Structural Features and Spirit","volume":"9","author":"Markus","year":"2008","journal-title":"Journal of the AIS"},{"key":"2025082212121966100_b69-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1201\/9780203483374","volume-title":"Exploratory Data Analysis with MATLAB","author":"Martinez","year":"2004"},{"issue":"3","key":"2025082212121966100_b70-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1046\/j.1467-2979.2002.00086.x","article-title":"On Biological Species, Species Concepts and Individuation in the Natural World","volume":"3","author":"Mayden","year":"2002","journal-title":"Fish and Fisheries"},{"key":"2025082212121966100_b71-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.biocon.2016.05.015","article-title":"Citizen Science Can Improve Conservation Science, Natural Resource Management, and Environmental Protection","volume":"208","author":"McKinley","year":"2016","journal-title":"Biological Conservation"},{"issue":"1","key":"2025082212121966100_b72-12_14439_ra_lukyanenko","first-page":"99","article-title":"Citizens4Citizens: Mapping Participatory Practices on the Internet","volume":"7","author":"Meijer","year":"2009","journal-title":"Electronic Journal of E-Government"},{"issue":"1","key":"2025082212121966100_b73-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1146\/annurev.ps.32.020181.000513","article-title":"Categorization of Natural Objects","volume":"32","author":"Mervis","year":"1981","journal-title":"Annual Review of Psychology"},{"issue":"6","key":"2025082212121966100_b74-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1890\/110294","article-title":"The Future of Citizen Science: Emerging Technologies and Shifting Paradigms","volume":"10","author":"Newman","year":"2012","journal-title":"Frontiers in Ecology and the Environment"},{"issue":"112","key":"2025082212121966100_b75-12_14439_ra_lukyanenko","first-page":"7","article-title":"Some Observations on Mental Models","volume":"7","author":"Norman","year":"1983","journal-title":"Mental Models"},{"issue":"4","key":"2025082212121966100_b76-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0090375","article-title":"Scientists@ Home: What Drives the Quantity and Quality of Online Citizen Science Participation","volume":"9","author":"Nov","year":"2014","journal-title":"PloS One"},{"key":"2025082212121966100_b77-12_14439_ra_lukyanenko","volume-title":"Conceptual Modeling of Information Systems","author":"Oliv\u00e9","year":"2007"},{"issue":"11","key":"2025082212121966100_b78-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1016\/j.datak.2010.07.009","article-title":"Using Ontologies with UML Class-Based Modeling: The TwoUse Approach","volume":"69","author":"Parreiras","year":"2010","journal-title":"Data & Knowledge Engineering"},{"issue":"7336","key":"2025082212121966100_b79-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1038\/471037a","article-title":"Easier Citizen Science Is Better","volume":"471","author":"Parsons","year":"2011","journal-title":"Nature"},{"issue":"2","key":"2025082212121966100_b80-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1145\/357775.357778","article-title":"Emancipating Instances from the Tyranny of Classes in Information Modeling","volume":"25","author":"Parsons","year":"2000","journal-title":"ACM Transactions on Database Systems"},{"issue":"4","key":"2025082212121966100_b81-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"7","DOI":"10.2753\/MIS0742-1222290401","article-title":"Information Systems Success: The Quest for the Independent Variables","volume":"29","author":"Petter","year":"2013","journal-title":"Journal of Management Information Systems"},{"issue":"4","key":"2025082212121966100_b82-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1145\/505248.506010","article-title":"Data Quality Assessment","volume":"45","author":"Pipino","year":"2002","journal-title":"Communications of the ACM"},{"key":"2025082212121966100_b83-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1016\/j.chb.2015.05.051","article-title":"Points, Stories, Worlds, and Diegesis: Comparing Player Experiences in Two Citizen Science Games","volume":"52","author":"Prestopnik","year":"2015","journal-title":"Computers in Human Behavior"},{"key":"2025082212121966100_b84-12_14439_ra_lukyanenko","volume-title":"Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking","author":"Provost","year":"2013"},{"issue":"1","key":"2025082212121966100_b85-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.bushor.2014.09.005","article-title":"How to Work a Crowd: Developing Crowd Capital through Crowdsourcing","volume":"58","author":"Prpi\u0107","year":"2015","journal-title":"Business Horizons"},{"issue":"1","key":"2025082212121966100_b86-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.25300\/MISQ\/2016\/40.1.E0","article-title":"Editor\u2019s Comments: Synergies Between Big Data and Theory","volume":"40","author":"Rai","year":"2016","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b87-12_14439_ra_lukyanenko","volume-title":"Data Quality for the Information Age","author":"Redman","year":"1996"},{"issue":"3","key":"2025082212121966100_b88-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/0010-0285(76)90013-X","article-title":"Basic Objects in Natural Categories","volume":"8","author":"Rosch","year":"1976","journal-title":"Cognitive Psychology"},{"issue":"1","key":"2025082212121966100_b89-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/25148826","article-title":"Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks","volume":"32","author":"Rosemann","year":"2008","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b90-12_14439_ra_lukyanenko","unstructured":"Saghafi, A.\n          \u20082016. \u201cOntological and Cognitive Principles on Information Systems Modelling,\u201d Doctoral Dissertation, University of British Columbia."},{"issue":"4","key":"2025082212121966100_b91-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.25300\/MISQ\/2018\/13255","article-title":"Exploring the Effects of Extensional Versus Intentional Representations on Domain Understanding","volume":"42","author":"Samuel","year":"2018","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082212121966100_b92-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"467","DOI":"10.22237\/jmasm\/1257035100","article-title":"New Effect Size Rules of Thumb","volume":"8","author":"Sawilowsky","year":"2009","journal-title":"Journal of Modern Applied Statistical Methods"},{"key":"2025082212121966100_b93-12_14439_ra_lukyanenko","first-page":"102","article-title":"Sliced Column-Store (SCS): Ontological Foundations and Practical Implications","author":"Sekhavat","year":"2012"},{"issue":"2","key":"2025082212121966100_b94-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1145\/2996198","article-title":"From Content to Context: The Evolution and Growth of Data Quality Research","volume":"8","author":"Shankaranarayanan","year":"2017","journal-title":"Journal of Data and Information Quality"},{"issue":"3","key":"2025082212121966100_b95-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"553","DOI":"10.2307\/25148856","article-title":"Representing Part-Whole Relations in Conceptual Modeling: An Empirical Evaluation","volume":"32","author":"Shanks","year":"2008","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b96-12_14439_ra_lukyanenko","first-page":"614","article-title":"Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers","author":"Sheng","year":"2008"},{"issue":"9","key":"2025082212121966100_b97-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1016\/j.tree.2009.03.017","article-title":"A New Dawn for Citizen Science","volume":"24","author":"Silvertown","year":"2009","journal-title":"Trends in Ecology & Evolution"},{"issue":"5","key":"2025082212121966100_b98-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1145\/253769.253804","article-title":"Data Quality in Context","volume":"40","author":"Strong","year":"1997","journal-title":"Communications of the ACM"},{"issue":"10","key":"2025082212121966100_b99-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"2282","DOI":"10.1016\/j.biocon.2009.05.006","article-title":"EBird: A Citizen-Based Bird Observation Network in the Biological Sciences","volume":"142","author":"Sullivan","year":"2009","journal-title":"Biological Conservation"},{"key":"2025082212121966100_b100-12_14439_ra_lukyanenko","volume-title":"The Wisdom of Crowds","author":"Surowiecki","year":"2005"},{"key":"2025082212121966100_b101-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1038\/sdata.2015.26","article-title":"Snapshot Serengeti, High-Frequency Annotated Camera Trap Images of 40 Mammalian Species in an African Savanna","volume":"2","author":"Swanson","year":"2015","journal-title":"Scientific Data"},{"issue":"1","key":"2025082212121966100_b102-12_14439_ra_lukyanenko","first-page":"75","article-title":"Recovering and Learning from Service Failure","volume":"40","author":"Tax","year":"1998","journal-title":"MIT Sloan Management Review"},{"issue":"1","key":"2025082212121966100_b103-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s12599-016-0459-8","article-title":"Towards a Conceptualization of Data and Information Quality in Social Information Systems","volume":"59","author":"Tilly","year":"2016","journal-title":"Business & Information Systems Engineering"},{"issue":"1","key":"2025082212121966100_b104-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"38","DOI":"10.2307\/256472","article-title":"Peer Reporting of Unethical Behavior: A Social Context Perspective","volume":"35","author":"Trevino","year":"1992","journal-title":"Academy of Management Journal"},{"issue":"2","key":"2025082212121966100_b105-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"55","DOI":"10.2307\/41166165","article-title":"Why Hospitals Don\u2019t Learn from Failures: Organizational and Psychological Dynamics That Inhibit System Change","volume":"45","author":"Tucker","year":"2003","journal-title":"California Management Review"},{"issue":"4157","key":"2025082212121966100_b106-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","article-title":"Judgment under Uncertainty: Heuristics and Biases","volume":"185","author":"Tversky","year":"1974","journal-title":"Science"},{"issue":"3","key":"2025082212121966100_b107-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User Acceptance of Information Technology: Toward a Unified View","volume":"27","author":"Venkatesh","year":"2003","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082212121966100_b108-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/S1364-6613(98)01261-3","article-title":"Learning to Recognize Objects","volume":"3","author":"Wallis","year":"1999","journal-title":"Trends in Cognitive Sciences"},{"issue":"11","key":"2025082212121966100_b109-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/240455.240479","article-title":"Anchoring Data Quality Dimensions in Ontological Foundations","volume":"39","author":"Wand","year":"1996","journal-title":"Communications of the ACM"},{"issue":"3-4","key":"2025082212121966100_b110-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/0167-9236(93)E0050-N","article-title":"Toward Quality Data: An Attribute-Based Approach","volume":"13","author":"Wang","year":"1995","journal-title":"Decision Support Systems"},{"issue":"4","key":"2025082212121966100_b111-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond Accuracy: What Data Quality Means to Data Consumers","volume":"12","author":"Wang","year":"1996","journal-title":"Journal of Management Information Systems"},{"issue":"2","key":"2025082212121966100_b112-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","first-page":"373","DOI":"10.2307\/23044048","article-title":"What Signals Are You Sending? How Website Quality Influences Perceptions of Product Quality and Purchase Intentions","volume":"35","author":"Wells","year":"2011","journal-title":"MIS Quarterly"},{"key":"2025082212121966100_b113-12_14439_ra_lukyanenko","volume-title":"Data Management Guide for Public Participation in Scientific Research","author":"Wiggins","year":"2013"},{"key":"2025082212121966100_b114-12_14439_ra_lukyanenko","doi-asserted-by":"crossref","DOI":"10.1109\/HICSS.2011.207","article-title":"From Conservation to Crowdsourcing: A Typology of Citizen Science","author":"Wiggins","year":"2011"},{"key":"2025082212121966100_b115-12_14439_ra_lukyanenko","first-page":"14","article-title":"Mechanisms for Data Quality and Validation in Citizen Science","author":"Wiggins","year":"2011"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/43\/2\/623\/5872\/12_14439_ra_lukyanenko.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/43\/2\/623\/5872\/12_14439_ra_lukyanenko.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:13:41Z","timestamp":1755879221000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/43\/2\/623\/1624\/Expecting-the-Unexpected-Effects-of-Data"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,1]]},"references-count":115,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,6,1]]},"published-print":{"date-parts":[[2019,6,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2019\/14439","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,1]]}}}