{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T14:47:01Z","timestamp":1774018021995,"version":"3.50.1"},"reference-count":48,"publisher":"MIS Quarterly","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,3,1]]},"abstract":"<jats:p>Crowdsourcing contests are contests by which organizations tap into the wisdom of crowds by outsourcing tasks to large groups of people on the Internet. In an online environment often characterized by anonymity and lack of trust, there are inherent uncertainties for participants of such contests. This study focuses on crowd-sourcing contests with winner-take-all prizes. During these contests, submissions are made sequentially and contest hosts can provide public in-process feedback to the submissions as soon as they are received. Drawing on the uncertainty literature, we examine how the use of prize guarantees (guaranteeing that a winner will be picked and paid) and in-process feedback (numeric ratings to individual designs and public textual comments during the contest) can help attract more submissions by influencing the various uncertainties faced by the contestants. We find that guaranteeing the prize increases submissions. The volume of in-process feedback (both numeric reviews and textual comments) has a positive effect on the number of submissions, and such an effect is bigger in contests without prize guarantees. In addition, providing highly positive or extremely negative feedback discourages overall future submissions, and the negative effect of highly positive feedback is mitigated in guaranteed contests.<\/jats:p>","DOI":"10.25300\/misq\/2019\/13649","type":"journal-article","created":{"date-parts":[[2019,2,19]],"date-time":"2019-02-19T13:56:42Z","timestamp":1550584602000},"page":"97-112","source":"Crossref","is-referenced-by-count":85,"title":["Managing the Crowds: The Effect of Prize Guarantees and In-Process Feedback on Participation in Crowdsourcing Contests1"],"prefix":"10.25300","volume":"43","author":[{"given":"Lian","family":"Jian","sequence":"first","affiliation":[{"name":"Annenberg School of Communication, University of Southern California, Los Angeles, CA 90089 U.S.A."}]},{"given":"Sha","family":"Yang","sequence":"additional","affiliation":[{"name":"Marshall School of Business, University of Southern California, Los Angeles, CA 90089 U.S.A."}]},{"given":"Sulin","family":"Ba","sequence":"additional","affiliation":[{"name":"School of Business, University of Connecticut, Storrs, CT 06268 U.S.A."}]},{"given":"Li","family":"Lu","sequence":"additional","affiliation":[{"name":"College of Business & Public Management, West Chester University, West Chester, PA 19383 U.S.A."}]},{"given":"Li Crystal","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Media and Communication, City University of Hong Kong, Hong Kong, China"}]}],"member":"10933","published-online":{"date-parts":[[2019,3,1]]},"reference":[{"issue":"3","key":"2025082212182530500_b1-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"488","DOI":"10.2307\/1879431","article-title":"The Market for \u2018Lemons\u2019: Quality Uncertainty and the Market Mechanism","volume":"84","author":"Ackerlof","year":"1970","journal-title":"The Quarterly Journal of Economics"},{"issue":"2","key":"2025082212182530500_b2-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1287\/mksc.1080.0403","article-title":"Estimating Demand heterogeneity Using Aggregated Data: An Application to the Frozen Pizza Catgory","volume":"28","author":"Albuquerque","year":"2009","journal-title":"Marketing Science"},{"key":"2025082212182530500_b3-05_13649_ra_jianyang","first-page":"17","article-title":"99designs: An Analysis of Creative Competition in Crowdsourced Design","author":"Araujo","year":"2013"},{"key":"2025082212182530500_b4-05_13649_ra_jianyang","doi-asserted-by":"crossref","DOI":"10.1111\/poms.12552","article-title":"Heterogeneous Submission Behavior and Its Implications for Success in Innovation Contests with Public Submissions","author":"Bockstedt","year":"2016","journal-title":"Production and Operations Management"},{"issue":"5","key":"2025082212182530500_b5-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1287\/mnsc.1110.1322","article-title":"Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis","volume":"57","author":"Boudreau","year":"2011","journal-title":"Management Science"},{"key":"2025082212182530500_b6-05_13649_ra_jianyang","article-title":"Cumulative Innovation and Open Disclosure of Intermediate Results: Evidence from a Policy Experiment in Bioinformatics","author":"Boudreau","year":"2013","journal-title":"Working Paper, Harvard Business School"},{"issue":"8","key":"2025082212182530500_b7-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1080\/13691181003624090","article-title":"Moving the Crowd at Threadless","volume":"13","author":"Brabham","year":"2010","journal-title":"Information, Communication & Society"},{"issue":"3","key":"2025082212182530500_b8-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1509\/jmkr.43.3.345","article-title":"The Effect of Word of Mouth on Sales: Online Book Reviews","volume":"43","author":"Chevalier","year":"2006","journal-title":"Journal of Marketing Research"},{"issue":"1","key":"2025082212182530500_b9-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"73","DOI":"10.2307\/258630","article-title":"Integrating Variable Risk Preference, Trust, and Transaction Cost Economics","volume":"21","author":"Chiles","year":"1996","journal-title":"Academy of Management Review"},{"issue":"5","key":"2025082212182530500_b10-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1287\/mnsc.32.5.554","article-title":"Organizational Information Requirements, Media Richness and Structural Design","volume":"32","author":"Daft","year":"1986","journal-title":"Management Science"},{"issue":"2","key":"2025082212182530500_b11-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"279","DOI":"10.25300\/MISQ\/2016\/40.2.01","article-title":"The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: Giving Voice to the less Powerful Through Value Sensitive Design","volume":"40","author":"Deng","year":"2016","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082212182530500_b12-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"395","DOI":"10.2307\/41703461","article-title":"On Product Uncertainty in Online Markets: Theory and Evidence","volume":"32","author":"Dimoka","year":"2012","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082212182530500_b13-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"23","DOI":"10.2307\/20650277","article-title":"Informational Cascades and Software Adoption on the Internet: An Empirical Investigation","volume":"33","author":"Duan","year":"2009","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082212182530500_b14-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1509\/jm.13.0190","article-title":"Understanding the Impact of In-Process Promotional Messages: An Application to Online Auctions","volume":"80","author":"Ducarroz","year":"2016","journal-title":"Journal of Marketing"},{"issue":"1","key":"2025082212182530500_b15-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1257\/aer.102.1.469","article-title":"A Structural Analysis of Disappointment Aversion in a Real Effort Competition","volume":"102","author":"Gill","year":"2012","journal-title":"American Economic Review"},{"issue":"4","key":"2025082212182530500_b16-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1287\/mnsc.1090.1144","article-title":"Idea Generation and the Quality of the Best Idea","volume":"56","author":"Girotra","year":"2010","journal-title":"Management Science"},{"issue":"2","key":"2025082212182530500_b17-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1111\/1756-2171.12182","article-title":"Performance Feedback in Competitive Product Development","volume":"48","author":"Gross","year":"2017","journal-title":"RAND Journal of Economics"},{"issue":"2","key":"2025082212182530500_b18-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1287\/isre.2014.0520","article-title":"Product Fit Uncertainty in Online Markets: Nature, Effects, and Antecedents","volume":"25","author":"Hong","year":"2014","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082212182530500_b19-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1287\/isre.2015.0606","article-title":"Comparing Open and Sealed Bid Auctions: Evidence from Online Labor Markets","volume":"27","author":"Hong","year":"2016","journal-title":"Information Systems Research"},{"key":"2025082212182530500_b20-05_13649_ra_jianyang","volume-title":"Crowdsourcing: How the Power of the Crowd Is Driving the Future of Business","author":"Howe","year":"2008"},{"key":"2025082212182530500_b21-05_13649_ra_jianyang","article-title":"How to Design Crowdsourcing Contest: A Structural Empirical Analysis","volume-title":"Workshop on Information Systems and Economics","author":"Huang","year":"2012"},{"key":"2025082212182530500_b22-05_13649_ra_jianyang","first-page":"611","article-title":"Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk","author":"Irani","year":"2013"},{"issue":"3","key":"2025082212182530500_b23-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1007\/s10683-016-9504-1","article-title":"Simultaneous Versus Sequential All-Pay Auctions: An Experimental Study","volume":"20","author":"Jian","year":"2017","journal-title":"Experimental Economics"},{"key":"2025082212182530500_b24-05_13649_ra_jianyang","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.2884922","article-title":"The Role of Feedback in Dynamic Crowdsourcing Contests: A Structural Empirical Analysis","volume-title":"Ross School of Business Paper No. 1334","author":"Jiang","year":"2016"},{"key":"2025082212182530500_b25-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","article-title":"Prospect Theory: An Analysis of Decision Under Risk","volume":"47","author":"Kahneman","year":"1979","journal-title":"Econometrica"},{"issue":"10","key":"2025082212182530500_b26-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"2449","DOI":"10.1287\/mnsc.2014.2063","article-title":"On Product-Level Uncertainty and Online Purchase Behavior: An Empirical Analysis","volume":"61","author":"Kim","year":"2015","journal-title":"Management Science"},{"issue":"2","key":"2025082212182530500_b27-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10058-007-0029-0","article-title":"The Generalized Stackelberg Equilibrium of the All-Pay Auction with Complete Information","volume":"11","author":"Konrad","year":"2007","journal-title":"Review of Economic Design"},{"key":"2025082212182530500_b28-05_13649_ra_jianyang","article-title":"The Value of Openness in Scientific Problem Solving","volume-title":"Working Paper","author":"Lakhani","year":"2007"},{"issue":"8","key":"2025082212182530500_b29-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1287\/mnsc.2013.1845","article-title":"Crowd-sourcing with All-Pay Auctions: A Field Experiment on Taskcn","volume":"60","author":"Liu","year":"2014","journal-title":"Management Science"},{"issue":"3","key":"2025082212182530500_b30-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"919","DOI":"10.25300\/MISQ\/2018\/14103","article-title":"Know When to Run: Recommendations in Crowdsourcing Contests","volume":"42","author":"Mo","year":"2018","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082212182530500_b31-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1177\/1536867X0400400206","article-title":"Computing Interaction Effects and Standard Errors in Logit and Probit Models","volume":"4","author":"Norton","year":"2004","journal-title":"Stata Journal"},{"key":"2025082212182530500_b32-05_13649_ra_jianyang","volume-title":"Applied Imagination","author":"Osborn","year":"1953"},{"issue":"1","key":"2025082212182530500_b33-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"105","DOI":"10.2307\/25148783","article-title":"Understanding and Mitigating Uncertainty in Online Exchange Relationships: A Principal\u2013Agent Perspective","volume":"31","author":"Pavlou","year":"2007","journal-title":"MIS Quarterly"},{"key":"2025082212182530500_b34-05_13649_ra_jianyang","volume-title":"The External Control of Organizations: A Resource Dependence Perspective","author":"Pfeffer","year":"1978"},{"issue":"3","key":"2025082212182530500_b35-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1023\/A:1020363010465","article-title":"Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation","volume":"2","author":"Rubin","year":"2001","journal-title":"Health Services and Outcomes Research Methodology"},{"key":"2025082212182530500_b36-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.euroecorev.2014.06.006","article-title":"Multi-Stage Sequential All-Pay Auctions","volume":"70","author":"Segev","year":"2014","journal-title":"European Economic Review"},{"key":"2025082212182530500_b37-05_13649_ra_jianyang","first-page":"18","article-title":"Sellers\u2019 Problems in Human Computation Markets","author":"Silberman","year":"2010"},{"issue":"4","key":"2025082212182530500_b38-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/0004-3702(73)90011-8","article-title":"The Structure of Ill Structured Problems","volume":"4","author":"Simon","year":"1973","journal-title":"Artificial Intelligence"},{"issue":"9","key":"2025082212182530500_b39-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1287\/mnsc.1080.0884","article-title":"Innovation Contests, Open Innovation, and Multiagent Problem Solving","volume":"54","author":"Terwiesch","year":"2008","journal-title":"Management Science"},{"issue":"1","key":"2025082212182530500_b40-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0048-7333(93)00747-H","article-title":"How Learning by Doing Is Done: Problem Identification in Novel Process Equipment","volume":"24","author":"von Hippel","year":"1995","journal-title":"Research Policy"},{"key":"2025082212182530500_b41-05_13649_ra_jianyang","article-title":"Towards Measuring Crowd-sourcing Success: An Empirical Study on Effects of External Factors in Online Idea Contest","author":"Walter","year":"2011"},{"key":"2025082212182530500_b42-05_13649_ra_jianyang","volume-title":"Markets and Hierarchies: Analysis and Antitrust Implications","author":"Williamson","year":"1975"},{"key":"2025082212182530500_b43-05_13649_ra_jianyang","volume-title":"The Economic Institutions of Capitalism: Firms, Markets, Relational Contracting","author":"Williamson","year":"1985"},{"key":"2025082212182530500_b44-05_13649_ra_jianyang","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195078244.001.0001","volume-title":"The Mechanisms of Governance","author":"Williamson","year":"1996"},{"key":"2025082212182530500_b45-05_13649_ra_jianyang","article-title":"The Impact of Visibility in Innovation Tournaments: Evidence from Field Experiments","author":"Wooten","year":"2015","journal-title":"University of Pennsylvania Scholarly Commons"},{"issue":"1","key":"2025082212182530500_b46-05_13649_ra_jianyang","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1111\/poms.12613","article-title":"Idea Generation and the Role of Feedback: Evidence from Field Experiments with Innovation Tournaments","volume":"26","author":"Wooten","year":"2016","journal-title":"Production and Operations Management"},{"key":"2025082212182530500_b47-05_13649_ra_jianyang","first-page":"11","article-title":"Impact of Past Performance and Strategic Bidding on Winner Determination of Open Innovation Contest","author":"Yang","year":"2010"},{"key":"2025082212182530500_b48-05_13649_ra_jianyang","article-title":"Managing Open Innovation Contests in Online Market","volume-title":"Working Paper","author":"Yang","year":"2013"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/43\/1\/97\/6255\/05_13649_ra_jianyang.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/43\/1\/97\/6255\/05_13649_ra_jianyang.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:20:10Z","timestamp":1755879610000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/43\/1\/97\/1748\/Managing-the-Crowds-The-Effect-of-Prize-Guarantees"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,1]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3,1]]},"published-print":{"date-parts":[[2019,3,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2019\/13649","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,1]]}}}