{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T16:25:25Z","timestamp":1781972725120,"version":"3.54.5"},"reference-count":107,"publisher":"MIS Quarterly","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,9,1]]},"abstract":"<jats:p>Crowdsourcing contests have emerged as an innovative way for firms to solve business problems by acquiring ideas from participants external to the firm. As the number of participants on crowdsourcing contest platforms has increased, so has the number of tasks that are open at any time. This has made it difficult for solvers to identify tasks in which to participate. We present a framework to recommend tasks to solvers who wish to participate in crowdsourcing contests. The existence of competition among solvers is an important and unique aspect of this environment, and our framework considers the competition a solver would face in each open task. As winning a task depends on performance, we identify a theory of performance and reinforce it with theories from learning, motivation, and tournaments. This augmented theory of performance guides us to variables specific to crowdsourcing contests that could impact a solver\u2019s winning probability. We use these variables as input into various probability prediction models adapted to our context, and make recommendations based on the probability or the expected payoff of the solver winning an open task. We validate our framework using data from a real crowdsourcing platform. The recommender system is shown to have the potential of improving the success rates of solvers across all abilities. Recommendations have to be made for open tasks and we find that the relative rankings of tasks at similar stages of their time lines remain remarkably consistent when the tasks close. Further, we show that deploying such a system should benefit not only the solvers, but also the seekers and the platform itself.<\/jats:p>","DOI":"10.25300\/misq\/2018\/14103","type":"journal-article","created":{"date-parts":[[2018,8,28]],"date-time":"2018-08-28T17:15:23Z","timestamp":1535476523000},"page":"919-943","source":"Crossref","is-referenced-by-count":72,"title":["Know When to Run: Recommendations in Crowdsourcing Contests1"],"prefix":"10.25300","volume":"42","author":[{"given":"Jiahui","family":"Mo","sequence":"first","affiliation":[{"name":"Nanyang Business School, Nanyang Technological University, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sumit","family":"Sarkar","sequence":"additional","affiliation":[{"name":"Naveen Jindal School of Management, University of Texas at Dallas, Richardson, TX 75080 U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Syam","family":"Menon","sequence":"additional","affiliation":[{"name":"Naveen Jindal School of Management, University of Texas at Dallas, Richardson, TX 75080 U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10933","published-online":{"date-parts":[[2018,9,1]]},"reference":[{"issue":"2","key":"2025082212170482500_b1-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/2.901170","article-title":"Using Data Mining Methods to Build Customer Profiles","volume":"34","author":"Adomavicius","year":"2001","journal-title":"Computer"},{"key":"2025082212170482500_b2-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-7637-6_6","article-title":"Context-Aware Recom-mender Systems","volume-title":"Recommender Systems Handbook","author":"Adomavicius","year":"2015","edition":"2nd"},{"key":"2025082212170482500_b3-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-29659-3","volume-title":"Recommender Systems: The Textbook","author":"Aggarwal","year":"2016"},{"issue":"3","key":"2025082212170482500_b4-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1080\/02796015.2004.12086253","article-title":"Extrinsic Reinforcement in the Classroom: Bribery or Best Practice","volume":"33","author":"Akin-Little","year":"2004","journal-title":"School Psychology Review"},{"key":"2025082212170482500_b5-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"199","DOI":"10.2307\/270983","article-title":"Logit Models for Sets of Ranked Items","volume":"24","author":"Allison","year":"1994","journal-title":"Sociological Methodology"},{"key":"2025082212170482500_b6-11_14103_ra_mosarkar","first-page":"80","article-title":"Towards Task Recommendation in Micro-Task Markets","author":"Ambati","year":"2011"},{"key":"2025082212170482500_b7-11_14103_ra_mosarkar","volume-title":"Cognitive Psychology and its Implications","author":"Anderson","year":"1985","edition":"2nd"},{"issue":"9","key":"2025082212170482500_b8-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"455","DOI":"10.17705\/1jais.00237","article-title":"A Theory-Driven Design Framework for Social Recommender Systems","volume":"11","author":"Arazy","year":"2010","journal-title":"Journal of the Association for Information Systems"},{"key":"2025082212170482500_b9-11_14103_ra_mosarkar","first-page":"21","article-title":"Money, Glory and Cheap Talk: Analyzing Strategic Behavior of Contestants in Simultaneous Innovation Contests on Topcoder.Com","author":"Archak","year":"2010"},{"key":"2025082212170482500_b10-11_14103_ra_mosarkar","article-title":"Optimal Design of Crowdsourcing Contests","author":"Archak","year":"2009"},{"issue":"2","key":"2025082212170482500_b11-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1287\/mnsc.1100.1266","article-title":"Accelerated Learning of User Profiles","volume":"57","author":"Atahan","year":"2011","journal-title":"Management Science"},{"issue":"3","key":"2025082212170482500_b12-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1145\/245108.245124","article-title":"Fab: Content-Based, Collaborative Recommendation","volume":"40","author":"Balabanovic","year":"1997","journal-title":"Communications of the ACM"},{"issue":"3","key":"2025082212170482500_b13-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1287\/opre.2016.1508","article-title":"Online Collaborative Filtering on Graphs","volume":"64","author":"Banerjee","year":"2016","journal-title":"Operations Research"},{"key":"2025082212170482500_b14-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"336","DOI":"10.2307\/2393228","article-title":"The Incentive Effects of Tournament Compensation Systems","volume":"37","author":"Becker","year":"1992","journal-title":"Administrative Science Quarterly"},{"key":"2025082212170482500_b15-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0304-4076(81)90056-7","article-title":"Assessing the Potential Demand for Electric Cars","volume":"17","author":"Beggs","year":"1981","journal-title":"Journal of Econometrics"},{"key":"2025082212170482500_b16-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.knosys.2013.03.012","article-title":"Recommender Systems Survey","volume":"46","author":"Bobadilla","year":"2013","journal-title":"Knowledge-Based Systems"},{"key":"2025082212170482500_b17-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.jom.2014.12.002","article-title":"Problem-Solving Effort and Success in Innovation Contests: The Role of National Wealth and National Culture","volume":"36","author":"Bockstedt","year":"2015","journal-title":"Journal of Operations Management"},{"issue":"7","key":"2025082212170482500_b18-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1111\/poms.12552","article-title":"Heterogeneous Submission Behavior and its Implications for Success in Innovation Contests with Public Submissions","volume":"25","author":"Bockstedt","year":"2016","journal-title":"Production and Operations Management"},{"issue":"8","key":"2025082212170482500_b19-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1040","DOI":"10.1287\/mnsc.32.8.1040","article-title":"Searching for Positive Returns at the Track: A Multinomial Logit Model for Handicapping Horse Races","volume":"32","author":"Bolton","year":"1986","journal-title":"Management Science"},{"issue":"5","key":"2025082212170482500_b20-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1287\/mnsc.1110.1322","article-title":"Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis","volume":"57","author":"Boudreau","year":"2011","journal-title":"Management Science"},{"issue":"8","key":"2025082212170482500_b21-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1080\/13691181003624090","article-title":"Moving the Crowd at Threadless: Motivation for Participation in a Crowdsourcing Application","volume":"13","author":"Brabham","year":"2010","journal-title":"Information, Communication & Society"},{"key":"2025082212170482500_b22-11_14103_ra_mosarkar","first-page":"43","article-title":"Empirical Analysis of Predictive Algorithms for Collaborative Filtering","author":"Breese","year":"1998"},{"issue":"235","key":"2025082212170482500_b23-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1111\/j.1475-4932.2000.tb00032.x","article-title":"It\u2019s the Economy Stupid: Macroeconomics and Federal Elections in Australia","volume":"76","author":"Cameron","year":"2000","journal-title":"The Economic Record"},{"key":"2025082212170482500_b24-11_14103_ra_mosarkar","first-page":"687","article-title":"Modeling the Performance Prediction Problem in Industrial and Organizational Psychology","volume-title":"Handbook of Industrial and Organizational Psychology","author":"Campbell","year":"1990"},{"key":"2025082212170482500_b25-11_14103_ra_mosarkar","first-page":"35","article-title":"A Theory of Performance","volume-title":"Personnel Selection in Organizations","author":"Campbell","year":"1993"},{"issue":"3","key":"2025082212170482500_b26-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"288","DOI":"10.2307\/3151563","article-title":"Exploiting Rank Ordered Choice Set Data within the Stochastic Utility Model","volume":"19","author":"Chapman","year":"1982","journal-title":"Journal of Marketing Research"},{"issue":"8","key":"2025082212170482500_b27-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.1287\/mnsc.1080.0872","article-title":"Modeling a Presidential Prediction Market","volume":"54","author":"Chen","year":"2008","journal-title":"Management Science"},{"issue":"2","key":"2025082212170482500_b28-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s11257-015-9155-5","article-title":"Recommender Systems Based on User Reviews: The State of The Art","volume":"25","author":"Chen","year":"2015","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"2025082212170482500_b29-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.1145\/1837885.1837889","article-title":"Task Search in a Human Computation Market","author":"Chilton","year":"2010"},{"issue":"6","key":"2025082212170482500_b30-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1111\/j.1475-3995.2000.tb00218.x","article-title":"Using Official Ratings to Simulate Major Tennis Tournaments","volume":"7","author":"Clarke","year":"2000","journal-title":"International Transactions in Operational Research"},{"issue":"1","key":"2025082212170482500_b31-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"128","DOI":"10.2307\/2393553","article-title":"Absorptive Capacity: A New Perspective on Learning and Innovation","volume":"35","author":"Cohen","year":"1990","journal-title":"Administrative Science Quarterly"},{"issue":"1","key":"2025082212170482500_b32-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1177\/0149206313498902","article-title":"Tournament Theory: Thirty Years of Contests and Competitions","volume":"40","author":"Connelly","year":"2014","journal-title":"Journal of Management"},{"key":"2025082212170482500_b33-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.knosys.2012.07.008","article-title":"Pi-Football: A Bayesian Network Model for Forecasting Association Football Match Outcomes","volume":"36","author":"Constantinou","year":"2012","journal-title":"Knowledge-Based Systems"},{"key":"2025082212170482500_b34-11_14103_ra_mosarkar","volume-title":"A Behavioral Theory of the Firm","author":"Cyert","year":"1963","edition":"2nd"},{"issue":"2","key":"2025082212170482500_b35-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.2202\/1559-0410.1327","article-title":"NFL Prediction Using Committees of Artificial Neural Networks","volume":"7","author":"David","year":"2011","journal-title":"Journal of Quantitative Analysis in Sports"},{"issue":"12","key":"2025082212170482500_b36-11_14103_ra_mosarkar","first-page":"537","article-title":"Folk Music Psychology","volume":"7","author":"Davis","year":"1994","journal-title":"The Psychologist"},{"issue":"4","key":"2025082212170482500_b37-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1007\/s10683-014-9421-0","article-title":"A Survey of Experimental Research on Contests, All-Pay Auctions and Tournaments","volume":"18","author":"Dechenaux","year":"2015","journal-title":"Experimental Economics"},{"issue":"2","key":"2025082212170482500_b38-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1016\/j.ijforecast.2011.05.002","article-title":"A Comparative Analysis of Data Mining Methods in Predicting NCAA Bowl Outcomes","volume":"28","author":"Delen","year":"2012","journal-title":"International Journal of Forecasting"},{"issue":"4","key":"2025082212170482500_b39-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1515\/jqas-2014-0093","article-title":"Riding a Probabilistic Support Vector Machine to the Stanley Cup","volume":"11","author":"Demers","year":"2015","journal-title":"Journal of Quantitative Analysis in Sports"},{"key":"2025082212170482500_b40-11_14103_ra_mosarkar","first-page":"119","article-title":"Crowdsourcing and All-Pay Auctions","author":"DiPalantino","year":"2009"},{"issue":"2","key":"2025082212170482500_b41-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1207\/s15327051hci0502&3_5","article-title":"Expertise in a Computer Operating System: Conceptualization and Performance","volume":"5","author":"Doane","year":"1990","journal-title":"Human\u2013Computer Interaction"},{"issue":"3","key":"2025082212170482500_b42-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1037\/h0041692","article-title":"The Prediction of Decisions among Bets","volume":"50","author":"Edwards","year":"1955","journal-title":"Journal of Experimental Psychology"},{"key":"2025082212170482500_b43-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1017\/CBO9780511816796.038","article-title":"The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance","volume-title":"The Cambridge Handbook of Expertise and Expert Performance","author":"Ericsson","year":"2006"},{"issue":"3","key":"2025082212170482500_b45-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1037\/0033-295X.107.3.578","article-title":"How Experts\u2019 Adaptations to Representative Task Demands Account for the Expertise Effect in Memory Recall: Comment on Vicente and Wang (1998)","volume":"107","author":"Ericsson","year":"2000","journal-title":"Psychological Review"},{"key":"2025082212170482500_b46-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1016\/j.electstud.2012.04.008","article-title":"Markets vs. Polls as Election Predictors: An Historical Assessment","volume":"31","author":"Erikson","year":"2012","journal-title":"Electoral Studies"},{"issue":"12","key":"2025082212170482500_b47-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1287\/mnsc.46.12.1554.12072","article-title":"Coordinating Expertise in Software Development Teams","volume":"46","author":"Faraj","year":"2000","journal-title":"Management Science"},{"key":"2025082212170482500_b48-11_14103_ra_mosarkar","first-page":"1","article-title":"Facilitating Individual Role Innovation","volume-title":"Innovation and Creativity at Work","author":"Farr","year":"1990"},{"issue":"5","key":"2025082212170482500_b49-11_14103_ra_mosarkar","first-page":"1142","article-title":"Anatomy of an Experimental Political Stock Market","volume":"82","author":"Forsythe","year":"1992","journal-title":"The American Economic Review"},{"issue":"3","key":"2025082212170482500_b50-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1287\/isre.2015.0583","article-title":"Recommendations Using Information from Multiple Association Rules: A Probabilistic Approach","volume":"26","author":"Ghoshal","year":"2015","journal-title":"Information Systems Research"},{"issue":"4","key":"2025082212170482500_b51-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1257\/jep.25.4.191","article-title":"When and Why Incentives (Don\u2019t) Work to Modify Behavior","volume":"25","author":"Gneezy","year":"2011","journal-title":"The Journal of Economic Perspectives"},{"issue":"12","key":"2025082212170482500_b52-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1145\/138859.138867","article-title":"Using Collaborative Filtering to Weave an Information Tapestry","volume":"35","author":"Goldberg","year":"1992","journal-title":"Communications of the ACM"},{"key":"2025082212170482500_b53-11_14103_ra_mosarkar","volume-title":"Econometric Analysis","author":"Greene","year":"2011","edition":"7th"},{"key":"2025082212170482500_b54-11_14103_ra_mosarkar","article-title":"Context-Aware Recommendation Based on Review Mining","author":"Hariri","year":"2011"},{"key":"2025082212170482500_b55-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/0304-4076(87)90068-6","article-title":"Specifying and Testing Econometric Models for Rank-Ordered Data","volume":"34","author":"Hausman","year":"1987","journal-title":"Journal of Econometrics"},{"issue":"3","key":"2025082212170482500_b56-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1287\/isre.1090.0262","article-title":"Timing of Adaptive Web Personalization and Its Effects on Online Consumer Behavior","volume":"22","author":"Ho","year":"2011","journal-title":"Information Systems Research"},{"key":"2025082212170482500_b57-11_14103_ra_mosarkar","article-title":"Crowd-sourcing Contests: A Dynamic Structural Model of the Impact of Incentive Structure on Solution Quality","author":"Huang","year":"2012"},{"issue":"7","key":"2025082212170482500_b58-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1146","DOI":"10.1287\/mnsc.1060.0619","article-title":"Analyzing Consumer-Product Graphs: Empirical Findings and Applications in Recom-mender Systems","volume":"53","author":"Huang","year":"2007","journal-title":"Management Science"},{"issue":"1","key":"2025082212170482500_b59-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1287\/mnsc.1080.0921","article-title":"Team Familiarity, Role Experience, and Performance: Evidence from Indian Software Services","volume":"55","author":"Huckman","year":"2009","journal-title":"Management Science"},{"key":"2025082212170482500_b60-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.electstud.2014.05.002","article-title":"Fundamental Models for Forecasting Elections at the State Level","volume":"35","author":"Hummel","year":"2014","journal-title":"Electoral Studies"},{"issue":"3","key":"2025082212170482500_b61-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/0001-8791(86)90013-8","article-title":"Cognitive Ability, Cognitive Aptitudes, Job Knowledge, and Job Performance","volume":"29","author":"Hunter","year":"1986","journal-title":"Journal of Vocational Behavior"},{"issue":"5","key":"2025082212170482500_b62-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1287\/orsc.1090.0491","article-title":"Marginality and Problem-Solving Effectiveness in Broadcast Search","volume":"21","author":"Jeppesen","year":"2010","journal-title":"Organi-zation Science"},{"key":"2025082212170482500_b63-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1037\/0021-9010.74.4.657","article-title":"Motivation and Cognitive Abilities: An Integrative\/Aptitude-Treatment Interaction Approach to Skill Acquisition","volume":"74","author":"Kanfer","year":"1989","journal-title":"Journal of Applied Psychology"},{"issue":"12","key":"2025082212170482500_b64-11_14103_ra_mosarkar","first-page":"1","article-title":"Crowdsourcing Contests: Understanding the Effect of Competitors\u2019 Participation History on Their Performance","volume":"33","author":"Khasraghi","year":"2014","journal-title":"Behaviour & Information Technology"},{"key":"2025082212170482500_b65-11_14103_ra_mosarkar","volume-title":"Work and Personality: An Inquiry into the Impact of Social Stratification","author":"Kohn","year":"1983"},{"issue":"4","key":"2025082212170482500_b66-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"941","DOI":"10.2307\/25148760","article-title":"The Effects of Personalization and Familiarity on Trust and Adoption of Recommendation Agents","volume":"30","author":"Komiak","year":"2006","journal-title":"MIS Quarterly"},{"issue":"8","key":"2025082212170482500_b67-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MC.2009.263","article-title":"Matrix Factorization Techniques for Recommender Systems","volume":"42","author":"Koren","year":"2009","journal-title":"Computer"},{"key":"2025082212170482500_b68-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.1145\/2598153.2602249","article-title":"Toward Effective Tasks Navigation in Crowdsourcing","author":"Kucherbaev","year":"2014"},{"key":"2025082212170482500_b69-11_14103_ra_mosarkar","unstructured":"Lacy, S.\n          \u20082012. \u201cGet Over It, Haters: 99designs Has Tipped\u201d (https:\/\/pando.com\/2012\/01\/24\/get-over-it-haters-99designs-has-tipped\/)."},{"key":"2025082212170482500_b70-11_14103_ra_mosarkar","article-title":"The Value of Openness in Scientific Problem Solving","volume-title":"Working Paper","author":"Lakhani","year":"2007"},{"key":"2025082212170482500_b71-11_14103_ra_mosarkar","article-title":"An Empirical Study of Boxing Match Prediction Using a Logistic Regression Analysis","author":"Lee","year":"1997"},{"issue":"3","key":"2025082212170482500_b72-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"169","DOI":"10.5750\/jpm.v1i3.427","article-title":"Adapting Least-Square Support Vector Regression Models to Forecast the Outcome of Horseraces","volume":"1","author":"Lessman","year":"2012","journal-title":"The Journal of Prediction Markets"},{"issue":"2","key":"2025082212170482500_b73-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"72","DOI":"10.17705\/1jais.00389","article-title":"Online Recommendation Systems in a B2C E-Commerce Context: A Review and Future Directions","volume":"16","author":"Li","year":"2015","journal-title":"Journal of the Association for Information Systems"},{"issue":"6","key":"2025082212170482500_b74-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1287\/mnsc.2016.2446","article-title":"Utility-Based Link Recommendation for Online Social Networks","volume":"63","author":"Li","year":"2017","journal-title":"Management Science"},{"issue":"2","key":"2025082212170482500_b75-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"397","DOI":"10.25300\/MISQ\/2017\/41.2.04","article-title":"The Demand Effects of Product Recommendation Networks: An Empirical Analysis of Network Diversity and Stability","volume":"41","author":"Lin","year":"2017","journal-title":"MIS Quarterly"},{"issue":"8","key":"2025082212170482500_b76-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1287\/mnsc.2013.1845","article-title":"Crowd-sourcing with All-Pay Auctions: A Field Experiment on TaskCN","volume":"60","author":"Liu","year":"2014","journal-title":"Management Science"},{"issue":"1","key":"2025082212170482500_b77-11_14103_ra_mosarkar","first-page":"1","article-title":"Predicting NBA Games Using Neural Networks","volume":"5","author":"Loeffelhold","year":"2009","journal-title":"Journal of Quantitative Analysis in Sports"},{"key":"2025082212170482500_b78-11_14103_ra_mosarkar","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511809071","volume-title":"Introduction to Information Retrieval","author":"Manning","year":"2008"},{"issue":"4","key":"2025082212170482500_b79-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1037\/0021-9010.79.4.493","article-title":"A Confirmatory Test of a Model of Performance Determinants","volume":"79","author":"McCloy","year":"1994","journal-title":"Journal of Applied Psychology"},{"issue":"2","key":"2025082212170482500_b80-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1037\/0021-9010.73.2.327","article-title":"Job Experience Correlates of Job Performance","volume":"73","author":"McDaniel","year":"1988","journal-title":"Journal of Applied Psychology"},{"issue":"3","key":"2025082212170482500_b81-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1257\/aer.91.3.542","article-title":"The Optimal Allocation of Prizes in Contests","volume":"91","author":"Moldovanu","year":"2001","journal-title":"American Economic Review"},{"issue":"1","key":"2025082212170482500_b82-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"21","DOI":"10.2307\/3003535","article-title":"Prizes and Incentives: Towards a General Theory of Compensation and Competition","volume":"14","author":"Nalebuff","year":"1983","journal-title":"The Bell Journal of Economics"},{"issue":"11","key":"2025082212170482500_b83-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1861","DOI":"10.1287\/mnsc.1090.1057","article-title":"A Matter of Balance: Specialization, Task Variety, and Individual Learning in a Software Maintenance Environment","volume":"55","author":"Narayanan","year":"2009","journal-title":"Management Science"},{"issue":"1","key":"2025082212170482500_b84-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"65","DOI":"10.2307\/41410406","article-title":"Recommendation Networks and the Long Tail of Electronic Commerce","volume":"36","author":"Oestreicher-Singer","year":"2012","journal-title":"MIS Quarterly"},{"issue":"11","key":"2025082212170482500_b85-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1287\/mnsc.1120.1536","article-title":"The Visible Hand? Demand Effects of Recommendation Networks in Electronic Markets","volume":"58","author":"Oestreicher-Singer","year":"2012","journal-title":"Management Science"},{"key":"2025082212170482500_b86-11_14103_ra_mosarkar","volume-title":"Managerial Attitudes and Performance","author":"Porter","year":"1968"},{"issue":"2","key":"2025082212170482500_b87-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1287\/isre.2015.0576","article-title":"Finding Similar Mobile Consumers with a Privacy-Friendly Geosocial Design","volume":"26","author":"Provost","year":"2015","journal-title":"Information Systems Research"},{"issue":"4","key":"2025082212170482500_b88-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1111\/j.1744-6570.1995.tb01785.x","article-title":"The Relationship Between Work Experience and Job Performance: A Conceptual and Meta-Analytic Review","volume":"48","author":"Qui\u00f1ones","year":"1995","journal-title":"Personnel Psychology"},{"key":"2025082212170482500_b89-11_14103_ra_mosarkar","unstructured":"Roth, Y., Petavy, F., and de Matos, M. B.\u20082016. \u201cThe State of Crowdsourcing in 2016,\u201d eYaka 2016 Crowdsourcing Report (eyaka.com)."},{"issue":"4","key":"2025082212170482500_b90-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.2307\/41703509","article-title":"A Hidden Markov Model for Collaborative Filtering","volume":"36","author":"Sahoo","year":"2012","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082212170482500_b91-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1287\/mnsc.49.1.39.12750","article-title":"Learning by Doing Something Else: Variation, Relatedness, and The Learning Curve","volume":"49","author":"Schilling","year":"2003","journal-title":"Management Science"},{"issue":"3","key":"2025082212170482500_b92-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1037\/0021-9010.71.3.432","article-title":"Impact of Job Experience and Ability on Job Knowledge, Work Sample Performance, and Supervisory Ratings of Job Performance","volume":"71","author":"Schmidt","year":"1986","journal-title":"Journal of Applied Psychology"},{"key":"2025082212170482500_b93-11_14103_ra_mosarkar","article-title":"Worker\u2019s Task Choice in Crowdsourcing and Human Computation Markets","author":"Schulze","year":"2012"},{"issue":"6","key":"2025082212170482500_b94-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.5465\/amj.2008.35732606","article-title":"Learning in Hybrid-Project Systems: The Effects of Project Performance on Repeated Collaboration","volume":"51","author":"Schwab","year":"2008","journal-title":"Academy of Management Journal"},{"key":"2025082212170482500_b95-11_14103_ra_mosarkar","first-page":"39","article-title":"Improving the Effectiveness of Collaborative Recommendation with Ontology-based User Profiles","author":"Sieg","year":"2010"},{"issue":"4","key":"2025082212170482500_b96-11_14103_ra_mosarkar","first-page":"309","article-title":"Creativity as Blind Variation and Selective Retention: Is the Creative Process Darwinian?","volume":"10","author":"Simonton","year":"1999","journal-title":"Psychological Inquiry"},{"key":"2025082212170482500_b97-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1006\/drev.1999.0504","article-title":"Creative Development as Acquired Expertise: Theoretical Issues and an Empirical Test","volume":"20","author":"Simonton","year":"2000","journal-title":"Developmental Review"},{"issue":"4","key":"2025082212170482500_b98-11_14103_ra_mosarkar","first-page":"115","article-title":"Data Mining in Sports: Predicting Cy Young Award Winners","volume":"22","author":"Smith","year":"2007","journal-title":"Journal of Computing Sciences in Colleges"},{"key":"2025082212170482500_b99-11_14103_ra_mosarkar","first-page":"427","article-title":"Job Performance","volume-title":"The Sage Handbook of Organizational Behavior","author":"Sonnentag","year":"2008"},{"issue":"9","key":"2025082212170482500_b100-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1287\/mnsc.1080.0884","article-title":"Innovation Contests, Open Innovation, and Multiagent Problem Solving","volume":"54","author":"Terwiesch","year":"2008","journal-title":"Management Science"},{"key":"2025082212170482500_b101-11_14103_ra_mosarkar","first-page":"271","article-title":"Toward a Hierarchical Model of Intrinsic and Extrinsic Motivation","volume-title":"Advances in Experimental Social Psychology","author":"Vallerand","year":"1997"},{"key":"2025082212170482500_b102-11_14103_ra_mosarkar","volume-title":"Work and Motivation","author":"Vroom","year":"1964"},{"issue":"3","key":"2025082212170482500_b103-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1080\/07468342.2002.11921944","article-title":"Winning Games in Canadian Football: A Logistic Regression Analysis","volume":"33","author":"Willoughby","year":"2002","journal-title":"The College Mathematics Journal"},{"issue":"1","key":"2025082212170482500_b104-11_14103_ra_mosarkar","doi-asserted-by":"crossref","first-page":"137","DOI":"10.2307\/25148784","article-title":"E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact","volume":"31","author":"Xiao","year":"2007","journal-title":"MIS Quarterly"},{"key":"2025082212170482500_b105-11_14103_ra_mosarkar","first-page":"246","article-title":"Crowd-sourcing and Knowledge Sharing: Strategic User Behavior on TaskCN","author":"Yang","year":"2008"},{"key":"2025082212170482500_b106-11_14103_ra_mosarkar","article-title":"Winner Determination of Open Innovation Contests in Online Markets","author":"Yang","year":"2011"},{"key":"2025082212170482500_b107-11_14103_ra_mosarkar","article-title":"Open Innovation: An Empirical Study of Online Contest","author":"Yang","year":"2009"},{"key":"2025082212170482500_b108-11_14103_ra_mosarkar","first-page":"22","article-title":"Task Recommendation in Crowdsourcing Systems","author":"Yuen","year":"2012"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/42\/3\/919\/6147\/11_14103_ra_mosarkar.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/42\/3\/919\/6147\/11_14103_ra_mosarkar.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:19:03Z","timestamp":1755879543000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/42\/3\/919\/1720\/Know-When-to-Run-Recommendations-in-Crowdsourcing"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,1]]},"references-count":107,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,9,1]]},"published-print":{"date-parts":[[2018,9,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2018\/14103","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,1]]}}}