{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T21:32:14Z","timestamp":1761514334186,"version":"3.41.2"},"reference-count":63,"publisher":"ASME International","issue":"3","funder":[{"DOI":"10.13039\/100000147","name":"Division of Civil, Mechanical and Manufacturing Innovation","doi-asserted-by":"publisher","award":["1400050"],"award-info":[{"award-number":["1400050"]}],"id":[{"id":"10.13039\/100000147","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,9,1]]},"abstract":"<jats:p>This paper analyzes participation behaviors in design crowdsourcing by modeling interactions between participants and design contests as a bipartite network. Such a network consists of two types of nodes, participant nodes and design contest nodes, and the links indicating participation decisions. The exponential random graph models (ERGMs) are utilized to test the interdependence between participants' decisions. ERGMs enable the utilization of different network configurations (e.g., stars and triangles) to characterize different forms of dependencies and to identify the factors that influence the link formation. A case study of an online design crowdsourcing platform is carried out. Our results indicate that designer, contest, incentive, and factors of dependent relations have significant effects on participation in online contests. The results reveal some unique features about the effects of incentives, e.g., the fraction of total prize allocated to the first prize negatively influences participation. Further, we observe that the contest popularity modeled by the alternating k-star network statistic has a significant influence on participation, whereas associations between participants modeled by the alternating two-path network statistic do not. These insights are useful to system designers for initiating effective crowdsourcing mechanisms to support product design and development. The approach is validated by applying the estimated ERGMs to predict participants' decisions and comparing with their actual decisions.<\/jats:p>","DOI":"10.1115\/1.4042639","type":"journal-article","created":{"date-parts":[[2019,1,25]],"date-time":"2019-01-25T04:21:36Z","timestamp":1548390096000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":9,"title":["Modeling Participation Behaviors in Design Crowdsourcing Using a Bipartite Network-Based Approach"],"prefix":"10.1115","volume":"19","author":[{"given":"Zhenghui","family":"Sha","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, University of Arkansas, Fayetteville, AR 72701 e-mail:"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashish M.","family":"Chaudhari","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jitesh H.","family":"Panchal","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Purdue University, West Lafayette, IN 47907"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"33","published-online":{"date-parts":[[2019,3,21]]},"reference":[{"issue":"4","key":"2019100602465377400_bib1","first-page":"872","article-title":"Digging for Golden Carrots: An Analysis of Research Tournaments","volume":"85","year":"1995","journal-title":"Am. Econ. Rev."},{"issue":"3","key":"2019100602465377400_bib2","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1257\/000282803322157025","article-title":"Optimal Design of Research Contests","volume":"93","year":"2003","journal-title":"Am. Econ. Rev."},{"issue":"1","key":"2019100602465377400_bib3","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1111\/j.1467-6419.2008.00557.x","article-title":"Multiple-Prize Contests\u2014The Optimal Allocation of Prizes","volume":"23","year":"2009","journal-title":"J. Econ. Surv."},{"issue":"2","key":"2019100602465377400_bib4","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1111\/j.1465-7295.2009.00274.x","article-title":"Contest Design: An Experimental Investigation","volume":"49","year":"2011","journal-title":"Econ. Inquiry"},{"issue":"5","key":"2019100602465377400_bib5","doi-asserted-by":"publisher","first-page":"051405","DOI":"10.1115\/1.4029767","article-title":"Behavioral Experimentation and Game Theory in Engineering Systems Design","volume":"137","year":"2015","journal-title":"ASME J. Mech. Des."},{"key":"2019100602465377400_bib6","unstructured":"Chaudhari, A., Thekinen, J., and Panchal, J., 2016, \u201cUsing Contests for Engineering Systems Design: A Study of Auctions and Fixed-Prize Tournaments,\u201d DS 84: DESIGN 2016: 14th International Design Conference, Durbovnik, Croatia, May 16\u201319, pp. 947\u2013956.https:\/\/www.designsociety.org\/publication\/38905\/USING+CONTESTS+FOR+ENGINEERING+SYSTEMS+DESIGN%3A+A+STUDY+OF+AUCTIONS+AND+FIXED-PRIZE+TOURNAMENTS"},{"issue":"9","key":"2019100602465377400_bib7","doi-asserted-by":"publisher","first-page":"091402","DOI":"10.1115\/1.4037253","article-title":"Understanding Design Decisions Under Competition Using Games With Information Acquisition and a Behavioral Experiment","volume":"139","year":"2017","journal-title":"ASME J. Mech. Des."},{"issue":"9","key":"2019100602465377400_bib8","doi-asserted-by":"publisher","first-page":"091401","DOI":"10.1115\/1.4040166","article-title":"Analyzing Participant Behaviors in Design Crowdsourcing Contests Using Causal Inference on Field Data","volume":"140","year":"2018","journal-title":"ASME J. Mech. Des."},{"key":"2019100602465377400_bib9","article-title":"Engineering & Design Challenges"},{"article-title":"Human Intelligence Through an API","year":"2018","author":"Amazon Mechanical Turk","key":"2019100602465377400_bib10"},{"key":"2019100602465377400_bib11","unstructured":"Panchal, J., 2015, \u201cUsing Crowds in Engineering Design\u2014Towards a Holistic Framework,\u201d International Conference on Engineering Design, Design Society (ICED), Milan, Italy, July 27\u201330, pp. 27\u201330.https:\/\/engineering.purdue.edu\/DELP\/sites\/default\/files\/Panchal_ICED_2015_0.pdf"},{"issue":"3","key":"2019100602465377400_bib12","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.indmarman.2013.12.008","article-title":"A Network Perspective on Idea and Innovation Crowdsourcing in Industrial Firms","volume":"43","year":"2014","journal-title":"Ind. Mark. Manage."},{"issue":"2","key":"2019100602465377400_bib13","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.ejpoleco.2004.07.002","article-title":"Incentive Effects of Second Prizes","volume":"21","year":"2005","journal-title":"Eur. J. Political Econ."},{"issue":"4","key":"2019100602465377400_bib14","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1016\/S0176-2680(98)00028-7","article-title":"Influence and the Discretionary Allocation of Several Prizes","volume":"14","year":"1998","journal-title":"Eur. J. Political Econ."},{"issue":"1","key":"2019100602465377400_bib15","doi-asserted-by":"publisher","first-page":"62","DOI":"10.2307\/2696375","article-title":"Using Auctions to Reward Tournament Winners: Theory and Experimental Investigation","volume":"33","year":"2002","journal-title":"RAND J. Econ."},{"key":"2019100602465377400_bib16","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s00199-007-0208-9","article-title":"Fixed-Prize Tournaments Versus First-Price Auctions in Innovation Contests","volume":"35","year":"2008","journal-title":"Econ. Theory"},{"issue":"7","key":"2019100602465377400_bib17","doi-asserted-by":"publisher","first-page":"896","DOI":"10.1108\/OIR-08-2014-0188","article-title":"Effects of Extrinsic and Intrinsic Motivation on Participation in Crowdsourcing Contest","volume":"38","year":"2014","journal-title":"Online Inf. Rev."},{"issue":"4","key":"2019100602465377400_bib18","doi-asserted-by":"publisher","first-page":"57","DOI":"10.2753\/JEC1086-4415150402","article-title":"Task Design, Motivation, and Participation in Crowdsourcing Contests","volume":"15","year":"2011","journal-title":"Int. J. Electron. Commerce"},{"issue":"7","key":"2019100602465377400_bib19","doi-asserted-by":"publisher","first-page":"984","DOI":"10.1287\/mnsc.1060.0554","article-title":"Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects","volume":"52","year":"2006","journal-title":"Manage. Sci."},{"issue":"2","key":"2019100602465377400_bib20","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1525\/cmr.2010.52.2.98","article-title":"Refining Virtual Co-Creation From a Consumer Perspective","volume":"52","year":"2010","journal-title":"California Manage. Rev."},{"issue":"1","key":"2019100602465377400_bib21","doi-asserted-by":"publisher","first-page":"197","DOI":"10.2753\/MIS0742-1222260108","article-title":"Leveraging Crowdsourcing: Activation-Supporting Components for It-Based Ideas Competition","volume":"26","year":"2009","journal-title":"J. Manage. Inf. Syst."},{"issue":"4","key":"2019100602465377400_bib22","doi-asserted-by":"publisher","first-page":"39","DOI":"10.2753\/JEC1086-4415130403","article-title":"Motivations in Open Source Software Communities: The Mediating Role of Effort Intensity and Goal Commitment","volume":"13","year":"2009","journal-title":"Int. J. Electron. Commerce"},{"key":"2019100602465377400_bib23","first-page":"17","article-title":"An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets","volume":"11","year":"2011","journal-title":"ICWSM"},{"key":"2019100602465377400_bib24","doi-asserted-by":"crossref","unstructured":"Archak, N., 2010, \u201cMoney, Glory and Cheap Talk: Analyzing Strategic Behavior of Contestants in Simultaneous Crowdsourcing Contests on TopCoder.com,\u201d 19th International Conference on World Wide Web, Raleigh, NC, Apr. 26\u201330, pp. 21\u201330.","DOI":"10.1145\/1772690.1772694"},{"key":"2019100602465377400_bib25","unstructured":"Aker, A., El-Haj, M., Albakour, M.-D., and Kruschwitz, U., 2012, \u201cAssessing Crowdsourcing Quality Through Objective Tasks,\u201d Language Resources and Evaluation (LREC), Istambul, Turkey, May 23\u201327, pp. 1456\u20131461."},{"key":"2019100602465377400_bib26","doi-asserted-by":"crossref","unstructured":"Li, K., Xiao, J., Wang, Y., and Wang, Q., 2013, \u201cAnalysis of the Key Factors for Software Quality in Crowdsourcing Development: An Empirical Study on TopCoder.com,\u201d IEEE37th Annual Computer Software and Applications Conference, Kyoto, Japan, July 22\u201326, pp. 812\u2013817.10.1109\/COMPSAC.2013.133","DOI":"10.1109\/COMPSAC.2013.133"},{"issue":"2","key":"2019100602465377400_bib27","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1016\/j.dss.2007.07.001","article-title":"A Trust-Based Consumer Decision-Making Model in Electronic Commerce: The Role of Trust, Perceived Risk, and Their Antecedents","volume":"44","year":"2008","journal-title":"Decis. Support Syst."},{"issue":"3","key":"2019100602465377400_bib28","first-page":"212","article-title":"Antecedents of Solution Quality in Crowdsourcing: The Sponsor's Perspective","volume":"15","year":"2014","journal-title":"J. Electron. Commerce Res."},{"issue":"4","key":"2019100602465377400_bib29","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1287\/mksc.1090.0555","article-title":"The Impact of Customer Community Participation on Customer Behaviors: An Empirical Investigation","volume":"29","year":"2010","journal-title":"Mark. Sci."},{"key":"2019100602465377400_bib30","doi-asserted-by":"crossref","unstructured":"Kazai, G., 2011, \u201cIn Search of Quality in Crowdsourcing for Search Engine Evaluation,\u201d European Conference on Information Retrieval (ECIR), Dublin, Ireland, Apr. 18\u201321, pp. 165\u2013176.https:\/\/dl.acm.org\/citation.cfm?id=1996911","DOI":"10.1007\/978-3-642-20161-5_17"},{"issue":"5","key":"2019100602465377400_bib31","doi-asserted-by":"publisher","first-page":"1016","DOI":"10.1287\/orsc.1090.0491","article-title":"Marginality and Problem-Solving Effectiveness in Broadcast Search","volume":"21","year":"2010","journal-title":"Org. Sci."},{"issue":"3","key":"2019100602465377400_bib32","doi-asserted-by":"publisher","first-page":"031101","DOI":"10.1115\/1.4029065","article-title":"When Crowdsourcing Fails: A Study of Expertise on Crowdsourced Design Evaluation","volume":"137","year":"2015","journal-title":"ASME J. Mech. Des."},{"issue":"2","key":"2019100602465377400_bib33","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.jadohealth.2009.01.007","article-title":"Adolescent Affiliations and Adiposity: A Social Network Analysis of Friendships and Obesity","volume":"45","year":"2009","journal-title":"J. Adolesc. Health"},{"issue":"4","key":"2019100602465377400_bib34","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1080\/1091367X.2010.495559","article-title":"The Application of Social Network Analysis to Team Sports","volume":"14","year":"2010","journal-title":"Meas. Phys. Educ. Exercise Sci."},{"issue":"6","key":"2019100602465377400_bib35","doi-asserted-by":"publisher","first-page":"994","DOI":"10.1016\/j.leaqua.2012.10.010","article-title":"The Topology of Collective Leadership","volume":"23","year":"2012","journal-title":"Leadership Q."},{"issue":"373","key":"2019100602465377400_bib36","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1080\/01621459.1981.10477598","article-title":"An Exponential Family of Probability Distributions for Directed Graphs","volume":"76","year":"1981","journal-title":"J. Am. Stat. Assoc."},{"issue":"395","key":"2019100602465377400_bib37","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1080\/01621459.1986.10478342","article-title":"Markov Graphs","volume":"81","year":"1986","journal-title":"J. Am. Stat. Assoc."},{"issue":"1","key":"2019100602465377400_bib38","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/1467-9531.00119","article-title":"Neighborhood\u2013Based Models for Social Networks","volume":"32","year":"2002","journal-title":"Sociol. Methodol."},{"issue":"1","key":"2019100602465377400_bib39","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1111\/j.1467-9531.2006.00176.x","article-title":"New Specifications for Exponential Random Graph Models","volume":"36","year":"2006","journal-title":"Sociol. Methodol."},{"issue":"2","key":"2019100602465377400_bib40","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.socnet.2011.12.004","article-title":"Exponential Random Graph Model Specifications for Bipartite Networks\u2014A Dependence Hierarchy","volume":"35","year":"2013","journal-title":"Soc. Networks"},{"issue":"1","key":"2019100602465377400_bib41","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.socnet.2013.01.004","article-title":"Exponential Random Graph Models for Multilevel Networks","volume":"35","year":"2013","journal-title":"Soc. Networks"},{"key":"2019100602465377400_bib42","doi-asserted-by":"publisher","first-page":"e11","DOI":"10.1017\/dsj.2016.11","article-title":"Modeling Customer Preferences Using Multidimensional Network Analysis in Engineering Design","volume":"2","year":"2016","journal-title":"Des. Sci."},{"key":"2019100602465377400_bib43","doi-asserted-by":"publisher","first-page":"e9","DOI":"10.1017\/dsj.2018.4","article-title":"Predicting Product Co-Consideration and Market Competitions for Technology-Driven Product Design: Anetwork-Based Approach","volume":"4","year":"2018","journal-title":"Des. Sci."},{"key":"2019100602465377400_bib44","doi-asserted-by":"publisher","first-page":"2753638","DOI":"10.1155\/2018\/2753638","article-title":"A Network-Based Approach to Modeling and Predicting Product Coconsideration Relations","volume":"2018","year":"2018","journal-title":"Complexity"},{"key":"2019100602465377400_bib45","doi-asserted-by":"publisher","DOI":"10.1115\/DETC2017-68099","article-title":"Two-Stage Modeling of Customer Choice Preferences in Engineering Design Using Bipartite Network Analysis","volume-title":"ASME","year":"2017"},{"issue":"1","key":"2019100602465377400_bib46","first-page":"1548","article-title":"Statnet: Software Tools for the Representation, Visualization, Analysis and Simulation of Network Data","volume":"24","year":"2008","journal-title":"J. Stat. Software"},{"issue":"2","key":"2019100602465377400_bib47","first-page":"1","article-title":"Markov Chain Monte Carlo Estimation of Exponential Random Graph Models","volume":"3","year":"2002","journal-title":"J. Soc. Struct."},{"issue":"2","key":"2019100602465377400_bib48","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/j.socnet.2006.08.005","article-title":"Curved Exponential Family Models for Social Networks","volume":"29","year":"2007","journal-title":"Soc. Networks"},{"author":"Scrapy.org","key":"2019100602465377400_bib49","article-title":"A Fast and Powerful Scraping and Web Crawling Framework"},{"issue":"1","key":"2019100602465377400_bib50","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1103\/RevModPhys.74.47","article-title":"Statistical Mechanics of Complex Networks","volume":"74","year":"2002","journal-title":"Rev. Modern Phys."},{"author":"Autodesk Inc.","key":"2019100602465377400_bib51","article-title":"Autodesk Robot Gripper Arm Design Challenge"},{"key":"2019100602465377400_bib52","article-title":"Dirtbike Tire Changing Tool Challenge"},{"issue":"9","key":"2019100602465377400_bib53","doi-asserted-by":"publisher","first-page":"1529","DOI":"10.1287\/mnsc.1080.0884","article-title":"Innovation Contests, Open Innovation, and Multiagent Problem Solving","volume":"54","year":"2008","journal-title":"Manage. Sci."},{"key":"2019100602465377400_bib54","article-title":"Airplane Bearing Bracket Challenge"},{"key":"2019100602465377400_bib55","article-title":"Robot Gripper Test Object Challenge"},{"issue":"5","key":"2019100602465377400_bib56","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1086\/261010","article-title":"Rank-Order Tournaments as Optimum Labor Contracts","volume":"89","year":"1981","journal-title":"J. Political Econ."},{"issue":"1","key":"2019100602465377400_bib57","doi-asserted-by":"publisher","first-page":"33","DOI":"10.2307\/3069283","article-title":"The Relationships Among Organizational Context, Pay Dispersion, and Among Managerial Turnover","volume":"45","year":"2002","journal-title":"Acad. Manage. J."},{"issue":"4","key":"2019100602465377400_bib58","doi-asserted-by":"publisher","first-page":"1199","DOI":"10.5465\/amr.2007.26586096","article-title":"What's the Difference? Diversity Constructs as Separation, Variety, or Disparity in Organizations","volume":"32","year":"2007","journal-title":"Acad. Manage. Rev."},{"issue":"4","key":"2019100602465377400_bib59","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1086\/342041","article-title":"Tournament Rewards and Risk Taking","volume":"20","year":"2002","journal-title":"J. Labor Econ."},{"issue":"5439","key":"2019100602465377400_bib60","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1126\/science.286.5439.509","article-title":"Emergence of Scaling in Random Networks","volume":"286","year":"1999","journal-title":"Science"},{"issue":"8","key":"2019100602465377400_bib61","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An Introduction to Roc Analysis","volume":"27","year":"2006","journal-title":"Pattern Recognit. Lett."},{"issue":"3","key":"2019100602465377400_bib62","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0118432","article-title":"The Precision-Recall Plot is More Informative Than the Roc Plot When Evaluating Binary Classifiers on Imbalanced Datasets","volume":"10","year":"2015","journal-title":"PLoS One"},{"key":"2019100602465377400_bib63","doi-asserted-by":"publisher","DOI":"10.1115\/DETC2018-85686","article-title":"Modeling Participation Behaviors in Design Crowdsourcing Using a Bipartite Network-Based Approach","volume-title":"ASME","year":"2018"}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4042639\/6390743\/jcise_019_03_031010.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4042639\/6390743\/jcise_019_03_031010.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,6]],"date-time":"2019-10-06T06:47:05Z","timestamp":1570344425000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/doi\/10.1115\/1.4042639\/726255\/Modeling-Participation-Behaviors-in-Design"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,21]]},"references-count":63,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4042639","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2019,3,21]]},"article-number":"031010"}}