{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:01:05Z","timestamp":1775023265733,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"GROUP","license":[{"start":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T00:00:00Z","timestamp":1625702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","award":["312870\/2018-3"],"award-info":[{"award-number":["312870\/2018-3"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"crossref","award":["311256\/2018-0"],"award-info":[{"award-number":["311256\/2018-0"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004263","name":"FAPERGS","doi-asserted-by":"crossref","award":["17\/2551-0001 205-4"],"award-info":[{"award-number":["17\/2551-0001 205-4"]}],"id":[{"id":"10.13039\/501100004263","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,7,8]]},"abstract":"<jats:p>Software Crowdsourcing (SW CS) allows a requester to increase the speed of its software development efforts by submitting a task to be performed by the crowd. SW CS is usually structured around software platforms, which are used by crowd members to identify a task suited for them, gather information about this task, and finally, submit a solution for it. In competitive software crowdsourcing, members of the crowd independently create solutions while competing against each other by monetary rewards for task completion. While competition usually reduces collaboration, in this paper, we investigated how crowd members create a collaborative behavior during programming challenges using online forums to help each other, share useful information, and discuss important documents and artifacts. We also investigated different collaborative behaviours by crowd members and and how this collaboration is associated with crowd members' improved outcome in the challenges. These results are based on analysis of the online forums from Topcoder, one of the largest competitive SW CS platforms<\/jats:p>","DOI":"10.1145\/3463932","type":"journal-article","created":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T16:52:15Z","timestamp":1626195135000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Collaborative Behavior and Winning Challenges in Competitive Software Crowdsourcing"],"prefix":"10.1145","volume":"5","author":[{"given":"Leticia S.","family":"Machado","sequence":"first","affiliation":[{"name":"Universidade Federal do Par\u00e1, Belem, Brazil"}]},{"given":"Ricardo Rodrigo M.","family":"Melo","sequence":"additional","affiliation":[{"name":"Universidade Federal do Par\u00e1, Bel\u00e9m, Brazil"}]},{"given":"Cleidson R. B.","family":"de Souza","sequence":"additional","affiliation":[{"name":"Universidade Federal do Par\u00e1, Belem, Brazil"}]},{"given":"Rafael","family":"Prikladnicki","sequence":"additional","affiliation":[{"name":"Pontif\u00edcia Universidade Cat\u00f3lica do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2021,7,13]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Innovation Contests: A Review, Classification and Outlook. Creativity and Innovation Management 21 (12","author":"Adamczyk Sabrina","year":"2012"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772694"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/2478553.2478856"},{"key":"e_1_2_1_4_1","volume-title":"From Crowds to Collaborators: Initiating Effort Catalyzing Interactions Among Online Creative Workers. SSRN Electronic Journal (01","author":"Boudreau Kevin","year":"2014"},{"key":"e_1_2_1_5_1","volume-title":"Incentives and Follow-on Reuse: Theory on Processes of Cumulative Innovation and a Field Experiment in Computational Biology. Research Policy 44 (02","author":"Boudreau Kevin","year":"2015"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Brabham and Daren C. 2008. Crowdsourcing as a Model for Problem Solving: An Introduction and Cases. The International Journal of Research into New Media Technologies 14 (1) (01 2008) 75--90.  Brabham and Daren C. 2008. Crowdsourcing as a Model for Problem Solving: An Introduction and Cases. The International Journal of Research into New Media Technologies 14 (1) (01 2008) 75--90.","DOI":"10.1177\/1354856507084420"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099205"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180929"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-012-9181-3"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358948"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"J. Corbin and A. Strauss. 2008. Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory. Sage.  J. Corbin and A. Strauss. 2008. Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory. Sage.","DOI":"10.4135\/9781452230153"},{"key":"e_1_2_1_12_1","volume-title":"Research design: Qualitative, quantitative, and mixed methods approaches","author":"Creswell John W"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3375194"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1924421.1924442"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Alpana Dubey Kumar Abhinav Sakshi Taneja Gurdeep Virdi Anurag Dwarakanath Alex Kass and Suma Mani. 2016. Dynamics of Software Development Crowdsourcing. https:\/\/doi.org\/10.1109\/ICGSE.2016.13  Alpana Dubey Kumar Abhinav Sakshi Taneja Gurdeep Virdi Anurag Dwarakanath Alex Kass and Suma Mani. 2016. Dynamics of Software Development Crowdsourcing. https:\/\/doi.org\/10.1109\/ICGSE.2016.13","DOI":"10.1109\/ICGSE.2016.13"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819942"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00136714"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025012916465"},{"key":"e_1_2_1_19_1","volume-title":"Collaboration and Control: Crisis Management and Multimedia Technology in London Underground Line Control Rooms. Computer Supported Cooperative Work - CSCW 1 (03","author":"Heath Christian","year":"1992"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134687"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1481457"},{"key":"e_1_2_1_22_1","volume-title":"Communitition: The Tension Between Competition and Collaboration in Community Based Design Contests. Creativity and Innovation Management 20 (02","author":"Hutter Katja","year":"2011"},{"key":"e_1_2_1_23_1","volume-title":"Managing the Human Cloud. MIT Sloan Management Review 54 (12","author":"Kaganer Evgeny","year":"2013"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869086.1869096"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_2_1_26_1","volume-title":"Developing Software through Crowdsourcing.(01","author":"Lakhani Karim","year":"2010"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2818754.2818823"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2016.12"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647349"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675161"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-014-9205-2"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSI-SE.2017.6"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMR.2010.5559142"},{"key":"e_1_2_1_34_1","volume-title":"A Survey of the Use of Crowdsourcing in Software Engineering. Journal of Systems and Software 126 (09","author":"Mao Ke","year":"2016"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470728"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Sreeja Nag Ira Heffan Alvar Saenz-Otero and Mike Lydon. 2012. SPHERES Zero Robotics Software Development: Lessons on Crowdsourcing and Collaborative Competition. https:\/\/doi.org\/10.1109\/AERO.2012.6187452  Sreeja Nag Ira Heffan Alvar Saenz-Otero and Mike Lydon. 2012. SPHERES Zero Robotics Software Development: Lessons on Crowdsourcing and Collaborative Competition. https:\/\/doi.org\/10.1109\/AERO.2012.6187452","DOI":"10.1109\/AERO.2012.6187452"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2018.00114"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143549"},{"key":"e_1_2_1_39_1","volume-title":"Muhammad Ali Babar, and Christof Ebert","author":"Peng Xin","year":"2014"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2820116.2820120"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2017.2"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1080\/10580530.2013.739883"},{"key":"e_1_2_1_43_1","volume-title":"Towards a characterization of crowdsourcing practices. Journal of Innovation Economics n\u00b07 (01","author":"Schenk Eric","year":"2011"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2774297"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568249"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134735"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531731"},{"key":"e_1_2_1_48_1","volume-title":"Retrieved","year":"2017"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3266237.3266265"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985765"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985765"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460650"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-013-2320-2"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2961111.2962594"},{"key":"e_1_2_1_55_1","volume-title":"Worker Behaviors in Competitive Crowdsourcing Tasks. Empirical Software Engineering and Measurement (ESEM), 2015 ACM\/IEEE International Symposium on (10","author":"Yang Ye","year":"2015"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2016.151"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463932","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3463932","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:15Z","timestamp":1750191135000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,8]]},"references-count":56,"journal-issue":{"issue":"GROUP","published-print":{"date-parts":[[2021,7,8]]}},"alternative-id":["10.1145\/3463932"],"URL":"https:\/\/doi.org\/10.1145\/3463932","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,8]]},"assertion":[{"value":"2021-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}