{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:50:45Z","timestamp":1771699845680,"version":"3.50.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2013,8,14]],"date-time":"2013-08-14T00:00:00Z","timestamp":1376438400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Front. Comput. Sci."],"published-print":{"date-parts":[[2013,10]]},"DOI":"10.1007\/s11704-013-2320-2","type":"journal-article","created":{"date-parts":[[2013,8,14]],"date-time":"2013-08-14T10:50:37Z","timestamp":1376477437000},"page":"694-709","source":"Crossref","is-referenced-by-count":49,"title":["An evaluation framework for software crowdsourcing"],"prefix":"10.1007","volume":"7","author":[{"given":"Wenjun","family":"Wu","sequence":"first","affiliation":[]},{"given":"Wei-Tek","family":"Tsai","sequence":"additional","affiliation":[]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,8,14]]},"reference":[{"issue":"4","key":"2320_CR1","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/1924421.1924442","volume":"54","author":"A Doan","year":"2011","unstructured":"Doan A, Ramakrishnan R, Halevy A Y. Crowdsourcing systems on the World-Wide Web. Communications of the ACM, 2011, 54(4): 86\u201396","journal-title":"Communications of the ACM"},{"key":"2320_CR2","volume-title":"Topcoder (a): developing software through crowdsourcing","author":"K Lakhani","year":"2010","unstructured":"Lakhani K, Garvin D, Lonstein E. Topcoder (a): developing software through crowdsourcing. Harvard Business School General Management Unit Case, 2010. Available at SSRN: http:\/\/ssrn.com\/abstract=2002884"},{"key":"2320_CR3","unstructured":"uTest. https:\/\/www.utest.com\/"},{"key":"2320_CR4","first-page":"111","volume-title":"Proceedings of the 13th International Software Product Line Conference","author":"J Bosch","year":"2009","unstructured":"Bosch J. From software product lines to software ecosystems. In: Proceedings of the 13th International Software Product Line Conference. 2009, 111\u2013119"},{"key":"2320_CR5","first-page":"187","volume-title":"Proceedings of the 31st International Conference on Software Engineering-Companion Volume","author":"S Jansen","year":"2009","unstructured":"Jansen S, Finkelstein A, Brinkkemper S. A sense of community: a research agenda for software ecosystems. In: Proceedings of the 31st International Conference on Software Engineering-Companion Volume. 2009, 187\u2013190"},{"key":"2320_CR6","unstructured":"Apple Store Metrics. http:\/\/148apps.biz\/app-store-metrics\/ , 2012"},{"key":"2320_CR7","unstructured":"AppStori. http:\/\/appstori.com\/ , 2012"},{"issue":"2","key":"2320_CR8","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1145\/1869086.1869096","volume":"17","author":"A Kittur","year":"2010","unstructured":"Kittur A. Crowdsourcing, collaboration and creativity. XRDS, 2010, 17(2): 22\u201326","journal-title":"XRDS"},{"issue":"1","key":"2320_CR9","first-page":"187","volume":"2","author":"R Constantinescu","year":"2007","unstructured":"Constantinescu R, Iacob I M. Capability maturity model integration. Journal of Applied Quantitative Methods, 2007, 2(1): 187","journal-title":"Journal of Applied Quantitative Methods"},{"key":"2320_CR10","volume-title":"Military standard: defense system software development","author":"M Atwood","year":"1988","unstructured":"Atwood M. Military standard: defense system software development. Department of Defense, USA, 1988"},{"key":"2320_CR11","volume-title":"Workshop on Open Source Innovation, Strasbourg, France","author":"E Schenk","year":"2009","unstructured":"Schenk E, Guittard C. Crowdsourcing: what can be outsourced to the crowd, and why. In: Workshop on Open Source Innovation, Strasbourg, France. 2009"},{"key":"2320_CR12","volume-title":"Public-private partnerships for organizing and executing prize-based competitions","author":"R Tong","year":"2012","unstructured":"Tong R, Lakhani K. Public-private partnerships for organizing and executing prize-based competitions. Berkman Center Research Publication, 2012. Available at SSRN: http:\/\/ssrn.com\/abstract=2083755"},{"key":"2320_CR13","unstructured":"Algorithm Development Through Crowdsourcing. http:\/\/catalyst.harvard.edu\/services\/crowdsourcing\/ , 2012"},{"key":"2320_CR14","first-page":"1","volume-title":"Proceedings of the 30th International Conference on Information Systems","author":"N Archak","year":"2009","unstructured":"Archak N, Sundararajan A. Optimal design of crowdsourcing contests. In: Proceedings of the 30th International Conference on Information Systems. 2009, 1\u201316"},{"key":"2320_CR15","volume-title":"Creative software crowdsourcing","author":"T W Wu","year":"2013","unstructured":"Wu T W, Li W. Creative software crowdsourcing. Creative Software Crowdsourcing: From Components and Algorithm Development to Project Concept Formations, 2013"},{"issue":"7","key":"2320_CR16","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1287\/mnsc.1060.0546","volume":"52","author":"C Y Baldwin","year":"2006","unstructured":"Baldwin C Y, Clark K B. The architecture of participation: does code architecture mitigate free riding in the open source development model? Management Science, 2006, 52(7): 1116\u20131127","journal-title":"Management Science"},{"issue":"5945","key":"2320_CR17","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1126\/science.1177418","volume":"325","author":"D G Rand","year":"2009","unstructured":"Rand D G, Dreber A, Ellingsen T, Fudenberg D, Nowak MA. Positive interactions promote public cooperation. Science, 2009, 325(5945): 1272\u20131275","journal-title":"Science"},{"key":"2320_CR18","first-page":"569","volume":"19","author":"R Herbrich","year":"2007","unstructured":"Herbrich R, Minka T, Graepel T. TrueSkill\u2122: a bayesian skill rating system. In: Proceedings of the 2006 Annual Conference of Advances in Neural Information Processing Systems. 2007, 19: 569\u2013576","journal-title":"Proceedings of the 2006 Annual Conference of Advances in Neural Information Processing Systems"},{"key":"2320_CR19","unstructured":"TopCoder Inc. http:\/\/apps.topcoder.com\/wiki\/display\/tc\/algorithm+competition+rating+system , 2013"},{"key":"2320_CR20","unstructured":"Apple App Store Review Guidelines. https:\/\/developer.apple.com\/appstore\/guidelines.html , 2010"},{"key":"2320_CR21","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1145\/1772690.1772694","volume-title":"Proceedings of the 19th International Conference on World Wide Web","author":"N Archak","year":"2010","unstructured":"Archak N. Money, glory and cheap talk: analyzing strategic behavior of contestants in simultaneous crowdsourcing contests on topcoder. com. In: Proceedings of the 19th International Conference on World Wide Web. 2010, 21\u201330"},{"key":"2320_CR22","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1145\/1566374.1566392","volume-title":"Proceedings of the 10th ACM Conference on Electronic Commerce","author":"D DiPalantino","year":"2009","unstructured":"DiPalantino D, Vojnovic M. Crowdsourcing and all-pay auctions. In: Proceedings of the 10th ACM Conference on Electronic Commerce. 2009, 119\u2013128"},{"key":"2320_CR23","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1145\/1807342.1807376","volume-title":"Proceedings of the 11th ACM Conference on Electronic Commerce","author":"J J Horton","year":"2010","unstructured":"Horton J J, Chilton L B. The labor economics of paid crowdsourcing. In: Proceedings of the 11th ACM Conference on Electronic Commerce. 2010, 209\u2013218"},{"key":"2320_CR24","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1145\/1639950.1640066","volume-title":"Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications","author":"D F Bacon","year":"2009","unstructured":"Bacon D F, Chen Y, Parkes D, Rao M. A market-based approach to software evolution. In: Proceedings of the 24th ACM SIGPLAN Conference Companion on Object Oriented Programming Systems Languages and Applications. 2009, 973\u2013980"},{"key":"2320_CR25","volume-title":"Proceedings of the 16th Americas Conference on Information Systems","author":"A C Bullinger","year":"2010","unstructured":"Bullinger A C, Moeslein K. Innovation contests-where are we? In: Proceedings of the 16th Americas Conference on Information Systems. 2010"},{"issue":"1","key":"2320_CR26","doi-asserted-by":"crossref","first-page":"197","DOI":"10.2753\/MIS0742-1222260108","volume":"26","author":"J M Leimeister","year":"2009","unstructured":"Leimeister J M, Huber M, Bretschneider U, Krcmar H. Leveraging crowdsourcing: activation-supporting components for it-based ideas competition. Journal of Management Information Systems, 2009, 26(1): 197\u2013224","journal-title":"Journal of Management Information Systems"},{"issue":"7","key":"2320_CR27","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1145\/1538788.1538808","volume":"52","author":"R Kazman","year":"2009","unstructured":"Kazman R, Chen HM. The metropolis model a new logic for development of crowdsourced systems. Communications of the ACM, 2009, 52(7): 76\u201384","journal-title":"Communications of the ACM"},{"key":"2320_CR28","unstructured":"Bratvold D, Armstrong C. http:\/\/www.dailycrowdsource.com , 2013"}],"container-title":["Frontiers of Computer Science"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11704-013-2320-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11704-013-2320-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11704-013-2320-2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,7,20]],"date-time":"2019-07-20T23:45:35Z","timestamp":1563666335000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11704-013-2320-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,8,14]]},"references-count":28,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2013,10]]}},"alternative-id":["2320"],"URL":"https:\/\/doi.org\/10.1007\/s11704-013-2320-2","relation":{},"ISSN":["2095-2228","2095-2236"],"issn-type":[{"value":"2095-2228","type":"print"},{"value":"2095-2236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,8,14]]}}}