{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:16:15Z","timestamp":1750220175128,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":19,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T00:00:00Z","timestamp":1634342400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Chinese Ministry of Science and Technology","award":["2018YFB1402700"],"award-info":[{"award-number":["2018YFB1402700"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61690202"],"award-info":[{"award-number":["61690202"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key Laboratory of Software Environment at Beihang University"},{"name":"National 973 Program","award":["2013CB329601"],"award-info":[{"award-number":["2013CB329601"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,16]]},"DOI":"10.1145\/3503181.3503185","type":"proceedings-article","created":{"date-parts":[[2022,3,1]],"date-time":"2022-03-01T23:13:40Z","timestamp":1646176420000},"page":"18-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["From Crowdsourced Software Development to Crowdtesting"],"prefix":"10.1145","author":[{"given":"Wei-Tek","family":"Tsai","sequence":"first","affiliation":[{"name":"Digital Society & Blockchain Laboratory, Beihang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Zhang","sequence":"additional","affiliation":[{"name":"Digital Society & Blockchain Laboratory, Beihang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shufeng","family":"Hu","sequence":"additional","affiliation":[{"name":"Digital Society & Blockchain Laboratory, Beihang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3]]},"reference":[{"volume-title":"Software sourcing in the age of open: leveraging the unknown workforce","author":"\u00c5gerfalk J","key":"e_1_3_2_1_1_1","unstructured":"P\u00e4r\u00a0 J \u00c5gerfalk , Brian Fitzgerald , and Klaas-Jan Stol . 2015. Software sourcing in the age of open: leveraging the unknown workforce . Springer . P\u00e4r\u00a0J \u00c5gerfalk, Brian Fitzgerald, and Klaas-Jan Stol. 2015. Software sourcing in the age of open: leveraging the unknown workforce. Springer."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2018.00018"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2017.080605"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2016.69"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICGSE.2016.13"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2014.79"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2018.515"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.37"},{"key":"e_1_3_2_1_9_1","unstructured":"Niklas Leicht David Durward Ivo Blohm and Jan\u00a0Marco Leimeister. 2015. Crowdsourcing in software development: A state-of-the-art analysis. (2015).  Niklas Leicht David Durward Ivo Blohm and Jan\u00a0Marco Leimeister. 2015. Crowdsourcing in software development: A state-of-the-art analysis. (2015)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"N Leicht N Knop I Blohm C M\u00fcller-Bloch and JM Leimeister. 2016. When is crowdsourcing advantageous. The case of crowdsourced software testing(2016).  N Leicht N Knop I Blohm C M\u00fcller-Bloch and JM Leimeister. 2016. When is crowdsourcing advantageous. The case of crowdsourced software testing(2016).","DOI":"10.2139\/ssrn.3159166"},{"volume-title":"Crowdsourcing","author":"Li Wei","key":"e_1_3_2_1_11_1","unstructured":"Wei Li , Wei-Tek Tsai , and Wenjun Wu. 2015. Crowdsourcing for large-scale software development . In Crowdsourcing . Springer , 3\u201323. Wei Li, Wei-Tek Tsai, and Wenjun Wu. 2015. Crowdsourcing for large-scale software development. In Crowdsourcing. Springer, 3\u201323."},{"key":"e_1_3_2_1_12_1","volume-title":"Superminds: The surprising power of people and computers thinking together. Little, Brown Spark.","author":"Malone W","year":"2018","unstructured":"Thomas\u00a0 W Malone . 2018 . Superminds: The surprising power of people and computers thinking together. Little, Brown Spark. Thomas\u00a0W Malone. 2018. Superminds: The surprising power of people and computers thinking together. Little, Brown Spark."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.09.015"},{"key":"e_1_3_2_1_14_1","volume-title":"Functionality Testing, Usability Testing, Localization Testing, and Security Testing), Platform","author":"Markets Markets","year":"2024","unstructured":"Markets and Markets . 2019. Crowdsourced Testing Market by Testing Type (Performance Testing , Functionality Testing, Usability Testing, Localization Testing, and Security Testing), Platform , Organization Size, Vertical , and Region - Global Forecast to 2024 . Technical Report. MarketsandMarkets Research Private Ltd . Markets and Markets. 2019. Crowdsourced Testing Market by Testing Type (Performance Testing, Functionality Testing, Usability Testing, Localization Testing, and Security Testing), Platform, Organization Size, Vertical, and Region - Global Forecast to 2024. Technical Report. MarketsandMarkets Research Private Ltd."},{"key":"e_1_3_2_1_15_1","volume-title":"Leveraging the crowd: How 48,000 users helped improve lync performance","author":"Musson Robert","year":"2013","unstructured":"Robert Musson , Jacqueline Richards , Danyel Fisher , Christian Bird , Brian Bussone , and Sandipan Ganguly . 2013. Leveraging the crowd: How 48,000 users helped improve lync performance . IEEE software 30, 4 ( 2013 ), 38\u201345. Robert Musson, Jacqueline Richards, Danyel Fisher, Christian Bird, Brian Bussone, and Sandipan Ganguly. 2013. Leveraging the crowd: How 48,000 users helped improve lync performance. IEEE software 30, 4 (2013), 38\u201345."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.04.027"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJCRC.2013.056925"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-013-2320-2"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2017.28"}],"event":{"name":"ICCSE '21: 5th International Conference on Crowd Science and Engineering","acronym":"ICCSE '21","location":"Jinan China"},"container-title":["5th International Conference on Crowd Science and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503181.3503185","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503181.3503185","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:48Z","timestamp":1750186848000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503181.3503185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,16]]},"references-count":19,"alternative-id":["10.1145\/3503181.3503185","10.1145\/3503181"],"URL":"https:\/\/doi.org\/10.1145\/3503181.3503185","relation":{},"subject":[],"published":{"date-parts":[[2021,10,16]]},"assertion":[{"value":"2022-03-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}