{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T19:11:16Z","timestamp":1770491476715,"version":"3.49.0"},"reference-count":84,"publisher":"Wiley","license":[{"start":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T00:00:00Z","timestamp":1625702400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"University Patent Development Project of Heilongjiang Intellectual Property Office"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientific Programming"],"published-print":{"date-parts":[[2021,7,8]]},"abstract":"<jats:p>Crowdsourcing is a task-solving model in which human crowd is hired to solve a particular task. During the crowdsourcing process, the crowd selection is performed in order to select appropriate crowd workers for a specific task; without appropriate selection of crowd workers, the process of crowdsourcing is aimless. The main goal of this paper was to identify the features of crowd in crowdsourcing activity, reasons behind crowd participation in the activity of crowdsourcing, and the existing techniques that were utilized for crowd selection in crowdsourcing. Search strings with corresponding keywords were used to capture relevant studies related to crowdsourcing, and crowd selection was classified under conference papers, journal articles, proceedings, and book chapters. 81 relevant studies are selected from 7 digital data repositories using a search strategy. In crowdsourcing practices, crowd selection was considerably addressed. Nonetheless, it has been noticed that the selection is based only on a single crowd worker attribute such as confidence, past success, efficiency, and experience. For the efficiency and effectiveness of the crowdsourcing operation, crowd selection on multicriteria features is essential.<\/jats:p>","DOI":"10.1155\/2021\/9368128","type":"journal-article","created":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T17:05:23Z","timestamp":1625763923000},"page":"1-23","source":"Crossref","is-referenced-by-count":2,"title":["Selection of Crowd in Crowdsourcing for Smart Intelligent Applications: A Systematic Mapping Study"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7119-0361","authenticated-orcid":true,"given":"Rui","family":"Shang","sequence":"first","affiliation":[{"name":"Office of Science and Technology Administration, Heilongjiang Bayi Agricultural University, DaQing 163000, China"}]},{"given":"YongMei","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, Chaohu University, HeFei 238000, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8164-9511","authenticated-orcid":true,"given":"Farhad","family":"Ali","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Swabi, Swabi, Pakistan"}]},{"given":"ChuanShuang","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Public Affairs, University of Science and Technology of China, HeFei 230026, China"},{"name":"Academic Affairs Office, Chaohu University, HeFei 238000, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0126-9944","authenticated-orcid":true,"given":"Shah","family":"Nazir","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Swabi, Swabi, Pakistan"}]},{"given":"Huafei","family":"Wei","sequence":"additional","affiliation":[{"name":"Business School, Anhui University, HeFei 230601, China"}]},{"given":"Abdullah","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Swabi, Swabi, Pakistan"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/5216495"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1016\/s2212-5671(15)01359-3"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.04.027"},{"key":"4","first-page":"41","article-title":"Toward microtask crowdsourcing software design work","author":"E. R. Q. Weidema"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1080\/10580530.2020.1696586"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2018.03.006"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1111\/ntwe.12104"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2018.01.008"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1016\/j.jisa.2014.10.003"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-017-0490-8"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2015.05.001"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.10.001"},{"key":"13","first-page":"36","article-title":"Task allocation for crowdsourcing using AI planning","author":"L. Machado"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1016\/j.technovation.2014.01.011"},{"key":"15","first-page":"85","article-title":"Crowd development","author":"T. D. LaToza"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1109\/mic.2012.66"},{"key":"17","first-page":"4894","article-title":"Virtual team performance in crowdsourcing contest: a social network perspective","author":"I. Dissanayake"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2018.10.030"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2017.2774297"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1111\/ijmr.12135"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1016\/j.technovation.2016.05.002"},{"key":"22","first-page":"69","article-title":"Supporting coordination in crowdsourced software testing services","author":"M. Alsayyari"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2015.12.022"},{"key":"24","first-page":"281","article-title":"Estimating software task effort in crowds","author":"M. Alhamed"},{"key":"25","article-title":"CrowdBuild: a methodology for enterprise software development using crowdsourcing","author":"A. Dwarakanath"},{"key":"26","article-title":"CrowdSelect: increasing accuracy of crowdsourcing tasks through behavior prediction and user selection","author":"C. Qiu"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1007\/s11066-018-9128-z"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/icgse.2016.16"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-016-0429-6"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1016\/b978-0-12-410464-8.00008-8"},{"issue":"1","key":"31","article-title":"Catering to the crowd: an HRM perspective on crowd worker engagement","volume":"31","author":"J. T. Bush","year":"2018","journal-title":"Human Resource Management Review"},{"key":"32","volume-title":"Procedures for Performing Systematic Reviews","author":"B. Kitchenham","year":"2004"},{"key":"33","unstructured":"KitchenhamB.ChartersS.Guidelines for Performing Systematic Literature Reviews in Software Engineering2007Keele, UKSchool of Computer Science and Mathematics, Keele UniversityTechnical Report EBSE-2007-01"},{"key":"34","first-page":"28","article-title":"A hybrid simulation model for crowdsourced software development","author":"R. Saremi"},{"key":"35","first-page":"563","article-title":"A vision of crowd development","author":"T. D. LaToza"},{"key":"36","first-page":"1","article-title":"Affinity-Aware online selection mechanisms in mobile crowdsourcing sensing","author":"M. Li"},{"key":"37","first-page":"901","article-title":"An exploratory study on perception of Indian crowd towards crowdsourcing software development","author":"S. Sharma"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1109\/ms.2017.32"},{"key":"39","first-page":"9","article-title":"Competence, collaboration, and time management: barriers and recommendations for crowdworkers","author":"A. L. Zanatta"},{"key":"40","first-page":"214","article-title":"CrowdService: serving the individuals through mobile crowdsourcing and service composition","author":"X. Peng"},{"key":"41","first-page":"656","article-title":"Crowdsourced software development: exploring the motivational and inhibiting factors of the South African crowd","author":"F. Moodley"},{"key":"42","first-page":"923","article-title":"Efficient worker selection through history-based learning in crowdsourcing","author":"T. Awwad"},{"key":"43","first-page":"752","article-title":"Guiding the crowds for android testing","author":"X. Zhang"},{"key":"44","first-page":"103","article-title":"Leveraging crowdsourcing for team elasticity: an empirical evaluation at TopCoder","author":"R. L. Saremi"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1109\/ms.2017.37"},{"key":"46","first-page":"75","article-title":"Who should Be selected to perform a task in crowdsourced testing?","author":"Q. Cui"},{"key":"47","first-page":"1801","article-title":"Worker ranking determination in crowdsourcing platforms using aggregation functions","author":"D. S\u00e1nchez-Charles"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1016\/s2210-8327(15)00019-8"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.09.015"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2016.03.016"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2015.05.020"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2012.09.003"},{"key":"53","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.09.234"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2019.04.001"},{"key":"55","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2019.02.057"},{"key":"56","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2014.04.005"},{"key":"57","doi-asserted-by":"publisher","DOI":"10.1016\/j.protcy.2014.10.103"},{"key":"58","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2019.05.005"},{"key":"59","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2016.09.007"},{"key":"60","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102135"},{"key":"61","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2016.11.015"},{"key":"62","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.10.028"},{"key":"63","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2019.04.004"},{"key":"64","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2017.11.021"},{"key":"65","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.12.007"},{"key":"66","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.07.181"},{"key":"67","doi-asserted-by":"publisher","DOI":"10.1016\/j.jengtecman.2015.08.003"},{"key":"68","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-014-9423-5"},{"key":"69","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-60131-1_11"},{"key":"70","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-018-0558-9"},{"key":"71","doi-asserted-by":"publisher","DOI":"10.1080\/10429247.2018.1548231"},{"key":"72","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2017.1344126"},{"key":"73","doi-asserted-by":"publisher","DOI":"10.1080\/08874417.2017.1394171"},{"key":"74","doi-asserted-by":"publisher","DOI":"10.1080\/17517575.2018.1493539"},{"key":"75","doi-asserted-by":"publisher","DOI":"10.1080\/10580530.2013.739883"},{"key":"76","doi-asserted-by":"publisher","DOI":"10.1080\/09537325.2014.923095"},{"key":"77","doi-asserted-by":"publisher","DOI":"10.2753\/jec1086-4415150402"},{"key":"78","doi-asserted-by":"publisher","DOI":"10.1111\/beer.12173"},{"key":"79","doi-asserted-by":"crossref","article-title":"A transfer learning based framework of crowd-selection on twitter","author":"Z. Zhao","DOI":"10.1145\/2487575.2487708"},{"key":"80","article-title":"CrowdEval: a cost-efficient strategy to evaluate crowdsourced worker\u2019s reliability","author":"C. Qiu"},{"key":"81","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007290"},{"key":"82","doi-asserted-by":"crossref","article-title":"Declarative user selection with soft constraints","author":"Y. Amsterdamer","DOI":"10.1145\/3357384.3358025"},{"key":"83","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/7413460"},{"key":"84","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"}],"container-title":["Scientific Programming"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2021\/9368128.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2021\/9368128.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2021\/9368128.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T17:05:31Z","timestamp":1625763931000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/sp\/2021\/9368128\/"}},"subtitle":[],"editor":[{"given":"Mian Ahmad","family":"Jan","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,7,8]]},"references-count":84,"alternative-id":["9368128","9368128"],"URL":"https:\/\/doi.org\/10.1155\/2021\/9368128","relation":{},"ISSN":["1875-919X","1058-9244"],"issn-type":[{"value":"1875-919X","type":"electronic"},{"value":"1058-9244","type":"print"}],"subject":[],"published":{"date-parts":[[2021,7,8]]}}}