{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T19:46:55Z","timestamp":1773517615534,"version":"3.50.1"},"reference-count":29,"publisher":"Tsinghua University Press","issue":"2","license":[{"start":{"date-parts":[[2020,4,16]],"date-time":"2020-04-16T00:00:00Z","timestamp":1586995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJCS"],"published-print":{"date-parts":[[2020,4,16]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>This paper aims to gauge developers\u2019 perspectives regarding the participation of the public and anonymous crowd testers worldwide, with a range of varied experiences. It also aims to gather their needs that could reduce their concerns of dealing with the public crowd testers and increase the opportunity of using the crowdtesting platforms.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>An online exploratory survey was conducted to gather information from the participants, which included 50 mobile application developers from various countries with diverse experiences across Android and iOS mobile platforms.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The findings revealed that a significant proportion (90%) of developers is potentially willing to perform testing via the public crowd testers worldwide. This on condition that several fundamental features were available, which enable them to achieve more realistic tests without artificial environments on large numbers of devices. The results also demonstrated that a group of developers does not consider testing as a serious job that they have to pay for, which can affect the gig-economy and global market.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>This paper provides new insights for future research in the study of how acceptable it is to work with public and anonymous crowd workers, with varying levels of experience, to perform tasks in different domains and not only in software testing. In addition, it will assist individual or small development teams who have limited resources or who do not have thousands of testers in their private testing community, to perform large-scale testing of their products.<\/jats:p><\/jats:sec>","DOI":"10.1108\/ijcs-01-2020-0002","type":"journal-article","created":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T13:28:09Z","timestamp":1588080489000},"page":"209-228","source":"Crossref","is-referenced-by-count":8,"title":["Definitive guidelines toward effective mobile devices crowdtesting methodology"],"prefix":"10.26599","volume":"4","author":[{"given":"Qamar","family":"Naith","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Ciravegna","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"11138","reference":[{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2010.05.006"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1109\/MobileCloud.2014.13"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1109\/CloudCom.2012.6512429"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1145\/2406367.2406402"},{"key":"ref14","first-page":"1","article-title":"More than fun and money. Worker motivation in crowdsourcing &#x2013; a study on mechanical Turk","volume":"11","author":"kaufmann","year":"2011","journal-title":"AMCIS"},{"key":"ref15","author":"knott","year":"2015","journal-title":"Hands-on mobile app testing"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1086\/229028"},{"key":"ref17","author":"mathers","year":"1998","journal-title":"Survey Questionnaire"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.3390\/rs9010087"},{"key":"ref19","first-page":"6","article-title":"Crowdsourcing for industrial problems","author":"munt\u00e9s-mulero","year":"2012","journal-title":"International Workshop on Citizen in Sensor Networks"},{"key":"ref28","author":"starov","year":"2013","journal-title":"Cloud platform for research crowdsourcing in mobile testing"},{"key":"ref4","author":"bayley","year":"2012","journal-title":"Mobitest a cross-platform tool for testing mobile applications"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1109\/FUZZ-IEEE.2014.6891807"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.08.282"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v13i6.2159"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom.2013.35"},{"key":"ref5","author":"bell","year":"2018","journal-title":"Business Research Methods"},{"key":"ref8","author":"denscombe","year":"2014","journal-title":"The Good Research Guide for Small-scale Social Research Projects"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.4324\/9780203413081"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186035"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1109\/CSI-SE.2015.14"},{"key":"ref1","author":"afzal","year":"2007","journal-title":"Metrics in software test planning and test design processes"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1108\/IJCS-09-2018-0024"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1145\/3371238.3371247"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1145\/3265689.3265690"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCCT.2014.7019292"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1145\/2766498.2766522"},{"key":"ref26","author":"rosson","year":"2002","journal-title":"Usability Engineering Scenario Based Development of Human-Computer Interaction"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702469"}],"container-title":["International Journal of Crowd Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJCS-01-2020-0002\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJCS-01-2020-0002\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T14:25:09Z","timestamp":1660832709000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJCS-01-2020-0002\/full\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,16]]},"references-count":29,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,16]]}},"alternative-id":["10.1108\/IJCS-01-2020-0002"],"URL":"https:\/\/doi.org\/10.1108\/ijcs-01-2020-0002","relation":{},"ISSN":["2398-7294","2398-7294"],"issn-type":[{"value":"2398-7294","type":"print"},{"value":"2398-7294","type":"print"}],"subject":[],"published":{"date-parts":[[2020,4,16]]}}}