{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T20:00:24Z","timestamp":1781726424690,"version":"3.54.5"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T00:00:00Z","timestamp":1562198400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T00:00:00Z","timestamp":1562198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61272036"],"award-info":[{"award-number":["61272036"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003995","name":"Natural Science Foundation of Anhui Province","doi-asserted-by":"crossref","award":["KJ2017A414"],"award-info":[{"award-number":["KJ2017A414"]}],"id":[{"id":"10.13039\/501100003995","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003995","name":"Anhui Provincial Natural Science Foundation","doi-asserted-by":"crossref","award":["1908085MF191"],"award-info":[{"award-number":["1908085MF191"]}],"id":[{"id":"10.13039\/501100003995","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum. Cent. Comput. Inf. Sci."],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Mobile crowdsourcing has emerged as a promising collaboration paradigm in which each spatial task requires a set of mobile workers in near vicinity to the target location. Considering the desired privacy of the participating mobile devices, trust is considered to be an important factor to enable effective collaboration in mobile crowdsourcing. The main impediment to the success of mobile crowdsourcing is the allocation of trustworthy mobile workers to nearby spatial tasks for collaboration. This process becomes substantially more challenging for large-scale online spatial task allocations in uncertain mobile crowdsourcing systems. The uncertainty can mislead the task allocation, resulting in performance degradation. Moreover, the large-scale nature of real-world crowdsourcing poses a considerable challenge to spatial task allocation in uncertain environments. To address the aforementioned challenges, first, an optimization problem of mobile crowdsourcing task allocation is formulated to maximize the trustworthiness of workers and minimize movement distance costs. Second, for the uncertain crowdsourcing scenario, a Markov decision process-based mobile crowdsourcing model (MCMDP) is formulated to illustrate the dynamic trust-aware task allocation problem. Third, to solve large-scale MCMDP problems in a stable manner, this study proposes an improved deep Q-learning-based trust-aware task allocation (ImprovedDQL-TTA) algorithm that combines trust-aware task allocation and deep Q-learning as an improvement over the uncertain mobile crowdsourcing systems. Finally, experimental results illustrate that the ImprovedDQL-TTA algorithm can stably converge in a number of training iterations. Compared with the reference algorithm, our proposed algorithm achieves effective solutions on the experimental data sets.<\/jats:p>","DOI":"10.1186\/s13673-019-0187-4","type":"journal-article","created":{"date-parts":[[2019,7,4]],"date-time":"2019-07-04T14:27:20Z","timestamp":1562250440000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A trust-aware task allocation method using deep q-learning for uncertain mobile crowdsourcing"],"prefix":"10.1186","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7619-0363","authenticated-orcid":false,"given":"Yong","family":"Sun","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenan","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,7,4]]},"reference":[{"issue":"3","key":"187_CR1","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/MCOM.2015.7060488","volume":"53","author":"R Ju","year":"2015","unstructured":"Ju R, Zhang Y, Zhang K (2015) Exploiting mobile crowdsourcing for pervasive cloud services: challenges and solutions. IEEE Commun Mag 53(3):98\u2013105","journal-title":"IEEE Commun Mag"},{"issue":"(C)","key":"187_CR2","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.eswa.2016.03.022","volume":"58","author":"UU Hassan","year":"2016","unstructured":"Hassan UU, Curry E (2016) Efficient task assignment for spatial crowdsourcing: a combinatorial fractional optimization approach with semi-bandit learning. Expert Syst Appl 58((C)):36\u201356","journal-title":"Expert Syst Appl"},{"key":"187_CR3","doi-asserted-by":"crossref","unstructured":"To H (2016) Task assignment in spatial crowdsourcing: challenges and approaches. In: Proceedings of the 3rd ACM SIGSPATIAL PhD symposium, San Francisco, CA, USA, 26 June\u20131 July 2016","DOI":"10.1145\/3003819.3003820"},{"issue":"3","key":"187_CR4","doi-asserted-by":"publisher","first-page":"37:1","DOI":"10.1145\/3078853","volume":"9","author":"L Tran","year":"2018","unstructured":"Tran L, To H, Fan L (2018) A real-time framework for task assignment in hyperlocal spatial crowdsourcing. ACM Trans Intell Syst Technol 9(3):37:1\u201337:26","journal-title":"ACM Trans Intell Syst Technol"},{"issue":"12","key":"187_CR5","doi-asserted-by":"publisher","first-page":"311","DOI":"10.3390\/sym9120311","volume":"9","author":"Y Li","year":"2017","unstructured":"Li Y, Shin B (2017) Task-management method using R-tree spatial cloaking for large-scale crowdsourcing. Symmetry 9(12):311","journal-title":"Symmetry"},{"key":"187_CR6","doi-asserted-by":"crossref","unstructured":"Sun Y, Wang J, Tan W. Dynamic worker-and-task assignment on uncertain spatial crowdsourcing. In: IEEE CSCWD 20th international conference on computer supported cooperative work in design, 2018. pp 755\u2013760","DOI":"10.1109\/CSCWD.2018.8465361"},{"issue":"3","key":"187_CR7","doi-asserted-by":"publisher","first-page":"1749","DOI":"10.1109\/JIOT.2018.2815982","volume":"5","author":"B Guo","year":"2018","unstructured":"Guo B, Liu Y, Wang L (2018) Task allocation in spatial crowdsourcing: current state and future directions. IEEE Intern Things J 5(3):1749\u20131764","journal-title":"IEEE Intern Things J"},{"key":"187_CR8","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.comnet.2018.02.008","volume":"135","author":"Y Wang","year":"2018","unstructured":"Wang Y, Cai Z, Tong X (2018) Truthful incentive mechanism with location privacy-preserving for mobile crowdsourcing systems. Comput Netw 135:32\u201343","journal-title":"Comput Netw"},{"issue":"7","key":"187_CR9","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1109\/MCOM.2016.7509386","volume":"54","author":"Y Zhao","year":"2016","unstructured":"Zhao Y, Han Q (2016) Spatial crowdsourcing: current state and future directions. IEEE Commun Mag 54(7):102\u2013107","journal-title":"IEEE Commun Mag"},{"issue":"2","key":"187_CR10","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s10707-017-0305-2","volume":"22","author":"A Liu","year":"2018","unstructured":"Liu A, Wang W, Shang S (2018) Efficient task assignment in spatial crowdsourcing with worker and task privacy protection. GeoInformatica 22(2):335\u2013362","journal-title":"GeoInformatica"},{"key":"187_CR11","doi-asserted-by":"publisher","first-page":"5678","DOI":"10.1109\/ACCESS.2017.2783322","volume":"6","author":"Z Chi","year":"2018","unstructured":"Chi Z, Wang Y, Huang Y (2018) The novel location privacy-preserving CKD for mobile crowdsourcing systems. IEEE Access 6:5678\u20135687","journal-title":"IEEE Access"},{"key":"187_CR12","doi-asserted-by":"crossref","unstructured":"Kazemi L, Shahabi C, Chen L, et al. GeoTruCrowd:trustworthy query answering with spatial crowdsourcing. In: ACM Sigspatial international conference on advances in geographic information systems. ACM, 2013. pp 314\u2013323","DOI":"10.1145\/2525314.2525346"},{"key":"187_CR13","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.comnet.2015.07.011","volume":"90","author":"M Hayam","year":"2015","unstructured":"Hayam M, Sonia BM, Omar H (2015) Trust management and reputation systems in mobile participatory sensing applications: a survey. Comput Netw 90:49\u201373","journal-title":"Comput Netw"},{"key":"187_CR14","volume-title":"Learning from delayed rewards. Ph.D. thesis","author":"CJ Watkins","year":"1989","unstructured":"Watkins CJ (1989) Learning from delayed rewards. Ph.D. thesis. Cambridge University, Cambridge"},{"key":"187_CR15","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"1988","unstructured":"Sutton RS, Barto AG (1988) Reinforcement learning: an introduction, vol 1. MIT Press, Cambridge"},{"issue":"3","key":"187_CR16","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1109\/TCYB.2015.2415732","volume":"46","author":"CR Azevedo","year":"2015","unstructured":"Azevedo CR, Von Zuben FJ (2015) Learning to anticipate flexible choices in multiple criteria decision-making under uncertainty. IEEE Trans Cybern 46(3):778\u2013791","journal-title":"IEEE Trans Cybern"},{"key":"187_CR17","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V et al (2015) Human-level control through deep reinforcement learning. Nature 518:529\u2013533","journal-title":"Nature"},{"issue":"7676","key":"187_CR18","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D Silver","year":"2017","unstructured":"Silver D et al (2017) Mastering the game of go without human knowledge. Nature 550(7676):354\u2013359","journal-title":"Nature"},{"key":"187_CR19","doi-asserted-by":"crossref","unstructured":"Liu N, et al (2017) A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning. In: Proc. IEEE 37th Int. Conf. Distrib. Comput. Syst. (ICDCS), Atlanta, GA, USA, pp 372\u2013382","DOI":"10.1109\/ICDCS.2017.123"},{"key":"187_CR20","first-page":"1","volume":"99","author":"Y Sun","year":"2018","unstructured":"Sun Y, Peng M, Mao S (2018) Deep reinforcement learning based mode selection and resource management for green fog radio access networks. IEEE Intern Things J 99:1","journal-title":"IEEE Intern Things J"},{"issue":"9","key":"187_CR21","doi-asserted-by":"publisher","first-page":"2246","DOI":"10.1109\/TKDE.2016.2555805","volume":"28","author":"AI Chittilappilly","year":"2016","unstructured":"Chittilappilly AI, Chen L, Ameryahia S (2016) A survey of general-purpose crowdsourcing techniques. IEEE Trans Knowl Data Eng 28(9):2246\u20132266","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"187_CR22","doi-asserted-by":"publisher","DOI":"10.1145\/1924421.1924442","volume-title":"Crowdsourcing systems on the World-Wide Web","author":"A Doan","year":"2011","unstructured":"Doan A, Ramakrishnan R, Halevy AY (2011) Crowdsourcing systems on the World-Wide Web. ACM, New York"},{"key":"187_CR23","unstructured":"Whitehill J, Wu TF, Bergsma J, Movellan JR, Ruvolo PL (2009) Whose vote should count more: optimal integration of labels from labelers of unknown expertise. In: Advances in neural information processing systems. pp 2035\u20132043"},{"issue":"5","key":"187_CR24","doi-asserted-by":"publisher","first-page":"267","DOI":"10.14778\/1952376.1952377","volume":"4","author":"A Parameswaran","year":"2011","unstructured":"Parameswaran A, Sarma AD, Garcia-Molina H (2011) Human-assisted graph search: it\u2019s okay to ask questions. Proc Vldb Endow 4(5):267\u2013278","journal-title":"Proc Vldb Endow"},{"issue":"10","key":"187_CR25","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.14778\/2336664.2336676","volume":"5","author":"Xuan Liu","year":"2012","unstructured":"Liu Xuan, Meiyu Lu, Ooi Beng Chin, Shen Yanyan, Sai Wu, Zhang Meihui (2012) CDAS: a crowdsourcing data analytics system. Proc VLDB Endow 5(10):1040\u20131051","journal-title":"Proc VLDB Endow"},{"key":"187_CR26","doi-asserted-by":"crossref","unstructured":"Bulut MF, Yilmaz YS, Demirbas M. Crowdsourcing location-based queries. In: 2011 IEEE international conference on pervasive computing and communications workshops (PERCOM Workshops). IEEE, New York, pp 513\u2013518","DOI":"10.1109\/PERCOMW.2011.5766944"},{"issue":"3","key":"187_CR27","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1007\/s10796-015-9547-4","volume":"18","author":"Y Sun","year":"2016","unstructured":"Sun Y, Tan W, Li LX (2016) A new method to identify collaborative partners in social service provider networks. Inform Syst Front 18(3):565\u2013578","journal-title":"Inform Syst Front"},{"issue":"2","key":"187_CR28","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1007\/s10489-014-0528-y","volume":"41","author":"GK Awal","year":"2014","unstructured":"Awal GK, Bharadwaj KK (2014) Team formation in social networks based on collective intelligence-an evolutionary approach. Appl Intell 41(2):627\u2013648","journal-title":"Appl Intell"},{"key":"187_CR29","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.dss.2016.06.019","volume":"90","author":"C Miao","year":"2016","unstructured":"Miao C, Yu H, Shen Z (2016) Balancing quality and budget considerations in mobile crowdsourcing. Decis Support Syst 90:56\u201364","journal-title":"Decis Support Syst"},{"key":"187_CR30","doi-asserted-by":"crossref","unstructured":"Feng Z, Zhu Y, Zhang Q et al (2014) Trac: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing. In: Proceedings of the IEEE INFOCOM conference, pp 1231\u20131239","DOI":"10.1109\/INFOCOM.2014.6848055"},{"key":"187_CR31","doi-asserted-by":"crossref","unstructured":"Kazemi L, Shahabi C (2012) GeoCrowd: enabling query answering with spatial crowdsourcing. In: Advances in geographic information systems. pp 189\u2013198","DOI":"10.1145\/2424321.2424346"},{"key":"187_CR32","doi-asserted-by":"crossref","unstructured":"Cheng P, Lian X, Chen L et al (2017) Prediction-based task assignment in spatial crowdsourcing. In: International conference on data engineering, pp 997\u20131008","DOI":"10.1109\/ICDE.2017.146"},{"key":"187_CR33","unstructured":"Schaul T, Quan J, Antonoglou I, et al (2016) Prioritized experience replay. In: International conference on learning representations, ICLR"},{"key":"187_CR34","unstructured":"Wang Z, Schaul T, Hessel M, et al (2016) Dueling network architectures for deep reinforcement learning. In: International conference on machine learning, pp. 1995\u20132003"},{"key":"187_CR35","unstructured":"Li Y (2017) Deep reinforcement learning: an overview"},{"issue":"3","key":"187_CR36","doi-asserted-by":"publisher","first-page":"868","DOI":"10.1109\/JSYST.2013.2260072","volume":"8","author":"W Tan","year":"2014","unstructured":"Tan W, Sun Y, Li L (2014) A trust service-oriented scheduling model for workflow applications in cloud computing. IEEE Syst J 8(3):868\u2013878","journal-title":"IEEE Syst J"}],"container-title":["Human-centric Computing and Information Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-019-0187-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13673-019-0187-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-019-0187-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T11:43:43Z","timestamp":1627645423000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13673-019-0187-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,4]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["187"],"URL":"https:\/\/doi.org\/10.1186\/s13673-019-0187-4","relation":{},"ISSN":["2192-1962"],"issn-type":[{"value":"2192-1962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,4]]},"assertion":[{"value":"23 January 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 June 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"25"}}