{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T18:25:42Z","timestamp":1779906342405,"version":"3.53.1"},"reference-count":60,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,7,1]],"date-time":"2023-07-01T00:00:00Z","timestamp":1688169600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the coverage of sensor-rich smart devices (smartphones, iPads, etc.), combined with the need to collect large amounts of data, mobile crowd sensing (MCS) has gradually attracted the attention of academics in recent years. MCS is a new and promising model for mass perception and computational data collection. The main function is to recruit a large group of participants with mobile devices to perform sensing tasks in a given area. Task assignment is an important research topic in MCS systems, which aims to efficiently assign sensing tasks to recruited workers. Previous studies have focused on greedy or heuristic approaches, whereas the MCS task allocation problem is usually an NP-hard optimisation problem due to various resource and quality constraints, and traditional greedy or heuristic approaches usually suffer from performance loss to some extent. In addition, the platform-centric task allocation model usually considers the interests of the platform and ignores the feelings of other participants, to the detriment of the platform\u2019s development. Therefore, in this paper, deep reinforcement learning methods are used to find more efficient task assignment solutions, and a weighted approach is adopted to optimise multiple objectives. Specifically, we use a double deep Q network (D3QN) based on the dueling architecture to solve the task allocation problem. Since the maximum travel distance of the workers, the reward value, and the random arrival and time sensitivity of the sensing tasks are considered, this is a dynamic task allocation problem under multiple constraints. For dynamic problems, traditional heuristics (eg, pso, genetics) are often difficult to solve from a modeling and practical perspective. Reinforcement learning can obtain sub-optimal or optimal solutions in a limited time by means of sequential decision-making. Finally, we compare the proposed D3QN-based solution with the standard baseline solution, and experiments show that it outperforms the baseline solution in terms of platform profit, task completion rate, etc., the utility and attractiveness of the platform are enhanced.<\/jats:p>","DOI":"10.3390\/s23136088","type":"journal-article","created":{"date-parts":[[2023,7,3]],"date-time":"2023-07-03T00:53:16Z","timestamp":1688345596000},"page":"6088","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["A Dynamic Task Allocation Framework in Mobile Crowd Sensing with D3QN"],"prefix":"10.3390","volume":"23","author":[{"given":"Yanming","family":"Fu","sequence":"first","affiliation":[{"name":"School of Computer and Electronic Information, Guangxi University, No. 100, University East Road, Nanning 530004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8064-4185","authenticated-orcid":false,"given":"Yuming","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Computer and Electronic Information, Guangxi University, No. 100, University East Road, Nanning 530004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Computer and Electronic Information, Guangxi University, No. 100, University East Road, Nanning 530004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MCOM.2011.6069707","article-title":"Mobile crowdsensing: Current state and future challenges","volume":"49","author":"Ganti","year":"2011","journal-title":"IEEE Commun. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2705","DOI":"10.1109\/TIFS.2019.2903659","article-title":"Trust evaluation mechanism for user recruitment in mobile crowd-sensing in the Internet of Things","volume":"14","author":"Truong","year":"2019","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2818183","article-title":"Mobile crowd sensing and computing: The review of an emerging human-powered sensing paradigm","volume":"48","author":"Guo","year":"2015","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Reddy, S., Shilton, K., Burke, J., Estrin, D., Hansen, M., and Srivastava, M. (2009, January 7\u20138). Using context annotated mobility profiles to recruit data collectors in participatory sensing. Proceedings of the International Symposium on Location-and Context-Awareness, Tokyo, Japan.","DOI":"10.1007\/978-3-642-01721-6_4"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"He, Z., Cao, J., and Liu, X. (May, January 26). High quality participant recruitment in vehicle-based crowdsourcing using predictable mobility. Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM), Hong Kong, China.","DOI":"10.1109\/INFOCOM.2015.7218644"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4231","DOI":"10.1109\/TII.2019.2948068","article-title":"A personalized privacy protection framework for mobile crowdsensing in IIoT","volume":"16","author":"Xiong","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"16795","DOI":"10.1109\/JIOT.2022.3153473","article-title":"Achieving Privacy-Preserving Multi-Task Allocation for Mobile Crowdsensing","volume":"9","author":"Zhang","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1109\/COMST.2014.2387836","article-title":"A survey of incentive mechanisms for participatory sensing","volume":"17","author":"Gao","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1109\/JIOT.2015.2409151","article-title":"A survey of incentive techniques for mobile crowd sensing","volume":"2","author":"Jaimes","year":"2015","journal-title":"IEEE Internet Things J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4618","DOI":"10.1109\/TVT.2014.2317701","article-title":"QoI-aware multitask-oriented dynamic participant selection with budget constraints","volume":"63","author":"Song","year":"2014","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1109\/JIOT.2016.2608141","article-title":"Fine-grained multitask allocation for participatory sensing with a shared budget","volume":"3","author":"Wang","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Coric, V., and Gruteser, M. (2013, January 20\u201323). Crowdsensing maps of on-street parking spaces. Proceedings of the 2013 IEEE International Conference on Distributed Computing in Sensor Systems, Cambridge, MA, USA.","DOI":"10.1109\/DCOSS.2013.15"},{"key":"ref_13","first-page":"4041291","article-title":"A survey of crowd sensing opportunistic signals for indoor localization","volume":"2016","author":"Pei","year":"2016","journal-title":"Mob. Inf. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1002\/wcm.2733","article-title":"Accurate indoor localization based on crowd sensing","volume":"16","author":"Guo","year":"2016","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/TMC.2019.2938509","article-title":"Distributed and energy-efficient mobile crowdsensing with charging stations by deep reinforcement learning","volume":"20","author":"Liu","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Liu, F., and Hsieh, H.P. (2013, January 11\u201314). U-air: When urban air quality inference meets big data. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.","DOI":"10.1145\/2487575.2488188"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1109\/TMC.2014.2385097","article-title":"FlierMeet: A mobile crowdsensing system for cross-space public information reposting, tagging, and sharing","volume":"14","author":"Guo","year":"2014","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/OJCS.2022.3177290","article-title":"A Survey of Sparse Mobile Crowdsensing: Developments and Opportunities","volume":"3","author":"Zhao","year":"2022","journal-title":"IEEE Open J. Comput. Soc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/JPROC.2018.2808759","article-title":"Crowdsensing framework for monitoring bridge vibrations using moving smartphones","volume":"106","author":"Matarazzo","year":"2018","journal-title":"Proc. IEEE"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kim, S., Robson, C., Zimmerman, T., Pierce, J., and Haber, E.M. (2011, January 7\u201312). Creek watch: Pairing usefulness and usability for successful citizen science. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.","DOI":"10.1145\/1978942.1979251"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, P., Zheng, Y., and Li, M. (2012, January 25\u201329). How long to wait? Predicting bus arrival time with mobile phone based participatory sensing. Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, Windermere, UK.","DOI":"10.1145\/2307636.2307671"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Reddy, S., Estrin, D., and Srivastava, M. (2010, January 17\u201320). Recruitment framework for participatory sensing data collections. Proceedings of the International Conference on Pervasive Computing, Helsinki, Finland.","DOI":"10.1007\/978-3-642-12654-3_9"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cheng, P., Lian, X., Chen, Z., Fu, R., Chen, L., Han, J., and Zhao, J. (2014). Reliable diversity-based spatial crowdsourcing by moving workers. arXiv.","DOI":"10.14778\/2794367.2794372"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kazemi, L., and Shahabi, C. (2012, January 6\u20139). Geocrowd: Enabling query answering with spatial crowdsourcing. Proceedings of the 20th International Conference on Advances in Geographic Information Systems, Redondo Beach, CA, USA.","DOI":"10.1145\/2424321.2424346"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1109\/JIOT.2018.2866973","article-title":"Location-dependent task allocation for mobile crowdsensing with clustering effect","volume":"6","author":"Tao","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3291933","article-title":"A survey of spatial crowdsourcing","volume":"44","author":"Gummidi","year":"2019","journal-title":"ACM Trans. Database Syst. (TODS)"},{"key":"ref_27","unstructured":"Reinelt, G. (2003). The Traveling Salesman: Computational Solutions for TSP Applications, Springer."},{"key":"ref_28","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_30","unstructured":"Paulus, R., Xiong, C., and Socher, R. (2017). A deep reinforced model for abstractive summarization. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zheng, G., Zhang, F., Zheng, Z., Xiang, Y., Yuan, N.J., Xie, X., and Li, Z. (2018, January 23\u201327). DRN: A deep reinforcement learning framework for news recommendation. Proceedings of the 2018 World Wide Web Conference, Lyon, France.","DOI":"10.1145\/3178876.3185994"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"11547","DOI":"10.1109\/JIOT.2020.3022611","article-title":"DeepSensing: A novel mobile crowdsensing framework with double deep Q-network and prioritized experience replay","volume":"7","author":"Tao","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3139256","article-title":"Quality of information in mobile crowdsensing: Survey and research challenges","volume":"13","author":"Restuccia","year":"2017","journal-title":"ACM Trans. Sens. Netw. (TOSN)"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7698","DOI":"10.1109\/TVT.2015.2490679","article-title":"Quality-aware sensing coverage in budget-constrained mobile crowdsensing networks","volume":"65","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.1109\/JIOT.2018.2864341","article-title":"Task allocation in mobile crowd sensing: State-of-the-art and future opportunities","volume":"5","author":"Wang","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1109\/JIOT.2018.2815982","article-title":"Task allocation in spatial crowdsourcing: Current state and future directions","volume":"5","author":"Guo","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Roitman, H., Mamou, J., Mehta, S., Satt, A., and Subramaniam, L. (2012, January 2). Harnessing the crowds for smart city sensing. Proceedings of the 1st International Workshop on Multimodal Crowd Sensing, Maui, HI, USA.","DOI":"10.1145\/2390034.2390043"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1109\/COMST.2019.2914030","article-title":"A survey on mobile crowdsensing systems: Challenges, solutions, and opportunities","volume":"21","author":"Capponi","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/MCOM.2013.6525603","article-title":"Fostering participaction in smart cities: A geo-social crowdsensing platform","volume":"51","author":"Cardone","year":"2013","journal-title":"IEEE Commun. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2523068","article-title":"Mining geographic-temporal-semantic patterns in trajectories for location prediction","volume":"5","author":"Ying","year":"2014","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cheng, P., Lian, X., Chen, L., and Shahabi, C. (2017, January 19\u201322). Prediction-based task assignment in spatial crowdsourcing. Proceedings of the 2017 IEEE 33rd International Conference on Data Engineering (ICDE), San Diego, CA, USA.","DOI":"10.1109\/ICDE.2017.146"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2418","DOI":"10.1109\/TNSE.2022.3163925","article-title":"Dynamic Delayed-decision Task Assignment under Spatial-temporal Constrains in Mobile Crowdsensing","volume":"9","author":"Ding","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1109\/THMS.2016.2599489","article-title":"ActiveCrowd: A framework for optimized multitask allocation in mobile crowdsensing systems","volume":"47","author":"Guo","year":"2016","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Liu, Y., Guo, B., Wang, Y., Wu, W., Yu, Z., and Zhang, D. (2016, January 12\u201316). TaskMe: Multi-task allocation in mobile crowd sensing. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.","DOI":"10.1145\/2971648.2971709"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1109\/TSC.2017.2725835","article-title":"A crowd-sensing framework for allocation of time-constrained and location-based tasks","volume":"13","author":"Estrada","year":"2017","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Gong, W., Zhang, B., and Li, C. (2017, January 4\u20138). Location-based online task scheduling in mobile crowdsensing. Proceedings of the GLOBECOM 2017\u20132017 IEEE Global Communications Conference, Singapore.","DOI":"10.1109\/GLOCOM.2017.8254735"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1126\/science.aaa8415","article-title":"Machine learning: Trends, perspectives, and prospects","volume":"349","author":"Jordan","year":"2015","journal-title":"Science"},{"key":"ref_48","unstructured":"Cunningham, P., Cord, M., and Delany, S.J. (2008). Machine Learning Techniques for Multimedia, Springer."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1016\/j.procir.2018.03.212","article-title":"Optimization of global production scheduling with deep reinforcement learning","volume":"72","author":"Waschneck","year":"2018","journal-title":"Procedia Cirp."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_52","unstructured":"Li, Y. (2017). Deep reinforcement learning: An overview. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","article-title":"Deep reinforcement learning: A brief survey","volume":"34","author":"Arulkumaran","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_54","unstructured":"Manchanda, S., Mittal, A., Dhawan, A., Medya, S., Ranu, S., and Singh, A. (2019). Learning heuristics over large graphs via deep reinforcement learning. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MWC.2019.1800411","article-title":"Artificial intelligence empowered edge computing and caching for internet of vehicles","volume":"26","author":"Dai","year":"2019","journal-title":"IEEE Wirel. Commun."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"e5654","DOI":"10.1002\/cpe.5654","article-title":"Task scheduling based on deep reinforcement learning in a cloud manufacturing environment","volume":"32","author":"Dong","year":"2020","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1109\/JSAC.2018.2864373","article-title":"Energy-efficient UAV control for effective and fair communication coverage: A deep reinforcement learning approach","volume":"36","author":"Liu","year":"2018","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AR, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_59","unstructured":"Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., and Freitas, N. (2016, January 20\u201322). Dueling network architectures for deep reinforcement learning. Proceedings of the International Conference on Machine Learning, PMLR, New York, NY, USA."},{"key":"ref_60","unstructured":"Noulas, A., Scellato, S., Mascolo, C., and Pontil, M. (2011, January 17\u201321). An empirical study of geographic user activity patterns in foursquare. Proceedings of the International AAAI Conference on Web and Social Media, Barcelona, Spain."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6088\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:04:43Z","timestamp":1760126683000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6088"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,1]]},"references-count":60,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23136088"],"URL":"https:\/\/doi.org\/10.3390\/s23136088","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,1]]}}}