{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T18:19:25Z","timestamp":1779905965938,"version":"3.53.1"},"reference-count":38,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62002092"],"award-info":[{"award-number":["62002092"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61872120"],"award-info":[{"award-number":["61872120"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Zhejiang Provincial Natural Science Foundation of China","award":["LQY19G030001"],"award-info":[{"award-number":["LQY19G030001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>On a crowdsourcing platform, in order to cheat for rewards or sabotage the crowdsourcing processes, spam workers may submit numerous erroneous answers to the tasks published by requesters. This type of behavior extremely reduces the completion rate of tasks and the enthusiasm of honest users, which may lead a crowdsourcing platform to a failure. Defending against malicious attacks is an important issue in crowdsourcing, which has been extensively addressed by existing methods, e.g., verification-based defense mechanisms, data analysis solutions, trust-based defense models, and workers\u2019 properties matching mechanisms. However, verification-based defense mechanisms will consume a lot of resources, and data analysis solutions cannot motivate workers to provide high-quality services. Trust-based defense models and workers\u2019 properties matching mechanisms cannot guarantee the authenticity of information when collusion requesters publish shadow tasks to help malicious workers get more participation opportunities. To defend such collusion attacks in crowdsourcing platforms, we propose a new defense model named TruthTrust. Firstly, we define a complete life cycle system that from users\u2019 interaction to workers\u2019 recommendation, and separately define the trust value of each worker and the credence of each requester. Secondly, in order to ensure the authenticity of the information, we establish a trust model based on the CRH framework. The calculated truth value and weight are used to define the global properties of workers and requesters. Moreover, we propose a reverse mechanism to improve the resistance under attacks. Finally, extensive experiments demonstrate that TruthTrust significantly outperforms the state-of-the-art approaches in terms of effective task completion rate.<\/jats:p>","DOI":"10.3390\/s21082578","type":"journal-article","created":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T11:31:59Z","timestamp":1617795119000},"page":"2578","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["TruthTrust: Truth Inference-Based Trust Management Mechanism on a Crowdsourcing Platform"],"prefix":"10.3390","volume":"21","author":[{"given":"Jiyuan","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xing","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lanping","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Limin","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yizhi","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Cyberspace, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, Q., Gao, J., Lin, W., and Li, X. (2020). NWPU-crowd: A large-scale benchmark for crowd counting and localization. arXiv.","DOI":"10.1109\/TPAMI.2020.3013269"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Duan, Y., Fu, G., Zhou, N., Sun, X., Narendra, N.C., and Hu, B. (July, January 27). Everything as a service (XaaS) on the cloud: Origins, current and future trends. Proceedings of the 2015 IEEE 8th International Conference on Cloud Computing, New York, NY, USA.","DOI":"10.1109\/CLOUD.2015.88"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, Q., Gao, J., Lin, W., and Yuan, Y. (2019, January 15\u201320). Learning from synthetic data for crowd counting in the wild. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00839"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ye, B., and Wang, Y. (July, January 27). Crowdrec: Trust-aware worker recommendation in crowdsourcing environments. Proceedings of the 2016 IEEE International Conference on Web Services (ICWS), San Francisco, CA, USA.","DOI":"10.1109\/ICWS.2016.10"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jss.2016.09.015","article-title":"A survey of the use of crowdsourcing in software engineering","volume":"126","author":"Mao","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yuen, M.C., King, I., and Leung, K.S. (2011, January 9\u201311). A survey of crowdsourcing systems. Proceedings of the 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing, Boston, MA, USA.","DOI":"10.1109\/PASSAT\/SocialCom.2011.203"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xu, J., and Li, H. (2007, January 23\u201327). Adarank: A boosting algorithm for information retrieval. Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands.","DOI":"10.1145\/1277741.1277809"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Miao, C., Li, Q., Xiao, H., Jiang, W., Huai, M., and Su, L. (2018, January 25\u201328). Towards data poisoning attacks in crowd sensing systems. Proceedings of the Eighteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, Los Angeles, CA, USA.","DOI":"10.1145\/3209582.3209594"},{"key":"ref_9","unstructured":"Hirth, M., Ho\u00dffeld, T., and Tran-Gia, P. (2010). Cheat-Detection Mechanisms for Crowdsourcing, University of W\u00fcrzburg. Tech. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, G., Wang, B., Wang, T., Nika, A., Zheng, H., and Zhao, B.Y. (2016, January 25\u201330). Defending against sybil devices in crowdsourced mapping services. Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, Singapore.","DOI":"10.1145\/2906388.2906420"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sanchez, L., Rosas, E., and Hidalgo, N. (2018, January 9\u201313). Crowdsourcing under attack: Detecting malicious behaviors in Waze. Proceedings of the IFIP International Conference on Trust Management, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-95276-5_7"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1109\/TNET.2018.2818073","article-title":"Ghost riders: Sybil attacks on crowdsourced mobile mapping services","volume":"26","author":"Wang","year":"2018","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_13","first-page":"491","article-title":"Eliminating spammers and ranking annotators for crowdsourced labeling tasks","volume":"13","author":"Raykar","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physa.2019.01.120","article-title":"Empirical study of crowd dynamic in public gathering places during a terrorist attack event","volume":"523","author":"Wang","year":"2019","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kittur, A., Chi, E.H., and Suh, B. (2008, January 5\u201310). Crowdsourcing user studies with Mechanical Turk. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy.","DOI":"10.1145\/1357054.1357127"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MNET.2010.5430141","article-title":"Quadrant of euphoria: A crowdsourcing platform for QoE assessment","volume":"24","author":"Chen","year":"2010","journal-title":"IEEE Netw."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hirth, M., Ho\u00dffeld, T., and Tran-Gia, P. (July, January 30). Cost-optimal validation mechanisms and cheat-detection for crowdsourcing platforms. Proceedings of the 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, Seoul, Korea.","DOI":"10.1109\/IMIS.2011.91"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1109\/TII.2019.2896287","article-title":"Bayesian co-clustering truth discovery for mobile crowd sensing systems","volume":"16","author":"Du","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, X., and Baras, J.S. (2017, January 12\u201315). Crowdsourcing with multi-dimensional trust and active learning. Proceedings of the 2017 IEEE 56th Annual Conference on Decision and Control (CDC), Melbourne, Australia.","DOI":"10.1109\/CDC.2017.8264132"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lin, J., Yang, D., Wu, K., Tang, J., and Xue, G. (2019, January 7\u20139). A sybil-resistant truth discovery framework for mobile crowdsensing. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Richardson, TX, USA.","DOI":"10.1109\/ICDCS.2019.00091"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huang, Z., Pan, M., and Gong, Y. (2019, January 9\u201313). Robust truth discovery against data poisoning in mobile crowdsensing. Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA.","DOI":"10.1109\/GLOBECOM38437.2019.9013890"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ye, B., Wang, Y., and Liu, L. (July, January 27). Crowd trust: A context-aware trust model for worker selection in crowdsourcing environments. Proceedings of the 2015 IEEE International Conference on Web Services, New York, NY, USA.","DOI":"10.1109\/ICWS.2015.26"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yuen, M.C., King, I., and Leung, K.S. (2011, January 19\u201322). Task matching in crowdsourcing. Proceedings of the 2011 International Conference on Internet of Things and 4th International Conference on Cyber, Physical and Social Computing, Dalian, China.","DOI":"10.1109\/iThings\/CPSCom.2011.128"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1109\/TSMC.2017.2777447","article-title":"Context-aware reliable crowdsourcing in social networks","volume":"50","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_25","first-page":"1953","article-title":"Iterative learning for reliable crowdsourcing systems","volume":"24","author":"Karger","year":"2011","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"486","DOI":"10.1109\/WI-IAT.2012.104","article-title":"Challenges and opportunities for trust management in crowdsourcing","volume":"Volume 2","author":"Yu","year":"2012","journal-title":"Proceedings of the 2012 IEEE\/WIC\/ACM International Conferences on Web Intelligence and Intelligent Agent Technology"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kantarci, B., Glasser, P.M., and Foschini, L. (2015, January 6\u201310). Crowdsensing with social network-aided collaborative trust scores. Proceedings of the 2015 IEEE Global Communications Conference (GLOBECOM), San Diego, CA, USA.","DOI":"10.1109\/GLOCOM.2015.7417008"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ye, B., Wang, Y., and Liu, L. (2017, January 25\u201330). CrowdDefense: A trust vector-based threat defense model in crowdsourcing environments. Proceedings of the 2017 IEEE International Conference on Web Services (ICWS), Honolulu, HI, USA.","DOI":"10.1109\/ICWS.2017.39"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"541","DOI":"10.14778\/3055540.3055547","article-title":"Truth inference in crowdsourcing: Is the problem solved?","volume":"10","author":"Zheng","year":"2017","journal-title":"Proc. VLDB Endow."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2897350.2897352","article-title":"A survey on truth discovery","volume":"17","author":"Li","year":"2016","journal-title":"ACM Sigkdd Explor. Newsl."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, Y., Li, Q., Gao, J., Su, L., Zhao, B., Fan, W., and Han, J. (2015, January 10\u201313). On the discovery of evolving truth. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, NSW, Australia.","DOI":"10.1145\/2783258.2783277"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MIC.2015.96","article-title":"Crowdsourcing processes: A survey of approaches and opportunities","volume":"20","author":"Kucherbaev","year":"2015","journal-title":"IEEE Internet Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1111\/ijmr.12135","article-title":"Crowdsourcing: A review and suggestions for future research","volume":"20","author":"Ghezzi","year":"2018","journal-title":"Int. J. Manag. Rev."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2090","DOI":"10.1109\/TIFS.2017.2697401","article-title":"Stochastic collision attack","volume":"12","author":"Bruneau","year":"2017","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s11390-014-1412-2","article-title":"Trust-based personalized service recommendation: A network perspective","volume":"29","author":"Deng","year":"2014","journal-title":"J. Comput. Sci. Technol."},{"key":"ref_36","unstructured":"Vakharia, D., and Lease, M. (2013). Beyond AMT: An analysis of crowd work platforms. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TETC.2014.2330519","article-title":"A survey of clustering algorithms for big data: Taxonomy and empirical analysis","volume":"2","author":"Fahad","year":"2014","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_38","unstructured":"Aljalbout, E., Golkov, V., Siddiqui, Y., Strobel, M., and Cremers, D. (2018). Clustering with deep learning: Taxonomy and new methods. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2578\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:58:46Z","timestamp":1760363926000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,7]]},"references-count":38,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21082578"],"URL":"https:\/\/doi.org\/10.3390\/s21082578","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,7]]}}}