{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T08:56:19Z","timestamp":1770281779081,"version":"3.49.0"},"reference-count":40,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:p> Freelancing systems such as Freelancer and Upwork have recently been increasing in popularity due to their ability to provide efficient solutions. Nevertheless, the success of freelancing depends on the delivery of high-quality freelanced output. Indeed, quality control is a major concern and is affected by the uncertainty stemming from human factors relating to the diversity of workers\u2019 skills and the workers\u2019 changing behaviour over time. This article proposes a quality-aware freelancing data model (QADM) that takes into account both the diversity of worker skills and workers\u2019 changing behaviour. The QADM is comprised of three submodels: skill, task and worker. The main goal is to model worker quality appropriately, and it does so by effectively modelling (1) worker suitability for new tasks, (2) worker reputation, (3) worker accuracy in completed tasks and (4) worker expected accuracy in new tasks. To improve the worker accuracy estimation, a task-to-task similarity algorithm is developed that achieves higher accuracy than Cos(topic), Cos(tf-idf) and Jaccard similarity methods. The quality-aware task assignment decision problem is solved as a top-k task recommendation problem. The results achieved in this article show that the QADM accomplishes a high recommender system mean average precision for the assignment decisions. <\/jats:p>","DOI":"10.1177\/01655515221136232","type":"journal-article","created":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T14:32:08Z","timestamp":1669300328000},"page":"242-264","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["QADM: A quality-aware data model for freelancing applications based on recommendation systems"],"prefix":"10.1177","volume":"51","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2987-4601","authenticated-orcid":false,"given":"Arwa","family":"Bokhari","sequence":"first","affiliation":[{"name":"College of Computers and Information Technology, Information Technology Department, Taif University, Saudi Arabia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3875-074X","authenticated-orcid":false,"given":"Asma","family":"Cherif","sequence":"additional","affiliation":[{"name":"Information Technology Department, Faculty of Computing and Information Technology and Center of Excellence in Smart Environment Research, King Abdulaziz University, Saudi Arabia"}]}],"member":"179","published-online":{"date-parts":[[2022,11,23]]},"reference":[{"key":"bibr1-01655515221136232","unstructured":"Amazon Mechanical Turk (AMT), 2019, https:\/\/www.mturk.com\/ (accessed 21 June 2019)."},{"key":"bibr2-01655515221136232","doi-asserted-by":"publisher","DOI":"10.14778\/3025111.3025118"},{"key":"bibr3-01655515221136232","first-page":"193","volume-title":"Proceedings of the 18th international conference on extending database technology (EDBT)","author":"Zheng Y"},{"key":"bibr4-01655515221136232","first-page":"1015","volume-title":"Proceedings of the 2015 ACM SIGMOD international conference on management of data (SIGMOD\u201915)","author":"Fan J"},{"key":"bibr5-01655515221136232","first-page":"1031","volume-title":"Proceedings of the 2015 ACM SIGMOD international conference on management of data (SIGMOD\u201915)","author":"Zheng Y"},{"key":"bibr6-01655515221136232","first-page":"93","volume-title":"Proceedings of the 39th international conference on software engineering: software engineering in practice track (ICSE-SEIP\u201917)","author":"Abhinav K"},{"key":"bibr7-01655515221136232","unstructured":"Upwork. Hire freelancers and get freelance jobs online, 2019, https:\/\/www.upwork.com\/ (accessed 21 June 2019)."},{"issue":"3","key":"bibr8-01655515221136232","first-page":"21","volume":"51","author":"Malone TW","year":"2010","journal-title":"MIT Sloan Manage Rev"},{"key":"bibr9-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2013.1235"},{"key":"bibr10-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1145\/3148148"},{"key":"bibr11-01655515221136232","first-page":"1711","volume-title":"Proceedings of the 2017 ACM international conference on management of data (SIGMOD\u201917)","author":"Li G"},{"key":"bibr12-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187900"},{"key":"bibr13-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883070"},{"key":"bibr14-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2902913"},{"issue":"1","key":"bibr15-01655515221136232","first-page":"491","volume":"13","author":"Raykar VC","year":"2012","journal-title":"J Mach Learn Res"},{"key":"bibr16-01655515221136232","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350264"},{"key":"bibr17-01655515221136232","unstructured":"Freelancer. Hire freelancers and find freelance jobs online, 2019, https:\/\/www.freelancer.com\/ (accessed 7 June 2019)."},{"key":"bibr18-01655515221136232","doi-asserted-by":"publisher","DOI":"10.14778\/2809974.2809977"},{"key":"bibr19-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0385-2"},{"key":"bibr20-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-43984-5_29"},{"key":"bibr21-01655515221136232","first-page":"745","volume-title":"Proceedings of the 21st ACM SIGKDD international conference on knowledge discovery and data mining (KDD\u201915)","author":"Ma F"},{"key":"bibr22-01655515221136232","first-page":"1953","volume-title":"Advances in neural information processing systems 24","author":"Karger DR","year":"2011"},{"key":"bibr23-01655515221136232","first-page":"64","volume-title":"Proceedings of the ACM SIGKDD workshop on human computation (HCOMP\u201910)","author":"Ipeirotis PG"},{"key":"bibr24-01655515221136232","doi-asserted-by":"publisher","DOI":"10.14778\/3055540.3055547"},{"key":"bibr25-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2018.10.020"},{"key":"bibr26-01655515221136232","first-page":"1433","volume-title":"Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining (KDD\u201912)","author":"Liu X"},{"key":"bibr27-01655515221136232","first-page":"2198","volume-title":"Proceedings of the 58th annual meeting of the Association for Computational Linguistics","author":"Shang C"},{"key":"bibr28-01655515221136232","first-page":"133","volume-title":"Proceedings of the 32nd annual meeting on Association for Computational Linguistics (ACL\u201994)","author":"Wu Z"},{"key":"bibr29-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-017-1078-5"},{"key":"bibr30-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2535242"},{"key":"bibr31-01655515221136232","unstructured":"Zheng Y. Managing the quality of crowdsourced databases. HKU Thesis Online (HKUTO), https:\/\/hub.hku.hk\/handle\/10722\/250761"},{"key":"bibr32-01655515221136232","first-page":"1139","volume-title":"Proceedings of the 2018 IEEE 32nd international conference on advanced information networking and applications (AINA)","author":"Qiao L"},{"key":"bibr33-01655515221136232","first-page":"380","volume-title":"Proceedings of the international multiconference of engineers and computer scientists","author":"Niwattanakul S"},{"key":"bibr34-01655515221136232","doi-asserted-by":"publisher","DOI":"10.14778\/2140436.2140440"},{"key":"bibr35-01655515221136232","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2012.09.003"},{"key":"bibr36-01655515221136232","first-page":"66","volume-title":"Proceedings of the international conference on business process management","author":"Satzger B"},{"key":"bibr37-01655515221136232","unstructured":"Basu Roy S, Lykourentzou I, Thirumuruganathan S et al. Optimization in knowledge-intensive crowdsourcing. CoRR, vol. abs\/1401.1302, https:\/\/arxiv.org\/abs\/1401.1302"},{"key":"bibr38-01655515221136232","unstructured":"Rahman H, Basu Roy S, Thirumuruganathan S et al. \u2018The whole is greater than the sum of its parts\u2019: optimization in collaborative crowdsourcing. CoRR, vol. abs\/1502.05106, http:\/\/arxiv.org\/abs\/1502.05106"},{"key":"bibr39-01655515221136232","first-page":"949","volume-title":"Proceedings of the 2015 IEEE international conference on data mining","author":"Rahman H"},{"key":"bibr40-01655515221136232","first-page":"2035","volume-title":"Advances in neural information processing systems 22","author":"Whitehill J","year":"2009"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221136232","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515221136232","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515221136232","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T18:55:38Z","timestamp":1740855338000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515221136232"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,23]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["10.1177\/01655515221136232"],"URL":"https:\/\/doi.org\/10.1177\/01655515221136232","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,23]]}}}