{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T11:05:34Z","timestamp":1779447934844,"version":"3.53.1"},"reference-count":79,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T00:00:00Z","timestamp":1775001600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T00:00:00Z","timestamp":1777075200000},"content-version":"vor","delay-in-days":24,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"JSPS KAKENHI","award":["22H00508"],"award-info":[{"award-number":["22H00508"]}]},{"name":"CREST","award":["JPMJCR22M2"],"award-info":[{"award-number":["JPMJCR22M2"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["The VLDB Journal"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Large-scale crowdsourcing with high-quality results, such as online surveys and data labeling tasks, is in wide demand. Existing techniques on task assignment result quality optimization, however, have addressed only a part of optimization space that does not necessarily reflect the real-world problem. For example, in reality, the proper worker set for task assignment and the workers\u2019 submissions to the task are non-obvious in advance, which is not considered by existing techniques. Hence, this paper discusses a task assignment algorithm that dynamically probes the proper worker set(s) and worker submission models for the task to optimize task assignments in terms of quality, time, and expense. Specifically, we introduce CrowdBwO (Crowd Bandit with Optimization), a novel multi-armed bandit algorithm that is based on batched bandits and bandits with Knapsack and incorporates worker submission models. CrowdBwO dynamically determines and utilizes proper worker set(s) and worker submission models for each task under uncertainty to achieve high-performance crowdsourcing. We conducted extensive experiments with synthetic workers and real workers to evaluate CrowdBwO in two specific problem settings. Our extensive experimental results demonstrate that CrowdBwO is significant for real-world crowdsourcing and has a high performance.<\/jats:p>","DOI":"10.1007\/s00778-026-00969-5","type":"journal-article","created":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T02:39:03Z","timestamp":1777084743000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Efficient Task Assignment for Multi-Workerset Crowdsourcing with Time and Expense Considerations"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-0841-260X","authenticated-orcid":false,"given":"Yunyi","family":"Xiao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiroyoshi","family":"Ito","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atsuyuki","family":"Morishima","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,25]]},"reference":[{"key":"969_CR1","doi-asserted-by":"crossref","unstructured":"Assadi, S., Hsu, J., Jabbari, S.: Online assignment of heterogeneous tasks in crowdsourcing markets. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 3, pp. 12\u201321 (2015)","DOI":"10.1609\/hcomp.v3i1.13236"},{"key":"969_CR2","doi-asserted-by":"crossref","unstructured":"Badanidiyuru, A., Kleinberg, R., Slivkins, A.: Bandits with knapsacks. J. of the ACM (JACM) 65(3), 1\u201355 (2018)","DOI":"10.1145\/3164539"},{"issue":"4","key":"969_CR3","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s00778-015-0385-2","volume":"24","author":"S Basu Roy","year":"2015","unstructured":"Basu Roy, S., Lykourentzou, I., Thirumuruganathan, S., Amer-Yahia, S., Das, G.: Task assignment optimization in knowledge-intensive crowdsourcing. VLDB J. 24(4), 467\u2013491 (2015)","journal-title":"VLDB J."},{"key":"969_CR4","doi-asserted-by":"publisher","first-page":"800","DOI":"10.3758\/s13428-011-0081-0","volume":"43","author":"TS Behrend","year":"2011","unstructured":"Behrend, T.S., Sharek, D.J., Meade, A.W., Wiebe, E.N.: The viability of crowdsourcing for survey research. Behav. Res. Methods 43, 800\u2013813 (2011)","journal-title":"Behav. Res. Methods"},{"issue":"7","key":"969_CR5","first-page":"1","volume":"22","author":"V Bengs","year":"2021","unstructured":"Bengs, V., Busa-Fekete, R., El Mesaoudi-Paul, A., H\u00fcllermeier, E.: Preference-based online learning with dueling bandits: a survey. J. Mach. Learn. Res. 22(7), 1\u2013108 (2021)","journal-title":"J. Mach. Learn. Res."},{"key":"969_CR6","doi-asserted-by":"crossref","unstructured":"Biswas, A., Jain, S., Mandal, D., Narahari, Y.: A truthful budget feasible multi-armed bandit mechanism for crowdsourcing time critical tasks. In: AAMAS, pp. 1101\u20131109 (2015)","DOI":"10.65109\/MCWB1736"},{"key":"969_CR7","doi-asserted-by":"crossref","unstructured":"Bouneffouf, D., Rish, I., Aggarwal, C.: Survey on applications of multi-armed and contextual bandits. In: 2020 IEEE Congress on Evolutionary Computation (CEC), pp. 1\u20138. IEEE (2020)","DOI":"10.1109\/CEC48606.2020.9185782"},{"issue":"2","key":"969_CR8","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.amepre.2013.10.016","volume":"46","author":"DC Brabham","year":"2014","unstructured":"Brabham, D.C., Ribisl, K.M., Kirchner, T.R., Bernhardt, J.M.: Crowdsourcing applications for public health. Am. J. Prev. Med. 46(2), 179\u2013187 (2014)","journal-title":"Am. J. Prev. Med."},{"key":"969_CR9","doi-asserted-by":"crossref","unstructured":"Chai, C., Fan, J., Li, G., Wang, J., Zheng, Y.: Crowdsourcing database systems: overview and challenges. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 2052\u20132055. IEEE (2019)","DOI":"10.1109\/ICDE.2019.00237"},{"key":"969_CR10","doi-asserted-by":"crossref","unstructured":"Chang, J.C., Amershi, S., Kamar, E.: Revolt: collaborative crowdsourcing for labeling machine learning datasets. In: Proceedings of the 2017 CHI conference on human factors in computing systems, pp. 2334\u20132346 (2017)","DOI":"10.1145\/3025453.3026044"},{"key":"969_CR11","doi-asserted-by":"crossref","unstructured":"Checco, A., Bates, J., Demartini, G.: All that glitters is gold\u2013an attack scheme on gold questions in crowdsourcing. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 6, pp. 2\u201311 (2018)","DOI":"10.1609\/hcomp.v6i1.13332"},{"key":"969_CR12","unstructured":"Chen, X., Lin, Q., Zhou, D.: Optimistic knowledge gradient policy for optimal budget allocation in crowdsourcing. In: International conference on machine learning, pp. 64\u201372. PMLR (2013)"},{"key":"969_CR13","doi-asserted-by":"crossref","unstructured":"Chilton, L.B., Horton, J.J., Miller, R.C., Azenkot, S.: Task search in a human computation market. In: Proceedings of the ACM SIGKDD workshop on human computation, pp. 1\u20139 (2010)","DOI":"10.1145\/1837885.1837889"},{"issue":"9","key":"969_CR14","doi-asserted-by":"publisher","first-page":"2246","DOI":"10.1109\/TKDE.2016.2555805","volume":"28","author":"AI Chittilappilly","year":"2016","unstructured":"Chittilappilly, A.I., Chen, L., Amer-Yahia, S.: A survey of general-purpose crowdsourcing techniques. IEEE Trans. Knowl. Data Eng. 28(9), 2246\u20132266 (2016)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"969_CR15","unstructured":"Combes, R., Talebi Mazraeh Shahi, M.S., Proutiere, A., et\u00a0al.: Combinatorial bandits revisited. Adv. in Neural Inf. Process. Syst. 28, (2015)"},{"issue":"1","key":"969_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3148148","volume":"51","author":"F Daniel","year":"2018","unstructured":"Daniel, F., Kucherbaev, P., Cappiello, C., Benatallah, B., Allahbakhsh, M.: Quality control in crowdsourcing: a survey of quality attributes, assessment techniques, and assurance actions. ACM Comput. Surveys (CSUR) 51(1), 1\u201340 (2018)","journal-title":"ACM Comput. Surveys (CSUR)"},{"key":"969_CR17","doi-asserted-by":"crossref","unstructured":"Dickerson, J.P., Sankararaman, K.A., Srinivasan, A., Xu, P.: Assigning tasks to workers based on historical data: online task assignment with two-sided arrivals. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), (2018)","DOI":"10.65109\/CNMV6270"},{"key":"969_CR18","doi-asserted-by":"crossref","unstructured":"Difallah, D.E., Catasta, M., Demartini, G., Ipeirotis, P.G., Cudr\u00e9-Mauroux, P.: The dynamics of micro-task crowdsourcing: the case of amazon mturk. In: Proceedings of the 24th international conference on world wide web, pp. 238\u2013247 (2015)","DOI":"10.1145\/2736277.2741685"},{"key":"969_CR19","doi-asserted-by":"crossref","unstructured":"Difallah, D.E., Demartini, G., Cudr\u00e9-Mauroux, P.: Pick-a-crowd: tell me what you like, and i\u2019ll tell you what to do. In: Proceedings of the 22nd international conference on World Wide Web, pp. 367\u2013374 (2013)","DOI":"10.1145\/2488388.2488421"},{"key":"969_CR20","doi-asserted-by":"crossref","unstructured":"Duan, X., Tajima, K.: Improving multiclass classification in crowdsourcing by using hierarchical schemes. In: The World Wide Web Conference, pp. 2694\u20132700 (2019)","DOI":"10.1145\/3308558.3313749"},{"key":"969_CR21","doi-asserted-by":"crossref","unstructured":"Fan, J., Li, G., Ooi, B.C., Tan, K.l., Feng, J.: Icrowd: an adaptive crowdsourcing framework. In: Proceedings of the 2015 ACM SIGMOD international conference on management of data, pp. 1015\u20131030 (2015)","DOI":"10.1145\/2723372.2750550"},{"key":"969_CR22","doi-asserted-by":"crossref","unstructured":"Gadiraju, U., Kawase, R., Dietze, S., Demartini, G.: Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, pp. 1631\u20131640 (2015)","DOI":"10.1145\/2702123.2702443"},{"key":"969_CR23","unstructured":"Gao, Z., Han, Y., Ren, Z., Zhou, Z.: Batched multi-armed bandits problem. In: Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019 Alch\u00e9-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32. Curran Associates, Inc (2019)"},{"issue":"2","key":"969_CR24","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1111\/ijmr.12135","volume":"20","author":"A Ghezzi","year":"2018","unstructured":"Ghezzi, A., Gabelloni, D., Martini, A., Natalicchio, A.: Crowdsourcing: a review and suggestions for future research. Int. J. Manag. Rev. 20(2), 343\u2013363 (2018)","journal-title":"Int. J. Manag. Rev."},{"key":"969_CR25","doi-asserted-by":"crossref","unstructured":"Goel, N., Faltings, B.: Crowdsourcing with fairness, diversity and budget constraints. In: Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 297\u2013304 (2019)","DOI":"10.1145\/3306618.3314282"},{"key":"969_CR26","doi-asserted-by":"publisher","unstructured":"Goncalves, J., Feldman, M., Hu, S., Kostakos, V., Bernstein, A.: Task routing and assignment in crowdsourcing based on cognitive abilities. In: Proceedings of the 26th International Conference on World Wide Web Companion, WWW \u201917 Companion, pp. 1023\u20131031. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE (2017). https:\/\/doi.org\/10.1145\/3041021.3055128","DOI":"10.1145\/3041021.3055128"},{"issue":"16","key":"969_CR27","doi-asserted-by":"publisher","first-page":"1925","DOI":"10.1093\/bioinformatics\/btt333","volume":"29","author":"BM Good","year":"2013","unstructured":"Good, B.M., Su, A.I.: Crowdsourcing for bioinformatics. Bioinf. 29(16), 1925\u20131933 (2013)","journal-title":"Crowdsourcing for bioinformatics. Bioinf."},{"issue":"12","key":"969_CR28","doi-asserted-by":"publisher","first-page":"1642","DOI":"10.14778\/2824032.2824062","volume":"8","author":"D Haas","year":"2015","unstructured":"Haas, D., Ansel, J., Gu, L., Marcus, A.: Argonaut: macrotask crowdsourcing for complex data processing. Proc. of the VLDB Endowment 8(12), 1642\u20131653 (2015)","journal-title":"Proc. of the VLDB Endowment"},{"issue":"3","key":"969_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3494522","volume":"55","author":"D Hettiachchi","year":"2022","unstructured":"Hettiachchi, D., Kostakos, V., Goncalves, J.: A survey on task assignment in crowdsourcing. ACM Comput. Surveys (CSUR) 55(3), 1\u201335 (2022)","journal-title":"ACM Comput. Surveys (CSUR)"},{"key":"969_CR30","doi-asserted-by":"crossref","unstructured":"Hettiachchi, D., Van Berkel, N., Kostakos, V., Goncalves, J.: Crowdcog: a cognitive skill based system for heterogeneous task assignment and recommendation in crowdsourcing. Proc. of the ACM on Human-Comput. Inter. 4(CSCW2), 1\u201322 (2020)","DOI":"10.1145\/3415181"},{"key":"969_CR31","unstructured":"Ho, C.J., Jabbari, S., Vaughan, J.W.: Adaptive task assignment for crowdsourced classification. In: International Conference on Machine Learning, pp. 534\u2013542. PMLR (2013)"},{"issue":"1","key":"969_CR32","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1108\/SO-12-2014-0029","volume":"8","author":"M Hossain","year":"2015","unstructured":"Hossain, M., Kauranen, I.: Crowdsourcing: a comprehensive literature review. Strategic Outsourcing: An Int. J. 8(1), 2\u201322 (2015)","journal-title":"Strategic Outsourcing: An Int. J."},{"key":"969_CR33","first-page":"27057","volume":"34","author":"R Huang","year":"2021","unstructured":"Huang, R., Wu, W., Yang, J., Shen, C.: Federated linear contextual bandits. Adv. Neural. Inf. Process. Syst. 34, 27057\u201327068 (2021)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"969_CR34","unstructured":"Hwang, T., Chai, K., Oh, M.H.: Combinatorial neural bandits. In: International Conference on Machine Learning, pp. 14203\u201314236. PMLR (2023)"},{"key":"969_CR35","doi-asserted-by":"crossref","unstructured":"Ipeirotis, P.G., Gabrilovich, E.: Quizz: targeted crowdsourcing with a billion (potential) users. In: Proceedings of the 23rd international conference on World wide web, pp. 143\u2013154 (2014)","DOI":"10.1145\/2566486.2567988"},{"key":"969_CR36","doi-asserted-by":"publisher","unstructured":"Jiang, J., Zhou, Y., Jiang, Y., Bu, Z., Cao, J.: Batch allocation for decomposition-based complex task crowdsourcing e-markets in social networks. Knowl.-Based Syst. 194, 105522 (2020). https:\/\/doi.org\/10.1016\/j.knosys.2020.105522","DOI":"10.1016\/j.knosys.2020.105522"},{"key":"969_CR37","doi-asserted-by":"crossref","unstructured":"Kobayashi, M., Wakabayashi, K., Morishima, A.: Human+ ai crowd task assignment considering result quality requirements. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 9, pp. 97\u2013107 (2021)","DOI":"10.1609\/hcomp.v9i1.18943"},{"key":"969_CR38","doi-asserted-by":"crossref","unstructured":"Lattimore, T., Szepesv\u00e1ri, C.: Bandit Algorithms. Cambridge University Press (2020)","DOI":"10.1017\/9781108571401"},{"issue":"9","key":"969_CR39","doi-asserted-by":"publisher","first-page":"2296","DOI":"10.1109\/TKDE.2016.2535242","volume":"28","author":"G Li","year":"2016","unstructured":"Li, G., Wang, J., Zheng, Y., Franklin, M.J.: Crowdsourced data management: a survey. IEEE Trans. Knowl. Data Eng. 28(9), 2296\u20132319 (2016)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"969_CR40","doi-asserted-by":"crossref","unstructured":"Li, G., Zheng, Y., Fan, J., Wang, J., Cheng, R.: Crowdsourced data management: overview and challenges. In: Proceedings of the 2017 ACM international conference on Management of Data, pp. 1711\u20131716 (2017)","DOI":"10.1145\/3035918.3054776"},{"key":"969_CR41","doi-asserted-by":"crossref","unstructured":"Li, H., Liu, Q.: Cheaper and better: selecting good workers for crowdsourcing. In: Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, vol. 3, pp. 20\u201321 (2015)","DOI":"10.1609\/hcomp.v3i1.13248"},{"key":"969_CR42","doi-asserted-by":"crossref","unstructured":"Li, H., Zhao, B., Fuxman, A.: The wisdom of minority: discovering and targeting the right group of workers for crowdsourcing. In: Proceedings of the 23rd international conference on World wide web, pp. 165\u2013176 (2014)","DOI":"10.1145\/2566486.2568033"},{"key":"969_CR43","doi-asserted-by":"crossref","unstructured":"Li, J., Fukumoto, F.: A dataset of crowdsourced word sequences: collections and answer aggregation for ground truth creation. In: Proceedings of the First Workshop on Aggregating and Analysing Crowdsourced Annotations for NLP, pp. 24\u201328 (2019)","DOI":"10.18653\/v1\/D19-5904"},{"key":"969_CR44","doi-asserted-by":"crossref","unstructured":"Li, K., Li, G., Wang, Y., Huang, Y., Liu, Z., Wu, Z.: Crowdrl: an end-to-end reinforcement learning framework for data labelling. In: 2021 IEEE 37th International Conference on Data Engineering (ICDE), pp. 289\u2013300. IEEE (2021)","DOI":"10.1109\/ICDE51399.2021.00032"},{"key":"969_CR45","doi-asserted-by":"publisher","unstructured":"Liu, X., Lu, M., Ooi, B.C., Shen, Y., Wu, S., Zhang, M.: Cdas: a crowdsourcing data analytics system. Proc. VLDB Endow. 5(10), 1040\u20131051 (2012). https:\/\/doi.org\/10.14778\/2336664.2336676","DOI":"10.14778\/2336664.2336676"},{"key":"969_CR46","doi-asserted-by":"crossref","unstructured":"Matsubara, M., Borromeo, R.M., Amer-Yahia, S., Morishima, A.: Task assignment strategies for crowd worker ability improvement. Proc. of the ACM on Human-Comput. Inter. 5(CSCW2), 1\u201320 (2021)","DOI":"10.1145\/3479519"},{"key":"969_CR47","doi-asserted-by":"crossref","unstructured":"Mavridis, P., Gross-Amblard, D., Mikl\u00f3s, Z.: Using hierarchical skills for optimized task assignment in knowledge-intensive crowdsourcing. In: Proceedings of the 25th International Conference on World Wide Web, pp. 843\u2013853 (2016)","DOI":"10.1145\/2872427.2883070"},{"key":"969_CR48","doi-asserted-by":"crossref","unstructured":"Michael, J., Stanovsky, G., He, L., Dagan, I., Zettlemoyer, L.: Crowdsourcing question-answer meaning representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 560\u2013568 (2018)","DOI":"10.18653\/v1\/N18-2089"},{"key":"969_CR49","doi-asserted-by":"crossref","unstructured":"Mo, K., Zhong, E., Yang, Q.: Cross-task crowdsourcing. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, pp. 677\u2013685 (2013)","DOI":"10.1145\/2487575.2487593"},{"key":"969_CR50","doi-asserted-by":"publisher","unstructured":"Mo, L., Cheng, R., Kao, B., Yang, X.S., Ren, C., Lei, S., Cheung, D.W., Lo, E.: Optimizing plurality for human intelligence tasks. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, CIKM \u201913, pp. 1929\u20131938. Association for Computing Machinery, New York, NY, USA (2013). https:\/\/doi.org\/10.1145\/2505515.2505755","DOI":"10.1145\/2505515.2505755"},{"key":"969_CR51","doi-asserted-by":"publisher","first-page":"1023","DOI":"10.3758\/s13428-013-0434-y","volume":"46","author":"E Peer","year":"2014","unstructured":"Peer, E., Vosgerau, J., Acquisti, A.: Reputation as a sufficient condition for data quality on amazon mechanical turk. Behav. Res. Methods 46, 1023\u20131031 (2014)","journal-title":"Behav. Res. Methods"},{"key":"969_CR52","doi-asserted-by":"crossref","unstructured":"Peng, Q., Liu, H., Wang, Y., Xu, H., Jiao, P., Shao, M., Wang, W.: Towards a multi-view attentive matching for personalized expert finding. In: Proceedings of the ACM web conference 2022, pp. 2131\u20132140 (2022)","DOI":"10.1145\/3485447.3512086"},{"key":"969_CR53","doi-asserted-by":"crossref","unstructured":"Perchet, V., Rigollet, P., Chassang, S., Snowberg, E.: Batched bandit problems. Ann. Stat. 660\u2013681 (2016)","DOI":"10.2139\/ssrn.2683578"},{"issue":"4","key":"969_CR54","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1007\/BF02579324","volume":"7","author":"P Raghavan","year":"1987","unstructured":"Raghavan, P., Tompson, C.D.: Randomized rounding: a technique for provably good algorithms and algorithmic proofs. Combinatorica 7(4), 365\u2013374 (1987)","journal-title":"Combinatorica"},{"key":"969_CR55","doi-asserted-by":"crossref","unstructured":"Rangi, A., Franceschetti, M.: Multi-armed bandit algorithms for crowdsourcing systems with online estimation of workers\u2019 ability. In: AAMAS, pp. 1345\u20131352 (2018)","DOI":"10.65109\/IWWG6201"},{"issue":"2","key":"969_CR56","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1287\/mnsc.2023.4895","volume":"70","author":"Z Ren","year":"2024","unstructured":"Ren, Z., Zhou, Z.: Dynamic batch learning in high-dimensional sparse linear contextual bandits. Manage. Sci. 70(2), 1315\u20131342 (2024)","journal-title":"Manage. Sci."},{"key":"969_CR57","unstructured":"Sankararaman, K.A., Slivkins, A.: Combinatorial semi-bandits with knapsacks. In: International Conference on Artificial Intelligence and Statistics, pp. 1760\u20131770. PMLR (2018)"},{"issue":"2","key":"969_CR58","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1109\/TSC.2011.2","volume":"5","author":"D Schall","year":"2011","unstructured":"Schall, D., Skopik, F., Dustdar, S.: Expert discovery and interactions in mixed service-oriented systems. IEEE Trans. Serv. Comput. 5(2), 233\u2013245 (2011)","journal-title":"IEEE Trans. Serv. Comput."},{"key":"969_CR59","doi-asserted-by":"crossref","unstructured":"Shan, C., Mamoulis, N., Cheng, R., Li, G., Li, X., Qian, Y.: An end-to-end deep rl framework for task arrangement in crowdsourcing platforms. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp. 49\u201360. IEEE (2020)","DOI":"10.1109\/ICDE48307.2020.00012"},{"key":"969_CR60","doi-asserted-by":"crossref","unstructured":"Shan, C., Mamoulis, N., Li, G., Cheng, R., Huang, Z., Zheng, Y.: T-crowd: effective crowdsourcing for tabular data. In: 2018 IEEE 34th International Conference on Data Engineering (ICDE), pp. 1316\u20131319. IEEE (2018)","DOI":"10.1109\/ICDE.2018.00139"},{"issue":"11","key":"969_CR61","doi-asserted-by":"publisher","first-page":"2060","DOI":"10.1109\/TKDE.2019.2914903","volume":"32","author":"C Shan","year":"2019","unstructured":"Shan, C., Mamoulis, N., Li, G., Cheng, R., Huang, Z., Zheng, Y.: A crowdsourcing framework for collecting tabular data. IEEE Trans. Knowl. Data Eng. 32(11), 2060\u20132074 (2019)","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"969_CR62","doi-asserted-by":"crossref","unstructured":"Sheng, V.S., Zhang, J.: Machine learning with crowdsourcing: A brief summary of the past research and future directions. In: Proceedings of the AAAI conference on artificial intelligence, vol. 33, pp. 9837\u20139843 (2019)","DOI":"10.1609\/aaai.v33i01.33019837"},{"key":"969_CR63","doi-asserted-by":"crossref","unstructured":"Simchi-Levi, D., Xu, Y.: Phase transitions and cyclic phenomena in bandits with switching constraints. Adv. Neural. Inf. Process. Syst. 32, (2019)","DOI":"10.2139\/ssrn.3380783"},{"key":"969_CR64","unstructured":"Simchi-Levi, D., Xu, Y., Zhao, J.: Blind network revenue management and bandits with knapsacks under limited switches. arXiv preprint arXiv:1911.01067 (2019)"},{"key":"969_CR65","unstructured":"Snoek, J., Larochelle, H., Adams, R.P.: Practical bayesian optimization of machine learning algorithms. Adv. Neural. Inf. Process. Syst. 25, (2012)"},{"key":"969_CR66","unstructured":"Su, H., Deng, J., Fei-Fei, L.: Crowdsourcing annotations for visual object detection. HCOMP@ AAAI 1 (2012)"},{"key":"969_CR67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13278-015-0276-y","volume":"5","author":"A Tagarelli","year":"2015","unstructured":"Tagarelli, A., Interdonato, R.: Time-aware analysis and ranking of lurkers in social networks. Soc. Netw. Anal. Min. 5, 1\u201323 (2015)","journal-title":"Soc. Netw. Anal. Min."},{"key":"969_CR68","doi-asserted-by":"crossref","unstructured":"Tran-Thanh, L., Chapman, A., Rogers, A., Jennings, N.: Knapsack based optimal policies for budget-limited multi-armed bandits. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 26, pp. 1134\u20131140 (2012)","DOI":"10.1609\/aaai.v26i1.8279"},{"issue":"1","key":"969_CR69","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1007\/s13278-022-00928-2","volume":"12","author":"L Vassio","year":"2022","unstructured":"Vassio, L., Garetto, M., Leonardi, E., Chiasserini, C.F.: Mining and modelling temporal dynamics of followers\u2019 engagement on online social networks. Soc. Netw. Anal. Min. 12(1), 96 (2022)","journal-title":"Soc. Netw. Anal. Min."},{"issue":"193","key":"969_CR70","first-page":"1","volume":"18","author":"JW Vaughan","year":"2018","unstructured":"Vaughan, J.W.: Making better use of the crowd: how crowdsourcing can advance machine learning research. J. Mach. Learn. Res. 18(193), 1\u201346 (2018)","journal-title":"J. Mach. Learn. Res."},{"key":"969_CR71","unstructured":"Wang, J., Faridani, S., Ipeirotis, P.: Estimating the completion time of crowdsourced tasks using survival analysis models. Crowdsourcing for Search and Data Mining (CSDM 2011) 31, 31\u201338 (2011)"},{"issue":"1\u20132","key":"969_CR72","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/0016-0032(76)90138-1","volume":"301","author":"IH Witten","year":"1976","unstructured":"Witten, I.H.: The apparent conflict between estimation and control-a survey of the two-armed bandit problem. J. Franklin Inst. 301(1\u20132), 161\u2013189 (1976)","journal-title":"J. Franklin Inst."},{"key":"969_CR73","doi-asserted-by":"crossref","unstructured":"Xiao, Y., Yamashita, Y., Ito, H., Matsubara, M., Morishima, A.: Multi-armed bandit approach to qualification task assignment across multi crowdsourcing platforms. In: 2022 IEEE International Conference on Big Data (Big Data), pp. 4040\u20134048. IEEE (2022)","DOI":"10.1109\/BigData55660.2022.10020816"},{"key":"969_CR74","doi-asserted-by":"crossref","unstructured":"Xu, G., Ding, W., Tang, J., Yang, S., Huang, G.Y., Liu, Z.: Learning effective embeddings from crowdsourced labels: An educational case study. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 1922\u20131927. IEEE (2019)","DOI":"10.1109\/ICDE.2019.00208"},{"key":"969_CR75","doi-asserted-by":"crossref","unstructured":"Yuen, M.C., King, I., Leung, K.S.: A survey of crowdsourcing systems. In: 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing, pp. 766\u2013773. IEEE (2011)","DOI":"10.1109\/PASSAT\/SocialCom.2011.203"},{"key":"969_CR76","doi-asserted-by":"crossref","unstructured":"Zhang, H., Huang, W., Su, Z., Chen, J., Jiang, D., Fan, L., Zhang, C., Lian, D., Wu, K.: Hierarchical crowdsourcing for data labeling with heterogeneous crowd. In: 2023 IEEE 39th International Conference on Data Engineering (ICDE), pp. 1234\u20131246. IEEE (2023)","DOI":"10.1109\/ICDE55515.2023.00099"},{"issue":"11","key":"969_CR77","doi-asserted-by":"publisher","first-page":"2447","DOI":"10.1162\/NECO_a_00782","volume":"27","author":"H Zhang","year":"2015","unstructured":"Zhang, H., Ma, Y., Sugiyama, M.: Bandit-based task assignment for heterogeneous crowdsourcing. Neural Comput. 27(11), 2447\u20132475 (2015)","journal-title":"Neural Comput."},{"key":"969_CR78","doi-asserted-by":"crossref","unstructured":"Zheng, L., Chen, L.: Mutual benefit aware task assignment in a bipartite labor market. In: 2016 IEEE 32nd International Conference on Data Engineering (ICDE), pp. 73\u201384. IEEE (2016)","DOI":"10.1109\/ICDE.2016.7498230"},{"key":"969_CR79","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Li, G., Cheng, R.: Docs: a domain-aware crowdsourcing system using knowledge bases. Proc. of the VLDB Endow. 10(4), 361\u2013372 (2016)","DOI":"10.14778\/3025111.3025118"}],"container-title":["The VLDB Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00778-026-00969-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00778-026-00969-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00778-026-00969-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,22]],"date-time":"2026-05-22T10:15:59Z","timestamp":1779444959000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00778-026-00969-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4]]},"references-count":79,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["969"],"URL":"https:\/\/doi.org\/10.1007\/s00778-026-00969-5","relation":{},"ISSN":["1066-8888","0949-877X"],"issn-type":[{"value":"1066-8888","type":"print"},{"value":"0949-877X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4]]},"assertion":[{"value":"16 January 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 February 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 April 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The data used for experiments in this paper was approved by the Ethics Review Board of the University of Tsukuba, Number 23-11.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}}],"article-number":"23"}}