{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T05:33:29Z","timestamp":1778045609015,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":114,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,5,9]],"date-time":"2017-05-09T00:00:00Z","timestamp":1494288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSERC Discovery Grant","award":["19579"],"award-info":[{"award-number":["19579"]}]},{"name":"RGC Projects","award":["17229116 and 17205115"],"award-info":[{"award-number":["17229116 and 17205115"]}]},{"name":"NSF of China","award":["61373024 61632016 61422205 61472198 61602488"],"award-info":[{"award-number":["61373024 61632016 61422205 61472198 61602488"]}]},{"name":"973 of China","award":["2015CB358700"],"award-info":[{"award-number":["2015CB358700"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,5,9]]},"DOI":"10.1145\/3035918.3054776","type":"proceedings-article","created":{"date-parts":[[2017,5,10]],"date-time":"2017-05-10T18:09:00Z","timestamp":1494439740000},"page":"1711-1716","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":81,"title":["Crowdsourced Data Management"],"prefix":"10.1145","author":[{"given":"Guoliang","family":"Li","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yudian","family":"Zheng","sequence":"additional","affiliation":[{"name":"The University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ju","family":"Fan","sequence":"additional","affiliation":[{"name":"Remin University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiannan","family":"Wang","sequence":"additional","affiliation":[{"name":"Simon Fraser University, Vancouver, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reynold","family":"Cheng","sequence":"additional","affiliation":[{"name":"The University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,5,9]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"https:\/\/www.mturk.com\/. https:\/\/www.mturk.com\/."},{"key":"e_1_3_2_1_2_1","unstructured":"http:\/\/www.crowdflower.com. http:\/\/www.crowdflower.com."},{"key":"e_1_3_2_1_3_1","unstructured":"https:\/\/docs.aws.amazon.com\/AWSMechTurk\/latest\/RequesterUI\/amt-ui.pdf. https:\/\/docs.aws.amazon.com\/AWSMechTurk\/latest\/RequesterUI\/amt-ui.pdf."},{"key":"e_1_3_2_1_4_1","unstructured":"http:\/\/www.chinacrowds.com. http:\/\/www.chinacrowds.com."},{"key":"e_1_3_2_1_5_1","unstructured":"http:\/\/dbgroup.cs.tsinghua.edu.cn\/ligl\/crowddata. http:\/\/dbgroup.cs.tsinghua.edu.cn\/ligl\/crowddata."},{"key":"e_1_3_2_1_6_1","unstructured":"https:\/\/www.waze.com. https:\/\/www.waze.com."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007323"},{"key":"e_1_3_2_1_8_1","volume-title":"CIDR","author":"Amsterdamer Y.","year":"2015","unstructured":"Y. Amsterdamer , S. Davidson , A. Kukliansky , T. Milo , S. Novgorodov , and A. Somech . Managing general and individual knowledge in crowd mining applications . In CIDR , 2015 . Y. Amsterdamer, S. Davidson, A. Kukliansky, T. Milo, S. Novgorodov, and A. Somech. Managing general and individual knowledge in crowd mining applications. In CIDR, 2015."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610514"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733039"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465318"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536274.2536288"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.2307\/2346806"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2892753.2892959"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2012.122"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350264"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915252"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113418"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433420"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733047"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2448496.2448524"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187900"},{"issue":"1","key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the em algorithm","volume":"30","author":"Dempster A. P.","year":"1977","unstructured":"A. P. Dempster , N. M. Laird , and D. B. Rubin . Maximum likelihood from incomplete data via the em algorithm . J.R.Statist.Soc.B , 30 ( 1 ): 1 -- 38 , 1977 . A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. J.R.Statist.Soc.B, 30(1):1--38, 1977.","journal-title":"J.R.Statist.Soc.B"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/3402755.3402809"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2109"},{"key":"e_1_3_2_1_26_1","first-page":"265","volume-title":"AISTATS","author":"Eriksson B.","year":"2013","unstructured":"B. Eriksson . Learning to top-k search using pairwise comparisons . In AISTATS , pages 265 -- 273 , 2013 . B. Eriksson. Learning to top-k search using pairwise comparisons. In AISTATS, pages 265--273, 2013."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2750550"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816716"},{"key":"e_1_3_2_1_29_1","article-title":"Distribution-aware crowdsourced entity collection","author":"Fan J.","year":"2017","unstructured":"J. Fan , Z. Wei , D. Zhang , J. Yang , and X. Du . Distribution-aware crowdsourced entity collection . IEEE Trans. Knowl. Data Eng. , 2017 . J. Fan, Z. Wei, D. Zhang, J. Yang, and X. Du. Distribution-aware crowdsourced entity collection. IEEE Trans. Knowl. Data Eng., 2017.","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2407353"},{"key":"e_1_3_2_1_31_1","volume-title":"AAAI Workshop","author":"Faradani S.","year":"2011","unstructured":"S. Faradani , B. Hartmann , and P. G. Ipeirotis . What's the right price? pricing tasks for finishing on time . In AAAI Workshop , 2011 . S. Faradani, B. Hartmann, and P. G. Ipeirotis. What's the right price? pricing tasks for finishing on time. In AAAI Workshop, 2011."},{"key":"e_1_3_2_1_32_1","first-page":"453","volume-title":"DASFAA 2014, Bali, Indonesia, April 21--24, 2014. Proceedings, Part II","author":"Feng J.","year":"2014","unstructured":"J. Feng , G. Li , H. Wang , and J. Feng . Incremental quality inference in crowdsourcing. In Database Systems for Advanced Applications - 19th International Conference , DASFAA 2014, Bali, Indonesia, April 21--24, 2014. Proceedings, Part II , pages 453 -- 467 , 2014 . J. Feng, G. Li, H. Wang, and J. Feng. Incremental quality inference in crowdsourcing. In Database Systems for Advanced Applications - 19th International Conference, DASFAA 2014, Bali, Indonesia, April 21--24, 2014. Proceedings, Part II, pages 453--467, 2014."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989331"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824136"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733085.2733101"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588576"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2745754.2745775"},{"key":"e_1_3_2_1_38_1","unstructured":"A. Gruenheid D. Kossmann S. Ramesh and F. Widmer. Crowdsourcing entity resolution: When is A=B? Technical report ETH Z\u00fcrich. A. Gruenheid D. Kossmann S. Ramesh and F. Widmer. Crowdsourcing entity resolution: When is A=B? Technical report ETH Z\u00fcrich."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213880"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824062"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.14778\/2856318.2856331"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v1i1.13079"},{"key":"e_1_3_2_1_43_1","first-page":"534","volume-title":"ICML","author":"Ho C.-J.","year":"2013","unstructured":"C.-J. Ho , S. Jabbari , and J. W. Vaughan . Adaptive task assignment for crowdsourced classification . In ICML , pages 534 -- 542 , 2013 . C.-J. Ho, S. Jabbari, and J. W. Vaughan. Adaptive task assignment for crowdsourced classification. In ICML, pages 534--542, 2013."},{"key":"e_1_3_2_1_44_1","volume-title":"AAAI","author":"Ho C.-J.","year":"2012","unstructured":"C.-J. Ho and J. W. Vaughan . Online task assignment in crowdsourcing markets . In AAAI , 2012 . C.-J. Ho and J. W. Vaughan. Online task assignment in crowdsourcing markets. In AAAI, 2012."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2016.7498298"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2016.7498229"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837885.1837906"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376701"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487595"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113284"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536360.2536369"},{"key":"e_1_3_2_1_52_1","first-page":"1953","volume-title":"NIPS","author":"Karger D. R.","year":"2011","unstructured":"D. R. Karger , S. Oh , and D. Shah . Iterative learning for reliable crowdsourcing systems . In NIPS , pages 1953 -- 1961 , 2011 . D. R. Karger, S. Oh, and D. Shah. Iterative learning for reliable crowdsourcing systems. In NIPS, pages 1953--1961, 2011."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2525314.2525346"},{"key":"e_1_3_2_1_54_1","volume-title":"Hybrid strategies for finding the max with the crowd. Technical report","author":"Khan A. R.","year":"2014","unstructured":"A. R. Khan and H. Garcia-Molina . Hybrid strategies for finding the max with the crowd. Technical report , 2014 . A. R. Khan and H. Garcia-Molina. Hybrid strategies for finding the max with the crowd. Technical report, 2014."},{"key":"e_1_3_2_1_55_1","first-page":"619","volume-title":"AISTATS","author":"Kim H.-C.","year":"2012","unstructured":"H.-C. Kim and Z. Ghahramani . Bayesian classifier combination . In AISTATS , pages 619 -- 627 , 2012 . H.-C. Kim and Z. Ghahramani. Bayesian classifier combination. In AISTATS, pages 619--627, 2012."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-002-0173-7"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2535242"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735496.2735505"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610509"},{"key":"e_1_3_2_1_60_1","first-page":"701","volume-title":"NIPS","author":"Liu Q.","year":"2012","unstructured":"Q. Liu , J. Peng , and A. T. Ihler . Variational inference for crowdsourcing . In NIPS , pages 701 -- 709 , 2012 . Q. Liu, J. Peng, and A. T. Ihler. Variational inference for crowdsourcing. In NIPS, pages 701--709, 2012."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.14778\/2336664.2336676"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2452376.2452431"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41924-9_25"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544940"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783314"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.14778\/2535568.2448944"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000044"},{"key":"e_1_3_2_1_68_1","first-page":"211","volume-title":"CIDR","author":"Marcus A.","year":"2011","unstructured":"A. Marcus , E. Wu , S. Madden , and R. C. Miller . Crowdsourced databases: Query processing with people . In CIDR , pages 211 -- 214 , 2011 . A. Marcus, E. Wu, S. Madden, and R. C. Miller. Crowdsourced databases: Query processing with people. In CIDR, pages 211--214, 2011."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735471.2735474"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816653"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737095.2737116"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732939.2732942"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213878"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398421"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.14778\/1952376.1952377"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610503"},{"key":"e_1_3_2_1_77_1","volume-title":"AAAI","author":"Pfeiffer T.","year":"2012","unstructured":"T. Pfeiffer , X. A. Gao , Y. Chen , A. Mao , and D. G. Rand . Adaptive polling for information aggregation . In AAAI , 2012 . T. Pfeiffer, X. A. Gao, Y. Chen, A. Mao, and D. G. Rand. Adaptive polling for information aggregation. In AAAI, 2012."},{"key":"e_1_3_2_1_78_1","first-page":"491","article-title":"Eliminating spammers and ranking annotators for crowdsourced labeling tasks","volume":"13","author":"Raykar V. C.","year":"2012","unstructured":"V. C. Raykar and S. Yu . Eliminating spammers and ranking annotators for crowdsourced labeling tasks . Journal of Machine Learning Research , 13 : 491 -- 518 , 2012 . V. C. Raykar and S. Yu. Eliminating spammers and ranking annotators for crowdsourced labeling tasks. Journal of Machine Learning Research, 13:491--518, 2012.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553488"},{"key":"e_1_3_2_1_80_1","volume-title":"Learning from crowds. JMLR, 11(Apr):1297--1322","author":"Raykar V. C.","year":"2010","unstructured":"V. C. Raykar , S. Yu , L. H. Zhao , G. H. Valadez , C. Florin , L. Bogoni , and L. Moy . Learning from crowds. JMLR, 11(Apr):1297--1322 , 2010 . V. C. Raykar, S. Yu, L. H. Zhao, G. H. Valadez, C. Florin, L. Bogoni, and L. Moy. Learning from crowds. JMLR, 11(Apr):1297--1322, 2010."},{"key":"e_1_3_2_1_81_1","first-page":"964","volume-title":"ICDE","author":"Sarma A. D.","year":"2014","unstructured":"A. D. Sarma , A. G. Parameswaran , H. Garcia-Molina , and A. Y. Halevy . Crowd-powered find algorithms . In ICDE , pages 964 -- 975 , 2014 . A. D. Sarma, A. G. Parameswaran, H. Garcia-Molina, and A. Y. Halevy. Crowd-powered find algorithms. In ICDE, pages 964--975, 2014."},{"key":"e_1_3_2_1_82_1","first-page":"1085","volume-title":"NIPS","author":"Smyth P.","year":"1994","unstructured":"P. Smyth , U. M. Fayyad , M. C. Burl , P. Perona , and P. Baldi . Inferring ground truth from subjective labelling of venus images . In NIPS , pages 1085 -- 1092 , 1994 . P. Smyth, U. M. Fayyad, M. C. Burl, P. Perona, and P. Baldi. Inferring ground truth from subjective labelling of venus images. In NIPS, pages 1085--1092, 1994."},{"key":"e_1_3_2_1_83_1","first-page":"1144","volume-title":"ICDE","author":"Su H.","year":"2014","unstructured":"H. Su , K. Zheng , J. Huang , H. Jeung , L. Chen , and X. Zhou . Crowdplanner: A crowd-based route recommendation system . In ICDE , pages 1144 -- 1155 . IEEE, 2014 . H. Su, K. Zheng, J. Huang, H. Jeung, L. Chen, and X. Zhou. Crowdplanner: A crowd-based route recommendation system. In ICDE, pages 1144--1155. IEEE, 2014."},{"key":"e_1_3_2_1_84_1","first-page":"1178","volume-title":"ICDE","author":"Su H.","year":"2014","unstructured":"H. Su , K. Zheng , J. Huang , T. Liu , H. Wang , and X. Zhou . A crowd-based route recommendation system-crowdplanner . In ICDE , pages 1178 -- 1181 , 2014 . H. Su, K. Zheng, J. Huang, T. Liu, H. Wang, and X. Zhou. A crowd-based route recommendation system-crowdplanner. In ICDE, pages 1178--1181, 2014."},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732951.2732966"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544865"},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2567989"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187969"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113286"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2749440"},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2732982"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1160379"},{"key":"e_1_3_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350263"},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610505"},{"key":"e_1_3_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465280"},{"key":"e_1_3_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2723739"},{"key":"e_1_3_2_1_97_1","first-page":"2424","volume-title":"NIPS","author":"Welinder P.","year":"2010","unstructured":"P. Welinder , S. Branson , P. Perona , and S. J. Belongie . The multidimensional wisdom of crowds . In NIPS , pages 2424 -- 2432 , 2010 . P. Welinder, S. Branson, P. Perona, and S. J. Belongie. The multidimensional wisdom of crowds. In NIPS, pages 2424--2432, 2010."},{"key":"e_1_3_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2010.5543189"},{"key":"e_1_3_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536336.2536337"},{"key":"e_1_3_2_1_100_1","first-page":"2035","volume-title":"NIPS","author":"Whitehill J.","year":"2009","unstructured":"J. Whitehill , P. Ruvolo , T. Wu , J. Bergsma , and J. R. Movellan . Whose vote should count more: Optimal integration of labels from labelers of unknown expertise . In NIPS , pages 2035 -- 2043 , 2009 . J. Whitehill, P. Ruvolo, T. Wu, J. Bergsma, and J. R. Movellan. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In NIPS, pages 2035--2043, 2009."},{"key":"e_1_3_2_1_101_1","first-page":"2035","volume-title":"NIPS","author":"Whitehill J.","year":"2009","unstructured":"J. Whitehill , T.-f. Wu , J. Bergsma , J. R. Movellan , and P. L. Ruvolo . Whose vote should count more: Optimal integration of labels from labelers of unknown expertise . In NIPS , pages 2035 -- 2043 , 2009 . J. Whitehill, T.-f. Wu, J. Bergsma, J. R. Movellan, and P. L. Ruvolo. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In NIPS, pages 2035--2043, 2009."},{"key":"e_1_3_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.93"},{"key":"e_1_3_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/1814433.1814443"},{"key":"e_1_3_2_1_104_1","volume-title":"ICML Workshop","author":"Ye P.","year":"2013","unstructured":"P. Ye , U. EDU, and D. Doermann . Combining preference and absolute judgements in a crowd-sourced setting . In ICML Workshop , 2013 . P. Ye, U. EDU, and D. Doermann. Combining preference and absolute judgements in a crowd-sourced setting. In ICML Workshop, 2013."},{"key":"e_1_3_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536360.2536374"},{"key":"e_1_3_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733085.2733105"},{"key":"e_1_3_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.14778\/2921558.2921559"},{"key":"e_1_3_2_1_108_1","first-page":"397","volume-title":"EDBT","author":"Zhao Z.","year":"2015","unstructured":"Z. Zhao , F. Wei , M. Zhou , W. Chen , and W. Ng . Crowd-selection query processing in crowdsourcing databases: A task-driven approach . In EDBT , pages 397 -- 408 , 2015 . Z. Zhao, F. Wei, M. Zhou, W. Chen, and W. Ng. Crowd-selection query processing in crowdsourcing databases: A task-driven approach. In EDBT, pages 397--408, 2015."},{"key":"e_1_3_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487708"},{"key":"e_1_3_2_1_110_1","first-page":"193","volume-title":"EDBT","author":"Zheng Y.","year":"2015","unstructured":"Y. Zheng , R. Cheng , S. Maniu , and L. Mo . On optimality of jury selection in crowdsourcing . In EDBT , pages 193 -- 204 , 2015 . Y. Zheng, R. Cheng, S. Maniu, and L. Mo. On optimality of jury selection in crowdsourcing. In EDBT, pages 193--204, 2015."},{"key":"e_1_3_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.14778\/3025111.3025118"},{"key":"e_1_3_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.14778\/3055540.3055547"},{"key":"e_1_3_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2749430"},{"key":"e_1_3_2_1_114_1","first-page":"2195","volume-title":"NIPS","author":"Zhou D.","year":"2012","unstructured":"D. Zhou , S. Basu , Y. Mao , and J. C. Platt . Learning from the wisdom of crowds by minimax entropy . In NIPS , pages 2195 -- 2203 , 2012 . D. Zhou, S. Basu, Y. Mao, and J. C. Platt. Learning from the wisdom of crowds by minimax entropy. In NIPS, pages 2195--2203, 2012."}],"event":{"name":"SIGMOD\/PODS'17: International Conference on Management of Data","location":"Chicago Illinois USA","acronym":"SIGMOD\/PODS'17","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"]},"container-title":["Proceedings of the 2017 ACM International Conference on Management of Data"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3054776","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3035918.3054776","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:36:48Z","timestamp":1750217808000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3035918.3054776"}},"subtitle":["Overview and Challenges"],"short-title":[],"issued":{"date-parts":[[2017,5,9]]},"references-count":114,"alternative-id":["10.1145\/3035918.3054776","10.1145\/3035918"],"URL":"https:\/\/doi.org\/10.1145\/3035918.3054776","relation":{},"subject":[],"published":{"date-parts":[[2017,5,9]]},"assertion":[{"value":"2017-05-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}