{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:17:12Z","timestamp":1750306632218,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2014,6,2]],"date-time":"2014-06-02T00:00:00Z","timestamp":1401667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2014,6,2]]},"DOI":"10.1145\/2611040.2611074","type":"proceedings-article","created":{"date-parts":[[2014,5,27]],"date-time":"2014-05-27T12:57:10Z","timestamp":1401195430000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Aggregation of Crowdsourced Labels Based on Worker History"],"prefix":"10.1145","author":[{"given":"Mihai","family":"Georgescu","sequence":"first","affiliation":[{"name":"L3S Research Center, Leibniz Universit\u00e4t Hannover, Appelstr. 9a, 30167 Hannover, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaofei","family":"Zhu","sequence":"additional","affiliation":[{"name":"L3S Research Center, Leibniz Universit\u00e4t Hannover, Appelstr. 9a, 30167 Hannover, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,6,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/978-3-642-20161-5_16","volume-title":"Advances in Information Retrieval: 33rd European Conference on IR Research, ECIR 2011","volume":"6611","author":"Alonso O.","unstructured":"O. Alonso and R. Baeza-Yates . Design and implementation of relevance assessments using crowdsourcing . In Advances in Information Retrieval: 33rd European Conference on IR Research, ECIR 2011 , volume 6611 , page 153 . Springer, 2011. O. Alonso and R. Baeza-Yates. Design and implementation of relevance assessments using crowdsourcing. In Advances in Information Retrieval: 33rd European Conference on IR Research, ECIR 2011, volume 6611, page 153. Springer, 2011."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187971"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/PST.2013.6596075"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.2307\/2346806"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187900"},{"key":"e_1_3_2_1_6_1","first-page":"1387","volume-title":"CrowdDB: Query Processing with the VLDB Crowd","author":"Feng A.","year":"2011","unstructured":"A. Feng , M. J. Franklin , D. Kossmann , T. Kraska , S. Madden , S. Ramesh , A. Wang , R. Xin , and R. Xin . CrowdDB: Query Processing with the VLDB Crowd . pages 1387 -- 1390 , 2011 . A. Feng, M. J. Franklin, D. Kossmann, T. Kraska, S. Madden, S. Ramesh, A. Wang, R. Xin, and R. Xin. CrowdDB: Query Processing with the VLDB Crowd. pages 1387--1390, 2011."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989331"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398554"},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop","author":"Georgescu M.","year":"2013","unstructured":"M. Georgescu and X. Zhu . L3S at MediaEval 2013 Crowdsourcing for Social Multimedia Task . In Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop , 2013 . M. Georgescu and X. Zhu. L3S at MediaEval 2013 Crowdsourcing for Social Multimedia Task. In Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop, 2013."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-28997-2_16"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837885.1837906"},{"key":"e_1_3_2_1_12_1","volume-title":"Human Computation","author":"Jung H. J.","year":"2011","unstructured":"H. J. Jung and M. Lease . Improving consensus accuracy via z-score and weighted voting . In Human Computation , 2011 . H. J. Jung and M. Lease. Improving consensus accuracy via z-score and weighted voting. In Human Computation, 2011."},{"key":"e_1_3_2_1_13_1","first-page":"101","volume-title":"Proceedings of the 4th Human Computation Workshop (HCOMP) at AAAI","author":"Jung H. J.","year":"2012","unstructured":"H. J. Jung and M. Lease . Improving quality of crowdsourced labels via probabilistic matrix factorization . In Proceedings of the 4th Human Computation Workshop (HCOMP) at AAAI , pages 101 -- 106 , 2012 . H. J. Jung and M. Lease. Improving quality of crowdsourced labels via probabilistic matrix factorization. In Proceedings of the 4th Human Computation Workshop (HCOMP) at AAAI, pages 101--106, 2012."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935896"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009947"},{"key":"e_1_3_2_1_16_1","volume-title":"Human Computation","author":"Lease M.","year":"2011","unstructured":"M. Lease . On quality control and machine learning in crowdsourcing . In Human Computation , 2011 . M. Lease. On quality control and machine learning in crowdsourcing. In Human Computation, 2011."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2557642.2563675"},{"key":"e_1_3_2_1_18_1","volume-title":"MediaEval 2013 Workshop","author":"Loni B.","year":"2013","unstructured":"B. Loni , M. Larson , A. Bozzon , and L. Gottlieb . Crowdsourcing for Social Multimedia at MediaEval 2013: Challenges, data set, and evaluation . In MediaEval 2013 Workshop , Barcelona, Spain , 2013 . B. Loni, M. Larson, A. Bozzon, and L. Gottlieb. Crowdsourcing for Social Multimedia at MediaEval 2013: Challenges, data set, and evaluation. In MediaEval 2013 Workshop, Barcelona, Spain, 2013."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483977.2483984"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/2047485.2047487"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1859894"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_3_2_1_23_1","first-page":"156","volume-title":"Proceedings of the 1st AAAI Conference on Human Computation (HCOMP)","author":"Sheshadri A.","year":"2013","unstructured":"A. Sheshadri and M. Lease . SQUARE: A Benchmark for Research on Computing Crowd Consensus . In Proceedings of the 1st AAAI Conference on Human Computation (HCOMP) , pages 156 -- 164 , 2013 . A. Sheshadri and M. Lease. SQUARE: A Benchmark for Research on Computing Crowd Consensus. In Proceedings of the 1st AAAI Conference on Human Computation (HCOMP), pages 156--164, 2013."},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop","author":"Sheshadri A.","year":"2013","unstructured":"A. Sheshadri and M. Lease . SQUARE: Benchmarking Crowd Consensus at MediaEval . In Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop , 2013 . A. Sheshadri and M. Lease. SQUARE: Benchmarking Crowd Consensus at MediaEval. In Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop, 2013."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"key":"e_1_3_2_1_26_1","volume-title":"SIGIR 2011 Workshop on Crowdsourcing for Information Retrieval (CIR)","author":"Tang W.","year":"2011","unstructured":"W. Tang and M. Lease . Semi-supervised consensus labeling for crowdsourcing . In SIGIR 2011 Workshop on Crowdsourcing for Information Retrieval (CIR) , 2011 . W. Tang and M. Lease. Semi-supervised consensus labeling for crowdsourcing. In SIGIR 2011 Workshop on Crowdsourcing for Information Retrieval (CIR), 2011."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187969"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.196"},{"key":"e_1_3_2_1_29_1","volume-title":"CIVR","author":"von Ahn L.","year":"2009","unstructured":"L. von Ahn . Human computation . In CIVR , 2009 . L. von Ahn. Human computation. In CIVR, 2009."},{"key":"e_1_3_2_1_30_1","first-page":"2424","volume-title":"NIPS","volume":"10","author":"Welinder P.","year":"2010","unstructured":"P. Welinder , S. Branson , S. Belongie , and P. Perona . The multidimensional wisdom of crowds . In NIPS , volume 10 , pages 2424 -- 2432 , 2010 . P. Welinder, S. Branson, S. Belongie, and P. Perona. The multidimensional wisdom of crowds. In NIPS, volume 10, pages 2424--2432, 2010."},{"key":"e_1_3_2_1_31_1","first-page":"2035","volume-title":"NIPS","volume":"22","author":"Whitehill J.","year":"2009","unstructured":"J. Whitehill , P. Ruvolo , T. Wu , J. Bergsma , and J. R. Movellan . Whose vote should count more: Optimal integration of labels from labelers of unknown expertise . In NIPS , volume 22 , pages 2035 -- 2043 , 2009 . J. Whitehill, P. Ruvolo, T. Wu, J. Bergsma, and J. R. Movellan. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In NIPS, volume 22, pages 2035--2043, 2009."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835526"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSE.2009.395"}],"event":{"name":"WIMS '14: 4th International Conference on Web Intelligence, Mining and Semantics","sponsor":["Aristotle University of Thessaloniki"],"location":"Thessaloniki Greece","acronym":"WIMS '14"},"container-title":["Proceedings of the 4th International Conference on Web Intelligence, Mining and Semantics (WIMS14)"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2611040.2611074","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2611040.2611074","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:55:48Z","timestamp":1750229748000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2611040.2611074"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,2]]},"references-count":33,"alternative-id":["10.1145\/2611040.2611074","10.1145\/2611040"],"URL":"https:\/\/doi.org\/10.1145\/2611040.2611074","relation":{},"subject":[],"published":{"date-parts":[[2014,6,2]]},"assertion":[{"value":"2014-06-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}