{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T11:03:39Z","timestamp":1763809419751,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":52,"publisher":"ACM","license":[{"start":{"date-parts":[[2015,5,27]],"date-time":"2015-05-27T00:00:00Z","timestamp":1432684800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EU-FP7 EINS project","award":["288021"],"award-info":[{"award-number":["288021"]}]},{"name":"ScienceWise SNSF Sinergia","award":["147609"],"award-info":[{"award-number":["147609"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,5,27]]},"DOI":"10.1145\/2723372.2723731","type":"proceedings-article","created":{"date-parts":[[2015,6,2]],"date-time":"2015-06-02T05:35:02Z","timestamp":1433223302000},"page":"999-1014","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["Minimizing Efforts in Validating Crowd Answers"],"prefix":"10.1145","author":[{"given":"Nguyen Quoc Viet","family":"Hung","sequence":"first","affiliation":[{"name":"EPFL, Lausanne, Switzerland"}]},{"given":"Duong Chi","family":"Thang","sequence":"additional","affiliation":[{"name":"EPFL, Lausanne, Switzerland"}]},{"given":"Matthias","family":"Weidlich","sequence":"additional","affiliation":[{"name":"Imperial College London, London, United Kingdom"}]},{"given":"Karl","family":"Aberer","sequence":"additional","affiliation":[{"name":"EPFL, Lausanne, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2015,5,27]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"https:\/\/code.google.com\/p\/crowdvalidator\/.  https:\/\/code.google.com\/p\/crowdvalidator\/."},{"key":"e_1_3_2_1_2_1","unstructured":"http:\/\/www.crowdflower.com\/.  http:\/\/www.crowdflower.com\/."},{"key":"e_1_3_2_1_3_1","unstructured":"http:\/\/www.mturk.com\/.  http:\/\/www.mturk.com\/."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465318"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807252"},{"key":"e_1_3_2_1_6_1","first-page":"712","volume-title":"EDBT","author":"Artikis A.","year":"2014","unstructured":"A. Artikis , M. Weidlich , F. Schnitzler , I. Boutsis , T. Liebig , N. Piatkowski , C. Bockermann , K. Morik , V. Kalogeraki , J. Marecek , Heterogeneous stream processing and crowdsourcing for urban traffic management . In EDBT , pages 712 -- 723 , 2014 . A. Artikis, M. Weidlich, F. Schnitzler, I. Boutsis, T. Liebig, N. Piatkowski, C. Bockermann, K. Morik, V. Kalogeraki, J. Marecek, et al. Heterogeneous stream processing and crowdsourcing for urban traffic management. In EDBT, pages 712--723, 2014."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/16894.16861"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/2350229.2350264"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.2307\/2346806"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187900"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1921054"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687691"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687620"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288367"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718504"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639714.1639785"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588576"},{"key":"e_1_3_2_1_18_1","volume-title":"Optimization and Machine Learning","author":"Goldberg D. E.","year":"1989","unstructured":"D. E. Goldberg . Genetic Algorithms in Search , Optimization and Machine Learning . Addison-Wesley Longman , 1989 . D. E. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman, 1989."},{"key":"e_1_3_2_1_19_1","first-page":"558","volume-title":"NIPS","author":"Gomes R. G.","year":"2011","unstructured":"R. G. Gomes , P. Welinder , A. Krause , and P. Perona . Crowdclustering . In NIPS , pages 558 -- 566 , 2011 . R. G. Gomes, P. Welinder, A. Krause, and P. Perona. Crowdclustering. In NIPS, pages 558--566, 2011."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06608-0_17"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468694"},{"key":"e_1_3_2_1_22_1","first-page":"1","volume-title":"WISE","author":"Hung N. Q. V.","year":"2013","unstructured":"N. Q. V. Hung , N. T. Tam , L. N. Tran , and K. Aberer . An evaluation of aggregation techniques in crowdsourcing . In WISE , pages 1 -- 15 , 2013 . N. Q. V. Hung, N. T. Tam, L. N. Tran, and K. Aberer. An evaluation of aggregation techniques in crowdsourcing. In WISE, pages 1--15, 2013."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837885.1837906"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376701"},{"key":"e_1_3_2_1_25_1","first-page":"101","volume-title":"HCOMP","author":"Jung H. J.","year":"2012","unstructured":"H. J. Jung and M. Lease . Improving quality of crowdsourced labels via probabilistic matrix factorization . In HCOMP , pages 101 -- 106 , 2012 . H. J. Jung and M. Lease. Improving quality of crowdsourced labels via probabilistic matrix factorization. In HCOMP, pages 101--106, 2012."},{"key":"e_1_3_2_1_26_1","first-page":"107","volume-title":"HCOMP","author":"Kajino H.","year":"2012","unstructured":"H. Kajino , Y. Tsuboi , I. Sato , and H. Kashima . Learning from crowds and experts . In HCOMP , pages 107 -- 113 , 2012 . H. Kajino, Y. Tsuboi, I. Sato, and H. Kashima. Learning from crowds and experts. In HCOMP, pages 107--113, 2012."},{"key":"e_1_3_2_1_27_1","first-page":"1953","volume-title":"NIPS","author":"Karger D. R.","year":"2011","unstructured":"D. R. Karger , S. Oh , and D. Shah . Iterative learning for reliable crowdsourcing systems . In NIPS , pages 1953 -- 1961 , 2011 . D. R. Karger, S. Oh, and D. Shah. Iterative learning for reliable crowdsourcing systems. In NIPS, pages 1953--1961, 2011."},{"key":"e_1_3_2_1_28_1","volume-title":"Metis-unstructured graph partitioning and sparse matrix ordering system, version 2.0","author":"Karypis G.","year":"1995","unstructured":"G. Karypis and V. Kumar . Metis-unstructured graph partitioning and sparse matrix ordering system, version 2.0 . 1995 . G. Karypis and V. Kumar. Metis-unstructured graph partitioning and sparse matrix ordering system, version 2.0. 1995."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063860"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.43.4.684"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988726"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772843"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/2336664.2336676"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816653"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031114.1031116"},{"key":"e_1_3_2_1_36_1","first-page":"1009","volume-title":"WWW","author":"Pasternack J.","year":"2013","unstructured":"J. Pasternack and D. Roth . Latent credibility analysis . In WWW , pages 1009 -- 1020 , 2013 . J. Pasternack and D. Roth. Latent credibility analysis. In WWW, pages 1009--1020, 2013."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979148"},{"key":"e_1_3_2_1_38_1","first-page":"1809","volume-title":"NIPS","author":"Raykar V. C.","year":"2011","unstructured":"V. C. Raykar and S. Yu . Ranking annotators for crowdsourced labeling tasks . In NIPS , pages 1809 -- 1817 , 2011 . V. C. Raykar and S. Yu. Ranking annotators for crowdsourced labeling tasks. In NIPS, pages 1809--1817, 2011."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139062367"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85820-3_23"},{"key":"e_1_3_2_1_42_1","volume-title":"Pearson Education","author":"Russell S. J.","year":"2003","unstructured":"S. J. Russell and P. Norvig . Artificial Intelligence: A Modern Approach . Pearson Education , 2003 . S. J. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Pearson Education, 2003."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/584091.584093"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733024"},{"key":"e_1_3_2_1_45_1","volume-title":"Societies and Nations","author":"Surowiecki J.","year":"2004","unstructured":"J. Surowiecki . The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies. Economies , Societies and Nations , 2004 . J. Surowiecki. The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies. Economies, Societies and Nations, 2004."},{"key":"e_1_3_2_1_46_1","volume-title":"Global wage report 2012--13","author":"TRAVAIL.","year":"2012","unstructured":"TRAVAIL. Global wage report 2012--13 . International Labour Organization (ILO) , 2012 . TRAVAIL. Global wage report 2012--13. International Labour Organization (ILO), 2012."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185677.2185737"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2010.5543189"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.14778\/1952376.1952378"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1814433.1814443"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536360.2536374"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/2168651.2168656"}],"event":{"name":"SIGMOD\/PODS'15: International Conference on Management of Data","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"],"location":"Melbourne Victoria Australia","acronym":"SIGMOD\/PODS'15"},"container-title":["Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2723372.2723731","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2723372.2723731","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:03:58Z","timestamp":1750273438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2723372.2723731"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,27]]},"references-count":52,"alternative-id":["10.1145\/2723372.2723731","10.1145\/2723372"],"URL":"https:\/\/doi.org\/10.1145\/2723372.2723731","relation":{},"subject":[],"published":{"date-parts":[[2015,5,27]]},"assertion":[{"value":"2015-05-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}