{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:28:51Z","timestamp":1750307331824,"version":"3.41.0"},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2011,5,24]],"date-time":"2011-05-24T00:00:00Z","timestamp":1306195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2011,5,24]]},"abstract":"<jats:p>The Crowdsourcing for Search and Data Mining (CSDM 2011) workshop was held on February 9, 2011 in Hong Kong, China, in conjunction with the Fourth ACM International Conference onWeb Search and Data Mining (WSDM2011). The workshop addressed recent advances in theory and empirical methods, as well as novel applications, in crowdsourcing for search and data mining. Three invited talks were presented, along with eight refereed papers. Workshop proceedings and presentation slides can be found online.<\/jats:p>","DOI":"10.1145\/1988852.1988856","type":"journal-article","created":{"date-parts":[[2011,6,6]],"date-time":"2011-06-06T11:51:38Z","timestamp":1307361098000},"page":"18-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Crowdsourcing for search and data mining"],"prefix":"10.1145","volume":"45","author":[{"given":"Matthew","family":"Lease","sequence":"first","affiliation":[{"name":"University of Texas, Austin, TX"}]},{"given":"Vitor R.","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Intelius, Bellevue, WA"}]},{"given":"Emine","family":"Yilmaz","sequence":"additional","affiliation":[{"name":"Microsoft Research, Cambridge, UK"}]}],"member":"320","published-online":{"date-parts":[[2011,5,24]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"7","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Alonso O.","year":"2011","unstructured":"O. Alonso . Perspectives on Infrastructure for Crowdsourcing . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 7 -- 10 , 2011 . O. Alonso. Perspectives on Infrastructure for Crowdsourcing. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 7--10, 2011."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935831"},{"key":"e_1_2_1_3_1","first-page":"15","volume-title":"Proceedings of the SIGIR 2009 Workshop on the Future of IR Evaluation","author":"Alonso O.","year":"2009","unstructured":"O. Alonso and S. Mizzaro . Can we get rid of TREC assessors? Using Mechanical Turk for relevance assessment . In Proceedings of the SIGIR 2009 Workshop on the Future of IR Evaluation , pages 15 -- 16 , 2009 . O. Alonso and S. Mizzaro. Can we get rid of TREC assessors? Using Mechanical Turk for relevance assessment. In Proceedings of the SIGIR 2009 Workshop on the Future of IR Evaluation, pages 15--16, 2009."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148263"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148219"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1924475.1924481"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/275537.275544"},{"key":"e_1_2_1_8_1","first-page":"11","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Eickhoff C.","year":"2011","unstructured":"C. Eickhoff and A. de Vries . How Crowdsourcable is Your Task? In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 11 -- 14 , 2011 . C. Eickhoff and A. de Vries. How Crowdsourcable is Your Task? In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 11--14, 2011."},{"key":"e_1_2_1_9_1","first-page":"3","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Graepel T.","year":"2011","unstructured":"T. Graepel . The Smarter Crowd: Active Learning, Knowledge Corroboration, and Collective IQs . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 3 -- 4 , 2011 . T. Graepel. The Smarter Crowd: Active Learning, Knowledge Corroboration, and Collective IQs. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 3--4, 2011."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2009.36"},{"key":"e_1_2_1_11_1","first-page":"15","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Harris C.","year":"2011","unstructured":"C. Harris . Youre Hired! An Examination of Crowdsourcing Incentive Models in Human Resource Tasks . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 15 -- 18 , 2011 . C. Harris. Youre Hired! An Examination of Crowdsourcing Incentive Models in Human Resource Tasks. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 15--18, 2011."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1982624.1982625"},{"key":"e_1_2_1_13_1","first-page":"19","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Kumar A.","year":"2011","unstructured":"A. Kumar and M. Lease . Modeling Annotator Accuracies for Supervised Learning . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 19 -- 22 , 2011 . A. Kumar and M. Lease. Modeling Annotator Accuracies for Supervised Learning. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 19--22, 2011."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010","author":"Lease M.","year":"2010","unstructured":"M. Lease , V. Carvalho , and E. Yilmaz , editors . Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010 ). Geneva, Switzerland , July 2010 . Available online at http:\/\/ir.ischool.utexas.edu\/cse2010. M. Lease, V. Carvalho, and E. Yilmaz, editors. Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010). Geneva, Switzerland, July 2010. Available online at http:\/\/ir.ischool.utexas.edu\/cse2010."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000016"},{"key":"e_1_2_1_16_1","first-page":"5","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Mason W.","year":"2011","unstructured":"W. Mason . Individual vs. Group Success in Social Networks . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , page 5 , 2011 . W. Mason. Individual vs. Group Success in Social Networks. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), page 5, 2011."},{"key":"e_1_2_1_17_1","first-page":"23","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"McCreadie R.","year":"2011","unstructured":"R. McCreadie , C. Macdonald , and I. Ounis . Crowdsourcing Blog Track Top News Judgments at TREC . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 23 -- 26 , 2011 . R. McCreadie, C. Macdonald, and I. Ounis. Crowdsourcing Blog Track Top News Judgments at TREC. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 23--26, 2011."},{"key":"e_1_2_1_18_1","first-page":"31","volume-title":"Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010","author":"McCreadie R. M. C.","year":"2010","unstructured":"R. M. C. McCreadie , C. Macdonald , and I. Ounis . Crowdsourcing a news query classification dataset . In Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010 ), pages 31 -- 38 , Geneva, Switzerland , July 2010 . R. M. C. McCreadie, C. Macdonald, and I. Ounis. Crowdsourcing a news query classification dataset. In Proceedings of the ACM SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (CSE 2010), pages 31--38, Geneva, Switzerland, July 2010."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_2_1_21_1","first-page":"27","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining","author":"Vliegendhart R.","year":"2011","unstructured":"R. Vliegendhart , M. Larson , C. Kofler , C. Eickhoff , and J. Pouwelse . Investigating Factors Influencing Crowdsourcing Tasks with High Imaginative Load . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining , pages 27 -- 30 , 2011 . R. Vliegendhart, M. Larson, C. Kofler, C. Eickhoff, and J. Pouwelse. Investigating Factors Influencing Crowdsourcing Tasks with High Imaginative Load. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining, pages 27--30, 2011."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"},{"key":"e_1_2_1_23_1","first-page":"31","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Wang J.","year":"2011","unstructured":"J. Wang , S. Faridani , and P. Ipeirotis . Estimating Completion Time for Crowdsourced Tasks Using Survival Analysis Models . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 31 -- 34 , 2011 . J. Wang, S. Faridani, and P. Ipeirotis. Estimating Completion Time for Crowdsourced Tasks Using Survival Analysis Models. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 31--34, 2011."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1814433.1814443"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390437"},{"key":"e_1_2_1_26_1","first-page":"35","volume-title":"Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM)","author":"Zuccon G.","year":"2011","unstructured":"G. Zuccon , T. Leelanupab , S. Whiting , J. Jose , and L. Azzopardi . Crowdsourcing Interactions - A proposal for capturing user interactions through crowdsourcing . In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM) , pages 35 -- 38 , 2011 . G. Zuccon, T. Leelanupab, S. Whiting, J. Jose, and L. Azzopardi. Crowdsourcing Interactions - A proposal for capturing user interactions through crowdsourcing. In Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (CSDM) at the Fourth ACM International Conference on Web Search and Data Mining (WSDM), pages 35--38, 2011."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1988852.1988856","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1988852.1988856","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:06:08Z","timestamp":1750244768000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1988852.1988856"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,5,24]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2011,5,24]]}},"alternative-id":["10.1145\/1988852.1988856"],"URL":"https:\/\/doi.org\/10.1145\/1988852.1988856","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2011,5,24]]},"assertion":[{"value":"2011-05-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}