{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:49:40Z","timestamp":1750308580025,"version":"3.41.0"},"publisher-location":"New York, New York, USA","reference-count":13,"publisher":"ACM Press","license":[{"start":{"date-parts":[[2017,1,1]],"date-time":"2017-01-01T00:00:00Z","timestamp":1483228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["25240012"],"award-info":[{"award-number":["25240012"]}]},{"name":"JST CREST"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017]]},"DOI":"10.1145\/3041021.3051147","type":"proceedings-article","created":{"date-parts":[[2018,1,11]],"date-time":"2018-01-11T18:39:25Z","timestamp":1515695965000},"page":"1387-1393","source":"Crossref","is-referenced-by-count":1,"title":["Worker Viewpoints"],"prefix":"10.1145","author":[{"given":"Ryota","family":"Hayashi","sequence":"first","affiliation":[{"name":"University of Tsukuba, Tsukuba, Japan"}]},{"given":"Nobuyuki","family":"Shimizu","sequence":"additional","affiliation":[{"name":"Yahoo Japan Corporation, Chiyoda, Japan"}]},{"given":"Atsuyuki","family":"Morishima","sequence":"additional","affiliation":[{"name":"University of Tsukuba, Tsukuba, Japan"}]}],"member":"320","reference":[{"key":"key-10.1145\/3041021.3051147-1","unstructured":"S. J. andLakshminarayanan Subramanian andAshwin Venkataraman. Reputation-based worker filtering in crowdsourcing. In Advances in Neural Information Processing Systems 27:Annual Conferenceon Neural Information Processing Systems 2014, December 8-13 2014,Montreal, Quebec, Canada, pages 2492--2500, 2014."},{"key":"key-10.1145\/3041021.3051147-2","unstructured":"A. F. andPavel Kucherbaev andStefano Tranquillini and Gregorio Convertino. Keep it simple: reward and task design in crowdsourcing. In Biannual conference of the Italian chapter of SIGCHI, CHItaly '13,Trento, Italy - September 16-20, 2013, pages 14:1--14:4, 2013."},{"key":"key-10.1145\/3041021.3051147-3","doi-asserted-by":"crossref","unstructured":"R. Artstein and M. Poesio. Inter-coder agreement for computational linguistics. Comput. Linguist., 34(4):555--596, dec 2008.","DOI":"10.1162\/coli.07-034-R2"},{"key":"key-10.1145\/3041021.3051147-4","doi-asserted-by":"crossref","unstructured":"D. E. Difallah, G. Demartini, and P. Cudré-Mauroux. Pick-a-crowd: tell me what you like, and i'll tell youwhat to do. In 22nd International World Wide Web Conference, WWW'13, Rio de Janeiro, Brazil, May 13-17, 2013, pages 367--374, 2013.","DOI":"10.1145\/2488388.2488421"},{"key":"key-10.1145\/3041021.3051147-5","unstructured":"R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. Liblinear: A library for large linear classification. J. Mach. Learn. Res., 9:1871--1874, jun 2008."},{"key":"key-10.1145\/3041021.3051147-6","doi-asserted-by":"crossref","unstructured":"M. Gallé. The bag-of-repeats representation of documents. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '13, pages 1053--1056, New York, NY, USA, 2013. ACM.","DOI":"10.1145\/2484028.2484142"},{"key":"key-10.1145\/3041021.3051147-7","doi-asserted-by":"crossref","unstructured":"N. Q. V. Hung, N. T. Tam, N. T. Lam, and K. Aberer. An evaluation of aggregation techniques in crowdsourcing. In Web Information Systems Engineering - WISE 2013 -14th International Conference, Nanjing, China, October 13-15, 2013,Proceedings, Part II, pages 1--15, 2013.","DOI":"10.1007\/978-3-642-41154-0_1"},{"key":"key-10.1145\/3041021.3051147-8","doi-asserted-by":"crossref","unstructured":"C. D. Manning, P. Raghavan, and H. Schütze. Introduction to information retrieval. Cambridge University Press, 2008.","DOI":"10.1017\/CBO9780511809071"},{"key":"key-10.1145\/3041021.3051147-9","doi-asserted-by":"crossref","unstructured":"M. Melenhorst, M. Menéndez Blanco, and M. Larson. A crowdsourcing procedure for the discovery of non-obvious attributes of social images. In Proceedings of the 2014 International ACM Workshop on Crowdsourcing for Multimedia, CrowdMM '14, pages 45--48, New York, NY, USA, 2014. ACM.","DOI":"10.1145\/2660114.2660121"},{"key":"key-10.1145\/3041021.3051147-10","doi-asserted-by":"crossref","unstructured":"D. Okanohara and J. Tsujii. Text categorization with all substring features. In SIAM International Conference on Data Mining (SDM), pages 838--846, 2009.","DOI":"10.1137\/1.9781611972795.72"},{"key":"key-10.1145\/3041021.3051147-11","unstructured":"G. Tremper. Weakly supervised learning of presupposition relations between verbs. In Proceedings of the ACL 2010 Student Research Workshop, ACLstudent '10, pages 97--102, Stroudsburg, PA, USA, 2010. Association for Computational Linguistics."},{"key":"key-10.1145\/3041021.3051147-12","unstructured":"H. Weisman, J. Berant, I. Szpektor, and I. Dagan. Learning verb inference rules from linguistically-motivated evidence. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, EMNLP-CoNLL '12, pages 194--204, Stroudsburg, PA, USA, 2012. Association for Computational Linguistics."},{"key":"key-10.1145\/3041021.3051147-13","doi-asserted-by":"crossref","unstructured":"K. Wiemer-Hastings and P. Wiemer-Hastings. Dp: A detector for presuppositions in survey questions. In Proceedings of the Sixth Conference on Applied Natural Language Processing, ANLC '00, pages 90--96, Stroudsburg, PA, USA, 2000. Association for Computational Linguistics.","DOI":"10.3115\/974147.974160"}],"event":{"number":"26","sponsor":["SIGWEB, ACM Special Interest Group on Hypertext, Hypermedia, and Web","IW3C2, International World Wide Web Conference Committee"],"acronym":"WWW '17 Companion","name":"the 26th International Conference","start":{"date-parts":[[2017,4,3]]},"location":"Perth, Australia","end":{"date-parts":[[2017,4,7]]}},"container-title":["Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3041021.3051147","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/dl.acm.org\/ft_gateway.cfm?id=3051147&ftid=1865283&dwn=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:04:58Z","timestamp":1750273498000},"score":1,"resource":{"primary":{"URL":"http:\/\/dl.acm.org\/citation.cfm?doid=3041021.3051147"}},"subtitle":["Valuable Feedback for Microtask Designers in Crowdsourcing"],"proceedings-subject":"World Wide Web Companion","short-title":[],"issued":{"date-parts":[[2017]]},"references-count":13,"URL":"https:\/\/doi.org\/10.1145\/3041021.3051147","relation":{},"subject":[],"published":{"date-parts":[[2017]]}}}