{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T23:20:31Z","timestamp":1776122431492,"version":"3.50.1"},"publisher-location":"Republic and Canton of Geneva, Switzerland","reference-count":28,"publisher":"International World Wide Web Conferences Steering Committee","license":[{"start":{"date-parts":[[2015,5,18]],"date-time":"2015-05-18T00:00:00Z","timestamp":1431907200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,5,18]]},"DOI":"10.1145\/2736277.2741681","type":"proceedings-article","created":{"date-parts":[[2016,2,5]],"date-time":"2016-02-05T20:37:12Z","timestamp":1454704632000},"page":"592-602","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Getting More for Less"],"prefix":"10.1145","author":[{"given":"Ari","family":"Kobren","sequence":"first","affiliation":[{"name":"UMass Amherst, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chun How","family":"Tan","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiotis","family":"Ipeirotis","sequence":"additional","affiliation":[{"name":"NYU, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evgeniy","family":"Gabrilovich","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,5,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/11577935_1"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488398"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i2.19016"},{"key":"e_1_3_2_1_4_1","first-page":"1183","volume-title":"Proceedings of the 29th International Conference on Machine Learning (ICML-12)","author":"Bachrach Y.","year":"2012","unstructured":"Y. Bachrach , T. Graepel , T. Minka , and J. Guiver . How to grade a test without knowing the answers|a bayesian graphical model for adaptive crowdsourcing and aptitude testing . In Proceedings of the 29th International Conference on Machine Learning (ICML-12) , pages 1183 -- 1190 , 2012 . Y. Bachrach, T. Graepel, T. Minka, and J. Guiver. How to grade a test without knowing the answers|a bayesian graphical model for adaptive crowdsourcing and aptitude testing. In Proceedings of the 29th International Conference on Machine Learning (ICML-12), pages 1183--1190, 2012."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124928"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2013.06.002"},{"key":"e_1_3_2_1_7_1","first-page":"20","volume-title":"Maximum likelihood estimation of observer error-rates using the em algorithm. Applied statistics","author":"Dawid A. P.","year":"1979","unstructured":"A. P. Dawid and A. M. Skene . Maximum likelihood estimation of observer error-rates using the em algorithm. Applied statistics , pages 20 -- 28 , 1979 . A. P. Dawid and A. M. Skene. Maximum likelihood estimation of observer error-rates using the em algorithm. Applied statistics, pages 20--28, 1979."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492002.2482571"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/643477.643478"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2567988"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518927"},{"key":"e_1_3_2_1_12_1","first-page":"53","volume-title":"KI-97: Advances in artificial intelligence","author":"Langley P.","year":"1997","unstructured":"P. Langley . Machine learning for adaptive user interfaces . In KI-97: Advances in artificial intelligence , pages 53 -- 62 . Springer , 1997 . P. Langley. Machine learning for adaptive user interfaces. In KI-97: Advances in artificial intelligence, pages 53--62. Springer, 1997."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31454-4_14"},{"key":"e_1_3_2_1_14_1","volume-title":"S.-Kang, U.--Jeon, E.--Linacre, JM (eds.): Development of Computerised Middle School Achievement Tests, MESA Research Memorandum, (69)","author":"Linacre J. M.","year":"2000","unstructured":"J. M. Linacre Computer-adaptive testing: A methodology whose time has come. Chae , S.-Kang, U.--Jeon, E.--Linacre, JM (eds.): Development of Computerised Middle School Achievement Tests, MESA Research Memorandum, (69) , 2000 . J. M. Linacre et al. Computer-adaptive testing: A methodology whose time has come. Chae, S.-Kang, U.--Jeon, E.--Linacre, JM (eds.): Development of Computerised Middle School Achievement Tests, MESA Research Memorandum, (69), 2000."},{"key":"e_1_3_2_1_15_1","volume-title":"First AAAI Conference on Human Computation and Crowdsourcing","author":"Mao A.","year":"2013","unstructured":"A. Mao , E. Kamar , and E. Horvitz . Why stop now? predicting worker engagement in online crowdsourcing . In First AAAI Conference on Human Computation and Crowdsourcing , 2013 . A. Mao, E. Kamar, and E. Horvitz. Why stop now? predicting worker engagement in online crowdsourcing. In First AAAI Conference on Human Computation and Crowdsourcing, 2013."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809422"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPA.2008.63"},{"key":"e_1_3_2_1_18_1","first-page":"1177","volume-title":"Advances in neural information processing systems","author":"Neumann G.","year":"2009","unstructured":"G. Neumann and J. R. Peters . Fitted q-iteration by advantage weighted regression . In Advances in neural information processing systems , pages 1177 -- 1184 , 2009 . G. Neumann and J. R. Peters. Fitted q-iteration by advantage weighted regression. In Advances in neural information processing systems, pages 1177--1184, 2009."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_20_1","volume-title":"Markov decision processes: discrete stochastic dynamic programming","author":"Puterman M. L.","year":"2009","unstructured":"M. L. Puterman . Markov decision processes: discrete stochastic dynamic programming , volume 414 . John Wiley & Sons , 2009 . M. L. Puterman. Markov decision processes: discrete stochastic dynamic programming, volume 414. John Wiley & Sons, 2009."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1859894"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1520340.1520597"},{"key":"e_1_3_2_1_23_1","volume-title":"First AAAI Conference on Human Computation and Crowdsourcing","author":"Rzeszotarski J. M.","year":"2013","unstructured":"J. M. Rzeszotarski , E. Chi , P. Paritosh , and P. Dai . Inserting micro-breaks into crowdsourcing work flows . In First AAAI Conference on Human Computation and Crowdsourcing , 2013 . J. M. Rzeszotarski, E. Chi, P. Paritosh, and P. Dai. Inserting micro-breaks into crowdsourcing work flows. In First AAAI Conference on Human Computation and Crowdsourcing, 2013."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2449396.2449398"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1160379"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441846"},{"key":"e_1_3_2_1_27_1","first-page":"2035","volume-title":"Advances in neural information processing systems","author":"Whitehill J.","year":"2009","unstructured":"J. Whitehill , T.-f. Wu , J. Bergsma , J. R. Movellan , and P. L. Ruvolo . Whose vote should count more: Optimal integration of labels from labelers of unknown expertise . In Advances in neural information processing systems , pages 2035 -- 2043 , 2009 . J. Whitehill, T.-f. Wu, J. Bergsma, J. R. Movellan, and P. L. Ruvolo. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In Advances in neural information processing systems, pages 2035--2043, 2009."},{"issue":"1","key":"e_1_3_2_1_28_1","first-page":"1","article-title":"Probability plotting methods for the analysis for the analysis of data","volume":"55","author":"Wilk M. B.","year":"1968","unstructured":"M. B. Wilk and R. Gnanadesikan . Probability plotting methods for the analysis for the analysis of data . Biometrika , 55 ( 1 ): 1 -- 17 , 1968 . M. B. Wilk and R. Gnanadesikan. Probability plotting methods for the analysis for the analysis of data. Biometrika, 55(1):1--17, 1968.","journal-title":"Biometrika"}],"event":{"name":"WWW '15: 24th International World Wide Web Conference","location":"Florence Italy","acronym":"WWW '15","sponsor":["IW3C2 International World Wide Web Conference Committee","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the 24th International Conference on World Wide Web"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2736277.2741681","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2736277.2741681","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:12:30Z","timestamp":1750227150000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2736277.2741681"}},"subtitle":["Optimized Crowdsourcing with Dynamic Tasks and Goals"],"short-title":[],"issued":{"date-parts":[[2015,5,18]]},"references-count":28,"alternative-id":["10.1145\/2736277.2741681","10.5555\/2736277"],"URL":"https:\/\/doi.org\/10.1145\/2736277.2741681","relation":{},"subject":[],"published":{"date-parts":[[2015,5,18]]},"assertion":[{"value":"2015-05-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}