{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:41:01Z","timestamp":1780054861231,"version":"3.54.0"},"publisher-location":"New York, NY, USA","reference-count":21,"publisher":"ACM","license":[{"start":{"date-parts":[[2016,5,14]],"date-time":"2016-05-14T00:00:00Z","timestamp":1463184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2016,5,14]]},"DOI":"10.1145\/2897659.2897662","type":"proceedings-article","created":{"date-parts":[[2016,5,17]],"date-time":"2016-05-17T18:19:17Z","timestamp":1463509157000},"page":"8-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Exploring crowd consistency in a mechanical turk survey"],"prefix":"10.1145","author":[{"given":"Peng","family":"Sun","sequence":"first","affiliation":[{"name":"North Carolina State University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn T.","family":"Stolee","sequence":"additional","affiliation":[{"name":"North Carolina State University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,5,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676726.2676973"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2013.44"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753688"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499149.2499168"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338965.2336775"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2010.5609691"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.04.004"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2442576.2442591"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647349"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809422"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494603.2480303"},{"issue":"5","key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on amazon mechanical turk","volume":"5","author":"Paolacci G.","year":"2010","unstructured":"G. Paolacci , J. Chandler , and P. G. Ipeirotis . Running experiments on amazon mechanical turk . Judgment and Decision making , 5 ( 5 ): 411 -- 419 , 2010 . G. Paolacci, J. Chandler, and P. G. Ipeirotis. Running experiments on amazon mechanical turk. Judgment and Decision making, 5(5):411--419, 2010.","journal-title":"Judgment and Decision making"},{"key":"e_1_3_2_1_14_1","volume-title":"ICWSM","author":"Rogstadius J.","year":"2011","unstructured":"J. Rogstadius , V. Kostakos , A. Kittur , B. Smus , J. Laredo , and M. Vukovic . An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets . In ICWSM , 2011 . J. Rogstadius, V. Kostakos, A. Kittur, B. Smus, J. Laredo, and M. Vukovic. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. In ICWSM, 2011."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2398857.2384624"},{"issue":"5","key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1017\/S1930297500005611","article-title":"The average laboratory samples a population of 7,300 amazon mechanical turk workers","volume":"10","author":"Stewart N.","year":"2015","unstructured":"N. Stewart , C. Ungemach , A. J. Harris , D. M. Bartels , B. R. Newell , G. Paolacci , J. Chandler , The average laboratory samples a population of 7,300 amazon mechanical turk workers . Judgment and Decision Making , 10 ( 5 ): 479 -- 491 , 2015 . N. Stewart, C. Ungemach, A. J. Harris, D. M. Bartels, B. R. Newell, G. Paolacci, J. Chandler, et al. The average laboratory samples a population of 7,300 amazon mechanical turk workers. Judgment and Decision Making, 10(5):479--491, 2015.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1852786.1852832"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985805"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2581377"},{"key":"e_1_3_2_1_21_1","volume-title":"Second AAAI Conference on Human Computation and Crowdsourcing","author":"Yin M.","year":"2014","unstructured":"M. Yin , Y. Chen , and Y.-A. Sun . Monetary interventions in crowdsourcing task switching . In Second AAAI Conference on Human Computation and Crowdsourcing , 2014 . M. Yin, Y. Chen, and Y.-A. Sun. Monetary interventions in crowdsourcing task switching. In Second AAAI Conference on Human Computation and Crowdsourcing, 2014."}],"event":{"name":"ICSE '16: 38th International Conference on Software Engineering","location":"Austin Texas","acronym":"ICSE '16","sponsor":["ACM Association for Computing Machinery","SIGSOFT ACM Special Interest Group on Software Engineering","IEEE-CS\\DATC IEEE Computer Society","TCSE IEEE Computer Society's Tech. Council on Software Engin."]},"container-title":["Proceedings of the 3rd International Workshop on CrowdSourcing in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897659.2897662","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897659.2897662","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:55:58Z","timestamp":1750222558000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897659.2897662"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,14]]},"references-count":21,"alternative-id":["10.1145\/2897659.2897662","10.1145\/2897659"],"URL":"https:\/\/doi.org\/10.1145\/2897659.2897662","relation":{},"subject":[],"published":{"date-parts":[[2016,5,14]]},"assertion":[{"value":"2016-05-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}