{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,11]],"date-time":"2026-10-11T10:49:56Z","timestamp":1791715796231,"version":"4.3.4"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,2,2]],"date-time":"2018-02-02T00:00:00Z","timestamp":1517529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,2,2]]},"DOI":"10.1145\/3159652.3159661","type":"proceedings-article","created":{"date-parts":[[2018,2,6]],"date-time":"2018-02-06T18:12:23Z","timestamp":1517940743000},"page":"135-143","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":357,"title":["Demographics and Dynamics of Mechanical Turk Workers"],"prefix":"10.1145","author":[{"given":"Djellel","family":"Difallah","sequence":"first","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"Filatova","sequence":"additional","affiliation":[{"name":"New York University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Panos","family":"Ipeirotis","sequence":"additional","affiliation":[{"name":"New York University, New York City, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,2,2]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Manly","author":"Amstrup Steven C.","year":"2010","unstructured":"Steven C. Amstrup , Trent L. McDonald , and Bryan F. J . Manly . 2010 . Handbook of Capture-Recapture Analysis. Princeton University Press , Princeton, NJ. Steven C. Amstrup, Trent L. McDonald, and Bryan F. J. Manly. 2010. Handbook of Capture-Recapture Analysis. Princeton University Press, Princeton, NJ."},{"key":"e_1_3_2_1_2_1","volume-title":"Carr","author":"Arch Joanna J.","year":"2016","unstructured":"Joanna J. Arch and Alaina L . Carr . 2016 . Using Mechanical Turk for research on cancer survivors. Psycho-Oncology Forthcoming (2016), --. PON- 15-0731.R1. Joanna J. Arch and Alaina L. Carr. 2016. Using Mechanical Turk for research on cancer survivors. Psycho-Oncology Forthcoming (2016), --. PON-15-0731.R1."},{"key":"e_1_3_2_1_3_1","volume-title":"Conducting interactive experiments online. Experimental Economics Forthcoming (09","author":"Arechar Antonio A.","year":"2017","unstructured":"Antonio A. Arechar , Simon G\u00e4chter , and Lucas Molleman . 2017. Conducting interactive experiments online. Experimental Economics Forthcoming (09 May 2017 ), 1--33. Antonio A. Arechar, Simon G\u00e4chter, and Lucas Molleman. 2017. Conducting interactive experiments online. Experimental Economics Forthcoming (09 May 2017), 1--33."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/65.3.625"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1866696.1866697"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2013.05.009"},{"key":"e_1_3_2_1_7_1","volume-title":"Handbook of Human Computation","author":"Chandler Jesse","unstructured":"Jesse Chandler , Gabriele Paolacci , and Pam Mueller . 2013. Risks and Rewards of Crowdsourcing Marketplaces . In Handbook of Human Computation . Springer , New York , 377--392. Jesse Chandler, Gabriele Paolacci, and Pam Mueller. 2013. Risks and Rewards of Crowdsourcing Marketplaces. In Handbook of Human Computation. Springer, New York, 377--392."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-021815-093623"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.2307\/2531532"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/51.3-4.429"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v034.i02"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajpy.12110"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.promfg.2015.07.514"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741685"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00057"},{"key":"e_1_3_2_1_16_1","volume-title":"Are all research fields equal? Rethinking practice for the use of data from crowd-sourcing market places. Behavior Research Methods 49 (August","author":"Gleibs Ilka H.","year":"2017","unstructured":"Ilka H. Gleibs . 2017. Are all research fields equal? Rethinking practice for the use of data from crowd-sourcing market places. Behavior Research Methods 49 (August 2017 ), 1333--1342. Issue 4. Ilka H. Gleibs. 2017. Are all research fields equal? Rethinking practice for the use of data from crowd-sourcing market places. Behavior Research Methods 49 (August 2017), 1333--1342. Issue 4."},{"key":"e_1_3_2_1_17_1","volume-title":"Demographics of Mechanical Turk","author":"Ipeirotis Panagiotis","unstructured":"Panagiotis Ipeirotis . 2010. Demographics of Mechanical Turk . Technical Report CeDER-10-01. New York University . Panagiotis Ipeirotis. 2010. Demographics of Mechanical Turk. Technical Report CeDER-10-01. New York University."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/52.1-2.225"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/00913367.2016.1269304"},{"key":"e_1_3_2_1_20_1","volume-title":"Calculating waterfowl abundance on the basis of banding returns. US Dept. of Agriculture","author":"Lincoln Frederick Charles","unstructured":"Frederick Charles Lincoln . 1930. Calculating waterfowl abundance on the basis of banding returns. US Dept. of Agriculture , Washington, DC . Frederick Charles Lincoln. 1930. Calculating waterfowl abundance on the basis of banding returns. US Dept. of Agriculture, Washington, DC."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9107-y"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1600150.1600175"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/per0000191"},{"key":"e_1_3_2_1_24_1","first-page":"4","article-title":"Open CaptureRecapture Models with Heterogeneity","volume":"59","author":"Pledger Shirley","year":"2003","unstructured":"Shirley Pledger , Kenneth H. Pollock , and James L. Norris . 2003 . Open CaptureRecapture Models with Heterogeneity : I. Cormack-Jolly-Seber Model. Biometrics 59 , 4 (Dec. 2003), 786--794. Shirley Pledger, Kenneth H. Pollock, and James L. Norris. 2003. Open CaptureRecapture Models with Heterogeneity: I. Cormack-Jolly-Seber Model. Biometrics 59, 4 (Dec. 2003), 786--794.","journal-title":"I. Cormack-Jolly-Seber Model. Biometrics"},{"key":"e_1_3_2_1_25_1","first-page":"3","article-title":"Open CaptureRecapture Models with Heterogeneity","volume":"66","author":"Pledger Shirley","year":"2010","unstructured":"Shirley Pledger , Kenneth H. Pollock , and James L. Norris . 2010 . Open CaptureRecapture Models with Heterogeneity : II. Jolly-Seber Model. Biometrics 66 , 3 (September 2010), 883--890. Shirley Pledger, Kenneth H. Pollock, and James L. Norris. 2010. Open CaptureRecapture Models with Heterogeneity: II. Jolly-Seber Model. Biometrics 66, 3 (September 2010), 883--890.","journal-title":"II. Jolly-Seber Model. Biometrics"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.2307\/2533048"},{"key":"e_1_3_2_1_28_1","volume-title":"The Estimation of Animal Abundance and Related Parameters. Charles Griffin","author":"Seber George","unstructured":"George Seber . 1982. The Estimation of Animal Abundance and Related Parameters. Charles Griffin , London, UK . George Seber. 1982. The Estimation of Animal Abundance and Related Parameters. Charles Griffin, London, UK."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/52.1-2.249"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_3_2_1_31_1","volume-title":"A better lemon squeezer? Maximumlikelihood regression with beta-distributed dependent variables. Psychological methods 11","author":"Smithson Michael","year":"2006","unstructured":"Michael Smithson and Jay Verkuilen . 2006. A better lemon squeezer? Maximumlikelihood regression with beta-distributed dependent variables. Psychological methods 11 ( 2006 ), 54--71. Issue 1. Michael Smithson and Jay Verkuilen. 2006. A better lemon squeezer? Maximumlikelihood regression with beta-distributed dependent variables. Psychological methods 11 (2006), 54--71. Issue 1."},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '08)","author":"Snow Rion","unstructured":"Rion Snow , Brendan O'Connor , Daniel Jurafsky , and Andrew Y. Ng . 2008. Cheap and Fast-but is It Good?: Evaluating Non-expert Annotations for Natural Language Tasks . In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '08) . Association for Computational Linguistics, Stroudsburg, PA, USA, 254--263. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Y. Ng. 2008. Cheap and Fast-but is It Good?: Evaluating Non-expert Annotations for Natural Language Tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '08). Association for Computational Linguistics, Stroudsburg, PA, USA, 254--263."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2016.00610"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1017\/S1930297500005611","article-title":"The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers","volume":"10","author":"Stewart Neil","year":"2015","unstructured":"Neil Stewart , Christoph Ungemach , Adam J. L. Harris , Daniel M. Bartels , Ben R. Newell , Gabriele Paolaccik , and Jesse Chandler . 2015 . The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers . Judgment and Decision Making 10 , 5 (2015), 479 -- 491 . Neil Stewart, Christoph Ungemach, Adam J. L. Harris, Daniel M. Bartels, Ben R. Newell, Gabriele Paolaccik, and Jesse Chandler. 2015. The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making 10, 5 (2015), 479--491.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1017\/S1930297500007622","article-title":"Investigating an alternate form of the cognitive reflection test","volume":"11","author":"Thomson Keela S.","year":"2016","unstructured":"Keela S. Thomson and Daniel M. Oppenheimer . 2016 . Investigating an alternate form of the cognitive reflection test . Judgment and Decision Making 11 , 1 (2016), 99 -- 113 . Keela S. Thomson and Daniel M. Oppenheimer. 2016. Investigating an alternate form of the cognitive reflection test. Judgment and Decision Making 11, 1 (2016), 99--113.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2845644"}],"event":{"name":"WSDM 2018: The Eleventh ACM International Conference on Web Search and Data Mining","location":"Marina Del Rey CA USA","acronym":"WSDM 2018","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3159652.3159661","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3159652.3159661","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:11Z","timestamp":1750213571000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3159652.3159661"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,2]]},"references-count":36,"alternative-id":["10.1145\/3159652.3159661","10.1145\/3159652"],"URL":"https:\/\/doi.org\/10.1145\/3159652.3159661","relation":{},"subject":[],"published":{"date-parts":[[2018,2,2]]},"assertion":[{"value":"2018-02-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}