{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T15:57:47Z","timestamp":1762444667684,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":9,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,2,25]],"date-time":"2017-02-25T00:00:00Z","timestamp":1487980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,2,25]]},"DOI":"10.1145\/3022198.3023267","type":"proceedings-article","created":{"date-parts":[[2017,2,16]],"date-time":"2017-02-16T15:18:54Z","timestamp":1487258334000},"page":"25-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["LabintheWild"],"prefix":"10.1145","author":[{"given":"Nigini","family":"Oliveira","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eunice","family":"Jun","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trevor","family":"Croxson","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof Z.","family":"Gajos","sequence":"additional","affiliation":[{"name":"Harvard University, Cambridge, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katharina","family":"Reinecke","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,2,25]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"A theory of social comparison processes. Human relations 7(2)","author":"Festinger L","year":"1954","unstructured":"L Festinger . 1954. A theory of social comparison processes. Human relations 7(2) ( 1954 ), 117--140. L Festinger. 1954. A theory of social comparison processes. Human relations 7(2) (1954), 117--140."},{"key":"e_1_3_2_1_2_1","volume-title":"Is the Web as good as the lab? Comparable performance from Web and lab in cognitive\/perceptual experiments. Psychonomic bulletin & review 19, 5","author":"Germine Laura","year":"2012","unstructured":"Laura Germine , Ken Nakayama , Bradley C Duchaine , Christopher F Chabris , Garga Chatterjee , and Jeremy B Wilmer . 2012. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive\/perceptual experiments. Psychonomic bulletin & review 19, 5 ( 2012 ), 847--857. Laura Germine, Ken Nakayama, Bradley C Duchaine, Christopher F Chabris, Garga Chatterjee, and Jeremy B Wilmer. 2012. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive\/perceptual experiments. Psychonomic bulletin & review 19, 5 (2012), 847--857."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.1753"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.59.2.93"},{"key":"e_1_3_2_1_5_1","volume-title":"When does cognitive functioning peak? The asynchronous rise and fall of different cognitive abilities across the life span. Psychological science","author":"Hartshorne Joshua K","year":"2015","unstructured":"Joshua K Hartshorne and Laura T Germine . 2015. When does cognitive functioning peak? The asynchronous rise and fall of different cognitive abilities across the life span. Psychological science ( 2015 ), 0956797614567339. Joshua K Hartshorne and Laura T Germine. 2015. When does cognitive functioning peak? The asynchronous rise and fall of different cognitive abilities across the life span. Psychological science (2015), 0956797614567339."},{"key":"e_1_3_2_1_6_1","volume-title":"Conducting behavioral research on Amazon's Mechanical Turk. Behavior research methods 44, 1","author":"Mason Winter","year":"2012","unstructured":"Winter Mason and Siddharth Suri . 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior research methods 44, 1 ( 2012 ), 1--23. Winter Mason and Siddharth Suri. 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior research methods 44, 1 (2012), 1--23."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675246"},{"volume-title":"Chen. In Proceedings of the ACM 2011 conference on Computer supported cooperative work","author":"Shaw Aaron D.","key":"e_1_3_2_1_8_1","unstructured":"Aaron D. Shaw , John J. Horton , and Daniel L . Chen. In Proceedings of the ACM 2011 conference on Computer supported cooperative work . New York, NY, USA. Aaron D. Shaw, John J. Horton, and Daniel L. Chen. In Proceedings of the ACM 2011 conference on Computer supported cooperative work. New York, NY, USA."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1017\/S1930297500005611","article-title":"The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers","volume":"10","author":"Stewart Neil","year":"2015","unstructured":"Neil Stewart , Christoph Ungemach , Adam JL Harris , Daniel M Bartels , Ben R Newell , Gabriele Paolacci , and Jesse Chandler . 2015 . The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers . Judgment and Decision Making 10 , 5 (2015), 479 . Neil Stewart, Christoph Ungemach, Adam JL Harris, Daniel M Bartels, Ben R Newell, Gabriele Paolacci, and Jesse Chandler. 2015. The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making 10, 5 (2015), 479.","journal-title":"Judgment and Decision Making"}],"event":{"name":"CSCW '17: Computer Supported Cooperative Work and Social Computing","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Portland Oregon USA","acronym":"CSCW '17"},"container-title":["Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3022198.3023267","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3022198.3023267","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:54Z","timestamp":1750220634000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3022198.3023267"}},"subtitle":["How to Design Uncompensated, Feedback-driven Online Experiments"],"short-title":[],"issued":{"date-parts":[[2017,2,25]]},"references-count":9,"alternative-id":["10.1145\/3022198.3023267","10.1145\/3022198"],"URL":"https:\/\/doi.org\/10.1145\/3022198.3023267","relation":{},"subject":[],"published":{"date-parts":[[2017,2,25]]},"assertion":[{"value":"2017-02-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}