{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,30]],"date-time":"2025-11-30T22:33:19Z","timestamp":1764541999644,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T00:00:00Z","timestamp":1533600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1652537"],"award-info":[{"award-number":["1652537"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,8,7]]},"DOI":"10.1145\/3235765.3235796","type":"proceedings-article","created":{"date-parts":[[2018,9,13]],"date-time":"2018-09-13T12:54:52Z","timestamp":1536843292000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Comparing paid and volunteer recruitment in human computation games"],"prefix":"10.1145","author":[{"given":"Anurag","family":"Sarkar","sequence":"first","affiliation":[{"name":"Northeastern University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seth","family":"Cooper","sequence":"additional","affiliation":[{"name":"Northeastern University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,8,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 10th International Conference on the Foundations of Digital Games.","author":"Barone Jonathan","year":"2015","unstructured":"Jonathan Barone , Colin Bayer , Rowan Copley , Nova Barlow , Matthew Burns , Sundipta Rao , Georg Seelig , Zoran Popovi\u0107 , Seth Cooper , and Nanocrafter Players . 2015 . Nanocrafter: design and evaluation of a DNA nanotechnology game . In Proceedings of the 10th International Conference on the Foundations of Digital Games. Jonathan Barone, Colin Bayer, Rowan Copley, Nova Barlow, Matthew Burns, Sundipta Rao, Georg Seelig, Zoran Popovi\u0107, Seth Cooper, and Nanocrafter Players. 2015. Nanocrafter: design and evaluation of a DNA nanotechnology game. In Proceedings of the 10th International Conference on the Foundations of Digital Games."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0081-0"},{"key":"e_1_3_2_1_3_1","volume-title":"GDC Games User Research Summit","author":"Birk Max","year":"2016","unstructured":"Max Birk and Regan Mandryk . 2016. Crowdsourcing Player Experience Evaluation . In GDC Games User Research Summit 2016 . San Francisco, CA , USA. Max Birk and Regan Mandryk. 2016. Crowdsourcing Player Experience Evaluation. In GDC Games User Research Summit 2016. San Francisco, CA, USA."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116608"},{"volume-title":"Why Engagement Matters: Cross-Disciplinary Perspectives of User Engagement in Digital Media, Heather O'Brien and Paul Cairns (Eds.)","author":"Cairns Paul","key":"e_1_3_2_1_5_1","unstructured":"Paul Cairns . 2016. Engagement in digital games . In Why Engagement Matters: Cross-Disciplinary Perspectives of User Engagement in Digital Media, Heather O'Brien and Paul Cairns (Eds.) . Springer International Publishing , 81--104. Paul Cairns. 2016. Engagement in digital games. In Why Engagement Matters: Cross-Disciplinary Perspectives of User Engagement in Digital Media, Heather O'Brien and Paul Cairns (Eds.). Springer International Publishing, 81--104."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/108844.108874"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.03.003"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963662514554354"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature09304"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0057410"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C.","author":"Dean Drew","year":"2015","unstructured":"Drew Dean , Sean Gaurino , Leonard Eusebi , Andrew Keplinger , Tim Pavlik , Ronald Watro , Aaron Cammarata , John Murray , Kelly McLaughlin , John Cheng , and Thomas Maddern . 2015 . Lessons learned in game development for crowdsourced software formal verification . In Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C. Drew Dean, Sean Gaurino, Leonard Eusebi, Andrew Keplinger, Tim Pavlik, Ronald Watro, Aaron Cammarata, John Murray, Kelly McLaughlin, John Cheng, and Thomas Maddern. 2015. Lessons learned in game development for crowdsourced software formal verification. In Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of the Americas Conference on Information Systems.","author":"Kaufmann Nicolas","year":"2011","unstructured":"Nicolas Kaufmann , Thimo Schulze , and Daniel Veit . 2011 . More than fun and money. Worker motivation in crowdsourcing - a study on Mechanical Turk . In Proceedings of the Americas Conference on Information Systems. Nicolas Kaufmann, Thimo Schulze, and Daniel Veit. 2011. More than fun and money. Worker motivation in crowdsourcing - a study on Mechanical Turk. In Proceedings of the Americas Conference on Information Systems."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0031362"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858253"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature13240"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceddings of the Third AAAI Conference on Human Computation and Crowdsourcing.","author":"Krause Markus","year":"2015","unstructured":"Markus Krause and Ren\u00e9 Kizilcec . 2015 . To play or not to play: interactions between response quality and task complexity in games and paid crowdsourcing . In Proceddings of the Third AAAI Conference on Human Computation and Crowdsourcing. Markus Krause and Ren\u00e9 Kizilcec. 2015. To play or not to play: interactions between response quality and task complexity in games and paid crowdsourcing. In Proceddings of the Third AAAI Conference on Human Computation and Crowdsourcing."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702594"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 9th International Conference on the Foundations of Digital Games.","author":"Logas Heather","year":"2014","unstructured":"Heather Logas , Jim Whitehead , Michael Mateas , Richard Vallejos , Lauren Scott , Dan Shapiro , John Murray , Kate Compton , Joseph Osborn , Orlando Salvatore , Zhongpeng Lin , Huascar Sanchez , Michael Shavlovsky , Daniel Cetina , Shayne Clementi , and Chris Lewis . 2014 . Software verification games: designing Xylem, The Code of Plants . In Proceedings of the 9th International Conference on the Foundations of Digital Games. Heather Logas, Jim Whitehead, Michael Mateas, Richard Vallejos, Lauren Scott, Dan Shapiro, John Murray, Kate Compton, Joseph Osborn, Orlando Salvatore, Zhongpeng Lin, Huascar Sanchez, Michael Shavlovsky, Daniel Cetina, Shayne Clementi, and Chris Lewis. 2014. Software verification games: designing Xylem, The Code of Plants. In Proceedings of the 9th International Conference on the Foundations of Digital Games."},{"volume-title":"Proceedings of the First AAAI Conference on Human Computation and Crowdsourcing.","author":"Mao Andrew","key":"e_1_3_2_1_19_1","unstructured":"Andrew Mao , Ece Kamar , Yiling Chen , Eric Horvitz , Megan E. Schwamb , Chris J. Lintott , and Arfon M. Smith . 2013. Volunteering versus work for pay: incentives and tradeoffs in crowdsourcing . In Proceedings of the First AAAI Conference on Human Computation and Crowdsourcing. Andrew Mao, Ece Kamar, Yiling Chen, Eric Horvitz, Megan E. Schwamb, Chris J. Lintott, and Arfon M. Smith. 2013. Volunteering versus work for pay: incentives and tradeoffs in crowdsourcing. In Proceedings of the First AAAI Conference on Human Computation and Crowdsourcing."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0124-6"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1600150.1600175"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1476589.1476628"},{"key":"e_1_3_2_1_23_1","first-page":"5","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci Gabriele","year":"2010","unstructured":"Gabriele Paolacci , Jesse Chandler , and Panagiotis G. Ipeirotis . 2010 . Running experiments on Amazon Mechanical Turk . Judgment and Decision Making 5 , 5 (June 2010), 411--419. Gabriele Paolacci, Jesse Chandler, and Panagiotis G. Ipeirotis. 2010. Running experiments on Amazon Mechanical Turk. Judgment and Decision Making 5, 5 (June 2010), 411--419.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_24_1","unstructured":"PlaytestCloud. 2018. https:\/\/www.playtestcloud.com\/. (2018).  PlaytestCloud. 2018. https:\/\/www.playtestcloud.com\/. (2018)."},{"volume-title":"Understanding Motivation and Emotion","author":"Reeve Johnmarshall","key":"e_1_3_2_1_25_1","unstructured":"Johnmarshall Reeve . 2015. Understanding Motivation and Emotion ( Sixth edition). Wiley , Hoboken, New Jersey. Johnmarshall Reeve. 2015. Understanding Motivation and Emotion (Sixth edition). Wiley, Hoboken, New Jersey."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1020"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.55.1.68"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the 13th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.","author":"Sarkar Anurag","year":"2017","unstructured":"Anurag Sarkar and Seth Cooper . 2017 . Level difficulty and player skill prediction in human computation games . In Proceedings of the 13th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. Anurag Sarkar and Seth Cooper. 2017. Level difficulty and player skill prediction in human computation games. In Proceedings of the 13th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102071.3102093"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878114554176"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-010-0039-7"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 10th International Conference on the Foundations of Digital Games.","author":"Fritz Steffen","year":"2015","unstructured":"Tobias Sturn, Michael Wimmer, Carl Salk, Christoph Perger, Linda See, and Steffen Fritz . 2015 . Cropland Capture - a game for improving global cropland maps . In Proceedings of the 10th International Conference on the Foundations of Digital Games. Tobias Sturn, Michael Wimmer, Carl Salk, Christoph Perger, Linda See, and Steffen Fritz. 2015. Cropland Capture - a game for improving global cropland maps. In Proceedings of the 10th International Conference on the Foundations of Digital Games."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"},{"key":"e_1_3_2_1_34_1","volume-title":"Measuring engagement in video game-based environments: investigation of the user engagement scale. Computers in Human Behavior 32 (March","author":"Wiebe Eric N.","year":"2014","unstructured":"Eric N. Wiebe , Allison Lamb , Megan Hardy , and David Sharek . 2014. Measuring engagement in video game-based environments: investigation of the user engagement scale. Computers in Human Behavior 32 (March 2014 ), 123--132. Eric N. Wiebe, Allison Lamb, Megan Hardy, and David Sharek. 2014. Measuring engagement in video game-based environments: investigation of the user engagement scale. Computers in Human Behavior 32 (March 2014), 123--132."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66715-7_31"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"}],"event":{"name":"FDG '18: Foundations of Digital Games 2018","acronym":"FDG '18","location":"Malm\u00f6 Sweden"},"container-title":["Proceedings of the 13th International Conference on the Foundations of Digital Games"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3235765.3235796","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3235765.3235796","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3235765.3235796","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:22Z","timestamp":1750282882000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3235765.3235796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,7]]},"references-count":36,"alternative-id":["10.1145\/3235765.3235796","10.1145\/3235765"],"URL":"https:\/\/doi.org\/10.1145\/3235765.3235796","relation":{},"subject":[],"published":{"date-parts":[[2018,8,7]]},"assertion":[{"value":"2018-08-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}