{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T08:09:31Z","timestamp":1767773371589,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,8,14]],"date-time":"2017-08-14T00:00:00Z","timestamp":1502668800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/M023265\/1"],"award-info":[{"award-number":["EP\/M023265\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1652537"],"award-info":[{"award-number":["1652537"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,8,14]]},"DOI":"10.1145\/3102071.3102093","type":"proceedings-article","created":{"date-parts":[[2017,8,29]],"date-time":"2017-08-29T17:54:31Z","timestamp":1504029271000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Engagement effects of player rating system-based matchmaking for level ordering in human computation games"],"prefix":"10.1145","author":[{"given":"Anurag","family":"Sarkar","sequence":"first","affiliation":[{"name":"Northeastern University"}]},{"given":"Michael","family":"Williams","sequence":"additional","affiliation":[{"name":"Northeastern University"}]},{"given":"Sebastian","family":"Deterding","sequence":"additional","affiliation":[{"name":"University of York"}]},{"given":"Seth","family":"Cooper","sequence":"additional","affiliation":[{"name":"Northeastern University"}]}],"member":"320","published-online":{"date-parts":[[2017,8,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcom.2012.09.001"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceeding of the 15th International Conference of the ACIA. 173--184","author":"Anstegui Carlos","year":"2012","unstructured":"Carlos Anstegui , Mara Luisa Bonet , Jordi Levy , and Chu Min Li . 2012 . Analysis and generation of pseudo-industrial MaxSAT instances . In Proceeding of the 15th International Conference of the ACIA. 173--184 . Carlos Anstegui, Mara Luisa Bonet, Jordi Levy, and Chu Min Li. 2012. Analysis and generation of pseudo-industrial MaxSAT instances. In Proceeding of the 15th International Conference of the ACIA. 173--184."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/IGIC.2013.6659150"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2010.16713.x"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.2307\/2334029"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702330"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-27446-1_4"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2658537.2658701"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.03.003"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 11th Annual Interactive Multimedia Systems Conference.","author":"Jordan Chang David Michael","year":"2013","unstructured":"David Michael Jordan Chang . 2013 . Dynamic difficulty adjustment in computer games . In Proceedings of the 11th Annual Interactive Multimedia Systems Conference. David Michael Jordan Chang. 2013. Dynamic difficulty adjustment in computer games. In Proceedings of the 11th Annual Interactive Multimedia Systems Conference."},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the 1st International Joint Conference of DiGRA and FDG.","author":"Compton Kate","year":"2016","unstructured":"Kate Compton , Heather Logas , Joseph C. Osborn , Chandranil Chakrabortti , Kelsey Coffman , Daniel Fava , Dylan Lederle-Ensign , Zhongpeng Lin , Jo Mazeika , Afshin Mobramaein , Johnathan Pagnutti , Husacar Sanchez , Jim Whitehead , and Brenda Laurel . 2016 . Design lessons fromBinary Fission: a crowd sourced game for precondition discovery . In Proceedings of the 1st International Joint Conference of DiGRA and FDG. Kate Compton, Heather Logas, Joseph C. Osborn, Chandranil Chakrabortti, Kelsey Coffman, Daniel Fava, Dylan Lederle-Ensign, Zhongpeng Lin, Jo Mazeika, Afshin Mobramaein, Johnathan Pagnutti, Husacar Sanchez, Jim Whitehead, and Brenda Laurel. 2016. Design lessons fromBinary Fission: a crowd sourced game for precondition discovery. In Proceedings of the 1st International Joint Conference of DiGRA and FDG."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of the 1st International Joint Conference of DiGRA and FDG.","author":"Cooper Seth","year":"2016","unstructured":"Seth Cooper , Sebastian Deterding , and Theo Tsapakos . 2016 . Player rating systems for balancing human computation games: testing the effect of bipartiteness . In Proceedings of the 1st International Joint Conference of DiGRA and FDG. Seth Cooper, Sebastian Deterding, and Theo Tsapakos. 2016. Player rating systems for balancing human computation games: testing the effect of bipartiteness. In Proceedings of the 1st International Joint Conference of DiGRA and FDG."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature09304"},{"volume-title":"Flow: the psychology of optimal experience","author":"Csikszentmihalyi Mihaly","key":"e_1_3_2_1_14_1","unstructured":"Mihaly Csikszentmihalyi . 1990. Flow: the psychology of optimal experience . Harper and Row , New York . Mihaly Csikszentmihalyi. 1990. Flow: the psychology of optimal experience. Harper and Row, New York."},{"key":"e_1_3_2_1_15_1","volume-title":"Online games as social-computational systems for solving NP-complete problems. Meaningful Play","author":"Cusack Charles","year":"2010","unstructured":"Charles Cusack , Jeff Largent , Ryan Alfuth , and Kimberly Klask . 2010. Online games as social-computational systems for solving NP-complete problems. Meaningful Play ( 2010 ). Charles Cusack, Jeff Largent, Ryan Alfuth, and Kimberly Klask. 2010. Online games as social-computational systems for solving NP-complete problems. Meaningful Play (2010)."},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C.","author":"Dean Drew","year":"2015","unstructured":"Drew Dean , Sean Gaurino , Leonard Eusebi , Andrew Keplinger , Tim Pavlik , Ronald Watro , Aaron Cammarata , John Murray , Kelly McLaughlin , John Cheng , and Thomas Maddern . 2015 . Lessons learned in game development for crowd-sourced software formal verification . In Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C. Drew Dean, Sean Gaurino, Leonard Eusebi, Andrew Keplinger, Tim Pavlik, Ronald Watro, Aaron Cammarata, John Murray, Kelly McLaughlin, John Cheng, and Thomas Maddern. 2015. Lessons learned in game development for crowd-sourced software formal verification. In Proceedings of the 2015 USENIX Summit on Gaming, Games, and Gamification in Security Education. USENIX Association, Washington, D.C."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2793107.2793141"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2782702.2782707"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_3_2_1_20_1","unstructured":"Arpad E. Elo. 1978. The rating of chessplayers past and present. Arco.  Arpad E. Elo. 1978. The rating of chessplayers past and present. Arco."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11031-008-9102-4"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1464-0597.2012.00494.x"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9876.00159"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/02664760120059219"},{"key":"e_1_3_2_1_25_1","volume-title":"Jones","author":"Glickman Mark E.","year":"1999","unstructured":"Mark E. Glickman and Albyn C . Jones . 1999 . Rating the chess rating system. Chance 12 (Jan. 1999), 21--28. Mark E. Glickman and Albyn C. Jones. 1999. Rating the chess rating system. Chance 12 (Jan. 1999), 21--28."},{"volume-title":"Advances in Neural Information Processing Systems 20","author":"Herbrich Ralf","key":"e_1_3_2_1_26_1","unstructured":"Ralf Herbrich , TomMinka, and Thore Graepel . 2007. TrueSkill(TM) : aBayesian skill rating system . In Advances in Neural Information Processing Systems 20 . MIT Press , 569--576. Ralf Herbrich, TomMinka, and Thore Graepel. 2007. TrueSkill(TM): aBayesian skill rating system. In Advances in Neural Information Processing Systems 20. MIT Press, 569--576."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741102"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the Americas Conference on Information Systems.","author":"Kaufmann Nicolas","year":"2011","unstructured":"Nicolas Kaufmann , Thimo Schulze , and Daniel Veit . 2011 . More than fun and money. Worker motivation in crowdsourcing - a study on Mechanical Turk . In Proceedings of the Americas Conference on Information Systems. Nicolas Kaufmann, Thimo Schulze, and Daniel Veit. 2011. More than fun and money. Worker motivation in crowdsourcing - a study on Mechanical Turk. In Proceedings of the Americas Conference on Information Systems."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858253"},{"key":"e_1_3_2_1_30_1","unstructured":"Ryan Kirkman. 2010. pyglicko2: a Python Implementation of the Glicko-2 algorithm. (2010).  Ryan Kirkman. 2010. pyglicko2: a Python Implementation of the Glicko-2 algorithm. (2010)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1089\/cpb.2007.9942"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Edith Law and Luis von Ahn. 2011. Human Computation. Morgan & Claypool.  Edith Law and Luis von Ahn. 2011. Human Computation. Morgan & Claypool.","DOI":"10.1007\/978-3-031-01555-7"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699760"},{"key":"e_1_3_2_1_34_1","volume-title":"Proceedings of the 9th International Conference on the Foundations of Digital Games.","author":"Logas Heather","year":"2014","unstructured":"Heather Logas , Jim Whitehead , Michael Mateas , Richard Vallejos , Lauren Scott , Dan Shapiro , John Murray , Kate Compton , Joseph Osborn , Orlando Salvatore , Zhongpeng Lin , Huascar Sanchez , Michael Shavlovsky , Daniel Cetina , Shayne Clementi , and Chris Lewis . 2014 . Software verification games: designing Xylem, The Code of Plants . In Proceedings of the 9th International Conference on the Foundations of Digital Games. Heather Logas, Jim Whitehead, Michael Mateas, Richard Vallejos, Lauren Scott, Dan Shapiro, John Murray, Kate Compton, Joseph Osborn, Orlando Salvatore, Zhongpeng Lin, Huascar Sanchez, Michael Shavlovsky, Daniel Cetina, Shayne Clementi, and Chris Lewis. 2014. Software verification games: designing Xylem, The Code of Plants. In Proceedings of the 9th International Conference on the Foundations of Digital Games."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470668"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1600150.1600175"},{"key":"e_1_3_2_1_37_1","volume-title":"Game Developers Conference. (March","author":"Menke Josh","year":"2016","unstructured":"Josh Menke . 2016 . Skill, matchmaking, and ranking systems design . Game Developers Conference. (March 2016). Josh Menke. 2016. Skill, matchmaking, and ranking systems design. Game Developers Conference. (March 2016)."},{"key":"e_1_3_2_1_38_1","first-page":"5","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci Gabriele","year":"2010","unstructured":"Gabriele Paolacci , Jesse Chandler , and Panagiotis G. Ipeirotis . 2010 . Running experiments on Amazon Mechanical Turk . Judgment and Decision Making 5 , 5 (June 2010), 411--419. Gabriele Paolacci, Jesse Chandler, and Panagiotis G. Ipeirotis. 2010. Running experiments on Amazon Mechanical Turk. Judgment and Decision Making 5, 5 (June 2010), 411--419.","journal-title":"Judgment and Decision Making"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITNG.2012.124"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1080\/10496505.2016.1116339"},{"volume-title":"Understanding Motivation and Emotion","author":"Reeve Johnmarshall","key":"e_1_3_2_1_41_1","unstructured":"Johnmarshall Reeve . 2015. Understanding Motivation and Emotion ( Sixth edition). Wiley , Hoboken, New Jersey. Johnmarshall Reeve. 2015. Understanding Motivation and Emotion (Sixth edition). Wiley, Hoboken, New Jersey."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1408907112"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36406-8_1"},{"key":"e_1_3_2_1_44_1","unstructured":"Alex Cho Snyder and Mario Izquierdo. 2014. Jumpcraft. Game [PC]. (2014).  Alex Cho Snyder and Mario Izquierdo. 2014. Jumpcraft. Game [PC]. (2014)."},{"key":"e_1_3_2_1_45_1","volume-title":"Proceedings of the 10th International Conference on the Foundations of Digital Games.","author":"Fritz Steffen","year":"2015","unstructured":"Tobias Sturn, Michael Wimmer, Carl Salk, Christoph Perger, Linda See, and Steffen Fritz . 2015 . Cropland Capture - a game for improving global cropland maps . In Proceedings of the 10th International Conference on the Foundations of Digital Games. Tobias Sturn, Michael Wimmer, Carl Salk, Christoph Perger, Linda See, and Steffen Fritz. 2015. Cropland Capture - a game for improving global cropland maps. In Proceedings of the 10th International Conference on the Foundations of Digital Games."},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077246.1077253"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985733"}],"event":{"name":"FDG'17: International Conference on the Foundations of Digital Games 2017","sponsor":["Microsoft Microsoft","Massive Entertainment Massive Entertainment","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques","SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Hyannis Massachusetts","acronym":"FDG'17"},"container-title":["Proceedings of the 12th International Conference on the Foundations of Digital Games"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3102071.3102093","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3102071.3102093","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3102071.3102093","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:39:25Z","timestamp":1750217965000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3102071.3102093"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,14]]},"references-count":47,"alternative-id":["10.1145\/3102071.3102093","10.1145\/3102071"],"URL":"https:\/\/doi.org\/10.1145\/3102071.3102093","relation":{},"subject":[],"published":{"date-parts":[[2017,8,14]]},"assertion":[{"value":"2017-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}