{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T02:58:41Z","timestamp":1777604321706,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T00:00:00Z","timestamp":1604275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,11,2]]},"DOI":"10.1145\/3410404.3414235","type":"proceedings-article","created":{"date-parts":[[2020,11,3]],"date-time":"2020-11-03T13:28:10Z","timestamp":1604410090000},"page":"585-593","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Predicting Game Difficulty and Churn Without Players"],"prefix":"10.1145","author":[{"given":"Shaghayegh","family":"Roohi","sequence":"first","affiliation":[{"name":"Aalto University, Helsinki, Finland"}]},{"given":"Asko","family":"Relas","sequence":"additional","affiliation":[{"name":"Rovio Entertainment, Espoo, Finland"}]},{"given":"Jari","family":"Takatalo","sequence":"additional","affiliation":[{"name":"Rovio Entertainment, Espoo, Finland"}]},{"given":"Henri","family":"Heiskanen","sequence":"additional","affiliation":[{"name":"Rovio Entertainment, Espoo, Finland"}]},{"given":"Perttu","family":"H\u00e4m\u00e4l\u00e4inen","sequence":"additional","affiliation":[{"name":"Aalto University, Helsinki, Finland"}]}],"member":"320","published-online":{"date-parts":[[2020,11,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92040-5_19"},{"key":"e_1_3_2_1_2_1","unstructured":"Amazon. 2006. Amazon web services. http:\/\/aws.amazon.com  Amazon. 2006. Amazon web services. http:\/\/aws.amazon.com"},{"key":"e_1_3_2_1_3_1","volume-title":"Automated Video Game Testing Using Synthetic and Human-Like Agents","author":"Ariyurek Sinan","year":"2019","unstructured":"Sinan Ariyurek , Aysu Betin-Can , and Elif Surer . 2019. Automated Video Game Testing Using Synthetic and Human-Like Agents . IEEE Transactions on Games ( 2019 ). Sinan Ariyurek, Aysu Betin-Can, and Elif Surer. 2019. Automated Video Game Testing Using Synthetic and Human-Like Agents. IEEE Transactions on Games (2019)."},{"key":"e_1_3_2_1_4_1","volume-title":"Enhancing the Monte Carlo Tree Search Algorithm for Video Game Testing. arXiv preprint arXiv:2003.07813","author":"Ariyurek Sinan","year":"2020","unstructured":"Sinan Ariyurek , Aysu Betin-Can , and Elif Surer . 2020. Enhancing the Monte Carlo Tree Search Algorithm for Video Game Testing. arXiv preprint arXiv:2003.07813 ( 2020 ). Sinan Ariyurek, Aysu Betin-Can, and Elif Surer. 2020. Enhancing the Monte Carlo Tree Search Algorithm for Video Game Testing. arXiv preprint arXiv:2003.07813 (2020)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2017.8080412"},{"key":"e_1_3_2_1_6_1","volume-title":"Modelling Early User-Game Interactions for Joint Estimation of Survival Time and Churn Probability. In 2019 IEEE Conference on Games (CoG)","author":"Bonometti Valerio","year":"2020","unstructured":"Valerio Bonometti , Charles Ringer , Mark Hall , Alex R Wade , and Anders Drachen . 2019. Modelling Early User-Game Interactions for Joint Estimation of Survival Time and Churn Probability. In 2019 IEEE Conference on Games (CoG) . IEEE, 1--8. Predicting Game Difficulty and Churn Without Players CHI PLAY ?20, November 2--4, 2020 , Virtual Event, Canada Valerio Bonometti, Charles Ringer, Mark Hall, Alex R Wade, and Anders Drachen. 2019. Modelling Early User-Game Interactions for Joint Estimation of Survival Time and Churn Probability. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8. Predicting Game Difficulty and Churn Without Players CHI PLAY ?20, November 2--4, 2020, Virtual Event, Canada"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376701"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102071.3102105"},{"key":"e_1_3_2_1_9_1","unstructured":"Rovio Entertainment. 2018. Angry Birds Dream Blast. Game [Android iOS].  Rovio Entertainment. 2018. Angry Birds Dream Blast. Game [Android iOS]."},{"key":"e_1_3_2_1_10_1","volume-title":"Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science 349, 6245","author":"Gershman Samuel J","year":"2015","unstructured":"Samuel J Gershman , Eric J Horvitz , and Joshua B Tenenbaum . 2015. Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science 349, 6245 ( 2015 ), 273--278. Samuel J Gershman, Eric J Horvitz, and Joshua B Tenenbaum. 2015. Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science 349, 6245 (2015), 273--278."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2018.8490442"},{"key":"e_1_3_2_1_12_1","volume-title":"The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772","author":"Hansen Nikolaus","year":"2016","unstructured":"Nikolaus Hansen . 2016. The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 ( 2016 ). Nikolaus Hansen. 2016. The CMA evolution strategy: A tutorial. arXiv preprint arXiv:1604.00772 (2016)."},{"key":"e_1_3_2_1_13_1","volume-title":"Antonios Liapis, and Julian Togelius.","author":"Holmgard Christoffer","year":"2018","unstructured":"Christoffer Holmgard , Michael Cerny Green , Antonios Liapis, and Julian Togelius. 2018 . Automated playtesting with procedural personas with evolved heuristics. IEEE Transactions on Games ( 2018). Christoffer Holmgard, Michael Cerny Green, Antonios Liapis, and Julian Togelius. 2018. Automated playtesting with procedural personas with evolved heuristics. IEEE Transactions on Games (2018)."},{"key":"e_1_3_2_1_14_1","unstructured":"Aaron Isaksen Daniel Gopstein and Andrew Nealen. 2015. Exploring Game Space Using Survival Analysis.. In FDG.  Aaron Isaksen Daniel Gopstein and Andrew Nealen. 2015. Exploring Game Space Using Survival Analysis.. In FDG."},{"key":"e_1_3_2_1_15_1","volume-title":"Unity: A general platform for intelligent agents. arXiv preprint arXiv:1809.02627","author":"Juliani Arthur","year":"2018","unstructured":"Arthur Juliani , Vincent-Pierre Berges , Esh Vckay , Yuan Gao , Hunter Henry , Marwan Mattar , and Danny Lange . 2018 . Unity: A general platform for intelligent agents. arXiv preprint arXiv:1809.02627 (2018). Arthur Juliani, Vincent-Pierre Berges, Esh Vckay, Yuan Gao, Hunter Henry, Marwan Mattar, and Danny Lange. 2018. Unity: A general platform for intelligent agents. arXiv preprint arXiv:1809.02627 (2018)."},{"key":"e_1_3_2_1_16_1","volume-title":"Deep learning for video game playing","author":"Justesen Niels","year":"2019","unstructured":"Niels Justesen , Philip Bontrager , Julian Togelius , and Sebastian Risi . 2019. Deep learning for video game playing . IEEE Transactions on Games ( 2019 ). Niels Justesen, Philip Bontrager, Julian Togelius, and Sebastian Risi. 2019. Deep learning for video game playing. IEEE Transactions on Games (2019)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2019.8848003"},{"key":"e_1_3_2_1_18_1","volume-title":"Curiosity and interest: The benefits of thriving on novelty and challenge. Oxford handbook of positive psychology 2","author":"Kashdan Todd B","year":"2009","unstructured":"Todd B Kashdan and Paul J Silvia . 2009. Curiosity and interest: The benefits of thriving on novelty and challenge. Oxford handbook of positive psychology 2 ( 2009 ), 367--374. Todd B Kashdan and Paul J Silvia. 2009. Curiosity and interest: The benefits of thriving on novelty and challenge. Oxford handbook of positive psychology 2 (2009), 367--374."},{"key":"e_1_3_2_1_19_1","volume-title":"Churn prediction of mobile and online casual games using play log data. PloS one 12, 7","author":"Kim Seungwook","year":"2017","unstructured":"Seungwook Kim , Daeyoung Choi , Eunjung Lee , and Wonjong Rhee . 2017. Churn prediction of mobile and online casual games using play log data. PloS one 12, 7 ( 2017 ). Seungwook Kim, Daeyoung Choi, Eunjung Lee, and Wonjong Rhee. 2017. Churn prediction of mobile and online casual games using play log data. PloS one 12, 7 (2017)."},{"key":"e_1_3_2_1_20_1","volume-title":"Combining Sequential and Aggregated Data for Churn Prediction in Casual Freemium Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8.","author":"Kristensen Jeppe Theiss","year":"2019","unstructured":"Jeppe Theiss Kristensen and Paolo Burelli . 2019 . Combining Sequential and Aggregated Data for Churn Prediction in Casual Freemium Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8. Jeppe Theiss Kristensen and Paolo Burelli. 2019. Combining Sequential and Aggregated Data for Churn Prediction in Casual Freemium Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298548"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TG.2018.2888863"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2658537.2658695"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470668"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025638"},{"key":"e_1_3_2_1_26_1","volume-title":"Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , and Martin Riedmiller . 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 ( 2013 ). Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski etal 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529--533.  Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2014.04.047"},{"key":"e_1_3_2_1_29_1","volume-title":"Computational interaction","author":"Oulasvirta Antti","unstructured":"Antti Oulasvirta . 2018. Computational interaction . Oxford University Press . Antti Oulasvirta. 2018. Computational interaction. Oxford University Press."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.70"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2010.2043950"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2016.84"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026047"},{"key":"e_1_3_2_1_34_1","unstructured":"Erik Ragnar Poromaa. 2017. Crushing candy crush: predicting human success rate in a mobile game using Monte-Carlo tree search.  Erik Ragnar Poromaa. 2017. Crushing candy crush: predicting human success rate in a mobile game using Monte-Carlo tree search."},{"key":"e_1_3_2_1_35_1","volume-title":"Iv\u00e1n Encinas, Manel Sort, Jan Wedekind, and Mari\u00e1n Bogun\u00e1.","author":"Reguera David","year":"2019","unstructured":"David Reguera , Pol Colomer-de Sim\u00f3n , Iv\u00e1n Encinas, Manel Sort, Jan Wedekind, and Mari\u00e1n Bogun\u00e1. 2019 . The Physics of Fun: Quantifying Human Engagement into Playful Activities . arXiv preprint arXiv:1911.01864 (2019). David Reguera, Pol Colomer-de Sim\u00f3n, Iv\u00e1n Encinas, Manel Sort, Jan Wedekind, and Mari\u00e1n Bogun\u00e1. 2019. The Physics of Fun: Quantifying Human Engagement into Playful Activities. arXiv preprint arXiv:1911.01864 (2019)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173921"},{"key":"e_1_3_2_1_37_1","volume-title":"The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4","author":"Ryan Richard M","year":"2006","unstructured":"Richard M Ryan , C Scott Rigby , and Andrew Przybylski . 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 ( 2006 ), 344--360. Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344--360."},{"key":"e_1_3_2_1_38_1","volume-title":"The Art of Game Design: A book of lenses","author":"Schell Jesse","unstructured":"Jesse Schell . 2008. The Art of Game Design: A book of lenses . CRC press . Jesse Schell. 2008. The Art of Game Design: A book of lenses. CRC press."},{"key":"e_1_3_2_1_39_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_3_2_1_40_1","volume-title":"A Survey of Deep Reinforcement Learning in Video Games. arXiv preprint arXiv:1912.10944","author":"Shao Kun","year":"2019","unstructured":"Kun Shao , Zhentao Tang , Yuanheng Zhu , Nannan Li , and Dongbin Zhao . 2019. A Survey of Deep Reinforcement Learning in Video Games. arXiv preprint arXiv:1912.10944 ( 2019 ). Kun Shao, Zhentao Tang, Yuanheng Zhu, Nannan Li, and Dongbin Zhao. 2019. A Survey of Deep Reinforcement Learning in Video Games. arXiv preprint arXiv:1912.10944 (2019)."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.80.2.325"},{"key":"e_1_3_2_1_42_1","volume-title":"Current directions in psychological science 17, 1","author":"Silvia Paul J","year":"2008","unstructured":"Paul J Silvia . 2008. Interest? The curious emotion. Current directions in psychological science 17, 1 ( 2008 ), 57--60. Paul J Silvia. 2008. Interest?The curious emotion. Current directions in psychological science 17, 1 (2008), 57--60."},{"key":"e_1_3_2_1_43_1","volume-title":"Evaluating user experience in games","author":"Takatalo Jari","unstructured":"Jari Takatalo , Jukka H\u00e4kkinen , Jyrki Kaistinen , and G\u00f6te Nyman . 2010. Presence , involvement, and flow in digital games . In Evaluating user experience in games . Springer , 23--46. Jari Takatalo, Jukka H\u00e4kkinen, Jyrki Kaistinen, and G\u00f6te Nyman. 2010. Presence, involvement, and flow in digital games. In Evaluating user experience in games. Springer, 23--46."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2017.2727642"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2016.7860393"},{"key":"e_1_3_2_1_46_1","volume-title":"Michelle Yeo, Alireza Makhzani, Heinrich K\u00fcttler, John Agapiou, Julian Schrittwieser, et al.","author":"Vinyals Oriol","year":"2017","unstructured":"Oriol Vinyals , Timo Ewalds , Sergey Bartunov , Petko Georgiev , Alexander Sasha Vezhnevets , Michelle Yeo, Alireza Makhzani, Heinrich K\u00fcttler, John Agapiou, Julian Schrittwieser, et al. 2017 . Starcraft ii: A new challenge for reinforcement learning. arXiv preprint arXiv:1708.04782 (2017). Oriol Vinyals, Timo Ewalds, Sergey Bartunov, Petko Georgiev, Alexander Sasha Vezhnevets, Michelle Yeo, Alireza Makhzani, Heinrich K\u00fcttler, John Agapiou, Julian Schrittwieser, et al. 2017. Starcraft ii: A new challenge for reinforcement learning. arXiv preprint arXiv:1708.04782 (2017)."},{"key":"e_1_3_2_1_47_1","volume-title":"The Eighty Five Percent Rule for optimal learning. Nature communications 10, 1","author":"Wilson Robert C","year":"2019","unstructured":"Robert C Wilson , Amitai Shenhav , Mark Straccia , and Jonathan D Cohen . 2019. The Eighty Five Percent Rule for optimal learning. Nature communications 10, 1 ( 2019 ), 1--9. Robert C Wilson, Amitai Shenhav, Mark Straccia, and Jonathan D Cohen. 2019. The Eighty Five Percent Rule for optimal learning. Nature communications 10, 1 (2019), 1--9."},{"key":"e_1_3_2_1_48_1","volume-title":"Mining Player In-game Time Spending Regularity for Churn Prediction in Free Online Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8.","author":"Yang Wanshan","year":"2019","unstructured":"Wanshan Yang , Ting Huang , Junlin Zeng , Gemeng Yang , Jintian Cai , Lijun Chen , Shivakant Mishra , and Youjian Eugene Liu . 2019 . Mining Player In-game Time Spending Regularity for Churn Prediction in Free Online Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8. Wanshan Yang, Ting Huang, Junlin Zeng, Gemeng Yang, Jintian Cai, Lijun Chen, Shivakant Mishra, and Youjian Eugene Liu. 2019. Mining Player In-game Time Spending Regularity for Churn Prediction in Free Online Games. In 2019 IEEE Conference on Games (CoG). IEEE, 1--8."},{"key":"e_1_3_2_1_49_1","unstructured":"Georgios N Yannakakis Pieter Spronck Daniele Loiacono and Elisabeth Andr\u00e9. 2013. Player modeling. (2013).  Georgios N Yannakakis Pieter Spronck Daniele Loiacono and Elisabeth Andr\u00e9. 2013. Player modeling. (2013)."},{"key":"e_1_3_2_1_50_1","volume-title":"Ahmad Beirami, Jason Rupert, Caedmon Somers, Jesse Harder, John Kolen, Jervis Pinto, Reza Pourabolghasem, et al.","author":"Zhao Yunqi","year":"2019","unstructured":"Yunqi Zhao , Igor Borovikov , Fernando de Mesentier Silva , Ahmad Beirami, Jason Rupert, Caedmon Somers, Jesse Harder, John Kolen, Jervis Pinto, Reza Pourabolghasem, et al. 2019 . Winning Isn't Everything : Enhancing Game Development with Intelligent Agents . arXiv preprint arXiv:1903.10545 (2019). Yunqi Zhao, Igor Borovikov, Fernando de Mesentier Silva, Ahmad Beirami, Jason Rupert, Caedmon Somers, Jesse Harder, John Kolen, Jervis Pinto, Reza Pourabolghasem, et al. 2019. Winning Isn't Everything: Enhancing Game Development with Intelligent Agents. arXiv preprint arXiv:1903.10545 (2019)."}],"event":{"name":"CHI PLAY '20: The Annual Symposium on Computer-Human Interaction in Play","location":"Virtual Event Canada","acronym":"CHI PLAY '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the Annual Symposium on Computer-Human Interaction in Play"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3410404.3414235","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3410404.3414235","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:50Z","timestamp":1750195910000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3410404.3414235"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,2]]},"references-count":50,"alternative-id":["10.1145\/3410404.3414235","10.1145\/3410404"],"URL":"https:\/\/doi.org\/10.1145\/3410404.3414235","relation":{},"subject":[],"published":{"date-parts":[[2020,11,2]]},"assertion":[{"value":"2020-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}