{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T02:45:08Z","timestamp":1771296308484,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Games"],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:p>\n            Difficulty constitutes a key component of games. It both serves as motivation to play the game and as a way to control progression. Usually, a video game offers a gradual progression in gameplay difficulty, starting with easy levels that allow players to grasp the basic mechanics and incrementally introducing more challenging obstacles as they progress. Needless to say, the success of a game heavily relies on its ability to provide a well-balanced difficulty curve and a satisfying progression. Therefore, designing a game entails a complex and time-consuming process that involves extensive playtesting. One potential approach to address this challenge is the utilization of software tools capable of automatically evaluating the difficulty of game levels. In this article, we present a comprehensive model for automatically evaluating the difficulty levels of platformer games. Our model is based on the formal calculation of static danger zones within levels and the analysis of enemy movement patterns using simulated pheromones. To validate our model, we implemented it and conducted tests using the complete set of levels from the game\n            <jats:italic>Super Mario Bros.<\/jats:italic>\n            Futhermore, the article includes a detailed presentation of the model, the tools developed, a comparative analysis showing the computed results, and a discussion on the limitations and advantages.\n          <\/jats:p>","DOI":"10.1145\/3705013","type":"journal-article","created":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T10:22:36Z","timestamp":1734344556000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["A Comprehensive Model of Automated Evaluation of Difficulty in Platformer Games"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4315-1955","authenticated-orcid":false,"given":"Yannick","family":"Francillette","sequence":"first","affiliation":[{"name":"Informatique et Math\u00e9matique, Universit\u00e9 du Qu\u00e9bec \u00e0 Chicoutimi, Chicoutimi, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5056-5830","authenticated-orcid":false,"given":"Hugo","family":"Tremblay","sequence":"additional","affiliation":[{"name":"Informatique et Math\u00e9matique, Universit\u00e9 du Qu\u00e9bec \u00e0 Chicoutimi, Chicoutimi, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8408-3258","authenticated-orcid":false,"given":"Bruno","family":"Bouchard","sequence":"additional","affiliation":[{"name":"Informatique et Math\u00e9matique, Universit\u00e9 du Qu\u00e9bec \u00e0 Chicoutimi, Chicoutimi, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9027-4352","authenticated-orcid":false,"given":"Bob-Antoine","family":"Menelas","sequence":"additional","affiliation":[{"name":"Informatique et Math\u00e9matique, Universit\u00e9 du Qu\u00e9bec \u00e0 Chicoutimi, Chicoutimi, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,1,24]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.entcom.2012.09.001","article-title":"An investigation of the effects of game difficulty on player enjoyment","volume":"4","author":"Alexander J. T.","year":"2013","unstructured":"J. T. Alexander, J. Sear, and A. Oikomomou. 2013. An investigation of the effects of game difficulty on player enjoyment. Entert. Comput. 4, 1 (2013), 53\u201362.","journal-title":"Entert. Comput."},{"key":"e_1_3_4_3_2","first-page":"173","volume-title":"2nd International Conference on Science and Technology-Computer (ICST\u201916)","author":"Sihabuddin A. Anditya and A.","year":"2016","unstructured":"A. Anditya and A. Sihabuddin2016. An optimal input for role-playing game\u2019s combat pace using an active time battle system algorithm. In 2nd International Conference on Science and Technology-Computer (ICST\u201916). IEEE, 173\u2013180."},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04052-8_3"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2071423.2071484"},{"key":"e_1_3_4_6_2","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.entcom.2011.04.001","article-title":"Measuring the level of difficulty in single player video games","volume":"2","author":"Levieux. S. Natkin, M.-V. Aponte, and G.","year":"2011","unstructured":"S. Natkin, M.-V. Aponte, and G. Levieux.2011. Measuring the level of difficulty in single player video games. Entert. Comput. 2 (2011), 205\u2013213.","journal-title":"Entert. Comput."},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/235815.235821"},{"key":"e_1_3_4_8_2","unstructured":"G. Bradski. 2008. Learning OpenCV: Computer vision with the OpenCV library. O\u2019REILLY 2 (2008). https:\/\/www.oreilly.com\/library\/view\/learningopencv\/9780596516130\/"},{"key":"e_1_3_4_9_2","volume-title":"Programming Game AI by Example","author":"Buckland Mat","year":"2005","unstructured":"Mat Buckland. 2005. Programming Game AI by Example. Jones & Bartlett Learning."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02712873"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1232743.1232769"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v2i1.18755"},{"key":"e_1_3_4_13_2","first-page":"107","volume-title":"Conference on Human\u2013Computer Interaction (INTERACT\u201917)","author":"Constant Thomas","year":"2017","unstructured":"Thomas Constant, Guillaume Levieux, Axel Buendia, and St\u00e9phane Natkin. 2017. From objective to subjective difficulty evaluation in video games. In Conference on Human\u2013Computer Interaction (INTERACT\u201917), Regina Bernhaupt, Girish Dalvi, Anirudha Joshi, Devanuj K. Balkrishan, Jacki O\u2019Neill, and Marco Winckler (Eds.). Springer International Publishing, Cham, 107\u2013127."},{"key":"e_1_3_4_14_2","first-page":"2511","volume-title":"CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201917)","author":"Denisova Alena","year":"2017","unstructured":"Alena Denisova, Christian Guckelsberger, and David Zendle. 2017. Challenge in digital games: Towards developing a measurement tool. In CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201917). 2511\u20132519."},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986102"},{"key":"e_1_3_4_16_2","article-title":"A gameplay definition through videogame classification","volume":"2008","author":"Djaouti Damien","year":"2008","unstructured":"Damien Djaouti, Julian Alvarez, Jean-Pierre Jessel, Gilles Methel, and Pierre Molinier. 2008. A gameplay definition through videogame classification. Int. J. Comput. Games Technol. 2008 (2008).","journal-title":"Int. J. Comput. Games Technol."},{"key":"e_1_3_4_17_2","first-page":"1","article-title":"Development of difficulty in games","author":"Eberhart Kaleb","year":"2016","unstructured":"Kaleb Eberhart. 2016. Development of difficulty in games. GameDeveloper.com (2016), 1\u20135. https:\/\/www.gamedeveloper.com\/design\/developmentof-difficulty-in-games","journal-title":"GameDeveloper.com"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAR.2015.7251520"},{"key":"e_1_3_4_19_2","first-page":"1","article-title":"A new taxonomy of difficulty: A call to reconsider how we talk about difficulty in games.","author":"Frampton Rhys","year":"2021","unstructured":"Rhys Frampton. 2021. A new taxonomy of difficulty: A call to reconsider how we talk about difficulty in games. GameDeveloper.com (2021), 1\u20137. https:\/\/www.gamedeveloper.com\/game-platforms\/a-new-taxonomy-of-difficulty","journal-title":"GameDeveloper.com"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0190(72)90045-2"},{"key":"e_1_3_4_21_2","volume-title":"Reverse Design: Super Mario World","author":"Holleman Patrick","year":"2018","unstructured":"Patrick Holleman. 2018. Reverse Design: Super Mario World. CRC Press."},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/CEEC47804.2019.8974332"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2941229"},{"key":"e_1_3_4_24_2","doi-asserted-by":"crossref","first-page":"82","DOI":"10.4018\/978-1-4666-1634-9.ch005","volume-title":"Algorithmic and Architectural Gaming Design: Implementation and Development","author":"Jonathan Tremblay","year":"2012","unstructured":"Tremblay Jonathan, Bouchard Bruno, and Bouzouane Abdenour. 2012. Understanding and implementing adaptive difficulty adjustment in video games. In Algorithmic and Architectural Gaming Design: Implementation and Development. IGI Global, 82\u2013106."},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2015.7344647"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3486011.3486447"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/CoG52621.2021.9619050"},{"key":"e_1_3_4_28_2","unstructured":"Fausto Mourato and Manuel Pr\u00f3spero dos Santos. 2010. Measuring difficulty in platform videogames. In 4 \\(^a\\) Confer\u00eancia Nacional Interac\u00e7\u00e3o humano-computador."},{"key":"e_1_3_4_29_2","first-page":"1","article-title":"Managing difficulty in games","author":"Palban Vince","year":"2021","unstructured":"Vince Palban. 2021. Managing difficulty in games. Game Des. Devel. (2021), 1\u20134. https:\/\/ecampusontario.pressbooks.pub\/gamedesigndevelopmenttextbook\/chapter\/managing-difficulty-in-games\/","journal-title":"Game Des. Devel."},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2021.2020008"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3577190.3614203"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-90238-4_26"},{"key":"e_1_3_4_33_2","article-title":"Video game genres and advancing quantitative video game research with the genre diversity score","volume":"9","author":"Sevin. W. DeCamp and R.","year":"2020","unstructured":"W. DeCamp and R. Sevin.2020. Video game genres and advancing quantitative video game research with the genre diversity score. Comput. Games J. 9, 4 (2020), 401\u2013420.","journal-title":"Comput. Games J."},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2013.2271738"},{"key":"e_1_3_4_35_2","doi-asserted-by":"crossref","unstructured":"Tianye Shu Jialin Liu and Georgios N. Yannakakis. 2021. Experience-driven PCG via reinforcement learning: A Super Mario Bros study. (2021) 1\u20139.","DOI":"10.1109\/CoG52621.2021.9619124"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3230983"},{"key":"e_1_3_4_37_2","volume-title":"International Conference on Computer Supported Education","author":"Tremblay Jonathan","year":"2010","unstructured":"Jonathan Tremblay, Bruno Bouchard, and Abdenour Bouzouane. 2010. Adaptive game mechanics for learning purposes\u2014Making serious games playable and fun. In International Conference on Computer Supported Education."},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2015.7317913"},{"key":"e_1_3_4_39_2","first-page":"91","volume-title":"9th International Conference on Motion in Games","author":"Toll Wouter Van","year":"2016","unstructured":"Wouter Van Toll, Roy Triesscheijn, Marcelo Kallmann, Ramon Oliva, Nuria Pelechano, Julien Pettr\u00e9, and Roland Geraerts. 2016. A comparative study of navigation meshes. In 9th International Conference on Motion in Games. 91\u2013100."},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3555858.3563282"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","unstructured":"Kai Xu Vladimir Kim Qixing Huang Niloy Mitra and Evangelos Kalogerakis. 2016. Data-driven shape analysis and processing. In SIGGRAPH ASIA 2016 Courses. 1\u201338. DOI:10.1145\/2988458.2988473","DOI":"10.1145\/2988458.2988473"}],"container-title":["Games: Research and Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3705013","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3705013","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:02Z","timestamp":1750295882000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3705013"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,24]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3,31]]}},"alternative-id":["10.1145\/3705013"],"URL":"https:\/\/doi.org\/10.1145\/3705013","relation":{},"ISSN":["2832-5516"],"issn-type":[{"value":"2832-5516","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,24]]},"assertion":[{"value":"2023-12-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}