{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:15:56Z","timestamp":1777706156318,"version":"3.51.4"},"reference-count":108,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T00:00:00Z","timestamp":1646870400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2022,6,9]]},"abstract":"<jats:p>This study takes a new perspective on the procedural content generation (PCG) evaluation problem, extracts current PCG evaluation methods from previous works, and presents a novel classification of these methods while showing each method\u2019s capabilities. Also, the present study introduces a novel concept called Panda Evaluation. Additionally, the soft and hard launches were presented as two evaluation methods and possible building blocks of PE. A group of papers was analyzed to understand previous works and find new opportunities. In doing so, some missing PCG evaluation areas were found, and some new methods were proposed for future PCG evaluations. To the best of our knowledge, this is the first time these concepts have been presented in PCG evaluation.<\/jats:p>","DOI":"10.3233\/jifs-219318","type":"journal-article","created":{"date-parts":[[2022,3,11]],"date-time":"2022-03-11T11:56:01Z","timestamp":1646999761000},"page":"2191-2210","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["PCG\/PCGML evaluations: Introducing panda evaluation using the soft launch"],"prefix":"10.1177","volume":"43","author":[{"given":"Arman Balali","family":"Moghadam","sequence":"first","affiliation":[{"name":"Department of Computer Science, Faculty of Mathematics and Computer, Shahid Bahonar University of Kerman, Kerman, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marjan Kuchaki","family":"Rafsanjani","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Faculty of Mathematics and Computer, Shahid Bahonar University of Kerman, Kerman, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valentina Emilia","family":"Balas","sequence":"additional","affiliation":[{"name":"Department of Automatics and Applied Software, Faculty of Engineering, Aurel Vlaicu University of Arad, Arad, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2022,3,10]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","unstructured":"AmatoA. Procedural content generation in the game industry in: Game Dynamics O. Korn and N. Lee eds. Springer 2017 pp. 15\u201325.","DOI":"10.1007\/978-3-319-53088-8_2"},{"key":"e_1_3_1_3_2","unstructured":"Amazon Turk Amazon. (2020)."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-52190-5_9"},{"key":"e_1_3_1_5_2","first-page":"1","article-title":"Distance sensing with ultrasonic sensor and arduino","volume":"2","author":"Anju Latha N.","year":"2016","unstructured":"Anju LathaN., Rama MurthyB. and KumarK.B., Distance sensing with ultrasonic sensor and arduino, Intenational Journal of Advance Research, Ideas and Innovovations in Technology 2 (2016), 1\u20135.","journal-title":"Intenational Journal of Advance Research, Ideas and Innovovations in Technology"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-189214"},{"key":"e_1_3_1_7_2","unstructured":"ArkelA.V. KaravolosD. and BouwerA. Procedural generation of collaborative puzzle-platform game levels (2015)."},{"key":"e_1_3_1_8_2","doi-asserted-by":"crossref","unstructured":"AtmajaP.W. ParlikaR. and MuttaqinF. Generating two-dimensional platformer game levels from storylines Proceeding of the International Conference Science Technology (ICST 2018) 2018.","DOI":"10.2991\/icst-18.2018.212"},{"key":"e_1_3_1_9_2","unstructured":"BabineauxR. and KrumboltzJ. Fail fast fail often: How losing can help you win 2013."},{"key":"e_1_3_1_10_2","doi-asserted-by":"crossref","unstructured":"BaghdadiW. EddinF.S. Al-OmariR. AlhalawaniZ. ShakerM. and ShakerN. A procedural method for automatic generation of spelunky levels Proceeding of the European Conference on the Applications of Evolutionary Computation (2015) pp. 305\u2013317.","DOI":"10.1007\/978-3-319-16549-3_25"},{"key":"e_1_3_1_11_2","first-page":"15962","article-title":"Insights to sensor technology and it\u2019s applications","volume":"5","author":"Bapat P.M.","year":"2016","unstructured":"BapatP.M., Insights to sensor technology and it\u2019s applications, International Journal of Engineering and Computer Science 5 (2016), 15962\u201315965.","journal-title":"International Journal of Engineering and Computer Science"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19132877"},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"BottinoR. ChioccarielloA. FreinaL. and TavellaM. Digital games in primary schools for the development of key transversal skills in: Sustainable ICT Education and Learning A. Tatnall and N. Mavengere eds. SUZA 2019 pp. 55\u201365.","DOI":"10.1007\/978-3-030-28764-1_8"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","unstructured":"BousefsafF. MaaouiC. and PruskiA. Remote assessment of the heart rate variability to detect mental stress Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare May 2013 pp. 348\u2013351.","DOI":"10.4108\/pervasivehealth.2013.252181"},{"key":"e_1_3_1_15_2","unstructured":"CanossaA. and SmithG. Towards a procedural evaluation technique: metrics for level design Proceeding of the 10th International Conference on the Foundations of Digital Games (2015) pp. 8."},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-189216"},{"key":"e_1_3_1_17_2","unstructured":"ChernovaS. OrkinJ. and BreazealC. Crowdsourcing HRI through online multiplayer games Proceeding of the AAAI Fall Symposium Series 2010."},{"key":"e_1_3_1_18_2","unstructured":"CohnJ.F. and De La TorreF. Automated face analysis for affective computing in: The Oxford Handbook of Affective Computing R. Calvo S. D\u2019Mello J. Gratch and A. Kappas eds. Oxford University Press 2015."},{"key":"e_1_3_1_19_2","unstructured":"CuevasZ. Best Nintendo Switch 2D Platformers 2020 Imore Company (2020) https:\/\/www.imore.com\/best-nintendo-switch-2d-platformers."},{"key":"e_1_3_1_20_2","unstructured":"DahlskogS. and TogeliusJ. Patterns as objectives for level generation Proceeding of the Second Workshop Design Patterns Games 2013."},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"DahlskogS. and TogeliusJ. Procedural content generation using patterns as objectives Proceeding of the European Conference Applications of Evolutionary Computation (2014) pp. 325\u2013336.","DOI":"10.1007\/978-3-662-45523-4_27"},{"key":"e_1_3_1_22_2","doi-asserted-by":"crossref","unstructured":"DahlskogS. and TogeliusJ. Patterns and procedural content generation: revisiting Mario in world 1 level 1 Proceeding of the FirstWorkshop Design Patterns Games (2012) pp. 1.","DOI":"10.1145\/2427116.2427117"},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"DahlskogS. and TogeliusJ. A multi-level generator Proceeding of the Conference Computation Intelligence and Games (2014) pp. 1\u20138.","DOI":"10.1109\/CIG.2014.6932909"},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","unstructured":"DahlskogS. TogeliusJ. and NelsonM.J. Linear levels through n-grams Proceeding of the 18th International Academic MindTrek Conference: Media Business Management Content & Services (2014) pp. 200\u2013206.","DOI":"10.1145\/2676467.2676506"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"DemirI. and AliagaD.G. Guided proceduralization: Optimizing geometry processing and grammar extraction for architectural models Computation Graphics (2018).","DOI":"10.1016\/j.cag.2018.05.013"},{"key":"e_1_3_1_26_2","unstructured":"Derek YuL. Mossmouth Spelunky (2008)."},{"key":"e_1_3_1_27_2","unstructured":"EadN. Super Mario Bros (1985)."},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","unstructured":"FerreiraL.N. PereiraL. and ToledoC. Amulti-population genetic algorithm for procedural generation of levels for platform games Proceeding of the Conference on Genetic and Evolutionary Computation (2014) pp. 45\u201346.","DOI":"10.1145\/2598394.2598489"},{"key":"e_1_3_1_29_2","unstructured":"Game Analytics Game Analytics Ltd. (2011). www.gameanalytics.com"},{"key":"e_1_3_1_30_2","unstructured":"Google Google Analytics (2005). https:\/\/analytics.google.com\/analytics\/web\/"},{"key":"e_1_3_1_31_2","unstructured":"Google Scholar https:\/\/scholar.google.com\/intl\/en\/scholar\/about.html"},{"key":"e_1_3_1_32_2","unstructured":"GuzdialM.J. and RiedlM.O. Combinatorial creativity for procedural content generation via machine learning Proceeding of the Workshop Thirty-Second AAAI Conference Artificial Intelligence 2018."},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","unstructured":"GuzdialM. LiaoN. ChenJ. ChenS.-Y. ShahS. ShahV. RenoJ. SmithG. and RiedlM.O. Friend collaborator student manager: How design of an ai-driven game level editor affects creators Proceeding of the CHI Conference Human Factors Computation System (2019) pp. 624.","DOI":"10.1145\/3290605.3300854"},{"key":"e_1_3_1_34_2","unstructured":"GuzdialM. RenoJ. ChenJ. SmithG. and RiedlM. Explainable PCGML via game design patterns ArXiv Preprint ArXiv1809.09419. (2018)."},{"key":"e_1_3_1_35_2","unstructured":"GuzdialM. and RiedlM. Game level generation from gameplay videos Proceeding of the Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference 2016."},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"GuzdialM. and RiedlM. Automated game design via conceptual expansion Proceeding of the Fourteenth Artificial Intelligence and Interactive Digital Entertainment Conference 2018.","DOI":"10.1609\/aiide.v14i1.13022"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1080\/18756891.2015.1113747"},{"key":"e_1_3_1_38_2","unstructured":"HAl Laboratory Kirby\u2019s Adventure (1993)."},{"key":"e_1_3_1_39_2","doi-asserted-by":"crossref","unstructured":"HarrisJ. Exploreing Roguelike games CRC Press 2020.","DOI":"10.1201\/9781003053576"},{"key":"e_1_3_1_40_2","article-title":"Procedural content generation for games: A survey","volume":"9","author":"Hendrikx M.","year":"2013","unstructured":"HendrikxM., MeijerS., Van Der VeldenJ. and IosupA., Procedural content generation for games: A survey, ACM Transaction Multimedia, Communication and Computing Application 9 (2013).","journal-title":"ACM Transaction Multimedia, Communication and Computing Application"},{"key":"e_1_3_1_41_2","unstructured":"HenyD. MikamiK. and KondoK. Adaptable Game Experience Based on Player\u2019s Performance and EEG proceeding of the Nicograph International (NicoInt) (2017) pp. 1\u20138."},{"key":"e_1_3_1_42_2","unstructured":"HornB. DahlskogS. ShakerN. SmithG. and TogeliusJ. AComparative Evaluation of Procedural Level Generators in the Mario AI Framework Proceeding of the Foundations of Digital Games (2014) pp. 1\u20138."},{"key":"e_1_3_1_43_2","unstructured":"Ipsos I-Say (n.d.). rec.i-say.com."},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","unstructured":"JerrittaS. MurugappanM. NagarajanR. and WanK. Physiological signals based human emotion recognition: A review Proceeding of the IEEE 7th International Colloquium on Signal Processing and Its Applications 2011.","DOI":"10.1109\/CSPA.2011.5759912"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaa8415"},{"key":"e_1_3_1_46_2","first-page":"55","article-title":"The Mario AI benchmark and competitions","volume":"4","author":"Karakovskiy S.","year":"2012","unstructured":"KarakovskiyS. and TogeliusJ., The Mario AI benchmark and competitions, IEEE Transaction on Computational Intelligence and AI in Games 4 (2012), 55\u201367.","journal-title":"IEEE Transaction on Computational Intelligence and AI in Games"},{"key":"e_1_3_1_47_2","doi-asserted-by":"crossref","unstructured":"KarthI. and SmithA.M. Addressing the fundamental tension of PCGML with discriminative learning Proceeding of the 14th International Conference Foundations Digital Games (2019) pp. 1\u20139.","DOI":"10.1145\/3337722.3341845"},{"key":"e_1_3_1_48_2","doi-asserted-by":"crossref","unstructured":"KerssemakersM. TuxenJ. TogeliusJ. and YannakakisG.N. A procedural procedural level generator generator Proceeding of the Conference Computation Intelligence and Games (2012) pp. 335\u2013341.","DOI":"10.1109\/CIG.2012.6374174"},{"key":"e_1_3_1_49_2","unstructured":"KhadivpourF. and GuzdialM. Explainability via Responsibility ArXiv preprint ArXiv 2010.01676 (2020)."},{"key":"e_1_3_1_50_2","unstructured":"KhalifaA. GreenM.C. BarrosG. and TogeliusJ. Intentional computational level design ArXiv Preprint ArXiv1904.08972 (2019)."},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.5465\/amj.2013.1109"},{"key":"e_1_3_1_52_2","unstructured":"KoensF.E. Generating non-monotone 2D platform levels and predicting difficulty Master thesis Utrecht University Repository 2016."},{"key":"e_1_3_1_53_2","unstructured":"Koopa [Troopa Gamicus. (2018). https:\/\/gamicus.gamepedia.com\/Koopa_Troopa (accessed 9 August 2018)."},{"key":"e_1_3_1_54_2","unstructured":"LeeV. PartlanN. and CooperS. Precomputing player movement in platformers for level generation with reachability constraints Proceeding of the Experimental AI in Games 2020."},{"key":"e_1_3_1_55_2","article-title":"Crowdsourcing narrative intelligence","volume":"2","author":"Li B.","year":"2012","unstructured":"LiB., Lee-UrbanS., ApplingD.S. and RiedlM.O., Crowdsourcing narrative intelligence, Advances in Cognitive System 2 (2012).","journal-title":"Advances in Cognitive System"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2017.2678759"},{"key":"e_1_3_1_57_2","unstructured":"LtdR. Donkey Kong Country (1994)."},{"key":"e_1_3_1_58_2","doi-asserted-by":"crossref","unstructured":"MagerkoB. HeeterC. FitzgeraldJ. and MedlerB. Intelligent adaptation of digital game-based learning Proceeding of the Conference on Future Play: Research Play Share (2008) pp. 200\u2013203.","DOI":"10.1145\/1496984.1497021"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","unstructured":"MandrykR.L. AtkinsM.S. and InkpenK.M. A continuous and objective evaluation of emotional experience with interactive play environments Proceeding of the Conference Human Factors Computation System Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2006.","DOI":"10.1145\/1124772.1124926"},{"key":"e_1_3_1_60_2","doi-asserted-by":"crossref","unstructured":"MawhorterP. and MateasM. Procedural level generation using occupancy-regulated extension Proceeding of the Proceeding of the Conference Computation Intelligence and Games (2010) pp. 351\u2013358.","DOI":"10.1109\/ITW.2010.5593333"},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","unstructured":"MazzaC. RipamontiL.A. MaggioriniD. and GadiaD. Fun pledge 2.0: a funny platformers levels generator Proceeding of the 12th Biannual Conference on Italian SIGCHI Chapter (2017) pp. 22.","DOI":"10.1145\/3125571.3125592"},{"key":"e_1_3_1_62_2","doi-asserted-by":"crossref","unstructured":"McDuffD. GontarekS. and PicardR. Remote measurement of cognitive stress via heart rate variability Proceeding of the 36th Annual International Conference IEEE Engineering in Medicine and Biology Society (2014) pp. 2957\u20132960.","DOI":"10.1109\/EMBC.2014.6944243"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2014.2323695"},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","unstructured":"McDuffD.J. HernandezJ. GontarekS. and PicardR.W. COGCAM: Contact-free measurement of cognitive stress during computer tasks with a digital camera Proceeding of the Conference Human Factors Computation System 2016.","DOI":"10.1145\/2858036.2858247"},{"key":"e_1_3_1_65_2","doi-asserted-by":"crossref","unstructured":"MoghadamA.B. and Kuchaki RafsanjaniM. A genetic approach in procedural content generation for platformer games level creation Proceeding of the 2nd Conference Swarm Intelligence of Evolutionary Computation (2017) pp. 141\u2013146.","DOI":"10.1109\/CSIEC.2017.7940160"},{"key":"e_1_3_1_66_2","unstructured":"MortonL. and ParkM. 2021 games: all the new launches you\u2019ll want to watch for next year PC Gamer Company 2020. https:\/\/www.pcgamer.com\/new-games-2021"},{"key":"e_1_3_1_67_2","doi-asserted-by":"crossref","unstructured":"NaqaI.E. and MurphyM.J. What is machine learning? Machine Learning in Radiation Oncology Springer (2015) pp. 3\u201311.","DOI":"10.1007\/978-3-319-18305-3_1"},{"key":"e_1_3_1_68_2","unstructured":"NintendoP.S. Tose Sora Ltd. Nintendo Research & Development 1 Kid Icarus 1986."},{"key":"e_1_3_1_69_2","unstructured":"Nintendo Mega Man (1987)."},{"key":"e_1_3_1_70_2","unstructured":"Nintendo Koopa Troopa (n.d.) https:\/\/play.nintendo.com\/themes\/friends\/koopa-troopa\/"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X10379795"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","unstructured":"PinteaC.M. MateiO. RamadanR.A. PavoneM. NiaziM. and AzarA.T. A fuzzy approach of sensitivity for multiple colonies on ant colony optimization In: V. Balas L. Jain M. Balas (eds.) Soft Computing Applications. SOFA 2016. Advances in Intelligent Systems and Computing 634 (2019) 87\u201395 Springer doi.org\/10.1007\/978-3-319-62524-9_8.","DOI":"10.1007\/978-3-319-62524-9_8"},{"key":"e_1_3_1_73_2","unstructured":"RiederB. Using procedural content generation via machine learning as a game mechanic Austrian Marshall Plan Foundation (2018)."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3636-3"},{"key":"e_1_3_1_75_2","doi-asserted-by":"crossref","unstructured":"RouastP.V. AdamM.T.P. ChiongR. CornforthD. and LuxE. Remote heart rate measurement using low-cost RGB face video: a technical literature review Frontiers of Computer Science (2018).","DOI":"10.1007\/s11704-016-6243-6"},{"key":"e_1_3_1_76_2","doi-asserted-by":"crossref","unstructured":"SalaiM. Vass\u00e1nyiI. and K\u00f3saI. Stress detection using low cost heart rate sensors Journal of Healthcare Engineering (2016).","DOI":"10.1155\/2016\/5136705"},{"key":"e_1_3_1_77_2","unstructured":"SarkarA. and CooperS. Blending Levels from Different Games using LSTMs Proceedings of the Conference on Artificial Intelligence and Interactive Digital Entertainment Workshops 2018."},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1080\/09540090600768658"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766956"},{"key":"e_1_3_1_80_2","unstructured":"Scopus (2020). https:\/\/scopus.com\/"},{"key":"e_1_3_1_81_2","unstructured":"SEGA Sonic the Hedgehog 2020. https:\/\/www.sonicthehedgehog.com\/"},{"key":"e_1_3_1_82_2","doi-asserted-by":"crossref","unstructured":"ShakerN. NicolauM. YannakakisG.N. TogeliusJ. and O\u2019NeillM. Evolving levels for Super Mario Bros using grammatical evolution Proceeding of the Conference Computation Intelligence and Games (2012) pp. 304\u2013311.","DOI":"10.1109\/CIG.2012.6374170"},{"key":"e_1_3_1_83_2","unstructured":"ShakerN. TogeliusJ. and NelsonM.J. Procedural Content Generation in Games Springer 2016."},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2011.2166267"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2231413"},{"key":"e_1_3_1_86_2","doi-asserted-by":"crossref","unstructured":"ShakerN. YannakakisG. and TogeliusJ. Towards automatic personalized content generation for platform games Proceeding of the Sixth Artificial Intelligence and Interactive Digital Entertainment Conference 2010.","DOI":"10.1609\/aiide.v6i1.12399"},{"key":"e_1_3_1_87_2","doi-asserted-by":"crossref","unstructured":"SmithG. ChaM. and WhiteheadJ. A framework for analysis of 2D platformer levels Proceeding of the Sandbox 2008 An ACM SIGGRAPH Videogame symposium 2008.","DOI":"10.1145\/1401843.1401858"},{"key":"e_1_3_1_88_2","doi-asserted-by":"crossref","unstructured":"SmithG. and WhiteheadJ. Analyzing the expressive range of a level generator Proceeding of the Workshop Procedural Content Generation Games (2010) pp. 4.","DOI":"10.1145\/1814256.1814260"},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2011.2159716"},{"key":"e_1_3_1_90_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2010.2095855"},{"key":"e_1_3_1_91_2","doi-asserted-by":"crossref","unstructured":"SnodgrassS. and Ontan\u00f3nS. Player movement models for platformer game level generation Proceeding of the 26th International Joint Conference Artificial Intelligence (2017) pp. 757\u2013763.","DOI":"10.24963\/ijcai.2017\/105"},{"key":"e_1_3_1_92_2","unstructured":"SnodgrassS. and Ontan\u00f3nS. Leveraging multi-layer level representations for puzzle-platformer level generation Proceeding of the Thirteen Artificial Intelligence and Interactive Digital Entertainment Conference 2017."},{"key":"e_1_3_1_93_2","doi-asserted-by":"crossref","unstructured":"SnodgrassS. and Onta\u00f1\u00f3nS. Procedural level generation using multi-layer level representations with MdMCs Proceeding of the Proceeding of the Conference Computation Intelligence and Games (2017) pp. 280\u2013287.","DOI":"10.1109\/CIG.2017.8080447"},{"key":"e_1_3_1_94_2","unstructured":"SorensonN. and PasquierP. The Evolution of Fun: Automatic Level Design Through Challenge Modeling Proceeding of the International Conference on Computational Creativity (2010) pp. 258\u2013267."},{"key":"e_1_3_1_95_2","unstructured":"StoddartJ. Soft launch vs. hard launch: taking a new product to market 2018. http:\/\/marketing.channelcreator.com\/blog\/all\/soft-launch-vs-hard-launch-taking-a-new-product-to-market"},{"key":"e_1_3_1_96_2","doi-asserted-by":"crossref","unstructured":"SummervilleA. Mari\u00f1oJ.R.H. SnodgrassS. Onta\u00f1\u00f3nS. and LelisL.H.S. Understanding Mario: an evaluation of design metrics for platformers Proceeding of the 12th International Conference Foundations of Digital Games (2017) pp. 8.","DOI":"10.1145\/3102071.3102080"},{"key":"e_1_3_1_97_2","first-page":"257","article-title":"Procedural contentgeneration via machine learning (PCGML)","volume":"10","author":"Summerville A.","year":"2018","unstructured":"SummervilleA., SnodgrassS., GuzdialM., Holmg\u00e5rdC., HooverA.K., IsaksenA., NealenA. and TogeliusJ., Procedural contentgeneration via machine learning (PCGML), IEEE Transaction onGames 10 (2018), 257\u2013270.","journal-title":"IEEE Transaction onGames"},{"key":"e_1_3_1_98_2","unstructured":"Swagbucks (n.d.). www.swagbucks.com"},{"key":"e_1_3_1_99_2","doi-asserted-by":"crossref","unstructured":"TanC.T. BakkesS. and PisanY. Inferring player experiences using facial expressions analysis Proceeding of the ACM International Conference on Interactive Entertainment 2014.","DOI":"10.1145\/2677758.2677765"},{"key":"e_1_3_1_100_2","unstructured":"TanC.T. BakkesS. and PisanY. Correlation between facial expressions and the game experience questionnaire Proceeding of the 13th International Conference on Entertainment Computation (2014) pp. 229."},{"key":"e_1_3_1_101_2","doi-asserted-by":"crossref","unstructured":"TanC.T. RosserD. BakkesS. and PisanY. A feasibility study in using facial expressions analysis to evaluate player experiences Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System 2012.","DOI":"10.1145\/2336727.2336732"},{"key":"e_1_3_1_102_2","unstructured":"ThompsonT. \u2018With Fate Guiding My Every Move\u2019: The Challenge of Spelunky Proceeding of the Foundation of Digital Games 2015."},{"key":"e_1_3_1_103_2","doi-asserted-by":"crossref","unstructured":"TogeliusJ. KastbjergE. SchedlD. and YannakakisG.N. What is procedural content generation?: Mario on the borderline Proceeding of the 2nd International Workshop Procedural Content Generation Games (2011) pp. 3.","DOI":"10.1145\/2000919.2000922"},{"key":"e_1_3_1_104_2","doi-asserted-by":"crossref","unstructured":"VolzV. SchrumJ. LiuJ. LucasS.M. SmithA. and RisiS. Evolving mario levels in the latent space of a deep convolutional generative adversarial network Proceedings of the Genetic and Evolutionary Computation Conference (2018) pp. 221\u2013228.","DOI":"10.1145\/3205455.3205517"},{"key":"e_1_3_1_105_2","unstructured":"What are Sensors? http:\/\/manaelectron.com\/1108\/what-is-sensors\/.(accessed 27 December 2020)."},{"key":"e_1_3_1_106_2","doi-asserted-by":"crossref","unstructured":"WheatD. MasekM. LamC.P. and HingstonP. Modeling perceived difficulty in game levels Proceeding of the Australasian Computer Science Week Multiconference (2016) pp. 1\u20138.","DOI":"10.1145\/2843043.2843478"},{"key":"e_1_3_1_107_2","doi-asserted-by":"crossref","unstructured":"ZhanC. LiW. OgunbonaP. and SafaeiF. Facial Expression Recognition System for Online Games International Journal of Computation Games Technology (2008) 1\u20137.","DOI":"10.1155\/2008\/542918"},{"key":"e_1_3_1_108_2","unstructured":"ZhouX. HuangX. and WangY. Real-time facial expression recognition in the interactive game based on embedded Hidden Markov Model Proceeding of the International Conference Computation on Graphics Imaging Visuualization 2004."},{"key":"e_1_3_1_109_2","unstructured":"ZhouX. HuangX. XuB. and WangY. Real-time facial expression recognition based on boosted embedded hidden Markov model Proceeding of the Third International Conference Image on Graphics 2004."}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-219318","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-219318","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-219318","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:46:09Z","timestamp":1777455969000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-219318"}},"subtitle":[],"editor":[{"given":"Valentina Emilia","family":"Balas","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,3,10]]},"references-count":108,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,6,9]]}},"alternative-id":["10.3233\/JIFS-219318"],"URL":"https:\/\/doi.org\/10.3233\/jifs-219318","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,10]]}}}