{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,27]],"date-time":"2025-12-27T18:35:20Z","timestamp":1766860520207,"version":"3.48.0"},"reference-count":252,"publisher":"Springer Science and Business Media LLC","issue":"42","license":[{"start":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:00:00Z","timestamp":1760572800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:00:00Z","timestamp":1760572800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"DOI":"10.1007\/s11042-025-21109-1","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T14:19:54Z","timestamp":1760624394000},"page":"50729-50825","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["VGBT: Organizing Chaos with a Player-Focused Taxonomy of Video Game Bugs"],"prefix":"10.1007","volume":"84","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-7560-1023","authenticated-orcid":false,"given":"Nigar Azhar","family":"Butt","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Salman","family":"Sherin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad Uzair","family":"Khan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Atif Aftab Ahmed","family":"Jilani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad Zohaib","family":"Iqbal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"21109_CR1","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.entcom.2016.08.002","volume":"18","author":"JH B\u00e9cares","year":"2017","unstructured":"B\u00e9cares JH, Valero LC, Mart\u00edn PPG (2017) An approach to automated videogame beta testing. Entertain Comput 18:79\u201392","journal-title":"Entertain Comput"},{"key":"21109_CR2","doi-asserted-by":"crossref","unstructured":"Iftikhar S, Iqbal MZ, Khan MU, Mahmood W (2015) An automated model based testing approach for platform games. In: 2015 ACM\/IEEE 18th International conference on model driven engineering languages and systems (MODELS). IEEE, pp 426-435","DOI":"10.1109\/MODELS.2015.7338274"},{"issue":"2","key":"21109_CR3","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1109\/TG.2022.3167728","volume":"15","author":"J Pfau","year":"2022","unstructured":"Pfau J, Liapis A, Yannakakis GN, Malaka R (2022) Dungeons & replicants II: automated game balancing across multiple difficulty dimensions via deep player behaviour modeling. IEEE Trans Games 15(2):217\u2013227","journal-title":"IEEE Trans Games"},{"key":"21109_CR4","doi-asserted-by":"crossref","unstructured":"Shirzadehhajimahmood S, Prasetya ISWB, Dignum F, Dastani M (2022) An online agent-based search approach in automated computer game testing with model construction. In: Proceedings of the 13th international workshop on automating test case design, selection and evaluation pp 45-52","DOI":"10.1145\/3548659.3561309"},{"key":"21109_CR5","doi-asserted-by":"crossref","unstructured":"Bergdahl J, Gordillo C, Tollmar K, Gissl\u00e9n L (2020) Augmenting automated game testing with deep reinforcement learning. In 2020 IEEE conference on games (CoG). IEEE, pp 600-603","DOI":"10.1109\/CoG47356.2020.9231552"},{"key":"21109_CR6","doi-asserted-by":"crossref","unstructured":"Zheng Y, Xie X, Su T, Ma L, Hao J, Meng Z, Fan C (2019) Wuji: automatic online combat game testing using evolutionary deep reinforcement learning. In 2019 34th IEEE\/ACM international conference on automated software engineering (ASE). IEEE, pp 772-784","DOI":"10.1109\/ASE.2019.00077"},{"key":"21109_CR7","doi-asserted-by":"crossref","unstructured":"Schatten M, Duric BO, Tomicic I, Ivkovic N (2017) Automated mmorpg testing \u2013 an agent-based approach. In: Demazeau Y, Davidsson P, Bajo J, Vale Z (Eds) International conference on practical applications of agents and multi-agent system. Springer International Publishing, vol 10349","DOI":"10.1007\/978-3-319-59930-4_38"},{"key":"21109_CR8","doi-asserted-by":"crossref","unstructured":"Pfau J, Smeddinck JD, Malaka R (2017) Automated game testing with icarus: intelligent completion of adventure riddles via unsupervised solving. In: CHI PLAY 2017 extended abstracts-extended abstracts publication of the annual symposium on computer-human interaction in play, pp 153\u2013163","DOI":"10.1145\/3130859.3131439"},{"key":"21109_CR9","doi-asserted-by":"crossref","unstructured":"Chang K, Aytemiz B, Smith AM (2019) Reveal-more: amplifying human effort in quality assurance testing using automated exploration. In: 2019 IEEE Conference on Games(CoG)","DOI":"10.1109\/CIG.2019.8848091"},{"key":"21109_CR10","doi-asserted-by":"crossref","unstructured":"Ferdous R, Kifetew F, Prandi D, Prasetya ISWB, Shirzadehhajimahmood S, Susi A (2021) Search-based automated play testing of computer games: a model-based approach","DOI":"10.1007\/978-3-030-88106-1_5"},{"key":"21109_CR11","doi-asserted-by":"crossref","unstructured":"Chen K, Li Y, Chen Y, Fan C, Hu Z, Yang W (2021) Glib: towards automated test oracle for graphically-rich applications. In: 29th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, association for computing machinery(ACM)","DOI":"10.1145\/3468264.3468586"},{"key":"21109_CR12","doi-asserted-by":"crossref","unstructured":"Schaefer CJ, Do H (2014) Model-based exploratory testing: a controlled experiment. In: Proceedings-IEEE 7th international conference on software testing, verification and validation workshops, ICSTW 2014, IEEE Computer Society, pp 284\u2013293","DOI":"10.1109\/ICSTW.2014.31"},{"key":"21109_CR13","unstructured":"Lima P, Guerra E, Pereira NS, Meirelles P (2021) Towards automated playtesting in game development. In: Proceedings of SBGames"},{"key":"21109_CR14","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-S\u00e1nchez P, Tonda A, Mora AM, Squillero G, Merelo JJ (2018) Automated playtesting in collectible card games using evolutionary algorithms: a case study in hearthstone. Knowl-Based Syst 153","DOI":"10.1016\/j.knosys.2018.04.030"},{"key":"21109_CR15","doi-asserted-by":"crossref","unstructured":"Chen LK, Chen YH, Chang SF, Chang SC (2020) A long\/short-term memory-based automated testing model to quantitatively evaluate game design. Appl Sci (Switzerland) 10(19)","DOI":"10.3390\/app10196704"},{"key":"21109_CR16","doi-asserted-by":"crossref","unstructured":"Stahlke S, Nova A, Mirza-Babaei P (2019) Artificial playfulness: a tool for automated agent-based playtesting. In: Conference on human factors in computing systems-proceedings","DOI":"10.1145\/3290607.3313039"},{"key":"21109_CR17","doi-asserted-by":"crossref","unstructured":"Song Z (2020) An automated framework for gaming platform to test multiple games. In: ICSE-Companion","DOI":"10.1145\/3377812.3382171"},{"key":"21109_CR18","doi-asserted-by":"crossref","unstructured":"Varvaressos S, Lavoie K, Mass\u00e9 AB, Gaboury S, Hall\u00e9 S (2014) Automated bug finding in video games: a case study for runtime monitoring. In: Proceedings-IEEE 7th international conference on software testing, verification and validation, ICST 2014, pp 143\u2013152","DOI":"10.1109\/ICST.2014.27"},{"key":"21109_CR19","doi-asserted-by":"crossref","unstructured":"Tuovenen J, Oussalah M, Kostakos P (2019) Mauto: Automatic mobile game testing tool using image-matching based approach. Comput Games J 8","DOI":"10.1007\/s40869-019-00087-z"},{"issue":"1","key":"21109_CR20","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/TG.2019.2947597","volume":"13","author":"S Ariyurek","year":"2019","unstructured":"Ariyurek S, Betin-Can A, Surer E (2019) Automated video game testing using synthetic and humanlike agents. IEEE Trans Games 13(1):50\u201367","journal-title":"IEEE Trans Games"},{"key":"21109_CR21","doi-asserted-by":"crossref","unstructured":"Ariyurek S, Betin-Can A, Surer E (2020) Enhancing the Monte Carlo tree search algorithm for video game testing. In: IEEE conference on computational intelligence and games, CIG","DOI":"10.1109\/CoG47356.2020.9231670"},{"issue":"2","key":"21109_CR22","first-page":"26","volume":"17","author":"MR Taesiri","year":"2020","unstructured":"Taesiri MR, Habibi M, Fazli M (2020) A video game testing method utilizing deep learning. CSI J Comput Sci Eng 17(2):26\u201333","journal-title":"CSI J Comput Sci Eng"},{"key":"21109_CR23","doi-asserted-by":"crossref","unstructured":"Choi Y, Kim H, Park C, Jin S (2011) A case study: online game testing using massive virtual player. In: Communications in computer and information science, CCIS. vol 256","DOI":"10.1007\/978-3-642-26010-0_37"},{"key":"21109_CR24","doi-asserted-by":"crossref","unstructured":"Guerrero-Romero C, Lucas SM, Perez-Liebana D (2018) Using a team of general AI algorithms to assist game design and testing. In: 2018 IEEE conference on computational intelligence and games (CIG), IEEE, pp 1\u20138","DOI":"10.1109\/CIG.2018.8490417"},{"key":"21109_CR25","unstructured":"Cho CS, Sohn KM, Park CJ, Kang JH (2010) Online game testing using scenario-based control of massive virtual users. In: International conference on advanced communication technology, ICACT, vol 2"},{"key":"21109_CR26","doi-asserted-by":"crossref","unstructured":"Liu S, Chaoran L, Yue L et\u00a0al (2019) Automatic generation of tower defense levels using PCG. In: International conference on the foundations of digital games, ICST","DOI":"10.1145\/3337722.3337723"},{"key":"21109_CR27","doi-asserted-by":"crossref","unstructured":"Cho CS, Lee DC, Sohn KM, Park CJ, Kang JH (2010) Scenario-based approach for blackbox load testing of online game servers. In: Proceedings-2010 international conference on cyber-enabled distributed computing and knowledge discovery, CyberC 2010, pp 259\u2013265","DOI":"10.1109\/CyberC.2010.54"},{"key":"21109_CR28","doi-asserted-by":"crossref","unstructured":"Liaqat A, Sindhu MA, Siddiqui GF (2020) Metamorphic testing of an artificially intelligent chess game. IEEE Access 8","DOI":"10.1109\/ACCESS.2020.3024929"},{"key":"21109_CR29","doi-asserted-by":"crossref","unstructured":"Chen W-k, Liu C-h, Chen P-h (2016) A game framework supporting automatic functional testing for games. Appl Comput Inf Technol 727","DOI":"10.1007\/978-3-319-26396-0_2"},{"key":"21109_CR30","doi-asserted-by":"crossref","unstructured":"Nantes A, Brown R, Maire F (2008) A framework for the semi-automatic testing of video games, Proceedings of the fourth artificial intelligence and interactive digital entertainment conference","DOI":"10.1609\/aiide.v4i1.18697"},{"key":"21109_CR31","doi-asserted-by":"crossref","unstructured":"Wu Y, Chen Y, Xie X, Yu B, Fan C, Ma L (2020) Regression testing of massively multiplayer online role-playing games. In: Proceedings-2020 IEEE international conference on software maintenance and evolution, ICSME, Institute of Electrical and Electronics Engineers Inc., pp 692\u2013696","DOI":"10.1109\/ICSME46990.2020.00074"},{"key":"21109_CR32","doi-asserted-by":"crossref","unstructured":"Mozgovoy M, Pyshkin E (2017) Unity application testing automation with Appium and image recognition. In: Communications in computer and information science. Springer, Cham, vol 779, pp 139\u2013150","DOI":"10.1007\/978-3-319-71734-0_12"},{"key":"21109_CR33","unstructured":"Chan B, Denzinger J, Gates D, Loose K, Buchanan J (2004) Evolutionary behaviour testing of commercial computer games. In: Proceedings of the 2004 congress on evolutionary computation, CEC2004"},{"key":"21109_CR34","doi-asserted-by":"crossref","unstructured":"Shaker M, Shaker N, Toglius J (2013) Evolving playable content for Cut the Rope through a simulation-based approach. In: Proceedings \/ the Ninth AAAI conference on artificial intelligence and interactive digital entertainment, AAAI Press, pp 72\u201378","DOI":"10.1609\/aiide.v9i1.12690"},{"key":"21109_CR35","doi-asserted-by":"crossref","unstructured":"Shin Y, Kim J, Jin K, Kim YB (2020) Playtesting in match 3 game using strategic plays via reinforcement learning. IEEE Access 8","DOI":"10.1109\/ACCESS.2020.2980380"},{"key":"21109_CR36","first-page":"898","volume":"2","author":"G Xiao","year":"2005","unstructured":"Xiao G, Southey F, Holte RC, Wilkinson D (2005) Software testing by active learning for commercial games. Proc Natl Conf Artif Intell 2:898\u2013903","journal-title":"Proc Natl Conf Artif Intell"},{"key":"21109_CR37","doi-asserted-by":"crossref","unstructured":"Zhao H, Sun J, Hu G (2009) Study of methodology of testing mobile games based on TTCN-3. In: 2009 10th ACIS international conference on software engineering, artificial intelligence, networking and parallel\/distributed computing, IEEE","DOI":"10.1109\/SNPD.2009.26"},{"key":"21109_CR38","unstructured":"Krieger MP, Brucker AD (2011) OCL-based runtime monitoring of JVM hosted applications, vol 44"},{"key":"21109_CR39","doi-asserted-by":"crossref","unstructured":"Ahumada T, Bergel A (2020) Reproducing bugs in video games using genetic algorithms. In: IEEE games, multimedia, animation and multiple realities conference (GMAX). ISBN: 9781728161471","DOI":"10.1109\/GMAX49668.2020.9256837"},{"key":"21109_CR40","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez-S\u00e1nchez P, G\u00f3mez-Mart\u00edn MA, Gonz\u00e1lez-Calero PA, G\u00f3mez-Mart\u00edn PP (2021) Reinforcement learning methods to evaluate the impact of AI changes in game design. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment, vol 17, no 1","DOI":"10.1609\/aiide.v17i1.18885"},{"key":"21109_CR41","unstructured":"Nantes A, Brown R, Mair (2015) Measuring visual consistency in 3D rendering systems. In: Proceedings of the thirty-third australasian computer science conference, pp 43\u201352"},{"key":"21109_CR42","doi-asserted-by":"crossref","unstructured":"Stahlke SN, Mirza-Babaei P (2018) User testing without the user: opportunities and challenges of an AI-driven approach in games user research. Comput Ent 16(2)","DOI":"10.1145\/3183568"},{"key":"21109_CR43","doi-asserted-by":"crossref","unstructured":"Li X, Zhou D, Zhang L, Jing Y (2020) Human-like UI automation through automatic exploration. In: International conference on big data and artificial intelligence, ICST","DOI":"10.1145\/3436286.3436297"},{"key":"21109_CR44","doi-asserted-by":"crossref","unstructured":"Varvaressos S, Vaillancourt D, Gaboury S, Mass\u00e9 AB, Hall\u00e9 S (2013) Runtime monitoring of temporal logic properties in a platform game. In: International conference on runtime verification","DOI":"10.1007\/978-3-642-40787-1_23"},{"key":"21109_CR45","doi-asserted-by":"crossref","unstructured":"Kumar A, Kumar Purushothaman S, Singh V, Bharti A, Kashyap N (2017) Multi-game automation approach for Cocos-2d-x based card game. In: International conference on computing, communication and networking technologies (ICCCNT)","DOI":"10.1109\/ICCCNT.2017.8204091"},{"key":"21109_CR46","doi-asserted-by":"crossref","unstructured":"Wilkins B, Watkins C, Stathis K (2020) A metric learning approach to anomaly detection in video games. In: IEEE conference on computational intelligence and games, CIG, IEEE Computer Society, pp 604\u2013607","DOI":"10.1109\/CoG47356.2020.9231700"},{"key":"21109_CR47","doi-asserted-by":"crossref","unstructured":"Kazmi A, Fatima A, Idris A, Hussain S (2018) Adaptive usage statistical testing for 3D gaming applications. In: 2018 International conference on computing, electronic and electrical engineering, ICE Cube 2018, pp 1\u20136","DOI":"10.1109\/ICECUBE.2018.8610975"},{"key":"21109_CR48","doi-asserted-by":"crossref","unstructured":"Paduraru C, Paduraru M (2019) Automatic difficulty management and testing in games using a framework based on behaviour trees and genetic algorithms. In: Proceedings of the IEEE international conference on engineering of complex computer systems, ICECCS, Institute of Electrical and Electronics Engineers Inc., pp 170\u2013179","DOI":"10.1109\/ICECCS.2019.00026"},{"key":"21109_CR49","doi-asserted-by":"crossref","unstructured":"Powley EJ, Colton S, Gaudl S, Saunders R, Nelson MJ (2016) Semi-automated level design via auto-playtesting for handheld casual game creation. In: IEEE Conference on Computational Intelligence and Games","DOI":"10.1109\/CIG.2016.7860438"},{"key":"21109_CR50","doi-asserted-by":"crossref","unstructured":"Jung Y, Lim B-H, Sim K-H et\u00a0al (2004) Venus: the online game simulator using massively virtual clients. In: Asian simulation conference","DOI":"10.1007\/978-3-540-30585-9_66"},{"key":"21109_CR51","doi-asserted-by":"crossref","unstructured":"Morosan M, Poli R (2018) Lessons from testing an evolutionary automated game balancer in industry. In:IEEE Games, Entertainment, Media Conference (GEM). ISBN: 9781538663042","DOI":"10.1109\/GEM.2018.8516447"},{"key":"21109_CR52","unstructured":"Bell C, Goadrich M (2016) Automated playtesting with recycled cardstock. Game and Puzzle Design"},{"key":"21109_CR53","doi-asserted-by":"crossref","unstructured":"Toumi A, Gutierrez J, Wooldridge M (2015) A tool for the automated verification of Nash equilibria in concurrent games. In: Leucker M, Rueda C, Valencia FD (eds) International Colloquium on Theoretical Aspects of Computing. Springer International Publishing, vol 9399, pp 583\u2013594","DOI":"10.1007\/978-3-319-25150-9_34"},{"key":"21109_CR54","doi-asserted-by":"crossref","unstructured":"Jaffe A, Miller A, Andersen E, Liu Y-E, Karlin A, Popovi\u0107 ZP (2012) Evaluating competitive game balance with restricted play. In: Artificial intelligence and interactive digital entertainment conference","DOI":"10.1609\/aiide.v8i1.12513"},{"key":"21109_CR55","doi-asserted-by":"crossref","unstructured":"Preuss M, Pfeiffer T, Volz V, Pflanzl N (2018) Integrated balancing of an RTS game: case study and toolbox refinement. In: IEEE conference on computational intelligence and games (CIG)","DOI":"10.1109\/CIG.2018.8490426"},{"key":"21109_CR56","doi-asserted-by":"crossref","unstructured":"Isaksen A, Gopstein D, Togelius J, Nealen A (2018) Exploring game space of minimal action games via parameter tuning and survival analysis. IEEE Trans Games 10(2)","DOI":"10.1109\/TCIAIG.2017.2750181"},{"key":"21109_CR57","doi-asserted-by":"crossref","unstructured":"Morosan M, Poli R (2016) Automated game balancing in Ms. Pacman and Starcraft using evolutionary algorithms. In: Squillero G, Sim K (eds) European Conference on the Applications of Evolutionary Computation. Springer International Publishing, vol 10199","DOI":"10.1007\/978-3-319-55849-3_25"},{"key":"21109_CR58","doi-asserted-by":"crossref","unstructured":"Paduraru, C, Paduraru M, Stefanescu A (2022) Rivergame-a game testing tool using artificial intelligence. In: 2022 IEEE conference on software testing, verification and validation (ICST). IEEE, pp 422-432","DOI":"10.1109\/ICST53961.2022.00048"},{"key":"21109_CR59","unstructured":"Lu C, Georgescu R, Verwey J (2022) Go-explore complex 3D game environments for automated reachability testing. IEEE Trans Games"},{"key":"21109_CR60","doi-asserted-by":"crossref","unstructured":"Tufano R, Scalabrino S, Pascarella L, Aghajani E, Oliveto R, Bavota G (2022) Using reinforcement learning for load testing of video games, pp 2303\u20132314","DOI":"10.1145\/3510003.3510625"},{"key":"21109_CR61","doi-asserted-by":"crossref","unstructured":"Zhao Y, Tang E, Cai H, Guo X, Wang X, Meng N (2022) A lightweight approach of human-like playtest for Android apps, pp 309\u2013320","DOI":"10.1109\/SANER53432.2022.00047"},{"key":"21109_CR62","doi-asserted-by":"crossref","unstructured":"Feldmeier P, Fraser G (2022) Neuroevolution-based generation of tests and oracles for games, pp 1\u201313","DOI":"10.1145\/3551349.3556939"},{"key":"21109_CR63","doi-asserted-by":"crossref","unstructured":"Liu G, Cai M, Zhao L et\u00a0al (2022) Inspector: Pixel-based automated game testing via exploration, detection, and investigation, pp 237\u2013244","DOI":"10.1109\/CoG51982.2022.9893630"},{"key":"21109_CR64","doi-asserted-by":"crossref","unstructured":"DeLaurentis DA, Panchal JH, Raz AK et\u00a0al (2021) Toward automated game balance: a systematic engineering design approach, pp 1\u20138","DOI":"10.1109\/CoG52621.2021.9619032"},{"key":"21109_CR65","unstructured":"Negrao PM (2020) Automated playtesting in videogames"},{"key":"21109_CR66","unstructured":"Sriram V (2019) Automated playtesting of platformer games using reinforcement learning, Generic"},{"key":"21109_CR67","unstructured":"Loubos D (2018) Automated testing in virtual worlds (Thesis) . [Utrecht University] . https:\/\/studenttheses.uu.nl\/handle\/20.500.12932\/29741"},{"key":"21109_CR68","unstructured":"Dandey SR (2013) An automated testing tool for the virtual cell game"},{"key":"21109_CR69","unstructured":"Hooper S (2017) Automated testing and validation of computer graphics implementations for cross-platform game development"},{"key":"21109_CR70","unstructured":"Nikas A (2015) Automated GUI testing for games using pseudo-DSL"},{"key":"21109_CR71","unstructured":"Kljajic H, Karlsson O (2015) Applying automated testing in an existing client-server game: a pursuit for fault localization in Quake 3"},{"key":"21109_CR72","unstructured":"Sestini A, Gissl\u00e9n L, Bergdahl J, Tollmar K, Bagdanov AD (2022) CCPT: automatic gameplay testing and validation with curiosity-conditioned proximal trajectories"},{"key":"21109_CR73","doi-asserted-by":"crossref","unstructured":"Gordillo C, Bergdahl J, Tollmar K, Gissl\u00e9n L (2021) Improving playtesting coverage via curiosity-driven reinforcement learning agents","DOI":"10.1109\/CoG52621.2021.9619048"},{"key":"21109_CR74","doi-asserted-by":"crossref","unstructured":"John N, Gow J (2021) Adversarial behaviour debugging in a two-button fighting game, Generic","DOI":"10.1109\/CoG52621.2021.9618893"},{"key":"21109_CR75","unstructured":"Jonasson A, Nilsson J (2018) Using artificial intelligence for gameplay testing on turn-based games"},{"key":"21109_CR76","doi-asserted-by":"crossref","unstructured":"Lewis C, Whitehead J (2011) Repairing games at runtime or, how we learned to stop worrying and love emergence. IEEE Softw 28(5)","DOI":"10.1109\/MS.2011.87"},{"key":"21109_CR77","unstructured":"Zook A, Fruchter E, Riedl MO (2019) Automatic playtesting for game parameter tuning via active learning"},{"key":"21109_CR78","unstructured":"Zuo M, Schick L, Gombolay M, Gopalan N (2022) Efficient exploration via first-person behaviour cloning assisted rapidly-exploring random trees. arXiv:2203.12774"},{"key":"21109_CR79","unstructured":"(1999) Activision\u2019s Heavy Gear 2. https:\/\/bit.ly\/3rqbeBL"},{"key":"21109_CR80","unstructured":"(2015) An indie-style experiment at a AAA studio: Insomniac\u2019s Slow Down, Bull. https:\/\/bit.ly\/34egfol"},{"key":"21109_CR81","unstructured":"(2018) Another one bites the dust: dynasty feud postmortem. https:\/\/bit.ly\/3IZig6A"},{"key":"21109_CR82","unstructured":"(2012) Appy Entertainment\u2019s Spellcraft: School of Magic. https:\/\/bit.ly\/3IZigU8"},{"key":"21109_CR83","unstructured":"(2001) Baldur\u2019s Gate II: The Anatomy of a Sequel. https:\/\/bit.ly\/3IZihaE"},{"key":"21109_CR84","unstructured":"(2000) Blizzard\u2019s Diablo II. https:\/\/bit.ly\/3HsdMoJ"},{"key":"21109_CR85","unstructured":"(2007) Blue Fang\u2019s Zoo Tycoon 2: Marine Mania. https:\/\/bit.ly\/3LcO75Q"},{"key":"21109_CR86","unstructured":"(2003) Blue Tongue Software\u2019s Jurassic Park: Operation Genesis. https:\/\/bit.ly\/34xVWSq"},{"key":"21109_CR87","unstructured":"(2018) Collaborating on an Indie Sensation: Cuphead. https:\/\/bit.ly\/3uqcAyC"},{"key":"21109_CR88","unstructured":"(2003) Disney Online\u2019s Toontown. https:\/\/bit.ly\/3Grf167"},{"key":"21109_CR89","unstructured":"(1998) Dreamforge\u2019s Sanitarium. https:\/\/bit.ly\/3rpbhxK"},{"key":"21109_CR90","unstructured":"(1999) DreamWorks Interactive\u2019s Trespasser. https:\/\/bit.ly\/3rqWp24"},{"key":"21109_CR91","unstructured":"(2013) Drinkbox Studios\u2019 Guacamelee! https:\/\/bit.ly\/34lqfvU"},{"key":"21109_CR92","unstructured":"(2000) Ensemble Studios\u2019 Age of Empires II: Age of Kings. https:\/\/bit.ly\/35OfMd0"},{"key":"21109_CR93","unstructured":"(2007) Freeverse\u2019s Marathon 2: Durandal. https:\/\/bit.ly\/34fmus0"},{"key":"21109_CR94","unstructured":"(2009) Freeverse\u2019s Top Gun for iPhone. https:\/\/bit.ly\/3ooAIxB"},{"key":"21109_CR95","unstructured":"(2002) Game Kitchen\u2019s Wireless Pets. https:\/\/bit.ly\/3op8p26"},{"key":"21109_CR96","unstructured":"(2019) Hero-U: Rogue to Redemption Postmortem. https:\/\/bit.ly\/3opx3zt"},{"key":"21109_CR97","unstructured":"(2000) Ion Storm\u2019s Deus Ex. https:\/\/bit.ly\/3AXGj2P"},{"key":"21109_CR98","unstructured":"(2008) Ironclad\/Stardock\u2019s Sins of a Solar Empire. https:\/\/bit.ly\/3oo9M0Y"},{"key":"21109_CR99","unstructured":"(1999) Irrational Games\u2019 System Shock 2. https:\/\/bit.ly\/3Hx4TtZ"},{"key":"21109_CR100","unstructured":"(2001) LucasArts\u2019 Star Wars: Starfighter. https:\/\/bit.ly\/3Hr9QEt"},{"key":"21109_CR101","unstructured":"(2012) McMillen and Hims\u2019s The Binding of Isaac. https:\/\/bit.ly\/3GEbced"},{"key":"21109_CR102","unstructured":"(2001) Micro Forte\u2019s Fallout Tactics. https:\/\/bit.ly\/34h3yJs"},{"key":"21109_CR103","unstructured":"(2005) Mind Control\u2019s Oasis. https:\/\/bit.ly\/3umseuz"},{"key":"21109_CR104","unstructured":"(2012) Mode 7 Games\u2019 Frozen Synapse. https:\/\/bit.ly\/3ooWVLY"},{"key":"21109_CR105","unstructured":"(1999) Multitude\u2019s Fireteam. https:\/\/bit.ly\/3gnnyMX"},{"key":"21109_CR106","unstructured":"(2003) Nayantara\u2019s Star Chamber. https:\/\/bit.ly\/3onQgl0"},{"key":"21109_CR107","unstructured":"(2001) Ngames\u2019 Chop Suey Kung Fu. https:\/\/bit.ly\/3GlDR7n"},{"key":"21109_CR108","unstructured":"(2009) Ninjabees\u2019 A Kingdom for Keflings. https:\/\/bit.ly\/3sgtM6P"},{"key":"21109_CR109","unstructured":"(2001) Operation Flashpoint. https:\/\/bit.ly\/3GqF1yw"},{"key":"21109_CR110","unstructured":"(2010) Over the Top Games\u2019 NyxQuest: Kindred Spirits. https:\/\/bit.ly\/3rsH9lk"},{"key":"21109_CR111","unstructured":"(2013) Pangalore\u2019s Knightly Adventure. https:\/\/bit.ly\/3LcO7mm"},{"key":"21109_CR112","unstructured":"(2010) Pipeworks Software\u2019s Deadliest Warrior. https:\/\/bit.ly\/3seWRzE"},{"key":"21109_CR113","unstructured":"(2002) Pixelogic\u2019s The Italian Job. https:\/\/bit.ly\/3J3JwRu"},{"key":"21109_CR114","unstructured":"(2017) Poncho: A Postmortem. https:\/\/bit.ly\/3GtfRiR"},{"key":"21109_CR115","unstructured":"(2005) Postcard from GDC Europe 2005: the first generation of the next generation: a project gotham racing 3 postmortem. https:\/\/bit.ly\/3rrcSDg"},{"key":"21109_CR116","unstructured":"(2007) Postmortem: sniper studios\u2019 crazy taxi fare wars. https:\/\/bit.ly\/3uFEA1l"},{"key":"21109_CR117","unstructured":"(2015) Postmortem: E-Line Media and Upper One Games\u2019 Never Alone. https:\/\/bit.ly\/3rocBRE"},{"key":"21109_CR118","unstructured":"(1999) Postmortem: Presto Studios\u2019 Star Trek: Hidden Evil. https:\/\/bit.ly\/34lqfMq"},{"key":"21109_CR119","unstructured":"(2002) Presto\u2019s Whacked! https:\/\/bit.ly\/3AXCWJo"},{"key":"21109_CR120","unstructured":"(1999) Raven Software\u2019s Heretic II. https:\/\/bit.ly\/3roKNMJ"},{"key":"21109_CR121","unstructured":"(2009) Realtime Worlds\u2019 Crackdown. https:\/\/bit.ly\/3LbMaXh"},{"key":"21109_CR122","unstructured":"(2000) Red Storm\u2019s Rainbow Six. https:\/\/bit.ly\/3rmDTI2"},{"key":"21109_CR123","unstructured":"(2016) R\u00e9publique. https:\/\/bit.ly\/3uoqCAB"},{"key":"21109_CR124","unstructured":"(2008) Saber interactive\u2019s timeshift. https:\/\/bit.ly\/35HToSl"},{"key":"21109_CR125","unstructured":"(2000) Sierra studios\u2019 gabriel knight 3. https:\/\/bit.ly\/3goEkeI"},{"key":"21109_CR126","unstructured":"(2012) Sony bend studios\u2019 uncharted: golden abyss. https:\/\/bit.ly\/3uqcJSG"},{"key":"21109_CR127","unstructured":"(2012) Stardock entertainment and ironclad games\u2019 sins of a solar empire: rebellion. https:\/\/bit.ly\/34bNF7c"},{"key":"21109_CR128","unstructured":"(2006) Stardock\u2019s galactic civilizations II: dread lords. https:\/\/bit.ly\/3smLB4m"},{"key":"21109_CR129","unstructured":"(2004) Stardock\u2019s The Political Machine. https:\/\/bit.ly\/35HTpFT"},{"key":"21109_CR130","unstructured":"(2014) Starting from scratch: haemimont games\u2019 tropico 5 postmortem. https:\/\/bit.ly\/3J8n21P"},{"key":"21109_CR131","unstructured":"(2005) Student Postmortem: 6msoft\u2019s Romeo and Juliet. https:\/\/bit.ly\/3L916Ft"},{"key":"21109_CR132","unstructured":"(1999) Surreal software\u2019s drakan: order of the flame. https:\/\/bit.ly\/3Gl8uKp"},{"key":"21109_CR133","unstructured":"(2011) Team meat\u2019s super meat boy. https:\/\/bit.ly\/3GqF1P2"},{"key":"21109_CR134","unstructured":"(2014) The Chinese room\u2019s amnesia: a machine for pigs. https:\/\/bit.ly\/3utZZKz"},{"key":"21109_CR135","unstructured":"(2004) The Game Design of Surreal\u2019s The Suffering. https:\/\/bit.ly\/3oqHt21"},{"key":"21109_CR136","unstructured":"(2003) Tom Clancy\u2019s Splinter Cell. https:\/\/bit.ly\/3scvXbD"},{"key":"21109_CR137","unstructured":"(2008) Torpex Games\u2019 Schizoid. https:\/\/bit.ly\/3J3va3k"},{"key":"21109_CR138","unstructured":"Ty the Tasmanian Tiger 2 for the Younger Market, 2005. [Online]. Available: https:\/\/bit.ly\/3IWQhnY"},{"key":"21109_CR139","unstructured":"(2000) Vampire: the masquerade - redemption. https:\/\/bit.ly\/3upjuDX"},{"key":"21109_CR140","unstructured":"(2012) Zachtronics industries\u2019 spacechem. https:\/\/bit.ly\/3sj0CUr"},{"key":"21109_CR141","unstructured":"Foddy B (2015) Designing with physics - bend the physics engine to your will (Game Developers Conference (GDC)). https:\/\/bit.ly\/3sjxTio"},{"key":"21109_CR142","unstructured":"Saint-Pierre R (2013) Time Where it matters - friction free bug reporting (Game Developers Conference (GDC)). https:\/\/bit.ly\/3Gp7dSr"},{"key":"21109_CR143","unstructured":"Anguelov B, Sunzhine-Hill B (2013) Managing the movement - getting your animation behaviors to behave better (Game Developers Conference (GDC)). https:\/\/bit.ly\/3ooeSdL"},{"key":"21109_CR144","unstructured":"Madej M (2014) Challenges of designing multiplayer games (Digital Dragons). https:\/\/bit.ly\/3opMg3x"},{"key":"21109_CR145","unstructured":"\u0179ywiczy\u0144ski B (2018) Upgrading the production toolbelt - from this war of mine to frostpunk (Digital Dragons). https:\/\/bit.ly\/3J7j6hL"},{"key":"21109_CR146","unstructured":"Game-breaking glitches, (WK). https:\/\/bit.ly\/3okWTF2"},{"key":"21109_CR147","unstructured":"Game breaking bug, (WK). https:\/\/bit.ly\/3GkZu7W"},{"key":"21109_CR148","unstructured":"Metroid dread has a game-breaking bug: here\u2019s how to avoid it, (N). https:\/\/bit.ly\/3GqiJgy"},{"key":"21109_CR149","unstructured":"10 Infamous game breaking bugs in famous video games, (B). https:\/\/bit.ly\/3unigcz"},{"key":"21109_CR150","unstructured":"5 Worst game-breaking bugs of all time, (B). https:\/\/bit.ly\/3IWRbRo"},{"key":"21109_CR151","unstructured":"Pok\u00e9mon unite politely asks players to stop using game-breaking bug, (B). https:\/\/bit.ly\/3Hr0LvG"},{"key":"21109_CR152","unstructured":"Halo infinite has a save game-breaking bug that needs to be fixed, (B). https:\/\/bit.ly\/3skm23T"},{"key":"21109_CR153","unstructured":"Destiny 2 game-breaking glitch surfaces, bungie starts handing out bans, (B). https:\/\/bit.ly\/3goNjwo"},{"key":"21109_CR154","unstructured":"Game breaking bug in apex legends makes players invulnerable while reviving, (N). https:\/\/bit.ly\/3sguMrB"},{"key":"21109_CR155","unstructured":"New world\u2019s latest patch has brought 2 game-breaking bugs to healing and the auction house, (N). https:\/\/bit.ly\/3gqo6Sh"},{"key":"21109_CR156","unstructured":"Assassin\u2019s creed: valhalla has game-breaking bug four months after release despite recent update, (N). https:\/\/bit.ly\/3GEc5n3"},{"key":"21109_CR157","unstructured":"Call of Duty: Warzone\u2019s biggest game-breaking bug is back, (B). https:\/\/bit.ly\/3LcPb9Q"},{"key":"21109_CR158","unstructured":"\u2018Cyberpunk 2077\u2019 update introduced a game-breaking bug, (B). https:\/\/engt.co\/3oqjpfz"},{"key":"21109_CR159","unstructured":"Three game-breaking bugs still present in the game, (B). https:\/\/bit.ly\/32WO5O5"},{"key":"21109_CR160","unstructured":"Vanguard players demand fix to \u2018game-breaking\u2019 dead drop glitch, (B). https:\/\/bit.ly\/3ATWyy4"},{"key":"21109_CR161","unstructured":"Game-breaking bug on war! (F). https:\/\/bit.ly\/3gkuAC4"},{"key":"21109_CR162","unstructured":"New world invincibility exploit discovered and it\u2019s game-breaking, (N). https:\/\/bit.ly\/3GvyRNE"},{"key":"21109_CR163","unstructured":"Game-breaking apex legends bug is making ash\u2019s phase ultimate useless, (N). https:\/\/bit.ly\/3AVdsMC"},{"key":"21109_CR164","unstructured":"Possible game-breaking bug discovered in fallout 4, (N). https:\/\/bit.ly\/3umttKf"},{"key":"21109_CR165","unstructured":"Game-breaking bug in soma safe mode (Epic Store), (F). https:\/\/bit.ly\/3AUIvs9"},{"key":"21109_CR166","unstructured":"This is the most game breaking bug i\u2019ve ever seen - (YouTube). https:\/\/bit.ly\/3GlF7r7"},{"key":"21109_CR167","unstructured":"10 Recent worst game breaking glitches - (YouTube). https:\/\/bit.ly\/3AYTJvq"},{"key":"21109_CR168","unstructured":"Top 10 worst game breaking glitches - (YouTube). https:\/\/bit.ly\/3AYTKzu"},{"key":"21109_CR169","unstructured":"Top 10 worst game breaking glitches - (YouTube). https:\/\/bit.ly\/3Lb60Sa"},{"key":"21109_CR170","unstructured":"New world game breaking bug needs to be fixed ASAP! - (YouTube). https:\/\/bit.ly\/34xq40y"},{"key":"21109_CR171","unstructured":"Massive game breaking glitch in fortnite! - (YouTube). https:\/\/bit.ly\/3LcPqlg"},{"key":"21109_CR172","unstructured":"Blizzard has to fix this game breaking bug now! - (YouTube). https:\/\/bit.ly\/3rzRfAZ"},{"key":"21109_CR173","unstructured":"5 Game breaking glitches that bricked your console - fact hunt - Larry Bundy Jr - (YouTube). https:\/\/bit.ly\/3AWESSk"},{"key":"21109_CR174","unstructured":"Fallout 4 game-breaking bug discovered - GS news update - (YouTube). https:\/\/bit.ly\/34lrOdg"},{"key":"21109_CR175","unstructured":"Top 5 game breaking bugs and exploits in overwatch - (YouTube). https:\/\/bit.ly\/3uFG8sb"},{"key":"21109_CR176","unstructured":"New world game breaking bug deletes hours of gameplay! - (YouTube). https:\/\/bit.ly\/3omVy08"},{"key":"21109_CR177","unstructured":"New game breaking bug is truly awful... maybe don\u2019t play ranked RN - Pok\u00e9mon Unite - (YouTube). https:\/\/bit.ly\/3LbNkSD"},{"key":"21109_CR178","unstructured":"Wtf New Game Breaking Bug - Unlimited Gold Abuse Glitch - 7.29 Patch Dota 2 - (YouTube). https:\/\/bit.ly\/3gtJXrL"},{"key":"21109_CR179","unstructured":"Fallout 76\u2019s latest update adds in a major game breaking bug - (YouTube). https:\/\/bit.ly\/3ro7aSI"},{"key":"21109_CR180","unstructured":"The most game breaking bug of all time - (YouTube). https:\/\/bit.ly\/3L8Q1UV"},{"key":"21109_CR181","unstructured":"Season 11 gamebreaking bug #954 - (YouTube). https:\/\/bit.ly\/3B0DjCT"},{"key":"21109_CR182","unstructured":"The game breaking bugs that closed classic - (YouTube). https:\/\/bit.ly\/3Gr8rwo"},{"key":"21109_CR183","unstructured":"Game breaking bug gets you banned in Destiny 2! - (YouTube). https:\/\/bit.ly\/3GpPOJu"},{"key":"21109_CR184","unstructured":"There is a game breaking glitch in Sword and Shield... - (YouTube). https:\/\/bit.ly\/3J3wovs"},{"key":"21109_CR185","unstructured":"Minecraft\u2019s most game breaking glitches... - (YouTube). https:\/\/bit.ly\/36pvj37"},{"key":"21109_CR186","unstructured":"Is it worse post 1.1 patch? - game breaking bugs and glitches - Cyberpunk 2077 (Down on the Street) - (YouTube). https:\/\/bit.ly\/3BbbZCh"},{"key":"21109_CR187","unstructured":"Bug that crashed LCS game! Taliyah\/Karthus gamebreaking bug investigation! - (YouTube). https:\/\/bit.ly\/3siXxno"},{"key":"21109_CR188","unstructured":"Game-breaking glitch discovered in Paper Mario: The Origami King. Here\u2019s how to avoid it! - (YouTube). https:\/\/bit.ly\/3HtfyWE"},{"key":"21109_CR189","unstructured":"The wheelchair paladin [gamebreaking bug] - (YouTube). https:\/\/bit.ly\/3sj2yfF"},{"key":"21109_CR190","unstructured":"Dobrilova T (2021) How much is the gaming industry worth in 2021? https:\/\/techjury.net\/blog\/gaming-industry-worth\/#gref"},{"key":"21109_CR191","doi-asserted-by":"crossref","unstructured":"Politowski C, Petrillo F, Gu\u00e9h\u00e9neuc Y-G (2021) A survey of video game testing. In: 2021 IEEE\/ACM International Conference on Automation of Software Test(AST). IEEE, pp 90\u201399","DOI":"10.1109\/AST52587.2021.00018"},{"key":"21109_CR192","unstructured":"Lancaster M (2022) Cyberpunk 2077 makes cd projekt lose 75% of its market value. https:\/\/www.gizchina.com\/2022\/07\/19\/cyberpunk-2077-makes-cd-projekt-lose-75-of-its-market-value\/"},{"key":"21109_CR193","doi-asserted-by":"publisher","first-page":"106538","DOI":"10.1016\/j.infsof.2021.106538","volume":"134","author":"C Politowski","year":"2021","unstructured":"Politowski C, Petrillo F, Ullmann GC, Gu\u00e9h\u00e9neuc Y-G (2021) Game industry problems: an extensive analysis of the gray literature. Inf Softw Technol 134:106538","journal-title":"Inf Softw Technol"},{"key":"21109_CR194","unstructured":"Schultz CP, Bryant RD (2016) Game testing: all in one. Mercury learning and information"},{"key":"21109_CR195","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1007\/s10664-018-9627-4","volume":"24","author":"D Lin","year":"2019","unstructured":"Lin D, Bezemer C-P, Zou Y, Hassan AE (2019) An empirical study of game reviews on the steam platform. Empir Softw Eng 24:170\u2013207","journal-title":"Empir Softw Eng"},{"issue":"3","key":"21109_CR196","first-page":"94","volume":"32","author":"F Michael","year":"2014","unstructured":"Michael F, Armin B (2014) Using defect taxonomies for testing requirements. IEEE Softw 32(3):94\u2013101","journal-title":"IEEE Softw"},{"key":"21109_CR197","unstructured":"Marchetto A, Ricca F, Tonella P (2009) An empirical validation of a web fault taxonomy and its usage for web testing. J Web Eng 316\u2013345"},{"key":"21109_CR198","doi-asserted-by":"crossref","unstructured":"Lewis C, Whitehead J, Wardrip-Fruin N (2010) What went wrong: A taxonomy of video game bugs. In: Proceedings of the fifth international conference on the foundations of digital games","DOI":"10.1145\/1822348.1822363"},{"key":"21109_CR199","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.jss.2019.03.002","volume":"152","author":"C Gemma","year":"2019","unstructured":"Gemma C, Fabio P, Andy Z, Filomena F (2019) Not all bugs are the same: Understanding, characterizing, and classifying bug types. J Syst Softw 152:165\u2013181","journal-title":"J Syst Softw"},{"issue":"3","key":"21109_CR200","doi-asserted-by":"publisher","first-page":"e1804","DOI":"10.1002\/stvr.1804","volume":"32","author":"Y Wang","year":"2022","unstructured":"Wang Y, M\u00e4ntyl\u00e4 MV, Liu Z, Markkula J, Raulamo-jurvanen P (2022) Improving test automation maturity: a multivocal literature review. Softw Test Verif Reliab 32(3):e1804","journal-title":"Softw Test Verif Reliab"},{"key":"21109_CR201","unstructured":"International Organization for Standardization (2023) ISO\/IEC 25010:2023 systems and software engineering \u2014 Systems and software Quality Requirements and Evaluation (SQuaRE) \u2014 System and software quality models"},{"key":"21109_CR202","unstructured":"International Software Testing\u00a0Qualifications Board (2022) Certified tester game testing (ct-gt) syllabus. Accessed: 24-Feb-2025"},{"key":"21109_CR203","unstructured":"Institute of Electrical and Electronics Engineers (2009) IEEE Standard Classification for Software Anomalies"},{"key":"21109_CR204","doi-asserted-by":"crossref","unstructured":"Washburn\u00a0Jr M, Sathiyanarayanan P, Nagappan M, Zimmermann T, Bird C (2016) What went right and what went wrong: an analysis of 155 postmortems from game development. In: Proceedings of the 38th international conference on software engineering companion, pp 280\u2013289","DOI":"10.1145\/2889160.2889253"},{"issue":"2","key":"21109_CR205","doi-asserted-by":"publisher","first-page":"e70001","DOI":"10.1002\/stvr.70001","volume":"35","author":"A Roque","year":"2025","unstructured":"Roque A, Sotomayor JP, Santiago D, Clarke PJ (2025) A literature review of software testing practices and frameworks in the video gaming industry. Softw Test Verif Reliab 35(2):e70001","journal-title":"Softw Test Verif Reliab"},{"key":"21109_CR206","doi-asserted-by":"crossref","unstructured":"Coppola R, Fulcini T, Strada F (2024) Know your bugs: A survey of issues in automated game testing literature. In: 2024 IEEE gaming, entertainment, and media conference (GEM). IEEE, pp 1\u20136","DOI":"10.1109\/GEM61861.2024.10585558"},{"key":"21109_CR207","doi-asserted-by":"crossref","unstructured":"Truelove A, de\u00a0Almeida ES, Ahmed I (2021) We\u2019ll fix it in post: What do bug fixes in video game update notes tell us? In: 2021 IEEE\/ACM 43rd international conference on software engineering (ICSE). IEEE, pp 736\u2013747","DOI":"10.1109\/ICSE43902.2021.00073"},{"issue":"4","key":"21109_CR208","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3563214","volume":"32","author":"V Nardone","year":"2023","unstructured":"Nardone V, Muse B, Abidi M, Khomh F, Di Penta M (2023) Video game bad smells: what they are and how developers perceive them. ACM Trans Softw Eng Methodol 32(4):1\u201335","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"21109_CR209","volume-title":"A diagnostic taxonomy of failure in videogames","author":"A Batu","year":"2020","unstructured":"Batu A, Smith AM (2020) A diagnostic taxonomy of failure in videogames. Pervasive Computing Technologies for Healthcare, PervasiveHealth"},{"key":"21109_CR210","doi-asserted-by":"crossref","unstructured":"Cuerdo MAM, Mahajan A, Mao J, Melcer EF (2023) Try again?: a macro-level taxonomy of the challenge and failure process in games. In: 2023 IEEE conference on games (CoG). IEEE, pp 1\u20138","DOI":"10.1109\/CoG57401.2023.10333199"},{"issue":"6","key":"21109_CR211","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-022-10158-x","volume":"27","author":"Z Li","year":"2022","unstructured":"Li Z, Wu Y, Ma L, Xie X, Chen Y, Fan C (2022) Gbgallery: a benchmark and framework for game testing. Empir Softw Eng 27(6):1\u201327","journal-title":"Empir Softw Eng"},{"key":"21109_CR212","unstructured":"Mangia L, Paiano R (2004) Challenges for network computer games. In: Proceedings of the IADIS international conference. IADIS"},{"key":"21109_CR213","doi-asserted-by":"crossref","unstructured":"Adams RJ, Smart P, Huff AS (2017) Shades of grey: guidelines for working with the grey literature in systematic reviews for management and organizational studies. In: International journal of management reviews, vol\u00a019","DOI":"10.1111\/ijmr.12102"},{"key":"21109_CR214","doi-asserted-by":"crossref","unstructured":"Justesen N, Bontrager P, Togelius J, Risi S (2020) Deep learning for video game playing. IEEE Trans Games 12","DOI":"10.1109\/TG.2019.2896986"},{"key":"21109_CR215","unstructured":"Kitchenham B, Charters S et\u00a0al (2007) Guidelines for performing systematic literature reviews in software engineering"},{"key":"21109_CR216","doi-asserted-by":"crossref","unstructured":"Petersen K, Feldt R, Mujtaba S, Mattsson M (2008) Systematic mapping studies in software engineering. In: 12th international conference on evaluation and assessment in software engineering (EASE). BCS Learning & Development","DOI":"10.14236\/ewic\/EASE2008.8"},{"key":"21109_CR217","doi-asserted-by":"publisher","first-page":"111261","DOI":"10.1016\/j.jss.2022.111261","volume":"188","author":"A Aghyad","year":"2022","unstructured":"Aghyad A, Moataz A (2022) A co-evolutionary genetic algorithms approach to detect video game bugs. J Syst Softw 188:111261","journal-title":"J Syst Softw"},{"key":"21109_CR218","doi-asserted-by":"crossref","unstructured":"De Mesentier\u00a0Silva F, Lee S, Togelius J, Nealen A (2017) Ai-based playtesting of contemporary board games. In: ACM international conference proceeding series. Association for Computing Machinery, vol F130151","DOI":"10.1145\/3102071.3102105"},{"key":"21109_CR219","doi-asserted-by":"crossref","unstructured":"Schatten M, Tomicic I, Bogdan OD, Ivkovic N (2017) Towards an agent-based automated testing environment for massively multi-player role playing games. In: 2017 40th International convention on information and communication technology, Electronics and Microelectronics (MIPRO). IEEE","DOI":"10.23919\/MIPRO.2017.7973597"},{"key":"21109_CR220","unstructured":"Schatten M, \u0110uri\u0107 BO, Tomi\u010di\u0107 I (2018) Towards an application programming interface for automated testing of artificial intelligence agents in massively multi-player on-line role-playing games. In: Central European conference on information and intelligent systems"},{"key":"21109_CR221","doi-asserted-by":"crossref","unstructured":"Lovreto G, Endo AT, Nardi P, Durelli VHS (2018) Automated tests for mobile games: an experience report. In: 17th Brazilian Symposium on Computer Games","DOI":"10.1109\/SBGAMES.2018.00015"},{"key":"21109_CR222","doi-asserted-by":"crossref","unstructured":"De Mesentier F, Igor BS, Kolen J, Aghdaie N, Zaman K (2018) Exploring gameplay with ai agents. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment, vol 14, pp 159\u2013165","DOI":"10.1609\/aiide.v14i1.13034"},{"key":"21109_CR223","unstructured":"Isaksen A, Gopstein D, Nealen A (2015) Exploring game space using survival analysis. FDG"},{"key":"21109_CR224","unstructured":"Butt NA, Sherin S, Jilani AA, Khan MU, Iqbal MZ (2025) Data for deriving and evaluating a detailed taxonomy of game bugs, Vgbt"},{"key":"21109_CR225","doi-asserted-by":"crossref","unstructured":"Zhou Y, Zhang H, Huang X, Yang S, Babar MA, Tang H (2015) Quality assessment of systematic reviews in software engineering: A tertiary study. In: Proceedings of the 19th international conference on evaluation and assessment in software engineering, pp 1\u201314","DOI":"10.1145\/2745802.2745815"},{"key":"21109_CR226","doi-asserted-by":"crossref","unstructured":"Tebes G, Peppino D, Becker P, Matturro G, Solari M, Olsina L (2019) A systematic review on software testing ontologies. In: Quality of Information and Communications Technology: 12th International Conference, QUATIC 2019, Ciudad Real, Spain, September 11\u201313, 2019, Proceedings 12. Springer, pp 144\u2013160","DOI":"10.1007\/978-3-030-29238-6_11"},{"key":"21109_CR227","doi-asserted-by":"crossref","unstructured":"Politowski C, Petrillo F, Ullmann GC, De\u00a0Andrade\u00a0Werly J, Gu\u00e9h\u00e9neuc YG (2020) Dataset of video game development problems. In: Proceedings-2020 IEEE\/ACM 17th International Conference on Mining Software Repositories, MSR 2020","DOI":"10.1145\/3379597.3387486"},{"key":"21109_CR228","doi-asserted-by":"crossref","unstructured":"Bajwa SS, Wang X, Nguyen\u00a0Duc A, Abrahamsson P (2017) Failures to be celebrated: an analysis of major pivots of software startups. Empir Softw Eng 22","DOI":"10.1007\/s10664-016-9458-0"},{"key":"21109_CR229","doi-asserted-by":"crossref","unstructured":"Lin D, Bezemer C-P, Hassan AE (2019) Identifying gameplay videos that exhibit bugs in computer games. Empir Softw Eng","DOI":"10.1007\/s10664-019-09733-6"},{"key":"21109_CR230","unstructured":"IEC ISO and N\u00a0IEC. Iso\/iec (2017) IEEE International Standard-Systems and software engineering\u2013Vocabulary\u201324765-2017, pp 1\u2013541"},{"key":"21109_CR231","unstructured":"Schell J (2008) The art of game design: a book of lenses. CRC press"},{"key":"21109_CR232","unstructured":"Zubek R (2020) Elements of game design. MIT Press"},{"issue":"2","key":"21109_CR233","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1109\/TSE.2011.26","volume":"38","author":"M Unterkalmsteiner","year":"2011","unstructured":"Unterkalmsteiner M, Gorschek T, Islam AKMM, Cheng CK, Permadi RB, Feldt R (2011) Evaluation and measurement of software process improvement\u2013a systematic literature review. IEEE Trans Softw Eng 38(2):398\u2013424","journal-title":"IEEE Trans Softw Eng"},{"key":"21109_CR234","doi-asserted-by":"crossref","unstructured":"Punter T, Ciolkowski M, Freimut B, John I (2003) Conducting on-line surveys in software engineering. In: 2003 International symposium on empirical software engineering, 2003. ISESE 2003. Proceedings. IEEE, pp 80\u201388","DOI":"10.1109\/ISESE.2003.1237967"},{"issue":"1","key":"21109_CR235","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11219-022-09585-2","volume":"31","author":"D Torre","year":"2023","unstructured":"Torre D, Genero M, Labiche Y, Elaasar M (2023) How consistency is handled in model-driven software engineering and uml: an expert opinion survey. Softw Qual J 31(1):1\u201354","journal-title":"Softw Qual J"},{"issue":"5","key":"21109_CR236","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1007\/s10664-022-10134-5","volume":"27","author":"O Springer","year":"2022","unstructured":"Springer O, Miler J (2022) A comprehensive overview of software product management challenges. Empir Softw Eng 27(5):106","journal-title":"Empir Softw Eng"},{"key":"21109_CR237","doi-asserted-by":"crossref","unstructured":"Chakraborty P, Shahriyar R, Iqbal A, Bosu A (2018) Understanding the software development practices of blockchain projects: a survey. In: Proceedings of the 12th ACM\/IEEE international symposium on empirical software engineering and measurement, pp 1\u201310","DOI":"10.1145\/3239235.3240298"},{"key":"21109_CR238","unstructured":"Brown S (2010) Likert scale examples for surveys"},{"key":"21109_CR239","doi-asserted-by":"crossref","unstructured":"Zhao X, Xia X, Kochhar PS, Lo D, Li S (2014) An empirical study of bugs in build process. In: Proceedings of the 29th annual ACM symposium on applied computing, pp 1187\u20131189","DOI":"10.1145\/2554850.2555142"},{"key":"21109_CR240","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.infsof.2019.07.009","volume":"115","author":"LA Gomes","year":"2019","unstructured":"Gomes LA, da Silva Torres R, C\u00f4rtes ML (2019) Bug report severity level prediction in open source software: a survey and research opportunities. Inf Softw Technol 115:58\u201378","journal-title":"Inf Softw Technol"},{"key":"21109_CR241","unstructured":"Hess J, Singer E (1995) The role of respondent debriefing questions in questionnaire development. US Bureau of the Census"},{"key":"21109_CR242","doi-asserted-by":"publisher","first-page":"206235","DOI":"10.1109\/ACCESS.2020.3035410","volume":"8","author":"S Imtiaz","year":"2020","unstructured":"Imtiaz S, Ikram N (2020) Framework for task allocation in global software development. IEEE Access 8:206235\u2013206247","journal-title":"IEEE Access"},{"key":"21109_CR243","unstructured":"Dolcini S (2024) 0 A.D.: Reviving History in Real-Time, in FOSS! Interview published by Linux Professional Institute"},{"key":"21109_CR244","unstructured":"Madej M (2014) Challenges of designing multiplayer games(digital dragons)"},{"key":"21109_CR245","unstructured":"Albaghajati AM, Ahmed MAK (2020) Video game automated testing approaches: an assessment framework. IEEE Trans Games"},{"issue":"5","key":"21109_CR246","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1022494.1022541","volume":"29","author":"L Briand","year":"2004","unstructured":"Briand L, Labiche Y (2004) Empirical studies of software testing techniques: challenges, practical strategies, and future research. ACM SIGSOFT Softw Eng Notes 29(5):1\u20133","journal-title":"ACM SIGSOFT Softw Eng Notes"},{"issue":"3","key":"21109_CR247","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1080\/17511321.2020.1796773","volume":"15","author":"M Hemmingsen","year":"2021","unstructured":"Hemmingsen M (2021) Code is law: subversion and collective knowledge in the ethos of video game speedrunning. Sport, Ethics Philos 15(3):435\u2013460","journal-title":"Sport, Ethics Philos"},{"key":"21109_CR248","unstructured":"Lough DL (2001) A taxonomy of computer attacks with applications to wireless networks. Virginia Polytechnic Institute and State University"},{"key":"21109_CR249","unstructured":"Atlassian (2024) JIRA: issue and project tracking software. Accessed: 3-March-2025"},{"key":"21109_CR250","unstructured":"Mozilla Foundation (2024) Bugzilla: bug tracking system. Accessed: 3-March-2025"},{"key":"21109_CR251","doi-asserted-by":"crossref","unstructured":"O\u2019Shea Z, Freeman J (2019) Game design frameworks: where do we start? In Proceedings of the 14th International Conference on the Foundations of Digital Games, pp 1\u201310","DOI":"10.1145\/3337722.3337753"},{"key":"21109_CR252","unstructured":"Butt NA, Sherin S, Khan MU, Jilani AA, Iqbal MZ (2023) Deriving and evaluating a detailed taxonomy of game bugs. arXiv:2311.16645"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-025-21109-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-025-21109-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-025-21109-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,27]],"date-time":"2025-12-27T18:34:46Z","timestamp":1766860486000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-025-21109-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":252,"journal-issue":{"issue":"42","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["21109"],"URL":"https:\/\/doi.org\/10.1007\/s11042-025-21109-1","relation":{},"ISSN":["1573-7721"],"issn-type":[{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2 January 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors report that there are no competing interests to declare. The authors disclose that a nearly identical version of this work was previously shared as a preprint on arXiv under the title \u201cDeriving and Evaluating a Detailed Taxonomy of Game Bugs\u201d [\n                      \n                      ], available at\n                      \n                      . The current submission includes updates and revisions to improve clarity and align with journal formatting requirements.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure statement"}},{"value":"The survey validating the game bug taxonomy received approval from the Research Ethics Committee (REC) at the National University of Computer and Emerging Sciences (NUCES), ensuring strict adherence to ethical guidelines for research involving human participants, including anonymity and informed consent. The certificate reference number is REC-2023\/02\/001.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Survey submission by participants was considered as implied consent to participate in the study. All participants were informed about the study\u2019s purpose, and their responses were anonymized to ensure confidentiality.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"All participants were informed that the aggregated, anonymized findings of the study would be published in academic outputs such as journals or conference proceedings. Consent for publication of these findings was implicitly provided through survey submission.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Publish"}},{"value":"The authors declare that they have no competing interests related to this study.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}