{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:22:24Z","timestamp":1750220544913,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":17,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,26]],"date-time":"2021-06-26T00:00:00Z","timestamp":1624665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSERC"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,26]]},"DOI":"10.1145\/3449639.3459348","type":"proceedings-article","created":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T17:51:58Z","timestamp":1624297918000},"page":"111-119","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["On the impact of tangled program graph marking schemes under the atari reinforcement learning benchmark"],"prefix":"10.1145","author":[{"given":"Alexandru","family":"Ianta","sequence":"first","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}]},{"given":"Ryan","family":"Amaral","sequence":"additional","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}]},{"given":"Caleidgh","family":"Bayer","sequence":"additional","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}]},{"given":"Robert J.","family":"Smith","sequence":"additional","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}]},{"given":"Malcolm I.","family":"Heywood","sequence":"additional","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}]}],"member":"320","published-online":{"date-parts":[[2021,6,26]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/2566972.2566979"},{"volume-title":"Linear Genetic Programming","author":"Brameier Markus","key":"e_1_3_2_1_2_1","unstructured":"Markus Brameier and Wolfgang Banzhaf . 2007. Linear Genetic Programming . Springer . Markus Brameier and Wolfgang Banzhaf. 2007. Linear Genetic Programming. Springer."},{"key":"e_1_3_2_1_3_1","volume-title":"CoRR abs\/1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Open AI Gym . CoRR abs\/1606.01540 ( 2016 ), 4. Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI Gym. CoRR abs\/1606.01540 (2016), 4."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3441110.3441575"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2013.2294713"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11796"},{"key":"e_1_3_2_1_7_1","volume-title":"Model Based Reinforcement Learning for Atari. In International Conference on Learning Representations.","author":"Kaiser Lukasz","year":"2020","unstructured":"Lukasz Kaiser , Mohammad Babaeizadeh , Piotr Milos , Blazej Osinski , Roy H. Campbell , Konrad Czechowski , Dumitru Erhan , Chelsea Finn , Piotr Kozakowski , Sergey Levine , Afroz Mohiuddin , Ryan Sepassi , George Tucker , and Henryk Michalewski . 2020 . Model Based Reinforcement Learning for Atari. In International Conference on Learning Representations. Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, and Henryk Michalewski. 2020. Model Based Reinforcement Learning for Atari. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_8_1","volume-title":"Emergent Tangled Graph Representations for Atari Game Playing Agents. In European Conference on Genetic Programming (LNCS)","volume":"10196","author":"Kelly S.","unstructured":"S. Kelly and M. I. Heywood . 2017 . Emergent Tangled Graph Representations for Atari Game Playing Agents. In European Conference on Genetic Programming (LNCS) , Vol. 10196 . 64--79. S. Kelly and M. I. Heywood. 2017. Emergent Tangled Graph Representations for Atari Game Playing Agents. In European Conference on Genetic Programming (LNCS), Vol. 10196. 64--79."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco_a_00232"},{"key":"e_1_3_2_1_10_1","volume-title":"Heywood","author":"Kelly Stephen","year":"2018","unstructured":"Stephen Kelly , Robert J. Smith , and Malcolm I . Heywood . 2018 . Emergent Policy Discovery for Visual Reinforcement Learning Through Tangled Program Graphs: A Tutorial. In Genetic Programming Theory and Practice XVI (Genetic and Evolutionary Computation), Wolfgang Banzhaf, Lee Spector, and Leigh Sheneman (Eds .). 37--57. Stephen Kelly, Robert J. Smith, and Malcolm I. Heywood. 2018. Emergent Policy Discovery for Visual Reinforcement Learning Through Tangled Program Graphs: A Tutorial. In Genetic Programming Theory and Practice XVI (Genetic and Evolutionary Computation), Wolfgang Banzhaf, Lee Spector, and Leigh Sheneman (Eds.). 37--57."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3241691.3241702"},{"key":"e_1_3_2_1_12_1","volume-title":"Human-level control through deep reinforcement learning. Nature 518, 7540","author":"Mnih Volodymyr","year":"2015","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Andrei A. Rusu , Joel Veness , Marc G. Bellemare , Alex Graves , Martin Riedmiller , Andreas K. Fidjeland , Georg Ostrovski , Stig Petersen , Charles Beattie , Amir Sadik , Ioannis Antonoglou , Helen King , Dharshan Kumaran , Daan Wierstra , Shane Legg , and Demis Hassabis . 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 ( 2015 ), 529--533. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529--533."},{"key":"e_1_3_2_1_13_1","volume-title":"European Conference on Genetic Programming (Lecture LNCS)","volume":"10781","author":"Robert","unstructured":"Robert J. Smith and Malcolm I. Heywood. 2018. Scaling Tangled Program Graphs to Visual Reinforcement Learning in ViZDoom . In European Conference on Genetic Programming (Lecture LNCS) , Vol. 10781 . 135--150. Robert J. Smith and Malcolm I. Heywood. 2018. Scaling Tangled Program Graphs to Visual Reinforcement Learning in ViZDoom. In European Conference on Genetic Programming (Lecture LNCS), Vol. 10781. 135--150."},{"volume-title":"Proceedings of the ACM Genetic and Evolutionary Computation Conference. 179--187","author":"Robert","key":"e_1_3_2_1_14_1","unstructured":"Robert J. Smith and Malcolm I. Heywood. 2019. Evolving Dota 2 shadow fiend bots using genetic programming with external memory . In Proceedings of the ACM Genetic and Evolutionary Computation Conference. 179--187 . Robert J. Smith and Malcolm I. Heywood. 2019. Evolving Dota 2 shadow fiend bots using genetic programming with external memory. In Proceedings of the ACM Genetic and Evolutionary Computation Conference. 179--187."},{"key":"e_1_3_2_1_15_1","volume-title":"European Conference on Genetic Programming (LNCS)","volume":"11451","author":"Robert","unstructured":"Robert J. Smith and Malcolm I. Heywood. 2019. A Model of External Memory for Navigation in Partially Observable Visual Reinforcement Learning Tasks . In European Conference on Genetic Programming (LNCS) , Vol. 11451 . 162--177. Robert J. Smith and Malcolm I. Heywood. 2019. A Model of External Memory for Navigation in Partially Observable Visual Reinforcement Learning Tasks. In European Conference on Genetic Programming (LNCS), Vol. 11451. 162--177."},{"key":"e_1_3_2_1_16_1","volume-title":"Reinforcement Learning: An introduction. MIT.","author":"Sutton R. S.","year":"2018","unstructured":"R. S. Sutton and A. G. Barto . 2018 . Reinforcement Learning: An introduction. MIT. R. S. Sutton and A. G. Barto. 2018. Reinforcement Learning: An introduction. MIT."},{"volume-title":"Proceedings of the ACM Genetic and Evolutionary Computation Conference. 229--236","author":"Wilson Dennis G.","key":"e_1_3_2_1_17_1","unstructured":"Dennis G. Wilson , Sylvain Cussat-Blanc , Herv\u00e9 Luga , and Julian F. Miller . 2018. Evolving simple programs for playing Atari games . In Proceedings of the ACM Genetic and Evolutionary Computation Conference. 229--236 . Dennis G. Wilson, Sylvain Cussat-Blanc, Herv\u00e9 Luga, and Julian F. Miller. 2018. Evolving simple programs for playing Atari games. In Proceedings of the ACM Genetic and Evolutionary Computation Conference. 229--236."}],"event":{"name":"GECCO '21: Genetic and Evolutionary Computation Conference","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"],"location":"Lille France","acronym":"GECCO '21"},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449639.3459348","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449639.3459348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:09Z","timestamp":1750195689000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449639.3459348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,26]]},"references-count":17,"alternative-id":["10.1145\/3449639.3459348","10.1145\/3449639"],"URL":"https:\/\/doi.org\/10.1145\/3449639.3459348","relation":{},"subject":[],"published":{"date-parts":[[2021,6,26]]},"assertion":[{"value":"2021-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}