{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:05:00Z","timestamp":1777521900242,"version":"3.51.4"},"reference-count":54,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2009,2,1]],"date-time":"2009-02-01T00:00:00Z","timestamp":1233446400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2009,2]]},"abstract":"<jats:p>Learning classifier systems (LCSs) belong to a class of algorithms based on the principle of self-organization and have frequently been applied to the task of solving mazes, an important type of reinforcement learning (RL) problem. Maze problems represent a simplified virtual model of real environments that can be used for developing core algorithms of many real-world applications related to the problem of navigation. However, the best achievements of LCSs in maze problems are still mostly bounded to non-aliasing environments, while LCS complexity seems to obstruct a proper analysis of the reasons of failure.<\/jats:p>\n                  <jats:p>We construct a new LCS agent that has a simpler and more transparent performance mechanism, but that can still solve mazes better than existing algorithms. We use the structure of a predictive LCS model, strip out the evolutionary mechanism, simplify the reinforcement learning procedure and equip the agent with the ability of associative perception, adopted from psychology.<\/jats:p>\n                  <jats:p>To improve our understanding of the nature and structure of maze environments, we analyze mazes used in research for the last two decades, introduce a set of maze complexity characteristics, and develop a set of new maze environments. We then run our new LCS with associative perception through the old and new aliasing mazes, which represent partially observable Markov decision problems (POMDP) and demonstrate that it performs at least as well as, and in some cases better than, other published systems.<\/jats:p>","DOI":"10.1177\/1059712308099230","type":"journal-article","created":{"date-parts":[[2009,3,9]],"date-time":"2009-03-09T11:28:10Z","timestamp":1236598090000},"page":"28-57","source":"Crossref","is-referenced-by-count":13,"title":["Learning Mazes with Aliasing States: An LCS Algorithm with Associative Perception"],"prefix":"10.1177","volume":"17","author":[{"given":"Zhanna V.","family":"Zatuchna","sequence":"first","affiliation":[{"name":"School of Computing Sciences, University of East Anglia,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony","family":"Bagnall","sequence":"additional","affiliation":[{"name":"School of Computing Sciences, University of East Anglia,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2009,3,9]]},"reference":[{"key":"atypb1","unstructured":"Arai, S. & Sycara, K. (2001). Credit assignment method for learning effective stochastic policies in uncertain domain. In L. Spector et al. (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001) (pp. 815-822). San Francisco, CA: Morgan Kaufmann."},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39925-4_7"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1007\/11319122_12"},{"key":"atypb4","unstructured":"Browne, W. & Scott, D. (2005). An abstraction algorithm for genetics-based reinforcement learning. In H.G. Beyer et al. (Eds.), GECCO 2005: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation (Vol. 2, pp. 1875-1882). Washington DC: ACM Press."},{"key":"atypb5","unstructured":"Bull, L. (2002). Lookahead and latent learning in ZCS. In W. B. Langdon et al. (Eds.), GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference (pp. 897-904). New York: Morgan Kaufmann."},{"key":"atypb6","volume-title":"ZCS: Theory and practice. Technical Report 01-001, Learning Classifier Systems Group","author":"Bull, L.","year":"2001"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1162\/106365602320169848"},{"key":"atypb8","volume-title":"A neural learning classifier system with self-adaptive constructivism. Technical Report","author":"Bull, L.","year":"2003"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-0891-5"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021330114221"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45002-3_16"},{"key":"atypb12","volume-title":"New challenges for an ACS: Hard problems and possible solutions. Technical Report 99019","author":"Butz, M.V.","year":"1999"},{"key":"atypb13","volume-title":"Proceedings of the International Workshop on Learning Classifier Systems (IWLCS-2000)","author":"Butz, M.V."},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.818194"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45002-3_6"},{"key":"atypb16","volume-title":"Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI-94)","author":"Cassandra, A.R."},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1177\/105971239400300201"},{"key":"atypb18","volume-title":"Advances in Classifier Systems, Lecture notes in artificial intelligence","author":"Gerard, P."},{"key":"atypb19","doi-asserted-by":"crossref","unstructured":"G\u00e9rard, P. & Sigaud, O. (2003). Designing efficient exploration with MACS: Modules and function approximation. In E. Cant\u00fa-Paz et al. (Eds.), Genetic and Evolutionary Computation - GECCO-2003, Lecture notes in computer science (Vol. 2724, pp. 1882-1893). Berlin: Springer .","DOI":"10.1007\/3-540-45110-2_85"},{"key":"atypb20","volume-title":"Vorhersage und Erkenntnis","author":"Hoffman, J.","year":"1993"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45002-3_4"},{"key":"atypb22","volume-title":"Cognitive systems based on adaptive algorithms","author":"Holland, J.H.","year":"1978"},{"key":"atypb23","volume-title":"Schema learning: Experience-based construction of predictive action","author":"Holmes, M.","year":"2005"},{"key":"atypb24","volume-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"atypb25","volume-title":"Proceedings of the International Workshop on Learning Classifier Systems (IWLCS-2000)","author":"Hurst, J."},{"key":"atypb26","volume-title":"A model of the environment to avoid local learning (an analysis of the generalization mechanism of XCS)","author":"Lanzi, P.L.","year":"1997"},{"key":"atypb27","volume-title":"Solving problems in partially observable environments with Classifier Systems (Experiments on adding memory to XCS)","author":"Lanzi, P.L.","year":"1997"},{"key":"atypb28","volume-title":"Proceedings of the 7th International Conference on Genetic Algorithms (ICGA97)","author":"Lanzi, P.L."},{"key":"atypb29","unstructured":"Lanzi, P.L. (1998). An analysis of the memory mechanism of XCSM. In J. R. Koza et al. (Eds.), Genetic Programming 1998: Proceedings of the Third Annual Conference (pp. 643-651). Morgan Kaufmann. http:\/\/ftp.elet.polimi.it\/people\/lanzi\/gp98.ps.gz"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1162\/106365600568239"},{"key":"atypb31","volume-title":"From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior","author":"Littman, M.L."},{"key":"atypb32","volume-title":"Proceedings of the Twelfth International Conference on Machine Learning","author":"Littman, M.L."},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1007\/BF01905355"},{"key":"atypb34","volume-title":"Proceedings of the Tenth International Machine Learning Conference","author":"McCallum, A.R."},{"key":"atypb35","volume-title":"Proceedings of the International Workshop on Learning Classifier Systems (IWLCS-2000)","author":"M\u00e9tivier, M."},{"key":"atypb36","volume-title":"Proceedings of the International Conference on Systems, Man and Cybernetics (SMC 99)","author":"Miyazaki, K."},{"key":"atypb37","volume-title":"Maze lab 1: Event loop programming","author":"Nevison, C.","year":"1999"},{"key":"atypb38","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation","author":"O'Hara, T."},{"key":"atypb39","volume-title":"Conditioned reflexes","author":"Pavlov, I.P.","year":"1927"},{"key":"atypb40","volume-title":"The science of learning","author":"Pear, J.","year":"2001"},{"key":"atypb41","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001)","author":"Russell, S."},{"key":"atypb42","volume-title":"Science and human behavior","author":"Skinner, B.F.","year":"1953"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45027-0_9"},{"key":"atypb44","volume-title":"Using the XCS classifier system for multi-objective reinforcement learning problems. Technical report","author":"Studley, M.","year":"2005"},{"key":"atypb45","volume-title":"Reinforcement learning: An introduction","author":"Sutton, R.S.","year":"1998"},{"key":"atypb46","volume-title":"Animal intelligence","author":"Thorndike, E.L.","year":"1911"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1037\/11496-005"},{"key":"atypb49","doi-asserted-by":"crossref","unstructured":"Wilson, S.W. (1990). The animat path to AI. In J. A. Meyer & S. W. Wilson (Eds), From Animals to Animats 1. Proceedings of the First International Conference on Simulation of Adaptive Behavior (SAB90) (pp. 15-21). Cambridge, MA: MIT Press\/Bradford Books . http:\/\/prediction-dynamics.com\/","DOI":"10.7551\/mitpress\/3115.003.0004"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1994.2.1.1"},{"key":"atypb51","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1995.3.2.149"},{"key":"atypb52","volume-title":"Proceedings of the Parallel Problem Solving from Nature Conference (PPSN), Lecture notes in computer science","author":"Zatuchna, Z.V."},{"key":"atypb53","volume-title":"Proceedings of the 2005 Congress on Evolutionary Computation","author":"Zatuchna, Z.V."},{"key":"atypb54","volume-title":"A learning classifier system for mazes with aliasing clones","author":"Zatuchna, Z.V.","year":"2007"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712308099230","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712308099230","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:15:44Z","timestamp":1777392944000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1059712308099230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,2]]}},"alternative-id":["10.1177\/1059712308099230"],"URL":"https:\/\/doi.org\/10.1177\/1059712308099230","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,2]]}}}