{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T14:37:07Z","timestamp":1759847827127,"version":"3.38.0"},"reference-count":33,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[1994,9,1]],"date-time":"1994-09-01T00:00:00Z","timestamp":778377600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[1994,9]]},"abstract":"<jats:p> In a recent article, Wilson (1994) described a \"zeroth-level\" classifier system (ZCS). ZCS employs a reinforcement learning technique comparable to Q-learning (Watkins, 1989). This article presents results from the first reconstruction of ZCS. Having replicated Wilson's results, we extend ZCS in a manner suggested by Wilson: The original formulation of ZCS has no memory mechanisms, but Wilson (1994b) suggested how internal \"temporary memory\" registers could be added. We show results from adding one-bit and two-bit memory registers to ZCS. Our results demonstrate that ZCS can exploit memory facilities efficiently in non-Markov environments. We also show that the memoryless ZCS can converge on near-optimal stochastic solutions in non-Markov environments. <\/jats:p><jats:p> We then present results from trials using ZCS in Markov environments that require increasingly long chains of actions before reward is received. Our results indicate that inaccurate overgeneral classifiers can interact with the classifier-generation mechanisms to cause catastrophic breakdowns in overall system performance. Basing classifier fitness on accuracy may alleviate this problem. We conclude that the memory mechanism in its current form is unlikely to scale well for situations requiring large amounts of temporary memory. Nevertheless, the ability to find stochastic solutions when there is insufficient memory might offset this problem somewhat. <\/jats:p>","DOI":"10.1177\/105971239400300201","type":"journal-article","created":{"date-parts":[[2007,3,11]],"date-time":"2007-03-11T06:45:25Z","timestamp":1173595525000},"page":"101-150","source":"Crossref","is-referenced-by-count":71,"title":["Adding Temporary Memory to ZCS"],"prefix":"10.1177","volume":"3","author":[{"given":"Dave","family":"Cliff","sequence":"first","affiliation":[{"name":"University of Sussex"}]},{"given":"Susi","family":"Ross","sequence":"additional","affiliation":[{"name":"University of Sussex"}]}],"member":"179","published-online":{"date-parts":[[1994,9,1]]},"reference":[{"volume-title":"Proceedings of the Third International Conference on Genetic Algorithms","author":"Booker, L.B.","key":"atypb1"},{"volume-title":"Toward a practice of autonomous systems: Proceedings of the First European Conference on Artificial Life (ECAL91)","author":"Brooks, R.A.","key":"atypb2"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1007\/BF00605469"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1007\/BF00318718"},{"volume-title":"Flava: Flatland vision for animats; a simple minimal simulation of distal sensing for animat studies","year":"1994","author":"Cliff, D.","key":"atypb5"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1177\/105971239300200103"},{"key":"atypb7","first-page":"295","volume":"337","author":"Collett, T.S.","year":"1992","journal-title":"Proc. R. Soc. Lond."},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1177\/105971239400200302"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90074-Y"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1993.1.2.151"},{"volume-title":"From animals to animats 3: Proceedings of the Third International Conference on Simulation of Adaptive Behavior","author":"Dorigo, M.","key":"atypb11"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1007\/BF00114162"},{"volume-title":"Genetic algorithms in search, optimization, and machine learning","year":"1989","author":"Goldberg, D.E.","key":"atypb13"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116876"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-543104-0.50012-3"},{"key":"atypb16","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3729.001.0001","volume-title":"Induction: Processes of inference, learning, and discovery","author":"Holland, J.H.","year":"1986"},{"volume-title":"Cognitive systems based on adaptive algorithms","year":"1978","author":"Holland, J.H.","key":"atypb17"},{"volume-title":"Genetic programming: On the programming of computers by means of natural selection","year":"1992","author":"Koza, J.","key":"atypb18"},{"volume-title":"From animals to animats 3: Proceedings of the Third International Conference on Simulation of Adaptive Behavior","author":"Littman, M.L.","key":"atypb19"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(92)90058-6"},{"volume-title":"Machine learning: Proceedings of the Eleventh International Conference on Machine Learning","author":"Matari\u0107, M.J.","key":"atypb21"},{"volume-title":"Accurate reaction or reflective action","year":"1994","author":"Ross, S.","key":"atypb22"},{"volume-title":"Learning from delayed rewards","year":"1989","author":"Watkins, C.J.C.H.","key":"atypb23"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"volume-title":"Learning to perceive and act (Tech. Rep. TR 331)","year":"1990","author":"Whitehead, S.D.","key":"atypb25"},{"journal-title":"Artificial Intelligence","author":"Whitehead, S.D.","key":"atypb26"},{"volume-title":"Proceedings of an International Conference on Genetic Algorithms and their Applications (ICGA85)","author":"Wilson, S.W.","key":"atypb27"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1007\/BF00058679"},{"volume-title":"From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior (SAB90)","author":"Wilson, S.W.","key":"atypb29"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1994.2.1.1"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1995.3.2.149"},{"volume-title":"Proceedings of the Third International Conference on Genetic Algorithms","author":"Wilson, S.W.","key":"atypb32"},{"volume-title":"Proceedings of the Fifth International Conference on Genetic Algorithms","author":"Yates, D.F.","key":"atypb33"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/105971239400300201","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/105971239400300201","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T06:56:16Z","timestamp":1740984976000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/105971239400300201"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1994,9]]},"references-count":33,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1994,9]]}},"alternative-id":["10.1177\/105971239400300201"],"URL":"https:\/\/doi.org\/10.1177\/105971239400300201","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"type":"print","value":"1059-7123"},{"type":"electronic","value":"1741-2633"}],"subject":[],"published":{"date-parts":[[1994,9]]}}}