{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T21:17:08Z","timestamp":1673299028987},"reference-count":28,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Evolutionary Computation"],"published-print":{"date-parts":[[2014,3]]},"abstract":"<jats:p> It has been shown previously that the control of a robot arm can be efficiently learned using the XCSF learning classifier system, which is a nonlinear regression system based on evolutionary computation. So far, however, the predictive knowledge about how actual motor activity changes the state of the arm system has not been exploited. In this paper, we utilize the forward velocity kinematics knowledge of XCSF to alleviate the negative effect of noisy sensors for successful learning and control. We incorporate Kalman filtering for estimating successive arm positions, iteratively combining sensory readings with XCSF-based predictions of hand position changes over time. The filtered arm position is used to improve both trajectory planning and further learning of the forward velocity kinematics. We test the approach on a simulated kinematic robot arm model. The results show that the combination can improve learning and control performance significantly. However, it also shows that variance estimates of XCSF prediction may be underestimated, in which case self-delusional spiraling effects can hinder effective learning. Thus, we introduce a heuristic parameter, which can be motivated by theory, and which limits the influence of XCSF's predictions on its own further learning input. As a result, we obtain drastic improvements in noise tolerance, allowing the system to cope with more than 10\u00a0times higher noise levels. <\/jats:p>","DOI":"10.1162\/evco_a_00108","type":"journal-article","created":{"date-parts":[[2013,6,7]],"date-time":"2013-06-07T16:22:17Z","timestamp":1370622137000},"page":"139-158","source":"Crossref","is-referenced-by-count":8,"title":["Filtering Sensory Information with XCSF: Improving Learning Robustness and Robot Arm Control Performance"],"prefix":"10.1162","volume":"22","author":[{"given":"Jan","family":"Kneissler","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of T\u00fcbingen, Sand 14, 72076 T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick O.","family":"Stalph","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of T\u00fcbingen, Sand 14, 72076 T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"Drugowitsch","sequence":"additional","affiliation":[{"name":"D\u00e9partment d'Etudes Cognitives, Ecole Normale Sup\u00e8rieure, 29 rue d'Ulm, 75005 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin V.","family":"Butz","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of T\u00fcbingen, Sand 14, 72076 T\u00fcbingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","volume-title":"Generalized inverses: Theory and applications","author":"Ben-Israel A.","year":"2003"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1162\/106365603322365289"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39925-4"},{"key":"B4","volume-title":"Rule-based evolutionary online learning systems: A principled approach to LCS analysis and design","author":"Butz M. V","year":"2006"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1145\/1389095.1389360"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144237"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.903551"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1570059"},{"key":"B9","volume-title":"Proceedings of the International Conference on Cognitive Systems, CogSys 2008","author":"Butz M. V.","year":"2008"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001744"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-007-5024-8"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1145\/1276958.1277278"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-737550-2.50020-8"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1145\/2330163.2330284"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144243"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2007.15.2.133"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88138-4_7"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2008.02.003"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-05181-4"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2011.07.006"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1007\/s10710-011-9147-0"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1145\/1830761.1830818"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1162\/089976605774320557"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1995.3.2.149"},{"key":"B26","first-page":"665","volume-title":"Proceedings of the Third Annual Conference on Genetic Programming","author":"Wilson S. W","year":"1998"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45027-0_11"},{"key":"B28","first-page":"974","volume-title":"Genetic and Evolutionary Computation Conference, GECCO 2001","author":"Wilson S. W","year":"2001"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1023\/A:1016535925043"}],"container-title":["Evolutionary Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/EVCO_a_00108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:58:27Z","timestamp":1615586307000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/evco\/article\/22\/1\/139-158\/972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,3]]},"references-count":28,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,3]]}},"alternative-id":["10.1162\/EVCO_a_00108"],"URL":"https:\/\/doi.org\/10.1162\/evco_a_00108","relation":{},"ISSN":["1063-6560","1530-9304"],"issn-type":[{"value":"1063-6560","type":"print"},{"value":"1530-9304","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,3]]}}}