{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,15]],"date-time":"2026-02-15T12:06:13Z","timestamp":1771157173386,"version":"3.50.1"},"reference-count":0,"publisher":"SAGE Publications","issue":"1-2","license":[{"start":{"date-parts":[[2009,2,1]],"date-time":"2009-02-01T00:00:00Z","timestamp":1233446400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2009,2]]},"abstract":"<jats:p>Temporal difference learning and eligibility traces are two\n\t\t\t mechanisms for solving reinforcement learning problems. The temporal difference\n\t\t\t technique bootstraps the state value or state-action value at every step as\n\t\t\t with dynamic programming, and learns by sampling episodes from experience as in\n\t\t\t the Monte Carlo approach. Eligibility traces is a mechanism that offers a means\n\t\t\t for recording the degree of which state is eligible for undergoing learning\n\t\t\t process. This paper aims to investigate the underlying mechanism of eligibility\n\t\t\t traces strategies using on-policy and off-policy learning algorithms. In doing\n\t\t\t so, the performance metrics can be obtained by defining the learning problem in\n\t\t\t a simulation environment, in conjunction with different learning algorithms.\n\t\t\t However, measuring learning performance and analysing sensibility are very\n\t\t\t expensive because such performance metrics can only be obtained by running an\n\t\t\t experiment with different parameter values. This paper proposes a comparative\n\t\t\t study for analysing the mechanism of eligibility traces. The objective of this\n\t\t\t paper is to compare and investigate the influences on performance caused by\n\t\t\t those different approaches.<\/jats:p>","DOI":"10.3233\/ifs-2009-0416","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T17:40:01Z","timestamp":1575308401000},"page":"73-82","source":"Crossref","is-referenced-by-count":4,"title":["Experimental analysis on Sarsa(\u03bb) and\t\t\t Q(\u03bb) with different eligibility traces\t\t\t strategies"],"prefix":"10.1177","volume":"20","author":[{"given":"Jinsong","family":"Leng","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering,\r\t\t\t Knowledge Based Intelligent Engineering Systems Centre, University of South\r\t\t\t Australia, Mawson Lakes SA 5095, Australia"}]},{"given":"Colin","family":"Fyfe","sequence":"additional","affiliation":[{"name":"Applied Computational Intelligence Research Unit,\r\t\t\t University of the West of Scotland, Paisley, Scotland"}]},{"given":"Lakhmi C.","family":"Jain","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering,\r\t\t\t Knowledge Based Intelligent Engineering Systems Centre, University of South\r\t\t\t Australia, Mawson Lakes SA 5095, Australia"}]}],"member":"179","published-online":{"date-parts":[[2009,2]]},"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IFS-2009-0416","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IFS-2009-0416","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,15]],"date-time":"2026-02-15T11:47:38Z","timestamp":1771156058000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/IFS-2009-0416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2]]},"references-count":0,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2009,2]]}},"alternative-id":["10.3233\/IFS-2009-0416"],"URL":"https:\/\/doi.org\/10.3233\/ifs-2009-0416","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,2]]}}}