{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,19]],"date-time":"2025-08-19T10:57:07Z","timestamp":1755601027786},"reference-count":17,"publisher":"World Scientific Pub Co Pte Lt","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Advs. Complex Syst."],"published-print":{"date-parts":[[2019,3]]},"abstract":"<jats:p> Options framework is one of the prominent models serving as a basis to improve learning speed by means of temporal abstractions. An option is mainly composed of three elements: initiation set, option\u2019s local policy and termination condition. Although various attempts exist that focus on how to derive high-quality termination conditions for a given problem, the impact of initiation set generation is relatively unexplored. In this work, we propose an effective goal-oriented heuristic method to derive useful initiation set elements via an analysis of the recent history of events. Effectiveness of the method is experimented on various benchmark problems, and the results are discussed. <\/jats:p>","DOI":"10.1142\/s0219525919500012","type":"journal-article","created":{"date-parts":[[2019,2,28]],"date-time":"2019-02-28T07:39:20Z","timestamp":1551339560000},"page":"1950001","source":"Crossref","is-referenced-by-count":1,"title":["GENERATING EFFECTIVE INITIATION SETS FOR SUBGOAL-DRIVEN OPTIONS"],"prefix":"10.1142","volume":"22","author":[{"given":"ALPER","family":"DEM\u0130R","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Middle East Technical University, 06531 Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ERK\u0130N","family":"\u00c7\u0130LDEN","sequence":"additional","affiliation":[{"name":"STM Defense Technologies Engineering and Trade Inc., 06530 Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"FARUK","family":"POLAT","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Middle East Technical University, 06531 Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2019,3,31]]},"reference":[{"key":"S0219525919500012BIB001","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008942012299"},{"key":"S0219525919500012BIB002","series-title":"Adaptive Computation and Machine Learning Series","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"S0219525919500012BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00052-1"},{"key":"S0219525919500012BIB004","doi-asserted-by":"publisher","DOI":"10.1613\/jair.639"},{"key":"S0219525919500012BIB005","first-page":"1043","volume-title":"Advances in Neural Information Processing Systems","volume":"10","author":"Parr R.","year":"1998"},{"key":"S0219525919500012BIB006","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-36755-1_25"},{"key":"S0219525919500012BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/BF00115009"},{"key":"S0219525919500012BIB010","volume-title":"Dynamic Programming","author":"Bellman R. E.","year":"1957"},{"key":"S0219525919500012BIB011","first-page":"393","volume-title":"Advances in Neural Information Processing Systems","volume":"7","author":"Bradtke S. J.","year":"1994"},{"key":"S0219525919500012BIB017","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-010-5182-y"},{"key":"S0219525919500012BIB019","first-page":"2259","volume":"7","author":"Jonsson A.","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"S0219525919500012BIB020","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992699"},{"key":"S0219525919500012BIB021","doi-asserted-by":"publisher","DOI":"10.1080\/0022250X.2001.9990249"},{"key":"S0219525919500012BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/34.868688"},{"key":"S0219525919500012BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/43.87601"},{"key":"S0219525919500012BIB025","first-page":"229","volume-title":"Theory and Novel Applications of Machine Learning","author":"Dung L. T.","year":"2009"},{"key":"S0219525919500012BIB027","volume-title":"Metamagical Themas: Questing for the Essence of Mind and Pattern","author":"Hofstadter D. R.","year":"1985"}],"container-title":["Advances in Complex Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219525919500012","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T04:39:27Z","timestamp":1565152767000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219525919500012"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3]]},"references-count":17,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2019,3,31]]},"published-print":{"date-parts":[[2019,3]]}},"alternative-id":["10.1142\/S0219525919500012"],"URL":"https:\/\/doi.org\/10.1142\/s0219525919500012","relation":{},"ISSN":["0219-5259","1793-6802"],"issn-type":[{"value":"0219-5259","type":"print"},{"value":"1793-6802","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3]]}}}