{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,27]],"date-time":"2025-03-27T09:49:52Z","timestamp":1743068992829,"version":"3.40.3"},"publisher-location":"Berlin, Heidelberg","reference-count":19,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"type":"print","value":"9783642202162"},{"type":"electronic","value":"9783642202179"}],"license":[{"start":{"date-parts":[[2011,1,1]],"date-time":"2011-01-01T00:00:00Z","timestamp":1293840000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011]]},"DOI":"10.1007\/978-3-642-20217-9_36","type":"book-chapter","created":{"date-parts":[[2011,3,19]],"date-time":"2011-03-19T00:05:31Z","timestamp":1300493131000},"page":"418-429","source":"Crossref","is-referenced-by-count":0,"title":["LearnPNP: A Tool for Learning Agent Behaviors"],"prefix":"10.1007","author":[{"given":"Matteo","family":"Leonetti","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca","family":"Iocchi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"key":"36_CR1","unstructured":"Andre, D., Russell, S.: Programmable reinforcement learning agents. In: Advances in Neural Information Processing Systems, pp. 1019\u20131025 (2001)"},{"key":"36_CR2","unstructured":"Boutilier, C., Reiter, R., Soutchanski, M., Thrun, S.: Decision-theoretic, high-level agent programming in the situation calculus. In: Proceedings of the National Conference on Artificial Intelligence, pp. 355\u2013362. AAAI Press \/ The MIT Press (2000)"},{"issue":"3","key":"36_CR3","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1109\/TSMCC.2006.886964","volume":"37","author":"S. Chalup","year":"2007","unstructured":"Chalup, S., Murch, C., Quinlan, M.: Machine learning with AIBO robots in the four-legged league of robocup. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews\u00a037(3), 297\u2013310 (2007)","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews"},{"key":"36_CR4","unstructured":"Crook, P., Hayes, G.: Learning in a state of confusion: Perceptual aliasing in grid world navigation. Towards Intelligent Mobile Robots\u00a04 (2003)"},{"key":"36_CR5","unstructured":"Crook, P.A.: Consistent exploration improves convergence of reinforcement learning on pomdps (2007)"},{"key":"36_CR6","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/978-3-642-11876-0_14","volume-title":"RoboCup 2009: Robot Soccer World Cup XIII","author":"S. Kalyanakrishnan","year":"2010","unstructured":"Kalyanakrishnan, S., Stone, P.: Learning complementary multiagent behaviors: A case study. In: Baltes, J., Lagoudakis, M.G., Naruse, T., Ghidary, S.S. (eds.) RoboCup 2009. LNCS, vol.\u00a05949, pp. 153\u2013165. Springer, Heidelberg (2010)"},{"key":"36_CR7","unstructured":"Leonetti, M., Iocchi, L.: Improving the Performance of Complex Agent Plans Through Reinforcement Learning. In: Proceedings of the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) (2010)"},{"key":"36_CR8","doi-asserted-by":"publisher","DOI":"10.1142\/2742","volume-title":"Design of Intelligent Control Systems Based on Hierarchical Stochastic Automata","author":"P.U. Lima","year":"1996","unstructured":"Lima, P.U., Saridis, G.N.: Design of Intelligent Control Systems Based on Hierarchical Stochastic Automata. World Scientific Publ., Singapore (1996)"},{"key":"36_CR9","unstructured":"Marthi, B., Russell, S.J., Latham, D., Guestrin, C.: Concurrent hierarchical reinforcement learning. In: Kaelbling, L.P., Saffiotti, A. (eds.) IJCAI, pp. 779\u2013785. Professional Book Center (2005)"},{"issue":"4","key":"36_CR10","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1109\/5.24143","volume":"77","author":"T. Murata","year":"1989","unstructured":"Murata, T.: Petri nets: Properties, analysis and applications. Proceedings of the IEEE\u00a077(4), 541\u2013580 (1989)","journal-title":"Proceedings of the IEEE"},{"key":"36_CR11","first-page":"421","volume-title":"ICML","author":"M.D. Pendrith","year":"1998","unstructured":"Pendrith, M.D., McGarity, M.: An analysis of direct reinforcement learning in non-markovian domains. In: Shavlik, J.W. (ed.) ICML, pp. 421\u2013429. Morgan Kaufmann, San Francisco (1998)"},{"key":"36_CR12","first-page":"497","volume-title":"Proceedings of the Nineteenth International Conference on Machine Learning","author":"T. Perkins","year":"2002","unstructured":"Perkins, T., Pendrith, M.: On the existence of fixed points for Q-learning and Sarsa in partially observable domains. In: Proceedings of the Nineteenth International Conference on Machine Learning, p. 497. Morgan Kaufmann Publishers Inc., San Francisco (2002)"},{"key":"36_CR13","unstructured":"Perkins, T.J.: Reinforcement learning for pomdps based on action values and stochastic optimization. In: Eighteenth National Conference on Artificial Intelligence, Menlo Park, CA, USA, pp. 199\u2013204. American Association for Artificial Intelligence (2002)"},{"key":"36_CR14","doi-asserted-by":"crossref","unstructured":"Singh, S., Jaakkola, T., Jordan, M.: Learning without state-estimation in partially observable Markovian decision processes. In: Proc. of 11th International Conference on Machine Learning (1994)","DOI":"10.1016\/B978-1-55860-335-6.50042-8"},{"issue":"3","key":"36_CR15","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1177\/105971230501300301","volume":"13","author":"P. Stone","year":"2005","unstructured":"Stone, P., Sutton, R.S., Kuhlmann, G.: Reinforcement learning for RoboCup-soccer keepaway. Adaptive Behavior\u00a013(3), 165\u2013188 (2005)","journal-title":"Adaptive Behavior"},{"key":"36_CR16","unstructured":"Stone, P., Veloso, M.: Multiagent systems: A survey from a machine learning perspective. Autonomous Robotics\u00a08(3) (July 2000)"},{"key":"36_CR17","volume-title":"Reinforcement Learning: An Introduction","author":"R.S. Sutton","year":"1998","unstructured":"Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)"},{"issue":"3","key":"36_CR18","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1109\/70.240195","volume":"RA\u20139","author":"F.-Y. Wang","year":"1993","unstructured":"Wang, F.-Y., Saridis, G.N.: Task translation and integration specification in Intelligent Machines. IEEE Transactions on Robotics and Automation\u00a0RA\u20139(3), 257\u2013271 (1993)","journal-title":"IEEE Transactions on Robotics and Automation"},{"key":"36_CR19","unstructured":"Ziparo, V.A., Iocchi, L., Nardi, D., Palamara, P.F., Costelha, H.: Petri net plans: a formal model for representation and execution of multi-robot plans. In: AAMAS 2008: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, Richland, SC, pp. 79\u201386. International Foundation for Autonomous Agents and Multiagent Systems (2008)"}],"container-title":["Lecture Notes in Computer Science","RoboCup 2010: Robot Soccer World Cup XIV"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-642-20217-9_36","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,21]],"date-time":"2019-05-21T22:09:37Z","timestamp":1558476577000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-3-642-20217-9_36"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011]]},"ISBN":["9783642202162","9783642202179"],"references-count":19,"URL":"https:\/\/doi.org\/10.1007\/978-3-642-20217-9_36","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2011]]}}}