{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T03:45:56Z","timestamp":1772163956014,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2008,10,19]],"date-time":"2008-10-19T00:00:00Z","timestamp":1224374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2008,10,19]]},"DOI":"10.1145\/1449764.1449811","type":"proceedings-article","created":{"date-parts":[[2008,10,22]],"date-time":"2008-10-22T08:25:44Z","timestamp":1224663944000},"page":"603-614","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Towards adaptive programming"],"prefix":"10.1145","author":[{"given":"Christopher","family":"Simpkins","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sooraj","family":"Bhat","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"suffix":"Jr.","given":"Charles","family":"Isbell","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Mateas","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, Santa Cruz, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2008,10,19]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Advances in Neural Information Processing Systems","volume":"13","author":"Andre David","year":"2001","unstructured":"David Andre and Stuart Russell . Programmable reinforcement learning agents . In Advances in Neural Information Processing Systems , volume 13 , 2001 . David Andre and Stuart Russell. Programmable reinforcement learning agents. In Advances in Neural Information Processing Systems, volume 13, 2001."},{"key":"e_1_3_2_1_2_1","volume-title":"AAAI-02","author":"Andre David","year":"2002","unstructured":"David Andre and Stuart Russell . State abstraction for programmable reinforcement learning agents . In AAAI-02 , Edmonton, Alberta , 2002 . AAAI Press . David Andre and Stuart Russell. State abstraction for programmable reinforcement learning agents. In AAAI-02, Edmonton, Alberta, 2002. AAAI Press."},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-06)","author":"Bhat Sooraj","year":"2006","unstructured":"Sooraj Bhat , Charles Isbell , and Michael Mateas . On the difficulty of modular reinforcement learning for real-world partial programming . In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-06) , Boston, MA, USA , July 2006 . Sooraj Bhat, Charles Isbell, and Michael Mateas. On the difficulty of modular reinforcement learning for real-world partial programming. In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-06), Boston, MA, USA, July 2006."},{"key":"e_1_3_2_1_4_1","first-page":"118","volume-title":"Proc. 15th International Conf. on Machine Learning","author":"Dietterich Thomas G.","year":"1998","unstructured":"Thomas G. Dietterich . The MAXQ method for hierarchical reinforcement learning . In Proc. 15th International Conf. on Machine Learning , pages 118 -- 126 . Morgan Kaufmann, San Francisco, CA , 1998 . Thomas G. Dietterich. The MAXQ method for hierarchical reinforcement learning. In Proc. 15th International Conf. on Machine Learning, pages 118--126. Morgan Kaufmann, San Francisco, CA, 1998."},{"key":"e_1_3_2_1_5_1","volume-title":"Reinforcement learning: A survey. Journal of Artificial Intelligence Research}, 237--285","author":"Kaelbling Leslie Pack","year":"1996","unstructured":"Leslie Pack Kaelbling , Michael L. Littman , and Andrew P. Moore . Reinforcement learning: A survey. Journal of Artificial Intelligence Research}, 237--285 , 1996 . Leslie Pack Kaelbling, Michael L. Littman, and Andrew P. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research}, 237--285, 1996."},{"key":"e_1_3_2_1_7_1","volume-title":"Game Developers Conference: Game Design Track","author":"Mateas Michael","year":"2003","unstructured":"Michael Mateas and Andrew Stern . Facade : An experiment in building a fully-realized interactive drama . In Game Developers Conference: Game Design Track , San Jose, CA , March 2003 . Michael Mateas and Andrew Stern. Facade: An experiment in building a fully-realized interactive drama. In Game Developers Conference: Game Design Track, San Jose, CA, March 2003."},{"key":"e_1_3_2_1_8_1","volume-title":"Tools, Affective Functions and Applications","author":"Mateas Michael","year":"2004","unstructured":"Michael Mateas and Andrew Stern . Life-like Characters. Tools, Affective Functions and Applications , chapter A Behavior Language: Joint Action and Behavioral Idioms. Springer , 2004 . Michael Mateas and Andrew Stern. Life-like Characters. Tools, Affective Functions and Applications, chapter A Behavior Language: Joint Action and Behavioral Idioms. Springer, 2004."},{"key":"e_1_3_2_1_9_1","volume-title":"Machine Learning","author":"Mitchell Tom","year":"1997","unstructured":"Tom Mitchell . Machine Learning . McGraw-Hill , 1997 . Tom Mitchell. Machine Learning. McGraw-Hill, 1997."},{"key":"e_1_3_2_1_10_1","volume-title":"Presentation","author":"Norvig Peter","year":"1998","unstructured":"Peter Norvig . Decision theory : The language of adaptive agent software . Presentation , March 1998 . http:\/\/www.norvig.com\/adaptive\/index.htm Peter Norvig. Decision theory: The language of adaptive agent software. Presentation, March 1998. http:\/\/www.norvig.com\/adaptive\/index.htm"},{"key":"e_1_3_2_1_11_1","volume-title":"Adaptive software","author":"Norvig Peter","year":"1998","unstructured":"Peter Norvig and David Cohn . Adaptive software , 1998 . http:\/\/norvig.com\/adapaper-pcai.html Peter Norvig and David Cohn. Adaptive software, 1998. http:\/\/norvig.com\/adapaper-pcai.html"},{"key":"e_1_3_2_1_12_1","volume-title":"Advances in Neural Information Processing Systems","author":"Parr Ronald","year":"1998","unstructured":"Ronald Parr and Stuart Russell . Reinforcement learning with hierarchies of machines . In Michael I. Jordan, Michael J. Kearns, and Sara A. Solla, editors, Advances in Neural Information Processing Systems , volume 10 . The MIT Press , 1998 . Ronald Parr and Stuart Russell. Reinforcement learning with hierarchies of machines. In Michael I. Jordan, Michael J. Kearns, and Sara A. Solla, editors, Advances in Neural Information Processing Systems, volume 10. The MIT Press, 1998."},{"key":"e_1_3_2_1_13_1","volume-title":"Artificial Intelligence: A Modern Approach. Prenticce Hall","author":"Russell Stuart","year":"2003","unstructured":"Stuart Russell and Peter Norvig . Artificial Intelligence: A Modern Approach. Prenticce Hall , Upper Saddle River, NJ , 2003 . Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach. Prenticce Hall, Upper Saddle River, NJ, 2003."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, 2003. Workshop paper.","unstructured":"Sprague, N., and Ballard, D . Multiple-Goal Reinforcement Learning with Modular Sarsa(0) . In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, 2003. Workshop paper. Sprague, N., and Ballard, D. Multiple-Goal Reinforcement Learning with Modular Sarsa(0). In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence, 2003. Workshop paper."}],"event":{"name":"OOPSLA08: ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications","location":"Nashville TN USA","acronym":"OOPSLA08","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages","ACM Association for Computing Machinery"]},"container-title":["Proceedings of the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1449764.1449811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1449764.1449811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:56:16Z","timestamp":1750240576000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1449764.1449811"}},"subtitle":["integrating reinforcement learning into a programming language"],"short-title":[],"issued":{"date-parts":[[2008,10,19]]},"references-count":14,"alternative-id":["10.1145\/1449764.1449811","10.1145\/1449764"],"URL":"https:\/\/doi.org\/10.1145\/1449764.1449811","relation":{"is-identical-to":[{"id-type":"doi","id":"10.1145\/1449955.1449811","asserted-by":"object"}]},"subject":[],"published":{"date-parts":[[2008,10,19]]},"assertion":[{"value":"2008-10-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}