{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T12:12:52Z","timestamp":1763467972895,"version":"3.41.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2009,12,1]],"date-time":"2009-12-01T00:00:00Z","timestamp":1259625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:p>We present a method for precomputing robust task-based control policies for physically simulated characters. This allows for characters that can demonstrate skill and purpose in completing a given task, such as walking to a target location, while physically interacting with the environment in significant ways. As input, the method assumes an abstract action vocabulary consisting of balance-aware, step-based controllers. A novel constrained state exploration phase is first used to define a character dynamics model as well as a finite volume of character states over which the control policy will be defined. An optimized control policy is then computed using reinforcement learning. The final policy spans the cross-product of the character state and task state, and is more robust than the conrollers it is constructed from. We demonstrate real-time results for six locomotion-based tasks and on three highly-varied bipedal characters. We further provide a game-scenario demonstration.<\/jats:p>","DOI":"10.1145\/1618452.1618516","type":"journal-article","created":{"date-parts":[[2009,12,8]],"date-time":"2009-12-08T20:53:14Z","timestamp":1260305594000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":53,"title":["Robust task-based control policies for physics-based characters"],"prefix":"10.1145","volume":"28","author":[{"given":"Stelian","family":"Coros","sequence":"first","affiliation":[{"name":"University of British Columbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philippe","family":"Beaudoin","sequence":"additional","affiliation":[{"name":"University of British Columbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michiel","family":"van de Panne","sequence":"additional","affiliation":[{"name":"University of British Columbia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2009,12]]},"reference":[{"volume-title":"Proc. ACM SIGGRAPH\/EG Symposium on Computer Animation, 249--258","author":"Abe Y.","key":"e_1_2_2_1_1"},{"key":"e_1_2_2_2_1","first-page":"1611","article-title":"Nonparametric representation of policies and value functions: A trajectory-based approach","volume":"15","author":"Atkeson C. G.","year":"2003","journal-title":"Advances in Neural Information Processing Systems"},{"volume-title":"Proc. Neural Information Processing Systems Conf.","author":"Atkeson C. G.","key":"e_1_2_2_3_1"},{"volume-title":"Proc. IEEE Int'l Conf. on Robotics and Automation.","author":"Byl K.","key":"e_1_2_2_4_1"},{"volume-title":"Proc. IEEE Int'l Conf. on Robotics and Automation.","author":"Chestnutt J.","key":"e_1_2_2_5_1"},{"key":"e_1_2_2_6_1","unstructured":"Chestnutt J. 2007. Navigation Planning for Legged Robots. PhD thesis Carnegie Mellon University.  Chestnutt J. 2007. Navigation Planning for Legged Robots . PhD thesis Carnegie Mellon University."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/636886.636889"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1457515.1409066"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360681"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531388"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1088690"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383287"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218414"},{"volume-title":"Tech. Rep. UCB\/CSD-05-1395, EECS Department","year":"2005","author":"Ikemoto L.","key":"e_1_2_2_14_1"},{"volume-title":"Proc. IEEE Int'l Conf. on Robotics and Automation.","author":"Kajita S.","key":"e_1_2_2_15_1"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843604000058"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237231"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073408"},{"volume-title":"ACM SIGGRAPH\/EG Symposium on Computer Animation, 299--308","author":"Lau M.","key":"e_1_2_2_19_1"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028523.1028535"},{"volume-title":"ACM SIGGRAPH\/EG Symposium on Computer Animation.","author":"Lo W.","key":"e_1_2_2_21_1"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276385"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Morimoto J. and Atkeson C. G. 2007. Learning biped locomotion: Application of poincare-map-based reinforcement leraning. IEEE Robotics&amp;Automation Magazine 14 2 41--51.  Morimoto J. and Atkeson C. G. 2007. Learning biped locomotion: Application of poincare-map-based reinforcement leraning. IEEE Robotics&amp;Automation Magazine 14 2 41--51.","DOI":"10.1109\/MRA.2007.380654"},{"volume-title":"Proc. IEEE Int'l Conf. on Robotics and Automation.","author":"Morimoto J.","key":"e_1_2_2_24_1"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531387"},{"key":"e_1_2_2_26_1","unstructured":"ODE. Open dynamics engine http:\/\/www.ode.org\/.  ODE. Open dynamics engine http:\/\/www.ode.org\/."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/122718.122755"},{"volume-title":"Proc. IEEE Int'l Conf. on Robotics and Automation.","author":"Sharon D.","key":"e_1_2_2_28_1"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276511"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"volume":"3","volume-title":"Proc. Int'l Conf. on Intelligent Robots and Systems","author":"Tedrake R.","key":"e_1_2_2_31_1"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276386"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276509"},{"key":"e_1_2_2_34_1","unstructured":"Yoshida E. Belousov I. Esteves C. and Laumond J. 2005. Humanoid motion planning for dynamic tasks. In Humanoid Robots.  Yoshida E. Belousov I. Esteves C. and Laumond J. 2005. Humanoid motion planning for dynamic tasks. In Humanoid Robots ."},{"volume-title":"ACM SIGGRAPH\/EG Symposium on Computer Animation.","author":"Zhao L.","key":"e_1_2_2_35_1"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073249"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1618452.1618516","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1618452.1618516","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:23:23Z","timestamp":1750249403000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1618452.1618516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,12]]},"references-count":36,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["10.1145\/1618452.1618516"],"URL":"https:\/\/doi.org\/10.1145\/1618452.1618516","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2009,12]]},"assertion":[{"value":"2009-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}