{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T20:56:44Z","timestamp":1792961804932,"version":"4.5.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2010,7,26]],"date-time":"2010-07-26T00:00:00Z","timestamp":1280102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2010,7,26]]},"abstract":"<jats:p>We introduce methods for optimizing physics-based walking controllers for robustness to uncertainty. Many unknown factors, such as external forces, control torques, and user control inputs, cannot be known in advance and must be treated as uncertain. These variables are represented with probability distributions, and a return function scores the desirability of a single motion. Controller optimization entails maximizing the expected value of the return, which is computed by Monte Carlo methods. We demonstrate examples with different sources of uncertainty and task constraints. Optimizing control strategies under uncertainty increases robustness and produces natural variations in style.<\/jats:p>","DOI":"10.1145\/1778765.1778810","type":"journal-article","created":{"date-parts":[[2010,7,15]],"date-time":"2010-07-15T12:48:46Z","timestamp":1279198126000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":68,"title":["Optimizing walking controllers for uncertain inputs and environments"],"prefix":"10.1145","volume":"29","author":[{"given":"Jack M.","family":"Wang","sequence":"first","affiliation":[{"name":"University of Toronto"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David J.","family":"Fleet","sequence":"additional","affiliation":[{"name":"University of Toronto"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron","family":"Hertzmann","sequence":"additional","affiliation":[{"name":"University of Toronto"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2010,7,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"Abbeel P. Coates A. Quigley M. and Ng A. Y. 2007. An application of reinforcement learning to aerobatic helicopter flight. In Adv. NIPS 19. MIT Press 1--8.  Abbeel P. Coates A. Quigley M. and Ng A. Y. 2007. An application of reinforcement learning to aerobatic helicopter flight. In Adv. NIPS 19. MIT Press 1--8.","DOI":"10.7551\/mitpress\/7503.003.0006"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364909340446"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618516"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360681"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2258"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383287"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218411"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280816"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-004-1856-7"},{"key":"e_1_2_2_10_1","volume-title":"Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms","author":"Hansen N.","unstructured":"Hansen , N. 2006. The CMA evolution strategy: A comparing review . In Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms . Springer , 75--102. Hansen, N. 2006. The CMA evolution strategy: A comparing review. In Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms. Springer, 75--102."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/29528"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01373.x"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1142998"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2005.03.004"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618515"},{"key":"e_1_2_2_16_1","volume-title":"Proc. Symposium on Computer Animation, ACM SIGGRAPH\/Eurographics, 29--38","author":"Lo W.-Y.","unstructured":"Lo , W.-Y. , and Zwicker , M . 2008. Real-time planning for parameterized human motion . In Proc. Symposium on Computer Animation, ACM SIGGRAPH\/Eurographics, 29--38 . Lo, W.-Y., and Zwicker, M. 2008. Real-time planning for parameterized human motion. In Proc. Symposium on Computer Animation, ACM SIGGRAPH\/Eurographics, 29--38."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276385"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531387"},{"key":"e_1_2_2_19_1","volume-title":"Proc. UAI, AUAI, 406--415","author":"Ng A. Y.","unstructured":"Ng , A. Y. , and Jordan , M. I . 2000. PEGASUS: A policy search method for large MDPs and POMDPs . In Proc. UAI, AUAI, 406--415 . Ng, A. Y., and Jordan, M. I. 2000. PEGASUS: A policy search method for large MDPs and POMDPs. In Proc. UAI, AUAI, 406--415."},{"key":"e_1_2_2_20_1","volume-title":"Proc. ICRA, IEEE, 2387--2392","author":"Sharon D.","unstructured":"Sharon , D. , and van de Panne, M. 2005. Synthesis of controllers for stylized planar bipedal walking . In Proc. ICRA, IEEE, 2387--2392 . Sharon, D., and van de Panne, M. 2005. Synthesis of controllers for stylized planar bipedal walking. In Proc. ICRA, IEEE, 2387--2392."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192167"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276511"},{"key":"e_1_2_2_23_1","volume-title":"Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control","author":"Spall J. C.","unstructured":"Spall , J. C. 2003. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control . Wiley . Spall, J. C. 2003. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control. Wiley."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"key":"e_1_2_2_25_1","volume-title":"Proc. IROS","volume":"3","author":"Tedrake R.","unstructured":"Tedrake , R. , Zhang , T. W. , and Seung , H. S . 2004. Stochastic policy gradient reinforcement learning on a simple 3D biped . In Proc. IROS , vol. 3 , IEEE\/RSJ, 2849--2854. Tedrake, R., Zhang, T. W., and Seung, H. S. 2004. Stochastic policy gradient reinforcement learning on a simple 3D biped. In Proc. IROS, vol. 3, IEEE\/RSJ, 2849--2854."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/nn1309"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276386"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/166117.166159"},{"key":"e_1_2_2_29_1","volume-title":"Proc. CAS, EG, 165--177","author":"van de Panne M.","unstructured":"van de Panne , M. , and Lamouret , A . 1995. Guided optimization for balanced locomotion . In Proc. CAS, EG, 165--177 . van de Panne, M., and Lamouret, A. 1995. Guided optimization for balanced locomotion. In Proc. CAS, EG, 165--177."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618514"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276509"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778810","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1778765.1778810","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:25:53Z","timestamp":1750278353000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778810"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,7,26]]},"references-count":31,"aliases":["10.1145\/1833351.1778810"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2010,7,26]]}},"alternative-id":["10.1145\/1778765.1778810"],"URL":"https:\/\/doi.org\/10.1145\/1778765.1778810","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,7,26]]},"assertion":[{"value":"2010-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}