{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T09:56:02Z","timestamp":1777715762379,"version":"3.51.4"},"reference-count":41,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2008,2,1]],"date-time":"2008-02-01T00:00:00Z","timestamp":1201824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2008,2]]},"abstract":"<jats:p>One of the most general frameworks for phrasing control problems for complex, redundant robots is operational-space control. However, while this framework is of essential importance for robotics and well understood from an analytical point of view, it can be prohibitively hard to achieve accurate control in the face of modeling errors, which are inevitable in complex robots (e.g. humanoid robots). In this paper, we suggest a learning approach for operational-space control as a direct inverse model learning problem. A first important insight for this paper is that a physically correct solution to the inverse problem with redundant degrees of freedom does exist when learning of the inverse map is performed in a suitable piecewise linear way. The second crucial component of our work is based on the insight that many operational-space controllers can be understood in terms of a constrained optimal control problem. The cost function associated with this optimal control problem allows us to formulate a learning algorithm that automatically synthesizes a globally consistent desired resolution of redundancy while learning the operational-space controller. From the machine learning point of view, this learning problem corresponds to a reinforcement learning problem that maximizes an immediate reward. We employ an expectation-maximization policy search algorithm in order to solve this problem. Evaluations on a three degrees-of-freedom robot arm are used to illustrate the suggested approach. The application to a physically realistic simulator of the anthropomorphic SARCOS Master arm demonstrates feasibility for complex high degree-of-freedom robots. We also show that the proposed method works in the setting of learning resolved motion rate control on a real, physical Mitsubishi PA-10 medical robotics arm.<\/jats:p>","DOI":"10.1177\/0278364907087548","type":"journal-article","created":{"date-parts":[[2008,1,25]],"date-time":"2008-01-25T09:44:04Z","timestamp":1201254244000},"page":"197-212","source":"Crossref","is-referenced-by-count":128,"title":["Learning to Control in Operational Space"],"prefix":"10.1177","volume":"27","author":[{"given":"Jan","family":"Peters","sequence":"first","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, Spemannstrasse 38, 72076 T\u00fcbingen, Germany, University of Southern California, 3641 Watt Way, Los Angeles, CA 90089, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Schaal","sequence":"additional","affiliation":[{"name":"University of Southern California, 3641 Watt Way, Los Angeles, CA 90089, USA, ATR Computational Neuroscience Laboratory, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2008,2,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006559212014"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006511328852"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2000.846414"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.1993.5.4.408"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.2.271"},{"key":"atypb6","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation (ICRA)","author":"De Luca, A."},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1177\/027836499301200101"},{"key":"atypb8","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"D'Souza, A."},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1002\/0471781819"},{"key":"atypb10","volume-title":"Proceedings of IEEE International Conference on Neural Networks","author":"Guez, A."},{"key":"atypb11","volume-title":"Multiple paired forward-inverse models for human motor learning and control. Advances in Neural Information Processing Systems","author":"Haruno, M.","year":"1999"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1002\/rob.4620060203"},{"key":"atypb13","volume-title":"Genralized Inverses: Theory and Applications","author":"Israel, A.B.","year":"2003","edition":"2"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1603_1"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2005.848290"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1109\/JRA.1987.1087068"},{"key":"atypb18","volume-title":"InformationTheory, Inference, and Learning Algorithms","author":"MacKay, D.","year":"2003"},{"key":"atypb19","volume-title":"Advanced Robotics: Redundancy and Optimization","author":"Nakamura, Y.","year":"1991"},{"key":"atypb20","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Nakanishi, J."},{"key":"atypb21","volume-title":"Proceedings of the International Conference on Robotics and Automation (ICRA)","author":"Nakanishi, J."},{"key":"atypb22","volume-title":"IEEE International Conference on Intelligent Robotics Systems","author":"Nakanishi, J."},{"key":"atypb23","author":"Nguyen-Tuong, D.","year":"2007","journal-title":"Cybernetics"},{"key":"atypb24","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Park, J."},{"key":"atypb25","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Peters, J."},{"key":"atypb26","volume-title":"Proceedings of the International Conference on Robotics and Automation (ICRA)","author":"Peters, J."},{"key":"atypb27","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Peters, J."},{"key":"atypb28","volume-title":"Gaussian Processes for Machine Learning","author":"Rasmussen, C.E.","year":"2006"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015727715131"},{"key":"atypb30","volume-title":"Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond","author":"Sch\u00f6lkopf, B.","year":"2002"},{"key":"atypb31","volume-title":"Modeling and Control of Robot Manipulators","author":"Sciavicco, L.","year":"2007"},{"key":"atypb32","volume-title":"Proceedings of the International Conference on Robotics and Automation (ICRA). Barcelona","author":"Sentis, L."},{"key":"atypb33","volume-title":"Proceedings of Artificial Intelligence and Statistics (AISTATS)","author":"Snelson, E."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1002\/0471722138"},{"key":"atypb35","volume-title":"Robot Modeling and Control","author":"Spong, M.W.","year":"2006"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2000.844073"},{"key":"atypb37","volume-title":"Proceedings of the Robotics: Science and Systems Conference","author":"Ting, J.-A."},{"key":"atypb38","author":"Udwadia, F.E.","year":"2005","journal-title":"Personal communication"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511665479"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1162\/089976605774320557"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013258808932"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907087548","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907087548","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:16:15Z","timestamp":1777457775000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364907087548"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,2]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2008,2]]}},"alternative-id":["10.1177\/0278364907087548"],"URL":"https:\/\/doi.org\/10.1177\/0278364907087548","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,2]]}}}