{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T23:56:30Z","timestamp":1780098990831,"version":"3.54.0"},"reference-count":69,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T00:00:00Z","timestamp":1632268800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2022,2]]},"abstract":"<jats:p>Probability distributions are key components of many learning from demonstration (LfD) approaches, with the spaces chosen to represent tasks playing a central role. Although the robot configuration is defined by its joint angles, end-effector poses are often best explained within several task spaces. In many approaches, distributions within relevant task spaces are learned independently and only combined at the control level. This simplification implies several problems that are addressed in this work. We show that the fusion of models in different task spaces can be expressed as products of experts (PoE), where the probabilities of the models are multiplied and renormalized so that it becomes a proper distribution of joint angles. Multiple experiments are presented to show that learning the different models jointly in the PoE framework significantly improves the quality of the final model. The proposed approach particularly stands out when the robot has to learn hierarchical objectives that arise when a task requires the prioritization of several sub-tasks (e.g. in a humanoid robot, keeping balance has a higher priority than reaching for an object). Since training the model jointly usually relies on contrastive divergence, which requires costly approximations that can affect performance, we propose an alternative strategy using variational inference and mixture model approximations. In particular, we show that the proposed approach can be extended to PoE with a nullspace structure (PoENS), where the model is able to recover secondary tasks that are masked by the resolution of tasks of higher-importance.<\/jats:p>","DOI":"10.1177\/02783649211040561","type":"journal-article","created":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T07:52:32Z","timestamp":1632297152000},"page":"163-188","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":22,"title":["Learning from demonstration using products of experts: Applications to manipulation and task prioritization"],"prefix":"10.1177","volume":"41","author":[{"given":"Emmanuel","family":"Pignat","sequence":"first","affiliation":[{"name":"Idiap Research Institute, Martigny, Switzerland"},{"name":"EPFL, Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1428-8933","authenticated-orcid":false,"given":"Jo\u0101o","family":"Silv\u00e9rio","sequence":"additional","affiliation":[{"name":"Idiap Research Institute, Martigny, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9036-6799","authenticated-orcid":false,"given":"Sylvain","family":"Calinon","sequence":"additional","affiliation":[{"name":"Idiap Research Institute, Martigny, Switzerland"},{"name":"EPFL, Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2021,9,22]]},"reference":[{"key":"bibr1-02783649211040561","first-page":"265","author":"Abadi M","year":"2016","journal-title":"12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)"},{"key":"bibr2-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1996.503582"},{"key":"bibr3-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1023\/A:1020281327116"},{"key":"bibr4-02783649211040561","first-page":"234","volume":"80","author":"Arenz O","year":"2018","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr5-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206410"},{"key":"bibr6-02783649211040561","first-page":"226","author":"Bengio Y","year":"2014","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr7-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1177\/0278364910396389"},{"key":"bibr8-02783649211040561","volume-title":"Pattern Recognition and Machine Learning (Information Science and Statistics)","author":"Bishop CM","year":"2006"},{"key":"bibr9-02783649211040561","first-page":"416","author":"Bishop CM","year":"1998","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr10-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1504\/IJDSDE.2011.042939"},{"key":"bibr11-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1007\/s11370-015-0187-9"},{"key":"bibr12-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1163\/016918609X12529294461843"},{"key":"bibr13-02783649211040561","first-page":"1683","author":"Chen T","year":"2014","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr14-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"bibr15-02783649211040561","author":"Dinh L","year":"2017","journal-title":"Proceedings International Conference on Learning Representation (ICLR)"},{"key":"bibr16-02783649211040561","volume-title":"Speech Pattern Processing Using Products of Experts","author":"Dixon PR","year":"2006"},{"key":"bibr17-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1016\/0370-2693(87)91197-X"},{"key":"bibr18-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2014.2302442"},{"key":"bibr19-02783649211040561","first-page":"49","author":"Finn C","year":"2016","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr20-02783649211040561","first-page":"2672","author":"Goodfellow I","year":"2014","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr21-02783649211040561","first-page":"723","volume":"13","author":"Gretton A","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"bibr22-02783649211040561","author":"Guo F","year":"2016","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr23-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1049\/cp:19991075"},{"key":"bibr24-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1162\/089976602760128018"},{"key":"bibr25-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"bibr26-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460730"},{"key":"bibr27-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1177\/0278364920946815"},{"key":"bibr28-02783649211040561","first-page":"449","author":"Jetchev N","year":"2011","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr29-02783649211040561","first-page":"151","author":"Johnson DD","year":"2017","journal-title":"International Conference on Computational Creativity"},{"key":"bibr30-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6630743"},{"key":"bibr31-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1977.tb01610.x"},{"key":"bibr32-02783649211040561","author":"Kingma DP","year":"2015","journal-title":"Proceedings International Conference on Learning Representation (ICLR)"},{"key":"bibr33-02783649211040561","author":"Kingma DP","year":"2013","journal-title":"Proceedings International Conference on Learning Representation (ICLR)"},{"key":"bibr34-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-016-9571-3"},{"key":"bibr35-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/ast021"},{"key":"bibr36-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206116"},{"key":"bibr37-02783649211040561","first-page":"222","author":"Li W","year":"2004","journal-title":"Proceedings of ICINCO"},{"key":"bibr38-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139551"},{"key":"bibr39-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353932"},{"key":"bibr40-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2010.10.010"},{"key":"bibr41-02783649211040561","first-page":"2420","author":"Miller AC","year":"2017","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr42-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2009.5353894"},{"key":"bibr43-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1177\/027836498700600201"},{"key":"bibr44-02783649211040561","first-page":"663","volume":"1","author":"Ng AY","year":"2000","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr45-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914554471"},{"key":"bibr46-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.08-07-592"},{"key":"bibr47-02783649211040561","first-page":"2616","author":"Paraschos A","year":"2013","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr48-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2725440"},{"key":"bibr49-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177704472"},{"key":"bibr50-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1080\/02331939108843693"},{"key":"bibr51-02783649211040561","first-page":"1851","author":"Pradalier C","year":"2003","journal-title":"Proceedings IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)"},{"key":"bibr52-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353107"},{"key":"bibr53-02783649211040561","first-page":"814","volume":"33","author":"Ranganath R","year":"2014","journal-title":"Proceedings of Machine Learning Research"},{"key":"bibr54-02783649211040561","first-page":"1530","author":"Rezende DJ","year":"2015","journal-title":"Proceedings International Conference on Machine Learning (ICML)"},{"key":"bibr55-02783649211040561","first-page":"448","volume":"5","author":"Salakhutdinov R","year":"2009","journal-title":"Proceedings of Machine Learning Research"},{"key":"bibr56-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1214\/13-BA858"},{"key":"bibr57-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2018.2878355"},{"key":"bibr58-02783649211040561","unstructured":"Sminchisescu C, Welling M, Hinton G (2003) A mode-hopping MCMC sampler. Technical report, University of Toronto."},{"key":"bibr59-02783649211040561","first-page":"3483","author":"Sohn K","year":"2015","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr60-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2010.5650663"},{"key":"bibr61-02783649211040561","unstructured":"Voss C, Moll M, Kavraki LE (2017) Atlas+ X: Sampling-based planners on constraint manifolds. Technical Report, RICE Computer Science."},{"issue":"1","key":"bibr62-02783649211040561","first-page":"1","volume":"1","author":"Wainwright MJ","year":"2008","journal-title":"Foundations and Trends in Machine Learning"},{"key":"bibr63-02783649211040561","first-page":"417","author":"Welling M","year":"2004","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"bibr64-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/ICAR.2015.7251428"},{"key":"bibr65-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1177\/027836498500400201"},{"key":"bibr66-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2657001"},{"key":"bibr67-02783649211040561","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2165280"},{"key":"bibr68-02783649211040561","first-page":"2459","volume-title":"Proceedings IEEE International Conference on Robotics and Automation (ICRA)","author":"Zhang Y","year":"2013"},{"key":"bibr69-02783649211040561","first-page":"1433","volume-title":"Proceedings of AAAI","volume":"8","author":"Ziebart BD","year":"2008"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649211040561","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649211040561","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649211040561","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:16:52Z","timestamp":1777457812000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649211040561"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,22]]},"references-count":69,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,2]]}},"alternative-id":["10.1177\/02783649211040561"],"URL":"https:\/\/doi.org\/10.1177\/02783649211040561","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,22]]}}}