{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T02:34:12Z","timestamp":1773196452162,"version":"3.50.1"},"reference-count":73,"publisher":"Annual Reviews","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Annu. Rev. Control Robot. Auton. Syst."],"published-print":{"date-parts":[[2019,5,3]]},"abstract":"<jats:p> Planning and executing object manipulation requires integrating multiple sensory and motor channels while acting under uncertainty and complying with task constraints. As the modern environment is tuned for human hands, designing robotic systems with similar manipulative capabilities is crucial. Research on robotic object manipulation is divided into smaller communities interested in, e.g., motion planning, grasp planning, sensorimotor learning, and tool use. However, few attempts have been made to combine these areas into holistic systems. In this review, we aim to unify the underlying mechanics of grasping and in-hand manipulation by focusing on the temporal aspects of manipulation, including visual perception, grasp planning and execution, and goal-directed manipulation. Inspired by human manipulation, we envision that an emphasis on the temporal integration of these processes opens the way for human-like object use by robots. <\/jats:p>","DOI":"10.1146\/annurev-control-053018-023735","type":"journal-article","created":{"date-parts":[[2018,10,4]],"date-time":"2018-10-04T19:02:46Z","timestamp":1538679766000},"page":"161-179","source":"Crossref","is-referenced-by-count":16,"title":["From Visual Understanding to Complex Object Manipulation"],"prefix":"10.1146","volume":"2","author":[{"given":"Judith","family":"B\u00fctepage","sequence":"first","affiliation":[{"name":"Department of Robotics, Perception, and Learning, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden;, , , ,"}]},{"given":"Silvia","family":"Cruciani","sequence":"additional","affiliation":[{"name":"Department of Robotics, Perception, and Learning, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden;, , , ,"}]},{"given":"Mia","family":"Kokic","sequence":"additional","affiliation":[{"name":"Department of Robotics, Perception, and Learning, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden;, , , ,"}]},{"given":"Michael","family":"Welle","sequence":"additional","affiliation":[{"name":"Department of Robotics, Perception, and Learning, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden;, , , ,"}]},{"given":"Danica","family":"Kragic","sequence":"additional","affiliation":[{"name":"Department of Robotics, Perception, and Learning, KTH Royal Institute of Technology, 100 44 Stockholm, Sweden;, , , ,"}]}],"member":"22","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.21-17-06917.2001"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.2002.88.4.1716"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.30.4.749"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2007.06.005"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1016\/0022-0965(79)90109-7"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-011-2980-9"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2015.2470657"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2014.2326871"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2014.2326867"},{"key":"B10","first-page":"653","volume-title":"Principles of Neural Science","author":"Ghez C","year":"2000"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/BF00236911"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.05-07-01688.1985"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1007\/BF00339982"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1007\/BF00204593"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.4.709"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-010-2191-9"},{"key":"B17","first-page":"110","volume-title":"Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation","author":"ElKoura G","year":"2003"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2013.00023"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2004.1404285"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/60.4.389"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2621"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00310"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.4324\/9781315740218"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.20.1.174"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1037\/a0019004"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2011.07.016"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2013.2289018"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2003.1241860"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2008.4650722"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2011.6095133"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1996.506534"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2010.5509439"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914549607"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980145"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487517"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2017.XIII.058"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2014.2302442"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2014.7041469"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2009.2020351"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2012.2192171"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989392"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2014.6942775"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-014-9402-3"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-017-0562-1"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1177\/0278364912442972"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2602374"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-011-9243-2"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1016\/j.sna.2011.02.038"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2015.07.015"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696929"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2011.2162271"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2016.08.007"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631070"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2588879"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1109\/70.897777"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2017.1365011"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1987.1087910"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2006.1641181"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2017.2693391"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2017.XIII.015"},{"key":"B61","unstructured":"61.\u2002  Antonova  R,  Cruciani  S,  Smith  C,  Kragic  D.  2017.  Reinforcement learning for pivoting task.  arXiv:1703.00472 [cs.RO]"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2593053"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487159"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6907062"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7354264"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139709"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594303"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1109\/CoASE.2015.7294269"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989394"},{"key":"B70","volume-title":"Robot manipulation of human tools: autonomous detection and control of task relevant features","author":"Kemp CC","year":"2006"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2014.02.001"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2010.5723326"},{"key":"B73","volume-title":"RoboCup 2015 - homer@UniKoblenz (Germany)","author":"Seib V","year":"2015"}],"container-title":["Annual Review of Control, Robotics, and Autonomous Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.annualreviews.org\/doi\/pdf\/10.1146\/annurev-control-053018-023735","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T10:45:18Z","timestamp":1633689918000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.annualreviews.org\/doi\/10.1146\/annurev-control-053018-023735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,3]]},"references-count":73,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,5,3]]}},"alternative-id":["10.1146\/annurev-control-053018-023735"],"URL":"https:\/\/doi.org\/10.1146\/annurev-control-053018-023735","relation":{},"ISSN":["2573-5144","2573-5144"],"issn-type":[{"value":"2573-5144","type":"print"},{"value":"2573-5144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,3]]}}}