{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T20:26:49Z","timestamp":1773779209911,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>This paper focuses on development of a high-speed, low-latency telemanipulated robot hand system, evaluation of the system, and demonstration of the system. The characteristics of the developed system are the followings: non-contact, high-speed 3D visual sensing of the human hand, intuitive motion mapping between human hands and robot hands, and low-latency, fast responsiveness to human hand motion. Such a high-speed, low-latency telemanipulated robot hand system can be considered to be more effective from the viewpoint of usability. The developed system consists of a high-speed vision system, a high-speed robot hand, and a real-time controller. For the developed system, we propose new methods of 3D sensing, mapping between the human hand and the robot hand, and the robot hand control. We evaluated the performance (latency and responsiveness) of the developed system. As a result, the latency of the developed system is so small that humans cannot recognize the latency. In addition, we conducted experiments of opening\/closing motion, object grasping, and moving object grasping as demonstrations. Finally, we confirmed the validity and effectiveness of the developed system and proposed method.<\/jats:p>","DOI":"10.3390\/robotics10010041","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T20:29:48Z","timestamp":1614803388000},"page":"41","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Development of a High-Speed, Low-Latency Telemanipulated Robot Hand System"],"prefix":"10.3390","volume":"10","author":[{"given":"Yuji","family":"Yamakawa","sequence":"first","affiliation":[{"name":"Interfaculty Initiative in Information Studies, The University of Tokyo, Tokyo 153-8505, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yugo","family":"Katsuki","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science and Technology, The University of Tokyo, Tokyo 113-8656, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yoshihiro","family":"Watanabe","sequence":"additional","affiliation":[{"name":"School of Engineering, Tokyo Institute of Technology, Kanagawa 226-8503, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masatoshi","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Information Technology Center, The University of Tokyo, Tokyo 113-8656, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,3]]},"reference":[{"key":"ref_1","unstructured":"Sheridan, T.B. (1992). Telerobotics, Automation and Human Supervisory Control, The MIT Press."},{"key":"ref_2","unstructured":"Cui, J., Tosunoglu, S., Roberts, R., Moore, C., and Repperger, D.W. (2003, January 8\u20139). A review of teleoperation system control. Proceedings of the Florida Conference on Recent Advances in Robotics, Boca Raton, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TVCG.2005.99","article-title":"Development of anthropomorphic multi-DOF master-slave arm for mutual telexistence","volume":"11","author":"Tadakuma","year":"2005","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_4","unstructured":"Angelika, P., Einenkel, S., and Buss, M. (2008, January 1\u20133). Multi-fingered telemanipulation\u2014Mapping of a human hand to a three finger gripper. Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, Munich, Germany."},{"key":"ref_5","unstructured":"Tezuka, T., Goto, A., Kashiwa, K., Yoshikawa, H., and Kawano, R. (1994, January 18\u201320). A study on space interface for teleoperation system. Proceedings of the IEEE International Workshop Robot and Human Communication, Nagoya, Japan."},{"key":"ref_6","unstructured":"Arai, S., Miyake, K., Miyoshi, T., and Terashima, K. (2008, January 1\u20133). Tele-control between operator\u2019s hand and multi-fingered humanoid robot hand with delayed time. Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication, Munich, Germany."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bachmann, E.R., McGhee, R.B., Yun, X., and Zyda, M.J. (2001, January 15\u201317). Inertial and magnetic posture tracking for inserting humans into networked virtual environments. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Banff, AB, Canada.","DOI":"10.1145\/505008.505011"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1147\/sj.353.0639","article-title":"Inertial proprioceptive devices: Self-motion-sensing toys and tools","volume":"35","author":"Verplaetse","year":"1996","journal-title":"IBM Syst. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1109\/TRA.2003.808873","article-title":"A human-assisting manipulator teleoperated by EMG signals and arm motions","volume":"19","author":"Fukuda","year":"2003","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1109\/TIE.2005.855696","article-title":"Teleoperation of a robot manipulator using a vision-based human-robot interface","volume":"52","author":"Kofman","year":"2005","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, N., Chew, C.-M., Tee, K.P., and Han, B.S. (2012, January 9\u201313). Human-aided robotic grasping. Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France.","DOI":"10.1109\/ROMAN.2012.6343734"},{"key":"ref_12","unstructured":"Hu, C., Meng, M.Q., Liu, P.X., and Wang, X. (2003, January 27\u201331). Visual gesture recognition for human-machine interface of robot teleoperation. Proceedings of the 2003 IEEE\/RSJ International Conference Intelligent Robots and Systems, Las Vegas, NV, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.3390\/s130201385","article-title":"Complete Low-Cost Implementation of a Teleoperated Control System for a Humanoid Robot","volume":"13","author":"Cela","year":"2013","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yang, K., Bergasa, L.M., Romera, E., Huang, X., and Wang, K. (2018, January 6\u20139). Predicting Polarization Beyond Semantics for Wearable Robotics. Proceedings of the 2018 IEEE-RAS 18th International Conference on Humanoid Robots, Beijing, China.","DOI":"10.1109\/HUMANOIDS.2018.8625005"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hoshino, K., Tamaki, E., and Tanimoto, T. (2007, January 5\u20138). Copycat hand\u2014Robot hand generating imitative behavior. Proceedings of the 33rd Annual Conference of the IEEE Industrial Electronics Society, Taipei, Taiwan.","DOI":"10.1109\/IECON.2007.4460062"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"MacKenzie, I.S., and Ware, C. (1993, January 24\u201329). Lag as a determinant of human performance in interactive systems. Proceedings of the INTERACT\u201993 and CHI\u201993 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands.","DOI":"10.1145\/169059.169431"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Katsuki, Y., Yamakawa, Y., Watanabe, Y., and Ishikawa, M. (2015, January 2\u20135). Super-Low-Latency Telemanipulation Using High-Speed Vision and High-Speed Multifingered Robot Hand. Proceedings of the 2015 ACM\/IEEE International Conference on Human-Robot Interaction Extended Abstracts, Portland, OR, USA.","DOI":"10.1145\/2701973.2701983"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Katsuki, Y., Yamakawa, Y., Watanabe, Y., and Ishikawa, M. (October, January 28). Development of Fast-Response Master-Slave System Using High-speed Non-contact 3D Sensing and High-speed Robot Hand. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353527"},{"key":"ref_19","unstructured":"Namiki, A., Imai, Y., Ishikawa, M., and Kaneko, M. (2003, January 27\u201331). Development of a High-speed Multifingered Hand System and Its Application to Catching. Proceedings of the 2003 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453), Las Vegas, NV, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Griffin, W.B., Findley, R.P., Turner, M.L., and Cutkosky, M.R. (2000, January 5\u201310). Caribration and mapping of a human hand for dexterous telemanipulation. Proceedings of the ASME IMECE 2000 Conference Haptic Interfaces for Virtual Environments and Teleoperator Systems Symposium, Orlando, FL, USA.","DOI":"10.1115\/IMECE2000-2424"},{"key":"ref_21","unstructured":"Wang, H., Low, K.H., Wang, M.Y., and Gong, F. (2005, January 18\u201322). A mapping method for telemanipulation of the non-anthropomorphic robotic hands with initial experimental validation. Proceedings of the 2005 IEEE International Conference on Robotics and Animation, Barcelona, Spain."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Okumura, K., Oku, H., and Ishikawa, M. (2011, January 9\u201313). High-Speed Gaze Controller for Millisecond-order Pan\/tilt Camera. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980080"},{"key":"ref_23","unstructured":"(2021, January 05). Janken (Rock-Paper-Scissors) Robot with 100% Winning Rate: 3rd Version. Available online: https:\/\/www.youtube.com\/watch?v=Qb5UIPeFClM."},{"key":"ref_24","unstructured":"(2021, January 05). Telemanipulation System Using High-Speed Vision and High-Speed Multifingered Robot Hand. Available online: http:\/\/www.youtube.com\/watch?v=L6Teh3zMSyE."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4523","DOI":"10.1007\/s00170-017-1491-7","article-title":"Dynamic compensation robot with a new high-speed vision system for flexible manufacturing","volume":"95","author":"Huang","year":"2018","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1111\/j.0956-7976.2005.00796.x","article-title":"Visual recognition as soon as you know it is there, you know what it is","volume":"16","author":"Kanwisher","year":"2005","journal-title":"Psychol. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Katsuki, Y., Yamakawa, Y., and Ishikawa, M. (2015, January 2\u20135). High-speed Human\/Robot Hand Interaction System. Proceedings of the 2015 ACM\/IEEE Int. Conference on Human-Robot Interaction, Portland, OR, USA.","DOI":"10.1145\/2701973.2701984"},{"key":"ref_28","unstructured":"(2021, January 05). Ishikawa Group Laboratory. Available online: http:\/\/www.k2.t.u-tokyo.ac.jp\/fusion\/Janken\/."},{"key":"ref_29","unstructured":"Laming, D.R.J. (1968). Information Theory of Choice-Reaction Times, Academic Press."},{"key":"ref_30","unstructured":"Asano, T., and Yamakawa, Y. (2019, January 17\u201321). Dynamic Measurement of a Human Hand Motion with Noise Elimination and Slight Motion Detection Algorithms Using a 1 kHz Vision. Proceedings of the 2019 Asia Pacific Measurement Forum on Mechanical Quantities, Niigata, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yoshida, K., and Yamakawa, Y. (2020, January 16\u201318). 2D Position Estimation of Finger Joints with High Spatio-Temporal Resolution Using a High-speed Vision. Proceedings of the 21st SICE System Integration Division Annual Conference, Fukuoka, Japan. (In Japanese).","DOI":"10.1299\/jsmermd.2020.2P1-N01"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Katsuki, Y., Yamakawa, Y., Ishikawa, M., and Shimojo, M. (2015, January 1\u20134). High-speed Sensing of Softness during Grasping Process by Robot Hand Equipped with Tactile Sensor. Proceedings of the IEEE SENSORS, Busan, Korea.","DOI":"10.1109\/ICSENS.2015.7370616"},{"key":"ref_33","unstructured":"Gunji, D., Namiki, A., Shimojo, M., and Ishikawa, M. (2006, January 14\u201317). Grasping Force Control Against Tangential Force by Robot Hand with CoP Tactile Sensor. Proceedings of the 7th SICE System Integration Division Annual Conference, Hokkaido, Japan. (In Japanese)."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/TOH.2010.4","article-title":"Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound","volume":"3","author":"Hoshi","year":"2010","journal-title":"IEEE Trans. Haptics"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/41\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:32:18Z","timestamp":1760160738000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/41"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["robotics10010041"],"URL":"https:\/\/doi.org\/10.3390\/robotics10010041","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,3]]}}}