{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:46:13Z","timestamp":1760240773567,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,9,16]],"date-time":"2019-09-16T00:00:00Z","timestamp":1568592000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["RTI2018-094279-B-100"],"award-info":[{"award-number":["RTI2018-094279-B-100"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>This article presents a multiplatform application for the tele-operation of a robot hand using virtualization in Unity 3D. This approach grants usability to users that need to control a robotic hand, allowing supervision in a collaborative way. This paper focuses on a user application designed for the 3D virtualization of a robotic hand and the tele-operation architecture. The designed system allows for the simulation of any robotic hand. It has been tested with the virtualization of the four-fingered Allegro Hand of SimLab with 16 degrees of freedom, and the Shadow hand with 24 degrees of freedom. The system allows for the control of the position of each finger by means of joint and Cartesian co-ordinates. All user control interfaces are designed using Unity 3D, such that a multiplatform philosophy is achieved. The server side allows the user application to connect to a ROS (Robot Operating System) server through a TCP\/IP socket, to control a real hand or to share a simulation of it among several users. If a real robot hand is used, real-time control and feedback of all the joints of the hand is communicated to the set of users. Finally, the system has been tested with a set of users with satisfactory results.<\/jats:p>","DOI":"10.3390\/robotics8030081","type":"journal-article","created":{"date-parts":[[2019,9,16]],"date-time":"2019-09-16T03:17:57Z","timestamp":1568603877000},"page":"81","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Virtualization of Robotic Hands Using Mobile Devices \u2020"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6175-600X","authenticated-orcid":false,"given":"Santiago T.","family":"Puente","sequence":"first","affiliation":[{"name":"Physics, Systems, Engineering and Signal Theory Department, University of Alicante, 03690 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luc\u00eda","family":"M\u00e1s","sequence":"additional","affiliation":[{"name":"Physics, Systems, Engineering and Signal Theory Department, University of Alicante, 03690 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6261-9939","authenticated-orcid":false,"given":"Fernando","family":"Torres","sequence":"additional","affiliation":[{"name":"Physics, Systems, Engineering and Signal Theory Department, University of Alicante, 03690 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7126-0374","authenticated-orcid":false,"given":"and Francisco A.","family":"Candelas","sequence":"additional","affiliation":[{"name":"Physics, Systems, Engineering and Signal Theory Department, University of Alicante, 03690 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/TSMCB.2003.811794","article-title":"Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center","volume":"33","author":"Casper","year":"2003","journal-title":"IEEE Trans. Syst. Man Cybern. Part B (Cybern.)"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s12369-017-0463-2","article-title":"SPRinT: A Mixed Approach to a Hand-Held Robot Interface for Telepresence","volume":"10","author":"Jonggil","year":"2018","journal-title":"Int. J. Soc. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Alepis, E., and Sakelliou, A. (2016, January 13\u201315). Augmented car: A low-cost augmented reality RC car using the capabilities of a smartphone. Proceedings of the 7th International Conference on Information, Intelligence, Systems & Applications (IISA), Chalkidiki, Greece.","DOI":"10.1109\/IISA.2016.7785381"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Stoll, B., Reig, S., He, L., Kaplan, I., Jung, M.F., and Fussell, S.R. (2018, January 5\u20138). Wait, Can You Move the Robot? Examining Telepresence Robot Use in Collaborative Teams. Proceedings of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.","DOI":"10.1145\/3171221.3171243"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"055034","DOI":"10.1088\/1361-665X\/ab1176","article-title":"Soft-smart robotic end effectors with sensing, actuation, and gripping capabilities","volume":"28","author":"Xiang","year":"2019","journal-title":"Smart Mater. Struct."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1402","DOI":"10.1109\/LRA.2019.2895877","article-title":"Pre-Charged Pneumatic Soft Gripper with Closed-Loop Control","volume":"4","author":"Li","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Khan, A., Li, J., Malik, A., and Yusuf, K.M. (2019). Vision-Based Inceptive Integration for Robotic Control. Soft Computing and Signal Processing, Springer.","DOI":"10.1007\/978-981-13-3393-4_11"},{"key":"ref_8","unstructured":"SimLab (2019, April 30). Allegro Hand Overview. Available online: http:\/\/wiki.wonikrobotics.com\/AllegroHandWiki\/index.php\/Allegro_Hand_Overview."},{"key":"ref_9","unstructured":"Li, M., Yin, H., Tahara, K., and Billard, A. (June, January 31). Learning object-level impedance control for robust grasping and dexterous manipulation. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1109\/TRO.2016.2588879","article-title":"Hierarchical Fingertip Space: A Unified Framework for Grasp Planning and In-Hand Grasp Adaptation","volume":"32","author":"Hang","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1109\/LRA.2017.2734965","article-title":"Covering a Robot Fingertip with uSkin: A Soft Electronic Skin with Distributed 3-Axis Force Sensitive Elements for Robot Hands","volume":"3","author":"Tomo","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Or, K., Schmitz, A., Funabashi, S., Tomura, M., and Sugano, S. (2016, January 12\u201315). Development of robotic fingertip morphology for enhanced manipulation stability. Proceedings of the IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Banff, AB, Canada.","DOI":"10.1109\/AIM.2016.7576738"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Or, K., Tomura, M., Schmitz, A., Funabashi, S., and Sugano, S. (2015, January 11\u201313). Interpolation control posture design for in-hand manipulation. Proceedings of the IEEE\/SICE International Symposium on System Integration (SII), Nagoya, Japan.","DOI":"10.1109\/SII.2015.7404976"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.3390\/s140101787","article-title":"Control Framework for Dexterous Manipulation Using Dynamic Visual Servoing and Tactile Sensors\u2019 Feedback","volume":"14","author":"Jara","year":"2014","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Torres, A., Candelas Her\u00edas, F.A., Mira, D., and Torres Medina, F. (2017, January 24\u201326). DM-UAV: Dexterous Manipulation Unmanned Aerial Vehicle. Proceedings of the ICAART, Porto, Portugal.","DOI":"10.5220\/0006186701530158"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1007\/s11370-015-0178-x","article-title":"Computation of minimum contact forces of multifingered robot hand with soft fingertips","volume":"8","author":"Liu","year":"2015","journal-title":"Intell. Serv. Robot."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/MIE.2017.2688483","article-title":"Batteries in Portable Electronic Devices: A User\u2019s Perspective","volume":"11","author":"Saxena","year":"2017","journal-title":"IEEE Ind. Electron. Mag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.riai.2017.04.001","article-title":"Use of Platforms for the Development of Virtual Applications in the Modeling of Robot Manipulators","volume":"14","year":"2017","journal-title":"Rev. Iberoam. Autom. Inf. Ind. RIAI"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10055-016-0293-9","article-title":"Industry use of virtual reality in product design and manufacturing: A survey","volume":"21","author":"Berg","year":"2017","journal-title":"Virtual Real."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Nilsson, N.C., Serafin, S., Laursen, M.H., Pedersen, K.S., Sikstrom, E., and Nordahl, R. (2013, January 16\u201317). Tapping-in-place: Increasing the naturalness of immersive walking-in-place locomotion through novel gestural input. Proceedings of the IEEE Symposium on 3D User Interfaces, Orlando, FL, USA.","DOI":"10.1109\/3DUI.2013.6550193"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Andaluz, V.H., Chicaiza, F.A., Gallardo, C., Quevedo, W.X., Varela, J., S\u00e1nchez, J.S., and Arteaga, O. (2016, January 15\u201318). Unity3D-MatLab Simulator in Real Time for Robotics Applications. Proceedings of the Augmented Reality, Virtual Reality, and Computer Graphics: 3rd International Conference, AVR 2016, Lecce, Italy.","DOI":"10.1007\/978-3-319-40621-3_19"},{"key":"ref_22","unstructured":"Quigley, M., Conley, K., Gerkey, B.P., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 17). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan."},{"key":"ref_23","unstructured":"(2019, April 30). Unity. Available online: https:\/\/unity.com\/."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Craighead, J., Murphy, R., Burke, J., and Goldiez, B. (2007, January 10\u201314). A Survey of Commercial & Open Source Unmanned Vehicle Simulators. Proceedings of the IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.363092"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Meng, W., Hu, Y., Lin, J., Lin, F., and Teo, R. (2015, January 9\u201312). ROS + Unity: An Efficient High-Fidelity 3D Multi-UAV Navigation and Control Simulator in GPS-Denied Environments. Proceedings of the 41st Annual Conference of the IEEE Industrial Electronics Society, IECON 2015, Yokohama, Japan.","DOI":"10.1109\/IECON.2015.7392488"},{"key":"ref_26","unstructured":"Craighead, J., Burke, J., and Murphy, R. (2008, January 22\u201326). Using the Unity Game Engine to Develop SARGE: A Case Study. Proceedings of the 2008 Simulation Workshop at the International Conference on Intelligent Robots and Systems (IROS 2008), Nice, France."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.plrev.2016.02.001","article-title":"Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands","volume":"17","author":"Salvietti","year":"2016","journal-title":"Phys. Life Rev."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Codd-Downey, R., Mojiri Forooshani, P., Speers, A., Wang, H., and Jenkin, M. (2014, January 28\u201330). From ROS to Unity: Leveraging robot and virtual environment middleware for immersive teleoperation. Proceedings of the IEEE International Conference on Information and Automation (ICIA), Hailar, China.","DOI":"10.1109\/ICInfA.2014.6932785"},{"key":"ref_29","unstructured":"Koga, M., and Yunoki, T. (October, January 28). 3D Visualization Tool for Robot in URDF on Android Devices. Proceedings of the Japan Joint Automatic Control Conference, Hamburg, Germany."},{"key":"ref_30","first-page":"1334","article-title":"Android based teleoperation for the finch robot","volume":"7","author":"Faust","year":"2016","journal-title":"ICTACT J. Commun. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yan, B., Shi, D., Wei, J., and Pan, C. (2017, January 16\u201318). HiBot: A generic ROS-based robot-remote-control framework. Proceedings of the 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), Wuhan, China.","DOI":"10.1109\/ACIRS.2017.7986097"},{"key":"ref_32","unstructured":"Christensen, H.I., and Khatib, O. (2011, January 9\u201312). Rosbridge: ROS for Non-ROS Users. Proceedings of the Robotics Research: The 15th International Symposium ISRR, Flagstaff, AZ, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Codd-Downey, R., and Jenkin, M. (2015, January 21\u201323). RCON: Dynamic Mobile Interfaces for Command and Control of ROS-enabled Robots. Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Colmar, France.","DOI":"10.5220\/0005540000660073"},{"key":"ref_34","unstructured":"Puente, S.T., M\u00e1s, L., Torres, F., and Candelas, C. (2019, January 26\u201329). Teleoperation of robotic hands through virtualization in Unity 3D for mobile device. Proceedings of the Spanish Robotics Conference, Madrid, Spain."},{"key":"ref_35","unstructured":"(2019, April 30). Shadow Dexterous Hand. Available online: https:\/\/www.shadowrobot.com\/products\/dexterous-hand\/."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bae, J.H., Park, S.W., Kim, D., Baeg, M.H., and Oh, S.R. (2012, January 14\u201318). A Grasp Strategy with the Geometric Centroid of a Groped Object Shape Derived from Contact Spots. Proceedings of the 2012 IEEE International Conference on Robotics and Automation (ICRA2012), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225379"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1109\/TASE.2014.2368997","article-title":"Inside the virtual robotics challenge: Simulating real-time robotic disaster response","volume":"12","author":"Aguero","year":"2015","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1109\/MRA.2004.1371616","article-title":"Graspit! A Versatile Simulator for Robotic Grasping","volume":"11","author":"Miller","year":"2004","journal-title":"IEEE Robot. Autom. Mag."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/81\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:20:26Z","timestamp":1760188826000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/81"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,16]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["robotics8030081"],"URL":"https:\/\/doi.org\/10.3390\/robotics8030081","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2019,9,16]]}}}