{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T05:09:17Z","timestamp":1777957757089,"version":"3.51.4"},"reference-count":66,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T00:00:00Z","timestamp":1727308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100007195","name":"Universit\u00e0 degli Studi di Napoli Federico II","doi-asserted-by":"publisher","award":["PNC0000007"],"award-info":[{"award-number":["PNC0000007"]}],"id":[{"id":"10.13039\/100007195","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Prisma Hand II is an under-actuated prosthetic hand developed at the University of Naples, Federico II to study in-hand manipulations during grasping activities. 3 motors equipped on the robotic hand drive 19 joints using elastic tendons. The operations of the hand are achieved by combining tactile hand sensing with under-actuation capabilities. The hand has the potential to be employed in both industrial and prosthetic applications due to its dexterous motion capabilities. However, currently there are no commercially available tactile sensors with compatible dimensions suitable for the prosthetic hand. Hence, in this work, we develop a novel tactile sensor designed based on an opto-electronic technology for the Prisma Hand II. The optimised dimensions of the proposed sensor made it possible to be integrated with the fingertips of the prosthetic hand. The output voltage obtained from the novel tactile sensor is used to determine optimum grasping forces and torques during in-hand manipulation tasks employing Neural Networks (NNs). The grasping force values obtained using a Convolutional Neural Network (CNN) and an Artificial Neural Network (ANN) are compared based on Mean Square Error (MSE) values to find out a better training network for the tasks. The tactile sensing capabilities of the proposed novel sensing method are presented and compared in simulation studies and experimental validations using various hand manipulation tasks. The developed tactile sensor is found to be showcasing a better performance compared to previous version of the sensor used in the hand.<\/jats:p>","DOI":"10.3389\/frobt.2024.1460589","type":"journal-article","created":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T04:10:21Z","timestamp":1727323821000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Validations of various in-hand object manipulation strategies employing a novel tactile sensor developed for an under-actuated robot hand"],"prefix":"10.3389","volume":"11","author":[{"given":"Avinash","family":"Singh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Massimilano","family":"Pinto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Petros","family":"Kaltsas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Salvatore","family":"Pirozzi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shifa","family":"Sulaiman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fanny","family":"Ficuciello","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,9,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2015\/846487","article-title":"Pressure sensor: state of the art, design, and application for robotic hand","volume":"2015","author":"Almassri","year":"2015","journal-title":"J. Sensors"},{"key":"B2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0278364919887447","article-title":"Learning dexterous in-hand manipulation","volume":"39","author":"Andrychowicz","year":"2020","journal-title":"Int. J. Robotics Res."},{"key":"B3","doi-asserted-by":"publisher","first-page":"2288","DOI":"10.1088\/0960-1317\/17\/11\/016","article-title":"A miniaturized and flexible optoelectronic sensing system for tactile skin","volume":"17","author":"Ascari","year":"2007","journal-title":"J. Micromechanics Microengineering"},{"key":"B4","doi-asserted-by":"publisher","first-page":"616","DOI":"10.1109\/tro.2011.2132870","article-title":"Assessing grasp stability based on learning and haptic data","volume":"27","author":"Bekiroglu","year":"2011","journal-title":"IEEE Trans. Robotics"},{"key":"B5","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1682\/jrrd.2011.10.0188","article-title":"Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review","volume":"50","author":"Belter","year":"2013","journal-title":"J. rehabilitation Res. Dev."},{"key":"B6","doi-asserted-by":"crossref","first-page":"4090","DOI":"10.1109\/IROS.2012.6386142","article-title":"Haptic classification and recognition of objects using a tactile sensing forearm","volume-title":"2012 IEEE\/RSJ international Conference on intelligent Robots and systems","author":"Bhattacharjee","year":"2012"},{"key":"B7","doi-asserted-by":"crossref","first-page":"6694","DOI":"10.1109\/ICRA.2017.7989791","article-title":"A compliant four-bar linkage mechanism that makes the fingers of a prosthetic hand more impact resistant","volume-title":"2017 IEEE international conference on robotics and automation (ICRA)","author":"Choi","year":"2017"},{"key":"B8","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/ICRA.2016.7487123","article-title":"Improved normal and shear tactile force sensor performance via least squares artificial neural network (lsann)","volume-title":"2016 IEEE international conference on robotics and automation (ICRA)","author":"Chuah","year":"2016"},{"key":"B9","doi-asserted-by":"publisher","first-page":"9185","DOI":"10.1039\/c6nr00774k","article-title":"A tactile sensor using a conductive graphene-sponge composite","volume":"8","author":"Chun","year":"2016","journal-title":"Nanoscale"},{"key":"B10","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/978-3-319-32180-6_6","article-title":"Force\/tactile sensors based on optoelectronic technology for manipulation and physical human\u2013robot interaction","volume-title":"Advanced mechatronics and MEMS devices II","author":"Cirillo","year":"2017"},{"key":"B11","doi-asserted-by":"publisher","first-page":"4121","DOI":"10.1109\/jsen.2013.2279056","article-title":"Directions toward effective utilization of tactile skin: a review","volume":"13","author":"Dahiya","year":"2013","journal-title":"IEEE Sensors J."},{"key":"B12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.robot.2012.07.021","article-title":"Design of a flexible tactile sensor for classification of rigid and deformable objects","volume":"62","author":"Drimus","year":"2014","journal-title":"Robotics Aut. Syst."},{"key":"B13","first-page":"80","article-title":"Autonomous in-hand object modeling from a mobile manipulator","volume-title":"# placeholder_parent_metadata_value#","author":"Feigl","year":"2023"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1144","DOI":"10.1109\/tii.2018.2841043","article-title":"Synergy-based control of underactuated anthropomorphic hands","volume":"15","author":"Ficuciello","year":"2018","journal-title":"IEEE Trans. Industrial Inf."},{"key":"B15","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s11370-018-0262-0","article-title":"Hand-arm autonomous grasping: synergistic motions to enhance the learning process","volume":"12","author":"Ficuciello","year":"2019","journal-title":"Intell. Serv. Robot."},{"key":"B16","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1007\/978-3-319-56802-7_24","article-title":"Synergies evaluation of the schunk s5fh for grasping control","volume":"2016","author":"Ficuciello","year":"2018","journal-title":"Adv. Robot Kinemat."},{"key":"B17","doi-asserted-by":"crossref","first-page":"2255","DOI":"10.1109\/ICRA.2012.6224922","article-title":"Planning and control during reach to grasp using the three predominant ub hand iv postural synergies","volume-title":"2012 IEEE international conference on robotics and automation","author":"Ficuciello","year":"2012"},{"key":"B18","doi-asserted-by":"publisher","first-page":"103698","DOI":"10.1016\/j.engappai.2020.103698","article-title":"The prisma hand i: a novel underactuated design and emg\/voice-based multimodal control","volume":"93","author":"Ficuciello","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B19","volume-title":"Handbook of modern sensors: physics, designs, and applications","author":"Fraden","year":"2004"},{"key":"B20","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1109\/AMC.2019.8371115","article-title":"Optical fiber force myography sensor for applications in prosthetic hand control","volume-title":"2018 IEEE 15th international workshop on advanced motion control (AMC)","author":"Fujiwara","year":"2018"},{"key":"B21","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1109\/jeds.2018.2848917","article-title":"User-oriented piezoelectric force sensing and artificial neural networks in interactive displays","volume":"6","author":"Gao","year":"2018","journal-title":"IEEE J. Electron Devices Soc."},{"key":"B22","doi-asserted-by":"publisher","first-page":"2216","DOI":"10.1109\/jsen.2014.2320820","article-title":"A tensor-based pattern-recognition framework for the interpretation of touch modality in artificial skin systems","volume":"14","author":"Gastaldo","year":"2014","journal-title":"IEEE Sensors J."},{"key":"B23","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1021\/acsaelm.1c01274","article-title":"Capacitive sensor combining proximity and pressure sensing for accurate grasping of a prosthetic hand","volume":"4","author":"Ge","year":"2022","journal-title":"ACS Appl. Electron. Mater."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.1177\/0278364912459209","article-title":"The hand of the dlr hand arm system: designed for interaction","volume":"31","author":"Grebenstein","year":"2012","journal-title":"Int. J. Robotics Res."},{"key":"B25","first-page":"486","article-title":"Tactile sensors using the distributed optical fiber sensors","volume-title":"2008 3rd international conference on sensing technology","author":"Heo","year":"2008"},{"key":"B26","first-page":"1","article-title":"Three-dimensional tactile sensor with thin and soft elastic body","volume-title":"2008 IEEE workshop on advanced robotics and its social impacts","author":"Hoshino","year":"2008"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.3390\/s21051920","article-title":"Vision-based tactile sensor mechanism for the estimation of contact position and force distribution using deep learning","volume":"21","author":"Kakani","year":"2021","journal-title":"Sensors"},{"key":"B28","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1109\/AIM.2013.6584238","article-title":"A highly sensitive 3d-shaped tactile sensor","volume-title":"2013 IEEE\/ASME international conference on advanced intelligent mechatronics","author":"Koiva","year":"2013"},{"key":"B29","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-54927-9","volume-title":"Robot operating system (ROS)","author":"Koub\u00e2a","year":"2017"},{"key":"B30","article-title":"Imagine classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. neural Inf. Process. Syst."},{"key":"B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0957-4158(92)90034-l","article-title":"Object-slip detection during manipulation using a derived force vector","volume":"2","author":"Kyberd","year":"1992","journal-title":"Mechatronics"},{"key":"B32","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1109\/tmech.2016.2634602","article-title":"Kitsch-hand: a highly dexterous and modularized robotic hand","volume":"22","author":"Lee","year":"2016","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"B33","doi-asserted-by":"publisher","first-page":"5042","DOI":"10.1002\/smll.201600760","article-title":"Flexible capacitive tactile sensor based on micropatterned dielectric layer","volume":"12","author":"Li","year":"2016","journal-title":"Small"},{"key":"B34","first-page":"138","article-title":"Tactile image based contact shape recognition using neural network","volume-title":"2012 IEEE international Conference on multisensor Fusion and Integration for intelligent systems (MFI)","author":"Liu","year":""},{"key":"B35","first-page":"599","article-title":"Intelligent fingertip sensing for contact information identification","volume-title":"Advances in reconfigurable mechanisms and robots I","author":"Liu","year":""},{"key":"B36","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/AIM.2019.8868520","article-title":"The mero hand: a mechanically robust anthropomorphic prosthetic hand using novel compliant rolling contact joint","volume-title":"2019 IEEE\/ASME international Conference on advanced intelligent mechatronics (AIM)","author":"Liu","year":"2019"},{"key":"B37","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1109\/thms.2024.3381094","article-title":"Human-centered evaluation of emg-based upper-limb prosthetic control modes","volume":"54","author":"Liu","year":"2024","journal-title":"IEEE Trans. Human-Machine Syst."},{"key":"B38","doi-asserted-by":"publisher","first-page":"58976","DOI":"10.1021\/acsami.3c16276","article-title":"Microstructured gel polymer electrolyte and an interdigital electrode-based intronic barometric pressure sensor with high resolution over a broad range","volume":"15","author":"Liu","year":"2023","journal-title":"ACS Appl. Mater. and Interfaces"},{"key":"B39","doi-asserted-by":"crossref","first-page":"4488","DOI":"10.1109\/ROBOT.2005.1570811","article-title":"Development of ub hand 3: early results","volume-title":"Proceedings of the 2005 IEEE international Conference on Robotics and automation","author":"Lotti","year":"2005"},{"key":"B40","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/ICRA.2014.6907172","article-title":"St-hmp: unsupervised spatio-temporal feature learning for tactile data","volume-title":"2014 IEEE international conference on robotics and automation (ICRA)","author":"Madry","year":"2014"},{"key":"B41","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1201\/9781003146810-5","article-title":"Prosthesis control using undersampled surface electromyographic signals","volume-title":"Analysis of medical modalities for improved diagnosis in modern healthcare","author":"Marateb","year":"2021"},{"key":"B42","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1007\/978-3-319-44781-0_2","article-title":"Tactile convolutional networks for online slip and rotation detection","volume-title":"Artificial neural networks and machine learning\u2013ICANN 2016: 25th international conference on artificial neural networks, barcelona, Spain, september 6-9, 2016, proceedings, Part II 25","author":"Meier","year":"2016"},{"key":"B43","doi-asserted-by":"publisher","first-page":"103601","DOI":"10.1016\/j.addma.2023.103601","article-title":"Fully 3d printed piezoelectric pressure sensor for dynamic tactile sensing","volume":"71","author":"Nassar","year":"2023","journal-title":"Addit. Manuf."},{"key":"B44","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1177\/0278364913514466","article-title":"A compliant, underactuated hand for robust manipulation","volume":"33","author":"Odhner","year":"2014","journal-title":"Int. J. Robotics Res."},{"key":"B45","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1109\/ROBOT.2006.1641896","article-title":"Conformable and scalable tactile sensor skin for curved surfaces","volume-title":"Proceedings 2006 IEEE international conference on robotics and automation, 2006","author":"Ohmura","year":"2006"},{"key":"B46","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1080\/00140139.2023.2221413","article-title":"Assessing workload in using electromyography (emg)-based prostheses","volume":"67","author":"Park","year":"2024","journal-title":"Ergonomics"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1570","DOI":"10.1109\/tro.2021.3060342","article-title":"Deep neural network based electrical impedance tomographic sensing methodology for large-area robotic tactile sensing","volume":"5","author":"Park","year":"2021","journal-title":"IEEE Trans. Robotics"},{"key":"B48","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/ICSENS.2005.1597869","article-title":"A novel tactile sensor using a matrix of leds operating in both photoemitter and photodetector modes","volume-title":"SENSORS, 2005","author":"Rossiter","year":"2005"},{"key":"B49","volume-title":"Robot tactile sensing","author":"Russell","year":"1990"},{"key":"B50","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1109\/IROS.2008.4650712","article-title":"Measurement of force vector field of robotic finger using vision-based haptic sensor","volume-title":"2008 IEEE\/RSJ international conference on intelligent robots and systems","author":"Sato","year":"2008"},{"key":"B51","doi-asserted-by":"crossref","first-page":"2212","DOI":"10.1109\/IROS.2010.5648838","article-title":"A tactile sensor for the fingertips of the humanoid robot icub","volume-title":"2010 IEEE\/RSJ international Conference on intelligent Robots and systems","author":"Schmitz","year":"2010"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.3390\/s17071622","article-title":"Novel flexible wearable sensor materials and signal processing for vital sign and human activity monitoring","volume":"17","author":"Servati","year":"2017","journal-title":"Sensors"},{"key":"B53","doi-asserted-by":"publisher","first-page":"173438","DOI":"10.1109\/access.2019.2956882","article-title":"Ground truth force distribution for learning-based tactile sensing: a finite element approach","volume":"7","author":"Sferrazza","year":"2019","journal-title":"IEEE Access"},{"key":"B54","doi-asserted-by":"publisher","first-page":"035009","DOI":"10.1063\/5.0130394","article-title":"An optoelectronic muscle contraction sensor for prosthetic hand application","volume":"94","author":"Sharma","year":"2023","journal-title":"Rev. Sci. Instrum."},{"key":"B55","doi-asserted-by":"publisher","first-page":"3529","DOI":"10.1038\/s41467-020-17298-y","article-title":"Quantum effect-based flexible and transparent pressure sensors with ultrahigh sensitivity and sensing density","volume":"11","author":"Shi","year":"2020","journal-title":"Nat. Commun."},{"key":"B56","doi-asserted-by":"publisher","first-page":"11061","DOI":"10.1038\/s41598-017-11663-6","article-title":"An extremely simple macroscale electronic skin realized by deep machine learning","volume":"7","author":"Sohn","year":"2017","journal-title":"Sci. Rep."},{"key":"B57","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1682\/jrrd.2012.08.0140","article-title":"Functionality of i-limb and i-limb pulse hands: case report","volume":"50","author":"Van Der Niet","year":"2013","journal-title":"J. rehabilitation Res. Dev."},{"key":"B58","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/978-3-642-29041-1_5","article-title":"Grasping and control of multi-fingered hands","volume-title":"Advanced bimanual manipulation: results from the DEXMART Project","author":"Villani","year":"2012"},{"key":"B59","doi-asserted-by":"publisher","first-page":"1900090","DOI":"10.1002\/aisy.201900090","article-title":"Tactile sensors for advanced intelligent systems","volume":"1","author":"Wang","year":"2019","journal-title":"Adv. Intell. Syst."},{"key":"B60","doi-asserted-by":"publisher","first-page":"8825019","DOI":"10.1155\/2021\/8825019","article-title":"Three-dimensional force prediction of a flexible tactile sensor based on radial basis function neural networks","volume":"2021","author":"Wang","year":"2021","journal-title":"J. Sensors"},{"key":"B61","first-page":"471","article-title":"The working principle of resistive tactile sensor cells","volume-title":"IEEE international conference mechatronics and automation","author":"Wei\u00df","year":"2005"},{"key":"B62","doi-asserted-by":"publisher","first-page":"960","DOI":"10.1109\/tie.2005.851654","article-title":"Highly soft viscoelastic robot skin with a contact object-location-sensing capability","volume":"52","author":"Yamada","year":"2005","journal-title":"IEEE Trans. Industrial Electron."},{"key":"B63","doi-asserted-by":"publisher","first-page":"27","DOI":"10.3390\/s19010027","article-title":"A piezoresistive tactile sensor for a large area employing neural network","volume":"19","author":"Zhang","year":"2018","journal-title":"Sensors"},{"key":"B64","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1016\/j.neucom.2017.07.016","article-title":"Incomplete multi-view clustering via deep semantic mapping","volume":"275","author":"Zhao","year":"2018","journal-title":"Neurocomputing"},{"key":"B65","doi-asserted-by":"publisher","first-page":"3379","DOI":"10.1109\/lra.2018.2851360","article-title":"Bcl-13: a 13-dof soft robotic hand for dexterous grasping and in-hand manipulation","volume":"3","author":"Zhou","year":"2018","journal-title":"IEEE Robotics Automation Lett."},{"key":"B66","doi-asserted-by":"publisher","first-page":"23626","DOI":"10.1109\/access.2017.2762703","article-title":"3d conn based automatic diagnosis of attention deficit hyperactivity disorder using functional and structural mri","volume":"5","author":"Zou","year":"2017","journal-title":"Ieee Access"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1460589\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T04:10:33Z","timestamp":1727323833000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1460589\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,26]]},"references-count":66,"alternative-id":["10.3389\/frobt.2024.1460589"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1460589","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,26]]},"article-number":"1460589"}}