{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,13]],"date-time":"2026-11-13T02:50:30Z","timestamp":1794538230813,"version":"4.9.1"},"reference-count":36,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,2,22]],"date-time":"2019-02-22T00:00:00Z","timestamp":1550793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human skin is capable of sensing various types of forces with high resolution and accuracy. The development of an artificial sense of touch needs to address these properties, while retaining scalability to large surfaces with arbitrary shapes. The vision-based tactile sensor proposed in this article exploits the extremely high resolution of modern image sensors to reconstruct the normal force distribution applied to a soft material, whose deformation is observed on the camera images. By embedding a random pattern within the material, the full resolution of the camera can be exploited. The design and the motivation of the proposed approach are discussed with respect to a simplified elasticity model. An artificial deep neural network is trained on experimental data to perform the tactile sensing task with high accuracy for a specific indenter, and with a spatial resolution and a sensing range comparable to the human fingertip.<\/jats:p>","DOI":"10.3390\/s19040928","type":"journal-article","created":{"date-parts":[[2019,2,22]],"date-time":"2019-02-22T11:26:14Z","timestamp":1550834774000},"page":"928","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":136,"title":["Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7432-7634","authenticated-orcid":false,"given":"Carmelo","family":"Sferrazza","sequence":"first","affiliation":[{"name":"Institute for Dynamic Systems and Control, ETH Zurich, 8092 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raffaello","family":"D\u2019Andrea","sequence":"additional","affiliation":[{"name":"Institute for Dynamic Systems and Control, ETH Zurich, 8092 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1177\/0278364917710318","article-title":"Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection","volume":"37","author":"Levine","year":"2018","journal-title":"Int. J. Robot. Res."},{"key":"ref_2","first-page":"1334","article-title":"End-to-end training of deep visuomotor policies","volume":"17","author":"Levine","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1177\/0278364914549607","article-title":"Deep learning for detecting robotic grasps","volume":"34","author":"Lenz","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/BF00238156","article-title":"Factors influencing the force control during precision grip","volume":"53","author":"Westling","year":"1984","journal-title":"Exp. Brain Res."},{"key":"ref_5","first-page":"314","article-title":"The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes?","volume":"78","author":"Calandra","year":"2017","journal-title":"Proc. Mach. Learn. Res."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sferrazza, C., and D\u2019Andrea, R. (arXiv, 2018). Transfer learning for vision-based tactile sensing, arXiv.","DOI":"10.1109\/IROS40897.2019.8967571"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Siciliano, B., and Khatib, O. (2016). Springer Handbook of Robotics, Springer.","DOI":"10.1007\/978-3-319-32552-1"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1109\/JSEN.2004.833152","article-title":"A tactile sensor sheet using pressure conductive rubber with electrical-wires stitched method","volume":"4","author":"Shimojo","year":"2004","journal-title":"IEEE Sens. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/JSEN.2014.2337115","article-title":"Self-powered tactile pressure sensors using ordered crystalline ZnO nanorods on flexible substrates toward robotic skin and garments","volume":"15","author":"Nabar","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.robot.2015.07.015","article-title":"Tactile sensing in dexterous robot hands","volume":"74","author":"Kappassov","year":"2015","journal-title":"Robot. Auton. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1145\/2010324.1964941","article-title":"Microgeometry Capture using an Elastomeric Sensor","volume":"30","author":"Johnson","year":"2011","journal-title":"ACM Trans. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Koike, M., Saga, S., Okatani, T., and Deguchi, K. (2011, January 21\u201324). Sensing method of total-internal-reflection-based tactile sensor. Proceedings of the IEEE World Haptics Conference, Istanbul, Turkey.","DOI":"10.1109\/WHC.2011.5945556"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lincoln, L.S., Bamberg, S.J.M., Parsons, E., Salisbury, C., and Wheeler, J. (2012, January 24\u201327). An elastomeric insole for 3-axis ground reaction force measurement. Proceedings of the IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, Rome, Italy.","DOI":"10.1109\/BioRob.2012.6290838"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Winstone, B., Griffiths, G., Melhuish, C., Pipe, T., and Rossiter, J. (2012, January 11\u201314). TACTIP\u2014Tactile fingertip device, challenges in reduction of size to ready for robot hand integration. Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guangzhou, China.","DOI":"10.1109\/ROBIO.2012.6490960"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ma, D., Donlon, E., Dong, S., and Rodriguez, A. (arXiv, 2018). Dense Tactile Force Distribution Estimation using GelSlim and inverse FEM, arXiv.","DOI":"10.1109\/ICRA.2019.8794113"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1109\/LRA.2017.2665692","article-title":"Exploiting Sensor Symmetry for Generalized Tactile Perception in Biomimetic Touch","volume":"2","author":"Cramphorn","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","unstructured":"Kamiyama, K., Kajimoto, H., Kawakami, N., and Tachi, S. (May, January 26). Evaluation of a vision-based tactile sensor. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yuan, W., Dong, S., and Adelson, E.H. (2017). GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force. Sensors, 17.","DOI":"10.3390\/s17122762"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chuah, M.Y., and Kim, S. (2016, January 16\u201321). Improved normal and shear tactile force sensor performance via Least Squares Artificial Neural Network (LSANN). Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487123"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/MCG.2005.27","article-title":"Vision-based sensor for real-time measuring of surface traction fields","volume":"25","author":"Kamiyama","year":"2005","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hetnarski, R.B., and Ignaczak, J. (2004). Mathematical Theory of Elasticity, CRC Press.","DOI":"10.4324\/9780203502488"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Science & Business Media.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1520\/JTE103205","article-title":"Standardized polymer durometry","volume":"39","author":"Mix","year":"2011","journal-title":"J. Test. Eval."},{"key":"ref_24","unstructured":"Heath, M.T. (2002). Scientific Computing, McGraw-Hill."},{"key":"ref_25","unstructured":"Johnson, K.L. (1987). Contact Mechanics, Cambridge University Press."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fleet, D., and Weiss, Y. (2006). Optical Flow Estimation. Handbook of Mathematical Models in Computer Vision, Springer.","DOI":"10.1007\/0-387-28831-7_15"},{"key":"ref_27","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_28","first-page":"299","article-title":"The watershed transformation applied to image segmentation","volume":"6","author":"Beucher","year":"1992","journal-title":"Scan. Microsc. Suppl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"415","DOI":"10.4086\/toc.2012.v008a019","article-title":"Distance transforms of sampled functions","volume":"8","author":"Felzenszwalb","year":"2012","journal-title":"Theory Comput."},{"key":"ref_30","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wulff, J., and Black, M.J. (2015, January 7\u201312). Efficient sparse-to-dense optical flow estimation using a learned basis and layers. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298607"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kroeger, T., Timofte, R., Dai, D., and Van Gool, L. (2016, January 8\u201316). Fast optical flow using dense inverse search. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_29"},{"key":"ref_33","unstructured":"Dozat, T. (2016, January 2\u20134). Incorporating Nesterov Momentum into Adam. Proceedings of the International Conference on Learning Representations, Caribe Hilton, San Juan, Puerto Rico."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1002\/widm.1157","article-title":"A survey on multi-output regression","volume":"5","author":"Borchani","year":"2015","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yamaguchi, A., and Atkeson, C.G. (2016, January 15\u201317). Combining finger vision and optical tactile sensing: Reducing and handling errors while cutting vegetables. Proceedings of the IEEE-RAS International Conference on Humanoid Robots (Humanoids), Cancun, Mexico.","DOI":"10.1109\/HUMANOIDS.2016.7803400"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1002\/rcs.3","article-title":"Human tactile perception as a standard for artificial tactile sensing\u2014A review","volume":"1","author":"Dargahi","year":"2004","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/928\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:34:06Z","timestamp":1760186046000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/928"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,22]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19040928"],"URL":"https:\/\/doi.org\/10.3390\/s19040928","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,22]]}}}