{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T17:55:33Z","timestamp":1776189333916,"version":"3.50.1"},"reference-count":46,"publisher":"American Association for the Advancement of Science (AAAS)","issue":"93","content-domain":{"domain":["www.science.org"],"crossmark-restriction":true},"short-container-title":["Sci. Robot."],"published-print":{"date-parts":[[2024,8,21]]},"abstract":"<jats:p>The sense of touch is a property that allows humans to interact delicately with their physical environment. This article reports on a technological advancement in intuitive human-robot interaction that enables an intrinsic robotic sense of touch without the use of artificial skin or tactile instrumentation. On the basis of high-resolution joint-force-torque sensing in a redundant arrangement, we were able to let the robot sensitively feel the surrounding environment and accurately localize touch trajectories in space and time that were applied on its surface by a human. Through an intertwined combination of manifold learning techniques and artificial neural networks, the robot identified and interpreted those touch trajectories as machine-readable letters, symbols, or numbers. This opens up unexplored opportunities in terms of intuitive and flexible interaction between human and robot. Furthermore, we showed that our concept of so-called virtual buttons can be used to straightforwardly implement a tactile communication link, including switches and slider bars, which are complementary to speech, hardware buttons, and control panels. These interaction elements could be freely placed, moved, and configured in arbitrary locations on the robot structure. The intrinsic sense of touch we proposed in this work can serve as the basis for an advanced category of physical human-robot interaction that has not been possible yet, enabling a shift from conventional modalities toward adaptability, flexibility, and intuitive handling.<\/jats:p>","DOI":"10.1126\/scirobotics.adn4008","type":"journal-article","created":{"date-parts":[[2024,8,21]],"date-time":"2024-08-21T22:25:19Z","timestamp":1724279119000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark","source":"Crossref","is-referenced-by-count":51,"title":["Intrinsic sense of touch for intuitive physical human-robot interaction"],"prefix":"10.1126","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0644-0659","authenticated-orcid":true,"given":"Maged","family":"Iskandar","sequence":"first","affiliation":[{"name":"Institute of Robotics and Mechatronics, German Aerospace Center (DLR), M\u00fcnchener Str. 20, 82234 Wessling, Germany."}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5343-9074","authenticated-orcid":true,"given":"Alin","family":"Albu-Sch\u00e4ffer","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Mechatronics, German Aerospace Center (DLR), M\u00fcnchener Str. 20, 82234 Wessling, Germany."},{"name":"Technical University of Munich (TUM), 80333 M\u00fcnchen, Germany."}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3463-5074","authenticated-orcid":true,"given":"Alexander","family":"Dietrich","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Mechatronics, German Aerospace Center (DLR), M\u00fcnchener Str. 20, 82234 Wessling, Germany."}]}],"member":"221","reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2015.12.007"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-017-9677-2"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abl6307"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abi8017"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2020.3032142"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1021\/acsami.7b07311"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1002\/adma.201500917"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2884793"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mechatronics.2018.02.009"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2018.03.043"},{"key":"e_1_3_2_12_2","doi-asserted-by":"crossref","unstructured":"L. Bascetta G. Ferretti P. Rocco H. Ard\u00f6 H. Bruyninckx E. Demeester E. Di Lello Towards safe human-robot interaction in robotic cells: An approach based on visual tracking and intention estimation in 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IEEE 2011) pp. 2971\u20132978.","DOI":"10.1109\/IROS.2011.6094642"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2017.02.004"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2022.3188840"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"R. Stiefelhagen C. Fugen R. Gieselmann H. Holzapfel K. Nickel A. Waibel Natural human-robot interaction using speech head pose and gestures in 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2004) vol. 3 pp. 2422\u20132427.","DOI":"10.1109\/IROS.2004.1389771"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-013-0199-6"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mechmachtheory.2007.03.003"},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"S. Haddadin E. Croft \u201cPhysical human\u2013robot interaction\u201d in Springer Handbook of Robotics B. Siciliano O. Khatib Eds. (Springer 2016) pp. 1835\u20131874.","DOI":"10.1007\/978-3-319-32552-1_69"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1038\/nmat4731"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2009.2033627"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2019.2933348"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2011.2106330"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100047"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-022-00487-3"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41528-022-00215-2"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.ade0720"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abc8801"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abm7187"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1002\/jsid.100"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sna.2015.05.025"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2017.2723903"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2023.3270036"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","unstructured":"E. Magrini F. Flacco A. De Luca Control of generalized contact motion and force in physical human-robot interaction in 2015 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2015) pp. 2298\u20132304.","DOI":"10.1109\/ICRA.2015.7139504"},{"key":"e_1_3_2_34_2","doi-asserted-by":"crossref","unstructured":"E. Magrini F. Flacco A. De Luca Estimation of contact forces using a virtual force sensor in 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IEEE 2014) pp. 2126\u20132133.","DOI":"10.1109\/IROS.2014.6942848"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"F. Flacco T. Kr\u00f6ger A. De Luca O. Khatib A depth space approach to human-robot collision avoidance in 2012 IEEE International Conference on Robotics and Automation (IEEE 2012) pp. 338\u2013345.","DOI":"10.1109\/ICRA.2012.6225245"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","unstructured":"L. Manuelli R. Tedrake Localizing external contact using proprioceptive sensors: The contact particle filter in 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2016) pp. 5062\u20135069.","DOI":"10.1109\/IROS.2016.7759743"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","unstructured":"A. Zwiener C. Geckeler A. Zell Contact point localization for articulated manipulators with proprioceptive sensors and machine learning in 2018 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2018) pp. 323\u2013329.","DOI":"10.1109\/ICRA.2018.8462869"},{"key":"e_1_3_2_38_2","doi-asserted-by":"crossref","unstructured":"M. Iskandar O. Eiberger A. Albu-Sch\u00e4ffer A. De Luca A. Dietrich Collision detection identification and localization on the DLR SARA robot with sensing redundancy in 2021 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2021) pp. 3111\u20133117.","DOI":"10.1109\/ICRA48506.2021.9561677"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cirp.2019.05.002"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2021.3111786"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","unstructured":"S. Haddadin M. Suppa S. Fuchs T. Bodenm\u00fcller A. Albu-Sch\u00e4ffer G. Hirzinger Towards the robotic co-worker in Robotics Research: The 14th International Symposium ISRR (Springer 2011) pp. 261\u2013282.","DOI":"10.1007\/978-3-642-19457-3_16"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"G. Hirzinger N. Sporer A. Albu-Sch\u00e4ffer M. Hahnle R. Krenn A. Pascucci M. Schedl DLR\u2019s torque-controlled light weight Robot III\u2014Are we reaching the technological limits now? in Proceedings 2002 IEEE International Conference on Robotics and Automation (IEEE 2002) vol. 2 pp. 1710\u20131716.","DOI":"10.1109\/ROBOT.2002.1014788"},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"M. Iskandar C. Ott O. Eiberger M. Keppler A. Albu-Sch\u00e4ffer A. Dietrich Joint-level control of the DLR lightweight robot SARA in 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE 2020) pp. 8903\u20138910.","DOI":"10.1109\/IROS45743.2020.9340700"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10032-020-00350-4"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","unstructured":"E. J. Bekkers M. W. Lafarge M. Veta K. A. J. Eppenhof J. P. W. Pluim R. Duits Roto-translation covariant convolutional networks for medical image analysis in International Conference on Medical Image Computing and Computer-Assisted Intervention (Springer 2018) pp. 440\u2013448.","DOI":"10.1007\/978-3-030-00928-1_50"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","unstructured":"G. Cohen S. Afshar J. Tapson A. Van Schaik Emnist: Extending MNIST to handwritten letters in 2017 International Joint Conference on Neural Networks (IJCNN) (IEEE 2017) pp. 2921\u20132926.","DOI":"10.1109\/IJCNN.2017.7966217"}],"container-title":["Science Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.science.org\/doi\/pdf\/10.1126\/scirobotics.adn4008","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,21]],"date-time":"2024-08-21T22:25:38Z","timestamp":1724279138000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.adn4008"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,21]]},"references-count":46,"journal-issue":{"issue":"93","published-print":{"date-parts":[[2024,8,21]]}},"alternative-id":["10.1126\/scirobotics.adn4008"],"URL":"https:\/\/doi.org\/10.1126\/scirobotics.adn4008","relation":{},"ISSN":["2470-9476"],"issn-type":[{"value":"2470-9476","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,21]]},"assertion":[{"value":"2023-12-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"eadn4008"}}