{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T07:25:51Z","timestamp":1773041151632,"version":"3.50.1"},"reference-count":28,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T00:00:00Z","timestamp":1713916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China (NSFC)","doi-asserted-by":"publisher","award":["52025054"],"award-info":[{"award-number":["52025054"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China (NSFC)","doi-asserted-by":"publisher","award":["52105016"],"award-info":[{"award-number":["52105016"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biosensors"],"abstract":"<jats:p>The Wearable Robotic Limb (WRL) is a type of robotic arm worn on the human body, aiming to enhance the wearer\u2019s operational capabilities. However, proposing additional methods to control and perceive the WRL when human limbs are heavily occupied with primary tasks presents a challenge. Existing interactive methods, such as voice, gaze, and electromyography (EMG), have limitations in control precision and convenience. To address this, we have developed an interactive device that utilizes the mouth and tongue. This device is lightweight and compact, allowing wearers to achieve continuous motion and contact force control of the WRL. By using a tongue controller and mouth gas pressure sensor, wearers can control the WRL while also receiving sensitive contact feedback through changes in mouth pressure. To facilitate bidirectional interaction between the wearer and the WRL, we have devised an algorithm that divides WRL control into motion and force-position hybrid modes. In order to evaluate the performance of the device, we conducted an experiment with ten participants tasked with completing a pin-hole assembly task with the assistance of the WRL system. The results show that the device enables continuous control of the position and contact force of the WRL, with users perceiving feedback through mouth airflow resistance. However, the experiment also revealed some shortcomings of the device, including user fatigue and its impact on breathing. After experimental investigation, it was observed that fatigue levels can decrease with training. Experimental studies have revealed that fatigue levels can decrease with training. Furthermore, the limitations of the device have shown potential for improvement through structural enhancements. Overall, our mouth and tongue interactive device shows promising potential in controlling the WRL during tasks where human limbs are occupied.<\/jats:p>","DOI":"10.3390\/bios14050213","type":"journal-article","created":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T07:38:51Z","timestamp":1713944331000},"page":"213","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Mouth and Tongue Interactive Device to Control Wearable Robotic Limbs in Tasks where Human Limbs Are Occupied"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9842-472X","authenticated-orcid":false,"given":"Hongwei","family":"Jing","sequence":"first","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianjiao","family":"Zheng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qinghua","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benshan","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kerui","family":"Sun","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lele","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanhe","family":"Zhu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1038\/s41467-022-28725-7","article-title":"Principles of human movement augmentation and the challenges in making it a reality","volume":"13","author":"Eden","year":"2022","journal-title":"Nat. Commun."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Prattichizzo, D., Pozzi, M., Baldi, T.L., Malvezzi, M., Hussain, I., Rossi, S., and Salvietti, G. (2021). Human augmentation by wearable supernumerary robotic limbs: Review and perspectives. Prog. Biomed. Eng., 3.","DOI":"10.1088\/2516-1091\/ac2294"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Martinez-Hernandez, U., Metcalfe, B., Assaf, T., Jabban, L., Male, J., and Zhang, D. (2021). Wearable assistive robotics: A perspective on current challenges and future trends. Sensors, 21.","DOI":"10.3390\/s21206751"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bonilla, B.L., and Asada, H.H. (June, January 31). A robot on the shoulder: Coordinated human-wearable robot control using coloured petri nets and partial least squares predictions. Proceedings of the 2014 IEEE international conference on robotics and automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906598"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Vatsal, V., and Hoffman, G. (September, January 28). Wearing your arm on your sleeve: Studying usage contexts for a wearable robotic forearm. Proceedings of the 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Lisbon, Portugal.","DOI":"10.1109\/ROMAN.2017.8172421"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7407","DOI":"10.1109\/LRA.2022.3183251","article-title":"Rtsras: A series-parallel-reconfigurable tendon-driven supernumerary robotic arms","volume":"7","author":"Zhang","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1177\/0278364917714062","article-title":"Empirical characterization of modular variable stiffness inflatable structures for supernumerary grasp-assist devices","volume":"36","author":"Tiziani","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cunningham, J., Hapsari, A., Guilleminot, P., Shafti, A., and Faisal, A.A. (2018, January 26\u201329). The supernumerary robotic 3 rd thumb for skilled music tasks. Proceedings of the 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob), Enschede, The Netherlands.","DOI":"10.1109\/BIOROB.2018.8487609"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1646","DOI":"10.1109\/LRA.2021.3058926","article-title":"Integrated voluntary-reactive control of a human-superlimb hybrid system for hemiplegic patient support","volume":"6","author":"Song","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2796","DOI":"10.1109\/LRA.2023.3261701","article-title":"An Effective Head-Based HRI for 6D Robotic Grasping Using Mixed Reality","volume":"8","author":"Zhang","year":"2023","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1109\/TNSRE.2016.2529684","article-title":"Compensating hand function in chronic stroke patients through the robotic sixth finger","volume":"25","author":"Salvietti","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4505","DOI":"10.1109\/LRA.2023.3285474","article-title":"Task-based Human-Robot Collaboration Control of Supernumerary Robotic Limbs for Overhead Tasks","volume":"8","author":"Tu","year":"2023","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sasaki, T., Saraiji, M.Y., Fernando, C.L., Minamizawa, K., and Inami, M. (August, January 30). MetaLimbs: Metamorphosis for multiple arms interaction using artificial limbs. Proceedings of the ACM SIGGRAPH 2017 Posters, Los Angeles, CA, USA.","DOI":"10.1145\/3102163.3102166"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Oh, J., Ando, K., Iizuka, S., Guinot, L., Kato, F., and Iwata, H. (2020, January 15\u201317). 3D Head Pointer: A manipulation method that enables the spatial localization for a wearable robot arm by head bobbing. Proceedings of the 2020 23rd International Symposium on Measurement and Control in Robotics (ISMCR), Budapest, Hungary.","DOI":"10.1109\/ISMCR51255.2020.9263775"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Fan, Z., Lin, C., and Fu, C. (2020, January 26\u201329). A gaze signal based control method for supernumerary robotic limbs. Proceedings of the 2020 3rd International Conference on Control and Robots (ICCR), Tokyo, Japan.","DOI":"10.1109\/ICCR51572.2020.9344272"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Parietti, F., and Asada, H.H. (June, January 29). Independent, voluntary control of extra robotic limbs. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989702"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1298","DOI":"10.1109\/TNSRE.2022.3172974","article-title":"Wearable supernumerary robotic limb system using a hybrid control approach based on motor imagery and object detection","volume":"30","author":"Tang","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"eaat1228","DOI":"10.1126\/scirobotics.aat1228","article-title":"BMI control of a third arm for multitasking","volume":"3","author":"Penaloza","year":"2018","journal-title":"Sci. Robot."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4457","DOI":"10.1109\/LRA.2023.3284363","article-title":"Voluntary-Redundant Hybrid Control of SuperLimb based on Redundant Muscle for On-Site Assembly Tasks","volume":"8","author":"Lin","year":"2023","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1109\/LRA.2020.2970948","article-title":"Leveraging the human operator in the design and control of supernumerary robotic limbs","volume":"5","author":"Guggenheim","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2552","DOI":"10.1109\/TBME.2021.3055250","article-title":"Continuous tongue robot mapping for paralyzed individuals improves the functional performance of tongue-based robotic assistance","volume":"68","author":"Mohammadi","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/TNSRE.2017.2706524","article-title":"Error-free text typing performance of an inductive intra-oral tongue computer interface for severely disabled individuals","volume":"25","author":"Struijk","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"21565","DOI":"10.3390\/s141121565","article-title":"An arch-shaped intraoral tongue drive system with built-in tongue-computer interfacing SoC","volume":"14","author":"Park","year":"2014","journal-title":"Sensors"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1109\/TBCAS.2019.2926755","article-title":"A stand-alone intraoral tongue-controlled computer interface for people with tetraplegia","volume":"13","author":"Kong","year":"2019","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"7964","DOI":"10.1109\/JSEN.2020.3046469","article-title":"Inertial measurements for tongue motion tracking based on magnetic localization with orientation compensation","volume":"21","author":"Sebkhi","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_26","unstructured":"Ib\u00e1\u00f1ez Flamarique, A. (2024, March 27). The Lipmouse: A Labially Controlled Mouse Cursor Emulation Device for People with Special Needs. Available online: https:\/\/hdl.handle.net\/2454\/13303."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"819","DOI":"10.20965\/jrm.2016.p0819","article-title":"Development of an intraoral interface for human-ability extension robots","volume":"28","author":"Koike","year":"2016","journal-title":"J. Robot. Mechatron."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gallego Casc\u00f3n, P., Matthies, D.J., Muthukumarana, S., and Nanayakkara, S. (2019, January 4\u20139). Chewit. An intraoral interface for discreet interactions. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Scotland, UK.","DOI":"10.1145\/3290605.3300556"}],"container-title":["Biosensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-6374\/14\/5\/213\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:33:09Z","timestamp":1760106789000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-6374\/14\/5\/213"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,24]]},"references-count":28,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["bios14050213"],"URL":"https:\/\/doi.org\/10.3390\/bios14050213","relation":{},"ISSN":["2079-6374"],"issn-type":[{"value":"2079-6374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,24]]}}}