{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T03:19:24Z","timestamp":1767842364493,"version":"3.49.0"},"reference-count":45,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["FE 936\/6"],"award-info":[{"award-number":["FE 936\/6"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["KU 3498\/3-1"],"award-info":[{"award-number":["KU 3498\/3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>People with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard. Head motions are mapped to mouse pointer positions, while mouse button actions are triggered by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace the conventional keyboard. To allow for complex text entry, the sensory concept is complemented by an ambiguous keyboard layout with ten keys. The related word prediction function provides disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as well as the emulation of a two-button mouse.<\/jats:p>","DOI":"10.3390\/mti4040084","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T09:16:49Z","timestamp":1606468609000},"page":"84","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Human\u2013Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5320-6526","authenticated-orcid":false,"given":"Diyar","family":"G\u00fcr","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5433-0273","authenticated-orcid":false,"given":"Niklas","family":"Sch\u00e4fer","sequence":"additional","affiliation":[{"name":"Measurement and Sensor Technology, Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, Germany"}]},{"given":"Mario","family":"Kupnik","sequence":"additional","affiliation":[{"name":"Measurement and Sensor Technology, Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5703-6029","authenticated-orcid":false,"given":"Philipp","family":"Beckerle","sequence":"additional","affiliation":[{"name":"Elastic Lightweight Robotics Group, Robotics Research Institute, Department of Electrical Engineering and Information Technology, Technische Universit\u00e4t Dortmund, 44227 Dortmund, Germany"},{"name":"Institute for Mechatronic Systems in Mechanical Engineering, Technical University of Darmstadt, 64287 Darmstadt, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1016\/0002-9343(63)90135-9","article-title":"Muscular Dystrophy","volume":"35","author":"Pearson","year":"1963","journal-title":"Am. J. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/jnc.12327","article-title":"150 Years of Friedreich Ataxia: From Its Discovery to Therapy","volume":"126","author":"Schulz","year":"2013","journal-title":"J. Neurochem."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2120","DOI":"10.1016\/S0140-6736(08)60921-6","article-title":"Spinal Muscular Atrophy","volume":"371","author":"Lunn","year":"2008","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Krishnaswamy, K., Ord\u00f3 nez, P., Beckerle, P., Rinderknecht, S., and Felzer, T. (2016, January 23\u201326). OnScreenDualScribe with Point-and-Click Interface: A Viable Computer Interaction Alternative Based on a Virtual Modified Numerical Keypad. Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, New York, NY, USA.","DOI":"10.1145\/2982142.2982184"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1806923.1806925","article-title":"SAK: Scanning Ambiguous Keyboard for Efficient One-Key Text Entry","volume":"17","author":"Mackenzie","year":"2010","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1007\/978-3-642-14100-3_20","article-title":"Qanti: A Software Tool for Quick Ambiguous Non-Standard Text Input","volume":"Volume 6180","author":"Hutchison","year":"2010","journal-title":"Computers Helping People with Special Needs"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-642-03658-3_1","article-title":"Ambiguous Keyboards and Scanning: The Relevance of the Cell Selection Phase","volume":"Volume 5727","author":"Gross","year":"2009","journal-title":"Human-Computer Interaction\u2014INTERACT 2009"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1497302.1497304","article-title":"Conception and Experimentation of a Communication Device with Adaptive Scanning","volume":"1","author":"Ghedira","year":"2009","journal-title":"ACM Trans. Access. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1109\/TASLP.2014.2304637","article-title":"An Overview of Noise-Robust Automatic Speech Recognition","volume":"22","author":"Li","year":"2014","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yi, Z., Quan-jie, L., Yan-hua, L., and Li, Z. (2009, January 19\u201323). Intelligent Wheelchair Multimodal Human-Machine Interfaces in Lip Contour Extraction Based on PMM. Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guilin, China.","DOI":"10.1109\/ROBIO.2009.5420490"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/10400435.2010.483646","article-title":"Difficulties in Automatic Speech Recognition of Dysarthric Speakers and Implications for Speech-Based Applications Used by the Elderly: A Literature Review","volume":"22","author":"Young","year":"2010","journal-title":"Assist. Technol. Off. J. RESNA"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.cviu.2006.10.012","article-title":"Vision-Based Hand Pose Estimation: A Review","volume":"108","author":"Erol","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ghaoui, C. (2006). Eye Tracking in HCI and Usability Research. Encyclopedia of Human Computer Interaction, IGI Global.","DOI":"10.4018\/978-1-59140-562-7"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Panwar, P., Sarcar, S., and Samanta, D. (2012, January 27\u201329). EyeBoard: A Fast and Accurate Eye Gaze-Based Text Entry System. Proceedings of the 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI), Kharagpur, India.","DOI":"10.1109\/IHCI.2012.6481793"},{"key":"ref_15","unstructured":"Tobii Dynavox (2020, September 10). PCEye Plus, I-Series Product Page. Available online: https:\/\/www.tobiidynavox.com\/products\/devices\/."},{"key":"ref_16","unstructured":"Eyetech Digital Systems (2020, September 10). TM5-Mini by Eyetech Digital Systems Product Page. Available online: https:\/\/www.eyetechds.com\/tm5mini.html."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1044\/aac19.3.64","article-title":"Functional Performance Using Eye Control and Single Switch Scanning by People With ALS","volume":"19","author":"Gibbons","year":"2010","journal-title":"Perspect. Augment. Altern. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1093\/brain\/awh560","article-title":"Apraxia in Movement Disorders","volume":"128","author":"Zadikoff","year":"2005","journal-title":"Brain A J. Neurol."},{"key":"ref_19","unstructured":"Karpov, A., and Cadiou, A. (2006, January 25\u201329). Hands-Free Mouse Control System for Handicapped Operators. Proceedings of the 11-th International Conference SPECOM, St. Petersburg, Russia."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mihelic, F., and Zibert, J. (2008). Motion-Tracking and Speech Recognition for Hands-Free Mouse Pointer Manipulation. Speech Recognition, IN-TECH.","DOI":"10.5772\/93"},{"key":"ref_21","unstructured":"NaturalPoint (2020, September 10). SmartNav by NaturalPoint Product Page. Available online: https:\/\/www.naturalpoint.com\/smartnav\/."},{"key":"ref_22","unstructured":"Origin Instruments (2020, September 10). HeadMouse Nano Product Page. Available online: https:\/\/www.orin.com\/access\/headmouse\/."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"168781401664910","DOI":"10.1177\/1687814016649101","article-title":"Assistive Computer Input Device for Muscular Atrophy Patients","volume":"8","author":"Tsai","year":"2016","journal-title":"Adv. Mech. Eng."},{"key":"ref_24","first-page":"124","article-title":"Human-Computer Interface Based on Visual Lip Movement and Gesture Recognition","volume":"7","author":"Dalka","year":"2010","journal-title":"Int. J. Comput. Sci. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Orhan, U., Erdogmus, D., Roark, B., Purwar, S., Hild, K.E., Oken, B., Nezamfar, H., and Fried-Oken, M. (September, January 30). Fusion with Language Models Improves Spelling Accuracy for ERP-Based Brain Computer Interface spellers. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091429"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1109\/TNSRE.2004.834627","article-title":"Conversion of EEG Activity Into Cursor Movement by a Brain-Computer Interface (BCI)","volume":"12","author":"Fabiani","year":"2004","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dhillon, H.S., Singla, R., Rekhi, N.S., and Jha, R. (2009, January 8\u201311). EOG and EMG Based Virtual Keyboard: A Brain-Computer Interface. Proceedings of the 2009 2nd IEEE International Conference on Computer Science and Information Technology, Beijing, China.","DOI":"10.1109\/ICCSIT.2009.5234951"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1142\/S0218213009000202","article-title":"Integration of EMG and EGT Modalities for the Development of an Enhanced Cursor Control System","volume":"18","author":"Chin","year":"2009","journal-title":"Int. J. Artif. Intell. Tools"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yamagishi, K., Hori, J., and Miyakawa, M. (September, January 30). Development of EOG-Based Communication System Controlled by Eight-Directional Eye Movements. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA.","DOI":"10.1109\/IEMBS.2006.259914"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.jneumeth.2007.07.017","article-title":"Toward Enhanced P300 Speller Performance","volume":"167","author":"Krusienski","year":"2008","journal-title":"J. Neurosci. Methods"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1109\/86.847821","article-title":"Current Trends in Graz Brain-Computer Interface (BCI) Research","volume":"8","author":"Pfurtscheller","year":"2000","journal-title":"IEEE Trans. Rehabil. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1109\/JBHI.2014.2305103","article-title":"Human-Computer Interface Controlled by the Lip","volume":"19","author":"Jose","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"162","DOI":"10.14445\/22315381\/IJETT-V54P223","article-title":"Integration of IMU Sensor on Low-Cost EEG and Design of Cursor Control System with ANFIS","volume":"54","author":"Bozkurt","year":"2017","journal-title":"Int. J. Eng. Trends Technol."},{"key":"ref_34","unstructured":"Kurniawan, S., and Richards, J. Text Entry by Raising the Eyebrow with HaMCoS. Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility\u2014ASSETS \u201914."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1080\/07434610701553668","article-title":"AAC for Adults with Acquired Neurological Conditions: A Review","volume":"23","author":"Beukelman","year":"2007","journal-title":"Augment. Altern. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Esposito, D., Andreozzi, E., Fratini, A., Gargiulo, G.D., Savino, S., Niola, V., and Bifulco, P. (2018). A Piezoresistive Sensor to Measure Muscle Contraction and Mechanomyography. Sensors, 18.","DOI":"10.3390\/s18082553"},{"key":"ref_37","unstructured":"Hwang, F., McGrenere, J., and Flatla, D. Design and Testing of Sensors for Text Entry and Mouse Control for Individuals with Neuromuscular Diseases. Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility."},{"key":"ref_38","first-page":"288","article-title":"Comparison Among Ambiguous Virtual Keyboards for People with Severe Motor Disabilities","volume":"1","year":"2011","journal-title":"IJMER Int. J. Mod. Eng. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/TOH.2017.2689006","article-title":"Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives","volume":"10","author":"Pacchierotti","year":"2017","journal-title":"IEEE Trans. Haptics"},{"key":"ref_40","unstructured":"Barrett, K.E., Barman, S.M., Boitano, S., and Brooks, H.L. (2016). Ganong\u2019s Review of Medical Physiology, McGraw-Hill Education. [25th ed.]."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cockton, G., and Korhonen, P. (2003). Phrase Sets for Evaluating Text Entry Techniques. CHI \u201903 Extended Abstracts on Human Factors in Computing Systems\u2014CHI \u201903, ACM Press.","DOI":"10.1145\/765891"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Patern\u00f2, F. (2002). KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques. Human Computer Interaction with Mobile Devices, Springer.","DOI":"10.1007\/3-540-45756-9"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5296","DOI":"10.3390\/s140305296","article-title":"Flexible Tactile Sensing Based on Piezoresistive Composites: A Review","volume":"14","author":"Stassi","year":"2014","journal-title":"Sensors"},{"key":"ref_44","unstructured":"Hollinger, A., and Wanderley, M.M. (2006, January 4\u20138). Evaluation of Commercial Force Sensing Resistors. Proceedings of the International Conference on New Interfaces for Musical Expression, Paris, France."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1080\/07434619912331278625","article-title":"Efficient Keyboard Layouts for Sequential Access in Augmentative and Alternative Communication","volume":"15","author":"Venkatagiri","year":"1999","journal-title":"Augment. Altern. Commun."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/4\/4\/84\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:38:10Z","timestamp":1760179090000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/4\/4\/84"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["mti4040084"],"URL":"https:\/\/doi.org\/10.3390\/mti4040084","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]}}}