{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T03:04:01Z","timestamp":1760151841836,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T00:00:00Z","timestamp":1669680000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008784","name":"Universidad de las Fuerzas Armadas ESPE","doi-asserted-by":"publisher","award":["2022-EXT-003 ESPE","INV-0012-031"],"award-info":[{"award-number":["2022-EXT-003 ESPE","INV-0012-031"]}],"id":[{"id":"10.13039\/501100008784","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad Tecnol\u00f3gica Indoam\u00e9rica","award":["2022-EXT-003 ESPE","INV-0012-031"],"award-info":[{"award-number":["2022-EXT-003 ESPE","INV-0012-031"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Nowadays, daily life involves the extensive use of computers, since human beings are immersed in a technological society. Therefore, it is mandatory to interact with computers, which represents a true disadvantage for people with upper limb disabilities. In this context, this work aims to develop an interface for emulating mouse and keyboard functions (EMKEY) by applying concepts of artificial vision and voice recognition to replace the use of hands. Pointer control is achieved by head movement, whereas voice recognition is used to perform interface functionalities, including speech-to-text transcription. To evaluate the interface\u2019s usability and usefulness, two studies were carried out. The first study was performed with 30 participants without physical disabilities. Throughout this study, there were significant correlations found between the emulator\u2019s usability and aspects such as adaptability, execution time, and the participant\u2019s age. In the second study, the use of the emulator was analyzed by four participants with motor disabilities. It was found that the interface was best used by the participant with cerebral palsy, followed by the participants with upper limb paralysis, spina bifida, and muscular dystrophy. In general, the results show that the proposed interface is easy to use, practical, fairly accurate, and works on a wide range of computers.<\/jats:p>","DOI":"10.3390\/s22239279","type":"journal-article","created":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T02:09:58Z","timestamp":1669687798000},"page":"9279","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Low-Cost Human\u2013Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8841-0498","authenticated-orcid":false,"given":"Pablo","family":"Ramos","sequence":"first","affiliation":[{"name":"Departamento de El\u00e9ctrica, Electr\u00f3nica y Telecomunicaciones, Universidad de las Fuerzas Armadas ESPE, Av. General Rumi\u00f1ahui S\/N y Ambato, Sangolqu\u00ed 171103, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3382-2724","authenticated-orcid":false,"given":"Mireya","family":"Zapata","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Mecatr\u00f3nica y Sistemas Interactivos-MIST, Universidad Indoam\u00e9rica, Av. Machala y Sabanilla, Quito 170103, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin","family":"Valencia","sequence":"additional","affiliation":[{"name":"Departamento de El\u00e9ctrica, Electr\u00f3nica y Telecomunicaciones, Universidad de las Fuerzas Armadas ESPE, Av. General Rumi\u00f1ahui S\/N y Ambato, Sangolqu\u00ed 171103, Ecuador"},{"name":"Centro de Investigaci\u00f3n en Mecatr\u00f3nica y Sistemas Interactivos-MIST, Universidad Indoam\u00e9rica, Av. Machala y Sabanilla, Quito 170103, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3661-1172","authenticated-orcid":false,"given":"Vanessa","family":"Vargas","sequence":"additional","affiliation":[{"name":"Departamento de El\u00e9ctrica, Electr\u00f3nica y Telecomunicaciones, Universidad de las Fuerzas Armadas ESPE, Av. General Rumi\u00f1ahui S\/N y Ambato, Sangolqu\u00ed 171103, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5614-1994","authenticated-orcid":false,"given":"Carlos","family":"Ramos-Galarza","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Mecatr\u00f3nica y Sistemas Interactivos-MIST, Universidad Indoam\u00e9rica, Av. Machala y Sabanilla, Quito 170103, Ecuador"},{"name":"Facultad de Psicolog\u00eda, Pontificia Universidad Cat\u00f3lica del Ecuador, Av. 12 de Octubre y Roca, Quito 170143, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1007\/s11554-021-01070-6","article-title":"Implementing a real-time, AI-based, people detection and social distancing measuring system for COVID-19","volume":"18","author":"Saponara","year":"2021","journal-title":"J. Real Time Image Process."},{"key":"ref_2","first-page":"6783","article-title":"IEyeGASE: An intelligent eye gaze-based assessment system for deeper insights into learner performance","volume":"21\u201320","author":"Kamath","year":"2021","journal-title":"Sensors"},{"key":"ref_3","first-page":"171","article-title":"Educaci\u00f3n inclusiva y TIC: Sistemas de barrido ocular para alumnado con par\u00e1lisis cerebral en Educaci\u00f3n Primaria","volume":"35","author":"Espada","year":"2020","journal-title":"Ens. Rev. Fac. Educ. Albacete"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lupu, R.G., Ungureano, F., and Siriteanu, V. (2013, January 21\u201323). Eye tracking mouse for human computer interaction. Proceedings of the E-Health and Bioengineering Conference (EHB), Iasi, Romania.","DOI":"10.1109\/EHB.2013.6707244"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5739301","DOI":"10.1155\/2017\/5739301","article-title":"Eye tracking based control system for natural human-computer interaction","volume":"2017","author":"Zhang","year":"2017","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_6","unstructured":"Sias, A., Kruger, V., Cunha, R., Bender, M., Bender, M., and Aires, T. (2017, January 21\u201323). Evaluation of a head-tracking pointing device for users with motor disabilities. Proceedings of the Pervasive Technologies Related to Assistive Environments Conference (PETRA), Island of Rhodes, Greece."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nanni, L., Brahnam, S., and Lumini, A. (2019). Face detection ensemble with methods using depth information to filter false positives. Sensors, 19.","DOI":"10.3390\/s19235242"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TLA.2017.7827915","article-title":"Identifying facial gestures to emulate a mouse: Navigation application on Facebook","volume":"15","author":"Mosquera","year":"2017","journal-title":"IEEE Lat. Am. Trans."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1080\/17483107.2020.1799440","article-title":"Human-computer multimodal interface to internet navigation","volume":"16","author":"Mosquera","year":"2020","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"ref_10","first-page":"72","article-title":"Interfaz humano-computador basada en gestos faciales y orientada a la aplicaci\u00f3n WhatsApp para personas con limitaci\u00f3n motriz de miembros superiores","volume":"24","author":"Ferrin","year":"2021","journal-title":"TecnoL\u00f3gicas"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lund, M., Caltenco, A., Lontis, E., Christiensen, H., Bentsen, B., and Struijk, A. (2009, January 3\u20136). A framework for mouse and keyboard emulation in a tongue control system. Proceedings of the IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine (EMBC), Minneapolis, MN, USA.","DOI":"10.1109\/IEMBS.2009.5334055"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1109\/TBCAS.2017.2771235","article-title":"Simultaneous multimodal PC access for people with disabilities by integrating head tracking, speech recognition, and tongue motion","volume":"12","author":"Sahadat","year":"2018","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"G\u00fcr, D., Sch\u00e4fer, N., Kupnik, M., and Beckerle, P. (2020). A human-computer interface replacing mouse and keyboard for individuals with limited upper limb mobility. Multimod. Technol. Interact., 4.","DOI":"10.3390\/mti4040084"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1088\/1741-2560\/5\/2\/001","article-title":"Emulation of computer mouse control with a noninvasive brain\u2013computer interface","volume":"5","author":"McFarland","year":"2008","journal-title":"J. Neural Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103249","DOI":"10.1016\/j.jbi.2019.103249","article-title":"An empirical evaluation of a hands-free computer interaction for users with motor disabilities","volume":"96","author":"Debeljak","year":"2019","journal-title":"J. Biomed. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Loewenich, F., and Maire, F. (2007, January 28\u201330). Hands-free mouse-pointer manipulation using motion-tracking and speech recognition. Proceedings of the Australasian Conference on Computer-Human Interaction: Entertaining User Interfaces (OZCHI\u201907), Adelaide, Australia.","DOI":"10.1145\/1324892.1324955"},{"key":"ref_17","first-page":"141","article-title":"Face enable mouse using motion detection and speech recognition","volume":"1","author":"Sinha","year":"2015","journal-title":"Int. J. Innov. Res. Sci. Technol. IJIRST"},{"key":"ref_18","unstructured":"Guiawal, P., Alsadoon, A., Prasad, P., Hoe, L., and Elchouemi, A. (2016, January 5\u20137). A novel robust camera mouse for disabled people (RCMDP). Proceedings of the International Conference on Information and Communication Systems (ICICS), Irbid, Jordan."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Khan, S., Haque, S., Hossain, S., Hossain, E., and Ahmad, M. (2017, January 7\u20139). Nose tracking cursor control for the people with disabilities: An improved HCI. Proceedings of the 3rd International Conference on Electrical Information and Communication Technology (EICT), Khulna, Bangladesh.","DOI":"10.1109\/EICT.2017.8275178"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gupta, D., Hossain, E., Shahadat, H., Andersson, K., and Hossain, S. (2019, January 29). A digital personal assistant using Bangla voice command recognition and face detection. Proceedings of the IEEE International Conference on Robotics, Automation, Artificial-Intelligence and Internet-of-Things (RAAICON), Dhaka, Bangladesh.","DOI":"10.1109\/RAAICON48939.2019.47"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e12398","DOI":"10.1111\/exsy.12398","article-title":"Head mouse control system for people with disabilities","volume":"37","author":"Abiyev","year":"2020","journal-title":"Expert Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1002\/cae.21884","article-title":"An efficient speech recognition system for arm-disabled students based on isolated words","volume":"26","author":"Darabkh","year":"2018","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_23","first-page":"39","article-title":"Control mouse cursor by head movement: Development and implementation","volume":"40","author":"Alhamzawi","year":"2018","journal-title":"Appl. Med. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Paudyal, B., Creed, C., Frutos, M., and Williams, I. (2020, January 6\u201310). Voiceye: A multimodal inclusive development environment. Proceedings of the ACM Designing Interactive Systems Conference (DIS), Eindhoven, The Netherlands.","DOI":"10.1145\/3357236.3395553"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1080\/17483107.2017.1369592","article-title":"Development and evaluation of a mobile AAC: A virtual therapist and speech assistant for people with communication disabilities","volume":"13","author":"Wang","year":"2018","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1080\/17483107.2018.1508515","article-title":"A tablet-based program to enable people with intellectual and other disabilities to access leisure activities and video calls","volume":"15","author":"Lancioni","year":"2020","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"ref_27","unstructured":"(2021, November 05). Dlib: A Toolkit for Making Real World Machine Learning and Data Analysis Applications in C++. Available online: https:\/\/github.com\/davisking\/dlib."},{"key":"ref_28","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., and Pantic, M. (2013, January 2\u20138). 300 faces in-the-wild challenge: The first facial landmark localization challenge. Proceedings of the IEEE International Conference on Computer Vision Workshop (ICCV Workshops), Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.59"},{"key":"ref_30","unstructured":"Soukupov\u00e1, T., and Cech, J. (2016, January 3\u20135). Real-time eye blink detection using facial landmarks. Proceedings of the Computer Vision Winter Workshop (CVWW), Rimske Toplice, Slovenia."},{"key":"ref_31","unstructured":"(2021, December 20). VOSK Offline Speech Recognition API. Available online: https:\/\/alphacephei.com\/vosk\/."},{"key":"ref_32","unstructured":"(2022, January 30). PyAutoGUI Documentation. Available online: https:\/\/pyautogui.readthedocs.io\/en\/latest\/index.html."},{"key":"ref_33","unstructured":"(2022, January 18). PyGame. Available online: https:\/\/www.pygame.org\/wiki\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9279\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:28:55Z","timestamp":1760146135000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9279"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,29]]},"references-count":33,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239279"],"URL":"https:\/\/doi.org\/10.3390\/s22239279","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,11,29]]}}}