{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T01:31:23Z","timestamp":1776907883175,"version":"3.51.2"},"reference-count":30,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,5]],"date-time":"2021-08-05T00:00:00Z","timestamp":1628121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Navigation and Accessibility Research Center of Ariel University (NARCA)","award":["RA2000000284"],"award-info":[{"award-number":["RA2000000284"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Muteness at its various levels is a common disability. Most of the technological solutions to the problem creates vocal speech through the transition from mute languages to vocal acoustic sounds. We present a new approach for creating speech: a technology that does not require prior knowledge of sign language. This technology is based on the most basic level of speech according to the phonetic division into vowels and consonants. The speech itself is expected to be expressed through sensing of the hand movements, as the movements are divided into three rotations: yaw, pitch, and roll. The proposed algorithm converts these rotations through programming to vowels and consonants. For the hand movement sensing, we used a depth camera and standard speakers in order to produce the sounds. The combination of the programmed depth camera and the speakers, together with the cognitive activity of the brain, is integrated into a unique speech interface. Using this interface, the user can develop speech through an intuitive cognitive process in accordance with the ongoing brain activity, similar to the natural use of the vocal cords. Based on the performance of the presented speech interface prototype, it is substantiated that the proposed device could be a solution for those suffering from speech disabilities.<\/jats:p>","DOI":"10.3390\/s21165291","type":"journal-article","created":{"date-parts":[[2021,8,5]],"date-time":"2021-08-05T09:35:32Z","timestamp":1628156132000},"page":"5291","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Intuitive Cognition-Based Method for Generating Speech Using Hand Gestures"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5696-4384","authenticated-orcid":false,"given":"Eldad","family":"Holdengreber","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering and Mechatronics, Ariel University, Ariel 40700, Israel"},{"name":"Navigation and Accessibility Research Center of Ariel University (NARCA), Ariel 40700, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5180-4541","authenticated-orcid":false,"given":"Roi","family":"Yozevitch","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Holon Institute of Technology, Holon 58102, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vitali","family":"Khavkin","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering and Mechatronics, Ariel University, Ariel 40700, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,5]]},"reference":[{"key":"ref_1","unstructured":"Black, L.I., Vahratian, A., and Hoffman, H.J. (2015). Communication Disorders and Use of Intervention Services among Children Aged 3\u201317 Years: United States, 2012, US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Samonte, M.J.C., Gazmin, R.A., Soriano, J.D.S., and Valencia, M.N.O. (2019, January 16\u201318). BridgeApp: An Assistive Mobile Communication Application for the Deaf and Mute. Proceedings of the 2019 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea.","DOI":"10.1109\/ICTC46691.2019.8939866"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nagori, N.P., and Malode, V. (2016, January 9\u201310). Communication interface for deaf-mute people using microsoft kinect. Proceedings of the 2016 International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT), Pune, India.","DOI":"10.1109\/ICACDOT.2016.7877664"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Devi, S., and Deb, S. (2017, January 9\u201310). Low cost tangible glove for translating sign gestures to speech and text in Hindi language. Proceedings of the 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT), Ghaziabad, India.","DOI":"10.1109\/CIACT.2017.7977370"},{"key":"ref_5","unstructured":"Kumar, D.N., Madhukar, M., Prabhakara, A., Marathe, A.V., and Bharadwaj, S.S. (2019, January 19\u201320). Sign Language to Speech Conversion\u2014An Assistive System for Speech Impaired. Proceedings of the 2019 1st International Conference on Advanced Technologies in Intelligent Control, Environment, Computing & Communication Engineering (ICATIECE), Bangalore, India."},{"key":"ref_6","unstructured":"Macriga, A., Kruthiga, K., and Anusudha, S. (2017, January 23\u201324). Artificial Voice synthesizer using fuzzy logics. Proceedings of the 2017 2nd International Conference on Computing and Communications Technologies (ICCCT), Chennai, India."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nasrany, C., Abdou, R.B., Kassem, A., and Hamad, M. (2015, January 16\u201318). S2LV\u2014A sign to letter and voice converter. Proceedings of the 2015 International Conference on Advances in Biomedical Engineering (ICABME), Beirut, Lebanon.","DOI":"10.1109\/ICABME.2015.7323283"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1145\/1897816.1897838","article-title":"Vision-based hand-gesture applications","volume":"54","author":"Wachs","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yang, S., Liu, J., Lu, S., Er, M.H., and Kot, A.C. (2020). Collaborative learning of gesture recognition and 3D hand pose estimation with multi-order feature analysis. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-030-58580-8_45"},{"key":"ref_10","unstructured":"Zhang, F., Bazarevsky, V., Vakunov, A., Tkachenka, A., Sung, G., Chang, C.L., and Grundmann, M. (2020). MediaPipe Hands: On-device Real-time Hand Tracking. arXiv."},{"key":"ref_11","unstructured":"Motion, L. (2021, July 19). Leap Motion Controller. Available online: https:\/\/www.leapmotion.com."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Guzsvinecz, T., Szucs, V., and Sik-Lanyi, C. (2019). Suitability of the Kinect sensor and Leap Motion controller\u2014A literature review. Sensors, 19.","DOI":"10.3390\/s19051072"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"214","DOI":"10.3390\/s150100214","article-title":"Evaluation of the leap motion controller as a new contact-free pointing device","volume":"15","author":"Bachmann","year":"2015","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1109\/TMM.2018.2856094","article-title":"Exploiting recurrent neural networks and leap motion controller for the recognition of sign language and semaphoric hand gestures","volume":"21","author":"Avola","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7056","DOI":"10.1109\/JSEN.2019.2909837","article-title":"A modified LSTM model for continuous sign language recognition using leap motion","volume":"19","author":"Mittal","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/j.procs.2018.05.008","article-title":"Analysis of movement and gesture recognition using Leap Motion Controller","volume":"132","author":"Sharma","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_17","first-page":"559-462","article-title":"Text-to-speech synthesis using concatenative approach","volume":"3","author":"TS","year":"2016","journal-title":"Int. J. Trend Res. Dev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_19","first-page":"891","article-title":"Tone and non-tone languages: An alternative to language typology and parameters","volume":"5","author":"Duanmu","year":"2004","journal-title":"Lang. Linguist."},{"key":"ref_20","unstructured":"Crystal, D. (2004). The Cambridge Encyclopedia of the English Language, Ernst Klett Sprachen."},{"key":"ref_21","unstructured":"Shannon, C.E. (1949). The Mathematical Theory of Communication, by CE Shannon (and Recent Contributions to the Mathematical Theory of Communication), W. Weaver, University of Illinois Press."},{"key":"ref_22","unstructured":"Young, D.B. (2021, July 19). Foundations of Computer Security. Available online: https:\/\/www.cs.utexas.edu\/~byoung\/cs361\/lecture35.pdf."},{"key":"ref_23","unstructured":"Lynn, P.A. (2016). An Introduction to the Analysis and Processing of Signals, Macmillan International Higher Education."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2566","DOI":"10.1109\/TASL.2011.2151859","article-title":"Speech analysis and synthesis based on dynamic modes","volume":"19","author":"Vargas","year":"2011","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_25","first-page":"303","article-title":"A comparison of spectro-temporal representations of audio signals","volume":"22","author":"Krijnders","year":"2013","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1109\/LSP.2008.2005755","article-title":"Effect of analysis window duration on speech intelligibility","volume":"15","author":"Paliwal","year":"2008","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"203655","DOI":"10.1109\/ACCESS.2020.3036769","article-title":"Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence","volume":"8","author":"Tran","year":"2020","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"175353","DOI":"10.1109\/ACCESS.2019.2957572","article-title":"Investigation of different CNN-based models for improved bird sound classification","volume":"7","author":"Xie","year":"2019","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2063","DOI":"10.1109\/TKDE.2018.2873791","article-title":"Complete random forest based class noise filtering learning for improving the generalizability of classifiers","volume":"31","author":"Xia","year":"2019","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yozevitch, R., and Ben-Moshe, B. (2017). Advanced particle filter methods. Heuristics and Hyper-Heuristics-Principles and Applications, InTech.","DOI":"10.5772\/intechopen.69236"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5291\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:41:00Z","timestamp":1760164860000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5291"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,5]]},"references-count":30,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165291"],"URL":"https:\/\/doi.org\/10.3390\/s21165291","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,5]]}}}