{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T05:15:49Z","timestamp":1783401349719,"version":"3.54.6"},"reference-count":55,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T00:00:00Z","timestamp":1645401600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hubei Natural Science Foundation","award":["2021CFB156"],"award-info":[{"award-number":["2021CFB156"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Healthcare Engineering"],"published-print":{"date-parts":[[2022,2,21]]},"abstract":"<jats:p>In the era of modern technology, people may readily communicate through facial expressions, body language, and other means. As the use of the Internet evolves, it may be a boon to the medical fields. Recently, the Internet of Medical Things (IoMT) has provided a broader platform to handle difficulties linked to healthcare, including people's listening and hearing impairment. Although there are many translators that exist to help people of various linguistic backgrounds communicate more effectively. Using kinesics linguistics, one may assess or comprehend the communications of auditory and hearing-impaired persons who are standing next to each other. When looking at the present COVID-19 scenario, individuals are still linked in some way via online platforms; however, persons with disabilities have communication challenges with online platforms. The work provided in this research serves as a communication bridge inside the challenged community and the rest of the globe. The proposed work for Indian Sign Linguistic Recognition (ISLR) uses three-dimensional convolutional neural networks (3D-CNNs) and long short-term memory (LSTM) technique for analysis. A conventional hand gesture recognition system involves identifying the hand and its location or orientation, extracting certain essential features and applying an appropriate machine learning algorithm to recognise the completed action. In the calling interface of the web application, WebRTC has been implemented. A teleprompting technology is also used in the web app, which transforms sign language into audible sound. The proposed web app's average recognition rate is 97.21%.<\/jats:p>","DOI":"10.1155\/2022\/3978627","type":"journal-article","created":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T21:03:36Z","timestamp":1645477416000},"page":"1-17","source":"Crossref","is-referenced-by-count":16,"title":["CNN-LSTM Hybrid Real-Time IoT-Based Cognitive Approaches for ISLR with WebRTC: Auditory Impaired Assistive Technology"],"prefix":"10.1155","volume":"2022","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7366-0841","authenticated-orcid":true,"given":"Meenu","family":"Gupta","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Chandigarh University, Punjab, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1625-1280","authenticated-orcid":true,"given":"Narina","family":"Thakur","sequence":"additional","affiliation":[{"name":"CSE Department, Bhagwan Parshuram Institute of Technology, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1886-9527","authenticated-orcid":true,"given":"Dhruvi","family":"Bansal","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering Department, Bharati Vidyapeeth's College of Engineering New Delhi, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3991-3291","authenticated-orcid":true,"given":"Gopal","family":"Chaudhary","sequence":"additional","affiliation":[{"name":"Bharati Vidyapeeth\u2019s College of Engineering, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4118-2133","authenticated-orcid":true,"given":"Battulga","family":"Davaasambuu","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communication Engineering, School of Engineering and Applied Sciences, National University of Mongolia, Ulan Bator, Mongolia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5999-4498","authenticated-orcid":true,"given":"Qiaozhi","family":"Hua","sequence":"additional","affiliation":[{"name":"Computer School, Hubei University of Arts and Science, Xiangyang 441000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","reference":[{"key":"1","article-title":"Breach the wall of silence: give state recognition to Indian sign language","author":"Sharma","year":"2021"},{"key":"2","first-page":"1","article-title":"Messaging and video calling application for specially abled people using hand gesture recognition","author":"R. R. Chhajed"},{"key":"3","first-page":"251","article-title":"Comparative study of audio and video chat application over the internet","author":"N. Pathania"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1109\/access.2019.2901863"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.001.2000374"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3098422"},{"key":"7","first-page":"71","article-title":"Indian sign language interpretation and sentence formation","author":"D. Gangadia"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3079574"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2021.3081874"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.101.2001126"},{"key":"11","first-page":"572","article-title":"Sign language recognition using convolutional neural networks","author":"L. Pigou"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3125190"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3076015"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2020.3047606"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17881-8_5"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3120075"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3119921"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3113321"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/tim.2008.925725"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3116132"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3070544"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1109\/tim.2015.2444238"},{"key":"23","first-page":"139","article-title":"Dynamic sign language and voice recognition for smart home interactive application","author":"M. R. Abid"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2021.3101842"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2021.09.044"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1109\/tnn.2002.1021898"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.3027568"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3128954"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3117263"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1109\/tim.2011.2161140"},{"key":"31","first-page":"1","article-title":"Possibility theory based continuous Indian Sign Language gesture recognition","author":"N. Baranwal"},{"key":"32","first-page":"121","article-title":"Automatic alignment of hamnosys subunits for continuous sign language recognition","author":"O. Koller","year":"2016","journal-title":"LREC 2016 Proceedings"},{"key":"33","first-page":"474","article-title":"Multi-scale deep learning for gesture detection and localization","author":"N. Neverova"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2016.2537340"},{"key":"35","first-page":"4207","article-title":"Online detection and classification of dynamic hand gestures with recurrent 3d convolutional neural network","author":"P. Molchanov"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2018.2889563"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1109\/jsen.2019.2909837"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p16-1101"},{"key":"39","doi-asserted-by":"crossref","first-page":"1155","DOI":"10.1109\/ACCESS.2017.2778011","article-title":"Action recognition in video sequences using deep bi-directional LSTM with CNN features","volume":"6","author":"A. Ullah","year":"2017","journal-title":"IEEE access"},{"key":"40","doi-asserted-by":"publisher","DOI":"10.1109\/access.2019.2925654"},{"issue":"9","key":"41","doi-asserted-by":"crossref","first-page":"2306","DOI":"10.1109\/TPAMI.2019.2911077","article-title":"Weakly supervised learning with multi-stream CNN-LSTM-HMMs to discover sequential parallelism in sign language videos","volume":"42","author":"O. Koller","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"10","key":"42","doi-asserted-by":"crossref","first-page":"2069","DOI":"10.1109\/TPAMI.2015.2505297","article-title":"Saying what you're looking for: linguistics meets video search","volume":"38","author":"D. P. Barrett","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1049\/iet-ipr.2019.1248"},{"key":"44","first-page":"518","article-title":"Extraction of parametric human model for posture recognition using genetic algorithm","author":"C. Hu"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1049\/joe.2018.8327"},{"issue":"8","key":"46","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1109\/TPAMI.2015.2513479","article-title":"Explore efficient local features from RGB-D data for one-shot learning gesture recognition","volume":"38","author":"J. Wan","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.05.069"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1109\/lsp.2018.2797228"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2019.2894139"},{"key":"50","first-page":"835","article-title":"SEDAT: sentiment and emotion detection in Arabic text using CNN-LSTM deep learning","author":"M. Abdullah"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-019-00668-9"},{"issue":"9","key":"52","first-page":"7154","article-title":"Conversion of sign language into text","volume":"13","author":"M. K. Nb","year":"2018","journal-title":"International Journal of Applied Engineering Research"},{"key":"53","doi-asserted-by":"publisher","DOI":"10.1007\/11941439_114"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.4103\/0301-4738.37595"},{"key":"55","first-page":"130","article-title":"An efficient approach for interpretation of Indian sign language using machine learning","author":"S. Dhivyasri"}],"updated-by":[{"DOI":"10.1155\/2023\/9894609","type":"retraction","label":"Retraction","source":"retraction-watch","updated":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T00:00:00Z","timestamp":1702425600000},"record-id":"59106"},{"DOI":"10.1155\/2023\/9894609","type":"retraction","label":"Retraction","source":"publisher","updated":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T00:00:00Z","timestamp":1702425600000}}],"container-title":["Journal of Healthcare Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/jhe\/2022\/3978627.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jhe\/2022\/3978627.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jhe\/2022\/3978627.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,21]],"date-time":"2022-02-21T21:03:47Z","timestamp":1645477427000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/jhe\/2022\/3978627\/"}},"subtitle":[],"editor":[{"given":"Chinmay","family":"Chakraborty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,2,21]]},"references-count":55,"alternative-id":["3978627","3978627"],"URL":"https:\/\/doi.org\/10.1155\/2022\/3978627","relation":{"retraction":[{"id-type":"doi","id":"10.1155\/2023\/9894609","asserted-by":"object"}]},"ISSN":["2040-2309","2040-2295"],"issn-type":[{"value":"2040-2309","type":"electronic"},{"value":"2040-2295","type":"print"}],"subject":[],"published":{"date-parts":[[2022,2,21]]}}}