{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:10:20Z","timestamp":1767337820440,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T00:00:00Z","timestamp":1656460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Developing a smart classroom can make the modern classroom more efficient and intelligent. Much research has been conducted pertaining to smart classrooms for hearing-impaired college students. However, there have been few significant breakthroughs in mobilizing students\u2019 learning efficiency as measured by information transmission, communication, and interaction in class. This research collects data through nonparticipatory observation and in-depth interviews and analyzes available data on classroom interaction needs of these students. We found that diversified explanations, recordable interactive contents, and interaction between teachers and students could improve the learning effects in the classroom. We also propose a tracking-processing method based on gesture recognition and representation and present a design for a processing system based on AT89C52 microcontroller and Kinect. In this way, sign language can be translated into text and all students can receive the information and participate in the interaction, which greatly improves students\u2019 autonomy and enthusiasm of learning. This design enables deaf students to fully use classroom learning resources, reduces learning time costs, and improves learning efficiency. It can assist teachers in teaching and tutoring students to enhance their experience.<\/jats:p>","DOI":"10.3390\/fi14070198","type":"journal-article","created":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T20:47:56Z","timestamp":1656535676000},"page":"198","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Designing an Interactive Communication Assistance System for Hearing-Impaired College Students Based on Gesture Recognition and Representation"],"prefix":"10.3390","volume":"14","author":[{"given":"Yancong","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China"},{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"},{"name":"Human Resources Department, China Reform Health Management and Services Group Co., Ltd., Beijing 100028, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaoxi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Engineering and Applied Sciences, University at Buffalo, Buffalo, NY 14260, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gina","family":"Clepper","sequence":"additional","affiliation":[{"name":"College of Engineering, Purdue University, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingpeng","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Special Education, Beijing Union University, Beijing 100075, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3315-5370","authenticated-orcid":false,"given":"Wei","family":"Liu","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1177\/074193259902000606","article-title":"Vygotsky\u2019s vision: Reshaping the practice of special education for the 21st century","volume":"20","author":"Gindis","year":"1999","journal-title":"Remedial Spec. Educ."},{"key":"ref_2","first-page":"104","article-title":"Inclusive higher education for students with disabilities in China: What do the university teachers think?","volume":"8","author":"Zhang","year":"2018","journal-title":"High. Educ. Stud."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105738","DOI":"10.1016\/j.childyouth.2020.105738","article-title":"\u201cHow do I survive exclusion?\u201d Voices of students with disabilities at China\u2019s top universities","volume":"120","author":"Li","year":"2021","journal-title":"Child. Youth Serv. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"376","DOI":"10.3390\/fi5030376","article-title":"Internet Access by People with Intellectual Disabilities: Inequalities and Opportunities","volume":"5","author":"Chadwick","year":"2013","journal-title":"Futur. Internet"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1111\/jcal.12023","article-title":"A study to explore the effects of self-regulated learning environment for hearing-impaired students","volume":"30","author":"Chen","year":"2014","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"588","DOI":"10.17507\/tpls.0806.05","article-title":"Using New Media in Teaching English Reading and Writing for Hearing Impaired Students\u2014Taking Leshan Special Education School as an Example","volume":"8","author":"Xu","year":"2018","journal-title":"Theory Pract. Lang. Stud."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1016\/j.procs.2017.12.064","article-title":"Augmented Sign Language Modeling (ASLM) with interaction design on smartphone\u2014An assistive learning and communication tool for inclusive classroom","volume":"125","author":"Deb","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bragg, D., Koller, O., Bellard, M., Berke, L., Boudreault, P., Braffort, A., Caselli, N., Huenerfauth, M., Kacorri, H., and Verhoef, T. (2019, January 28\u201330). Sign language recognition, generation, and translation: An interdisciplinary perspective. Proceedings of the 21st International Conference on Computers and Accessibility, New York, NY, USA.","DOI":"10.1145\/3308561.3353774"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1145\/1165387.275628","article-title":"A hand gesture interface device","volume":"18","author":"Zimmerman","year":"1986","journal-title":"ACM SIGCHI Bull."},{"key":"ref_10","unstructured":"Chang, C.-C., and Pengwu, C.-M. (2004, January 27\u201330). Gesture recognition approach for sign language using curvature scale space and hidden Markov model. Proceedings of the 2004 IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Geetha, M., Menon, R., Jayan, S., James, R., and Janardhan, G.V.V. (2011, January 14\u201316). Gesture Recognition for American Sign Language with Polygon Approximation. Proceedings of the IEEE International Conference on Technology for Education, Tamil Nadu, India.","DOI":"10.1109\/T4E.2011.48"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/34.730553","article-title":"RIEVL: Recursive induction learning in hand gesture recognition","volume":"20","author":"Zhao","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1109\/TMM.2018.2856094","article-title":"Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures","volume":"21","author":"Avola","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-012-9356-9","article-title":"Vision based hand gesture recognition for human computer interaction: A survey","volume":"43","author":"Rautaray","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/72.182690","article-title":"Glove-Talk: A neural network interface between a data-glove and a speech synthesizer","volume":"4","author":"Fels","year":"1993","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_16","first-page":"1","article-title":"Interactive hand pose estimation using a stretch-sensing soft glove","volume":"38","author":"Glauser","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3398069","article-title":"Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems","volume":"27","author":"Thieme","year":"2020","journal-title":"ACM Trans. Computer-Hum. Interact."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Desmet, P., Xue, H., Xin, X., and Liu, W. (2022, January 24\u201328). Emotion deep dive for designers: Seven propositions that operationalize emotions in design innovation. Proceedings of the International Conference on Applied Human Factors and Ergonomics. AHFE International, New York, NY, USA.","DOI":"10.54941\/ahfe1001519"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Jing, Y., Jiang, M., Zhang, Z., Wang, D., and Liu, W. (2021). A Experimental Study of the Cognitive Load of In-vehicle Multiscreen Connected HUD. International Conference on Human-Computer Interaction, Springer.","DOI":"10.1007\/978-3-030-78227-6_20"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.vrih.2021.12.005","article-title":"Designing Generation Y Interactions: The Case of YPhone","volume":"4","author":"Liu","year":"2022","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_21","first-page":"32","article-title":"Designing products with added emotional value: Development and application of an approach for research through design","volume":"4","author":"Desmet","year":"2001","journal-title":"Des. J."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gray, C.M., Chivukula, S.S., and Lee, A. (2020, January 6\u201310). What Kind of Work Do \u201cAsshole Designers\u201d Create? Describing Properties of Ethical Concern on Reddit. Proceedings of the ACM Designing Interactive Systems Conference, Eindhoven, The Netherlands.","DOI":"10.1145\/3357236.3395486"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xin, X., Wang, Y., Xiang, G., Yang, W., and Liu, W. (2021, January 16\u201317). Effectiveness of Multimodal Display in Navigation Situation. Proceedings of the Ninth International Symposium of Chinese CHI, Online.","DOI":"10.1145\/3490355.3490361"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1016\/j.optcom.2007.11.016","article-title":"Horizontal parallax distortion in toed-in camera with wide-angle lens for mobile device","volume":"281","author":"Kang","year":"2008","journal-title":"Opt. Commun."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1049\/iet-ipr.2017.0037","article-title":"Local similarity refinement of shape-preserved warping for parallax-tolerant image stitching","volume":"12","author":"Li","year":"2018","journal-title":"IET Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"105579","DOI":"10.1016\/j.compag.2020.105579","article-title":"Real-time 3D unstructured environment reconstruction utilizing VR and Kinect-based immersive teleoperation for agricultural field robots","volume":"175","author":"Chen","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42979-021-00485-z","article-title":"An Efficient Sign Language Recognition (SLR) System Using Camshift Tracker and Hidden Markov Model (HMM)","volume":"2","author":"Roy","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1080\/10447318.2021.1948687","article-title":"How Post 90\u2019s Gesture Interact with Automobile Skylight","volume":"38","author":"Zhu","year":"2022","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/j.compind.2018.03.035","article-title":"ABC algorithm based optimization of 1-D hidden Markov model for hand gesture recognition applications","volume":"99","author":"Sagayam","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1177\/1077800418809455","article-title":"Thinking about Data with Grounded Theory","volume":"25","author":"Charmaz","year":"2019","journal-title":"Qual. Inq."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1134\/S1054661816020164","article-title":"Indian sign language recognition using SVM","volume":"26","author":"Raheja","year":"2016","journal-title":"Pattern Recognit. Image Anal."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kishore, P.V.V., Prasad, M.V., Prasad, C.R., and Rahul, R. (2015, January 2\u20133). 4-Camera model for sign language recognition using elliptical fourier descriptors and ANN. Proceedings of the International Conference on Signal Processing and Communication Engineering Systems, Vijayjawada, India.","DOI":"10.1109\/SPACES.2015.7058288"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Thang, P.Q., Dung, N.D., and Thuy, N.T. (2017, January 13\u201316). A comparison of SimpSVM and RVM for sign language recognition. Proceedings of the International Conference on Machine Learning and Soft Computing, Ho Chi Minh City, Vietnam.","DOI":"10.1145\/3036290.3036322"},{"key":"ref_34","unstructured":"Deng, C.X., Wang, G.B., and Yang, X.R. (2013, January 14\u201317). Image edge detection algorithm based on improved canny operator. Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, Tianjin, China."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, H., Qin, G., and Wang, X. (2010, January 16\u201318). Improvement of canny algorithm based on pavement edge detection. Proceedings of the 3rd International Congress on Image and Signal Processing, Yantai, China.","DOI":"10.1109\/CISP.2010.5646923"},{"key":"ref_36","first-page":"347","article-title":"Comparative analysis between different edge detection techniques on mammogram images using PSNR and MSE","volume":"43","author":"Saxena","year":"2022","journal-title":"J. Inf. Optim. Sci."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/7\/198\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:40:40Z","timestamp":1760139640000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/7\/198"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,29]]},"references-count":36,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["fi14070198"],"URL":"https:\/\/doi.org\/10.3390\/fi14070198","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2022,6,29]]}}}