{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T13:05:09Z","timestamp":1785330309563,"version":"3.55.0"},"reference-count":35,"publisher":"Sociedade Brasileira de Computa\u00e7\u00e3o","issue":"1","license":[{"start":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T00:00:00Z","timestamp":1783814400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JIS"],"abstract":"<jats:p>This study presents the use of convolutional neural networks aimed at detecting and simultaneously translating continuous signs of Brazilian Sign Language (LIBRAS) in videos captured by common computer cameras. The objective of this work was to propose a methodology that enabled the classification of signs performed by people of different genders, body types, and skin tones, with minimal interference from the video background while using cameras of medium or low quality, creating an accessible approach for various applications. For this purpose, the MediaPipe algorithm was used for video data extraction, the FastDTW algorithm was employed for data standardization, convolutional neural networks were implemented using the TensorFlow and Keras libraries for sign recognition, and a custom dataset was created to train the network. All these tools were integrated using the Python programming language to produce a model for real-time classification of continuous LIBRAS signals.<\/jats:p>","DOI":"10.5753\/jis.2026.6369","type":"journal-article","created":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T12:24:35Z","timestamp":1785327875000},"page":"674-683","source":"Crossref","is-referenced-by-count":0,"title":["Use of Neural Networks to Classify Real Time Signs From Brazilian Sign Language"],"prefix":"10.5753","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9303-0441","authenticated-orcid":false,"given":"Luciano Alves","family":"Cardona Junior","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5313-4593","authenticated-orcid":false,"given":"Anselmo Rafael","family":"Cukla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0050-3527","authenticated-orcid":false,"given":"Solon","family":"Bevilacqua","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7952-1049","authenticated-orcid":false,"given":"Daniel Pinheiro","family":"Bernardon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4714-7849","authenticated-orcid":false,"given":"Daniel Fernando Tello","family":"Gamarra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"3742","published-online":{"date-parts":[[2026,7,12]]},"reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"Abdallah, E. E. and Fayyoumi, E. (2016). Assistive technology for deaf people based on android platform. Procedia Computer Science, 94:295\u2013301. DOI: https:\/\/doi.org\/10.1016\/j.procs.2016.08.044.","DOI":"10.1016\/j.procs.2016.08.044"},{"key":"2","unstructured":"Almeida, S. G. M., Rezende, T. M., Almeida, G. T. B., Toffolo, A. C. R., and Guimar\u00e3es, F. G. (2019). Minds-libras dataset. Zenodo. DOI: https:\/\/doi.org\/10.5281\/zenodo.2667329."},{"key":"3","doi-asserted-by":"crossref","unstructured":"Antunes, D. R., Guimar\u00e3es, C., Garc\u00eda, L. S., Oliveira, L. E. S., and Fernandes, S. (2011). A framework to support development of sign language humancomputer interaction: Building tools for effective information access and inclusion of the deaf. In 2011 Fifth International Conference on Research Challenges in Information Science, pages 1\u201312. DOI: https:\/\/doi.org\/10.1016\/10.1109\/RCIS.2011.6006832.","DOI":"10.1109\/RCIS.2011.6006832"},{"key":"4","doi-asserted-by":"crossref","unstructured":"Badhe, P. C. and Kulkarni, V. (2015). Indian sign language translator using gesture recognition algorithm. In 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS), pages 195\u2013200. DOI: https:\/\/doi.org\/10.1109\/CGVIS.2015.7449921.","DOI":"10.1109\/CGVIS.2015.7449921"},{"key":"5","doi-asserted-by":"crossref","unstructured":"Bastos, I. L., Angelo, M. F., and Loula, A. C. (2015). Recognition of static gestures applied to brazilian sign language (libras). In 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images, pages 305\u2013312. DOI: https:\/\/doi.org\/10.1109\/SIBGRAPI.2015.26.","DOI":"10.1109\/SIBGRAPI.2015.26"},{"key":"6","doi-asserted-by":"crossref","unstructured":"Bhamidipati, V. S. P., Saxena, I., Saisanthiya, D., and Retnadhas, M. (2023). Robust intelligent posture estimation for an ai gym trainer using mediapipe and opencv. In 2023 International Conference on Networking and Communications (ICNWC), pages 1\u20137. DOI: https:\/\/doi.org\/10.1109\/ICNWC57852.2023.10127264.","DOI":"10.1109\/ICNWC57852.2023.10127264"},{"key":"7","unstructured":"Brasil (2005). Decreto n\u00ba 5.626, de 22 de dezembro de 2005. Di\u00e1rio Oficial da Uni\u00e3o. Regulamenta a Lei n\u00ba 10.436, de 24 de abril de 2002, que disp\u00f5e sobre a L\u00edngua Brasileira de Sinais - Libras, e o art. 18 da Lei n\u00ba 10.098, de 19 de dezembro de 2000."},{"key":"8","unstructured":"Brasil (2015). Lei n\u00ba 13.146, de 6 de julho de 2015. Di\u00e1rio Oficial da Uni\u00e3o. Institui a Lei Brasileira da Inclus\u00e3o da Pessoa com Defici\u00eancia. [<a href=\"https:\/\/www.planalto.gov.br\/ccivil_03\/_ato2015-2018\/2015\/lei\/l13146.htm\" target=\"_blank\">link<\/a>]. Accessed on 07 July 2026."},{"key":"9","doi-asserted-by":"crossref","unstructured":"Carvalho, G., Brand\u00e3o, A., and Ferreira, F. (2021). Handarch: A deep learning architecture for libras hand configuration recognition. In Anais do XVII Workshop de Vis\u00e3o Computacional, pages 19\u201324, Porto Alegre, RS, Brasil. SBC. DOI: https:\/\/doi.org\/10.5753\/wvc.2021.18883.","DOI":"10.5753\/wvc.2021.18883"},{"key":"10","doi-asserted-by":"crossref","unstructured":"Castro, S. S., Lef\u00e8vre, F., Lef\u00e8vre, A. M. C., and Cesar, C. L. G. (2011). Acessibilidade aos servi\u00e7os de sa\u00fade por pessoas com defici\u00eancia. Revista de Sa\u00fade P\u00fablica, 45(1):99\u2013105. DOI: https:\/\/doi.org\/10.1590\/S0034-89102010005000048.","DOI":"10.1590\/S0034-89102010005000048"},{"key":"11","doi-asserted-by":"crossref","unstructured":"Corr\u00eaa, Y., Maristela, C., Santarosa, L., and Biazus, M. C. (2014). Aplicativos de tradu\u00e7\u00e3o para libras e a busca pela validade social da tecnologia assistiva. In XXV Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educa\u00e7\u00e3o, page 164. DOI: https:\/\/doi.org\/10.5753\/cbie.sbie.2014.164.","DOI":"10.5753\/cbie.sbie.2014.164"},{"key":"12","doi-asserted-by":"crossref","unstructured":"Costa, A. P., Diniz, E., Sales, E., Coelho, F., Costa, W. C., and Sousa, L. (2024). Usabilidade de um aplicativo de libras para educa\u00e7\u00e3o e governan\u00e7a em uma cidade amaz\u00f4nica. In Anais do XXXV Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educa\u00e7\u00e3o, pages 1248\u20131262, Porto Alegre, RS, Brasil. SBC. DOI: https:\/\/doi.org\/10.5753\/sbie.2024.242459.","DOI":"10.5753\/sbie.2024.242459"},{"key":"13","doi-asserted-by":"crossref","unstructured":"Courtin, C. (2000). The impact of sign language on the cognitive development of deaf children: The case of theories of mind. The Journal of Deaf Studies and Deaf Education, 5(3):266\u2013276. DOI: https:\/\/doi.org\/10.1093\/deafed\/5.3.266.","DOI":"10.1093\/deafed\/5.3.266"},{"key":"14","doi-asserted-by":"crossref","unstructured":"C\u00f3rdova, G. D. (2018). L\u00edngua de heran\u00e7a: L\u00edngua brasileira de sinais \u2013 livro de ronice m\u00fcller de quadros. Pensares em Revista, 13. DOI: https:\/\/doi.org\/10.12957\/pr.2018.33402.","DOI":"10.12957\/pr.2018.33402"},{"key":"15","doi-asserted-by":"crossref","unstructured":"De Oliveira Feliciano, F. D., De Andrade Briano, A., Prudencio, R. B. C., and Alves, E. C. (2023). Recognition of static or dynamic libras words in complex background environments. In 2023 18th Iberian Conference on Information Systems and Technologies (CISTI), pages 1\u20134. DOI: https:\/\/doi.org\/10.23919\/CISTI58278.2023.10211498.","DOI":"10.23919\/CISTI58278.2023.10211498"},{"key":"16","doi-asserted-by":"crossref","unstructured":"Dias, T. S., Junior, J. J. A. M., and Pichorim, S. F. (2024). Classification of brazilian sign language gestures based on recurrent neural networks models, with instrumented glove. In Marques, J. L. B., Rodrigues, C. R., Suzuki, D. O. H., Marino Neto, J., and Garc\u00eda Ojeda, R., editors, IX Latin American Congress on Biomedical Engineering and XXVIII Brazilian Congress on Biomedical Engineering, pages 611\u2013620, Cham. Springer Nature Switzerland. DOI: https:\/\/doi.org\/10.1007\/978-3-031-49407-9_61.","DOI":"10.1007\/978-3-031-49407-9_61"},{"key":"17","doi-asserted-by":"crossref","unstructured":"Figueiredo, A., Guarisi, A., Valinho, C., Marcelino, G., and Souza, V. (2025). De sinais a texto: Um sistema inteligente para tradu\u00e7\u00e3o autom\u00e1tica de libras com foco na inclus\u00e3o educacional. In Anais do XXXVI Simp\u00f3sio Brasileiro de Inform\u00e1tica na Educa\u00e7\u00e3o, pages 1489\u20131496, Porto Alegre, RS, Brasil. SBC. DOI: https:\/\/doi.org\/10.5753\/sbie.2025.12170.","DOI":"10.5753\/sbie.2025.12170"},{"key":"18","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning. MIT Press, Cambridge, MA, USA. ISBN: 978-0262035613."},{"key":"19","doi-asserted-by":"crossref","unstructured":"Hommes, R. E., Borash, A. I., Hartwig, K., and DeGracia, D. (2018). American sign language interpreters perceptions of barriers to healthcare communication in deaf and hard of hearing patients. Journal of Community Health, 43:956\u2013961. DOI: https:\/\/doi.org\/10.1007\/s10900-018-0511-3.","DOI":"10.1007\/s10900-018-0511-3"},{"key":"20","unstructured":"Instituto Brasileiro de Geografia e Estat\u00edstica (2019). Pesquisa nacional de sa\u00fade. [<a href=\"https:\/\/www.ibge.gov.br\/estatisticas\/sociais\/saude\" target=\"_blank\">link<\/a>]. Accessed on 07 July 2026."},{"key":"21","doi-asserted-by":"crossref","unstructured":"Li, D., Opazo, C. R., Yu, X., and Li, H. (2020). Word-level deep sign language recognition from video: A new large-scale dataset and methods comparison. In 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 1448\u20131458. DOI: https:\/\/doi.org\/10.1109\/WACV45572.2020.9093512.","DOI":"10.1109\/WACV45572.2020.9093512"},{"key":"22","unstructured":"Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C., Yong, M. G., Lee, J., Chang, W., Hua, W., Georg, M., and Grundmann, M. (2019). Mediapipe: A framework for building perception pipelines. CoRR, abs\/1906.08172. DOI: https:\/\/doi.org\/10.48550\/arXiv.1906.08172."},{"key":"23","doi-asserted-by":"crossref","unstructured":"Palavissini, C. F. C., Lima, K. R. L. d., Castro, L. P. V. d., and Lima, D. F. d. (2021). Digital information and communication technologies on the acquisition of scientific knowledge to deaf students: an integrative literature review. Research, Society and Development, 10(16). DOI: https:\/\/doi.org\/10.33448\/rsd-v10i16.23998.","DOI":"10.33448\/rsd-v10i16.23998"},{"key":"24","doi-asserted-by":"crossref","unstructured":"Peixoto, J. S., Cukla, A. R., Welfer, D., and Gamarra, D. F. T. (2022). Comparison of different processing methods of joint coordinates features for gesture recognition with a rnn in the msrc-12. In Abraham, A., Gandhi, N., Hanne, T., Hong, T.-P., Nogueira Rios, T., and Ding, W., editors, Intelligent Systems Design and Applications, pages 498\u2013507, Cham. Springer International Publishing. DOI: https:\/\/doi.org\/10.1007\/978-3-030-96308-8_46.","DOI":"10.1007\/978-3-030-96308-8_46"},{"key":"25","doi-asserted-by":"crossref","unstructured":"Peixoto, J. S., Pfitscher, M., de Souza Leite Cuadros, M. A., Welfer, D., and Gamarra, D. F. T. (2021). Comparison of different processing methods of joint coordinates features for gesture recognition with a cnn in the msrc-12 database. In Abraham, A., Piuri, V., Gandhi, N., Siarry, P., Kaklauskas, A., and Madureira, A., editors, Intelligent Systems Design and Applications, pages 590\u2013599, Cham. Springer International Publishing. DOI: https:\/\/doi.org\/10.1007\/978-3-030-71187-0_54.","DOI":"10.1007\/978-3-030-71187-0_54"},{"key":"26","unstructured":"Quadros, R. M. D. and Karnopp, L. B. (2007). L\u00edngua de sinais brasileira: estudos ling\u00fc\u00edsticos. Biblioteca Artmed. Ling\u00fc\u00edstica. Artmed, S\u00e3o Paulo. ISBN: 9788536303086. [<a href=\"http:\/\/bds.unb.br\/handle\/123456789\/948\" target=\"_blank\">link<\/a>]. Accessed on 11 July 2026."},{"key":"27","doi-asserted-by":"crossref","unstructured":"Rastgoo, R., Kiani, K., and Escalera, S. (2021). Sign language recognition: A deep survey. Expert Systems with Applications, 164:113794. DOI: https:\/\/doi.org\/10.1016\/j.eswa.2020.113794.","DOI":"10.1016\/j.eswa.2020.113794"},{"key":"28","doi-asserted-by":"crossref","unstructured":"Rocha, J., Lensk, J., Ferreira, T., and Ferreira, M. (2020). Towards a tool to translate brazilian sign language (libras) to brazilian portuguese and improve communication with deaf. In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), pages 1\u20134. DOI: https:\/\/doi.org\/10.1109\/VL\/HCC50065.2020.9127257.","DOI":"10.1109\/VL\/HCC50065.2020.9127257"},{"key":"29","unstructured":"Rodrigues, A. and Zanchettin, C. (2024). V-librasil - a new dataset with signs in brazilian sign language (libras). IEEE Dataport. DOI: https:\/\/doi.org\/10.21227\/v589-hn68."},{"key":"30","doi-asserted-by":"crossref","unstructured":"Rumjanek, V. and da Silva, W. (2019). Ci\u00eancia para todos? Revista Brasileira de P\u00f3s-Gradua\u00e7\u00e3o, 15:1\u201320. DOI: https:\/\/doi.org\/10.21713\/rbpg.v15i34.1606.","DOI":"10.21713\/rbpg.v15i34.1606"},{"key":"31","doi-asserted-by":"crossref","unstructured":"Salvador, S. and Chan, P. (2007). Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis, 11(5):561\u2013580. DOI: https:\/\/doi.org\/10.3233\/IDA-2007-11508.","DOI":"10.3233\/IDA-2007-11508"},{"key":"32","doi-asserted-by":"crossref","unstructured":"Sarmento, A. H. d. A. and Ponti, M. A. (2023). A cross-dataset study on the brazilian sign language translation. In IEEE\/CVF International Conference on Computer Vision Workshops - ICCVW. IEEE. DOI: https:\/\/doi.org\/10.1109\/ICCVW60793.2023.00300.","DOI":"10.1109\/ICCVW60793.2023.00300"},{"key":"33","doi-asserted-by":"crossref","unstructured":"Silva, D., Araujo, T., R\u00eago, T., Brand\u00e3o, M., and Gon\u00e7alves, L. (2023). A multiple stream architecture for the recognition of signs in brazilian sign language in the context of health. Multimedia Tools and Applications, 83. DOI: https:\/\/doi.org\/10.1007\/s11042-023-16332-7.","DOI":"10.1007\/s11042-023-16332-7"},{"key":"34","doi-asserted-by":"crossref","unstructured":"Stopa, S. R., Szwarcwald, C. L., Oliveira, M. M. d., Gouvea, E. d. C. D. P., Vieira, M. L. F. P., Freitas, M. P. S. d., Sardinha, L. M. V., and Mac\u00e1rio, E. M. (2020). Pesquisa nacional de sa\u00fade 2019: hist\u00f3rico, m\u00e9todos e perspectivas. Epidemiologia e Servi\u00e7os de Sa\u00fade, 29(5):e2020315. DOI: https:\/\/doi.org\/10.1590\/S1679-49742020000500004.","DOI":"10.1590\/s1679-49742020000500004"},{"key":"35","doi-asserted-by":"crossref","unstructured":"Trotta, T., Rocha, L., de Andrade, T. R., de Paiva Guimar\u00e3es, M., and Dias, D. R. C. (2022). C-libras: A gesture recognition app for the brazilian sign language. In Gervasi, O., Murgante, B., Hendrix, E. M. T., Taniar, D., and Apduhan, B. O., editors, Computational Science and Its Applications \u2013 ICCSA 2022, pages 603\u2013618, Cham. Springer International Publishing. DOI: https:\/\/doi.org\/10.1007\/978-3-031-10522-7_41.","DOI":"10.1007\/978-3-031-10522-7_41"}],"container-title":["Journal on Interactive Systems"],"original-title":[],"link":[{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/download\/6369\/4150","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/download\/6369\/4150","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T12:24:44Z","timestamp":1785327884000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jis\/article\/view\/6369"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,12]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,1]]}},"URL":"https:\/\/doi.org\/10.5753\/jis.2026.6369","relation":{},"ISSN":["2763-7719"],"issn-type":[{"value":"2763-7719","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,12]]}}}