{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T15:55:20Z","timestamp":1788018920101,"version":"build-2784847793"},"reference-count":39,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T00:00:00Z","timestamp":1648512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["NSERC Discovery Grant 10007544"],"award-info":[{"award-number":["NSERC Discovery Grant 10007544"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["NSERC Strategic Partnership Grant 10022972"],"award-info":[{"award-number":["NSERC Strategic Partnership Grant 10022972"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Innovation for Defense Excellence and Security Network","award":["There is no grant number for the partial funding of the project."],"award-info":[{"award-number":["There is no grant number for the partial funding of the project."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Over the past decade, gait recognition had gained a lot of attention in various research and industrial domains. These include remote surveillance, border control, medical rehabilitation, emotion detection from posture, fall detection, and sports training. The main advantages of identifying a person by their gait include unobtrusiveness, acceptance, and low costs. This paper proposes a convolutional neural network KinectGaitNet for Kinect-based gait recognition. The 3D coordinates of each of the body joints over the gait cycle are transformed to create a unique input representation. The proposed KinectGaitNet is trained directly using the 3D input representation without the necessity of the handcrafted features. The KinectGaitNet design allows avoiding gait cycle resampling, and the residual learning method ensures high accuracy without the degradation problem. The proposed deep learning architecture surpasses the recognition performance of all state-of-the-art methods for Kinect-based gait recognition by achieving 96.91% accuracy on UPCV and 99.33% accuracy on the KGB dataset. The method is the first, to the best of our knowledge, deep learning-based architecture that is based on a unique 3D input representation of joint coordinates. It achieves performance higher than previous traditional and deep learning methods, with fewer parameters and shorter inference time.<\/jats:p>","DOI":"10.3390\/s22072631","type":"journal-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T21:45:51Z","timestamp":1648590351000},"page":"2631","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["KinectGaitNet: Kinect-Based Gait Recognition Using Deep Convolutional Neural Network"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1850-4816","authenticated-orcid":false,"given":"A. S. M. Hossain","family":"Bari","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Calgary, Calgary, AB T2N 1N4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5338-1834","authenticated-orcid":false,"given":"Marina L.","family":"Gavrilova","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Calgary, Calgary, AB T2N 1N4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TCSVT.2003.818349","article-title":"An introduction to biometric recognition","volume":"14","author":"Jain","year":"2004","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"259","DOI":"10.4218\/etrij.11.1510.0068","article-title":"Automated markerless analysis of human gait motion for recognition and classification","volume":"33","author":"Yoo","year":"2011","journal-title":"Etri J."},{"key":"ref_3","unstructured":"Gafurov, D. (2007, January 19\u201321). A survey of biometric gait recognition: Approaches, security and challenges. Proceedings of the Annual Norwegian Computer Science Conference, Oslo, Norway."},{"key":"ref_4","unstructured":"Preis, J., Kessel, M., Werner, M., and Linnhoff-Popien, C. (2012, January 18). Gait recognition with kinect. Proceedings of the 1st International Workshop on Kinect in Pervasive Computing, New Castle, UK."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"24909","DOI":"10.1007\/s11042-018-5722-1","article-title":"View-invariant gait recognition based on kinect skeleton feature","volume":"77","author":"Sun","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/THMS.2014.2377111","article-title":"Human activity recognition process using 3-D posture data","volume":"45","author":"Gaglio","year":"2014","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.patrec.2015.06.020","article-title":"A framework for gait-based recognition using Kinect","volume":"68","author":"Kastaniotis","year":"2015","journal-title":"Pattern Recognit. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bhatia, Y., Bari, A., Hsu, G.S.J., and Gavrilova, M. (2022). Motion Capture Sensor-Based Emotion Recognition Using a Bi-Modular Sequential Neural Network. Sensors, 22.","DOI":"10.3390\/s22010403"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Suarez, J., and Murphy, R.R. (2012, January 5\u20138). Using the Kinect for search and rescue robotics. Proceedings of the International Symposium on Safety, Security, and Rescue Robotics, College Station, TX, USA.","DOI":"10.1109\/SSRR.2012.6523918"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gavrilova, M.L., Ahmed, F., Bari, A.H., Liu, R., Liu, T., Maret, Y., Sieu, B.K., and Sudhakar, T. (2021). Multi-modal motion-capture-based biometric systems for emergency response and patient rehabilitation. Research Anthology on Rehabilitation Practices and Therapy, IGI Global.","DOI":"10.4018\/978-1-7998-3432-8.ch032"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Monwar, M.M., Gavrilova, M., and Wang, Y. (2011, January 18\u201320). A novel fuzzy multimodal information fusion technology for human biometric traits identification. Proceedings of the IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC\u201911), Banff, AB, Canada.","DOI":"10.1109\/COGINF.2011.6016128"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chaaraoui, A.A., Padilla-L\u00f3pez, J.R., and Fl\u00f3rez-Revuelta, F. (2015, January 4\u20138). Abnormal gait detection with RGB-D devices using joint motion history features. Proceedings of the 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, Ljubljana, Slovenia.","DOI":"10.1109\/FG.2015.7284881"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2313","DOI":"10.1016\/j.jstrokecerebrovasdis.2017.05.019","article-title":"Effects of virtual reality training using Xbox Kinect on motor function in stroke survivors: A preliminary study","volume":"26","author":"Park","year":"2017","journal-title":"J. Stroke Cerebrovasc. Dis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.jbiomech.2004.05.002","article-title":"A machine learning approach for automated recognition of movement patterns using basic, kinetic and kinematic gait data","volume":"38","author":"Begg","year":"2005","journal-title":"J. Biomech."},{"key":"ref_15","unstructured":"Yanushkevich, S.N., Stoica, A., Srihari, S.N., Shmerko, V.P., and Gavrilova, M. (2004, January 14\u201316). Simulation of biometric information: The new generation of biometric systems. Proceedings of the International Workshop Modeling and Simulation in Biometric Technology, Calgary, AB, Canada."},{"key":"ref_16","first-page":"931","article-title":"Implementation of machine learning algorithms for gait recognition","volume":"23","author":"Kececi","year":"2020","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3840","DOI":"10.1109\/TCYB.2020.2983860","article-title":"Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification","volume":"50","author":"Sun","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"123649","DOI":"10.1109\/ACCESS.2020.3005687","article-title":"Deep facial diagnosis: deep transfer learning from face recognition to facial diagnosis","volume":"8","author":"Jin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial expression recognition using weighted mixture deep neural network based on double-channel facial images","volume":"6","author":"Yang","year":"2017","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"El-Fiqi, H., Wang, M., Salimi, N., Kasmarik, K., Barlow, M., and Abbass, H. (2018, January 7\u201310). Convolution neural networks for person identification and verification using steady state visual evoked potential. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00188"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1177\/0278364918770733","article-title":"The limits and potentials of deep learning for robotics","volume":"37","author":"Brock","year":"2018","journal-title":"Int. J. Robot. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.neucom.2015.09.116","article-title":"Deep learning for visual understanding: A review","volume":"187","author":"Guo","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"162708","DOI":"10.1109\/ACCESS.2019.2952065","article-title":"Artificial Neural Network Based Gait Recognition Using Kinect Sensor","volume":"7","author":"Bari","year":"2019","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Andersson, V.O., and de Ara\u00fajo, R.M. (2015, January 25\u201330). Person Identification Using Anthropometric and Gait Data from Kinect Sensor. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9212"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1007\/s00371-015-1092-0","article-title":"DTW-based kernel and rank-level fusion for 3D gait recognition using Kinect","volume":"31","author":"Ahmed","year":"2015","journal-title":"Vis. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.jvcir.2016.05.020","article-title":"Relative distance features for gait recognition with Kinect","volume":"39","author":"Yang","year":"2016","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Monti, R.P., Tootoonian, S., and Cao, R. (2018). Avoiding degradation in deep feed-forward networks by phasing out skip-connections. International Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/978-3-030-01424-7_44"},{"key":"ref_29","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.jbiomech.2013.11.031","article-title":"Accuracy and repeatability of joint angles measured using a single camera markerless motion capture system","volume":"47","author":"Schmitz","year":"2014","journal-title":"J. Biomech."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1007\/s40846-016-0184-2","article-title":"Evaluation of Kinect 3D sensor for healthcare imaging","volume":"36","author":"Harkness","year":"2016","journal-title":"J. Med Biol. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.gaitpost.2018.11.029","article-title":"Three-dimensional cameras and skeleton pose tracking for physical function assessment: A review of uses, validity, current developments and Kinect alternatives","volume":"68","author":"Clark","year":"2019","journal-title":"Gait Posture"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ball, A., Rye, D., Ramos, F., and Velonaki, M. (2012, January 5\u20138). Unsupervised clustering of people from \u2018skeleton\u2019data. Proceedings of the seventh annual ACM\/IEEE international conference on Human-Robot Interaction, Boston, MA, USA.","DOI":"10.1145\/2157689.2157767"},{"key":"ref_34","first-page":"89","article-title":"A Deep Neural Network Approach for Model-based Gait Recognition","volume":"17","author":"Nattee","year":"2019","journal-title":"Thai J. Math."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.neucom.2020.02.048","article-title":"Learning 3D spatiotemporal gait feature by convolutional network for person identification","volume":"397","author":"Hua","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_36","unstructured":"Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv."},{"key":"ref_37","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","unstructured":"Goodfellow, I.J., Warde-Farley, D., Mirza, M., Courville, A., and Bengio, Y. (2013). Maxout networks. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2631\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:45:55Z","timestamp":1760136355000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2631"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,29]]},"references-count":39,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072631"],"URL":"https:\/\/doi.org\/10.3390\/s22072631","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,29]]}}}