{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T15:58:27Z","timestamp":1782575907595,"version":"3.54.5"},"reference-count":53,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"Ministry of Education","doi-asserted-by":"publisher","award":["2021R1A1A03040177"],"award-info":[{"award-number":["2021R1A1A03040177"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Walking is an exercise that uses muscles and joints of the human body and is essential for understanding body condition. Analyzing body movements through gait has been studied and applied in human identification, sports science, and medicine. This study investigated a spatiotemporal graph convolutional network model (ST-GCN), using attention techniques applied to pathological-gait classification from the collected skeletal information. The focus of this study was twofold. The first objective was extracting spatiotemporal features from skeletal information presented by joint connections and applying these features to graph convolutional neural networks. The second objective was developing an attention mechanism for spatiotemporal graph convolutional neural networks, to focus on important joints in the current gait. This model establishes a pathological-gait-classification system for diagnosing sarcopenia. Experiments on three datasets, namely NTU RGB+D, pathological gait of GIST, and multimodal-gait symmetry (MMGS), validate that the proposed model outperforms existing models in gait classification.<\/jats:p>","DOI":"10.3390\/s22134863","type":"journal-article","created":{"date-parts":[[2022,6,28]],"date-time":"2022-06-28T00:07:02Z","timestamp":1656374822000},"page":"4863","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Pathological-Gait Recognition Using Spatiotemporal Graph Convolutional Networks and Attention Model"],"prefix":"10.3390","volume":"22","author":[{"given":"Jungi","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Automotive Lighting Convergence Engineering, Yeungnam University, Gyeongsan 38541, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9092-5837","authenticated-orcid":false,"given":"Haneol","family":"Seo","sequence":"additional","affiliation":[{"name":"Research Institute of Human Ecology, Yeungnam University, Gyeongsan 38541, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Tahir","family":"Naseem","sequence":"additional","affiliation":[{"name":"Research Institute of Human Ecology, Yeungnam University, Gyeongsan 38541, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9606-0646","authenticated-orcid":false,"given":"Chan-Su","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Yeungnam University, Gyeongsan 38541, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3230633","article-title":"A survey on gait recognition","volume":"51","author":"Wan","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1049\/iet-bmt.2018.5063","article-title":"Robust gait recognition: A comprehensive survey","volume":"8","author":"Rida","year":"2019","journal-title":"IET Biom."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3243043","article-title":"Gait-based person re-identification: A survey","volume":"52","author":"Nambiar","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Echterhoff, J.M., Haladjian, J., and Brugge, B. (2018, January 8\u201312). Gait and jump classification in modern equestrian sports. Proceedings of the ACM International Symposium on Wearable Computers, Singapore.","DOI":"10.1145\/3267242.3267267"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1109\/TNSRE.2019.2958679","article-title":"Accurate ambulatory gait analysis in walking and running using machine learning models","volume":"28","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Verlekar, T.T., Correia, P.L., and Soares, L.D. (2018, January 3\u20136). Using transfer learning for classification of gait pathologies. Proceedings of the International Conference on Bioinformatics and Biomedicine, Madrid, Spain.","DOI":"10.1109\/BIBM.2018.8621302"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3362","DOI":"10.3390\/s140203362","article-title":"Gait analysis methods: An overview of wearable and non-wearable systems, highlighting clinical applications","volume":"14","year":"2014","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/RBME.2018.2807182","article-title":"A review on accelerometry-based gait analysis and emerging clinical applications","volume":"11","author":"Jarchi","year":"2018","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"633","DOI":"10.5124\/jkma.2020.63.10.633","article-title":"Diagnosis of sarcopenia in primary health care","volume":"63","author":"Won","year":"2020","journal-title":"J. Korean Med. Assoc."},{"key":"ref_10","first-page":"415","article-title":"Association between muscular strengths and gait characteristics of elderly people aged 65 to 74 and 75 and above","volume":"21","author":"Back","year":"2020","journal-title":"J. Korea Acad.-Ind. Coop. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"161576","DOI":"10.1109\/ACCESS.2021.3131613","article-title":"Deep learning-based multimodal abnormal gait classification using a 3D skeleton and plantar foot pressure","volume":"9","author":"Jun","year":"2021","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.artmed.2018.12.007","article-title":"Normal and pathological gait classification LSTM model","volume":"94","author":"Khokhlova","year":"2018","journal-title":"Artif. Intell. Med."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Albuquerque, P., Machado, J.P., Verlekar, T.T., Correia, P.L., and Soares, L.D. (2021). Remote Gait type classification system using markerless 2D video. Diagnostics, 11.","DOI":"10.3390\/diagnostics11101824"},{"key":"ref_14","first-page":"231951722","article-title":"Deep Gait Recognition: A Survey","volume":"1","author":"Etemad","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1055\/s-0037-1604202","article-title":"Contactless and hassle free real time heart rate measurement with facial video","volume":"1","author":"Singh","year":"2017","journal-title":"J. Card. Crit. Care TSS"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lin, B., Zhang, S., and Bao, F. (2020, January 12\u201316). Gait Recognition with Multiple-Temporal-Scale 3D Convolutional Neural Network. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413861"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fan, C., Peng, Y., Cao, C., Liu, X., Hou, S., Chi, J., Huang, Y., Li, Q., and He, Z. (2020, January 13\u201319). Gaitpart: Temporal part-based model for gait recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01423"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hou, S., Cao, C., Liu, X., and Huang, Y. (2020, January 23\u201328). Gait lateral network: Learning discriminative and compact representations for gait recognition. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58545-7_22"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liao, R., Cao, C., Garcia, E.B., Yu, S., and Huang, Y. (2017). Pose-Based Temporal-Spatial Network (PTSN) for Gait Recognition with Carrying and Clothing Variations. Biometric Recognition, Springer.","DOI":"10.1007\/978-3-319-69923-3_51"},{"key":"ref_20","unstructured":"Li, N., Zhaoa, X., and Ma, C. (2020). JointsGait:a model-based gait recognition method based on gait graph convolutional networks and joints relationship pyramid mapping. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lee, D., Jun, K., Lee, S., Ko, J., and Kim, M.S. (2019, January 23\u201327). Abnormal gait recognition using 3D joint information of multiple Kinects system and RNN-LSTM. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8857607"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"19196","DOI":"10.1109\/ACCESS.2020.2967845","article-title":"Feature extraction using an RNN auto encoder for skeleton-based abnormal gait recognition","volume":"8","author":"Jun","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"139881","DOI":"10.1109\/ACCESS.2020.3013029","article-title":"Pathological Gait Classification Using Kinect v2 and Gated Recurrent Neural Networks","volume":"8","author":"Jun","year":"2020","journal-title":"IEEE Access"},{"key":"ref_24","unstructured":"Kipf, N.T., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TNN.2008.2005605","article-title":"The Graph Neural Network Model","volume":"20","author":"Scarselli","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_26","unstructured":"Sijie, Y., Xiong, Y., and Lin, D. (2018, January 4\u20136). Spatial temporal graph convolutional networks for skeleton-based action recognition. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107069","DOI":"10.1016\/j.patcog.2019.107069","article-title":"A model-based gait recognition method with body pose and human prior knowledge","volume":"98","author":"Liao","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_28","unstructured":"Thakkar, K., and Narayanan, P.J. (2018, January 3\u20136). Part-based graph convolutional network for action recognition. Proceedings of the BMVC 2018, Newcastle, UK."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9532","DOI":"10.1109\/TIP.2020.3028207","article-title":"Skeleton-based action recognition with multi-stream adaptive graph convolutional networks","volume":"29","author":"Shi","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","unstructured":"Mnih, V., Heess, N., Graves, A., and Kavukcuoglu, K. (2014, January 8\u201313). Recurrent models of visual attention. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., Albanie, S., Sun, G., and Wu, E. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017, January 21\u201326). Residual attention network for image classification. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.683"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 21\u201326). Deformable convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/ICCV.2017.89"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the 16th European Conference, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yang, J., Ren, P., Zhang, D., Chen, D., Wen, F., Li, H., and Hua, G. (2017, January 21\u201326). Neural aggregation network for video face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.554"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, T., Zheng, H., and Guo, G. (2020, January 13\u201319). Hierarchical pyramid diverse attention networks for face recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00835"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chu, X., Yang, W., Ouyang, W., Ma, C., Yuille, A.L., and Wang, X. (2017, January 21\u201326). Multi-context attention for human pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.601"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18\u201323). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1109\/TIP.2017.2778563","article-title":"Recurrent spatial-temporal attention network for action recognition in videos","volume":"27","author":"Du","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainzet, B. (2018, January 4\u20136). Attention u-net: Learning where to look for the pancreas. Proceedings of the Medical Imaging with Deep Learning 2018, Amsterdam, The Netherlands."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.patrec.2019.11.040","article-title":"Thorax disease classification with attention guided convolutional neural network","volume":"131","author":"Guan","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_42","unstructured":"Park, J., Woo, S., Lee, J.-Y., and Kweon, I.S. (2018, January 3\u20136). Bam: Bottleneck attention module. Proceedings of the BMVC 2018, Newcastle, UK."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional block attention module. Proceedings of the Computer Vision-ECCV 2018-15th European Conference, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hou, Q., Zhou, D., and Feng, J. (2021, January 20\u201325). Coordinate attention for efficient mobile network design. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01350"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Ding, X., Yang, K., and Chen, W. (2020, January 8\u201311). A Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition. Proceedings of the 2020 the 4th International Conference on Innovation in Artificial Intelligence, Xiamen, China.","DOI":"10.1145\/3390557.3394129"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1109\/TCSVT.2020.3015051","article-title":"Richly Activated Graph Convolutional Network for Robust Skeleton-Based Action Recognition","volume":"31","author":"Song","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Shi, L., Zhang, Y., Cheng, J., and Lu, H. (2019, January 15\u201320). Two-stream adaptive graph convolutional networks for skeleton-based action recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01230"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Si, C., Chen, W., Wang, W., Wang, L., and Tan, T. (2019, January 15\u201320). An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00132"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1109\/LRA.2021.3056361","article-title":"Pose Refinement Graph Convolutional Network for Skeleton-Based Action Recognition","volume":"6","author":"Li","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shahroudy, A., Liu, J., Ng, T.T., and Wang, G. (2016, January 27\u201330). NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.115"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"e1901862","DOI":"10.1002\/adhm.201901862","article-title":"Artificial Intelligence and Machine Learning in Computational Nanotoxicology: Unlocking and Empowering Nanomedicine","volume":"9","author":"Singh","year":"2020","journal-title":"Adv. Health Mater."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.neucom.2021.12.004","article-title":"Skeleton-based abnormal gait recognition with spatio-temporal attention enhanced gait-structural graph convolutional networks","volume":"473","author":"Tian","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4863\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:39:17Z","timestamp":1760139557000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4863"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":53,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134863"],"URL":"https:\/\/doi.org\/10.3390\/s22134863","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,27]]}}}