{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:09:38Z","timestamp":1760148578660,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100019065","name":"Tianjin Science and Technology Plan Project","doi-asserted-by":"publisher","award":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"],"award-info":[{"award-number":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"]}],"id":[{"id":"10.13039\/501100019065","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Tianjin Research Innovation for Postgraduate Students","award":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"],"award-info":[{"award-number":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"]}]},{"name":"Tianjin Municipal Education Commission Scientific Research Program Project","award":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"],"award-info":[{"award-number":["22ZYCGSN00480","2022SKY284","2022ZD035","2021KJ011","2022ZD009"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Gait recognition is one of the important research directions of biometric authentication technology. However, in practical applications, the original gait data is often short, and a long and complete gait video is required for successful recognition. Also, the gait images from different views have a great influence on the recognition effect. To address the above problems, we designed a gait data generation network for expanding the cross-view image data required for gait recognition, which provides sufficient data input for feature extraction branching with gait silhouette as the criterion. In addition, we propose a gait motion feature extraction network based on regional time-series coding. By independently time-series coding the joint motion data within different regions of the body, and then combining the time-series data features of each region with secondary coding, we obtain the unique motion relationships between regions of the body. Finally, bilinear matrix decomposition pooling is used to fuse spatial silhouette features and motion time-series features to obtain complete gait recognition under shorter time-length video input. We use the OUMVLP-Pose and CASIA-B datasets to validate the silhouette image branching and motion time-series branching, respectively, and employ evaluation metrics such as IS entropy value and Rank-1 accuracy to demonstrate the effectiveness of our design network. Finally, we also collect gait-motion data in the real world and test them in a complete two-branch fusion network. The experimental results show that the network we designed can effectively extract the time-series features of human motion and achieve the expansion of multi-view gait data. The real-world tests also prove that our designed method has good results and feasibility in the problem of gait recognition with short-time video as input data.<\/jats:p>","DOI":"10.3390\/e25060837","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T10:51:56Z","timestamp":1684839116000},"page":"837","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Regional Time-Series Coding Network and Multi-View Image Generation Network for Short-Time Gait Recognition"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8190-0120","authenticated-orcid":false,"given":"Wenhao","family":"Sun","sequence":"first","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangda","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuangzhuang","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tinghang","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuanping","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Han","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"},{"name":"Tianjin Key Laboratory of Information Sensing & Intelligent Control, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9575","DOI":"10.1109\/JSEN.2019.2928777","article-title":"Deep learning for monitoring of human gait: A review","volume":"19","author":"Alharthi","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_2","first-page":"264","article-title":"Deep gait recognition: A survey","volume":"45","author":"Etemad","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"107069","DOI":"10.1016\/j.patcog.2019.107069","article-title":"A model-based gait recognition method with body pose and human prior knowledge","volume":"98","author":"Liao","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3653","DOI":"10.1007\/s11227-020-03409-5","article-title":"Gait recognition for person re-identification","volume":"77","author":"Elharrouss","year":"2021","journal-title":"J. Supercomput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e12541","DOI":"10.1111\/exsy.12541","article-title":"A multilevel paradigm for deep convolutional neural network features selection with an application to human gait recognition","volume":"39","author":"Arshad","year":"2022","journal-title":"Expert Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.patcog.2019.04.023","article-title":"A comprehensive study on gait biometrics using a joint CNN-based method","volume":"93","author":"Zhang","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"167830","DOI":"10.1109\/ACCESS.2020.3022818","article-title":"Latest research trends in gait analysis using wearable sensors and machine learning: A systematic review","volume":"8","author":"Saboor","year":"2020","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.medengphy.2020.11.005","article-title":"Gait analysis in neurological populations: Progression in the use of wearables","volume":"87","author":"Celik","year":"2021","journal-title":"Med. Eng. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Prasanth, H., Caban, M., Keller, U., Courtine, G., Ijspeert, A., Vallery, H., and Von Zitzewitz, J. (2021). Wearable sensor-based real-time gait detection: A systematic review. Sensors, 21.","DOI":"10.3390\/s21082727"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1109\/TPAMI.2003.1251144","article-title":"Silhouette analysis-based gait recognition for human identification","volume":"25","author":"Wang","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/j.patrec.2009.04.012","article-title":"Frame difference energy image for gait recognition with incomplete silhouettes","volume":"30","author":"Chen","year":"2009","journal-title":"Pattern Recognit. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"27061","DOI":"10.1007\/s11042-018-5904-x","article-title":"Efficient classification of the hyperspectral images using deep learning","volume":"77","author":"Singh","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kortli, Y., Jridi, M., Al Falou, A., and Atri, M. (2020). Face recognition systems: A survey. Sensors, 20.","DOI":"10.3390\/s20020342"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bhushan, S., Alshehri, M., Keshta, I., Chakraverti, A.K., Rajpurohit, J., and Abugabah, A. (2022). An experimental analysis of various machine learning algorithms for hand gesture recognition. Electronics, 11.","DOI":"10.3390\/electronics11060968"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"131889","DOI":"10.1016\/j.chemosphere.2021.131889","article-title":"Quantitative estimation of soil properties using hybrid features and RNN variants","volume":"287","author":"Singh","year":"2022","journal-title":"Chemosphere"},{"key":"ref_16","unstructured":"Chao, H., He, Y., Zhang, J., and Feng, J. (February, January 27). Gaitset: Regarding gait as a set for cross-view gait recognition. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fan, C., Peng, Y., Cao, C., Liu, X., Hou, S., Chi, J., Huang, Y., Li, Q., and He, Z. (2020, January 13\u201319). Gaitpart: Temporal part-based model for gait recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01423"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gong, Z., Zhang, Y., Lu, D., and Wu, T. (2022). Vision-Based Quadruped Pose Estimation and Gait Parameter Extraction Method. Electronics, 11.","DOI":"10.3390\/electronics11223702"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Stenum, J., Rossi, C., and Roemmich, R.T. (2021). Two-dimensional video-based analysis of human gait using pose estimation. PLoS Comput. Biol., 17.","DOI":"10.1371\/journal.pcbi.1008935"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"121812","DOI":"10.1016\/j.physa.2019.121812","article-title":"Gait analysis and recognition prediction of the human skeleton based on migration learning","volume":"532","author":"Sun","year":"2019","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.neucom.2019.02.025","article-title":"Learning view invariant gait features with two-stream GAN","volume":"339","author":"Wang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TCSVT.2020.2975671","article-title":"Cross-view gait recognition using pairwise spatial transformer networks","volume":"31","author":"Xu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yu, S., Chen, H., Garcia Reyes, E.B., and Poh, N. (2017, January 21\u201326). Gaitgan: Invariant gait feature extraction using generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.80"},{"key":"ref_24","first-page":"6000","article-title":"Attention is All You Need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/0304-4149(77)90052-7","article-title":"The estimation of a nonlinear moving average model","volume":"5","author":"Robinson","year":"1977","journal-title":"Stoch. Process. Appl."},{"key":"ref_27","first-page":"5243","article-title":"Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting","volume":"32","author":"Li","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3041","DOI":"10.1109\/TIP.2021.3055936","article-title":"Multi-view gait image generation for cross-view gait recognition","volume":"30","author":"Chen","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neunet.2013.11.006","article-title":"Batch gradient method with smoothing L1\/2 regularization for training of feedforward neural networks","volume":"50","author":"Wu","year":"2014","journal-title":"Neural Netw."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., RoyChowdhury, A., and Maji, S. (2015, January 7\u201313). Bilinear CNN models for fine-grained visual recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.170"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gao, Y., Beijbom, O., Zhang, N., and Darrell, T. (2016, January 27\u201330). Compact bilinear pooling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.41"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kong, S., and Fowlkes, C. (2017, January 21\u201326). Low-rank bilinear pooling for fine-grained classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.743"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yu, Z., Yu, J., Fan, J., and Tao, D. (2017, January 22\u201329). Multi-modal factorized bilinear pooling with co-attention learning for visual question answering. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.202"},{"key":"ref_34","unstructured":"Fu, Y., Wei, Y., Zhou, Y., Shi, H., Huang, G., Wang, X., Yao, Z., and Huang, T. (February, January 27). Horizontal pyramid matching for person re-identification. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1109\/TBIOM.2020.3008862","article-title":"Performance evaluation of model-based gait on multi-view very large population database with pose sequences","volume":"2","author":"An","year":"2020","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_36","unstructured":"Yu, S., Tan, D., and Tan, T. (2006, January 20\u201324). A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Fang, H.S., Xie, S., Tai, Y.W., and Lu, C. (2017, January 22\u201329). Rmpe: Regional multi-person pose estimation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.256"},{"key":"ref_39","unstructured":"Barratt, S., and Sharma, R. (2018). A note on the inception score. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e49","DOI":"10.1093\/bioinformatics\/btl242","article-title":"Integrating structured biological data by kernel maximum mean discrepancy","volume":"22","author":"Borgwardt","year":"2006","journal-title":"Bioinformatics"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.jprocont.2022.03.008","article-title":"A novel virtual sample generation method based on a modified conditional Wasserstein GAN to address the small sample size problem in soft sensing","volume":"113","author":"He","year":"2022","journal-title":"J. Process Control."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Huang, X., Zhu, D., Wang, H., Wang, X., Yang, B., He, B., Liu, W., and Feng, B. (2021, January 11\u201317). Context-sensitive temporal feature learning for gait recognition. Proceedings of the IEEE\/CVF International Conference on Computer Vision 2021, Venice, Italy.","DOI":"10.1109\/ICCV48922.2021.01267"},{"key":"ref_46","unstructured":"Shen, C., Lin, B., Zhang, S., Huang, G.Q., Yu, S., and Yu, X. (2022). Gait recognition with mask-based regularization. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/6\/837\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:40:28Z","timestamp":1760125228000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/6\/837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":46,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["e25060837"],"URL":"https:\/\/doi.org\/10.3390\/e25060837","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2023,5,23]]}}}