{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T03:18:25Z","timestamp":1761621505387,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,3,2]],"date-time":"2020-03-02T00:00:00Z","timestamp":1583107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["TIC-1692"],"award-info":[{"award-number":["TIC-1692"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006280","name":"Ministerio de Ciencia y Tecnolog\u00eda","doi-asserted-by":"publisher","award":["TIN2016-80920R"],"award-info":[{"award-number":["TIN2016-80920R"]}],"id":[{"id":"10.13039\/501100006280","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Gait recognition is being employed as an effective approach to identify people without requiring subject collaboration. Nowadays, developed techniques for this task are obtaining high performance on current datasets (usually more than     90 %     of accuracy). However, those datasets are simple as they only contain one subject in the scene at the same time. This fact limits the extrapolation of the results to real world conditions where, usually, multiple subjects are simultaneously present at the scene, generating different types of occlusions and requiring better tracking methods and models trained to deal with those situations. Thus, with the aim of evaluating more realistic and challenging situations appearing in scenarios with multiple subjects, we release a new framework (MuPeG) that generates augmented datasets with multiple subjects using existing datasets as input. By this way, it is not necessary to record and label new videos, since it is automatically done by our framework. In addition, based on the use of datasets generated by our framework, we propose an experimental methodology that describes how to use datasets with multiple subjects and the recommended experiments that are necessary to perform. Moreover, we release the first experimental results using datasets with multiple subjects. In our case, we use an augmented version of TUM-GAID and CASIA-B datasets obtained with our framework. In these augmented datasets the obtained accuracies are     54.8 %     and     42.3 %     whereas in the original datasets (single subject), the same model achieved     99.7 %     and     98.0 %     for TUM-GAID and CASIA-B, respectively. The performance drop shows clearly that the difficulty of datasets with multiple subjects in the scene is much higher than the ones reported in the literature for a single subject. Thus, our proposed framework is able to generate useful datasets with multiple subjects which are more similar to real life situations.<\/jats:p>","DOI":"10.3390\/s20051358","type":"journal-article","created":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T03:13:28Z","timestamp":1583205208000},"page":"1358","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["MuPeG\u2014The Multiple Person Gait Framework"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2365-6593","authenticated-orcid":false,"given":"Rub\u00e9n","family":"Delgado-Esca\u00f1o","sequence":"first","affiliation":[{"name":"Department of Computer Architecture, University of M\u00e1laga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7340-4976","authenticated-orcid":false,"given":"Francisco M.","family":"Castro","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture, University of M\u00e1laga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8993-1949","authenticated-orcid":false,"given":"Juli\u00e1n","family":"R. C\u00f3zar","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture, University of M\u00e1laga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9294-6714","authenticated-orcid":false,"given":"Manuel J.","family":"Mar\u00edn-Jim\u00e9nez","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Numerical Analysis, University of C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3431-6516","authenticated-orcid":false,"given":"Nicol\u00e1s","family":"Guil","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture, University of M\u00e1laga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Arsalan, M., Naqvi, R., Kim, D., Nguyen, P., Owais, M., and Park, K. (2018). IrisDenseNet: Robust iris segmentation using densely connected fully convolutional networks in the images by visible light and near-infrared light camera sensors. Sensors, 18.","DOI":"10.3390\/s18051501"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3418","DOI":"10.3390\/s120303418","article-title":"Improving fingerprint verification using minutiae triplets","volume":"12","year":"2012","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1145\/3230633","article-title":"A survey on gait recognition","volume":"51","author":"Wan","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s11760-011-0245-5","article-title":"Occlusion detection and gait silhouette reconstruction from degraded scenes","volume":"5","author":"Roy","year":"2011","journal-title":"Signal Image Video Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1049\/iet-cvi.2014.0170","article-title":"Modelling, synthesis and characterisation of occlusion in videos","volume":"9","author":"Roy","year":"2015","journal-title":"IET Comput. Vision"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s00138-016-0798-y","article-title":"Gait recognition from corrupted silhouettes: A robust statistical approach","volume":"28","author":"Ortells","year":"2017","journal-title":"Mach. Vision Appl."},{"key":"ref_7","unstructured":"Hofmann, M., Sural, S., and Rigoll, G. (2011). Gait recognition in the presence of occlusion: A new dataset and baseline algorithms. WSCG \u20192011: Communication Papers Proceedings, V\u00e1clav Skala\u2013UNION Agency."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1016\/j.patcog.2014.10.012","article-title":"Similar gait action recognition using an inertial sensor","volume":"48","author":"Ngo","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_9","first-page":"1897","article-title":"An End-to-End Multi-Task and Fusion CNN for Inertial-Based Gait Recognition","volume":"7","author":"Castro","year":"2018","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3603","DOI":"10.1016\/j.patcog.2012.03.008","article-title":"A cascade fusion scheme for gait and cumulative foot pressure image recognition","volume":"45","author":"Zheng","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2904","DOI":"10.1016\/j.patcog.2010.03.011","article-title":"Infrared gait recognition based on wavelet transform and support vector machine","volume":"43","author":"Xue","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1756002","DOI":"10.1142\/S021800141756002X","article-title":"Fisher motion descriptor for multiview gait recognition","volume":"31","author":"Castro","year":"2017","journal-title":"Inter. J. Pattern Recognit. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1007\/s00138-016-0767-5","article-title":"Multimodal features fusion for gait, gender and shoes recognition","volume":"27","author":"Castro","year":"2016","journal-title":"Mach. Vision Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1109\/TPAMI.2006.38","article-title":"Individual recognition using gait energy image","volume":"28","author":"Han","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Castro, F.M., Mar\u00edn-Jimenez, M.J., and Medina-Carnicer, R. (2014, January 24\u201328). Pyramidal fisher motion for multiview gait recognition. Proceedings of the 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.298"},{"key":"ref_16","unstructured":"Preis, J., Kessel, M., Werner, M., and Linnhoff-Popien, C. (2012, January 18). Gait recognition with Kinect. Proceedings of the 1st International Workshop on Kinect in Pervasive Computing, Newcastle, UK."},{"key":"ref_17","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2020, February 27). Available online: http:\/\/www.deeplearningbook.org."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hossain, E., and Chetty, G. (2013). Multimodal Feature Learning for Gait Biometric Based Human Identity Recognition. Neural Information Processing, Springer.","DOI":"10.1007\/978-3-642-42042-9_89"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yan, C., Zhang, B., and Coenen, F. (2015, January 14\u201316). Multi-attributes gait identification by convolutional neural networks. Proceedings of the International Congress on Image and Signal Processing (CISP), Shenyang, China.","DOI":"10.1109\/CISP.2015.7407957"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1960","DOI":"10.1109\/TMM.2015.2477681","article-title":"Learning Representative Deep Features for Image Set Analysis","volume":"17","author":"Wu","year":"2015","journal-title":"IEEE Trans. Multimed."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"G\u00e1lai, B., and Benedek, C. (2015, January 29\u201330). Feature selection for Lidar-based gait recognition. Proceedings of the 2015 International Workshop on Computational Intelligence for Multimedia Understanding (IWCIM), Prague, Czech Republic.","DOI":"10.1109\/IWCIM.2015.7347076"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Alotaibi, M., and Mahmood, A. (2015, January 13\u201315). Improved Gait recognition based on specialized deep convolutional neural networks. Proceedings of the IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, USA.","DOI":"10.1109\/AIPR.2015.7444550"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/TPAMI.2016.2545669","article-title":"A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs","volume":"39","author":"Wu","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Castro, F.M., Mar\u00edn-Jim\u00e9nez, M.J., Guil, N., and de la Blanca, N.P. (2020). Multimodal feature fusion for CNN-based gait recognition: An empirical comparison. Neural Comput. Appl.","DOI":"10.1007\/s00521-020-04811-z"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107069","DOI":"10.1016\/j.patcog.2019.107069","article-title":"A model-based gait recognition method with body pose and human prior knowledge","volume":"98","author":"Liao","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_26","unstructured":"Holden, D., Saito, J., Komura, T., and Joyce, T. (2020, February 27). Learning Motion Manifolds with Convolutional Autoencoders. Available online: http:\/\/www.ipab.inf.ed.ac.uk\/cgvu\/motioncnn.pdf."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1810","DOI":"10.1109\/ACCESS.2016.2557846","article-title":"Learning human identity from motion patterns","volume":"4","author":"Neverova","year":"2016","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mazzeo, P.L., Spagnolo, P., and Moeslund, T.B. (2014). The AVA Multi-View Dataset for Gait Recognition. Activity Monitoring by Multiple Distributed Sensing, Springer International Publishing. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-13323-2"},{"key":"ref_29","unstructured":"Yu, S., Tan, D., and Tan, T. (2006, January 20\u201324). A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China."},{"key":"ref_30","unstructured":"Tan, D., Huang, K., Yu, S., and Tan, T. (2006, January 20\u201324). Efficient Night Gait Recognition Based on Template Matching. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China."},{"key":"ref_31","unstructured":"Gross, R., and Shi, J. (2001). The CMU Motion of Body (MoBo) Database, Carnegie Mellon University. Technical Report CMU-RI-TR-01-18."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1109\/TIFS.2012.2204253","article-title":"The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition","volume":"7","author":"Iwama","year":"2012","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Takemura, N., Makihara, Y., Muramatsu, D., Echigo, T., and Yagi, Y. (2018). Multi-view large population gait dataset and its performance evaluation for cross-view gait recognition. IPSJ Trans. Comput. Vision Appl., 10.","DOI":"10.1186\/s41074-018-0039-6"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Matovski, D., Nixon, M., Mahmoodi, S., and Carter, J. (2012). The Effect of Time on Gait Recognition Performance. IEEE Trans. Inf. Forensics Secur., 7.","DOI":"10.1109\/TIFS.2011.2176118"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.jvcir.2013.02.006","article-title":"The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits","volume":"25","author":"Hofmann","year":"2014","journal-title":"J. Visual Commun. Image Represent."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"7884","DOI":"10.3390\/s130607884","article-title":"Gait-based person identification robust to changes in appearance","volume":"13","author":"Iwashita","year":"2013","journal-title":"Sensors"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1049\/iet-bmt.2016.0118","article-title":"View-invariant gait recognition system using a gait energy image decomposition method","volume":"6","author":"Verlekar","year":"2017","journal-title":"IET Biometrics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s13640-016-0126-5","article-title":"Gait recognition based on the golden ratio","volume":"2016","author":"Liang","year":"2016","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European conference on computer vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_40","unstructured":"Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., and Zisserman, A. (2020, February 27). The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. Available online: http:\/\/www.pascal-network.org\/challenges\/VOC\/voc2012\/workshop\/index.html."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Castro, F.M., Mar\u00edn-Jim\u00e9nez, M.J., Guil, N., and P\u00e9rez de la Blanca, N. (2017, January 14\u201316). Automatic Learning of Gait Signatures for People Identification. Proceedings of the Advances in Computational Intelligence (IWANN), Cadiz, Spain.","DOI":"10.1007\/978-3-319-59147-6_23"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., and Guadarrama, S. (2017, January 21\u201326). Speed\/accuracy trade-offs for modern convolutional object detectors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.351"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_44","unstructured":"Chollet, F. (2020, February 27). Keras. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_45","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2020, February 27). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/www.tensorflow.org\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1358\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:03:13Z","timestamp":1760173393000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1358"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,2]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20051358"],"URL":"https:\/\/doi.org\/10.3390\/s20051358","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,3,2]]}}}