{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T04:51:37Z","timestamp":1773377497183,"version":"3.50.1"},"reference-count":86,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2018,9,11]],"date-time":"2018-09-11T00:00:00Z","timestamp":1536624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2015R1D1A1A01056761"],"award-info":[{"award-number":["2015R1D1A1A01056761"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF- 2016M3A9E1915855"],"award-info":[{"award-number":["NRF- 2016M3A9E1915855"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the current field of human recognition, most of the research being performed currently is focused on re-identification of different body images taken by several cameras in an outdoor environment. On the other hand, there is almost no research being performed on indoor human recognition. Previous research on indoor recognition has mainly focused on face recognition because the camera is usually closer to a person in an indoor environment than an outdoor environment. However, due to the nature of indoor surveillance cameras, which are installed near the ceiling and capture images from above in a downward direction, people do not look directly at the cameras in most cases. Thus, it is often difficult to capture front face images, and when this is the case, facial recognition accuracy is greatly reduced. To overcome this problem, we can consider using the face and body for human recognition. However, when images are captured by indoor cameras rather than outdoor cameras, in many cases only part of the target body is included in the camera viewing angle and only part of the body is captured, which reduces the accuracy of human recognition. To address all of these problems, this paper proposes a multimodal human recognition method that uses both the face and body and is based on a deep convolutional neural network (CNN). Specifically, to solve the problem of not capturing part of the body, the results of recognizing the face and body through separate CNNs of VGG Face-16 and ResNet-50 are combined based on the score-level fusion by Weighted Sum rule to improve recognition performance. The results of experiments conducted using the custom-made Dongguk face and body database (DFB-DB1) and the open ChokePoint database demonstrate that the method proposed in this study achieves high recognition accuracy (the equal error rates of 1.52% and 0.58%, respectively) in comparison to face or body single modality-based recognition and other methods used in previous studies.<\/jats:p>","DOI":"10.3390\/s18093040","type":"journal-article","created":{"date-parts":[[2018,9,11]],"date-time":"2018-09-11T11:40:02Z","timestamp":1536666002000},"page":"3040","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["CNN-Based Multimodal Human Recognition in Surveillance Environments"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5904-3652","authenticated-orcid":false,"given":"Ja Hyung","family":"Koo","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pil-dong-ro, 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Se Woon","family":"Cho","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pil-dong-ro, 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Na Rae","family":"Baek","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pil-dong-ro, 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Min Cheol","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pil-dong-ro, 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang Ryoung","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pil-dong-ro, 1-gil, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2018,9,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","article-title":"Face Description with Local Binary Patterns: Application to Face Recognition","volume":"28","author":"Ahonen","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7\u201310). Deep Face Recognition. Proceedings of the British Machine Vision Conference, Swansea, UK.","DOI":"10.5244\/C.29.41"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1016\/S0031-3203(03)00061-X","article-title":"Full-body Person Recognition System","volume":"36","author":"Nakajima","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1109\/72.750575","article-title":"Face Recognition Using the Nearest Feature Line Method","volume":"10","author":"Li","year":"1999","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for Recognition","volume":"3","author":"Turk","year":"1991","journal-title":"J. Cogn. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.1364\/JOSAA.14.001724","article-title":"Discriminant Analysis for Recognition of Human Face Images","volume":"14","author":"Etemad","year":"1997","journal-title":"J. Opt. Soc. Am."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hong, H.G., Lee, M.B., and Park, K.R. (2017). Convolutional Neural Network-Based Finger-Vein Recognition Using NIR Image Sensors. Sensors, 17.","DOI":"10.3390\/s17061297"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2933","DOI":"10.3390\/s17122933","article-title":"Noisy Ocular Recognition Based on Three Convolutional Neural Networks","volume":"17","author":"Lee","year":"2017","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"13805","DOI":"10.1007\/s11042-016-3741-3","article-title":"Novel Descriptors for Geometrical 3D Face Analysis","volume":"76","author":"Marcolin","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12008-014-0244-1","article-title":"Cleft Lip Pathology Diagnosis and Foetal Landmark Extraction via 3D Geometrical Analysis","volume":"11","author":"Moos","year":"2017","journal-title":"Int. J. Interact. Des. Manuf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/79.911197","article-title":"Emotion Recognition in Human-computer Interaction","volume":"18","author":"Cowie","year":"2001","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","unstructured":"Tsapatsoulis, N., Doulamis, N., Doulamis, A., and Kollias, S. (1998, January 15). Face Extraction from Non-uniform Background and Recognition in Compressed Domain. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Seattle, WA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., Hong, H.G., Kim, K.W., and Park, K.R. (2017). Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal Cameras. Sensors, 17.","DOI":"10.3390\/s17030605"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1109\/TPAMI.2011.68","article-title":"Toward Development of a Face Recognition System for Watchlist Surveillance","volume":"33","author":"Lawson","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/JETCAS.2013.2256752","article-title":"Dynamic Bayesian Network for Unconstrained Face Recognition in Surveillance Camera Networks","volume":"3","author":"An","year":"2013","journal-title":"IEEE J. Emerg. Sel. Top. Circuits Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1007\/s11042-009-0417-2","article-title":"SCface\u2013Surveillance Cameras Face Database","volume":"51","author":"Grgic","year":"2011","journal-title":"Multimed. Tools Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Banerjee, S., and Das, S. (2016). Domain Adaptation with Soft-Margin Multiple Feature-Kernel Learning Beats Deep Learning for Surveillance Face Recognition. arXiv.","DOI":"10.1007\/978-3-319-68124-5_16"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M.A., and Wolf, L. (2014, January 23\u201328). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Antipov, G., Berrani, S.-A., Ruchaud, N., and Dugelay, J.-L. (2015, January 26\u201330). Learned vs. Hand-Crafted Features for Pedestrian Gender Recognition. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806332"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Layne, R., Hospedales, T.M., and Gong, S. (2012, January 7\u201313). Towards Person Identification and Re-Identification with Attributes. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.5244\/C.26.24"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., and Park, K.R. (2016). Body-Based Gender Recognition Using Images from Visible and Thermal Cameras. Sensors, 16.","DOI":"10.3390\/s16020156"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Figueira, D., Bazzani, L., Minh, H.Q., Cristani, M., Bernardino, A., and Murino, V. (2013, January 27\u201330). Semi-Supervised Multi-Feature Learning for Person Re-Identification. Proceedings of the 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, Krak\u00f3w, Poland.","DOI":"10.1109\/AVSS.2013.6636625"},{"key":"ref_24","unstructured":"Bak, S., Corvee, E., Br\u00e9mond, F., and Thonnat, M. (September, January 29). Person Re-Identification Using Spatial Covariance Regions of Human Body Parts. Proceedings of the 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, Boston, MA, USA."},{"key":"ref_25","unstructured":"Prosser, B., Zheng, W.-S., Gong, S., and Xiang, T. (September, January 31). Person Re-Identification by Support Vector Ranking. Proceedings of the British Machine Vision Conference, Aberystwyth, UK."},{"key":"ref_26","unstructured":"Chen, D., Yuan, Z., Chen, B., and Zheng, N. (July, January 26). Similarity Learning with Spatial Constraints for Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liao, S., Hu, Y., Zhu, X., and Li, S.Z. (2015, January 7\u201312). Person Re-Identification by Local Maximal Occurrence Representation and Metric Learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298832"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, W., Zhao, R., Xiao, T., and Wang, X. (2014, January 23\u201328). DeepReID: Deep Filter Pairing Neural Network for Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.27"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Varior, R.R., Haloi, M., and Wang, G. (2016, January 8\u201316). Gated Siamese Convolutional Neural Network Architecture for Human Re-Identification. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_48"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yi, D., Lei, Z., Liao, S., and Li, S.Z. (2014, January 24\u201328). Deep Metric Learning for Person Re-Identification. Proceedings of the 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.16"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shi, H., Yang, Y., Zhu, X., Liao, S., Lei, Z., Zheng, W., and Li, S.Z. (2016, January 8\u201316). Embedding Deep Metric for Person Re-identification: A Study Against Large Variations. Proceedings of the 14th European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_44"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, Y., Wen, L., Lyu, S., and Li, S.Z. (2017, January 4\u20139). Unsupervised Learning of Multi-Level Descriptors for Person Re-Identification. Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11224"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1109\/TPAMI.2003.1251144","article-title":"Silhouette Analysis-Based Gait Recognition for Human Identification","volume":"25","author":"Wang","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intel."},{"key":"ref_34","unstructured":"Han, J., and Bhanu, B. (July, January 27). Statistical Feature Fusion for Gait-Based Human Recognition. Proceedings of the IEEE Conference and Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1109\/TSMCB.2006.889612","article-title":"Integrating Face and Gait for Human Recognition at a Distance in Video","volume":"37","author":"Zhou","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part B-Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1016\/j.patcog.2007.06.019","article-title":"Feature Fusion of Side Face and Gait for Video-Based Human Identification","volume":"41","author":"Zhou","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_37","unstructured":"Zhou, X., and Bhanu, B. (2006, January 20\u201324). Feature Fusion of Face and Gait for Human Recognition at a Distance in Video. Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, China."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhou, X., Bhanu, B., and Han, J. (2005, January 20\u201322). Human Recognition at a Distance in Video by Integrating Face Profile and Gait. Proceedings of the Audio- and Video-based Biometric Person Authentication, Rye, NY, USA.","DOI":"10.1007\/11527923_55"},{"key":"ref_39","unstructured":"Kale, A., RoyChowdhury, A.K., and Chellappa, R. (2004, January 17\u201321). Fusion of Gait and Face for Human Identification. Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, Montreal, QC, Canada."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gruber, I., Hlav\u00e1\u010d, M., \u017delezn\u00fd, M., and Karpov, A. (2017, January 12\u201316). Facing Face Recognition with ResNet: Round One. Proceedings of the International Conference on Interactive Collaborative Robotics, Hatfield, UK.","DOI":"10.1007\/978-3-319-66471-2_8"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Martinez-Diaz, Y., Mendez-Vazquez, H., and Lopez-Avila, L. (2018, January 18\u201322). Toward More Realistic Face Recognition Evaluation Protocols for the YouTube Faces Database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00082"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zheng, L., Zhang, H., Sun, S., Chandraker, M., Yang, Y., and Tian, Q. (2017, January 21\u201326). Person Re-Identification in the Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.357"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Martinel, N., Dunnhofer, M., Foresti, G.L., and Micheloni, C. (2017, January 5\u20137). Person Re-Identification via Unsupervised Transfer of Learned Visual Representations. Proceedings of the 11th International Conference on Distributed Smart Cameras, Stanford, CA, USA.","DOI":"10.1145\/3131885.3131923"},{"key":"ref_44","unstructured":"Shakhnarovich, G., Lee, L., and Darrell, T. (2001, January 8\u201314). Integrated Face and Gait Recognition from Multiple Views. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_45","unstructured":"Shakhnarovich, G., and Darrell, T. (2002, January 20\u201321). On Probabilistic Combination of Face and Gait Cues for Identification. Proceedings of the 5th IEEE Conference on Automatic Face and Gesture Recognition, Washington, DC, USA."},{"key":"ref_46","unstructured":"Guan, Y., Wei, X., Li, C.-T., Marcialis, G.L., Roli, F., and Tistarelli, M. (October, January 29). Combining Gait and Face for Tackling the Elapsed Time Challenges. Proceedings of the 6th IEEE Conference on Biometrics: Theory, Applications and Systems, Washington, DC, USA."},{"key":"ref_47","unstructured":"Hofmann, M., Schmidt, S.M., Rajagopalan, A.N., and Rigoll, G. (April, January 29). Combined Face and Gait Recognition Using Alpha Matte Preprocessing. Proceedings of the 5th IAPR International Conference on Biometrics, New Delhi, India."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1016\/j.imavis.2006.05.022","article-title":"Outdoor Recognition at a Distance by Fusing Gait and Face","volume":"25","author":"Liu","year":"2007","journal-title":"Image Vis. Comput."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Geng, X., Wang, L., Li, M., Wu, Q., and Smith-Miles, K. (2007, January 5\u20137). Distance-Driven Fusion of Gait and Face for Human Identification in Video. Proceedings of the Image and Vision Computing New Zealand, Hamilton, New Zealand.","DOI":"10.1109\/WACV.2008.4544006"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Khamis, S., Kuo, C.-H., Singh, V.K., Shet, V.D., and Davis, L.S. (2014, January 6\u20137). Joint Learning for Attribute-Consistent Person Re-Identification. Proceedings of the European Conference on Computer Vision Workshops, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16199-0_10"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"K\u00f6stinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., and Bischof, H. (2012, January 16\u201321). Large Scale Metric Learning from Equivalence Constraints. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247939"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, W., and Wang, X. (2013, January 23\u201328). Locally Aligned Feature Transforms across Views. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.461"},{"key":"ref_53","unstructured":"(2018, June 16). Dongguk Face and Body Database (DFB-DB1). Available online: http:\/\/dm.dgu.edu\/link.html."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-Time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Kazemi, V., and Sullivan, J. (2014, January 23\u201328). One Millisecond Face Alignment with an Ensemble of Regression Trees. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.241"},{"key":"ref_56","unstructured":"(2018, September 07). OpenCV. Available online: https:\/\/opencv.org\/."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1630","DOI":"10.1016\/j.patrec.2007.04.004","article-title":"A Robust Eyelash Detection Based on Iris Focus Assessment","volume":"28","author":"Kang","year":"2007","journal-title":"Pattern Recognit. Lett."},{"key":"ref_58","unstructured":"(2018, January 25). Logitech BCC950 Camera. Available online: https:\/\/www.logitech.com\/en-roeu\/product\/conferencecam-bcc950."},{"key":"ref_59","unstructured":"(2018, January 25). Logitech C920 Camera. Available online: http:\/\/support.logitech.com\/en_roeu\/product\/hd-pro-webcam-c920\/specs."},{"key":"ref_60","unstructured":"(2018, January 26). ChokePoint Dataset. Available online: http:\/\/arma.sourceforge.net\/chokepoint\/."},{"key":"ref_61","unstructured":"(2018, September 07). VGG Face-16 CNN Model. Available online: http:\/\/www.robots.ox.ac.uk\/~vgg\/software\/vgg_face\/."},{"key":"ref_62","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2008, January 17). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. Proceedings of the Workshop on Faces in \u2018Real-Life\u2019 Images: Detection, Alignment, and Recognition, Marseille, France."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Wolf, L., Hassner, T., and Maoz, I. (2011, January 20\u201325). Face Recognition in Unconstrained Videos with Matched Background Similarity. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995566"},{"key":"ref_64","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A Large-scale Hierarchical Image Database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_66","unstructured":"(2018, January 25). CS231n Convolutional Neural Networks for Visual Recognition. Available online: http:\/\/cs231n.github.io\/convolutional-networks\/#overview."},{"key":"ref_67","unstructured":"(2018, January 25). Convolutional Neural Network. Available online: https:\/\/en.wikipedia.org\/wiki\/Convolutional_neural_network."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Scherer, D., M\u00fcller, A.C., and Behnke, S. (2010, January 15\u201318). Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition. Proceedings of the 20th International Conference on Artificial Neural Networks, Thessaloniki, Greece.","DOI":"10.1007\/978-3-642-15825-4_10"},{"key":"ref_69","unstructured":"(2018, September 07). ResNet-50 CNN Model. Available online: https:\/\/github.com\/KaimingHe\/deep-residual-networks."},{"key":"ref_70","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_71","unstructured":"(2018, April 13). Batch Norm Layer. Available online: http:\/\/caffe.berkeleyvision.org\/tutorial\/layers\/batchnorm.html."},{"key":"ref_72","unstructured":"Bottou, L. (2010, January 22\u201327). Large-scale Machine Learning with Stochastic Gradients Descent. Proceedings of the 19th International Conference on Computational Statistics, Paris, France."},{"key":"ref_73","unstructured":"(2018, May 27). Geforce GTX 1070. Available online: https:\/\/www.nvidia.com\/en-us\/geforce\/products\/10series\/geforce-gtx-1070-ti\/."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014). Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_75","unstructured":"(2018, June 05). Visual Studio 2013. Available online: https:\/\/www.microsoft.com\/en-us\/search\/result.aspx?q=visual+studio+2013."},{"key":"ref_76","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_77","unstructured":"(2018, February 20). Receiver Operating Characteristic. Available online: https:\/\/en.wikipedia.org\/wiki\/Receiver_operating_characteristic."},{"key":"ref_78","first-page":"141","article-title":"Gait Recognition Using Gait Energy Image","volume":"4","author":"Ali","year":"2011","journal-title":"Int. J. Signal Process."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1111\/j.1556-4029.2011.01793.x","article-title":"On Using Gait in Forensic Biometrics","volume":"56","author":"Bouchrika","year":"2011","journal-title":"J. Forensic Sci."},{"key":"ref_80","first-page":"168275","article-title":"Gait Correlation Analysis Based Human Identification","volume":"2014","author":"Chen","year":"2014","journal-title":"Sci. World J."},{"key":"ref_81","first-page":"495","article-title":"Gait Based Human Identification Approach","volume":"6","author":"Deshmukh","year":"2016","journal-title":"Int. J. Adv. Res. Comput. Sci. Softw. Eng."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Guan, Y., and Li, C.-T. (2013, January 4\u20137). A Robust Speed-Invariant Gait Recognition System for Walker and Runner Identification. Proceedings of the International Conference on Biometrics, Madrid, Spain.","DOI":"10.1109\/ICB.2013.6612965"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1654","DOI":"10.1109\/TSMCB.2012.2197823","article-title":"Gait Recognition Across Various Walking Speeds Using Higher Order Shape Configuration Based on a Differential Composition Model","volume":"42","author":"Kusakunniran","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"932","DOI":"10.3390\/s150100932","article-title":"Class Energy Image Analysis for Video Sensor-Based Gait Recognition: A Review","volume":"15","author":"Lv","year":"2015","journal-title":"Sensors"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/TPAMI.2016.2545669","article-title":"Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs","volume":"39","author":"Wu","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Arsalan, M., Naqvi, R.A., Kim, D.S., Nguyen, P.H., Owais, M., and Park, K.R. (2018). IrisDenseNet: Robust Iris Segmentation Using Densely Connected Fully Convolutional Networks in the Images by Visible Light and Near-Infrared Light Camera Sensors. Sensors, 18.","DOI":"10.3390\/s18051501"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/3040\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:19:58Z","timestamp":1760195998000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/3040"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,11]]},"references-count":86,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["s18093040"],"URL":"https:\/\/doi.org\/10.3390\/s18093040","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,11]]}}}