{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T11:30:11Z","timestamp":1778326211362,"version":"3.51.4"},"reference-count":59,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,3,16]],"date-time":"2017-03-16T00:00:00Z","timestamp":1489622400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The human body contains identity information that can be used for the person recognition (verification\/recognition) problem. In this paper, we propose a person recognition method using the information extracted from body images. Our research is novel in the following three ways compared to previous studies. First, we use the images of human body for recognizing individuals. To overcome the limitations of previous studies on body-based person recognition that use only visible light images for recognition, we use human body images captured by two different kinds of camera, including a visible light camera and a thermal camera. The use of two different kinds of body image helps us to reduce the effects of noise, background, and variation in the appearance of a human body. Second, we apply a state-of-the art method, called convolutional neural network (CNN) among various available methods, for image features extraction in order to overcome the limitations of traditional hand-designed image feature extraction methods. Finally, with the extracted image features from body images, the recognition task is performed by measuring the distance between the input and enrolled samples. The experimental results show that the proposed method is efficient for enhancing recognition accuracy compared to systems that use only visible light or thermal images of the human body.<\/jats:p>","DOI":"10.3390\/s17030605","type":"journal-article","created":{"date-parts":[[2017,3,16]],"date-time":"2017-03-16T11:24:28Z","timestamp":1489663468000},"page":"605","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":667,"title":["Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal Cameras"],"prefix":"10.3390","volume":"17","author":[{"given":"Dat","family":"Nguyen","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Hyung","family":"Hong","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Ki","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1109\/TSMC.2013.2244211","article-title":"Smart homecare surveillance system: Behavior identification based on state-transition support vector machines and sound directivity pattern analysis","volume":"43","author":"Chen","year":"2013","journal-title":"IEEE Trans. Syst. Man Cybern.-Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1109\/JSEN.2015.2501407","article-title":"Smartphone enabled intelligent surveillance system","volume":"16","author":"Sanoob","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/34.868683","article-title":"W4: Real-time surveillance of people and their activities","volume":"22","author":"Haritaoglu","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.procs.2016.03.052","article-title":"Automatic traffic surveillance using video tracking","volume":"79","author":"Namade","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.cviu.2015.11.014","article-title":"Temporal mapping of surveillance video for indexing and summarization","volume":"144","author":"Bagheri","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/978-3-642-32695-0_31","article-title":"Recognizing human gender in computer-vision: A survey","volume":"7458","author":"Ng","year":"2012","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"21726","DOI":"10.3390\/s141121726","article-title":"Face recognition system for set-top-box-based intelligent TV","volume":"14","author":"Lee","year":"2014","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M.A., and Wolf, L. (2014, January 23\u201328). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus Convention Center, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2228","DOI":"10.1109\/TIP.2011.2171697","article-title":"Human identification using finger images","volume":"21","author":"Kumar","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Borra, S.R., Reddy, G.J., and Reddy, E.S. (2016, January 23\u201325). A broad survey on fingerprint recognition systems. Proceedings of the International Conference on Wireless Communications, Signal Processing and Networking, Sri Sivasubramaniya Nadar College of Engineering Rajiv Gandhi Salai (OMR), Kalavakkam, Chennai, India.","DOI":"10.1109\/WiSPNET.2016.7566372"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.patrec.2016.02.001","article-title":"Iris recognition through machine learning techniques: A survey","volume":"82","author":"Marsico","year":"2016","journal-title":"Pattern Recognit. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/TIFS.2016.2606083","article-title":"Optimal generation of iris codes for iris recognition","volume":"12","author":"Hu","year":"2017","journal-title":"IEEE Trans. Inf. Forensic Secur."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TCSVT.2003.818349","article-title":"An introduction to biometric recognition","volume":"14","author":"Jain","year":"2004","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ahmed, E., Jones, M., and Marks, T.K. (2015, January 7\u201312). An improved deep learning architecture for person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hynes Convention Center, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299016"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cheng, D., Gong, Y., Zhou, S., Wang, J., and Zheng, N. (2016, January 27\u201330). Person re-identification by multi-channel parts-based CNN with improved triplet loss function. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.149"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhao, R., Ouyang, W., and Wang, X. (2013, January 1\u20138). Person re-identification by salience matching. Proceedings of the IEEE International Conference on Computer Vision, Sydney Convention and Exhibition Centre, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.314"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1007\/978-3-319-16199-0_10","article-title":"Joint learning for attribute-consistent person re-identification","volume":"8927","author":"Khamis","year":"2015","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., and Bischof, H. (2012, January 16\u201321). Large scale metric learning from equivalence constraints. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence Rhode Island Convention Center, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247939"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, W., and Wang, X. (2013, January 23\u201328). Locally aligned feature transforms across views. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Oregon Convention Center, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.461"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-319-10584-0_1","article-title":"Person re-identification using kernel-based learning methods","volume":"8695","author":"Xiong","year":"2014","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.neucom.2005.06.002","article-title":"View-independent person identification from human gait","volume":"69","author":"Zhang","year":"2005","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.neucom.2015.04.068","article-title":"Locality based discriminative measure for multiple-shot human re-identification","volume":"167","author":"Li","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1016\/j.neucom.2015.05.008","article-title":"Enhancing person re-identification by integrating gait biometric","volume":"168","author":"Liu","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.ins.2015.01.031","article-title":"Enhancing gait based person identification using joint sparsity model and l1-norm minimization","volume":"308","author":"Yogarajah","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2993","DOI":"10.1016\/j.patcog.2015.04.005","article-title":"Deep feature learning with relative distance comparison for person re-identification","volume":"48","author":"Ding","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1016\/j.neucom.2015.05.072","article-title":"Person re-identification with multi-level adaptive correspondence models","volume":"168","author":"Shi","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"7884","DOI":"10.3390\/s130607884","article-title":"Gait-based person identification robust to changes in appearance","volume":"13","author":"Iwashita","year":"2013","journal-title":"Sensors"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.jvcir.2016.06.009","article-title":"Person re-identification based on multi-region-set ensembles","volume":"40","author":"Li","year":"2016","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, X., Sugano, Y., Fritz, M., and Bulling, A. (2015, January 7\u201312). Appearance-based gaze estimation in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hynes Convention Center, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299081"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Qin, H., Yan, J., Li, X., and Hu, X. (2016, January 27\u201330). Joint training of cascaded CNN for face detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.376"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Krafka, K., Khosla, A., Kellnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., and Torralba, A. (2016, January 27\u201330). Eye tracking for everyone. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.239"},{"key":"ref_33","unstructured":"Gurghian, A., Koduri, T., Bailur, S.V., Carey, K.J., and Murali, V.N. (July, January 26). DeepLanes: End-to-end lane position estimation using deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"10580","DOI":"10.3390\/s150510580","article-title":"Robust pedestrian detection by combining visible and thermal infrared cameras","volume":"15","author":"Lee","year":"2015","journal-title":"Sensors"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Dhamecha, T.I., Nigam, A., Singh, R., and Vatsa, M. (2013, January 4\u20137). Disguise detection and face recognition in visible and thermal spectrums. Proceedings of the International Conference on Biometrics, Madrid, Spain.","DOI":"10.1109\/ICB.2013.6613019"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"17944","DOI":"10.3390\/s150817944","article-title":"Fusion of visible and thermal descriptors using genetic algorithms for face recognition systems","volume":"15","author":"Hermosilla","year":"2015","journal-title":"Sensors"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ghiass, R.S., Arandjelovic, O., Bendada, H., and Maldague, X. (2013, January 4\u20139). Infrared face recognition: A literature review. Proceedings of the International Joint Conference on Neural Networks, Fairmont Hotel Dallas, Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6707096"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/978-3-642-17277-9_10","article-title":"Multiple-object tracking in cluttered and crowded public spaces","volume":"6455","author":"Martin","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_39","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histogram of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hajizadeh, M.A., and Ebrahimnezhad, H. (2011, January 16\u201317). Classification of age groups from facial image using histograms of oriented gradients. Proceedings of the 7th Iranian Conference on Machine Vision and Image Processing, Iran University of Science and Technology (IUST), Tehran, Iran.","DOI":"10.1109\/IranianMVIP.2011.6121582"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Karaaba, M., Surinta, O., Schomaker, L., and Wiering, M.A. (2015, January 7\u201310). Robust face recognition by computing distances from multiple histograms of oriented gradients. Proceedings of the IEEE Symposium Series on Computational Intelligence, Cape Town International Convention Center, Cape Town, South Africa.","DOI":"10.1109\/SSCI.2015.39"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Cao, L., Dikmen, M., Fu, Y., and Huang, T.S. (2008, January 26\u201331). Gender recognition from body. Proceedings of the 16th ACM International Conference on Multimedia, Vancouver, BC, Canada.","DOI":"10.1145\/1459359.1459470"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Nguyen, D.T., and Park, K.R. (2016). Body-based gender recognition using images from visible and thermal cameras. Sensors, 16.","DOI":"10.3390\/s16020156"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1109\/TIFS.2013.2242063","article-title":"Gender classification based on fusion of different spatial scale features selected by mutual information from histogram of LBP, intensity and shape","volume":"8","author":"Tapia","year":"2013","journal-title":"IEEE Trans. Inf. Forensic Secur."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1016\/j.patcog.2010.12.005","article-title":"Age estimation using a hierarchical classifier based on global and local facial features","volume":"44","author":"Choi","year":"2011","journal-title":"Pattern Recognit."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"21898","DOI":"10.3390\/s150921898","article-title":"Human age estimation method robust to camera sensor and\/or face movement","volume":"15","author":"Nguyen","year":"2015","journal-title":"Sensors"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional neural networks for large-scale image recognition. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA.","DOI":"10.1109\/ICCV.2015.314"},{"key":"ref_48","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (, January 3\u20138). ImageNet classification with deep convolutional neural network. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_49","unstructured":"Li, W., Zhao, R., and Wang, X. (2012, January 5\u20139). Human re-identification with transferred metric learning. Proceedings of the 11th Asian Conference on Computer Vision, Daejeon, Korea."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Li, W., Zhao, R., Xiao, T., and Wang, X. (2014, January 23\u201328). Deepreid: Deep filter pairing neural network for person re-identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus Convention Center, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.27"},{"key":"ref_51","unstructured":"Gray, D., Brennan, S., and Tao, H. (2007, January 14). Evaluating appearance models for recognition, reacquisition, and tracking. Proceedings of the IEEE International Workshop on Performance Evaluation for Tracking and Surveillance, Rio de Janeiro, Brazil."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wang, T., Gong, S., Zhu, X., and Wang, S. (2014, January 6\u201312). Person re-identification by video ranking. Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_45"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Hirzer, M., Beleznai, C., Roth, P.M., and Bishof, H. (2011, January 23\u201327). Person re-identification by descriptive and discriminative classification. Proceedings of the Scandinavian Conference on Image Analysis, Ystad, Sweden.","DOI":"10.1007\/978-3-642-21227-7_9"},{"key":"ref_54","unstructured":"C600 Webcam Camera. Available online: https:\/\/support.logitech.com\/en_us\/product\/5869."},{"key":"ref_55","unstructured":"Tau2 Thermal Imaging Camera. Available online: http:\/\/www.flir.com\/cores\/display\/?id=54717."},{"key":"ref_56","unstructured":"Dongguk Body-Based Person Recognition Database (DBPerson-Recog-DB1). Available online: http:\/\/dm.dongguk.edu\/link.html."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Lu, Y., Yoon, S., Xie, S.J., Yang, J., Wang, Z., and Park, D.S. (2014, January 24\u201328). Finger-vein recognition using histogram of competitive Gabor responses. Proceedings of the 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.309"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.neucom.2012.10.032","article-title":"A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image","volume":"120","author":"Yang","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Manjunath, N., Anmol, N., Prathiksha, N.R., and Vinay, A. (2015, January 13\u201315). Performance analysis of various distance measures for PCA based face recognition. Proceedings of the National Conference on Recent Advances in Electronics & Computer Engineering, Roorkee, India.","DOI":"10.1109\/RAECE.2015.7510240"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/3\/605\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:30:36Z","timestamp":1760207436000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/3\/605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,16]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,3]]}},"alternative-id":["s17030605"],"URL":"https:\/\/doi.org\/10.3390\/s17030605","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,3,16]]}}}