{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:28:55Z","timestamp":1760243335268,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2014,10,20]],"date-time":"2014-10-20T00:00:00Z","timestamp":1413763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we propose a multi-modal 2D + 3D face recognition method for a smart city application based on a Wireless Sensor Network (WSN) and various kinds of sensors. Depth maps are exploited for the 3D face representation. As for feature extraction, we propose a new feature called Complete Local Derivative Pattern (CLDP). It adopts the idea of layering and has four layers. In the whole system, we apply CLDP separately on Gabor features extracted from a 2D image and depth map. Then, we obtain two features:  CLDP-Gabor and CLDP-Depth. The two features weighted by the corresponding coefficients are combined together in the decision level to compute the total classification distance. At last, the probe face is assigned the identity with the smallest classification distance. Extensive experiments are conducted on three different databases. The results demonstrate the robustness and superiority of the new approach. The experimental results also prove that the proposed multi-modal 2D + 3D method is superior to other multi-modal ones and CLDP performs better than other Local Binary Pattern (LBP) based features.<\/jats:p>","DOI":"10.3390\/s141019561","type":"journal-article","created":{"date-parts":[[2014,10,20]],"date-time":"2014-10-20T10:14:47Z","timestamp":1413800087000},"page":"19561-19581","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Multi-Modal Face Recognition Method Using Complete Local Derivative Patterns and Depth Maps"],"prefix":"10.3390","volume":"14","author":[{"given":"Shouyi","family":"Yin","sequence":"first","affiliation":[{"name":"Institute of Microelectronics, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xu","family":"Dai","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leibo","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaojun","family":"Wei","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/10630732.2011.601117","article-title":"Smart cities in Europe","volume":"18","author":"Caragliu","year":"2011","journal-title":"J. Urban Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s00138-008-0153-z","article-title":"IBM smart surveillance system (S3): Event based video surveillance system with an open and extensible framework","volume":"19","author":"Tian","year":"2008","journal-title":"Mach. Vision Appl."},{"key":"ref_3","first-page":"41","article-title":"A Survey of Face Recognition Techniques","volume":"5","author":"Jafri","year":"2009","journal-title":"JIPS"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1145\/954339.954342","article-title":"Face recognition: A literature survey","volume":"35","author":"Zhao","year":"2003","journal-title":"ACM Comput. Surv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1109\/34.598228","article-title":"Eigenfaces vs. fisherfaces: Recognition using class specific linear projection","volume":"19","author":"Belhumeur","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1109\/TIP.2002.999679","article-title":"Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition","volume":"11","author":"Liu","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vision"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1109\/5.628712","article-title":"Face recognition: Eigenface, elastic matching, and neural nets","volume":"85","author":"Zhang","year":"1997","journal-title":"Proc. IEEE"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1109\/TPAMI.2008.79","article-title":"Robust face recognition via sparse representation","volume":"31","author":"Wright","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.1016\/j.patrec.2006.12.018","article-title":"2D and 3D face recognition: A survey","volume":"28","author":"Abate","year":"2007","journal-title":"Pattern Recognit. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","article-title":"Face description with local binary patterns: Application to face recognition","volume":"28","author":"Ahonen","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1109\/TSMCC.2011.2118750","article-title":"Local binary patterns and its application to facial image analysis: A survey","volume":"41","author":"Huang","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_13","unstructured":"Huang, D., Wang, Y., and Wang, Y. (2007). Advances in Visual Computing, Springer."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.1109\/TIP.2010.2044957","article-title":"A completed modeling of local binary pattern operator for texture classification","volume":"19","author":"Guo","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/TIP.2009.2035882","article-title":"Local derivative pattern versus local binary pattern: Face recognition with high-order local pattern descriptor","volume":"19","author":"Zhang","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1109\/TIP.2011.2166974","article-title":"Enhanced patterns of oriented edge magnitudes for face recognition and image matching","volume":"21","author":"Vu","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2874","DOI":"10.1109\/TIP.2012.2188809","article-title":"Local tetra patterns: A new feature descriptor for content-based image retrieval","volume":"21","author":"Murala","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/j.neucom.2013.03.018","article-title":"Local ternary co-occurrence patterns: A new feature descriptor for MRI and CT image retrieval","volume":"119","author":"Murala","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1109\/TPAMI.2003.1227983","article-title":"Face recognition based on fitting a 3D morphable model","volume":"25","author":"Blanz","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","unstructured":"Lu, X., Colbry, D., and Jain, A.K. (2004). Biometric Authentication, Springer."},{"key":"ref_21","unstructured":"Chua, C.-S., Han, F., and Ho, Y.-K. (2000, January 28\u201330). 3D human face recognition using point signature. Grenoble, France."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1109\/TPAMI.2012.107","article-title":"Iterative closest normal point for 3d face recognition","volume":"35","author":"Mohammadzade","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1109\/TPAMI.2005.70","article-title":"An evaluation of multimodal 2D+ 3D face biometrics","volume":"27","author":"Chang","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","unstructured":"Xu, C., Wang, Y., Tan, T., and Quan, L. (2014, January 23\u201326). Depth vs. intensity: Which is more important for face recognition?. Cambridge, UK."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1016\/S0167-8655(02)00383-5","article-title":"Use of depth and colour eigenfaces for face recognition","volume":"24","author":"Tsalakanidou","year":"2003","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kosov, S., Scherbaum, K., Faber, K., Thormahlen, T., and Seidel, H.-P. (2009, January 7\u201310). Rapid stereo-vision enhanced face detection. Cairo, Egypt.","DOI":"10.1109\/ICIP.2009.5413675"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2063","DOI":"10.1016\/j.patrec.2007.06.003","article-title":"RegionBoost learning for 2D + 3D based face recognition","volume":"28","author":"Nanni","year":"2007","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","unstructured":"Li, S.Z., Zhao, C., Ao, M., and Lei, Z. (2005). Analysis and Modelling of Faces and Gestures, Springer."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, B.Y., Mian, A.S., Liu, W., and Krishna, A. (2013, January 15\u201317). Using kinect for face recognition under varying poses, expressions, illumination and disguise. Tampa, FL, USA.","DOI":"10.1109\/WACV.2013.6475017"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/34.598235","article-title":"Face recognition by elastic bunch graph matching","volume":"19","author":"Wiskott","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_31","unstructured":"Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. (1998, January 14\u201316). Coding facial expressions with gabor wavelets. Nara, Japan."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1364\/JOSAA.2.001160","article-title":"Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters","volume":"2","author":"Daugman","year":"1985","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_33","unstructured":"Tan, X., and Triggs, B. (2007). Analysis and Modeling of Faces and Gestures, Springer."},{"key":"ref_34","unstructured":"Zhang, W., Shan, S., Gao, W., Chen, X., and Zhang, H. (2005, January 17\u201321). Local Gabor binary pattern histogram sequence (LGBPHS): A novel non-statistical model for face representation and recognition. Beijing, China."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0262-8856(97)00070-X","article-title":"The FERET database and evaluation procedure for face-recognition algorithms","volume":"16","author":"Phillips","year":"1998","journal-title":"Image Vision Comput."},{"key":"ref_36","unstructured":"CurtinFaqes Database. Available online: http:\/\/impca.curtin.edu.au\/downloads\/datasets.cfm\/."},{"key":"ref_37","unstructured":"Li, B.Y., Liu, W., An, S., and Krishna, A. (2012, January 11\u201315). Tensor based robust color face recognition. Tsukuba, Japan."},{"key":"ref_38","unstructured":"CVRL Data Sets Available online: http:\/\/www3.nd.edu\/\u223ccvrl\/CVRL\/Data_Sets.html."},{"key":"ref_39","unstructured":"Vu, N.-S., and Caplier, A. (2010). Computer Vision\u2013ECCV 2010, Springer."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/10\/19561\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:17:09Z","timestamp":1760217429000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/10\/19561"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,20]]},"references-count":39,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2014,10]]}},"alternative-id":["s141019561"],"URL":"https:\/\/doi.org\/10.3390\/s141019561","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2014,10,20]]}}}