{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T18:28:25Z","timestamp":1790792905614,"version":"4.1.0"},"reference-count":59,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2019,7,31]],"date-time":"2019-07-31T00:00:00Z","timestamp":1564531200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Face verification is the task of checking if two provided images contain the face of the same person or not. In this work, we propose a fully-convolutional Siamese architecture to tackle this task, achieving state-of-the-art results on three publicly-released datasets, namely Pandora, High-Resolution Range-based Face Database (HRRFaceD), and CurtinFaces. The proposed method takes depth maps as the input, since depth cameras have been proven to be more reliable in different illumination conditions. Thus, the system is able to work even in the case of the total or partial absence of external light sources, which is a key feature for automotive applications. From the algorithmic point of view, we propose a fully-convolutional architecture with a limited number of parameters, capable of dealing with the small amount of depth data available for training and able to run in real time even on a CPU and embedded boards. The experimental results show acceptable accuracy to allow exploitation in real-world applications with in-board cameras. Finally, exploiting the presence of faces occluded by various head garments and extreme head poses available in the Pandora dataset, we successfully test the proposed system also during strong visual occlusions. The excellent results obtained confirm the efficacy of the proposed method.<\/jats:p>","DOI":"10.3390\/s19153361","type":"journal-article","created":{"date-parts":[[2019,7,31]],"date-time":"2019-07-31T11:37:07Z","timestamp":1564573027000},"page":"3361","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Driver Face Verification with Depth Maps"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2441-7524","authenticated-orcid":false,"given":"Guido","family":"Borghi","sequence":"first","affiliation":[{"name":"Softech-ICT, Dipartimento di Ingegneria Enzo Ferrari, Universit\u00e0 degli studi di Modena e Reggio Emilia, 41125 Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9821-2014","authenticated-orcid":false,"given":"Stefano","family":"Pini","sequence":"additional","affiliation":[{"name":"Softech-ICT, Dipartimento di Ingegneria Enzo Ferrari, Universit\u00e0 degli studi di Modena e Reggio Emilia, 41125 Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1046-6870","authenticated-orcid":false,"given":"Roberto","family":"Vezzani","sequence":"additional","affiliation":[{"name":"Softech-ICT, Dipartimento di Ingegneria Enzo Ferrari, Universit\u00e0 degli studi di Modena e Reggio Emilia, 41125 Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2239-283X","authenticated-orcid":false,"given":"Rita","family":"Cucchiara","sequence":"additional","affiliation":[{"name":"Softech-ICT, Dipartimento di Ingegneria Enzo Ferrari, Universit\u00e0 degli studi di Modena e Reggio Emilia, 41125 Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,31]]},"reference":[{"key":"ref_1","unstructured":"Masi, I., Wu, Y., Hassner, T., and Natarajan, P. (November, January 29). Deep Face Recognition: A Survey. Proceedings of the Conference on Graphics, Patterns and Images (SIBGRAPI), Paran\u00e1, Brazil."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.03.015","article-title":"A survey on face detection in the wild: Past, present and future","volume":"138","author":"Zafeiriou","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1720","DOI":"10.1109\/TPAMI.2018.2845370","article-title":"Predicting the Driver\u2019s Focus of Attention: The DR(eye)VE Project","volume":"41","author":"Palazzi","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.trf.2003.08.001","article-title":"Reducing drivers\u2019 mental workload by means of an adaptive man\u2013machine interface","volume":"6","author":"Piechulla","year":"2003","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/s12008-016-0349-9","article-title":"Advanced driver monitoring for assistance system (ADMAS)","volume":"12","year":"2018","journal-title":"Int. J. Interact. Des. Manuf. (IJIDeM)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Borghi, G., Fabbri, M., Vezzani, R., Calderara, S., and Cucchiara, R. (2019). Face-from-Depth for Head Pose Estimation on Depth Images. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2018.2885472"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13640-016-0103-z","article-title":"Driver head pose estimation using efficient descriptor fusion","volume":"2016","author":"Alioua","year":"2016","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_8","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, University of Massachusetts. Technical Report 07-49."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wolf, L., Hassner, T., and Maoz, I. (2011, January 20\u201325). Face recognition in unconstrained videos with matched background similarity. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995566"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7\u201313). Deep Learning Face Attributes in the Wild. Proceedings of the International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.425"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Guo, Y., Zhang, L., Hu, Y., He, X., and Gao, J. (2016). MS-Celeb-1M: A Dataset and Benchmark for Large Scale Face Recognition. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46487-9_6"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 24\u201327). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7\u201310). Deep Face Recognition. Proceedings of the British Machine Vision Conference, Swansea, UK.","DOI":"10.5244\/C.29.41"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mogelmose, A., Bahnsen, C., Moeslund, T., Clapes, A., and Escalera, S. (2013, January 23\u201328). Tri-modal person re-identification with rgb, depth and thermal features. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops, Portland, OR, USA.","DOI":"10.1109\/CVPRW.2013.52"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nikisins, O., Nasrollahi, K., Greitans, M., and Moeslund, T.B. (2014, January 24\u201328). RGB-DT based face recognition. Proceedings of the International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.302"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Borghi, G., Venturelli, M., Vezzani, R., and Cucchiara, R. (2017, January 21\u201326). POSEidon: Face-from-Depth for Driver Pose Estimation. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.583"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mantecon, T., del Bianco, C.R., Jaureguizar, F., and Garc\u00eda, N. (2014, January 27\u201330). Depth-based face recognition using local quantized patterns adapted for range data. Proceedings of the IEEE International Conference on Image Processing, Paris, France.","DOI":"10.1109\/ICIP.2014.7025058"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Frigieri, E., Borghi, G., Vezzani, R., and Cucchiara, R. (2017). Fast and accurate facial landmark localization in depth images for in-car applications. International Conference on Image Analysis and Processing, Springer.","DOI":"10.1007\/978-3-319-68560-1_48"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8514","DOI":"10.1364\/AO.53.008514","article-title":"Three-dimensional facial recognition using passive long-wavelength infrared polarimetric imaging","volume":"53","author":"Yuffa","year":"2014","journal-title":"Appl. Opt."},{"key":"ref_21","unstructured":"Borghi, G., Pini, S., Grazioli, F., Vezzani, R., and Cucchiara, R. (2018, January 3\u20136). Face Verification from Depth using Privileged Information. Proceedings of the 29th British Machine Vision Conference (BMVC), Newcastle, UK."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/TSMCA.2008.2007979","article-title":"Identifying noncooperative subjects at a distance using face images and inferred three-dimensional face models","volume":"39","author":"Medioni","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_23","unstructured":"Choi, J., Sharma, A., and Medioni, G. (2013, January 26\u201329). Comparing strategies for 3D face recognition from a 3D sensor. Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication, Gyeongju, Korea."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Anith, S., Vaithiyanathan, D., and Seshasayanan, R. (2013, January 21\u201322). Face recognition system based on feature extration. Proceedings of the IEEE International Conference on Information Communication and Embedded Systems, Chennai, India.","DOI":"10.1109\/ICICES.2013.6508266"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1109\/TPAMI.2012.219","article-title":"Local transform features and hybridization for accurate face and human detection","volume":"35","author":"Jun","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kay\u0131m, G., Sar\u0131, C., and Akg\u00fcl, C.B. (2013, January 24\u201326). Facial feature selection for gender recognition based on random decision forests. Proceedings of the 21st Signal Processing and Communications Applications Conference, Haspolat, Turkey.","DOI":"10.1109\/SIU.2013.6531267"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for recognition","volume":"3","author":"Turk","year":"1991","journal-title":"J. Cognit. Neurosci."},{"key":"ref_28","unstructured":"Zhang, W., Shan, S., Gao, W., Chen, X., and Zhang, H. (2005, January 20\u201325). Local Gabor binary pattern histogram sequence (LGBPHS): A novel non-statistical model for face representation and recognition. Proceedings of the IEEE International Conference on Computer Vision, San Diego, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ahonen, T., Rahtu, E., Ojansivu, V., and Heikkila, J. (2008, January 8\u201311). Recognition of blurred faces using local phase quantization. Proceedings of the International Conference on Pattern Recognition, Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761847"},{"key":"ref_30","unstructured":"Kannala, J., and Rahtu, E. (2012, January 11\u201315). Bsif: Binarized statistical image features. Proceedings of the International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_31","unstructured":"Sun, Y., Liang, D., Wang, X., and Tang, X. (2015). Deepid3: Face recognition with very deep neural networks. arXiv."},{"key":"ref_32","unstructured":"Kumar, N., Berg, A.C., Belhumeur, P.N., and Nayar, S.K. (October, January 29). Attribute and simile classifiers for face verification. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, J.C., Patel, V.M., and Chellappa, R. (2016, January 7\u20139). Unconstrained face verification using deep cnn features. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477557"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ghiassirad, H., and Teshnehlab, M. (2012, January 6\u20138). Similarity measurement in convolutional space. Proceedings of the IEEE International Conference on Intelligent Systems, Sofia, Bulgaria.","DOI":"10.1109\/IS.2012.6335144"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Khalil-Hani, M., and Sung, L.S. (2014, January 21\u201325). A convolutional neural network approach for face verification. Proceedings of the International Conference on High Performance Computing & Simulation, Bologna, Italy.","DOI":"10.1109\/HPCSim.2014.6903759"},{"key":"ref_36","unstructured":"Chopra, S., Hadsell, R., and LeCun, Y. (2005, January 20\u201325). Learning a similarity metric discriminatively, with application to face verification. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 15\u201321). Arcface: Additive angular margin loss for deep face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Huang, C., Li, Y., Chen, C.L., and Tang, X. (2019). Deep imbalanced learning for face recognition and attribute prediction. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2019.2914680"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zhao, K., Xu, J., and Cheng, M.M. (2019, January 16\u201320). RegularFace: Deep Face Recognition via Exclusive Regularization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00123"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.05.006","article-title":"Kinect range sensing: Structured-light versus time-of-flight kinect","volume":"139","author":"Sarbolandi","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10107-010-0420-4","article-title":"Pegasos: Primal estimated sub-gradient solver for svm","volume":"127","author":"Singer","year":"2011","journal-title":"Math. Program."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/LSP.2016.2553784","article-title":"Visual face recognition using bag of dense derivative depth patterns","volume":"23","author":"Jaureguizar","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kim, D., Hernandez, M., Choi, J., and Medioni, G. (2017, January 1\u20134). Deep 3D face identification. Proceedings of the International Joint Conference on Biometrics, Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272691"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lee, Y.C., Chen, J., Tseng, C.W., and Lai, S.H. (2016, January 19\u201322). Accurate and robust face recognition from RGB-D images with a deep learning approach. Proceedings of the British Machine Vision Conference, York, UK.","DOI":"10.5244\/C.30.123"},{"key":"ref_45","unstructured":"Neto, J.B.C., and Marana, A.N. (2017). Utilizing Deep Learning and 3DLBP for 3D Face Recognition. Iberoamerican Congress on Pattern Recognition, Springer."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhu, X., Lei, Z., Liu, X., Shi, H., and Li, S.Z. (2016, January 27\u201330). Face alignment across large poses: A 3d solution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.23"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hassner, T., Harel, S., Paz, E., and Enbar, R. (2015, January 7\u201312). Effective face frontalization in unconstrained images. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299058"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TPAMI.2017.2781233","article-title":"Hyperface: A deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition","volume":"41","author":"Ranjan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","unstructured":"Hahnloser, R.H., and Seung, H.S. (2001). Permitted and forbidden sets in symmetric threshold-linear networks. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_50","unstructured":"Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11\u201313). Deep sparse rectifier neural networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_52","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_53","unstructured":"Stefano, P., Filippo, G., Guido, B., Roberto, V., and Rita, C. (2018, January 5\u20138). Learning to Generate Facial Depth Maps. Proceedings of the International Conference on 3D Vision (3DV), Verona, Italy."},{"key":"ref_54","unstructured":"Diego, B., Borghi, G., Vezzani, R., and Cucchiara, R. (2018, January 20\u201324). Fully Convolutional Network for Head Detection with Depth Images. Proceedings of the 24th International Conference on Pattern Recognition (ICPR), Beijing, China."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Fabbri, M., Borghi, G., Lanzi, F., Vezzani, R., Calderara, S., and Cucchiara, R. (2018, January 20\u201324). Domain Translation with Conditional GANs: From Depth to RGB Face-to-Face. Proceedings of the 24th International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8545652"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Li, B.Y., Mian, A.S., Liu, W., and Krishna, A. (2013, January 15\u201317). Using kinect for face recognition under varying poses, expressions, illumination and disguise. Proceedings of the IEEE Workshop on Applications of Computer Vision, Tampa, FL, USA.","DOI":"10.1109\/WACV.2013.6475017"},{"key":"ref_57","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_59","unstructured":"Paszke, A., Gross, S., Chintala, S., and Chanan, G. (2017). Pytorch, Computer Software, Exxact Corporation. Version 0.3."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3361\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:11:30Z","timestamp":1760188290000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3361"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,31]]},"references-count":59,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19153361"],"URL":"https:\/\/doi.org\/10.3390\/s19153361","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,31]]}}}