{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T19:05:29Z","timestamp":1780513529652,"version":"3.54.1"},"reference-count":39,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 106-2218-E-006-004; MOST 108-2923-E-006-005-MY3"],"award-info":[{"award-number":["MOST 106-2218-E-006-004; MOST 108-2923-E-006-005-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Facial recognition has attracted more and more attention since the rapid growth of artificial intelligence (AI) techniques in recent years. However, most of the related works about facial reconstruction and recognition are mainly based on big data collection and image deep learning related algorithms. The data driven based AI approaches inevitably increase the computational complexity of CPU and usually highly count on GPU capacity. One of the typical issues of RGB-based facial recognition is its applicability in low light or dark environments. To solve this problem, this paper presents an effective procedure for facial reconstruction as well as facial recognition via using a depth sensor. For each testing candidate, the depth camera acquires a multi-view of its 3D point clouds. The point cloud sets are stitched for 3D model reconstruction by using the iterative closest point (ICP). Then, a segmentation procedure is designed to separate the model set into a body part and head part. Based on the segmented 3D face point clouds, certain facial features are then extracted for recognition scoring. Taking a single shot from the depth sensor, the point cloud data is going to register with other 3D face models to determine which is the best candidate the data belongs to. By using the proposed feature-based 3D facial similarity score algorithm, which composes of normal, curvature, and registration similarities between different point clouds, the person can be labeled correctly even in a dark environment. The proposed method is suitable for smart devices such as smart phones and smart pads with tiny depth camera equipped. Experiments with real-world data show that the proposed method is able to reconstruct denser models and achieve point cloud-based 3D face recognition.<\/jats:p>","DOI":"10.3390\/s21082587","type":"journal-article","created":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T11:31:59Z","timestamp":1617795119000},"page":"2587","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["3D Face Point Cloud Reconstruction and Recognition Using Depth Sensor"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1027-9979","authenticated-orcid":false,"given":"Cheng-Wei","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Aeronautics and Astronautics, National Cheng Kung University, Tainan 701, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4068-0632","authenticated-orcid":false,"given":"Chao-Chung","family":"Peng","sequence":"additional","affiliation":[{"name":"Department of Aeronautics and Astronautics, National Cheng Kung University, Tainan 701, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18\u201323). Frustum PointNets for 3D Object Detection from RGB-D Data. Proceedings of the the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, The Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yang, B., Luo, W., and Urtasun, R. (2018, January 18\u201323). PIXOR: Real-time 3D Object Detection from Point Clouds. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, The Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00798"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018, January 18\u201323). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, The Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Fan, H., Su, H., and Guibas, L. (2017, January 21\u201326). A Point Set Generation Network for 3D Object Reconstruction from a Single Image. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.264"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lin, C.-H., Kong, C., and Lucey, S. (2018, January 2\u20137). Learning efficient point cloud generation for dense 3d object reconstruction. Proceedings of the proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12278"},{"key":"ref_6","first-page":"43","article-title":"3D Object Recognition Based on Local and Global Features Using Point Cloud Library","volume":"7","author":"Alhamzi","year":"2015","journal-title":"Int. J. Adv. Comput. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Baikerikar, J., Kavathekar, V., Agarwal, Y., Bhat, S., Polly, C., and Juwatkar, S. (2020, January 28\u201329). Home Security System Usings Face Recognition. Proceedings of the 2nd International Conference on Advanced Computing Technologies and Applications, Mumbai, India.","DOI":"10.1007\/978-981-15-3242-9_29"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chowdhry, D.A., Hussain, A., Rehman, M.Z.U., Ahmad, F., Ahmad, A., and Pervaiz, M. (June, January 30). Smart security system for sensitive area using face recognition. Proceedings of the 2013 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (CSUDET), Selangor, Malaysia.","DOI":"10.1109\/CSUDET.2013.6670976"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Owayjan, M., Dergham, A., Haber, G., Fakih, N., Hamoush, A., and Abdo, E. (2013). Face Recognition Security System, Springer.","DOI":"10.1007\/978-3-319-06764-3_42"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Agbolade, O., Nazri, A., Yaakob, R., Ghani, A.A., and Cheah, Y.K. (2020). Down Syndrome Face Recognition: A Review. Symmetry, 12.","DOI":"10.3390\/sym12071182"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"123649","DOI":"10.1109\/ACCESS.2020.3005687","article-title":"Deep Facial Diagnosis: Deep Transfer Learning From Face Recognition to Facial Diagnosis","volume":"8","author":"Jin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Apoorva, P., Impana, H.C., Siri, S.L., Varshitha, M.R., and Ramesh, B. (2019, January 27\u201329). Automated Criminal Identification by Face Recognition using Open Computer Vision Classifiers. Proceedings of the 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC.2019.8819850"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sajjad, M., Nasir, M., Muhammad, K., Khan, S., Jan, Z., Sangaiah, A., Elhoseny, M., and Baik, S. (2017). Raspberry Pi assisted face recognition framework for enhanced law-enforcement services in smart cities. Future Gener. Comput. Syst., 108.","DOI":"10.1016\/j.future.2017.11.013"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"180681","DOI":"10.1109\/ACCESS.2020.3028106","article-title":"3D Face Reconstruction From Single 2D Image Using Distinctive Features","volume":"8","author":"Afzal","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Dou, P., Shah, S., and Kakadiaris, I. (2017, January 21\u201326). End-to-End 3D Face Reconstruction with Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.164"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Morales, A., Piella, G., and Sukno, F. (2020). Survey on 3D face reconstruction from uncalibrated images. ArXiv.","DOI":"10.1016\/j.cosrev.2021.100400"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tian, L., Liu, J., and Guo, W. (2019). Three-Dimensional Face Reconstruction Using Multi-View-Based Bilinear Model. Sensors, 19.","DOI":"10.3390\/s19030459"},{"key":"ref_19","first-page":"1","article-title":"Reconstruction of Personalized 3D Face Rigs from Monocular Video","volume":"35","author":"Garrido","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sucontphunt, T. (2014). 3D Face Reconstruction from a Single Shaded Image Using Subspace Crossing Engine. Iberoam. Congr. Pattern Recognit., 794\u2013801.","DOI":"10.1007\/978-3-319-12568-8_96"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, S., Yu, H., Dong, J., Wang, T., Ju, Z., and Liu, H. (2015, January 9\u201312). Automatic Reconstruction of Dense 3D Face Point Cloud with a Single Depth Image. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China.","DOI":"10.1109\/SMC.2015.255"},{"key":"ref_22","first-page":"127","article-title":"Facial feature detection using Haar classifiers","volume":"21","author":"Wilson","year":"2006","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_23","first-page":"41","article-title":"Performance Issues on K-Mean Partitioning Clustering Algorithm","volume":"14","author":"Subbalakshmi","year":"2014","journal-title":"Int. J. Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/MSP.2020.2984780","article-title":"3D Point Cloud Processing and Learning for Autonomous Driving: Impacting Map Creation, Localization, and Perception","volume":"38","author":"Chen","year":"2021","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12\u201317). Fast Point Feature Histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lovric, M. (2011). Principal Component Analysis. International Encyclopedia of Statistical Science. Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-04898-2"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Weinmann, M., Jutzi, B., Hinz, S., and Mallet, C. (2015). Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers. ISPRS J. Photogramm. Remote. Sens., 105.","DOI":"10.1016\/j.isprsjprs.2015.01.016"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2005.05.005","article-title":"A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition","volume":"101","author":"Bowyer","year":"2006","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_29","unstructured":"Nunes, L.F.d.M., Zaghetto, C., and Vidal, F. (2018, January 29\u201331). 3D Face Recognition on Point Cloud Data\u2014An Approaching based on Curvature Map Projection using Low Resolution Devices. Proceedings of the ICINCO, Porto, Portugal."},{"key":"ref_30","unstructured":"Medioni, G., and Waupotitsch, R. (September, January 2). Face modeling and recognition in 3-D. Proceedings of the 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443), Newport Beach, CA, USA."},{"key":"ref_31","unstructured":"Dong-Han, J., Daw-Tung, L., and Chi-Hung, T. (2016, January 4\u20138). Face verification with three-dimensional point cloud by using deep belief networks. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1007\/11527923_95","article-title":"Local Feature Based 3D Face Recognition","volume":"Volume 3546","author":"Lee","year":"2005","journal-title":"Proceedings of the International Conference on Audio-and Video-based Biometric Person Authentication"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.4249\/scholarpedia.1883","article-title":"K-nearest neighbor","volume":"4","author":"Peterson","year":"2009","journal-title":"Scholarpedia"},{"key":"ref_34","unstructured":"Kjer, H.M., and Wilm, J. (2010). Evaluation of Surface Registration Algorithms for PET Motion Correction. [Bachelor\u2019s Thesis, Technical University of Denmark]. DTU, DK-2800 Kgs."},{"key":"ref_35","unstructured":"Ester, M., Kriegel, H.-P., Sander, J., and Xu, X. (1996, January 2\u20134). A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the the Second International Conference on Knowledge Discovery and Data Mining, Portland, Oregon."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications","volume":"12","author":"Khoshelham","year":"2012","journal-title":"Sensors"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1016\/j.robot.2008.08.005","article-title":"Towards 3D Point cloud based object maps for household environments","volume":"56","author":"Rusu","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/34.625113","article-title":"COSMOS-A representation scheme for 3D free-form objects","volume":"19","author":"Dorai","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Huang, J., and You, S. (2012, January 16\u201321). Point cloud matching based on 3D self-similarity. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238913"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2587\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:26:29Z","timestamp":1760361989000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,7]]},"references-count":39,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21082587"],"URL":"https:\/\/doi.org\/10.3390\/s21082587","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,7]]}}}