{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:43:01Z","timestamp":1761396181763,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency","doi-asserted-by":"publisher","award":["P2-0250 (B) \u201cMetrology and Biometric Systems\u201d"],"award-info":[{"award-number":["P2-0250 (B) \u201cMetrology and Biometric Systems\u201d"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the past few years, there has been a leap from traditional palmprint recognition methodologies, which use handcrafted features, to deep-learning approaches that are able to automatically learn feature representations from the input data. However, the information that is extracted from such deep-learning models typically corresponds to the global image appearance, where only the most discriminative cues from the input image are considered. This characteristic is especially problematic when data is acquired in unconstrained settings, as in the case of contactless palmprint recognition systems, where visual artifacts caused by elastic deformations of the palmar surface are typically present in spatially local parts of the captured images. In this study we address the problem of elastic deformations by introducing a new approach to contactless palmprint recognition based on a novel CNN model, designed as a two-path architecture, where one path processes the input in a holistic manner, while the second path extracts local information from smaller image patches sampled from the input image. As elastic deformations can be assumed to most significantly affect the global appearance, while having a lesser impact on spatially local image areas, the local processing path addresses the issues related to elastic deformations thereby supplementing the information from the global processing path. The model is trained with a learning objective that combines the Additive Angular Margin (ArcFace) Loss and the well-known center loss. By using the proposed model design, the discriminative power of the learned image representation is significantly enhanced compared to standard holistic models, which, as we show in the experimental section, leads to state-of-the-art performance for contactless palmprint recognition. Our approach is tested on two publicly available contactless palmprint datasets\u2014namely, IITD and CASIA\u2014and is demonstrated to perform favorably against state-of-the-art methods from the literature. The source code for the proposed model is made publicly available.<\/jats:p>","DOI":"10.3390\/s22010073","type":"journal-article","created":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T21:40:21Z","timestamp":1640295621000},"page":"73","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Learning to Combine Local and Global Image Information for Contactless Palmprint Recognition"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4444-3877","authenticated-orcid":false,"given":"Marjan","family":"Stoimchev","sequence":"first","affiliation":[{"name":"Institut Jo\u017eef Stefan, Jamova Cesta 39, 1000 Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9061-3884","authenticated-orcid":false,"given":"Marija","family":"Ivanovska","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, 1000 Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3385-5780","authenticated-orcid":false,"given":"Vitomir","family":"\u0160truc","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, 1000 Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Svoboda, J., Masci, J., and Bronstein, M.M. (2016, January 4\u20138). Palmprint recognition via discriminative index learning. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7900298"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TIFS.2018.2837669","article-title":"Toward More Accurate Matching of Contactless Palmprint Images Under Less Constrained Environments","volume":"14","author":"Kumar","year":"2019","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1049\/iet-spr.2008.0152","article-title":"Phase Congruency Features for Palm-print Verification","volume":"3","year":"2009","journal-title":"IET Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TBIOM.2020.2967073","article-title":"Contactless Palmprint Identification Using Deeply Learned Residual Features","volume":"2","author":"Liu","year":"2020","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.patcog.2017.04.016","article-title":"Towards contactless palmprint recognition: A novel device, a new benchmark, and a collaborative representation based identification approach","volume":"69","author":"Zhang","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3160","DOI":"10.1109\/TIFS.2019.2911165","article-title":"PalmNet: Gabor-PCA Convolutional Networks for Touchless Palmprint Recognition","volume":"14","author":"Genovese","year":"2019","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Genovese, A., Piuri, V., and Scotti, F. (2014). Touchless Palmprint Recognition Systems, Springer. Advances in Information Security.","DOI":"10.1007\/978-3-319-10365-5"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1109\/TSMC.2013.2258010","article-title":"Histogram of Oriented Lines for Palmprint Recognition","volume":"44","author":"Jia","year":"2014","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/TIFS.2011.2121062","article-title":"A Unified Framework for Contactless Hand Verification","volume":"6","author":"Kanhangad","year":"2011","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Michael, G.K.O., Connie, T., and Teoh Beng Jin, A. (2010, January 15\u201317). Robust Palm Print and Knuckle Print Recognition System Using a Contactless Approach. Proceedings of the IEEE Conference on Industrial Electronics and Applications (ICIEA), Taichung, Taiwan.","DOI":"10.1109\/ICIEA.2010.5516864"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1109\/TPAMI.2015.2509968","article-title":"A 3D Feature Descriptor Recovered from a Single 2D Palmprint Image","volume":"38","author":"Zheng","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1109\/TPAMI.2008.242","article-title":"Latent Palmprint Matching","volume":"31","author":"Jain","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ramachandra, R., Raja, K.B., Venkatesh, S., Hegde, S., Dandappanavar, S.D., and Busch, C. (2018, January 20\u201323). Verifying the Newborns without Infection Risks Using Contactless Palmprints. Proceedings of the International Conference on Biometrics (ICB), Gold Coast, Australia.","DOI":"10.1109\/ICB2018.2018.00040"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.ins.2019.03.027","article-title":"Joint Deep Convolutional Feature Representation for Hyperspectral Palmprint Recognition","volume":"489","author":"Zhao","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4147","DOI":"10.1109\/TIFS.2021.3096024","article-title":"Privacy-Enhancing Face Biometrics: A Comprehensive Survey","volume":"16","author":"Meden","year":"2021","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_16","unstructured":"Rot, P., Peer, P., and \u0160truc, V. (2021). PrivacyProber: Assessment and Detection of Soft\u2014Biometric Privacy\u2014Enhancing Techniques. IEEE Trans. Dependable Secur. Comput., under review."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.neucom.2018.03.081","article-title":"Decade Progress of Palmprint Recognition: A Brief Survey","volume":"328","author":"Zhong","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1109\/TSMC.2018.2795609","article-title":"Feature extraction methods for palmprint recognition: A survey and evaluation","volume":"49","author":"Fei","year":"2018","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/TIM.2020.2964076","article-title":"Feature extraction for 3-D palmprint recognition: A survey","volume":"69","author":"Fei","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1109\/TPAMI.2003.1227981","article-title":"Online palmprint identification","volume":"25","author":"Zhang","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TIM.2009.2028772","article-title":"An Online System of Multispectral Palmprint Verification","volume":"59","author":"Zhang","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3314","DOI":"10.1016\/j.patcog.2014.04.008","article-title":"A SIFT-Based Contactless Palmprint Verification Approach Using Iterative RANSAC and Local Palmprint Descriptors","volume":"47","author":"Wu","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kumar, A. (2008, January 16\u201319). Incorporating Cohort Information for Reliable Palmprint Authentication. Proceedings of the Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP), Bhubaneswar, India.","DOI":"10.1109\/ICVGIP.2008.73"},{"key":"ref_24","unstructured":"Sun, Z., Tan, T., Wang, Y., and Li, S. (2005, January 20\u201325). Ordinal Palmprint Representation for Personal Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Charfi, N., Trichili, H., Alimi, A.M., and Solaiman, B. (2016, January 9\u201312). Local Invariant Representation for Multi-Instance Toucheless Palmprint Identification. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844778"},{"key":"ref_26","first-page":"1106","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_27","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S.E., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1109\/TBIOM.2020.3003406","article-title":"Boosting Unconstrained Palmprint Recognition With Adversarial Metric Learning","volume":"2","author":"Zhu","year":"2020","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"15785","DOI":"10.1007\/s00521-018-3530-1","article-title":"Evaluation and Analysis of Ear Recognition Models: Performance, Complexity and Resource Requirements","volume":"32","author":"Meden","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_33","unstructured":"Emer\u0161i\u010d, \u017d., \u0160tepec, D., \u0160truc, V., and Peer, P. (June, January 30). Training Convolutional Neural Networks with Limited Training Data for Ear Recognition in the Wild. Proceedings of the IEEE International Conference on Automatic Faceand Gesture Recognition and Workshops (FG), Washington, DC, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 15\u201320). ArcFace: Additive Angular Margin Loss for Deep Face Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., and Liu, W. (2018, January 18\u201323). CosFace: Large Margin Cosine Loss for Deep Face Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00552"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 11\u201314). A Discriminative Feature Learning Approach for Deep Face Recognition. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"\u0160tepec, D., Emer\u0161i\u010d, \u017d., Peer, P., and \u0160truc, V. (2020). Constellation-Based Deep Ear Recognition. Deep Biometrics, Springer.","DOI":"10.1007\/978-3-030-32583-1_8"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Rot, P., Vitek, M., Grm, K., Emer\u0161i\u010d, \u017d., Peer, P., and \u0160truc, V. (2020). Deep Sclera Segmentation and Recognition. Handbook of Vascular Biometrics, Springer.","DOI":"10.1007\/978-3-030-27731-4_13"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"17941","DOI":"10.1007\/s00521-020-04782-1","article-title":"A Comprehensive Investigation into Sclera Biometrics: A Novel Dataset and Performance Study","volume":"32","author":"Vitek","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.neucom.2016.08.139","article-title":"Ear Recognition: More Than a Survey","volume":"255","author":"Peer","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"108247","DOI":"10.1016\/j.patcog.2021.108247","article-title":"Towards open-set touchless palmprint recognition via weight-based meta metric learning","volume":"121","author":"Shao","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_42","unstructured":"Ojala, T., Pietikainen, M., and Harwood, D. (1994, January 9\u201313). Performance Evaluation of Texture Measures with Classification Based on Kullback Discrimination of Distributions. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Jerusalem, Israel."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ojansivu, V., Rahtu, E., and Heikkila, J. (2008, January 8\u201311). Rotation Invariant Local Phase Quantization for Blur Insensitive Texture Analysis. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761377"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ojansivu, V., and Heikkil\u00e4, J. (2008, January 1\u20133). Blur Insensitive Texture Classification Using Local Phase Quantization. Proceedings of the International Conference on Image and Signal Processing, 3rd International Conference, ICISP 2008, Cherbourg-Octeville, France.","DOI":"10.1007\/978-3-540-69905-7_27"},{"key":"ref_45","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_46","unstructured":"Kannala, J., and Rahtu, E. (2012, January 11\u201315). BSIF: Binarized Statistical Image Features. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2478","DOI":"10.1016\/j.patcog.2011.12.021","article-title":"Face Recognition Using the POEM Descriptor","volume":"45","author":"Vu","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2339","DOI":"10.1016\/S0031-3203(03)00121-3","article-title":"Palmprint Feature Extraction Using 2-D Gabor Filters","volume":"36","author":"Zhang","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_49","unstructured":"Jaderberg, M., Simonyan, K., Zisserman, A., and Kavukcuoglu, K. (2015, January 7\u201312). Spatial Transformer Networks. Proceedings of the International Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22\u201329). Deformable Convolutional Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.89"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Johnson, H.J., and Christensen, G.E. (2001, January 18\u201322). Landmark and Intensity-Based, Consistent Thin-Plate Spline Image Registration. Proceedings of the International Conference on Information Processing in Medical Imaging (IPMI), Davis, CA, USA.","DOI":"10.1007\/3-540-45729-1_33"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/TPAMI.2006.11","article-title":"Fingerprint Warping Using Ridge Curve Correspondences","volume":"28","author":"Ross","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1109\/34.494647","article-title":"Weighted Parzen Windows for Pattern Classification","volume":"18","author":"Babich","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_54","first-page":"2579","article-title":"Visualizing Data Using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1109\/TCSVT.2019.2904283","article-title":"Centralized Large Margin Cosine Loss for Open-Set Deep Palmprint Recognition","volume":"30","author":"Zhong","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/73\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:51:53Z","timestamp":1760169113000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/73"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,23]]},"references-count":55,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010073"],"URL":"https:\/\/doi.org\/10.3390\/s22010073","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,12,23]]}}}