{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T15:31:52Z","timestamp":1772033512626,"version":"3.50.1"},"reference-count":25,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T00:00:00Z","timestamp":1656720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["833704"],"award-info":[{"award-number":["833704"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Face recognition operating in visible domains exists in many aspects of our lives, while the remaining parts of the spectrum including near and thermal infrared are not sufficiently explored. Thermal\u2013visible face recognition is a promising biometric modality that combines affordable technology and high imaging qualities in the visible domain with low-light capabilities of thermal infrared. In this work, we present the results of our study in the field of thermal\u2013visible face verification using four different algorithm architectures tested using several publicly available databases. The study covers Siamese, Triplet, and Verification Through Identification methods in various configurations. As a result, we propose a triple triplet face verification method that combines three CNNs being used in each of the triplet branches. The triple triplet method outperforms other reference methods and achieves TAR @FAR 1% values up to 90.61%.<\/jats:p>","DOI":"10.3390\/s22135012","type":"journal-article","created":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T23:38:55Z","timestamp":1656977935000},"page":"5012","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Thermal\u2013Visible Face Recognition Based on CNN Features and Triple Triplet Configuration for On-the-Move Identity Verification"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1361-9828","authenticated-orcid":false,"given":"Marcin","family":"Kowalski","sequence":"first","affiliation":[{"name":"Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego, 00-908 Warsaw, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2641-8419","authenticated-orcid":false,"given":"Artur","family":"Grudzie\u0144","sequence":"additional","affiliation":[{"name":"Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego, 00-908 Warsaw, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5172-8419","authenticated-orcid":false,"given":"Krzysztof","family":"Mierzejewski","sequence":"additional","affiliation":[{"name":"Faculty of Cybernetics, Military University of Technology, Gen. S. Kaliskiego, 00-908 Warsaw, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23\u201328). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 8\u201316). A Discriminative Feature Learning Approach for Deep Face Recognition. Proceedings of the European Conference on Computer Vision\u2014ECCV 2016, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7\u201310). Deep Face Recognition. Proceedings of the British Machine Vision Conference (BMVC), Swansea, UK.","DOI":"10.5244\/C.29.41"},{"key":"ref_4","unstructured":"Weiyang, L., Wen, Y., Yu, Z., Li, M., Raj, B., and Song, L. (2017, January 21\u201326). SphereFace: Deep Hypersphere Embedding for Face Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1364\/JOSAA.32.000431","article-title":"Thermal-to-visible face recognition using partial least squares","volume":"32","author":"Hu","year":"2015","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.patrec.2015.06.021","article-title":"Matching thermal-to-visible face images using hidden factor analysis in a cascaded subspace learning framework","volume":"72","author":"Chen","year":"2016","journal-title":"Pattern Recognit. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1007\/s11263-016-0933-2","article-title":"Deep Perceptual Mapping for Thermal to Visible Face Recognition","volume":"122","author":"Sarfraz","year":"2017","journal-title":"Int. J. Comput. Vis."},{"key":"ref_8","unstructured":"Kantarci, A., and Ekenel, H.K. (2019, January 18\u201320). Thermal to Visible Face Recognition Using Deep Autoencoders. Proceedings of the International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany."},{"key":"ref_9","unstructured":"Fondje, C.N., Hu, S., Short, N.J., and Riggan, B.S. (October, January 28). Cross-Domain Identification for Thermal-to-Visible Face Recognition. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Houston, TX, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mallat, K., Damer, N., Boutros, F., Kuijper, A., and Dugleay, L.J. (2019, January 4\u20137). Cross-spectrum thermal to visible face recognition based on cascaded image synthesis. Proceedings of the International Conference on Biometrics (ICB), Crete, Greece.","DOI":"10.1109\/ICB45273.2019.8987347"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1109\/LSP.2018.2845692","article-title":"Thermal to Visible Facial Image Translation Using Generative Adversarial Networks","volume":"25","author":"Wang","year":"2018","journal-title":"Proc. IEEE Signal Processing Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kezebou, L., Oludare, V., Panetta, K., and Again, S. (May, January 21). TR-GAN: Thermal to RGB face synthesis with generative adversarial network for cross-modal face recognition. Proceedings of the SPIE 11399 Mobile Multimedia\/Image Processing, Security, and Applications 2020, Online.","DOI":"10.1117\/12.2558166"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Immidisetti, R., Hu, S., and Patel, V.M. (2021, January 4\u20137). Simultaneous Face Hallucination and Translation for Thermal to Visible Face Verification using Axial-GAN. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Shenzhen, China.","DOI":"10.1109\/IJCB52358.2021.9484353"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Anghelone, D., Chen, C., Faure, P., Ross, A., and Dantcheva, A. (2021, January 15\u201318). Explainable Thermal to Visible Face Recognition Using Latent-Guided Generative Adversarial Network. Proceedings of the 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), Jodhpur, India.","DOI":"10.1109\/FG52635.2021.9667018"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"9576","DOI":"10.1109\/ACCESS.2022.3144308","article-title":"Cross-Spectrum Thermal Face Pattern Generator","volume":"10","author":"Cao","year":"2022","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Poster, D., Thielke, M., Nguyen, R., Rajaraman, S., Di, X., Fondje, C.N., Patel, V.M., Short, N.J., Riggan, B.S., and Nasrabadi, N.M. (2021, January 3\u20138). A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset. Proceedings of the 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV48630.2021.00160"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, H., Patel, V.M., Riggan, B.S., and Hu, S. (2017, January 1\u20134). Generative adversarial network-based synthesis of visible faces from polarimetric thermal faces. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272687"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Di, X., Riggan, B.S., Hu, S., Short, N.J., and Patel, V.M. (2019, January 4\u20137). Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis. Proceedings of the International Conference on Biometrics (ICB), Crete, Greece.","DOI":"10.1109\/ICB45273.2019.8987329"},{"key":"ref_20","first-page":"403","article-title":"High-resolution thermal face dataset for face and expression recognition","volume":"25","author":"Kowalski","year":"2018","journal-title":"Metrol. Meas. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Abdrakhmanova, M., Kuzdeuov, A., Jarju, S., Khassanov, Y., Lewis, M., and Varol, H.A. (2021). SpeakingFaces: A Large-Scale Multimodal Dataset of Voice Commands with Visual and Thermal Video Streams. Sensors, 21.","DOI":"10.3390\/s21103465"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103218","DOI":"10.1016\/j.cviu.2021.103218","article-title":"Sejong Face Database: A Multi-Modal Disguise Face Database","volume":"208\u2013209","author":"Cheema","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ng, H.W., and Winkler, S. (2014, January 27\u201330). A data-driven approach to cleaning large face datasets. Proceedings of the IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025068"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Grudzie\u0144, A., Kowalski, M., and Pa\u0142ka, N. (2021). Thermal Face Verification through Identification. Sensors, 21.","DOI":"10.3390\/s21093301"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"307","DOI":"10.24425\/mms.2021.136609","article-title":"Detection of human faces in thermal infrared images","volume":"28","author":"Kowalski","year":"2021","journal-title":"Metrol. Meas. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/5012\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:42:11Z","timestamp":1760139731000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/5012"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,2]]},"references-count":25,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22135012"],"URL":"https:\/\/doi.org\/10.3390\/s22135012","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,2]]}}}