{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:19:15Z","timestamp":1760242755503,"version":"build-2065373602"},"reference-count":16,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2016,4,21]],"date-time":"2016-04-21T00:00:00Z","timestamp":1461196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education, Culture, Sports, Science, and Technology","award":["24240028"],"award-info":[{"award-number":["24240028"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>During the night or in poorly lit areas, thermal cameras are a better choice instead of normal cameras for security surveillance because they do not rely on illumination. A thermal camera is able to detect a person within its view, but identification from only thermal information is not an easy task. The purpose of this paper is to reconstruct the face image of a person from the thermal spectrum to the visible spectrum. After the reconstruction, further image processing can be employed, including identification\/recognition. Concretely, we propose a two-step thermal-to-visible-spectrum reconstruction method based on Canonical Correlation Analysis (CCA). The reconstruction is done by utilizing the relationship between images in both thermal infrared and visible spectra obtained by CCA. The whole image is processed in the first step while the second step processes patches in an image. Results show that the proposed method gives satisfying results with the two-step approach and outperforms comparative methods in both quality and recognition evaluations.<\/jats:p>","DOI":"10.3390\/s16040568","type":"journal-article","created":{"date-parts":[[2016,4,21]],"date-time":"2016-04-21T10:25:21Z","timestamp":1461234321000},"page":"568","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Reconstructing Face Image from the Thermal Infrared Spectrum to the Visible Spectrum"],"prefix":"10.3390","volume":"16","author":[{"given":"Brahmastro","family":"Kresnaraman","sequence":"first","affiliation":[{"name":"Graduate School of Information Science, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8601, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daisuke","family":"Deguchi","sequence":"additional","affiliation":[{"name":"Information Strategy Office, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8601, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomokazu","family":"Takahashi","sequence":"additional","affiliation":[{"name":"Faculty of Economics and Information, Gifu Shotoku Gakuen University, 1-38 Naka-Uzura, Gifu 501-6122, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yoshito","family":"Mekada","sequence":"additional","affiliation":[{"name":"School of Engineering, Chukyo University, 101 Tokodachi, Kaizu-cho, Toyota 470-0393, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ichiro","family":"Ide","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8601, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroshi","family":"Murase","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8601, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,4,21]]},"reference":[{"key":"ref_1","unstructured":"Chen, J., Yi, D., Yang, J., Zhao, G., Li, S.Z., and Pietikainen, M. (2009, January 20\u201325). Learning mappings for face synthesis from near infrared to visual light images. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009), Miami, FL, USA."},{"key":"ref_2","unstructured":"Zhang, Z., Wang, Y., and Zhang, Z. (2011, January 11\u201313). Face synthesis from near-infrared to visual light via sparse representation. Proceedings of the 2011 IEEE International Joint Conference on Biometrics Compendium (IJCB 2011), Washington, DC, USA."},{"key":"ref_3","unstructured":"Goh, K., Matsukawa, T., Okabe, T., and Sato, Y. (2013, January 20\u201323). Converting near infrared facial images to visible light images using skin pigment model. Proceedings of the 2013 IAPR International Conference on Machine Vision Applications (MVA 2013), Kyoto, Japan."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, J., Hao, P., Zhang, C., and Dou, M. (2008, January 12\u201315). Hallucinating faces from thermal infrared images. Proceedings of the 2008 15th IEEE International Conference on Image Processing (ICIP 2008), San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4711792"},{"key":"ref_5","unstructured":"Dou, M., Zhang, C., Hao, P., and Li, J. (2007, January 18\u201322). Converting thermal infrared face images into normal gray-level images. Proceedings of the 8th Asian Conference on Computer Vision (ACCV 2007), Tokyo, Japan."},{"key":"ref_6","unstructured":"Baker, S., and Kanade, T. (2000, January 28\u201330). Hallucinating faces. Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), Grenoble, France."},{"key":"ref_7","unstructured":"Liu, C., Shum, H., and Zhang, C.S. (2001, January 8\u201314). A two step approach to hallucinating faces: Global parametric model and local nonparametric model. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA."},{"key":"ref_8","unstructured":"Ma, X., Zhang, J., and Qi, C. (2009). Image Analysis and Processing\u2013ICIAP 2009, Springer."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/biomet\/28.3-4.321","article-title":"Relations between two sets of variates","volume":"28","author":"Hotelling","year":"1936","journal-title":"Biometrika"},{"key":"ref_10","unstructured":"H\u00e4rdle, W., and Simar, L. (2007). Applied Multivariate Statistical Analysis, Springer."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_12","first-page":"119","article-title":"Think globally, fit locally: Unsupervised learning of low dimensional manifolds","volume":"4","author":"Saul","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_13","unstructured":"Thermal video system advanced thermo TVS-500EX. Available online: http:\/\/www.infrared.avio.co.jp\/en\/products\/ir-thermo\/lineup\/tvs-500ex\/spec.html."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Ghanbari","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for recognition","volume":"3","author":"Turk","year":"1991","journal-title":"Cogn. Neurosci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/568\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:22:38Z","timestamp":1760210558000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/4\/568"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,21]]},"references-count":16,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2016,4]]}},"alternative-id":["s16040568"],"URL":"https:\/\/doi.org\/10.3390\/s16040568","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,4,21]]}}}