{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T08:35:38Z","timestamp":1770539738531,"version":"3.49.0"},"reference-count":39,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,10]],"date-time":"2021-11-10T00:00:00Z","timestamp":1636502400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The measurement accuracy and reliability of thermography is largely limited by a relatively low spatial-resolution of infrared (IR) cameras in comparison to digital cameras. Using a high-end IR camera to achieve high spatial-resolution can be costly or sometimes infeasible due to the high sample rate required. Therefore, there is a strong demand to improve the quality of IR images, particularly on edges, without upgrading the hardware in the context of surveillance and industrial inspection systems. This paper proposes a novel Conditional Generative Adversarial Networks (CGAN)-based framework to enhance IR edges by learning high-frequency features from corresponding visual images. A dual-discriminator, focusing on edge and content\/background, is introduced to guide the cross imaging modality learning procedure of the U-Net generator in high and low frequencies respectively. Results demonstrate that the proposed framework can effectively enhance barely visible edges in IR images without introducing artefacts, meanwhile the content information is well preserved. Different from most similar studies, this method only requires IR images for testing, which will increase the applicability of some scenarios where only one imaging modality is available, such as active thermography.<\/jats:p>","DOI":"10.3390\/s21227471","type":"journal-article","created":{"date-parts":[[2021,11,11]],"date-time":"2021-11-11T23:04:46Z","timestamp":1636671886000},"page":"7471","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Infer Thermal Information from Visual Information: A Cross Imaging Modality Edge Learning (CIMEL) Framework"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6734-1075","authenticated-orcid":false,"given":"Shuozhi","family":"Wang","sequence":"first","affiliation":[{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Bedford MK43 0AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianqiang","family":"Mei","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Tianjin University of Technology and Education, Tianjin 300222, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lichao","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Bedford MK43 0AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2383-5724","authenticated-orcid":false,"given":"Yifan","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Bedford MK43 0AL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wong, W.K., Tan, P.N., Loo, C.K., and Lim, W.S. (2009, January 3\u20135). An Effective Surveillance System Using Thermal Camera. Proceedings of the 2009 International Conference on Signal Acquisition and Processing, ICSAP 2009, Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICSAP.2009.12"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.infrared.2012.03.007","article-title":"Medical applications of infrared thermography: A review","volume":"55","author":"Lahiri","year":"2012","journal-title":"Infrared Phys. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1111\/psyp.12243","article-title":"Thermal infrared imaging in psychophysiology: Potentialities and limits","volume":"51","author":"Ioannou","year":"2014","journal-title":"Psychophysiology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.ndteint.2015.03.003","article-title":"Review of pulsed thermal NDT: Physical principles, theory and data processing","volume":"73","author":"Vavilov","year":"2015","journal-title":"NDT E Int."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1117\/12.160564","article-title":"Signal-processing algorithms for display and enhancement of IR images","volume":"Volume 2020","author":"Andresen","year":"1993","journal-title":"Infrared Technology XIX"},{"key":"ref_6","unstructured":"Acton, S.T. (1996, January 19). Edge enhancement of infrared imagery by way of the anisotropic diffusion pyramid. Proceedings of the 3rd IEEE International Conference on Image Processing, Lausanne, Switzerland."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4283","DOI":"10.1016\/j.optcom.2010.06.072","article-title":"A quantitative measure based infrared image enhancement algorithm using plateau histogram","volume":"283","author":"Lai","year":"2010","journal-title":"Opt. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.optlastec.2016.03.017","article-title":"Infrared image enhancement based on atmospheric scattering model and histogram equalization","volume":"83","author":"Li","year":"2016","journal-title":"Opt. Laser Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"076401","DOI":"10.1117\/1.2956655","article-title":"Dynamic-range compression and contrast enhancement in infrared imaging systems","volume":"47","author":"Branchitta","year":"2008","journal-title":"Opt. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/S1004-4132(06)60046-7","article-title":"New algorithm for infrared small target image enhancement based on wavelet transform and human visual properties","volume":"17","author":"Wang","year":"2006","journal-title":"J. Syst. Eng. Electron."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1016\/j.sigpro.2007.12.016","article-title":"A novel method of infrared image denoising and edge enhancement","volume":"88","author":"Ni","year":"2008","journal-title":"Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"206","DOI":"10.3788\/COL20090703.0206","article-title":"New enhancement of infrared image based on human visual system","volume":"7","author":"Yu","year":"2009","journal-title":"Chin. Opt. Lett."},{"key":"ref_14","first-page":"1","article-title":"Display and detail enhancement for high-dynamic-range infrared images","volume":"50","author":"Zuo","year":"2011","journal-title":"Opt. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.infrared.2014.07.013","article-title":"Detail enhancement for high-dynamic-range infrared images based on guided image filter","volume":"67","author":"Liu","year":"2014","journal-title":"Infrared Phys. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1016\/j.infrared.2016.06.023","article-title":"High dynamic range infrared images detail enhancement based on local edge preserving filter","volume":"77","author":"Song","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"163300","DOI":"10.1016\/j.ijleo.2019.163300","article-title":"Detail enhancement of infrared image based on bi-exponential edge preserving smoother","volume":"199","author":"Li","year":"2019","journal-title":"Optik"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.infrared.2010.12.001","article-title":"Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform","volume":"54","author":"Bai","year":"2011","journal-title":"Infrared Phys. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.infrared.2014.09.003","article-title":"High dynamic range compression and detail enhancement of infrared images in the gradient domain","volume":"67","author":"Zhang","year":"2014","journal-title":"Infrared Phys. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.infrared.2014.05.018","article-title":"Variational infrared image enhancement based on adaptive dual-threshold gradient field equalization","volume":"66","author":"Zhao","year":"2014","journal-title":"Infrared Phys. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"085706","DOI":"10.1088\/2040-8978\/18\/8\/085706","article-title":"Adaptive enhancement for infrared image using shearlet frame","volume":"18","author":"Fan","year":"2016","journal-title":"J. Opt."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.infrared.2018.04.005","article-title":"Edge enhancement and noise suppression for infrared image based on feature analysis","volume":"91","author":"Jiang","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Voronin, V., Tokareva, S., Semenishchev, E., and Agaian, S. (2018, January 8\u201310). Thermal Image Enhancement Algorithm Using Local And Global Logarithmic Transform Histogram Matching with Spatial Equalization. Proceedings of the 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), Las Vegas, NV, USA.","DOI":"10.1109\/SSIAI.2018.8470344"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.infrared.2015.11.006","article-title":"Noise suppression and details enhancement for infrared image via novel prior","volume":"74","author":"Fan","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1016\/j.infrared.2016.04.038","article-title":"Infrared image enhancement using Cellular Automata","volume":"76","author":"Qi","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.infrared.2016.11.011","article-title":"Edge enhanced morphology for infrared image analysis","volume":"80","author":"Bai","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"015401","DOI":"10.1088\/1555-6611\/aaed33","article-title":"Infrared upconverted image edge enhancement using spiral phase filter","volume":"29","author":"Liu","year":"2018","journal-title":"Laser Phys."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Mello Rom\u00e1n, J.C., V\u00e1zquez Noguera, J.L., Legal-Ayala, H., Pinto-Roa, D.P., Gomez-Guerrero, S., and Garc\u00eda Torres, M. (2019). Entropy and Contrast Enhancement of Infrared Thermal Images Using the Multiscale Top-Hat Transform. Entropy, 21.","DOI":"10.3390\/e21030244"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.infrared.2019.05.004","article-title":"Infrared image enhancement model based on gravitational force and lateral inhibition networks","volume":"100","author":"Cingiz","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Choi, Y., Kim, N., Hwang, S., and Kweon, I.S. (2016, January 9\u201314). Thermal Image Enhancement using Convolutional Neural Network. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759059"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"26867","DOI":"10.1109\/ACCESS.2017.2769687","article-title":"Brightness-Based Convolutional Neural Network for Thermal Image Enhancement","volume":"5","author":"Lee","year":"2017","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1016\/j.neucom.2017.07.017","article-title":"Dim infrared image enhancement based on convolutional neural network","volume":"272","author":"Fan","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.neucom.2018.11.081","article-title":"Single infrared image enhancement using a deep convolutional neural network","volume":"332","author":"Kuang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201327). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_35","unstructured":"Shapiro, L.G., and Stockman, G. (2001). C: \u201cComputer Vision\u201d, Prentice Hall."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Xie, S., and Tu, Z. (2015, January 7\u201313). Holistically-Nested Edge Detection. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.164"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-24571-3"},{"key":"ref_38","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 4\u20137). Bilateral filtering for gray and color images. Proceedings of the 1998 IEEE International Conference on Computer Vision (ICCV), Bombay, India."},{"key":"ref_39","unstructured":"INO (2020, November 10). Video Analytics Dataset. Available online: https:\/\/www.ino.ca\/en\/technologies\/video-analytics-dataset\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7471\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:28:08Z","timestamp":1760167688000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7471"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,10]]},"references-count":39,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227471"],"URL":"https:\/\/doi.org\/10.3390\/s21227471","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,10]]}}}