{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:49:07Z","timestamp":1767340147326,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T00:00:00Z","timestamp":1628726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2019R1A2C2002167"],"award-info":[{"award-number":["2019R1A2C2002167"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>An imaging system has natural statistics that reflect its intrinsic characteristics. For example, the gradient histogram of a visible light image generally obeys a heavy-tailed distribution, and its restoration considers natural statistics. Thermal imaging cameras detect infrared radiation, and their signal processors are specialized according to the optical and sensor systems. Thermal images, also known as long wavelength infrared (LWIR) images, suffer from distinct degradations of LWIR sensors and residual nonuniformity (RNU). However, despite the existence of various studies on the statistics of thermal images, thermal image processing has seldom attempted to incorporate natural statistics. In this study, natural statistics of thermal imaging sensors are derived, and an optimization method for restoring thermal images is proposed. To verify our hypothesis about the thermal images, high-frequency components of thermal images from various datasets are analyzed with various measures (correlation coefficient, histogram intersection, chi-squared test, Bhattacharyya distance, and Kullback\u2013Leibler divergence), and generalized properties are derived. Furthermore, cost functions accommodating the validated natural statistics are designed and minimized by a pixel-wise optimization method. The proposed algorithm has a specialized structure for thermal images and outperforms the conventional methods. Several image quality assessments are employed for quantitatively demonstrating the performance of the proposed method. Experiments with synthesized images and real-world images are conducted, and the results are quantified by reference image assessments (peak signal-to-noise ratio and structural similarity index measure) and no-reference image assessments (Roughness (Ro) and Effective Roughness (ERo) indices).<\/jats:p>","DOI":"10.3390\/s21165443","type":"journal-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T10:54:41Z","timestamp":1628765681000},"page":"5443","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Thermal Image Restoration Based on LWIR Sensor Statistics"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8798-1275","authenticated-orcid":false,"given":"Jaeduk","family":"Han","sequence":"first","affiliation":[{"name":"Samsung Electronics, Suwon-si 16677, Gyeonggi-do, Korea"}]},{"given":"Haegeun","family":"Lee","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}]},{"given":"Moon Gi","family":"Kang","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Morris, N.J.W., Avidan, S., Matusik, W., and Pfister, H. (2007, January 17\u201322). Statistics of Infrared Images. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383003"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1109\/TGRS.2019.2948601","article-title":"Simultaneous Intensity Bias Estimation and Stripe Noise Removal in Infrared Images Using the Global and Local Sparsity Constraints","volume":"58","author":"Liu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1109\/LGRS.2019.2938822","article-title":"Fourier Spectrum Guidance for Stripe Noise Removal in Thermal Infrared Imagery","volume":"17","author":"Zeng","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"104553","DOI":"10.1016\/j.compbiomed.2021.104553","article-title":"A hybrid methodology for breast screening and cancer diagnosis using thermography","volume":"135","author":"Resmini","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_5","unstructured":"(2021, July 14). Flir Thermal Dataset for Algorithm Training. FLIR ADAS. Available online: https:\/\/www.flir.in\/oem\/adas\/adas-dataset-form\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1016\/S0262-8856(03)00061-1","article-title":"Statistical hypothesis pruning for identifying faces from infrared images","volume":"21","author":"Srivastava","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4229","DOI":"10.1109\/TIP.2017.2705426","article-title":"Linear Support Tensor Machine With LSK Channels: Pedestrian Detection in Thermal Infrared Images","volume":"26","author":"Biswas","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1080\/17686733.2019.1579020","article-title":"Making long-wave infrared face recognition robust against image quality degradations","volume":"16","author":"Bovik","year":"2019","journal-title":"Quant. InfraRed Thermogr. J."},{"key":"ref_9","first-page":"388","article-title":"Implementation and performance of shutterless uncooled micro-bolometer cameras","volume":"Volume 9451","author":"Andresen","year":"2015","journal-title":"Infrared Technology and Applications XLI"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"9","DOI":"10.5194\/jsss-5-9-2016","article-title":"Shutter-less calibration of uncooled infrared cameras","volume":"5","author":"Tempelhahn","year":"2016","journal-title":"J. Sens. Sens. Syst."},{"key":"ref_11","unstructured":"San Martin, C., and Kim, S.W. (2011). Spectral Model for Fixed-Pattern-Noise in Infrared Focal-Plane Arrays. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Springer."},{"key":"ref_12","unstructured":"Johnson, K.R. (2016). Camera and Method for Thermal Image Noise Reduction Using Post Processing Techniques. (9,282,259), U.S. Patent."},{"key":"ref_13","unstructured":"Shepard, S.M. (2003). Temporal Noise Reduction, Compression and Analysis of Thermographic Image Data Sequences. (6,516,084), U.S. Patent."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1164","DOI":"10.1364\/JOSAA.28.001164","article-title":"Scene-based nonuniformity correction algorithm based on interframe registration","volume":"28","author":"Zuo","year":"2011","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/TIP.2015.2496289","article-title":"Tasking on Natural Statistics of Infrared Images","volume":"25","author":"Goodall","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3479","DOI":"10.1109\/TIP.2017.2695898","article-title":"Predicting the Quality of Fused Long Wave Infrared and Visible Light Images","volume":"26","author":"Bovik","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., and Freeman, W.T. (2006). Removing Camera Shake from a Single Photograph. ACM SIGGRAPH 2006 Papers, Association for Computing Machinery.","DOI":"10.1145\/1179352.1141956"},{"key":"ref_18","unstructured":"Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., and Culotta, A. (2009). Fast Image Deconvolution using Hyper-Laplacian Priors. Advances in Neural Information Processing Systems 22, Curran Associates, Inc."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kri\u0161to, M., and Iva\u0161i\u0107-Kos, M. (2019, January 20\u201324). Thermal Imaging Dataset for Person Detection. Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.23919\/MIPRO.2019.8757208"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Davis, J.W., and Keck, M.A. (2005, January 5\u20137). A Two-Stage Template Approach to Person Detection in Thermal Imagery. Proceedings of the 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV\/MOTION\u201905), Breckenridge, CO, USA.","DOI":"10.1109\/ACVMOT.2005.14"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.cviu.2006.06.010","article-title":"Background-subtraction using contour-based fusion of thermal and visible imagery","volume":"106","author":"Davis","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3556","DOI":"10.1109\/TIP.2018.2825112","article-title":"Permuted Coordinate-Wise Optimizations Applied to Lp-Regularized Image Deconvolution","volume":"27","author":"Han","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2206","DOI":"10.1016\/j.patrec.2008.08.004","article-title":"A non-local regularization strategy for image deconvolution","volume":"29","author":"Mignotte","year":"2008","journal-title":"Pattern Recognit. Lett."},{"key":"ref_24","first-page":"1","article-title":"Comprehensive survey on distance\/similarity measures between probability density functions","volume":"1","author":"Cha","year":"2007","journal-title":"City"},{"key":"ref_25","unstructured":"Deza, M.M., and Deza, E. (2006). Dictionary of Distances, Elsevier."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1137\/130942954","article-title":"iPiano: Inertial Proximal Algorithm for Nonconvex Optimization","volume":"7","author":"Ochs","year":"2014","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1137\/16M1075247","article-title":"Discrete Total Variation: New Definition and Minimization","volume":"10","author":"Condat","year":"2017","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1628","DOI":"10.1109\/TPAMI.2013.241","article-title":"Multi-Observation Blind Deconvolution with an Adaptive Sparse Prior","volume":"36","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3383","DOI":"10.1109\/TIP.2011.2150236","article-title":"Image Deconvolution With Multi-Stage Convex Relaxation and Its Perceptual Evaluation","volume":"20","author":"Hou","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1117\/12.7977030","article-title":"Iterative Image Restoration Algorithms","volume":"28","author":"Katsaggelos","year":"1989","journal-title":"Opt. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10107-015-0892-3","article-title":"Coordinate descent algorithms","volume":"151","author":"Wright","year":"2015","journal-title":"Math. Program."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1364\/AO.38.000772","article-title":"Statistical algorithm for nonuniformity correction in focal-plane arrays","volume":"38","author":"Hayat","year":"1999","journal-title":"Appl. Opt."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Martin, C.S., Torres, S.N., and Pezoa, J.E. (2007, January 21\u201325). An Effective Reference-Free Performance Metric for Non-uniformity Correction Algorithms in Infrared Imaging System. Proceedings of the LEOS 2007\u2014IEEE Lasers and Electro-Optics Society Annual Meeting Conference Proceedings, Lake Buena Vista, FL, USA.","DOI":"10.1109\/LEOS.2007.4382537"},{"key":"ref_36","first-page":"172","article-title":"A frequency domain model for the spatial fixed-pattern noise in infrared focal plane arrays","volume":"Volume 8155","author":"Razeghi","year":"2011","journal-title":"Infrared Sensors, Devices, and Applications; and Single Photon Imaging II"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. (October, January 16). Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space. Proceedings of the 2007 IEEE International Conference on Image Processing, San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4378954"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1137\/080725891","article-title":"The Split Bregman Method for L1-Regularized Problems","volume":"2","author":"Goldstein","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ochs, P., Dosovitskiy, A., Brox, T., and Pock, T. (2013, January 23\u201328). An Iterated L1 Algorithm for Non-smooth Non-convex Optimization in Computer Vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.230"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhang, L., and Zhang, D. (2018, January 8\u201314). A Trilateral Weighted Sparse Coding Scheme for Real-World Image Denoising. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01237-3_2"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Helgaso, S. (1999). The Radon Transform, Springer. [2nd ed.].","DOI":"10.1007\/978-1-4757-1463-0"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5443\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:44:47Z","timestamp":1760165087000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5443"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,12]]},"references-count":41,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165443"],"URL":"https:\/\/doi.org\/10.3390\/s21165443","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,8,12]]}}}