{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T02:47:02Z","timestamp":1781837222356,"version":"3.54.5"},"reference-count":50,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2021YFC3340500"],"award-info":[{"award-number":["2021YFC3340500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Infrared sensors capture thermal radiation emitted by objects. They can operate in all weather conditions and are thus employed in fields such as military surveillance, autonomous driving, and medical diagnostics. However, infrared imagery poses challenges such as low contrast and indistinct textures due to the long wavelength of infrared radiation and susceptibility to interference. In addition, complex enhancement algorithms make real-time processing challenging. To address these problems and improve visual quality, in this paper, we propose a multi-scale FPGA-based method for real-time enhancement of infrared images by using rolling guidance filter (RGF) and contrast-limited adaptive histogram equalization (CLAHE). Specifically, the original image is first decomposed into various scales of detail layers and a base layer using RGF. Secondly, we fuse detail layers of diverse scales, then enhance the detail information by using gain coefficients and employ CLAHE to improve the contrast of the base layer. Thirdly, we fuse the detail layers and base layer to obtain the image with global details of the input image. Finally, the proposed algorithm is implemented on an FPGA using advanced high-level synthesis tools. Comprehensive testing of our proposed method on the AXU15EG board demonstrates its effectiveness in significantly improving image contrast and enhancing detail information. At the same time, real-time enhancement at a speed of 147 FPS is achieved for infrared images with a resolution of 640 \u00d7 480.<\/jats:p>","DOI":"10.3390\/s23198101","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T03:49:14Z","timestamp":1695786554000},"page":"8101","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Multi-Scale FPGA-Based Infrared Image Enhancement by Using RGF and CLAHE"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4812-7416","authenticated-orcid":false,"given":"Jialong","family":"Liu","sequence":"first","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xichuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenlong","family":"Wan","sequence":"additional","affiliation":[{"name":"National Information Center of GACC, Beijing 100010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuefei","family":"Yang","sequence":"additional","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"He","sequence":"additional","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rulong","family":"He","sequence":"additional","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"},{"name":"The School of Electronic Engineering, Naval University of Engineering, Wuhan 430030, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7478-3103","authenticated-orcid":false,"given":"Yingcheng","family":"Lin","sequence":"additional","affiliation":[{"name":"The School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"104000","DOI":"10.1016\/j.infrared.2021.104000","article-title":"Infrared image enhancement algorithm using local entropy mapping histogram adaptive segmentation","volume":"120","author":"Zhang","year":"2022","journal-title":"Infrared Phys. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3805","DOI":"10.1109\/TIP.2020.2966082","article-title":"A Multimodal Saliency Model for Videos with High Audio-Visual Correspondence","volume":"29","author":"Min","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6054","DOI":"10.1109\/TIP.2020.2988148","article-title":"Study of Subjective and Objective Quality Assessment of Audio-Visual Signals","volume":"29","author":"Min","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Min, X., Zhai, G., Hu, C., and Gu, K. (2015, January 13\u201316). Fixation prediction through multimodal analysis. Proceedings of the 2015 Visual Communications and Image Processing (VCIP), Singapore.","DOI":"10.1109\/VCIP.2015.7457921"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhang, L., Yang, X., Wan, Z., Cao, D., and Lin, Y. (2022). A real-time FPGA implementation of infrared and visible image fusion using guided filter and saliency detection. Sensors, 22.","DOI":"10.3390\/s22218487"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TIP.2022.3228497","article-title":"UIU-Net: U-Net in U-Net for Infrared Small Object Detection","volume":"32","author":"Wu","year":"2023","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","first-page":"3163410","article-title":"Interior Attention-Aware Network for Infrared Small Target Detection","volume":"60","author":"Wang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/MGRS.2022.3145502","article-title":"Single-Frame Infrared Small-Target Detection: A survey","volume":"10","author":"Zhao","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2303","DOI":"10.1016\/j.ijheatmasstransfer.2017.01.086","article-title":"Infrared imaging technology for breast cancer detection\u2013Current status, protocols and new directions","volume":"108","author":"Kandlikar","year":"2017","journal-title":"Int. J. Heat Mass Transf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.jcm.2017.10.006","article-title":"Reliability of infrared thermography images in the analysis of the plantar surface temperature in diabetes mellitus","volume":"17","author":"Silva","year":"2018","journal-title":"J. Chiropr. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7604","DOI":"10.1364\/AO.55.007604","article-title":"Robust infrared small target detection via non-negativity constraint-based sparse representation","volume":"55","author":"Wan","year":"2016","journal-title":"Appl. Opt."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wan, M., Ren, K., Gu, G., Zhang, X., Qian, W., Chen, Q., and Yu, S. (2017). Infrared small moving target detection via saliency histogram and geometrical invariability. Appl. Sci., 7.","DOI":"10.3390\/app7060569"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.patrec.2014.09.011","article-title":"Infrared image enhancement using adaptive trilateral contrast enhancement","volume":"54","author":"Yuan","year":"2015","journal-title":"Pattern Recognit. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3470970","article-title":"Screen Content Quality Assessment: Overview, Benchmark, and Beyond","volume":"54","author":"Min","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1007\/s11831-020-09425-1","article-title":"Histogram Equalization Variants as Optimization Problems: A Review","volume":"28","author":"Dhal","year":"2021","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Abin, D., and Thepade, S.D. (2021, January 4\u20136). Illumination Inconsistency Reduction in Video Frames using DSIHE with Kekre\u2019s LUV Color Space. Proceedings of the 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India.","DOI":"10.1109\/ICICV50876.2021.9388567"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.1109\/TCE.2003.1261234","article-title":"Minimum mean brightness error bi-histogram equalization in contrast enhancement","volume":"49","author":"Chen","year":"2003","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fan, X., Wang, J., Wang, H., and Xia, C. (2022). Contrast-Controllable Image Enhancement Based on Limited Histogram. Electronics, 11.","DOI":"10.3390\/electronics11223822"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"29919","DOI":"10.1007\/s11042-022-12830-2","article-title":"Image enhancement by linear regression algorithm and sub-histogram equalization","volume":"81","author":"Chaudhary","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s11045-022-00853-9","article-title":"Image sub-division and quadruple clipped adaptive histogram equalization (ISQCAHE) for low exposure image enhancement","volume":"34","author":"Acharya","year":"2023","journal-title":"Multidimens. Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1007\/s11282-022-00654-7","article-title":"Evaluation of histogram equalization and contrast limited adaptive histogram equalization effect on image quality and fractal dimensions of digital periapical radiographs","volume":"39","author":"Mehdizadeh","year":"2023","journal-title":"Oral Radiol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3790","DOI":"10.1109\/TIP.2020.2966081","article-title":"A Metric for Light Field Reconstruction, Compression, and Display Quality Evaluation","volume":"29","author":"Min","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2879","DOI":"10.1109\/TITS.2018.2868771","article-title":"Objective Quality Evaluation of Dehazed Images","volume":"20","author":"Min","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2319","DOI":"10.1109\/TMM.2019.2902097","article-title":"Quality Evaluation of Image Dehazing Methods Using Synthetic Hazy Images","volume":"21","author":"Min","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"096401","DOI":"10.1117\/1.3216575","article-title":"New technique for the visualization of high dynamic range infrared images","volume":"48","author":"Branchitta","year":"2009","journal-title":"Opt. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"127401","DOI":"10.1117\/1.3659698","article-title":"Display and detail enhancement for high-dynamic-range infrared images","volume":"50","author":"Zuo","year":"2011","journal-title":"Opt. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.infrared.2014.07.013","article-title":"Detail enhancement for high-dynamic-range infrared images based on guided image filter","volume":"67","author":"Liu","year":"2014","journal-title":"Infrared Phys. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xie, J., and Liu, N. (2019, January 28\u201330). Detail enhancement of infrared image based on BEEPS. Proceedings of the Second Target Recognition and Artificial Intelligence Summit Forum, Shenyang, China.","DOI":"10.1117\/12.2552885"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a Deep Convolutional Network for Image Super-Resolution. Proceedings of the Computer Vision\u2014ECCV 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8\u201314). Image Super-Resolution Using Very Deep Residual Channel Attention Networks. Proceedings of the Computer Vision\u2014ECCV 2018, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.neucom.2018.11.081","article-title":"Single infrared image enhancement using a deep convolutional neural network","volume":"332","author":"Kuang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103690","DOI":"10.1016\/j.infrared.2021.103690","article-title":"Target attention deep neural network for infrared image enhancement","volume":"115","author":"Wang","year":"2021","journal-title":"Infrared Phys. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kokufuta, K., and Maruyama, T. (September, January 31). Real-time processing of contrast limited adaptive histogram equalization on FPGA. Proceedings of the 2010 International Conference on Field Programmable Logic and Applications (FPL), Milan, Italy.","DOI":"10.1109\/FPL.2010.37"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Unal, B., and Akoglu, A. (September, January 29). Resource efficient real-time processing of contrast limited adaptive histogram equalization. Proceedings of the 2016 26th International Conference on Field Programmable Logic and Applications (FPL), Lausanne, Switzerland.","DOI":"10.1109\/FPL.2016.7577362"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"6407","DOI":"10.1364\/AO.396417","article-title":"Real-time infrared image detail enhancement based on fast guided image filter and plateau equalization","volume":"59","author":"Chen","year":"2020","journal-title":"Appl. Opt."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1007\/s00530-022-01004-7","article-title":"Fast bilateral filter with spatial subsampling","volume":"29","author":"Yang","year":"2023","journal-title":"Multimed. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided image filtering","volume":"35","author":"He","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"168251","DOI":"10.1016\/j.ijleo.2021.168251","article-title":"Naturalness balance contrast enhancement using adaptive gamma with cumulative histogram and median filtering","volume":"251","author":"Singh","year":"2022","journal-title":"Optik"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Shen, X., Xu, L., and Jia, J. (2014, January 6\u201312). Rolling guidance filter. Proceedings of the Computer Vision\u2014ECCV 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10578-9_53"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4008","DOI":"10.1109\/JBHI.2022.3179652","article-title":"Masked Joint Bilateral Filtering via Deep Image Prior for Digital X-Ray Image Denoising","volume":"26","author":"Wu","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_42","unstructured":"Alexander, T. (2014). TNO Image Fusion Dataset, TNO."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Liu, J., Fan, X., Huang, Z., Wu, G., and Liu, R. (2022, January 21\u201324). Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00571"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"211301","DOI":"10.1007\/s11432-019-2757-1","article-title":"Perceptual image quality assessment: A survey","volume":"63","author":"Zhai","year":"2020","journal-title":"Sci. China Inf. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5462","DOI":"10.1109\/TIP.2017.2735192","article-title":"Unified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images","volume":"26","author":"Min","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1109\/TBC.2018.2816783","article-title":"Blind Image Quality Estimation via Distortion Aggravation","volume":"64","author":"Min","year":"2018","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2049","DOI":"10.1109\/TMM.2017.2788206","article-title":"Blind Quality Assessment Based on Pseudo-Reference Image","volume":"20","author":"Min","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Huang, Y., Bi, D., and Wu, D. (2018). Infrared and visible image fusion based on different constraints in the non-subsampled shearlet transform domain. Sensors, 18.","DOI":"10.3390\/s18041169"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Lv, M., Li, L., Jin, Q., Jia, Z., Chen, L., and Ma, H. (2023). Multi-Focus Image Fusion via Distance-Weighted Regional Energy and Structure Tensor in NSCT Domain. Sensors, 23.","DOI":"10.3390\/s23136135"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1007\/s11760-022-02188-1","article-title":"An adaptive bilateral filtering method based on improved convolution kernel used for infrared image enhancement","volume":"16","author":"Lv","year":"2022","journal-title":"Signal Image Video Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8101\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:59:10Z","timestamp":1760129950000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/19\/8101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":50,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23198101"],"URL":"https:\/\/doi.org\/10.3390\/s23198101","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]}}}