{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T04:22:58Z","timestamp":1773721378064,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T00:00:00Z","timestamp":1658361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2019YFC0117800"],"award-info":[{"award-number":["2019YFC0117800"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, deep convolutional neural network (CNN)-based image enhancement has shown outstanding performance. However, due to the problems of uneven illumination and low contrast existing in endoscopic images, the implementation of medical endoscopic image enhancement using CNN is still an exploratory and challenging task. An endoscopic image enhancement network (EIEN) based on the Retinex theory is proposed in this paper to solve these problems. The structure consists of three parts: decomposition network, illumination correction network, and reflection component enhancement algorithm. First, the decomposition network model of pre-trained Retinex-Net is retrained on the endoscopic image dataset, and then the images are decomposed into illumination and reflection components by this decomposition network. Second, the illumination components are corrected by the proposed self-attention guided multi-scale pyramid structure. The pyramid structure is used to capture the multi-scale information of the image. The self-attention mechanism is based on the imaging nature of the endoscopic image, and the inverse image of the illumination component is fused with the features of the green and blue channels of the image to be enhanced to generate a weight map that reassigns weights to the spatial dimension of the feature map, to avoid the loss of details in the process of multi-scale feature fusion and image reconstruction by the network. The reflection component enhancement is achieved by sub-channel stretching and weighted fusion, which is used to enhance the vascular information and image contrast. Finally, the enhanced illumination and reflection components are multiplied to obtain the reconstructed image. We compare the results of the proposed method with six other methods on a test set. The experimental results show that EIEN enhances the brightness and contrast of endoscopic images and highlights vascular and tissue information. At the same time, the method in this paper obtained the best results in terms of visual perception and objective evaluation.<\/jats:p>","DOI":"10.3390\/s22145464","type":"journal-article","created":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T22:38:50Z","timestamp":1658443130000},"page":"5464","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["EIEN: Endoscopic Image Enhancement Network Based on Retinex Theory"],"prefix":"10.3390","volume":"22","author":[{"given":"Ziheng","family":"An","sequence":"first","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Qian","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jubao","family":"Han","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Tan","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dou","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qianqian","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Anhui University, Hefei 230601, China"},{"name":"AnHui Engineering Laboratory of Agro-Ecological Big Data, Hefei 230601, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5518948","DOI":"10.1155\/2021\/5518948","article-title":"TXI: Texture and color enhancement imaging for endoscopic image enhancement","volume":"2021","author":"Sato","year":"2021","journal-title":"J. Healthc. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization, and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1752","DOI":"10.1109\/TCE.2007.4429280","article-title":"Brightness preserving dynamic histogram equalization for image contrast enhancement","volume":"53","author":"Ibrahim","year":"2007","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/76.915354","article-title":"An advanced contrast enhancement using partially overlapped sub-block histogram equalization","volume":"11","author":"Kim","year":"2001","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"106077","DOI":"10.1016\/j.asoc.2020.106077","article-title":"Fuzzy dissimilarity color histogram equalization for contrast enhancement and color correction","volume":"89","author":"Veluchamy","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1109\/TIP.2012.2226047","article-title":"Efficient contrast enhancement using adaptive gamma correction with weighting distribution","volume":"22","author":"Huang","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/83.557356","article-title":"Properties and performance of a center\/surround retinex","volume":"6","author":"Jobson","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rahman, Z., Jobson, D.J., and Woodell, G.A. (1996, January 4\u20139). Multiscale retinex for color rendition and dynamic range compression. Proceedings of the SPIE\u2019s 1996 International Symposium on Optical Science, Engineering, and Instrumentation, Denver, CO, USA.","DOI":"10.1117\/12.258224"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/83.597272","article-title":"A multiscale retinex for bridging the gap between color images and the human observation of scenes","volume":"6","author":"Jobson","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fu, X., Zeng, D., Huang, Y., Zhang, X.-P., and Ding, X. (2016, January 27\u201330). A weighted variational model for simultaneous reflectance and illumination estimation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.304"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/TIP.2016.2639450","article-title":"LIME: Low-light image enhancement via illumination map estimation","volume":"26","author":"Guo","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e2396","DOI":"10.1002\/rcs.2396","article-title":"Endoscopic image luminance enhancement based on the inverse square law for illuminance and retinex","volume":"18","author":"Wang","year":"2022","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1016\/j.patcog.2016.06.008","article-title":"LLNet: A deep autoencoder approach to natural low-light image enhancement","volume":"61","author":"Lore","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_14","unstructured":"Wei, C., Wang, W., Yang, W., and Liu, J. (2018). Deep retinex decomposition for low-light enhancement. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2340","DOI":"10.1109\/TIP.2021.3051462","article-title":"Enlightengan: Deep light enhancement without paired supervision","volume":"30","author":"Jiang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Guo, C., Li, C., Guo, J., Loy, C.C., Hou, J., Kwong, S., and Cong, R. (2020, January 13\u201319). Zero-reference deep curve estimation for low-light image enhancement. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00185"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3153","DOI":"10.1109\/TMM.2020.3021243","article-title":"Luminance-aware pyramid network for low-light image enhancement","volume":"23","author":"Li","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jiang, Q., Mao, Y., Cong, R., Ren, W., Huang, C., and Shao, F. (2022). Unsupervised Decomposition and Correction Network for Low-Light Image Enhancement. IEEE Trans. Intell. Transp. Syst., 1\u201316.","DOI":"10.1109\/TITS.2022.3165176"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1794","DOI":"10.1109\/TNNLS.2019.2926481","article-title":"Lightweight pyramid networks for image deraining","volume":"31","author":"Fu","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gao, Z., Xie, J., Wang, Q., and Li, P. (2019, January 15\u201320). Global second-order pooling convolutional networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00314"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18\u201323). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1109\/LSP.2020.2965824","article-title":"Unsupervised low-light image enhancement using bright channel prior","volume":"27","author":"Lee","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_25","first-page":"180167","article-title":"A vascular enhancement algorithm for endoscope image","volume":"46","author":"Hongpeng","year":"2019","journal-title":"Opto-Electron. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3097","DOI":"10.1109\/TIP.2011.2158229","article-title":"An augmented Lagrangian method for total variation video restoration","volume":"20","author":"Chan","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_28","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8\u201314). Pytorch: An imperative style, high-performance deep learning library. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada."},{"key":"ref_29","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image Quality Metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1109\/TIP.2013.2293423","article-title":"Gradient magnitude similarity deviation: A highly efficient perceptual image quality index","volume":"23","author":"Xue","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201ccompletely blind\u201d image quality analyzer","volume":"20","author":"Mittal","year":"2012","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5464\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:55:53Z","timestamp":1760140553000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,21]]},"references-count":33,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22145464"],"URL":"https:\/\/doi.org\/10.3390\/s22145464","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,21]]}}}