{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T07:16:15Z","timestamp":1763968575794,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology (MOST), Taiwan","award":["111-2221-E-011-146-MY2"],"award-info":[{"award-number":["111-2221-E-011-146-MY2"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In computer vision tasks, the ability to remove rain from a single image is a crucial element to enhance the effectiveness of subsequent high-level tasks in rainy conditions. Recently, numerous data-driven single-image deraining techniques have emerged, primarily relying on paired images (i.e., in a supervised manner). However, when dealing with real deraining tasks, it is common to encounter unpaired images. In such scenarios, removing rain streaks in an unsupervised manner becomes a challenging task, as there are no constraints between images, resulting in suboptimal restoration results. In this paper, we introduce a new unsupervised single-image deraining method called SE-RRACycleGAN, which does not require a paired dataset for training and can effectively leverage the constrained transfer learning capability and cyclic structures inherent in CycleGAN. Since rain removal is closely associated with the analysis of texture features in an input image, we proposed a novel recurrent rain attentive module (RRAM) to enhance rain-related information detection by simultaneously considering both rainy and rain-free images. We also utilize the squeeze-and-excitation enhancement technique to the generator network to effectively capture spatial contextual information among channels. Finally, content loss is introduced to enhance the visual similarity between the input and generated images. Our method excels at removing numerous rain streaks, preserving a smooth background, and closely resembling the ground truth compared to other approaches, based on both quantitative and qualitative results, without the need for paired training images. Extensive experiments on synthetic and real-world datasets demonstrate that our approach shows superiority over most unsupervised state-of-the-art techniques, particularly on the Rain12 dataset (achieving a PSNR of 34.60 and an SSIM of 0.954) and real rainy images (achieving a PSNR of 34.17 and an SSIM of 0.953), and is highly competitive when compared to supervised methods. Moreover, the performance of our model is evaluated using RMSE, FSIM, MAE, and the correlation coefficient, achieving remarkable results that indicate a high degree of accuracy in rain removal and strong preservation of the original image\u2019s structural details.<\/jats:p>","DOI":"10.3390\/rs16142642","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T13:12:57Z","timestamp":1721394777000},"page":"2642","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["SE-RRACycleGAN: Unsupervised Single-Image Deraining Using Squeeze-and-Excitation-Based Recurrent Rain-Attentive CycleGAN"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-1840-3115","authenticated-orcid":false,"given":"Getachew Nadew","family":"Wedajew","sequence":"first","affiliation":[{"name":"Graduate Institute of Automation and Control, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6951-2539","authenticated-orcid":false,"given":"Sendren Sheng-Dong","family":"Xu","sequence":"additional","affiliation":[{"name":"Graduate Institute of Automation and Control, National Taiwan University of Science and Technology, Taipei 106, Taiwan"},{"name":"Advanced Manufacturing Research Center, National Taiwan University of Science and Technology, Taipei 106, Taiwan"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1049\/iet-ipr.2018.6570","article-title":"Image super-resolution using conditional generative adversarial network","volume":"13","author":"Qiao","year":"2019","journal-title":"IET Image Process."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mao, J., Xiao, T., Jiang, Y., and Cao, Z. (2017, January 21\u201326). What can help pedestrian detection?. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.639"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R.W., and Yang, M.H. (2018, January 18\u201323). Vital: Visual tracking via adversarial learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00937"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., and Hu, S. (2016, January 27\u201330). Traffic-sign detection and classification in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.232"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1007\/s00170-020-06146-4","article-title":"Welding defect detection: Coping with artifacts in the production line","volume":"111","author":"Tripicchio","year":"2020","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.inffus.2021.09.005","article-title":"Real-world single image super-resolution: A brief review","volume":"79","author":"Chen","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1428","DOI":"10.1109\/JAS.2019.1911441","article-title":"Single image rain removal using image decomposition and a dense network","volume":"6","author":"Lian","year":"2019","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1109\/TIP.2018.2869722","article-title":"D3r-Net: Dynamic routing residue recurrent network for video rain removal","volume":"28","author":"Liu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, M., Xie, Q., Zhao, Q., Wei, W., Gu, S., Tao, J., and Meng, D. (2018, January 18\u201323). Video rain streak removal by multiscale convolutional sparse coding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00695"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1109\/TCSVT.2021.3068985","article-title":"EAGNet: Elementwise attentive gating network-based single image de-raining with rain simplification","volume":"32","author":"Ahn","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4788","DOI":"10.1109\/TIP.2021.3074804","article-title":"Deraincyclegan: Rain attentive cyclegan for single-image deraining and rainmaking","volume":"30","author":"Wei","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3727","DOI":"10.1007\/s00371-023-02947-2","article-title":"Cycle-Attention-Derain: Unsupervised rain removal with CycleGAN","volume":"39","author":"Chen","year":"2023","journal-title":"Vis. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1007\/s11760-021-01972-9","article-title":"DerainAttentionGAN: Unsupervised single-image deraining using attention-guided generative adversarial networks","volume":"16","author":"Guo","year":"2022","journal-title":"Signal Image Video Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4059","DOI":"10.1109\/TPAMI.2020.2995190","article-title":"single-image deraining: From model-based to data-driven and beyond","volume":"43","author":"Yang","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yu, X., Zhang, G., Tan, F., Li, F., and Xie, W. (2023). Progressive hybrid-modulated network for single-image deraining. Mathematics, 11.","DOI":"10.3390\/math11030691"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, T., Zhou, B., Luo, P., Zhang, Y., Niu, L., and Wang, G. (2022). Two-Stage and Two-Channel Attention single-image deraining Network for Promoting Ship Detection in Visual Perception System. Appl. Sci., 12.","DOI":"10.3390\/app12157766"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3664","DOI":"10.1109\/TNNLS.2020.3015897","article-title":"Rain streaks removal for single image via kernel-guided convolutional neural network","volume":"32","author":"Wang","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1109\/TIP.2011.2179057","article-title":"Automatic single-image-based rain streaks removal via image decomposition","volume":"21","author":"Kang","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Luo, Y., Xu, Y., and Ji, H. (2015, January 7\u201313). Removing rain from a single image via discriminative sparse coding. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.388"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y., Tan, R.T., Guo, X., Lu, J., and Brown, M.S. (2016, January 27\u201330). Rain streak removal using layer priors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.299"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3936","DOI":"10.1109\/TIP.2017.2708502","article-title":"A hierarchical approach for rain or snow removing in a single color image","volume":"26","author":"Wang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3943","DOI":"10.1109\/TCSVT.2019.2920407","article-title":"Image de-raining using a conditional generative adversarial network","volume":"30","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1109\/TPAMI.2019.2895793","article-title":"Joint rain detection and removal from a single image with contextualized deep networks","volume":"42","author":"Yang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_26","unstructured":"Zhu, H., Peng, X., Zhou, J.T., Yang, S., Chanderasekh, V., Li, L., and Lim, J.H. (February, January 27). Singe image rain removal with unpaired information: A differentiable programming perspective. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.neunet.2019.12.024","article-title":"Attention-guided CNN for image denoising","volume":"124","author":"Tian","year":"2020","journal-title":"Neural Netw."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1109\/TMM.2017.2648498","article-title":"Diversified visual attention networks for fine-grained object classification","volume":"19","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_29","unstructured":"Mnih, V., Heess, N., Graves, A., and Kavukcuoglu, K. (2014). Recurrent models of visual attention. Adv. Neural Inf. Process. Syst., 27."},{"key":"ref_30","first-page":"012068","article-title":"Attention-based CNNs for image classification: A survey","volume":"Volume 2171","author":"Zheng","year":"2022","journal-title":"Proceedings of the Journal of Physics: Conference Series"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Qian, R., Tan, R.T., Yang, W., Su, J., and Liu, J. (2018, January 18\u201323). Attentive generative adversarial network for raindrop removal from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00263"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6184713","DOI":"10.1155\/2018\/6184713","article-title":"Research on real-time local rainfall prediction based on MEMS sensors","volume":"2018","author":"Chao","year":"2018","journal-title":"J. Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"103592","DOI":"10.1016\/j.apor.2023.103592","article-title":"QSD-LSTM: Vessel trajectory prediction using long short-term memory with quaternion ship domain","volume":"136","author":"Liu","year":"2023","journal-title":"Appl. Ocean Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1123\/jab.2016-0355","article-title":"A comparison of self-selected walking speeds and walking speed variability when data are collected during repeated discrete trials and during continuous walking","volume":"33","author":"Brown","year":"2017","journal-title":"J. Appl. Biomech."},{"key":"ref_36","unstructured":"Zagoruyko, S., and Komodakis, N. (2016). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention: 18th International Conference, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2932","DOI":"10.1007\/s10489-020-01693-5","article-title":"single-image deraining via nonlocal squeeze-and-excitation enhancing network","volume":"50","author":"Wang","year":"2020","journal-title":"Appl. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8\u201314). Image super-resolution using very deep residual channel attention networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lee, H.Y., Tseng, H.Y., Huang, J.B., Singh, M., and Yang, M.H. (2018, January 8\u201314). Diverse image-to-image translation via disentangled representations. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_3"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4383","DOI":"10.1007\/s11042-020-09817-2","article-title":"Conditional generative adversarial network with densely-connected residual learning for single image super-resolution","volume":"80","author":"Qiao","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_43","first-page":"139","article-title":"Generative adversarial nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Du, R., Li, W., Chen, S., Li, C., and Zhang, Y. (2021). Unpaired underwater image enhancement based on cyclegan. Information, 13.","DOI":"10.3390\/info13010001"},{"key":"ref_45","unstructured":"Karen, S. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_47","unstructured":"Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2024, January 01). Automatic Differentiation in Pytorch. Available online: https:\/\/openreview.net\/forum?id=BJJsrmfCZ."},{"key":"ref_48","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Yang, W., Tan, R.T., Feng, J., Liu, J., Guo, Z., and Yan, S. (2017, January 21\u201326). Deep joint rain detection and removal from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.183"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wang, T., Yang, X., Xu, K., Chen, S., Zhang, Q., and Lau, R.W. (2019, January 15\u201320). Spatial attentive single-image deraining with a high quality real rain dataset. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01255"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wei, W., Meng, D., Zhao, Q., Xu, Z., and Wu, Y. (2019, January 15\u201320). Semi-supervised transfer learning for image rain removal. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00400"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"8","DOI":"10.4236\/jcc.2019.73002","article-title":"Image quality assessment through FSIM, SSIM, MSE and PSNR\u2014A comparative study","volume":"7","author":"Sara","year":"2019","journal-title":"J. Comput. Commun."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","article-title":"FSIM: A feature similarity index for image quality assessment","volume":"20","author":"Zhang","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3625818","article-title":"A Survey of Single Image Rain Removal Based on Deep Learning","volume":"56","author":"Su","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1057\/jt.2009.5","article-title":"The correlation coefficient: Its values range between +1\/\u22121, or do they?","volume":"17","author":"Ratner","year":"2009","journal-title":"J. Target. Meas. Anal. Mark."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Fu, X., Huang, J., Zeng, D., Huang, Y., Ding, X., and Paisley, J. (2017, January 21\u201326). Removing rain from single images via a deep detail network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.186"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"2944","DOI":"10.1109\/TIP.2017.2691802","article-title":"Clearing the skies: A deep network architecture for single-image rain removal","volume":"26","author":"Fu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Li, X., Wu, J., Lin, Z., Liu, H., and Zha, H. (2018, January 8\u201314). Recurrent squeeze-and-excitation context aggregation net for single image deraining. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_16"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Ren, D., Zuo, W., Hu, Q., Zhu, P., and Meng, D. (2019, January 15\u201320). Progressive image deraining networks: A better and simpler baseline. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00406"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"111101","DOI":"10.1007\/s11432-020-3225-9","article-title":"Survey on rain removal from videos or a single image","volume":"65","author":"Wang","year":"2022","journal-title":"Sci. China Inf. Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/14\/2642\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:19:45Z","timestamp":1760109585000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/14\/2642"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":61,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["rs16142642"],"URL":"https:\/\/doi.org\/10.3390\/rs16142642","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,7,19]]}}}