{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T20:53:12Z","timestamp":1768078392620,"version":"3.49.0"},"reference-count":44,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2020R1C1C1009662"],"award-info":[{"award-number":["2020R1C1C1009662"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2020X1A3A1093880"],"award-info":[{"award-number":["NRF-2020X1A3A1093880"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We propose a novel generative adversarial network (GAN)-based image denoising method that utilizes heterogeneous losses. In order to improve the restoration quality of the structural information of the generator, the heterogeneous losses, including the structural loss in addition to the conventional mean squared error (MSE)-based loss, are used to train the generator. To maximize the improvements brought on by the heterogeneous losses, the strength of the structural loss is adaptively adjusted by the discriminator for each input patch. In addition, a depth wise separable convolution-based module that utilizes the dilated convolution and symmetric skip connection is used for the proposed GAN so as to reduce the computational complexity while providing improved denoising quality compared to the convolutional neural network (CNN) denoiser. The experiments showed that the proposed method improved visual information fidelity and feature similarity index values by up to 0.027 and 0.008, respectively, compared to the existing CNN denoiser.<\/jats:p>","DOI":"10.3390\/s21041191","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T04:33:46Z","timestamp":1612931626000},"page":"1191","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Generative Adversarial Network-Based Image Denoiser Controlling Heterogeneous Losses"],"prefix":"10.3390","volume":"21","author":[{"given":"Sung In","family":"Cho","sequence":"first","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul 04620, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6233-4394","authenticated-orcid":false,"given":"Jae Hyeon","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Multimedia Engineering, Dongguk University, Seoul 04620, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4809-956X","authenticated-orcid":false,"given":"Suk-Ju","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Sogang University, Seoul 121-742, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zuo, W., Gu, S., and Zhang, L. (2017, January 22\u201325). Learning deep CNN denoiser prior for image restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.300"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/34.56205","article-title":"Scale-space and edge detection using anisotropic diffusion","volume":"12","author":"Perona","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_4","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 4\u20137). Bilateral filtering for gray and color images. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Bombay, India."},{"key":"ref_5","unstructured":"Buades, A., Coll, B., and Morel, J.M. (2005, January 20\u201326). A non-local algorithm for image denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","article-title":"Image denoising by sparse 3-D transform-domain collaborative filtering","volume":"16","author":"Dabov","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gu, S., Zhang, L., Zuo, W., and Feng, X. (2014, January 24\u201327). Weighted nuclear norm minimization with application to image denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.366"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhang, L., Zhang, D., and Feng, X. (2017, January 22\u201329). Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.125"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Burger, H.C., Schuler, C.J., and Harmeling, S. (2012, January 18\u201320). Image denoising: Can plain neural networks compete with BM3D?. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247952"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tai, Y., Yang, J., Liu, X., and Xu, C. (2017, January 22\u201329). MemNet: A Persistent Memory Network for Image Restoration. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.486"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4608","DOI":"10.1109\/TIP.2018.2839891","article-title":"Ffdnet: Toward a fast and flexible solution for cnn-based image denoising","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Guo, S., Yan, Z., Zhang, K., Zuo, W., and Zhang, L. (2019, January 16\u201320). Toward convolutional blind denoising of real photographs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00181"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, J., Chen, J., Chao, H., and Yang, M. (2018, January 19\u201321). Image blind denoising with generative adversarial network based noise modeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00333"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.1109\/TMM.2018.2820910","article-title":"Highly Accurate Image Reconstruction for Multimodal Noise Suppression Using Semisupervised Learning on Big Data","volume":"20","author":"Yin","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hou, X., Luo, H., Liu, J., Xu, B., Sun, K., Gong, Y., Liu, B., and Qiu, G. (2019, January 16\u201320). Learning Deep Image Priors for Blind Image Denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00224"},{"key":"ref_17","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mehdi, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_18","unstructured":"Sifre, L. (2014). Rigid-Motion Scattering for Image Classification. [Ph.D. Thesis, Ecole Polytechnique University]."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1109\/TMM.2018.2859791","article-title":"Gradient Prior-aided CNN Denoiser with Separable Convolution-based Optimization of Feature Dimension","volume":"21","author":"Cho","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning (ICML), Lille, France."},{"key":"ref_21","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_22","unstructured":"Yu, F., and Koltun, V. (2016, January 2\u20134). Multi-scale context aggregation by dilated convolutions. Proceedings of the International Conference on Learning Representations (ICLR), San Juan, Puerto Rico."},{"key":"ref_23","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 20). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_24","unstructured":"(2021, January 19). CIPR Database. Available online: http:\/\/www.cipr.rpi.edu\/resource\/stills\/index.html."},{"key":"ref_25","unstructured":"Jones, K. (2008). Methods of measurement for the power consumption of audio, video and related equipment. ENERGY STAR Program. Requirements for Displays, ENERGY STAR Program Requirements for Displays."},{"key":"ref_26","unstructured":"(2021, January 19). Football Sequences. Available online: http:\/\/media.xiph.org\/video\/derf\/."},{"key":"ref_27","first-page":"1738","article-title":"Geodesic path-based diffusion acceleration for image denoising","volume":"20","author":"Cho","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_28","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/7.8.2","article-title":"Local figure\u2013ground cues are valid for natural images","volume":"7","author":"Fowlkes","year":"2007","journal-title":"J. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TIP.2016.2631888","article-title":"Waterloo exploration database: New challenges for image quality assessment models","volume":"26","author":"Ma","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/TIP.2005.859378","article-title":"Image information and visual quality","volume":"15","author":"Sheikh","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","article-title":"FSIM: A feature similarity index for image quality assessment","volume":"20","author":"Zhang","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4447","DOI":"10.1109\/TIP.2013.2273671","article-title":"A perceptually relevant MSE-based image quality","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1109\/TCYB.2013.2278548","article-title":"From heuristic optimization to dictionary learning: A review and comprehensive comparison of image denoising algorithms","volume":"44","author":"Shao","year":"2014","journal-title":"IEEE Trans. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1109\/TIP.2011.2179057","article-title":"Automatic single-image-based rain streaks removal via image decomposition","volume":"21","author":"Kang","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"4587","DOI":"10.1109\/TIP.2013.2272517","article-title":"Enhancement of Backlight-Scaled Images","volume":"22","author":"Huang","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/TCE.2012.6227469","article-title":"Fast multi-exposure image fusion with median filter and recursive filter","volume":"58","author":"Li","year":"2012","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/TMM.2015.2512046","article-title":"CCR: Clustering and collaborative representation for fast single image super-resolution","volume":"18","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TMM.2016.2599145","article-title":"Single image super-resolution via locally regularized anchored neighborhood regression and nonlocal means","volume":"19","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/TMM.2016.2608780","article-title":"PLTD: Patch-based low-rank tensor decomposition for hyperspectral images","volume":"19","author":"Du","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3455","DOI":"10.1109\/TIP.2011.2150234","article-title":"Image interpolation via regularized local linear regression","volume":"20","author":"Liu","year":"2011","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1191\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:21:21Z","timestamp":1760160081000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1191"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,8]]},"references-count":44,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041191"],"URL":"https:\/\/doi.org\/10.3390\/s21041191","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,8]]}}}