{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T17:45:37Z","timestamp":1787161537639,"version":"build-2736575974"},"reference-count":49,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2018,11,27]],"date-time":"2018-11-27T00:00:00Z","timestamp":1543276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The spatial resolution and clarity of remote sensing images are crucial for many applications such as target detection and image classification. In the last several decades, tremendous image restoration tasks have shown great success in ordinary images. However, since remote sensing images are more complex and more blurry than ordinary images, most of the existing methods are not good enough for remote sensing image restoration. To address such problem, we propose a novel method named deep memory connected network (DMCN) based on the convolutional neural network to reconstruct high-quality images. We build local and global memory connections to combine image detail with global information. To further reduce parameters and ease time consumption, we propose Downsampling Units, shrinking the spatial size of feature maps. We verify its capability on two representative applications, Gaussian image denoising and single image super-resolution (SR). DMCN is tested on three remote sensing datasets with various spatial resolution. Experimental results indicate that our method yields promising improvements and better visual performance over the current state-of-the-art. The PSNR and SSIM improvements over the second best method are up to 0.3 dB.<\/jats:p>","DOI":"10.3390\/rs10121893","type":"journal-article","created":{"date-parts":[[2018,11,27]],"date-time":"2018-11-27T12:17:35Z","timestamp":1543321055000},"page":"1893","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Deep Memory Connected Neural Network for Optical Remote Sensing Image Restoration"],"prefix":"10.3390","volume":"10","author":[{"given":"Wenjia","family":"Xu","sequence":"first","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guangluan","family":"Xu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xian","family":"Sun","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8352-0081","authenticated-orcid":false,"given":"Daoyu","family":"Lin","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yirong","family":"Wu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Haut, J.M., Fernandez-Beltran, R., Paoletti, M.E., Plaza, J., Plaza, A., and Pla, F. (2018). A New Deep Generative Network for Unsupervised Remote Sensing Single-Image Super-Resolution. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2018.2843525"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1109\/LGRS.2018.2796604","article-title":"Progressive Dual-Domain Filter for Enhancing and Denoising Optical Remote-Sensing Images","volume":"15","author":"Huang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_3","unstructured":"Chang, H., Yeung, D.Y., and Xiong, Y. (July, January 27). Super-resolution through neighbor embedding. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/38.988747","article-title":"Example-based super-resolution","volume":"22","author":"Freeman","year":"2002","journal-title":"IEEE Comput. Gr. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","article-title":"Image denoising by sparse 3-D transform-domain collaborative filtering","volume":"16","author":"Dabov","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3736","DOI":"10.1109\/TIP.2006.881969","article-title":"Image denoising via sparse and redundant representations over learned dictionaries","volume":"15","author":"Elad","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1838","DOI":"10.1109\/TIP.2011.2108306","article-title":"Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization","volume":"20","author":"Dong","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yair, N., and Michaeli, T. (2018, January 18\u201321). Multi-Scale Weighted Nuclear Norm Image Restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00334"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gu, S., Zhang, L., Zuo, W., and Feng, X. (2014, January 23\u201328). Weighted nuclear norm minimization with application to image denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.366"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","unstructured":"Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11\u201313). Deep sparse rectifier neural networks. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA."},{"key":"ref_13","unstructured":"Ioffe, S., and Szegedy, C. (arXiv, 2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift, arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Haris, M., Shakhnarovich, G., and Ukita, N. (2018, January 20). Deep backprojection networks for super-resolution. Proceedings of the Conference on Computer Vision and Pattern Recognition, Beijing, China.","DOI":"10.1109\/CVPR.2018.00179"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201322). Residual dense network for image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lefkimmiatis, S. (2018, January 18\u201322). Universal Denoising Networks: A Novel CNN Architecture for Image Denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00338"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, J., Chen, J., Chao, H., and Yang, M. (2018, January 18\u201322). Image Blind Denoising With Generative Adversarial Network Based Noise Modeling. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00333"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1109\/JPROC.2017.2675998","article-title":"Remote sensing image scene classification: Benchmark and state of the art","volume":"105","author":"Cheng","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 13\u201316). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_22","unstructured":"Kingma, D.P., and Ba, J. (arXiv, 2014). Adam: A method for stochastic optimization, arXiv."},{"key":"ref_23","first-page":"2275","article-title":"Remote Sensing Image Denoising Using Patch Grouping-Based Nonlocal Means Algorithm","volume":"14","author":"Xu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","unstructured":"Kwan, C., and Zhou, J. (2015). Method for Image Denoising. (Patent 9,159,121)."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5366","DOI":"10.1109\/TGRS.2017.2706326","article-title":"Denoising of hyperspectral images using nonconvex low rank matrix approximation","volume":"55","author":"Chen","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fan, Y.R., Huang, T.Z., Zhao, X.L., Deng, L.J., and Fan, S. (2018). Multispectral Image Denoising via Nonlocal Multitask Sparse Learning. Remote Sens., 10.","DOI":"10.3390\/rs10010116"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Loncan, L., Almeida, L.B., Bioucas-Dias, J.M., Briottet, X., Chanussot, J., Dobigeon, N., Fabre, S., Liao, W., Licciardi, G.A., and Simoes, M. (arXiv, 2015). Hyperspectral pansharpening: A review, arXiv.","DOI":"10.1109\/MGRS.2015.2440094"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpening algorithms","volume":"53","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kwan, C., Choi, J., Chan, S., Zhou, J., and Budavari, B. (2018). A super-resolution and fusion approach to enhancing hyperspectral images. Remote Sens., 10.","DOI":"10.3390\/rs10091416"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. (2008, January 5\u20139). Extracting and composing robust features with denoising autoencoders. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390294"},{"key":"ref_31","unstructured":"Jain, V., and Seung, S. (2008, January 8\u201311). Natural image denoising with convolutional networks. Proceedings of the 21st International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1256","DOI":"10.1109\/TPAMI.2016.2596743","article-title":"Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration","volume":"39","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mildenhall, B., Barron, J.T., Chen, J., Sharlet, D., Ng, R., and Carroll, R. (2018, January 18\u201322). Burst Denoising with Kernel Prediction Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00265"},{"key":"ref_34","unstructured":"Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., and Aila, T. (arXiv, 2018). Noise2Noise: Learning Image Restoration without Clean Data, arXiv."},{"key":"ref_35","unstructured":"Putzky, P., and Welling, M. (arXiv, 2017). Recurrent inference machines for solving inverse problems, arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016, January 8\u201316). Accelerating the super-resolution convolutional neural network. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_37","unstructured":"Kim, J., Kwon Lee, J., and Mu Lee, K. (July, January 26). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1109\/JSTARS.2017.2655112","article-title":"Hyperspectral image superresolution by transfer learning","volume":"10","author":"Yuan","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Qu, Y., Qi, H., and Kwan, C. (2018, January 18\u201322). Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00266"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Shocher, A., Cohen, N., and Irani, M. (2018, January 20). Zero-Shot super-resolution using deep internal learning. Proceedings of the Conference on Computer Vision and Pattern Recognition, Beijing, China.","DOI":"10.1109\/CVPR.2018.00329"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A.P., Tejani, A., Totz, J., and Wang, Z. (2017, January 22\u201325). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the CVPR, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sajjadi, M.S., Vemulapalli, R., and Brown, M. (2018, January 18\u201322). Frame-Recurrent Video Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00693"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27\u201330). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing And Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Newell, A., Yang, K., and Deng, J. (2016, January 8\u201316). Stacked hourglass networks for human pose estimation. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 3\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference On Advances in Geographic Information Systems, San Jose, CA, UAS.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1109\/LGRS.2017.2704122","article-title":"Super-Resolution for Remote Sensing Images via Local-Global Combined Network","volume":"14","author":"Lei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TASSP.1981.1163711","article-title":"Cubic convolution interpolation for digital image processing","volume":"29","author":"Keys","year":"1981","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Timofte, R., De Smet, V., and Van Gool, L. (2014, January 1\u20135). A+: Adjusted anchored neighborhood regression for fast super-resolution. Proceedings of the Asian Conference on Computer Vision, Singapore.","DOI":"10.1109\/ICCV.2013.241"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/12\/1893\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:32:39Z","timestamp":1760196759000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/12\/1893"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,27]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["rs10121893"],"URL":"https:\/\/doi.org\/10.3390\/rs10121893","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,27]]}}}