{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T10:50:41Z","timestamp":1761648641455,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,6,7]],"date-time":"2019-06-07T00:00:00Z","timestamp":1559865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS1329481"],"award-info":[{"award-number":["CNS1329481"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R01EB019460"],"award-info":[{"award-number":["R01EB019460"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we propose a novel multi-view image denoising algorithm based on convolutional neural network (MVCNN). Multi-view images are arranged into 3D focus image stacks (3DFIS) according to different disparities. The MVCNN is trained to process each 3DFIS and generate a denoised image stack that contains the recovered image information for regions of particular disparities. The denoised image stacks are then fused together to produce a denoised target view image using the estimated disparity map. Different from conventional multi-view denoising approaches that group similar patches first and then perform denoising on those patches, our CNN-based algorithm saves the effort of exhaustive patch searching and greatly reduces the computational time. In the proposed MVCNN, residual learning and batch normalization strategies are also used to enhance the denoising performance and accelerate the training process. Compared with the state-of-the-art single image and multi-view denoising algorithms, experiments show that the proposed CNN-based algorithm is a highly effective and efficient method in Gaussian denoising of multi-view images.<\/jats:p>","DOI":"10.3390\/s19112597","type":"journal-article","created":{"date-parts":[[2019,6,7]],"date-time":"2019-06-07T03:56:31Z","timestamp":1559879791000},"page":"2597","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Multi-View Image Denoising Using Convolutional Neural Network"],"prefix":"10.3390","volume":"19","author":[{"given":"Shiwei","family":"Zhou","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3427-0677","authenticated-orcid":false,"given":"Yu-Hen","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA"}]},{"given":"Hongrui","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI 53706, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/S0146-664X(81)80018-4","article-title":"Refined filtering of image noise using local statistics","volume":"15","author":"Lee","year":"1981","journal-title":"Comput. Graph. Image Process."},{"key":"ref_2","first-page":"10","article-title":"Multiview imaging and 3DTV","volume":"24","author":"Kutoba","year":"2007","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1620","DOI":"10.1109\/TIP.2012.2235847","article-title":"Nonlocally centralized sparse representation for image restoration","volume":"22","author":"Dong","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","unstructured":"Buades, A., Coll, B., and Morel, J.M. (2005, January 20\u201325). A non-local algorithm for image denoising. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, J., Guo, Y., Ying, Y., Liu, Y., and Peng, Q. (2006, January 8\u201311). Fast non-local algorithm for image denoising. Proceedings of the 2006 International Conference on Image Processing, Atlanta, GA, USA.","DOI":"10.1109\/ICIP.2006.312698"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","article-title":"Image denoising by sparse 3-D transform-domain collaborative filtering","volume":"16","author":"Dabov","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mairal, J., Bach, F., Ponce, J., Sapiro, G., and Zisserman, A. (October, January 29). Non-local sparse models for image restoration. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459452"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gu, S., Zhang, L., Zuo, W., and Feng, X. (2014, January 23\u201328). Weighted nuclear norm minimization with application to image denoising. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.366"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhang, L., Zuo, W., Zhang, D., and Feng, X. (2015, January 7\u201313). Patch group based nonlocal self-similarity prior learning for image denoising. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.36"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/83.563320","article-title":"Wavelet-based image denoising using a Markov random field a priori model","volume":"6","author":"Malfait","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","unstructured":"Roth, S., and Black, M.J. (2005, January 20\u201325). Fields of experts: A framework for learning image priors. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lan, X., Roth, S., Huttenlocher, D., and Black, M.J. (2006, January 7\u201313). Efficient belief propagation with learned higher-order Markov random fields. Proceedings of the European conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744047_21"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1068","DOI":"10.1109\/TPAMI.2007.70844","article-title":"A comparative study of energy minimization methods for markov random fields with smoothness-based priors","volume":"30","author":"Szeliski","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1137\/0917016","article-title":"Iterative methods for total variation denoising","volume":"17","author":"Vogel","year":"1996","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1023\/B:JMIV.0000011321.19549.88","article-title":"An algorithm for total variation minimization and applications","volume":"20","author":"Chambolle","year":"2004","journal-title":"J. Math. Imaging Vision"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1109\/TIP.2009.2028250","article-title":"Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems","volume":"18","author":"Beck","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3660","DOI":"10.1109\/TGRS.2012.2185054","article-title":"Hyperspectral image denoising employing a spectral-spatial adaptive total variation model","volume":"50","author":"Yuan","year":"2012","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3736","DOI":"10.1109\/TIP.2006.881969","article-title":"Image denoising via sparse and redundant representations over learned dictionaries","volume":"15","author":"Elad","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4311","DOI":"10.1109\/TSP.2006.881199","article-title":"K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation","volume":"54","author":"Aharon","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/TIP.2007.911828","article-title":"Sparse representation for color image restoration","volume":"17","author":"Mairal","year":"2008","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TBME.2012.2217493","article-title":"Group-sparse representation with dictionary learning for medical image denoising and fusion","volume":"59","author":"Li","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Barbu, A. (2009, January 20\u201325). Learning real-time MRF inference for image denoising. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206811"},{"key":"ref_24","unstructured":"Xie, J., Xu, L., and Chen, E. (2012, January 3\u20136). Image denoising and inpainting with deep neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schmidt, U., and Roth, S. (2014, January 23\u201328). Shrinkage fields for effective image restoration. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.349"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1256","DOI":"10.1109\/TPAMI.2016.2596743","article-title":"Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration","volume":"39","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Burger, H.C., Schuler, C.J., and Harmeling, S. (2012, January 16\u201321). Image denoising: Can plain neural network compete with BM3D?. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247952"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond gaussian denoiser: Residual learning of deep cnn for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4608","DOI":"10.1109\/TIP.2018.2839891","article-title":"FFDNet: Toward a fast and flexible solution for cnn based image denoising","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4509","DOI":"10.1109\/TIP.2017.2713099","article-title":"Deep convolutional neural network for inverse problems in imaging","volume":"26","author":"Jin","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","unstructured":"Guo, S., Yan, Z., Zhang, K., Zuo, W., and Zhang, L. (2018). Toward convolutional blind denoising of real photographs. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.cviu.2018.05.007","article-title":"Multiple view image denoising using 3D focus image stacks","volume":"171","author":"Zhou","year":"2018","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_33","unstructured":"Zhang, L., Vaddadi, S., Jin, H., and Nayar, S. (2009, January 20\u201325). Multiple view image denoising. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Luo, E., Chan, S.H., Pan, S., and Nguyen, T. (2013, January 15\u201318). Adaptive non-local means for multiview image denoising: Search for the right patches via a statistical approach. Proceedings of the 2013 IEEE International Conference on Image Processing, Melbourne, VIC, Australia.","DOI":"10.1109\/ICIP.2013.6738112"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xue, Z., Yang, J., Dai, Q., and Zhang, N. (2010, January 7\u20139). Multi-view image denoising based on graphical model of surface patch. Proceedings of the 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video, Tampere, Finland.","DOI":"10.1109\/3DTV.2010.5506488"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1967","DOI":"10.1109\/TIP.2015.2412373","article-title":"Image denoising by exploring external and internal correlations","volume":"24","author":"Yue","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Miyata, M., Kadoma, K., and Hamamoto, T. (2014, January 7\u201310). Fast multiple-view denoising based on image reconstruction by plane sweeping. Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference, Valletta, Malta.","DOI":"10.1109\/VCIP.2014.7051606"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Collins, R.T. (1996, January 18\u201320). A space-sweep approach to true multi-image matching. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.1996.517097"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1109\/LSP.2018.2861212","article-title":"Light field denoising via anisotropic parallax analysis in a CNN framework","volume":"25","author":"Chen","year":"2018","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fujita, S., Takahashi, K., and Fujii, T. (2018, January 7\u201310). How should we handle 4D light fields with CNNs?. Proceedings of the 25th IEEE International Conference on Image Processing, Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451419"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_42","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.jvcir.2009.02.002","article-title":"Error concealment of multi-view video sequences using inter-view and intra-view correlations","volume":"20","author":"Song","year":"2009","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Jing, X.Y., Hu, R., Zhu, Y.P., Wu, S., Liang, C., and Yang, J.Y. (2014, January 27\u201331). Intra-view and inter-view supervised correlation analysis for multi-view feature learning. Proceedings of the AAAI Conference on Artificial Intelligence, Qu\u00e9bec City, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8986"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","unstructured":"Kim, J., Kwon Lee, J., and Mu Lee, K. (July, January 26). Accurate image super-resolution using very deep convolution networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kim, J., Kwon Lee, J., and Mu Lee, K. Deeply-recursive convolutional network for image super-resolution. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition.","DOI":"10.1109\/CVPR.2016.181"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016, January 8\u201316). Accelerating the super-resolution convolutional neural network. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_49","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","unstructured":"Martin, D., Fowlkes, C., Tal, D., and Malik, J. (2001, January 7\u201314). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the IEEE International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_53","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., and Lenc, K. (2015, January 26\u201330). Matconvnet: Convolutional neural networks for matlab. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2807412"},{"key":"ref_55","unstructured":"(2019, March 01). Middlebury Multi-View Stereo Datasets. Available online: http:\/\/vision.middlebury.edu\/stereo\/data\/."},{"key":"ref_56","unstructured":"(2019, March 01). The (New) Stanford Light Field Archive. Available online: http:\/\/lightfield.stanford.edu\/lfs.html."},{"key":"ref_57","unstructured":"Honauer, K., Johannsen, O., Kondermann, D., and Goldluecke, B. (2016, January 20\u201324). A dataset and evaluation methodology for depth estimation on 4D light fields. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"3952","DOI":"10.1109\/TIP.2012.2199324","article-title":"Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms","volume":"21","author":"Maggioni","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. (2007, January 16\u201319). Color image denoising via sparse 3D collaborative filtering with grouping constraint in luminance-chrominance space. Proceedings of the IEEE International Conference on Image Processing, San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4378954"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Golub, G.H., and van Loan, C.F. (2012). Matrix Computations, JHU Press.","DOI":"10.56021\/9781421407944"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/11\/2597\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:56:50Z","timestamp":1760187410000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/11\/2597"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,7]]},"references-count":60,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["s19112597"],"URL":"https:\/\/doi.org\/10.3390\/s19112597","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,6,7]]}}}