{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:09:00Z","timestamp":1760238540461,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Nowadays, the sizes of pixel sensors in digital cameras are decreasing as the resolution of the image sensor increases. Due to the decreased size, the pixel sensors receive less light energy, which makes it more sensitive to thermal noise. Even a small amount of noise in the color filter array (CFA) can have a significant effect on the reconstruction of the color image, as two-thirds of the missing data would have to be reconstructed from noisy data; because of this, direct denoising would need to be performed on the raw CFA to obtain a high-resolution color image. In this paper, we propose an interchannel nonlocal weighted moving least square method for the noise removal of the raw CFA. The proposed method is our first attempt of applying a two dimensional (2-D) polynomial approximation to denoising the CFA. Previous works make use of 2-D linear or directional 1-D polynomial approximations. The reason that 2-D polynomial approximation methods have not been applied to this problem is the difficulty of the weight control in the 2-D polynomial approximation method, as a small amount of noise can have a large effect on the approximated 2-D shape. This makes CFA denoising more important, as the approximated 2-D shape has to be reconstructed from only one-third of the original data. To address this problem, we propose a method that reconstructs the approximated 2-D shapes corresponding to the RGB color channels based on the measure of the similarities of the patches directly on the CFA. By doing so, the interchannel information is incorporated into the denoising scheme, which results in a well-controlled and higher order of polynomial approximation of the color channels. Compared to other nonlocal-mean-based denoising methods, the proposed method uses an extra reproducing constraint, which guarantees a certain degree of the approximation order; therefore, the proposed method can reduce the number of false reconstruction artifacts that often occur in nonlocal-mean-based denoising methods. Experimental results demonstrate the performance of the proposed algorithm.<\/jats:p>","DOI":"10.3390\/s20174697","type":"journal-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T09:35:31Z","timestamp":1597916131000},"page":"4697","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Joint Demosaicing and Denoising Based on Interchannel Nonlocal Mean Weighted Moving Least Squares Method"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2198-0899","authenticated-orcid":false,"given":"Yeahwon","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Mathematics, Graduate School, Kyung Hee University, Seoul 02447, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4735-4861","authenticated-orcid":false,"given":"Hohyung","family":"Ryu","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Graduate School, Kyung Hee University, Seoul 02447, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1126-0660","authenticated-orcid":false,"given":"Sunmi","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Applied Mathematics, Kyung Hee University, Yongin 446-701, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yeon Ju","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Applied Mathematics, Korea University, Sejong 30019, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"ref_1","unstructured":"Bayer, B. (1976). Color Imaging Array. (3971065 A), U.S. Patent."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5369","DOI":"10.1109\/TIP.2016.2604489","article-title":"Bayer demosaicing with polynomial interpolation","volume":"25","author":"Wu","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/TIP.2009.2017171","article-title":"Self-similarity driven demosaicing","volume":"18","author":"Buades","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kiku, D., Monno, Y., Tanaka, M., and Okutomi, M. (2013, January 15\u201318). Residual interpolation for color image demosaicing. Proceedings of the 2013 IEEE International Conference on Image Processing(ICIP), Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738475"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided Image Filtering","volume":"53","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pekkucuksen, I., and Altunbasak, Y. (2010, January 12\u201315). Gradient based threshold free color filter array interpolation. Proceedings of the 2010 IEEE International Conference on Image Processing(ICIP), Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5654327"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Akiyama, H., Tanaka, M., and Okutomi, M. (2015, January 27\u201330). Pseudo four-channel image denoising for noisy CFA raw data. Proceedings of the 2015 IEEE International Conference on Image Processing(ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351714"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Danielyan, A., Vehvilainen, M., Foi, A., Katkovnik, V., and Egiazarian, K. (2009, January 19\u201321). Cross-color BM3D filtering of noisy raw data. Proceedings of the 2009 International Workshop on Local and Non-Local Approximation in Image Processing, Tuusalu, Finland.","DOI":"10.1109\/LNLA.2009.5278395"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tan, H., Zeng, X., Lai, S., Liu, Y., and Zhang, M. (2017, January 17\u201320). Joint demosaicing and denoising of noisy bayer images with ADMM. Proceedings of the 2017 IEEE International Conference on Image Processing(ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296823"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huang, T., Wu, F.F., Dong, W., Guangming, S., and Li, X. (2018, January 20\u201324). Lightweight deep residue learning for joint color image demosaicking and denoising. Proceedings of the 2018 International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8546057"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ehret, T., Davy, A., Arias, P., and Facciolo, G. (November, January 27). Joint Demosaicking and denoising by fine-tuning of bursts of raw images. Proceedings of the 2019 International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00896"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4177","DOI":"10.1109\/TIP.2019.2905991","article-title":"Iterative joint image demosaicking and denoising wsing a residual denoising network","volume":"28","author":"Kokkinos","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Klatzer, T., Hammernik, K., Knobelreiter, P., and Pock, T. (2016, January 13\u201315). Learning joint demosaicing and denoising based on sequential energy minimization. Proceedings of the 2016 IEEE International Conference on Computational Photography (ICCP), Evanston, IL, USA.","DOI":"10.1109\/ICCPHOT.2016.7492871"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2980179.2982399","article-title":"Deep Joint Demosaicking and Denoising","volume":"35","author":"Gharbi","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7367608","DOI":"10.1155\/2020\/7367608","article-title":"Image Demosaicing based on generative adversarial network","volume":"2020","author":"Luo","year":"2020","journal-title":"Math. Probl. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1364\/OE.372746","article-title":"Hyperspectral imaging from a raw mosaic image with end-to-end learning","volume":"28","author":"Fu","year":"2020","journal-title":"Opt. Express"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1109\/TIP.2018.2872858","article-title":"DeepISP: Toward kearning an end-to-end image processing pipeline","volume":"28","author":"Schwartz","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"15678","DOI":"10.1364\/OE.391253","article-title":"Color reproduction pipeline for an RGBW color filter array sensor","volume":"28","author":"Choi","year":"2020","journal-title":"Opt. Express"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kwan, C., and Larkin, J. (2019). Demosaicing of bayer and CFA 2.0 patterns for low lighting images. Electronics, 8.","DOI":"10.3390\/electronics8121444"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"013018","DOI":"10.1117\/1.JEI.28.1.013018","article-title":"Hardware-efficient color correlation-adaptive demosaicing with multifiltering","volume":"28","author":"Lee","year":"2019","journal-title":"J. Electron. Imaging"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Szczepanski, M., and Giemza, F. (2020). Noise removal in the developing process of digital negatives. Sensors, 20.","DOI":"10.3390\/s20030902"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"050401","DOI":"10.2352\/J.ImagingSci.Technol.2018.62.5.050401","article-title":"Demosaicing of periodic and random color filter arrays by linear anisotropic diffusion","volume":"62","author":"Thomas","year":"2018","journal-title":"J. Imaging Sci. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mihoubi, S., Lapray, P., and Bigue, L. (2018). Survey of demosaicking methods for polarization filter array images. Sensors, 18.","DOI":"10.3390\/s18113688"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sober, B., and Levin, D. (2019). Manifold approximation by moving least-squares projection (MMLS). Constr. Approx.","DOI":"10.1007\/s00365-019-09489-8"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"84950","DOI":"10.1109\/ACCESS.2020.2990463","article-title":"Medical image denoising based on biquadratic polynomial with minimum error constraints and low-rank approximation","volume":"8","author":"Ji","year":"2020","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s13634-018-0598-9","article-title":"Orthogonality is superiority in piecewise-polynomial signal segmentation and denoising","volume":"2019","author":"Novosadova","year":"2019","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1109\/TIP.2006.888330","article-title":"Kernel regression for image processing and reconstruction","volume":"16","author":"Takeda","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2239","DOI":"10.1109\/TIP.2006.877406","article-title":"Superresolution and noise filtering using moving least squares","volume":"15","author":"Bose","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2682","DOI":"10.1109\/TIP.2010.2050108","article-title":"Nonlinear image upsampling method based on radial basis function interpolation","volume":"19","author":"Lee","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","first-page":"5857","article-title":"Modified moving least squares method for two-dimensional linear and nonlinear systems of integral equations","volume":"37","author":"MatinFar","year":"2018","journal-title":"Appl. Math."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"7203204","DOI":"10.1109\/TMAG.2019.2900374","article-title":"Modified Improved Interpolating Moving Least Squares Method for Meshless Approaches","volume":"55","author":"Fujita","year":"2019","journal-title":"IEEE Trans. Magn."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2018.11.001","article-title":"Probabilistic moving least squares with spatial constraints for nonlinear color transfer between images","volume":"180","author":"Hwang","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1007\/s10851-013-0428-5","article-title":"A framework for moving least squares method with total variation minimizing regularization","volume":"48","author":"Lee","year":"2013","journal-title":"J Math. Imaging Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1137\/080725891","article-title":"The split bregman method for L1-regularized problems","volume":"2","author":"Goldstein","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1090\/S0025-5718-98-00974-0","article-title":"The approximation power of moving least-squares","volume":"67","author":"Levin","year":"1998","journal-title":"Math. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4697\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:03:53Z","timestamp":1760177033000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4697"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":35,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20174697"],"URL":"https:\/\/doi.org\/10.3390\/s20174697","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,20]]}}}