{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T15:57:02Z","timestamp":1768838222607,"version":"3.49.0"},"reference-count":37,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,1]],"date-time":"2019-08-01T00:00:00Z","timestamp":1564617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NASA Jet Propulsion Laboratory","award":["80NSSC17C0035"],"award-info":[{"award-number":["80NSSC17C0035"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The RGBW color filter arrays (CFA), also known as CFA2.0, contains R, G, B, and white (W) pixels. It is a 4 \u00d7 4 pattern that has 8 white pixels, 4 green pixels, 2 red pixels, and 2 blue pixels. The pattern repeats itself over the whole image. In an earlier conference paper, we cast the demosaicing process for CFA2.0 as a pansharpening problem. That formulation is modular and allows us to insert different pansharpening algorithms for demosaicing. New algorithms in interpolation and demosaicing can also be used. In this paper, we propose a new enhancement of our earlier approach by integrating a deep learning-based algorithm into the framework. Extensive experiments using IMAX and Kodak images clearly demonstrated that the new approach improved the demosaicing performance even further.<\/jats:p>","DOI":"10.3390\/jimaging5080068","type":"journal-article","created":{"date-parts":[[2019,8,1]],"date-time":"2019-08-01T11:39:37Z","timestamp":1564659577000},"page":"68","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Further Improvement of Debayering Performance of RGBW Color Filter Arrays Using Deep Learning and Pansharpening Techniques"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4341-0769","authenticated-orcid":false,"given":"Chiman","family":"Kwan","sequence":"first","affiliation":[{"name":"Applied Research LLC., Rockville, MD 20850, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bryan","family":"Chou","sequence":"additional","affiliation":[{"name":"Applied Research LLC., Rockville, MD 20850, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,1]]},"reference":[{"key":"ref_1","unstructured":"Bayer, B.E. (1976). Color Imaging Array. (3,971,065), U.S. Patent."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S1076-5670(10)62005-8","article-title":"Comparison of color demosaicing methods","volume":"162","author":"Losson","year":"2010","journal-title":"Adv. Imaging Electron Phys. Elsevier"},{"key":"ref_3","unstructured":"Kijima, T., Nakamura, H., Compton, J.T., Hamilton, J.F., and DeWeese, T.E. (2012). Image Sensor With Improved Light Sensitivity. (US 8,139,130), U.S. Patent."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kwan, C., Chou, B., Kwan, L.M., and Budavari, B. (2017, January 19\u201321). Debayering RGBW color filter arrays: A pansharpening approach. Proceedings of the IEEE Ubiquitous Computing, Electronics & Mobile Communication Conference, New York, NY, USA.","DOI":"10.1109\/UEMCON.2017.8248995"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"023016","DOI":"10.1117\/1.3600632","article-title":"Color demosaicking by local directional interpolation and nonlocal adaptive thresholding","volume":"20","author":"Zhang","year":"2011","journal-title":"J. Electron. Imaging"},{"key":"ref_6","first-page":"485","article-title":"High-quality linear interpolation for demosaciking of color images","volume":"3","author":"Malvar","year":"2004","journal-title":"IEEE Int. Conf. Acoust. Speech Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2515","DOI":"10.1109\/TIP.2007.904459","article-title":"Adaptive filtering for color filter array demosaicking","volume":"16","author":"Lian","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1007\/s11760-017-1216-2","article-title":"Demosaicking enhancement using pixel level fusion","volume":"12","author":"Kwan","year":"2018","journal-title":"J. Signal Image Video Process."},{"key":"ref_9","first-page":"2167","article-title":"Color demosaicking via directional linear minimum mean square-error estimation","volume":"14","author":"Zhang","year":"2005","journal-title":"IEEE Trans. IP"},{"key":"ref_10","first-page":"1194","article-title":"Color filter array demosaicking: New method and performance measures","volume":"12","author":"Lu","year":"2003","journal-title":"IEEE Trans. IP"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/LSP.2005.859503","article-title":"Frequency-domain methods for demosaicking of bayer-sampled color images","volume":"12","author":"Dubois","year":"2005","journal-title":"IEEE Signal Proc. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1109\/TIP.2002.801121","article-title":"Color plane interpolation using alternating projections","volume":"11","author":"Gunturk","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rafinazaria, M., and Dubois, E. (2015, January 9\u201312). Demosaicking algorithm for the Kodak-RGBW color filter array. Proceedings of the Color Imaging XX: Displaying, Processing, Hardcopy, and Applications, San Francisco, CA, USA.","DOI":"10.1117\/12.2083667"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.1109\/TIP.2011.2107524","article-title":"Least-squares luma-chroma demultiplexing algorithm for Bayer demosaicking","volume":"20","author":"Leung","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5173","DOI":"10.1109\/TIP.2016.2601266","article-title":"Universal demosaicking of color filter arrays","volume":"25","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Condat, L. (2009, January 7\u201310). A generic variational approach for demosaicking from an arbitrary color filter array. Proceedings of the IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.","DOI":"10.1109\/ICIP.2009.5413388"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2209","DOI":"10.1109\/TIP.2009.2025092","article-title":"Regularization approaches to demosaicking","volume":"18","author":"Menon","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1109\/TIP.2016.2633869","article-title":"Automatic design of high-sensitivity color filter arrays with panchromatic pixels","volume":"26","author":"Li","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"035024","DOI":"10.1117\/1.JRS.10.035024","article-title":"Hyperspectral image super-resolution: A hybrid color mapping approach","volume":"10","author":"Zhou","year":"2016","journal-title":"Appl. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kwan, C., Choi, J., Chan, S., Zhou, J., and Budavari, B. (2018). A Super-Resolution and fusion approach to enhancing hyperspectral images. Remote Sens., 10.","DOI":"10.3390\/rs10091416"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kwan, C., Budavari, B., and Feng, G. (2017). A hybrid color mapping approach to fusing MODIS and Landsat images for forward prediction. Remote Sens., 10.","DOI":"10.3390\/rs10040520"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4553","DOI":"10.1109\/JSTARS.2017.2716923","article-title":"A novel utilization of image registration techniques to process Mastcam images in Mars rover with applications to image fusion, pixel clustering, and anomaly detection","volume":"10","author":"Ayhan","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.1109\/LGRS.2017.2737820","article-title":"Blind quality assessment of fused WorldView-3 images by using the combinations of pansharpening and hypersharpening paradigms","volume":"14","author":"Kwan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Qu, Y., Qi, H., Ayhan, B., Kwan, C., and Kidd, R. Does multispectral\/hyperspectral pansharpening improve the performance of anomaly detection? In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA, 23\u201328 July 2017, pp.","DOI":"10.1109\/IGARSS.2017.8128408"},{"key":"ref_25","first-page":"295","article-title":"Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic","volume":"57","author":"Chavez","year":"1991","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpening algorithms","volume":"53","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing filter based intensity modulation: A spectral preserve image fusion technique for improving spatial details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF-tailored multiscale fusion of high-resolution MS and pan imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/LGRS.2013.2281996","article-title":"Contrast and error-based fusion schemes for multispectral image pansharpening","volume":"11","author":"Vivone","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_30","unstructured":"Laben, C., and Brower, B. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. (6,011,875), U.S. Patent."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving component substitution pansharpening through multivariate regression of MS+pan data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2984","DOI":"10.1109\/JSTARS.2015.2420582","article-title":"Processing of multiresolution thermal hyperspectral and digital color data: Outcome of the 2014 IEEE GRSS data fusion contest","volume":"8","author":"Liao","year":"2015","journal-title":"IEEE J. Select. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2984","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A new adaptive component-substitution based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","unstructured":"(2018, December 22). Hybrid Color Mapping (HCM) Codes. Available online: https:\/\/openremotesensing.net\/knowledgebase\/hyperspectral-image-superresolution-a-hybrid-color-mapping-approach\/."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1145\/2980179.2982399","article-title":"Deep joint demosaicking and denoising","volume":"35","author":"Gharbi","year":"2016","journal-title":"Acm. Trans. Graph."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Oh, L.S., and Kang, M.G. (2017). Colorization-based rgb-white color interpolation using color filter array with randomly sampled pattern. Sensors, 17.","DOI":"10.3390\/s17071523"},{"key":"ref_37","first-page":"61","article-title":"A spatial extension of cielab for digital color image reproduction","volume":"5","author":"Zhang","year":"1997","journal-title":"SID J."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/5\/8\/68\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:12:22Z","timestamp":1760188342000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/5\/8\/68"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,1]]},"references-count":37,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["jimaging5080068"],"URL":"https:\/\/doi.org\/10.3390\/jimaging5080068","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,1]]}}}